Sun Feb 22 01:11:14 UTC 2026
dataset: mnist
project: example-get-started

DVC Plot

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     83.2192 (3.69)     83.2192 (3.69)     83.2192 (3.69)     0.0000 (1.0)      83.2192 (3.69)     0.0000 (1.0)           0;0  0.0120 (0.27)          1           1
test_add_copy-add[3.10.0]     85.2804 (3.79)     85.2804 (3.79)     85.2804 (3.79)     0.0000 (1.0)      85.2804 (3.79)     0.0000 (1.0)           0;0  0.0117 (0.26)          1           1
test_add_copy-add[3.53.2]     75.7604 (3.36)     75.7604 (3.36)     75.7604 (3.36)     0.0000 (1.0)      75.7604 (3.36)     0.0000 (1.0)           0;0  0.0132 (0.30)          1           1
test_add_copy-add[3.60.1]     22.5244 (1.0)      22.5244 (1.0)      22.5244 (1.0)      0.0000 (1.0)      22.5244 (1.0)      0.0000 (1.0)           0;0  0.0444 (1.0)           1           1
test_add_copy-add[main]       23.2446 (1.03)     23.2446 (1.03)     23.2446 (1.03)     0.0000 (1.0)      23.2446 (1.03)     0.0000 (1.0)           0;0  0.0430 (0.97)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     27.5612 (6.73)     27.5612 (6.73)     27.5612 (6.73)     0.0000 (1.0)      27.5612 (6.73)     0.0000 (1.0)           0;0  0.0363 (0.15)          1           1
test_add_copy-add-noop[3.10.0]     27.8991 (6.81)     27.8991 (6.81)     27.8991 (6.81)     0.0000 (1.0)      27.8991 (6.81)     0.0000 (1.0)           0;0  0.0358 (0.15)          1           1
test_add_copy-add-noop[3.53.2]     26.4666 (6.46)     26.4666 (6.46)     26.4666 (6.46)     0.0000 (1.0)      26.4666 (6.46)     0.0000 (1.0)           0;0  0.0378 (0.15)          1           1
test_add_copy-add-noop[3.60.1]      4.0962 (1.0)       4.0962 (1.0)       4.0962 (1.0)      0.0000 (1.0)       4.0962 (1.0)      0.0000 (1.0)           0;0  0.2441 (1.0)           1           1
test_add_copy-add-noop[main]        4.3014 (1.05)      4.3014 (1.05)      4.3014 (1.05)     0.0000 (1.0)       4.3014 (1.05)     0.0000 (1.0)           0;0  0.2325 (0.95)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     45.3713 (3.96)     45.3713 (3.96)     45.3713 (3.96)     0.0000 (1.0)      45.3713 (3.96)     0.0000 (1.0)           0;0  0.0220 (0.25)          1           1
test_add_hardlink-add[3.10.0]     45.1315 (3.94)     45.1315 (3.94)     45.1315 (3.94)     0.0000 (1.0)      45.1315 (3.94)     0.0000 (1.0)           0;0  0.0222 (0.25)          1           1
test_add_hardlink-add[3.53.2]     41.6228 (3.64)     41.6228 (3.64)     41.6228 (3.64)     0.0000 (1.0)      41.6228 (3.64)     0.0000 (1.0)           0;0  0.0240 (0.28)          1           1
test_add_hardlink-add[3.60.1]     11.4489 (1.0)      11.4489 (1.0)      11.4489 (1.0)      0.0000 (1.0)      11.4489 (1.0)      0.0000 (1.0)           0;0  0.0873 (1.0)           1           1
test_add_hardlink-add[main]       12.6360 (1.10)     12.6360 (1.10)     12.6360 (1.10)     0.0000 (1.0)      12.6360 (1.10)     0.0000 (1.0)           0;0  0.0791 (0.91)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     22.6599 (6.13)     22.6599 (6.13)     22.6599 (6.13)     0.0000 (1.0)      22.6599 (6.13)     0.0000 (1.0)           0;0  0.0441 (0.16)          1           1
test_add_hardlink-add-noop[3.10.0]     22.9847 (6.22)     22.9847 (6.22)     22.9847 (6.22)     0.0000 (1.0)      22.9847 (6.22)     0.0000 (1.0)           0;0  0.0435 (0.16)          1           1
test_add_hardlink-add-noop[3.53.2]     21.7278 (5.88)     21.7278 (5.88)     21.7278 (5.88)     0.0000 (1.0)      21.7278 (5.88)     0.0000 (1.0)           0;0  0.0460 (0.17)          1           1
test_add_hardlink-add-noop[3.60.1]      3.6960 (1.0)       3.6960 (1.0)       3.6960 (1.0)      0.0000 (1.0)       3.6960 (1.0)      0.0000 (1.0)           0;0  0.2706 (1.0)           1           1
test_add_hardlink-add-noop[main]        3.9207 (1.06)      3.9207 (1.06)      3.9207 (1.06)     0.0000 (1.0)       3.9207 (1.06)     0.0000 (1.0)           0;0  0.2551 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     66.9966 (1.91)     66.9966 (1.91)     66.9966 (1.91)     0.0000 (1.0)      66.9966 (1.91)     0.0000 (1.0)           0;0  0.0149 (0.52)          1           1
test_add_symlink-add[3.10.0]     66.6960 (1.90)     66.6960 (1.90)     66.6960 (1.90)     0.0000 (1.0)      66.6960 (1.90)     0.0000 (1.0)           0;0  0.0150 (0.53)          1           1
test_add_symlink-add[3.53.2]     61.9621 (1.77)     61.9621 (1.77)     61.9621 (1.77)     0.0000 (1.0)      61.9621 (1.77)     0.0000 (1.0)           0;0  0.0161 (0.57)          1           1
test_add_symlink-add[3.60.1]     35.0887 (1.0)      35.0887 (1.0)      35.0887 (1.0)      0.0000 (1.0)      35.0887 (1.0)      0.0000 (1.0)           0;0  0.0285 (1.0)           1           1
test_add_symlink-add[main]       37.7892 (1.08)     37.7892 (1.08)     37.7892 (1.08)     0.0000 (1.0)      37.7892 (1.08)     0.0000 (1.0)           0;0  0.0265 (0.93)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     44.3744 (8.18)     44.3744 (8.18)     44.3744 (8.18)     0.0000 (1.0)      44.3744 (8.18)     0.0000 (1.0)           0;0  0.0225 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     44.9444 (8.29)     44.9444 (8.29)     44.9444 (8.29)     0.0000 (1.0)      44.9444 (8.29)     0.0000 (1.0)           0;0  0.0222 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     43.6079 (8.04)     43.6079 (8.04)     43.6079 (8.04)     0.0000 (1.0)      43.6079 (8.04)     0.0000 (1.0)           0;0  0.0229 (0.12)          1           1
test_add_symlink-add-noop[3.60.1]      5.4244 (1.0)       5.4244 (1.0)       5.4244 (1.0)      0.0000 (1.0)       5.4244 (1.0)      0.0000 (1.0)           0;0  0.1844 (1.0)           1           1
test_add_symlink-add-noop[main]        5.9008 (1.09)      5.9008 (1.09)      5.9008 (1.09)     0.0000 (1.0)       5.9008 (1.09)     0.0000 (1.0)           0;0  0.1695 (0.92)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     39.3448 (1.91)     39.3448 (1.91)     39.3448 (1.91)     0.0000 (1.0)      39.3448 (1.91)     0.0000 (1.0)           0;0  0.0254 (0.52)          1           1
test_checkout_copy-checkout[3.10.0]     98.3941 (4.77)     98.3941 (4.77)     98.3941 (4.77)     0.0000 (1.0)      98.3941 (4.77)     0.0000 (1.0)           0;0  0.0102 (0.21)          1           1
test_checkout_copy-checkout[3.53.2]     28.2372 (1.37)     28.2372 (1.37)     28.2372 (1.37)     0.0000 (1.0)      28.2372 (1.37)     0.0000 (1.0)           0;0  0.0354 (0.73)          1           1
test_checkout_copy-checkout[3.60.1]     20.6391 (1.0)      20.6391 (1.0)      20.6391 (1.0)      0.0000 (1.0)      20.6391 (1.0)      0.0000 (1.0)           0;0  0.0485 (1.0)           1           1
test_checkout_copy-checkout[main]       21.7094 (1.05)     21.7094 (1.05)     21.7094 (1.05)     0.0000 (1.0)      21.7094 (1.05)     0.0000 (1.0)           0;0  0.0461 (0.95)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.4584 (1.68)     5.4584 (1.68)     5.4584 (1.68)     0.0000 (1.0)      5.4584 (1.68)     0.0000 (1.0)           0;0  0.1832 (0.59)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.6928 (1.75)     5.6928 (1.75)     5.6928 (1.75)     0.0000 (1.0)      5.6928 (1.75)     0.0000 (1.0)           0;0  0.1757 (0.57)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.5128 (1.70)     5.5128 (1.70)     5.5128 (1.70)     0.0000 (1.0)      5.5128 (1.70)     0.0000 (1.0)           0;0  0.1814 (0.59)          1           1
test_checkout_copy-checkout-noop[3.60.1]     3.2458 (1.0)      3.2458 (1.0)      3.2458 (1.0)      0.0000 (1.0)      3.2458 (1.0)      0.0000 (1.0)           0;0  0.3081 (1.0)           1           1
test_checkout_copy-checkout-noop[main]       3.3629 (1.04)     3.3629 (1.04)     3.3629 (1.04)     0.0000 (1.0)      3.3629 (1.04)     0.0000 (1.0)           0;0  0.2974 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     7.4766 (1.94)     7.4766 (1.94)     7.4766 (1.94)     0.0000 (1.0)      7.4766 (1.94)     0.0000 (1.0)           0;0  0.1338 (0.52)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.4139 (1.67)     6.4139 (1.67)     6.4139 (1.67)     0.0000 (1.0)      6.4139 (1.67)     0.0000 (1.0)           0;0  0.1559 (0.60)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.2295 (1.62)     6.2295 (1.62)     6.2295 (1.62)     0.0000 (1.0)      6.2295 (1.62)     0.0000 (1.0)           0;0  0.1605 (0.62)          1           1
test_checkout_copy-checkout-update[3.60.1]     3.8513 (1.0)      3.8513 (1.0)      3.8513 (1.0)      0.0000 (1.0)      3.8513 (1.0)      0.0000 (1.0)           0;0  0.2597 (1.0)           1           1
test_checkout_copy-checkout-update[main]       4.3302 (1.12)     4.3302 (1.12)     4.3302 (1.12)     0.0000 (1.0)      4.3302 (1.12)     0.0000 (1.0)           0;0  0.2309 (0.89)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     21.1680 (2.78)     21.1680 (2.78)     21.1680 (2.78)     0.0000 (1.0)      21.1680 (2.78)     0.0000 (1.0)           0;0  0.0472 (0.36)          1           1
test_checkout_hardlink-checkout[3.10.0]     16.4791 (2.17)     16.4791 (2.17)     16.4791 (2.17)     0.0000 (1.0)      16.4791 (2.17)     0.0000 (1.0)           0;0  0.0607 (0.46)          1           1
test_checkout_hardlink-checkout[3.53.2]     14.4588 (1.90)     14.4588 (1.90)     14.4588 (1.90)     0.0000 (1.0)      14.4588 (1.90)     0.0000 (1.0)           0;0  0.0692 (0.53)          1           1
test_checkout_hardlink-checkout[3.60.1]      7.6107 (1.0)       7.6107 (1.0)       7.6107 (1.0)      0.0000 (1.0)       7.6107 (1.0)      0.0000 (1.0)           0;0  0.1314 (1.0)           1           1
test_checkout_hardlink-checkout[main]        8.3353 (1.10)      8.3353 (1.10)      8.3353 (1.10)     0.0000 (1.0)       8.3353 (1.10)     0.0000 (1.0)           0;0  0.1200 (0.91)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.6741 (1.69)     5.6741 (1.69)     5.6741 (1.69)     0.0000 (1.0)      5.6741 (1.69)     0.0000 (1.0)           0;0  0.1762 (0.59)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.9786 (1.78)     5.9786 (1.78)     5.9786 (1.78)     0.0000 (1.0)      5.9786 (1.78)     0.0000 (1.0)           0;0  0.1673 (0.56)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.6978 (1.70)     5.6978 (1.70)     5.6978 (1.70)     0.0000 (1.0)      5.6978 (1.70)     0.0000 (1.0)           0;0  0.1755 (0.59)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.3598 (1.0)      3.3598 (1.0)      3.3598 (1.0)      0.0000 (1.0)      3.3598 (1.0)      0.0000 (1.0)           0;0  0.2976 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]       3.5763 (1.06)     3.5763 (1.06)     3.5763 (1.06)     0.0000 (1.0)      3.5763 (1.06)     0.0000 (1.0)           0;0  0.2796 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     7.9073 (1.97)     7.9073 (1.97)     7.9073 (1.97)     0.0000 (1.0)      7.9073 (1.97)     0.0000 (1.0)           0;0  0.1265 (0.51)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.7265 (1.67)     6.7265 (1.67)     6.7265 (1.67)     0.0000 (1.0)      6.7265 (1.67)     0.0000 (1.0)           0;0  0.1487 (0.60)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.6339 (1.65)     6.6339 (1.65)     6.6339 (1.65)     0.0000 (1.0)      6.6339 (1.65)     0.0000 (1.0)           0;0  0.1507 (0.61)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     4.0201 (1.0)      4.0201 (1.0)      4.0201 (1.0)      0.0000 (1.0)      4.0201 (1.0)      0.0000 (1.0)           0;0  0.2487 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       4.3408 (1.08)     4.3408 (1.08)     4.3408 (1.08)     0.0000 (1.0)      4.3408 (1.08)     0.0000 (1.0)           0;0  0.2304 (0.93)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     19.4475 (2.37)     19.4475 (2.37)     19.4475 (2.37)     0.0000 (1.0)      19.4475 (2.37)     0.0000 (1.0)           0;0  0.0514 (0.42)          1           1
test_checkout_symlink-checkout[3.10.0]     14.6665 (1.79)     14.6665 (1.79)     14.6665 (1.79)     0.0000 (1.0)      14.6665 (1.79)     0.0000 (1.0)           0;0  0.0682 (0.56)          1           1
test_checkout_symlink-checkout[3.53.2]     13.5584 (1.65)     13.5584 (1.65)     13.5584 (1.65)     0.0000 (1.0)      13.5584 (1.65)     0.0000 (1.0)           0;0  0.0738 (0.60)          1           1
test_checkout_symlink-checkout[3.60.1]      8.2026 (1.0)       8.2026 (1.0)       8.2026 (1.0)      0.0000 (1.0)       8.2026 (1.0)      0.0000 (1.0)           0;0  0.1219 (1.0)           1           1
test_checkout_symlink-checkout[main]        8.3260 (1.02)      8.3260 (1.02)      8.3260 (1.02)     0.0000 (1.0)       8.3260 (1.02)     0.0000 (1.0)           0;0  0.1201 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     4.8100 (1.31)     4.8100 (1.31)     4.8100 (1.31)     0.0000 (1.0)      4.8100 (1.31)     0.0000 (1.0)           0;0  0.2079 (0.76)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     5.1871 (1.42)     5.1871 (1.42)     5.1871 (1.42)     0.0000 (1.0)      5.1871 (1.42)     0.0000 (1.0)           0;0  0.1928 (0.71)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     5.0191 (1.37)     5.0191 (1.37)     5.0191 (1.37)     0.0000 (1.0)      5.0191 (1.37)     0.0000 (1.0)           0;0  0.1992 (0.73)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     3.6591 (1.0)      3.6591 (1.0)      3.6591 (1.0)      0.0000 (1.0)      3.6591 (1.0)      0.0000 (1.0)           0;0  0.2733 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]       3.8429 (1.05)     3.8429 (1.05)     3.8429 (1.05)     0.0000 (1.0)      3.8429 (1.05)     0.0000 (1.0)           0;0  0.2602 (0.95)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     7.3007 (1.52)     7.3007 (1.52)     7.3007 (1.52)     0.0000 (1.0)      7.3007 (1.52)     0.0000 (1.0)           0;0  0.1370 (0.66)          1           1
test_checkout_symlink-checkout-update[3.10.0]     6.3244 (1.32)     6.3244 (1.32)     6.3244 (1.32)     0.0000 (1.0)      6.3244 (1.32)     0.0000 (1.0)           0;0  0.1581 (0.76)          1           1
test_checkout_symlink-checkout-update[3.53.2]     6.2277 (1.30)     6.2277 (1.30)     6.2277 (1.30)     0.0000 (1.0)      6.2277 (1.30)     0.0000 (1.0)           0;0  0.1606 (0.77)          1           1
test_checkout_symlink-checkout-update[3.60.1]     4.8018 (1.0)      4.8018 (1.0)      4.8018 (1.0)      0.0000 (1.0)      4.8018 (1.0)      0.0000 (1.0)           0;0  0.2083 (1.0)           1           1
test_checkout_symlink-checkout-update[main]       5.1716 (1.08)     5.1716 (1.08)     5.1716 (1.08)     0.0000 (1.0)      5.1716 (1.08)     0.0000 (1.0)           0;0  0.1934 (0.93)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.1317 (1.67)     4.1317 (1.67)     4.1317 (1.67)     0.0000 (1.0)      4.1317 (1.67)     0.0000 (1.0)           0;0  0.2420 (0.60)          1           1
test_data_status-data-changed[3.10.0]     4.8862 (1.97)     4.8862 (1.97)     4.8862 (1.97)     0.0000 (1.0)      4.8862 (1.97)     0.0000 (1.0)           0;0  0.2047 (0.51)          1           1
test_data_status-data-changed[3.53.2]     4.9102 (1.98)     4.9102 (1.98)     4.9102 (1.98)     0.0000 (1.0)      4.9102 (1.98)     0.0000 (1.0)           0;0  0.2037 (0.50)          1           1
test_data_status-data-changed[3.60.1]     2.4749 (1.0)      2.4749 (1.0)      2.4749 (1.0)      0.0000 (1.0)      2.4749 (1.0)      0.0000 (1.0)           0;0  0.4041 (1.0)           1           1
test_data_status-data-changed[main]       2.7437 (1.11)     2.7437 (1.11)     2.7437 (1.11)     0.0000 (1.0)      2.7437 (1.11)     0.0000 (1.0)           0;0  0.3645 (0.90)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.2933 (1.73)     4.2933 (1.73)     4.2933 (1.73)     0.0000 (1.0)      4.2933 (1.73)     0.0000 (1.0)           0;0  0.2329 (0.58)          1           1
test_data_status-data-changed-noop[3.10.0]     5.1399 (2.07)     5.1399 (2.07)     5.1399 (2.07)     0.0000 (1.0)      5.1399 (2.07)     0.0000 (1.0)           0;0  0.1946 (0.48)          1           1
test_data_status-data-changed-noop[3.53.2]     4.9712 (2.00)     4.9712 (2.00)     4.9712 (2.00)     0.0000 (1.0)      4.9712 (2.00)     0.0000 (1.0)           0;0  0.2012 (0.50)          1           1
test_data_status-data-changed-noop[3.60.1]     2.4811 (1.0)      2.4811 (1.0)      2.4811 (1.0)      0.0000 (1.0)      2.4811 (1.0)      0.0000 (1.0)           0;0  0.4030 (1.0)           1           1
test_data_status-data-changed-noop[main]       2.7580 (1.11)     2.7580 (1.11)     2.7580 (1.11)     0.0000 (1.0)      2.7580 (1.11)     0.0000 (1.0)           0;0  0.3626 (0.90)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     18.3193 (3.55)     18.3193 (3.55)     18.3193 (3.55)     0.0000 (1.0)      18.3193 (3.55)     0.0000 (1.0)           0;0  0.0546 (0.28)          1           1
test_data_status-data-new[3.10.0]     19.6298 (3.81)     19.6298 (3.81)     19.6298 (3.81)     0.0000 (1.0)      19.6298 (3.81)     0.0000 (1.0)           0;0  0.0509 (0.26)          1           1
test_data_status-data-new[3.53.2]     19.3827 (3.76)     19.3827 (3.76)     19.3827 (3.76)     0.0000 (1.0)      19.3827 (3.76)     0.0000 (1.0)           0;0  0.0516 (0.27)          1           1
test_data_status-data-new[3.60.1]      5.1587 (1.0)       5.1587 (1.0)       5.1587 (1.0)      0.0000 (1.0)       5.1587 (1.0)      0.0000 (1.0)           0;0  0.1938 (1.0)           1           1
test_data_status-data-new[main]        5.5722 (1.08)      5.5722 (1.08)      5.5722 (1.08)     0.0000 (1.0)       5.5722 (1.08)     0.0000 (1.0)           0;0  0.1795 (0.93)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.1882 (1.70)     4.1882 (1.70)     4.1882 (1.70)     0.0000 (1.0)      4.1882 (1.70)     0.0000 (1.0)           0;0  0.2388 (0.59)          1           1
test_data_status-data-noop[3.10.0]     5.1719 (2.10)     5.1719 (2.10)     5.1719 (2.10)     0.0000 (1.0)      5.1719 (2.10)     0.0000 (1.0)           0;0  0.1934 (0.48)          1           1
test_data_status-data-noop[3.53.2]     5.2349 (2.13)     5.2349 (2.13)     5.2349 (2.13)     0.0000 (1.0)      5.2349 (2.13)     0.0000 (1.0)           0;0  0.1910 (0.47)          1           1
test_data_status-data-noop[3.60.1]     2.4620 (1.0)      2.4620 (1.0)      2.4620 (1.0)      0.0000 (1.0)      2.4620 (1.0)      0.0000 (1.0)           0;0  0.4062 (1.0)           1           1
test_data_status-data-noop[main]       2.7634 (1.12)     2.7634 (1.12)     2.7634 (1.12)     0.0000 (1.0)      2.7634 (1.12)     0.0000 (1.0)           0;0  0.3619 (0.89)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     6.6488 (1.27)     6.6488 (1.27)     6.6488 (1.27)     0.0000 (1.0)      6.6488 (1.27)     0.0000 (1.0)           0;0  0.1504 (0.79)          1           1
test_data_status_all_flags-data-changed[3.10.0]     7.6404 (1.46)     7.6404 (1.46)     7.6404 (1.46)     0.0000 (1.0)      7.6404 (1.46)     0.0000 (1.0)           0;0  0.1309 (0.69)          1           1
test_data_status_all_flags-data-changed[3.53.2]     7.6539 (1.46)     7.6539 (1.46)     7.6539 (1.46)     0.0000 (1.0)      7.6539 (1.46)     0.0000 (1.0)           0;0  0.1307 (0.68)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.2381 (1.0)      5.2381 (1.0)      5.2381 (1.0)      0.0000 (1.0)      5.2381 (1.0)      0.0000 (1.0)           0;0  0.1909 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       5.6434 (1.08)     5.6434 (1.08)     5.6434 (1.08)     0.0000 (1.0)      5.6434 (1.08)     0.0000 (1.0)           0;0  0.1772 (0.93)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     6.7401 (1.28)     6.7401 (1.28)     6.7401 (1.28)     0.0000 (1.0)      6.7401 (1.28)     0.0000 (1.0)           0;0  0.1484 (0.78)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     7.6293 (1.45)     7.6293 (1.45)     7.6293 (1.45)     0.0000 (1.0)      7.6293 (1.45)     0.0000 (1.0)           0;0  0.1311 (0.69)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     7.6813 (1.46)     7.6813 (1.46)     7.6813 (1.46)     0.0000 (1.0)      7.6813 (1.46)     0.0000 (1.0)           0;0  0.1302 (0.69)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     5.2746 (1.0)      5.2746 (1.0)      5.2746 (1.0)      0.0000 (1.0)      5.2746 (1.0)      0.0000 (1.0)           0;0  0.1896 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       5.5501 (1.05)     5.5501 (1.05)     5.5501 (1.05)     0.0000 (1.0)      5.5501 (1.05)     0.0000 (1.0)           0;0  0.1802 (0.95)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     20.6395 (2.67)     20.6395 (2.67)     20.6395 (2.67)     0.0000 (1.0)      20.6395 (2.67)     0.0000 (1.0)           0;0  0.0485 (0.37)          1           1
test_data_status_all_flags-data-new[3.10.0]     22.1824 (2.87)     22.1824 (2.87)     22.1824 (2.87)     0.0000 (1.0)      22.1824 (2.87)     0.0000 (1.0)           0;0  0.0451 (0.35)          1           1
test_data_status_all_flags-data-new[3.53.2]     21.8518 (2.83)     21.8518 (2.83)     21.8518 (2.83)     0.0000 (1.0)      21.8518 (2.83)     0.0000 (1.0)           0;0  0.0458 (0.35)          1           1
test_data_status_all_flags-data-new[3.60.1]      7.7291 (1.0)       7.7291 (1.0)       7.7291 (1.0)      0.0000 (1.0)       7.7291 (1.0)      0.0000 (1.0)           0;0  0.1294 (1.0)           1           1
test_data_status_all_flags-data-new[main]        8.2772 (1.07)      8.2772 (1.07)      8.2772 (1.07)     0.0000 (1.0)       8.2772 (1.07)     0.0000 (1.0)           0;0  0.1208 (0.93)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     6.1913 (1.34)     6.1913 (1.34)     6.1913 (1.34)     0.0000 (1.0)      6.1913 (1.34)     0.0000 (1.0)           0;0  0.1615 (0.75)          1           1
test_data_status_all_flags-data-noop[3.10.0]     7.2244 (1.56)     7.2244 (1.56)     7.2244 (1.56)     0.0000 (1.0)      7.2244 (1.56)     0.0000 (1.0)           0;0  0.1384 (0.64)          1           1
test_data_status_all_flags-data-noop[3.53.2]     7.0065 (1.51)     7.0065 (1.51)     7.0065 (1.51)     0.0000 (1.0)      7.0065 (1.51)     0.0000 (1.0)           0;0  0.1427 (0.66)          1           1
test_data_status_all_flags-data-noop[3.60.1]     4.6299 (1.0)      4.6299 (1.0)      4.6299 (1.0)      0.0000 (1.0)      4.6299 (1.0)      0.0000 (1.0)           0;0  0.2160 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       5.0353 (1.09)     5.0353 (1.09)     5.0353 (1.09)     0.0000 (1.0)      5.0353 (1.09)     0.0000 (1.0)           0;0  0.1986 (0.92)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     17.7490 (2.61)     17.7490 (2.61)     17.7490 (2.61)     0.0000 (1.0)      17.7490 (2.61)     0.0000 (1.0)           0;0  0.0563 (0.38)          1           1
test_diff-diff[3.10.0]     19.5199 (2.87)     19.5199 (2.87)     19.5199 (2.87)     0.0000 (1.0)      19.5199 (2.87)     0.0000 (1.0)           0;0  0.0512 (0.35)          1           1
test_diff-diff[3.53.2]     19.2025 (2.83)     19.2025 (2.83)     19.2025 (2.83)     0.0000 (1.0)      19.2025 (2.83)     0.0000 (1.0)           0;0  0.0521 (0.35)          1           1
test_diff-diff[3.60.1]      6.7935 (1.0)       6.7935 (1.0)       6.7935 (1.0)      0.0000 (1.0)       6.7935 (1.0)      0.0000 (1.0)           0;0  0.1472 (1.0)           1           1
test_diff-diff[main]        7.8707 (1.16)      7.8707 (1.16)      7.8707 (1.16)     0.0000 (1.0)       7.8707 (1.16)     0.0000 (1.0)           0;0  0.1271 (0.86)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     6.1574 (1.83)     6.1574 (1.83)     6.1574 (1.83)     0.0000 (1.0)      6.1574 (1.83)     0.0000 (1.0)           0;0  0.1624 (0.55)          1           1
test_diff-diff-changed[3.10.0]     6.6345 (1.97)     6.6345 (1.97)     6.6345 (1.97)     0.0000 (1.0)      6.6345 (1.97)     0.0000 (1.0)           0;0  0.1507 (0.51)          1           1
test_diff-diff-changed[3.53.2]     5.6226 (1.67)     5.6226 (1.67)     5.6226 (1.67)     0.0000 (1.0)      5.6226 (1.67)     0.0000 (1.0)           0;0  0.1779 (0.60)          1           1
test_diff-diff-changed[3.60.1]     3.3650 (1.0)      3.3650 (1.0)      3.3650 (1.0)      0.0000 (1.0)      3.3650 (1.0)      0.0000 (1.0)           0;0  0.2972 (1.0)           1           1
test_diff-diff-changed[main]       4.1548 (1.23)     4.1548 (1.23)     4.1548 (1.23)     0.0000 (1.0)      4.1548 (1.23)     0.0000 (1.0)           0;0  0.2407 (0.81)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.0575 (1.50)     5.0575 (1.50)     5.0575 (1.50)     0.0000 (1.0)      5.0575 (1.50)     0.0000 (1.0)           0;0  0.1977 (0.67)          1           1
test_diff-diff-changed-noop[3.10.0]     5.7388 (1.70)     5.7388 (1.70)     5.7388 (1.70)     0.0000 (1.0)      5.7388 (1.70)     0.0000 (1.0)           0;0  0.1743 (0.59)          1           1
test_diff-diff-changed-noop[3.53.2]     5.5255 (1.64)     5.5255 (1.64)     5.5255 (1.64)     0.0000 (1.0)      5.5255 (1.64)     0.0000 (1.0)           0;0  0.1810 (0.61)          1           1
test_diff-diff-changed-noop[3.60.1]     3.3696 (1.0)      3.3696 (1.0)      3.3696 (1.0)      0.0000 (1.0)      3.3696 (1.0)      0.0000 (1.0)           0;0  0.2968 (1.0)           1           1
test_diff-diff-changed-noop[main]       4.2233 (1.25)     4.2233 (1.25)     4.2233 (1.25)     0.0000 (1.0)      4.2233 (1.25)     0.0000 (1.0)           0;0  0.2368 (0.80)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.3532 (1.29)     4.3532 (1.29)     4.3532 (1.29)     0.0000 (1.0)      4.3532 (1.29)     0.0000 (1.0)           0;0  0.2297 (0.78)          1           1
test_diff-diff-noop[3.10.0]     4.9444 (1.46)     4.9444 (1.46)     4.9444 (1.46)     0.0000 (1.0)      4.9444 (1.46)     0.0000 (1.0)           0;0  0.2022 (0.68)          1           1
test_diff-diff-noop[3.53.2]     5.6573 (1.67)     5.6573 (1.67)     5.6573 (1.67)     0.0000 (1.0)      5.6573 (1.67)     0.0000 (1.0)           0;0  0.1768 (0.60)          1           1
test_diff-diff-noop[3.60.1]     3.3808 (1.0)      3.3808 (1.0)      3.3808 (1.0)      0.0000 (1.0)      3.3808 (1.0)      0.0000 (1.0)           0;0  0.2958 (1.0)           1           1
test_diff-diff-noop[main]       4.1993 (1.24)     4.1993 (1.24)     4.1993 (1.24)     0.0000 (1.0)      4.1993 (1.24)     0.0000 (1.0)           0;0  0.2381 (0.81)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

-------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]      1.2039 (1.0)       1.2039 (1.0)       1.2039 (1.0)      0.0000 (1.0)       1.2039 (1.0)      0.0000 (1.0)           0;0  0.8307 (1.0)           1           1
test_exp_show-exp[3.10.0]     12.1273 (10.07)    12.1273 (10.07)    12.1273 (10.07)    0.0000 (1.0)      12.1273 (10.07)    0.0000 (1.0)           0;0  0.0825 (0.10)          1           1
test_exp_show-exp[3.53.2]      6.6569 (5.53)      6.6569 (5.53)      6.6569 (5.53)     0.0000 (1.0)       6.6569 (5.53)     0.0000 (1.0)           0;0  0.1502 (0.18)          1           1
test_exp_show-exp[3.60.1]      6.8392 (5.68)      6.8392 (5.68)      6.8392 (5.68)     0.0000 (1.0)       6.8392 (5.68)     0.0000 (1.0)           0;0  0.1462 (0.18)          1           1
test_exp_show-exp[main]       13.1058 (10.89)    13.1058 (10.89)    13.1058 (10.89)    0.0000 (1.0)      13.1058 (10.89)    0.0000 (1.0)           0;0  0.0763 (0.09)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

---------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests ----------------------------------------------------------------------------
Name (time in s)                  Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     108.4783 (4.71)     108.4783 (4.71)     108.4783 (4.71)     0.0000 (1.0)      108.4783 (4.71)     0.0000 (1.0)           0;0  0.0092 (0.21)          1           1
test_fetch-fetch[3.10.0]     114.3474 (4.96)     114.3474 (4.96)     114.3474 (4.96)     0.0000 (1.0)      114.3474 (4.96)     0.0000 (1.0)           0;0  0.0087 (0.20)          1           1
test_fetch-fetch[3.53.2]      33.2998 (1.44)      33.2998 (1.44)      33.2998 (1.44)     0.0000 (1.0)       33.2998 (1.44)     0.0000 (1.0)           0;0  0.0300 (0.69)          1           1
test_fetch-fetch[3.60.1]      23.4220 (1.02)      23.4220 (1.02)      23.4220 (1.02)     0.0000 (1.0)       23.4220 (1.02)     0.0000 (1.0)           0;0  0.0427 (0.98)          1           1
test_fetch-fetch[main]        23.0474 (1.0)       23.0474 (1.0)       23.0474 (1.0)      0.0000 (1.0)       23.0474 (1.0)      0.0000 (1.0)           0;0  0.0434 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.9220 (1.0)      2.9220 (1.0)      2.9220 (1.0)      0.0000 (1.0)      2.9220 (1.0)      0.0000 (1.0)           0;0  0.3422 (1.0)           1           1
test_gc-gc[3.10.0]     3.2574 (1.11)     3.2574 (1.11)     3.2574 (1.11)     0.0000 (1.0)      3.2574 (1.11)     0.0000 (1.0)           0;0  0.3070 (0.90)          1           1
test_gc-gc[3.53.2]     3.0183 (1.03)     3.0183 (1.03)     3.0183 (1.03)     0.0000 (1.0)      3.0183 (1.03)     0.0000 (1.0)           0;0  0.3313 (0.97)          1           1
test_gc-gc[3.60.1]     3.0744 (1.05)     3.0744 (1.05)     3.0744 (1.05)     0.0000 (1.0)      3.0744 (1.05)     0.0000 (1.0)           0;0  0.3253 (0.95)          1           1
test_gc-gc[main]       2.9499 (1.01)     2.9499 (1.01)     2.9499 (1.01)     0.0000 (1.0)      2.9499 (1.01)     0.0000 (1.0)           0;0  0.3390 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     175.9124 (3.42)     175.9124 (3.42)     175.9124 (3.42)     0.0000 (1.0)      175.9124 (3.42)     0.0000 (1.0)           0;0  0.0057 (0.29)          1           1
test_get-get[3.10.0]     209.4124 (4.08)     209.4124 (4.08)     209.4124 (4.08)     0.0000 (1.0)      209.4124 (4.08)     0.0000 (1.0)           0;0  0.0048 (0.25)          1           1
test_get-get[3.53.2]     152.9300 (2.98)     152.9300 (2.98)     152.9300 (2.98)     0.0000 (1.0)      152.9300 (2.98)     0.0000 (1.0)           0;0  0.0065 (0.34)          1           1
test_get-get[3.60.1]      51.5008 (1.00)      51.5008 (1.00)      51.5008 (1.00)     0.0000 (1.0)       51.5008 (1.00)     0.0000 (1.0)           0;0  0.0194 (1.00)          1           1
test_get-get[main]        51.3817 (1.0)       51.3817 (1.0)       51.3817 (1.0)      0.0000 (1.0)       51.3817 (1.0)      0.0000 (1.0)           0;0  0.0195 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     87.6001 (5.24)     87.6001 (5.24)     87.6001 (5.24)     0.0000 (1.0)      87.6001 (5.24)     0.0000 (1.0)           0;0  0.0114 (0.19)          1           1
test_get_url-get-url[3.10.0]     89.9930 (5.38)     89.9930 (5.38)     89.9930 (5.38)     0.0000 (1.0)      89.9930 (5.38)     0.0000 (1.0)           0;0  0.0111 (0.19)          1           1
test_get_url-get-url[3.53.2]     16.7157 (1.0)      16.7157 (1.0)      16.7157 (1.0)      0.0000 (1.0)      16.7157 (1.0)      0.0000 (1.0)           0;0  0.0598 (1.0)           1           1
test_get_url-get-url[3.60.1]     16.9074 (1.01)     16.9074 (1.01)     16.9074 (1.01)     0.0000 (1.0)      16.9074 (1.01)     0.0000 (1.0)           0;0  0.0591 (0.99)          1           1
test_get_url-get-url[main]       16.8005 (1.01)     16.8005 (1.01)     16.8005 (1.01)     0.0000 (1.0)      16.8005 (1.01)     0.0000 (1.0)           0;0  0.0595 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     168.8655 (1.06)     181.5805 (1.08)     174.8352 (1.07)     2.9203 (1.32)     175.2267 (1.07)     3.8851 (1.23)         35;0  5.7197 (0.94)        100           1
test_help---help[3.10.0]     164.3145 (1.03)     213.0725 (1.26)     168.6715 (1.03)     5.0999 (2.30)     167.8067 (1.03)     3.6164 (1.15)          3;1  5.9287 (0.97)        100           1
test_help---help[3.53.2]     167.8732 (1.05)     180.6653 (1.07)     172.7126 (1.05)     2.8245 (1.27)     172.5765 (1.06)     4.2186 (1.34)         31;0  5.7900 (0.95)        100           1
test_help---help[3.60.1]     167.3221 (1.05)     209.6877 (1.24)     172.6738 (1.05)     5.5934 (2.52)     171.1851 (1.05)     4.4932 (1.43)          9;3  5.7913 (0.95)        100           1
test_help---help[main]       159.9644 (1.0)      168.8409 (1.0)      163.9012 (1.0)      2.2195 (1.0)      163.5674 (1.0)      3.1473 (1.0)          36;0  6.1012 (1.0)         100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     258.1466 (3.41)     258.1466 (3.41)     258.1466 (3.41)     0.0000 (1.0)      258.1466 (3.41)     0.0000 (1.0)           0;0  0.0039 (0.29)          1           1
test_import-import[3.10.0]     295.1267 (3.89)     295.1267 (3.89)     295.1267 (3.89)     0.0000 (1.0)      295.1267 (3.89)     0.0000 (1.0)           0;0  0.0034 (0.26)          1           1
test_import-import[3.60.1]      75.7789 (1.0)       75.7789 (1.0)       75.7789 (1.0)      0.0000 (1.0)       75.7789 (1.0)      0.0000 (1.0)           0;0  0.0132 (1.0)           1           1
test_import-import[main]        76.3481 (1.01)      76.3481 (1.01)      76.3481 (1.01)     0.0000 (1.0)       76.3481 (1.01)     0.0000 (1.0)           0;0  0.0131 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     221.6602 (4.85)     221.6602 (4.85)     221.6602 (4.85)     0.0000 (1.0)      221.6602 (4.85)     0.0000 (1.0)           0;0  0.0045 (0.21)          1           1
test_import_url-import-url[3.10.0]     197.2623 (4.32)     197.2623 (4.32)     197.2623 (4.32)     0.0000 (1.0)      197.2623 (4.32)     0.0000 (1.0)           0;0  0.0051 (0.23)          1           1
test_import_url-import-url[3.53.2]     115.5831 (2.53)     115.5831 (2.53)     115.5831 (2.53)     0.0000 (1.0)      115.5831 (2.53)     0.0000 (1.0)           0;0  0.0087 (0.40)          1           1
test_import_url-import-url[3.60.1]      45.7050 (1.0)       45.7050 (1.0)       45.7050 (1.0)      0.0000 (1.0)       45.7050 (1.0)      0.0000 (1.0)           0;0  0.0219 (1.0)           1           1
test_import_url-import-url[main]        47.0107 (1.03)      47.0107 (1.03)      47.0107 (1.03)     0.0000 (1.0)       47.0107 (1.03)     0.0000 (1.0)           0;0  0.0213 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

---------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     413.9455 (1.04)     427.1266 (1.02)     419.1343 (1.03)      2.9831 (1.0)      418.7621 (1.03)     4.1938 (1.15)         28;0  2.3859 (0.97)        100           1
test_init-init[3.10.0]     417.4229 (1.05)     440.0022 (1.05)     424.5531 (1.04)      3.4026 (1.14)     423.9334 (1.04)     3.6536 (1.0)          22;2  2.3554 (0.96)        100           1
test_init-init[3.53.2]     400.6582 (1.01)     429.0135 (1.02)     407.1791 (1.0)       4.3805 (1.47)     405.8670 (1.0)      4.5166 (1.24)         19;4  2.4559 (1.0)         100           1
test_init-init[3.60.1]     397.1379 (1.0)      418.9296 (1.0)      409.6826 (1.01)      3.5891 (1.20)     409.7522 (1.01)     4.3117 (1.18)         30;2  2.4409 (0.99)        100           1
test_init-init[main]       434.8338 (1.09)     557.4228 (1.33)     450.6534 (1.11)     14.6371 (4.91)     448.1423 (1.10)     4.3719 (1.20)         6;13  2.2190 (0.90)        100           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     675.1384 (1.07)     675.1384 (1.07)     675.1384 (1.07)     0.0000 (1.0)      675.1384 (1.07)     0.0000 (1.0)           0;0  1.4812 (0.93)          1           1
test_list-list[3.10.0]     988.3333 (1.57)     988.3333 (1.57)     988.3333 (1.57)     0.0000 (1.0)      988.3333 (1.57)     0.0000 (1.0)           0;0  1.0118 (0.64)          1           1
test_list-list[3.53.2]     657.2429 (1.04)     657.2429 (1.04)     657.2429 (1.04)     0.0000 (1.0)      657.2429 (1.04)     0.0000 (1.0)           0;0  1.5215 (0.96)          1           1
test_list-list[3.60.1]     690.3538 (1.10)     690.3538 (1.10)     690.3538 (1.10)     0.0000 (1.0)      690.3538 (1.10)     0.0000 (1.0)           0;0  1.4485 (0.91)          1           1
test_list-list[main]       630.0763 (1.0)      630.0763 (1.0)      630.0763 (1.0)      0.0000 (1.0)      630.0763 (1.0)      0.0000 (1.0)           0;0  1.5871 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     466.7886 (1.09)     466.7886 (1.09)     466.7886 (1.09)     0.0000 (1.0)      466.7886 (1.09)     0.0000 (1.0)           0;0  2.1423 (0.92)          1           1
test_list-list-dvc-only[3.10.0]     481.5268 (1.12)     481.5268 (1.12)     481.5268 (1.12)     0.0000 (1.0)      481.5268 (1.12)     0.0000 (1.0)           0;0  2.0767 (0.89)          1           1
test_list-list-dvc-only[3.53.2]     429.5384 (1.0)      429.5384 (1.0)      429.5384 (1.0)      0.0000 (1.0)      429.5384 (1.0)      0.0000 (1.0)           0;0  2.3281 (1.0)           1           1
test_list-list-dvc-only[3.60.1]     437.4862 (1.02)     437.4862 (1.02)     437.4862 (1.02)     0.0000 (1.0)      437.4862 (1.02)     0.0000 (1.0)           0;0  2.2858 (0.98)          1           1
test_list-list-dvc-only[main]       456.0790 (1.06)     456.0790 (1.06)     456.0790 (1.06)     0.0000 (1.0)      456.0790 (1.06)     0.0000 (1.0)           0;0  2.1926 (0.94)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.5970 (1.01)     2.5970 (1.01)     2.5970 (1.01)     0.0000 (1.0)      2.5970 (1.01)     0.0000 (1.0)           0;0  0.3851 (0.99)          1           1
test_list-list-recursive[3.10.0]     2.6698 (1.03)     2.6698 (1.03)     2.6698 (1.03)     0.0000 (1.0)      2.6698 (1.03)     0.0000 (1.0)           0;0  0.3746 (0.97)          1           1
test_list-list-recursive[3.53.2]     2.5833 (1.0)      2.5833 (1.0)      2.5833 (1.0)      0.0000 (1.0)      2.5833 (1.0)      0.0000 (1.0)           0;0  0.3871 (1.0)           1           1
test_list-list-recursive[3.60.1]     2.8552 (1.11)     2.8552 (1.11)     2.8552 (1.11)     0.0000 (1.0)      2.8552 (1.11)     0.0000 (1.0)           0;0  0.3502 (0.90)          1           1
test_list-list-recursive[main]       2.8774 (1.11)     2.8774 (1.11)     2.8774 (1.11)     0.0000 (1.0)      2.8774 (1.11)     0.0000 (1.0)           0;0  0.3475 (0.90)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     460.5050 (1.06)     460.5050 (1.06)     460.5050 (1.06)     0.0000 (1.0)      460.5050 (1.06)     0.0000 (1.0)           0;0  2.1715 (0.94)          1           1
test_list-list-shallow[3.10.0]     478.4446 (1.10)     478.4446 (1.10)     478.4446 (1.10)     0.0000 (1.0)      478.4446 (1.10)     0.0000 (1.0)           0;0  2.0901 (0.91)          1           1
test_list-list-shallow[3.53.2]     434.5800 (1.0)      434.5800 (1.0)      434.5800 (1.0)      0.0000 (1.0)      434.5800 (1.0)      0.0000 (1.0)           0;0  2.3011 (1.0)           1           1
test_list-list-shallow[3.60.1]     457.1281 (1.05)     457.1281 (1.05)     457.1281 (1.05)     0.0000 (1.0)      457.1281 (1.05)     0.0000 (1.0)           0;0  2.1876 (0.95)          1           1
test_list-list-shallow[main]       449.1718 (1.03)     449.1718 (1.03)     449.1718 (1.03)     0.0000 (1.0)      449.1718 (1.03)     0.0000 (1.0)           0;0  2.2263 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     71.2364 (3.64)     71.2364 (3.64)     71.2364 (3.64)     0.0000 (1.0)      71.2364 (3.64)     0.0000 (1.0)           0;0  0.0140 (0.27)          1           1
test_partial_add-add[3.10.0]     70.7336 (3.62)     70.7336 (3.62)     70.7336 (3.62)     0.0000 (1.0)      70.7336 (3.62)     0.0000 (1.0)           0;0  0.0141 (0.28)          1           1
test_partial_add-add[3.53.2]     63.7735 (3.26)     63.7735 (3.26)     63.7735 (3.26)     0.0000 (1.0)      63.7735 (3.26)     0.0000 (1.0)           0;0  0.0157 (0.31)          1           1
test_partial_add-add[3.60.1]     19.5482 (1.0)      19.5482 (1.0)      19.5482 (1.0)      0.0000 (1.0)      19.5482 (1.0)      0.0000 (1.0)           0;0  0.0512 (1.0)           1           1
test_partial_add-add[main]       20.8473 (1.07)     20.8473 (1.07)     20.8473 (1.07)     0.0000 (1.0)      20.8473 (1.07)     0.0000 (1.0)           0;0  0.0480 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     59.1668 (7.75)     59.1668 (7.75)     59.1668 (7.75)     0.0000 (1.0)      59.1668 (7.75)     0.0000 (1.0)           0;0  0.0169 (0.13)          1           1
test_partial_add-add-partial[3.10.0]     59.1949 (7.76)     59.1949 (7.76)     59.1949 (7.76)     0.0000 (1.0)      59.1949 (7.76)     0.0000 (1.0)           0;0  0.0169 (0.13)          1           1
test_partial_add-add-partial[3.53.2]     53.9461 (7.07)     53.9461 (7.07)     53.9461 (7.07)     0.0000 (1.0)      53.9461 (7.07)     0.0000 (1.0)           0;0  0.0185 (0.14)          1           1
test_partial_add-add-partial[3.60.1]      7.7803 (1.02)      7.7803 (1.02)      7.7803 (1.02)     0.0000 (1.0)       7.7803 (1.02)     0.0000 (1.0)           0;0  0.1285 (0.98)          1           1
test_partial_add-add-partial[main]        7.6305 (1.0)       7.6305 (1.0)       7.6305 (1.0)      0.0000 (1.0)       7.6305 (1.0)      0.0000 (1.0)           0;0  0.1311 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.6826 (1.0)      4.6826 (1.0)      4.6826 (1.0)      0.0000 (1.0)      4.6826 (1.0)      0.0000 (1.0)           0;0  0.2136 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     5.9962 (1.28)     5.9962 (1.28)     5.9962 (1.28)     0.0000 (1.0)      5.9962 (1.28)     0.0000 (1.0)           0;0  0.1668 (0.78)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     6.8013 (1.45)     6.8013 (1.45)     6.8013 (1.45)     0.0000 (1.0)      6.8013 (1.45)     0.0000 (1.0)           0;0  0.1470 (0.69)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     6.9233 (1.48)     6.9233 (1.48)     6.9233 (1.48)     0.0000 (1.0)      6.9233 (1.48)     0.0000 (1.0)           0;0  0.1444 (0.68)          1           1
test_partial_add-gc-cloud-noop[main]       5.9127 (1.26)     5.9127 (1.26)     5.9127 (1.26)     0.0000 (1.0)      5.9127 (1.26)     0.0000 (1.0)           0;0  0.1691 (0.79)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.5320 (1.0)      2.5320 (1.0)      2.5320 (1.0)      0.0000 (1.0)      2.5320 (1.0)      0.0000 (1.0)           0;0  0.3949 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.8767 (1.53)     3.8767 (1.53)     3.8767 (1.53)     0.0000 (1.0)      3.8767 (1.53)     0.0000 (1.0)           0;0  0.2580 (0.65)          1           1
test_partial_add-gc-noop[3.53.2]     3.7901 (1.50)     3.7901 (1.50)     3.7901 (1.50)     0.0000 (1.0)      3.7901 (1.50)     0.0000 (1.0)           0;0  0.2638 (0.67)          1           1
test_partial_add-gc-noop[3.60.1]     3.9677 (1.57)     3.9677 (1.57)     3.9677 (1.57)     0.0000 (1.0)      3.9677 (1.57)     0.0000 (1.0)           0;0  0.2520 (0.64)          1           1
test_partial_add-gc-noop[main]       2.8465 (1.12)     2.8465 (1.12)     2.8465 (1.12)     0.0000 (1.0)      2.8465 (1.12)     0.0000 (1.0)           0;0  0.3513 (0.89)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     81.8239 (4.26)     81.8239 (4.26)     81.8239 (4.26)     0.0000 (1.0)      81.8239 (4.26)     0.0000 (1.0)           0;0  0.0122 (0.23)          1           1
test_partial_add-push[3.10.0]     37.9782 (1.98)     37.9782 (1.98)     37.9782 (1.98)     0.0000 (1.0)      37.9782 (1.98)     0.0000 (1.0)           0;0  0.0263 (0.51)          1           1
test_partial_add-push[3.53.2]     20.1855 (1.05)     20.1855 (1.05)     20.1855 (1.05)     0.0000 (1.0)      20.1855 (1.05)     0.0000 (1.0)           0;0  0.0495 (0.95)          1           1
test_partial_add-push[3.60.1]     19.1953 (1.0)      19.1953 (1.0)      19.1953 (1.0)      0.0000 (1.0)      19.1953 (1.0)      0.0000 (1.0)           0;0  0.0521 (1.0)           1           1
test_partial_add-push[main]       19.5634 (1.02)     19.5634 (1.02)     19.5634 (1.02)     0.0000 (1.0)      19.5634 (1.02)     0.0000 (1.0)           0;0  0.0511 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     17.8392 (1.74)     17.8392 (1.74)     17.8392 (1.74)     0.0000 (1.0)      17.8392 (1.74)     0.0000 (1.0)           0;0  0.0561 (0.58)          1           1
test_partial_add-push-partial[3.10.0]     10.3972 (1.01)     10.3972 (1.01)     10.3972 (1.01)     0.0000 (1.0)      10.3972 (1.01)     0.0000 (1.0)           0;0  0.0962 (0.99)          1           1
test_partial_add-push-partial[3.53.2]     10.4996 (1.02)     10.4996 (1.02)     10.4996 (1.02)     0.0000 (1.0)      10.4996 (1.02)     0.0000 (1.0)           0;0  0.0952 (0.98)          1           1
test_partial_add-push-partial[3.60.1]     10.6412 (1.04)     10.6412 (1.04)     10.6412 (1.04)     0.0000 (1.0)      10.6412 (1.04)     0.0000 (1.0)           0;0  0.0940 (0.97)          1           1
test_partial_add-push-partial[main]       10.2725 (1.0)      10.2725 (1.0)      10.2725 (1.0)      0.0000 (1.0)      10.2725 (1.0)      0.0000 (1.0)           0;0  0.0973 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     83.9024 (3.73)     83.9024 (3.73)     83.9024 (3.73)     0.0000 (1.0)      83.9024 (3.73)     0.0000 (1.0)           0;0  0.0119 (0.27)          1           1
test_partial_remove-add[3.10.0]     84.0760 (3.74)     84.0760 (3.74)     84.0760 (3.74)     0.0000 (1.0)      84.0760 (3.74)     0.0000 (1.0)           0;0  0.0119 (0.27)          1           1
test_partial_remove-add[3.53.2]     75.0308 (3.34)     75.0308 (3.34)     75.0308 (3.34)     0.0000 (1.0)      75.0308 (3.34)     0.0000 (1.0)           0;0  0.0133 (0.30)          1           1
test_partial_remove-add[3.60.1]     22.4928 (1.0)      22.4928 (1.0)      22.4928 (1.0)      0.0000 (1.0)      22.4928 (1.0)      0.0000 (1.0)           0;0  0.0445 (1.0)           1           1
test_partial_remove-add[main]       23.7036 (1.05)     23.7036 (1.05)     23.7036 (1.05)     0.0000 (1.0)      23.7036 (1.05)     0.0000 (1.0)           0;0  0.0422 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     8.4122 (7.86)     8.4122 (7.86)     8.4122 (7.86)     0.0000 (1.0)      8.4122 (7.86)     0.0000 (1.0)           0;0  0.1189 (0.13)          1           1
test_partial_remove-add-update[3.10.0]     8.3537 (7.81)     8.3537 (7.81)     8.3537 (7.81)     0.0000 (1.0)      8.3537 (7.81)     0.0000 (1.0)           0;0  0.1197 (0.13)          1           1
test_partial_remove-add-update[3.53.2]     7.3504 (6.87)     7.3504 (6.87)     7.3504 (6.87)     0.0000 (1.0)      7.3504 (6.87)     0.0000 (1.0)           0;0  0.1360 (0.15)          1           1
test_partial_remove-add-update[3.60.1]     1.0701 (1.0)      1.0701 (1.0)      1.0701 (1.0)      0.0000 (1.0)      1.0701 (1.0)      0.0000 (1.0)           0;0  0.9345 (1.0)           1           1
test_partial_remove-add-update[main]       1.1206 (1.05)     1.1206 (1.05)     1.1206 (1.05)     0.0000 (1.0)      1.1206 (1.05)     0.0000 (1.0)           0;0  0.8924 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     3.2514 (1.0)      3.2514 (1.0)      3.2514 (1.0)      0.0000 (1.0)      3.2514 (1.0)      0.0000 (1.0)           0;0  0.3076 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.6324 (1.12)     3.6324 (1.12)     3.6324 (1.12)     0.0000 (1.0)      3.6324 (1.12)     0.0000 (1.0)           0;0  0.2753 (0.90)          1           1
test_partial_remove-gc[3.53.2]     3.7866 (1.16)     3.7866 (1.16)     3.7866 (1.16)     0.0000 (1.0)      3.7866 (1.16)     0.0000 (1.0)           0;0  0.2641 (0.86)          1           1
test_partial_remove-gc[3.60.1]     3.8079 (1.17)     3.8079 (1.17)     3.8079 (1.17)     0.0000 (1.0)      3.8079 (1.17)     0.0000 (1.0)           0;0  0.2626 (0.85)          1           1
test_partial_remove-gc[main]       3.5272 (1.08)     3.5272 (1.08)     3.5272 (1.08)     0.0000 (1.0)      3.5272 (1.08)     0.0000 (1.0)           0;0  0.2835 (0.92)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     4.9841 (1.02)     4.9841 (1.02)     4.9841 (1.02)     0.0000 (1.0)      4.9841 (1.02)     0.0000 (1.0)           0;0  0.2006 (0.98)          1           1
test_partial_remove-gc-cloud[3.10.0]     5.3547 (1.09)     5.3547 (1.09)     5.3547 (1.09)     0.0000 (1.0)      5.3547 (1.09)     0.0000 (1.0)           0;0  0.1868 (0.91)          1           1
test_partial_remove-gc-cloud[3.53.2]     5.0827 (1.04)     5.0827 (1.04)     5.0827 (1.04)     0.0000 (1.0)      5.0827 (1.04)     0.0000 (1.0)           0;0  0.1967 (0.96)          1           1
test_partial_remove-gc-cloud[3.60.1]     4.9979 (1.02)     4.9979 (1.02)     4.9979 (1.02)     0.0000 (1.0)      4.9979 (1.02)     0.0000 (1.0)           0;0  0.2001 (0.98)          1           1
test_partial_remove-gc-cloud[main]       4.8921 (1.0)      4.8921 (1.0)      4.8921 (1.0)      0.0000 (1.0)      4.8921 (1.0)      0.0000 (1.0)           0;0  0.2044 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     91.9730 (4.14)     91.9730 (4.14)     91.9730 (4.14)     0.0000 (1.0)      91.9730 (4.14)     0.0000 (1.0)           0;0  0.0109 (0.24)          1           1
test_partial_remove-push[3.10.0]     42.5344 (1.91)     42.5344 (1.91)     42.5344 (1.91)     0.0000 (1.0)      42.5344 (1.91)     0.0000 (1.0)           0;0  0.0235 (0.52)          1           1
test_partial_remove-push[3.53.2]     23.5249 (1.06)     23.5249 (1.06)     23.5249 (1.06)     0.0000 (1.0)      23.5249 (1.06)     0.0000 (1.0)           0;0  0.0425 (0.94)          1           1
test_partial_remove-push[3.60.1]     22.2271 (1.0)      22.2271 (1.0)      22.2271 (1.0)      0.0000 (1.0)      22.2271 (1.0)      0.0000 (1.0)           0;0  0.0450 (1.0)           1           1
test_partial_remove-push[main]       22.4245 (1.01)     22.4245 (1.01)     22.4245 (1.01)     0.0000 (1.0)      22.4245 (1.01)     0.0000 (1.0)           0;0  0.0446 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     1.8459 (1.0)      1.8459 (1.0)      1.8459 (1.0)      0.0000 (1.0)      1.8459 (1.0)      0.0000 (1.0)           0;0  0.5417 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     1.8483 (1.00)     1.8483 (1.00)     1.8483 (1.00)     0.0000 (1.0)      1.8483 (1.00)     0.0000 (1.0)           0;0  0.5410 (1.00)          1           1
test_partial_remove-push-update[3.53.2]     2.5200 (1.37)     2.5200 (1.37)     2.5200 (1.37)     0.0000 (1.0)      2.5200 (1.37)     0.0000 (1.0)           0;0  0.3968 (0.73)          1           1
test_partial_remove-push-update[3.60.1]     2.8288 (1.53)     2.8288 (1.53)     2.8288 (1.53)     0.0000 (1.0)      2.8288 (1.53)     0.0000 (1.0)           0;0  0.3535 (0.65)          1           1
test_partial_remove-push-update[main]       2.5445 (1.38)     2.5445 (1.38)     2.5445 (1.38)     0.0000 (1.0)      2.5445 (1.38)     0.0000 (1.0)           0;0  0.3930 (0.73)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

------------------------------------------------------------------------------ benchmark 'test_plots-plots-diff': 5 tests ------------------------------------------------------------------------------
Name (time in ms)                      Min                   Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     577.2114 (1.0)        598.3911 (1.0)      587.2662 (1.0)       9.0008 (2.11)     584.1232 (1.0)      15.1977 (2.31)          2;0  1.7028 (1.0)           5           3
test_plots-plots-diff[3.10.0]     981.5900 (1.70)     1,012.1587 (1.69)     993.4327 (1.69)     11.5151 (2.70)     992.6653 (1.70)     12.4079 (1.89)          2;0  1.0066 (0.59)          5           3
test_plots-plots-diff[3.53.2]     915.8421 (1.59)       956.9405 (1.60)     938.2572 (1.60)     17.0670 (4.00)     935.1771 (1.60)     28.0524 (4.26)          2;0  1.0658 (0.63)          5           3
test_plots-plots-diff[3.60.1]     940.0737 (1.63)     1,035.5896 (1.73)     988.6629 (1.68)     35.3620 (8.29)     991.4285 (1.70)     45.8886 (6.97)          2;0  1.0115 (0.59)          5           3
test_plots-plots-diff[main]       900.4321 (1.56)       910.9960 (1.52)     906.5198 (1.54)      4.2667 (1.0)      907.9017 (1.55)      6.5791 (1.0)           2;0  1.1031 (0.65)          5           3
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       575.7279 (1.0)        598.5430 (1.0)        584.8755 (1.0)      10.6454 (1.03)       579.6189 (1.0)      18.9053 (2.23)          1;0  1.7098 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,193.0370 (2.07)     1,220.6156 (2.04)     1,206.1119 (2.06)     11.4487 (1.11)     1,209.4266 (2.09)     18.5497 (2.18)          2;0  0.8291 (0.48)          5           3
test_plots-plots-diff-json[3.53.2]     1,000.5863 (1.74)     1,042.5132 (1.74)     1,022.0389 (1.75)     14.9871 (1.45)     1,021.2877 (1.76)     14.8528 (1.75)          2;0  0.9784 (0.57)          5           3
test_plots-plots-diff-json[3.60.1]     1,017.3297 (1.77)     1,058.4720 (1.77)     1,041.0801 (1.78)     16.9789 (1.64)     1,038.1048 (1.79)     26.5162 (3.12)          2;0  0.9605 (0.56)          5           3
test_plots-plots-diff-json[main]         981.7371 (1.71)     1,007.9749 (1.68)       989.9526 (1.69)     10.3415 (1.0)        986.9411 (1.70)      8.4955 (1.0)           1;1  1.0101 (0.59)          5           3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     473.7524 (1.0)      488.3161 (1.0)      479.4949 (1.0)       6.0130 (1.10)     478.5838 (1.0)       9.5137 (1.93)          1;0  2.0855 (1.0)           5           3
test_plots-plots-show[3.10.0]     810.4875 (1.71)     827.9173 (1.70)     815.8819 (1.70)      6.9358 (1.26)     813.6329 (1.70)      6.4163 (1.30)          1;1  1.2257 (0.59)          5           3
test_plots-plots-show[3.53.2]     844.1114 (1.78)     880.4223 (1.80)     866.7857 (1.81)     16.4290 (2.99)     874.4805 (1.83)     28.0352 (5.68)          1;0  1.1537 (0.55)          5           3
test_plots-plots-show[3.60.1]     752.7272 (1.59)     768.1867 (1.57)     760.4391 (1.59)      5.4894 (1.0)      760.3590 (1.59)      4.9400 (1.0)           2;0  1.3150 (0.63)          5           3
test_plots-plots-show[main]       764.7843 (1.61)     787.5825 (1.61)     774.7728 (1.62)      8.8901 (1.62)     773.2491 (1.62)     13.1329 (2.66)          2;0  1.2907 (0.62)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_plots-plots-show-json': 5 tests ------------------------------------------------------------------------------
Name (time in ms)                           Min                   Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     486.0284 (1.0)        494.3245 (1.0)      490.8794 (1.0)       3.3789 (1.0)      491.2869 (1.0)       5.3608 (1.0)           2;0  2.0372 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     933.3114 (1.92)     1,002.0889 (2.03)     955.6728 (1.95)     27.9467 (8.27)     954.1541 (1.94)     32.6866 (6.10)          1;0  1.0464 (0.51)          5           3
test_plots-plots-show-json[3.53.2]     859.1939 (1.77)       922.8397 (1.87)     898.1437 (1.83)     25.6906 (7.60)     895.0656 (1.82)     35.8502 (6.69)          1;0  1.1134 (0.55)          5           3
test_plots-plots-show-json[3.60.1]     837.8694 (1.72)       877.8411 (1.78)     858.2854 (1.75)     15.6543 (4.63)     861.1273 (1.75)     23.8609 (4.45)          2;0  1.1651 (0.57)          5           3
test_plots-plots-show-json[main]       803.7342 (1.65)       819.6089 (1.66)     809.1018 (1.65)      6.1234 (1.81)     807.2196 (1.64)      5.4401 (1.01)          1;1  1.2359 (0.61)          5           3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

-------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     90.5363 (4.12)     90.5363 (4.12)     90.5363 (4.12)     0.0000 (1.0)      90.5363 (4.12)     0.0000 (1.0)           0;0  0.0110 (0.24)          1           1
test_push-push[3.10.0]     42.4893 (1.93)     42.4893 (1.93)     42.4893 (1.93)     0.0000 (1.0)      42.4893 (1.93)     0.0000 (1.0)           0;0  0.0235 (0.52)          1           1
test_push-push[3.53.2]     22.7046 (1.03)     22.7046 (1.03)     22.7046 (1.03)     0.0000 (1.0)      22.7046 (1.03)     0.0000 (1.0)           0;0  0.0440 (0.97)          1           1
test_push-push[3.60.1]     21.9880 (1.0)      21.9880 (1.0)      21.9880 (1.0)      0.0000 (1.0)      21.9880 (1.0)      0.0000 (1.0)           0;0  0.0455 (1.0)           1           1
test_push-push[main]       22.6467 (1.03)     22.6467 (1.03)     22.6467 (1.03)     0.0000 (1.0)      22.6467 (1.03)     0.0000 (1.0)           0;0  0.0442 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     105.2712 (4.68)     105.2712 (4.68)     105.2712 (4.68)     0.0000 (1.0)      105.2712 (4.68)     0.0000 (1.0)           0;0  0.0095 (0.21)          1           1
test_sharing-fetch[3.10.0]     110.0920 (4.90)     110.0920 (4.90)     110.0920 (4.90)     0.0000 (1.0)      110.0920 (4.90)     0.0000 (1.0)           0;0  0.0091 (0.20)          1           1
test_sharing-fetch[3.53.2]      32.1702 (1.43)      32.1702 (1.43)      32.1702 (1.43)     0.0000 (1.0)       32.1702 (1.43)     0.0000 (1.0)           0;0  0.0311 (0.70)          1           1
test_sharing-fetch[3.60.1]      22.6525 (1.01)      22.6525 (1.01)      22.6525 (1.01)     0.0000 (1.0)       22.6525 (1.01)     0.0000 (1.0)           0;0  0.0441 (0.99)          1           1
test_sharing-fetch[main]        22.4859 (1.0)       22.4859 (1.0)       22.4859 (1.0)      0.0000 (1.0)       22.4859 (1.0)      0.0000 (1.0)           0;0  0.0445 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2523 (1.0)      1.2523 (1.0)      1.2523 (1.0)      0.0000 (1.0)      1.2523 (1.0)      0.0000 (1.0)           0;0  0.7985 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.6699 (2.93)     3.6699 (2.93)     3.6699 (2.93)     0.0000 (1.0)      3.6699 (2.93)     0.0000 (1.0)           0;0  0.2725 (0.34)          1           1
test_sharing-fetch-noop[3.53.2]     5.7107 (4.56)     5.7107 (4.56)     5.7107 (4.56)     0.0000 (1.0)      5.7107 (4.56)     0.0000 (1.0)           0;0  0.1751 (0.22)          1           1
test_sharing-fetch-noop[3.60.1]     5.9012 (4.71)     5.9012 (4.71)     5.9012 (4.71)     0.0000 (1.0)      5.9012 (4.71)     0.0000 (1.0)           0;0  0.1695 (0.21)          1           1
test_sharing-fetch-noop[main]       5.9619 (4.76)     5.9619 (4.76)     5.9619 (4.76)     0.0000 (1.0)      5.9619 (4.76)     0.0000 (1.0)           0;0  0.1677 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     94.1113 (4.17)     94.1113 (4.17)     94.1113 (4.17)     0.0000 (1.0)      94.1113 (4.17)     0.0000 (1.0)           0;0  0.0106 (0.24)          1           1
test_sharing-push[3.10.0]     44.0077 (1.95)     44.0077 (1.95)     44.0077 (1.95)     0.0000 (1.0)      44.0077 (1.95)     0.0000 (1.0)           0;0  0.0227 (0.51)          1           1
test_sharing-push[3.53.2]     22.8961 (1.01)     22.8961 (1.01)     22.8961 (1.01)     0.0000 (1.0)      22.8961 (1.01)     0.0000 (1.0)           0;0  0.0437 (0.99)          1           1
test_sharing-push[3.60.1]     22.5914 (1.0)      22.5914 (1.0)      22.5914 (1.0)      0.0000 (1.0)      22.5914 (1.0)      0.0000 (1.0)           0;0  0.0443 (1.0)           1           1
test_sharing-push[main]       22.7399 (1.01)     22.7399 (1.01)     22.7399 (1.01)     0.0000 (1.0)      22.7399 (1.01)     0.0000 (1.0)           0;0  0.0440 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     1.9882 (1.0)      1.9882 (1.0)      1.9882 (1.0)      0.0000 (1.0)      1.9882 (1.0)      0.0000 (1.0)           0;0  0.5030 (1.0)           1           1
test_sharing-push-noop[3.10.0]     2.0757 (1.04)     2.0757 (1.04)     2.0757 (1.04)     0.0000 (1.0)      2.0757 (1.04)     0.0000 (1.0)           0;0  0.4818 (0.96)          1           1
test_sharing-push-noop[3.53.2]     5.8684 (2.95)     5.8684 (2.95)     5.8684 (2.95)     0.0000 (1.0)      5.8684 (2.95)     0.0000 (1.0)           0;0  0.1704 (0.34)          1           1
test_sharing-push-noop[3.60.1]     5.9625 (3.00)     5.9625 (3.00)     5.9625 (3.00)     0.0000 (1.0)      5.9625 (3.00)     0.0000 (1.0)           0;0  0.1677 (0.33)          1           1
test_sharing-push-noop[main]       5.9421 (2.99)     5.9421 (2.99)     5.9421 (2.99)     0.0000 (1.0)      5.9421 (2.99)     0.0000 (1.0)           0;0  0.1683 (0.33)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     142.0774 (1.05)     142.0774 (1.05)     142.0774 (1.05)     0.0000 (1.0)      142.0774 (1.05)     0.0000 (1.0)           0;0  0.0070 (0.95)          1           1
test_sharing_azure-fetch[main]       134.6957 (1.0)      134.6957 (1.0)      134.6957 (1.0)      0.0000 (1.0)      134.6957 (1.0)      0.0000 (1.0)           0;0  0.0074 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     5.9815 (1.0)      5.9815 (1.0)      5.9815 (1.0)      0.0000 (1.0)      5.9815 (1.0)      0.0000 (1.0)           0;0  0.1672 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       6.0977 (1.02)     6.0977 (1.02)     6.0977 (1.02)     0.0000 (1.0)      6.0977 (1.02)     0.0000 (1.0)           0;0  0.1640 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     118.6761 (1.0)      118.6761 (1.0)      118.6761 (1.0)      0.0000 (1.0)      118.6761 (1.0)      0.0000 (1.0)           0;0  0.0084 (1.0)           1           1
test_sharing_azure-push[main]       120.8532 (1.02)     120.8532 (1.02)     120.8532 (1.02)     0.0000 (1.0)      120.8532 (1.02)     0.0000 (1.0)           0;0  0.0083 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     6.1119 (1.01)     6.1119 (1.01)     6.1119 (1.01)     0.0000 (1.0)      6.1119 (1.01)     0.0000 (1.0)           0;0  0.1636 (0.99)          1           1
test_sharing_azure-push-noop[main]       6.0731 (1.0)      6.0731 (1.0)      6.0731 (1.0)      0.0000 (1.0)      6.0731 (1.0)      0.0000 (1.0)           0;0  0.1647 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     554.0861 (1.05)     554.0861 (1.05)     554.0861 (1.05)     0.0000 (1.0)      554.0861 (1.05)     0.0000 (1.0)           0;0  0.0018 (0.96)          1           1
test_sharing_s3-fetch[main]       529.3091 (1.0)      529.3091 (1.0)      529.3091 (1.0)      0.0000 (1.0)      529.3091 (1.0)      0.0000 (1.0)           0;0  0.0019 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.2581 (1.0)      6.2581 (1.0)      6.2581 (1.0)      0.0000 (1.0)      6.2581 (1.0)      0.0000 (1.0)           0;0  0.1598 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       6.5001 (1.04)     6.5001 (1.04)     6.5001 (1.04)     0.0000 (1.0)      6.5001 (1.04)     0.0000 (1.0)           0;0  0.1538 (0.96)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     693.1510 (1.00)     693.1510 (1.00)     693.1510 (1.00)     0.0000 (1.0)      693.1510 (1.00)     0.0000 (1.0)           0;0  0.0014 (1.00)          1           1
test_sharing_s3-push[main]       690.6796 (1.0)      690.6796 (1.0)      690.6796 (1.0)      0.0000 (1.0)      690.6796 (1.0)      0.0000 (1.0)           0;0  0.0014 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     6.6626 (1.0)      6.6626 (1.0)      6.6626 (1.0)      0.0000 (1.0)      6.6626 (1.0)      0.0000 (1.0)           0;0  0.1501 (1.0)           1           1
test_sharing_s3-push-noop[main]       6.6986 (1.01)     6.6986 (1.01)     6.6986 (1.01)     0.0000 (1.0)      6.6986 (1.01)     0.0000 (1.0)           0;0  0.1493 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     14.4412 (3.57)     14.4412 (3.57)     14.4412 (3.57)     0.0000 (1.0)      14.4412 (3.57)     0.0000 (1.0)           0;0  0.0692 (0.28)          1           1
test_status-status[3.10.0]     14.8348 (3.67)     14.8348 (3.67)     14.8348 (3.67)     0.0000 (1.0)      14.8348 (3.67)     0.0000 (1.0)           0;0  0.0674 (0.27)          1           1
test_status-status[3.53.2]     13.8141 (3.42)     13.8141 (3.42)     13.8141 (3.42)     0.0000 (1.0)      13.8141 (3.42)     0.0000 (1.0)           0;0  0.0724 (0.29)          1           1
test_status-status[3.60.1]      4.0404 (1.0)       4.0404 (1.0)       4.0404 (1.0)      0.0000 (1.0)       4.0404 (1.0)      0.0000 (1.0)           0;0  0.2475 (1.0)           1           1
test_status-status[main]        4.0553 (1.00)      4.0553 (1.00)      4.0553 (1.00)     0.0000 (1.0)       4.0553 (1.00)     0.0000 (1.0)           0;0  0.2466 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     3.5216 (1.50)     3.5216 (1.50)     3.5216 (1.50)     0.0000 (1.0)      3.5216 (1.50)     0.0000 (1.0)           0;0  0.2840 (0.67)          1           1
test_status-status-changed[3.10.0]     3.7325 (1.59)     3.7325 (1.59)     3.7325 (1.59)     0.0000 (1.0)      3.7325 (1.59)     0.0000 (1.0)           0;0  0.2679 (0.63)          1           1
test_status-status-changed[3.53.2]     3.6835 (1.57)     3.6835 (1.57)     3.6835 (1.57)     0.0000 (1.0)      3.6835 (1.57)     0.0000 (1.0)           0;0  0.2715 (0.64)          1           1
test_status-status-changed[3.60.1]     2.3506 (1.0)      2.3506 (1.0)      2.3506 (1.0)      0.0000 (1.0)      2.3506 (1.0)      0.0000 (1.0)           0;0  0.4254 (1.0)           1           1
test_status-status-changed[main]       2.4877 (1.06)     2.4877 (1.06)     2.4877 (1.06)     0.0000 (1.0)      2.4877 (1.06)     0.0000 (1.0)           0;0  0.4020 (0.94)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     3.5939 (1.62)     3.5939 (1.62)     3.5939 (1.62)     0.0000 (1.0)      3.5939 (1.62)     0.0000 (1.0)           0;0  0.2782 (0.62)          1           1
test_status-status-changed-noop[3.10.0]     3.6610 (1.65)     3.6610 (1.65)     3.6610 (1.65)     0.0000 (1.0)      3.6610 (1.65)     0.0000 (1.0)           0;0  0.2731 (0.61)          1           1
test_status-status-changed-noop[3.53.2]     3.5776 (1.62)     3.5776 (1.62)     3.5776 (1.62)     0.0000 (1.0)      3.5776 (1.62)     0.0000 (1.0)           0;0  0.2795 (0.62)          1           1
test_status-status-changed-noop[3.60.1]     2.2152 (1.0)      2.2152 (1.0)      2.2152 (1.0)      0.0000 (1.0)      2.2152 (1.0)      0.0000 (1.0)           0;0  0.4514 (1.0)           1           1
test_status-status-changed-noop[main]       2.3824 (1.08)     2.3824 (1.08)     2.3824 (1.08)     0.0000 (1.0)      2.3824 (1.08)     0.0000 (1.0)           0;0  0.4197 (0.93)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     3.5173 (1.58)     3.5173 (1.58)     3.5173 (1.58)     0.0000 (1.0)      3.5173 (1.58)     0.0000 (1.0)           0;0  0.2843 (0.63)          1           1
test_status-status-noop[3.10.0]     3.6659 (1.65)     3.6659 (1.65)     3.6659 (1.65)     0.0000 (1.0)      3.6659 (1.65)     0.0000 (1.0)           0;0  0.2728 (0.61)          1           1
test_status-status-noop[3.53.2]     3.5832 (1.61)     3.5832 (1.61)     3.5832 (1.61)     0.0000 (1.0)      3.5832 (1.61)     0.0000 (1.0)           0;0  0.2791 (0.62)          1           1
test_status-status-noop[3.60.1]     2.2233 (1.0)      2.2233 (1.0)      2.2233 (1.0)      0.0000 (1.0)      2.2233 (1.0)      0.0000 (1.0)           0;0  0.4498 (1.0)           1           1
test_status-status-noop[main]       2.6511 (1.19)     2.6511 (1.19)     2.6511 (1.19)     0.0000 (1.0)      2.6511 (1.19)     0.0000 (1.0)           0;0  0.3772 (0.84)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     191.2625 (4.24)     191.2625 (4.24)     191.2625 (4.24)     0.0000 (1.0)      191.2625 (4.24)     0.0000 (1.0)           0;0  0.0052 (0.24)          1           1
test_update-import-url[3.10.0]     193.0183 (4.28)     193.0183 (4.28)     193.0183 (4.28)     0.0000 (1.0)      193.0183 (4.28)     0.0000 (1.0)           0;0  0.0052 (0.23)          1           1
test_update-import-url[3.53.2]     110.8577 (2.46)     110.8577 (2.46)     110.8577 (2.46)     0.0000 (1.0)      110.8577 (2.46)     0.0000 (1.0)           0;0  0.0090 (0.41)          1           1
test_update-import-url[3.60.1]      45.0648 (1.0)       45.0648 (1.0)       45.0648 (1.0)      0.0000 (1.0)       45.0648 (1.0)      0.0000 (1.0)           0;0  0.0222 (1.0)           1           1
test_update-import-url[main]        46.6946 (1.04)      46.6946 (1.04)      46.6946 (1.04)     0.0000 (1.0)       46.6946 (1.04)     0.0000 (1.0)           0;0  0.0214 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     177.7165 (5.24)     177.7165 (5.24)     177.7165 (5.24)     0.0000 (1.0)      177.7165 (5.24)     0.0000 (1.0)           0;0  0.0056 (0.19)          1           1
test_update-update[3.10.0]     180.9604 (5.34)     180.9604 (5.34)     180.9604 (5.34)     0.0000 (1.0)      180.9604 (5.34)     0.0000 (1.0)           0;0  0.0055 (0.19)          1           1
test_update-update[3.53.2]     104.7477 (3.09)     104.7477 (3.09)     104.7477 (3.09)     0.0000 (1.0)      104.7477 (3.09)     0.0000 (1.0)           0;0  0.0095 (0.32)          1           1
test_update-update[3.60.1]      33.9070 (1.0)       33.9070 (1.0)       33.9070 (1.0)      0.0000 (1.0)       33.9070 (1.0)      0.0000 (1.0)           0;0  0.0295 (1.0)           1           1
test_update-update[main]        34.9715 (1.03)      34.9715 (1.03)      34.9715 (1.03)     0.0000 (1.0)       34.9715 (1.03)     0.0000 (1.0)           0;0  0.0286 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     16.5002 (2.24)     16.5002 (2.24)     16.5002 (2.24)     0.0000 (1.0)      16.5002 (2.24)     0.0000 (1.0)           0;0  0.0606 (0.45)          1           1
test_update-update-noop[3.10.0]     17.4628 (2.37)     17.4628 (2.37)     17.4628 (2.37)     0.0000 (1.0)      17.4628 (2.37)     0.0000 (1.0)           0;0  0.0573 (0.42)          1           1
test_update-update-noop[3.53.2]     17.0175 (2.31)     17.0175 (2.31)     17.0175 (2.31)     0.0000 (1.0)      17.0175 (2.31)     0.0000 (1.0)           0;0  0.0588 (0.43)          1           1
test_update-update-noop[3.60.1]      7.3586 (1.0)       7.3586 (1.0)       7.3586 (1.0)      0.0000 (1.0)       7.3586 (1.0)      0.0000 (1.0)           0;0  0.1359 (1.0)           1           1
test_update-update-noop[main]        7.8464 (1.07)      7.8464 (1.07)      7.8464 (1.07)     0.0000 (1.0)       7.8464 (1.07)     0.0000 (1.0)           0;0  0.1274 (0.94)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean