Fri Feb  6 00:57:56 UTC 2026
dataset: mnist
project: example-get-started

DVC Plot

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     80.5515 (3.62)     80.5515 (3.62)     80.5515 (3.62)     0.0000 (1.0)      80.5515 (3.62)     0.0000 (1.0)           0;0  0.0124 (0.28)          1           1
test_add_copy-add[3.10.0]     81.3128 (3.65)     81.3128 (3.65)     81.3128 (3.65)     0.0000 (1.0)      81.3128 (3.65)     0.0000 (1.0)           0;0  0.0123 (0.27)          1           1
test_add_copy-add[3.53.2]     73.0617 (3.28)     73.0617 (3.28)     73.0617 (3.28)     0.0000 (1.0)      73.0617 (3.28)     0.0000 (1.0)           0;0  0.0137 (0.30)          1           1
test_add_copy-add[3.60.1]     22.2802 (1.0)      22.2802 (1.0)      22.2802 (1.0)      0.0000 (1.0)      22.2802 (1.0)      0.0000 (1.0)           0;0  0.0449 (1.0)           1           1
test_add_copy-add[main]       23.1775 (1.04)     23.1775 (1.04)     23.1775 (1.04)     0.0000 (1.0)      23.1775 (1.04)     0.0000 (1.0)           0;0  0.0431 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     26.2421 (6.45)     26.2421 (6.45)     26.2421 (6.45)     0.0000 (1.0)      26.2421 (6.45)     0.0000 (1.0)           0;0  0.0381 (0.16)          1           1
test_add_copy-add-noop[3.10.0]     26.5062 (6.51)     26.5062 (6.51)     26.5062 (6.51)     0.0000 (1.0)      26.5062 (6.51)     0.0000 (1.0)           0;0  0.0377 (0.15)          1           1
test_add_copy-add-noop[3.53.2]     25.2867 (6.21)     25.2867 (6.21)     25.2867 (6.21)     0.0000 (1.0)      25.2867 (6.21)     0.0000 (1.0)           0;0  0.0395 (0.16)          1           1
test_add_copy-add-noop[3.60.1]      4.0689 (1.0)       4.0689 (1.0)       4.0689 (1.0)      0.0000 (1.0)       4.0689 (1.0)      0.0000 (1.0)           0;0  0.2458 (1.0)           1           1
test_add_copy-add-noop[main]        4.4652 (1.10)      4.4652 (1.10)      4.4652 (1.10)     0.0000 (1.0)       4.4652 (1.10)     0.0000 (1.0)           0;0  0.2240 (0.91)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     44.9971 (3.77)     44.9971 (3.77)     44.9971 (3.77)     0.0000 (1.0)      44.9971 (3.77)     0.0000 (1.0)           0;0  0.0222 (0.27)          1           1
test_add_hardlink-add[3.10.0]     45.0227 (3.77)     45.0227 (3.77)     45.0227 (3.77)     0.0000 (1.0)      45.0227 (3.77)     0.0000 (1.0)           0;0  0.0222 (0.27)          1           1
test_add_hardlink-add[3.53.2]     41.7988 (3.50)     41.7988 (3.50)     41.7988 (3.50)     0.0000 (1.0)      41.7988 (3.50)     0.0000 (1.0)           0;0  0.0239 (0.29)          1           1
test_add_hardlink-add[3.60.1]     11.9497 (1.0)      11.9497 (1.0)      11.9497 (1.0)      0.0000 (1.0)      11.9497 (1.0)      0.0000 (1.0)           0;0  0.0837 (1.0)           1           1
test_add_hardlink-add[main]       12.7744 (1.07)     12.7744 (1.07)     12.7744 (1.07)     0.0000 (1.0)      12.7744 (1.07)     0.0000 (1.0)           0;0  0.0783 (0.94)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     22.8096 (6.10)     22.8096 (6.10)     22.8096 (6.10)     0.0000 (1.0)      22.8096 (6.10)     0.0000 (1.0)           0;0  0.0438 (0.16)          1           1
test_add_hardlink-add-noop[3.10.0]     22.7742 (6.09)     22.7742 (6.09)     22.7742 (6.09)     0.0000 (1.0)      22.7742 (6.09)     0.0000 (1.0)           0;0  0.0439 (0.16)          1           1
test_add_hardlink-add-noop[3.53.2]     21.7246 (5.81)     21.7246 (5.81)     21.7246 (5.81)     0.0000 (1.0)      21.7246 (5.81)     0.0000 (1.0)           0;0  0.0460 (0.17)          1           1
test_add_hardlink-add-noop[3.60.1]      3.7404 (1.0)       3.7404 (1.0)       3.7404 (1.0)      0.0000 (1.0)       3.7404 (1.0)      0.0000 (1.0)           0;0  0.2673 (1.0)           1           1
test_add_hardlink-add-noop[main]        3.9205 (1.05)      3.9205 (1.05)      3.9205 (1.05)     0.0000 (1.0)       3.9205 (1.05)     0.0000 (1.0)           0;0  0.2551 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     67.4554 (1.92)     67.4554 (1.92)     67.4554 (1.92)     0.0000 (1.0)      67.4554 (1.92)     0.0000 (1.0)           0;0  0.0148 (0.52)          1           1
test_add_symlink-add[3.10.0]     67.3442 (1.92)     67.3442 (1.92)     67.3442 (1.92)     0.0000 (1.0)      67.3442 (1.92)     0.0000 (1.0)           0;0  0.0148 (0.52)          1           1
test_add_symlink-add[3.53.2]     61.6363 (1.76)     61.6363 (1.76)     61.6363 (1.76)     0.0000 (1.0)      61.6363 (1.76)     0.0000 (1.0)           0;0  0.0162 (0.57)          1           1
test_add_symlink-add[3.60.1]     35.0983 (1.0)      35.0983 (1.0)      35.0983 (1.0)      0.0000 (1.0)      35.0983 (1.0)      0.0000 (1.0)           0;0  0.0285 (1.0)           1           1
test_add_symlink-add[main]       37.2794 (1.06)     37.2794 (1.06)     37.2794 (1.06)     0.0000 (1.0)      37.2794 (1.06)     0.0000 (1.0)           0;0  0.0268 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     45.8667 (8.48)     45.8667 (8.48)     45.8667 (8.48)     0.0000 (1.0)      45.8667 (8.48)     0.0000 (1.0)           0;0  0.0218 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     44.5559 (8.24)     44.5559 (8.24)     44.5559 (8.24)     0.0000 (1.0)      44.5559 (8.24)     0.0000 (1.0)           0;0  0.0224 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     43.7050 (8.08)     43.7050 (8.08)     43.7050 (8.08)     0.0000 (1.0)      43.7050 (8.08)     0.0000 (1.0)           0;0  0.0229 (0.12)          1           1
test_add_symlink-add-noop[3.60.1]      5.4099 (1.0)       5.4099 (1.0)       5.4099 (1.0)      0.0000 (1.0)       5.4099 (1.0)      0.0000 (1.0)           0;0  0.1848 (1.0)           1           1
test_add_symlink-add-noop[main]        5.5940 (1.03)      5.5940 (1.03)      5.5940 (1.03)     0.0000 (1.0)       5.5940 (1.03)     0.0000 (1.0)           0;0  0.1788 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests ----------------------------------------------------------------------------
Name (time in s)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]      40.4498 (1.94)      40.4498 (1.94)      40.4498 (1.94)     0.0000 (1.0)       40.4498 (1.94)     0.0000 (1.0)           0;0  0.0247 (0.52)          1           1
test_checkout_copy-checkout[3.10.0]     101.3495 (4.85)     101.3495 (4.85)     101.3495 (4.85)     0.0000 (1.0)      101.3495 (4.85)     0.0000 (1.0)           0;0  0.0099 (0.21)          1           1
test_checkout_copy-checkout[3.53.2]      28.0023 (1.34)      28.0023 (1.34)      28.0023 (1.34)     0.0000 (1.0)       28.0023 (1.34)     0.0000 (1.0)           0;0  0.0357 (0.75)          1           1
test_checkout_copy-checkout[3.60.1]      20.8923 (1.0)       20.8923 (1.0)       20.8923 (1.0)      0.0000 (1.0)       20.8923 (1.0)      0.0000 (1.0)           0;0  0.0479 (1.0)           1           1
test_checkout_copy-checkout[main]        21.7601 (1.04)      21.7601 (1.04)      21.7601 (1.04)     0.0000 (1.0)       21.7601 (1.04)     0.0000 (1.0)           0;0  0.0460 (0.96)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.4343 (1.65)     5.4343 (1.65)     5.4343 (1.65)     0.0000 (1.0)      5.4343 (1.65)     0.0000 (1.0)           0;0  0.1840 (0.61)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.8331 (1.77)     5.8331 (1.77)     5.8331 (1.77)     0.0000 (1.0)      5.8331 (1.77)     0.0000 (1.0)           0;0  0.1714 (0.57)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.8110 (1.76)     5.8110 (1.76)     5.8110 (1.76)     0.0000 (1.0)      5.8110 (1.76)     0.0000 (1.0)           0;0  0.1721 (0.57)          1           1
test_checkout_copy-checkout-noop[3.60.1]     3.3000 (1.0)      3.3000 (1.0)      3.3000 (1.0)      0.0000 (1.0)      3.3000 (1.0)      0.0000 (1.0)           0;0  0.3030 (1.0)           1           1
test_checkout_copy-checkout-noop[main]       3.6120 (1.09)     3.6120 (1.09)     3.6120 (1.09)     0.0000 (1.0)      3.6120 (1.09)     0.0000 (1.0)           0;0  0.2769 (0.91)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     7.5760 (1.92)     7.5760 (1.92)     7.5760 (1.92)     0.0000 (1.0)      7.5760 (1.92)     0.0000 (1.0)           0;0  0.1320 (0.52)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.5829 (1.67)     6.5829 (1.67)     6.5829 (1.67)     0.0000 (1.0)      6.5829 (1.67)     0.0000 (1.0)           0;0  0.1519 (0.60)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.4230 (1.62)     6.4230 (1.62)     6.4230 (1.62)     0.0000 (1.0)      6.4230 (1.62)     0.0000 (1.0)           0;0  0.1557 (0.62)          1           1
test_checkout_copy-checkout-update[3.60.1]     3.9533 (1.0)      3.9533 (1.0)      3.9533 (1.0)      0.0000 (1.0)      3.9533 (1.0)      0.0000 (1.0)           0;0  0.2530 (1.0)           1           1
test_checkout_copy-checkout-update[main]       4.3733 (1.11)     4.3733 (1.11)     4.3733 (1.11)     0.0000 (1.0)      4.3733 (1.11)     0.0000 (1.0)           0;0  0.2287 (0.90)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     20.1902 (2.74)     20.1902 (2.74)     20.1902 (2.74)     0.0000 (1.0)      20.1902 (2.74)     0.0000 (1.0)           0;0  0.0495 (0.36)          1           1
test_checkout_hardlink-checkout[3.10.0]     15.8793 (2.16)     15.8793 (2.16)     15.8793 (2.16)     0.0000 (1.0)      15.8793 (2.16)     0.0000 (1.0)           0;0  0.0630 (0.46)          1           1
test_checkout_hardlink-checkout[3.53.2]     14.1879 (1.93)     14.1879 (1.93)     14.1879 (1.93)     0.0000 (1.0)      14.1879 (1.93)     0.0000 (1.0)           0;0  0.0705 (0.52)          1           1
test_checkout_hardlink-checkout[3.60.1]      7.3682 (1.0)       7.3682 (1.0)       7.3682 (1.0)      0.0000 (1.0)       7.3682 (1.0)      0.0000 (1.0)           0;0  0.1357 (1.0)           1           1
test_checkout_hardlink-checkout[main]        8.2878 (1.12)      8.2878 (1.12)      8.2878 (1.12)     0.0000 (1.0)       8.2878 (1.12)     0.0000 (1.0)           0;0  0.1207 (0.89)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.4080 (1.67)     5.4080 (1.67)     5.4080 (1.67)     0.0000 (1.0)      5.4080 (1.67)     0.0000 (1.0)           0;0  0.1849 (0.60)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.7397 (1.77)     5.7397 (1.77)     5.7397 (1.77)     0.0000 (1.0)      5.7397 (1.77)     0.0000 (1.0)           0;0  0.1742 (0.56)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.5261 (1.71)     5.5261 (1.71)     5.5261 (1.71)     0.0000 (1.0)      5.5261 (1.71)     0.0000 (1.0)           0;0  0.1810 (0.59)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.2395 (1.0)      3.2395 (1.0)      3.2395 (1.0)      0.0000 (1.0)      3.2395 (1.0)      0.0000 (1.0)           0;0  0.3087 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]       3.4296 (1.06)     3.4296 (1.06)     3.4296 (1.06)     0.0000 (1.0)      3.4296 (1.06)     0.0000 (1.0)           0;0  0.2916 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     7.6374 (1.99)     7.6374 (1.99)     7.6374 (1.99)     0.0000 (1.0)      7.6374 (1.99)     0.0000 (1.0)           0;0  0.1309 (0.50)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.5024 (1.70)     6.5024 (1.70)     6.5024 (1.70)     0.0000 (1.0)      6.5024 (1.70)     0.0000 (1.0)           0;0  0.1538 (0.59)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.3881 (1.67)     6.3881 (1.67)     6.3881 (1.67)     0.0000 (1.0)      6.3881 (1.67)     0.0000 (1.0)           0;0  0.1565 (0.60)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     3.8355 (1.0)      3.8355 (1.0)      3.8355 (1.0)      0.0000 (1.0)      3.8355 (1.0)      0.0000 (1.0)           0;0  0.2607 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       4.2886 (1.12)     4.2886 (1.12)     4.2886 (1.12)     0.0000 (1.0)      4.2886 (1.12)     0.0000 (1.0)           0;0  0.2332 (0.89)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     24.1691 (2.37)     24.1691 (2.37)     24.1691 (2.37)     0.0000 (1.0)      24.1691 (2.37)     0.0000 (1.0)           0;0  0.0414 (0.42)          1           1
test_checkout_symlink-checkout[3.10.0]     19.2394 (1.89)     19.2394 (1.89)     19.2394 (1.89)     0.0000 (1.0)      19.2394 (1.89)     0.0000 (1.0)           0;0  0.0520 (0.53)          1           1
test_checkout_symlink-checkout[3.53.2]     17.4434 (1.71)     17.4434 (1.71)     17.4434 (1.71)     0.0000 (1.0)      17.4434 (1.71)     0.0000 (1.0)           0;0  0.0573 (0.58)          1           1
test_checkout_symlink-checkout[3.60.1]     10.1994 (1.0)      10.1994 (1.0)      10.1994 (1.0)      0.0000 (1.0)      10.1994 (1.0)      0.0000 (1.0)           0;0  0.0980 (1.0)           1           1
test_checkout_symlink-checkout[main]       11.4279 (1.12)     11.4279 (1.12)     11.4279 (1.12)     0.0000 (1.0)      11.4279 (1.12)     0.0000 (1.0)           0;0  0.0875 (0.89)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.7966 (1.58)     6.7966 (1.58)     6.7966 (1.58)     0.0000 (1.0)      6.7966 (1.58)     0.0000 (1.0)           0;0  0.1471 (0.63)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     6.9841 (1.62)     6.9841 (1.62)     6.9841 (1.62)     0.0000 (1.0)      6.9841 (1.62)     0.0000 (1.0)           0;0  0.1432 (0.62)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.7817 (1.57)     6.7817 (1.57)     6.7817 (1.57)     0.0000 (1.0)      6.7817 (1.57)     0.0000 (1.0)           0;0  0.1475 (0.64)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     4.3131 (1.0)      4.3131 (1.0)      4.3131 (1.0)      0.0000 (1.0)      4.3131 (1.0)      0.0000 (1.0)           0;0  0.2319 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]       4.5269 (1.05)     4.5269 (1.05)     4.5269 (1.05)     0.0000 (1.0)      4.5269 (1.05)     0.0000 (1.0)           0;0  0.2209 (0.95)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     9.8031 (1.68)     9.8031 (1.68)     9.8031 (1.68)     0.0000 (1.0)      9.8031 (1.68)     0.0000 (1.0)           0;0  0.1020 (0.60)          1           1
test_checkout_symlink-checkout-update[3.10.0]     8.5992 (1.47)     8.5992 (1.47)     8.5992 (1.47)     0.0000 (1.0)      8.5992 (1.47)     0.0000 (1.0)           0;0  0.1163 (0.68)          1           1
test_checkout_symlink-checkout-update[3.53.2]     8.6893 (1.49)     8.6893 (1.49)     8.6893 (1.49)     0.0000 (1.0)      8.6893 (1.49)     0.0000 (1.0)           0;0  0.1151 (0.67)          1           1
test_checkout_symlink-checkout-update[3.60.1]     5.8405 (1.0)      5.8405 (1.0)      5.8405 (1.0)      0.0000 (1.0)      5.8405 (1.0)      0.0000 (1.0)           0;0  0.1712 (1.0)           1           1
test_checkout_symlink-checkout-update[main]       6.3850 (1.09)     6.3850 (1.09)     6.3850 (1.09)     0.0000 (1.0)      6.3850 (1.09)     0.0000 (1.0)           0;0  0.1566 (0.91)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     3.9183 (1.72)     3.9183 (1.72)     3.9183 (1.72)     0.0000 (1.0)      3.9183 (1.72)     0.0000 (1.0)           0;0  0.2552 (0.58)          1           1
test_data_status-data-changed[3.10.0]     4.7930 (2.11)     4.7930 (2.11)     4.7930 (2.11)     0.0000 (1.0)      4.7930 (2.11)     0.0000 (1.0)           0;0  0.2086 (0.47)          1           1
test_data_status-data-changed[3.53.2]     4.7906 (2.11)     4.7906 (2.11)     4.7906 (2.11)     0.0000 (1.0)      4.7906 (2.11)     0.0000 (1.0)           0;0  0.2087 (0.47)          1           1
test_data_status-data-changed[3.60.1]     2.2747 (1.0)      2.2747 (1.0)      2.2747 (1.0)      0.0000 (1.0)      2.2747 (1.0)      0.0000 (1.0)           0;0  0.4396 (1.0)           1           1
test_data_status-data-changed[main]       2.5240 (1.11)     2.5240 (1.11)     2.5240 (1.11)     0.0000 (1.0)      2.5240 (1.11)     0.0000 (1.0)           0;0  0.3962 (0.90)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.0660 (1.78)     4.0660 (1.78)     4.0660 (1.78)     0.0000 (1.0)      4.0660 (1.78)     0.0000 (1.0)           0;0  0.2459 (0.56)          1           1
test_data_status-data-changed-noop[3.10.0]     5.0177 (2.20)     5.0177 (2.20)     5.0177 (2.20)     0.0000 (1.0)      5.0177 (2.20)     0.0000 (1.0)           0;0  0.1993 (0.45)          1           1
test_data_status-data-changed-noop[3.53.2]     4.8410 (2.12)     4.8410 (2.12)     4.8410 (2.12)     0.0000 (1.0)      4.8410 (2.12)     0.0000 (1.0)           0;0  0.2066 (0.47)          1           1
test_data_status-data-changed-noop[3.60.1]     2.2792 (1.0)      2.2792 (1.0)      2.2792 (1.0)      0.0000 (1.0)      2.2792 (1.0)      0.0000 (1.0)           0;0  0.4387 (1.0)           1           1
test_data_status-data-changed-noop[main]       2.5005 (1.10)     2.5005 (1.10)     2.5005 (1.10)     0.0000 (1.0)      2.5005 (1.10)     0.0000 (1.0)           0;0  0.3999 (0.91)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     17.9944 (3.70)     17.9944 (3.70)     17.9944 (3.70)     0.0000 (1.0)      17.9944 (3.70)     0.0000 (1.0)           0;0  0.0556 (0.27)          1           1
test_data_status-data-new[3.10.0]     19.4341 (3.99)     19.4341 (3.99)     19.4341 (3.99)     0.0000 (1.0)      19.4341 (3.99)     0.0000 (1.0)           0;0  0.0515 (0.25)          1           1
test_data_status-data-new[3.53.2]     18.3787 (3.77)     18.3787 (3.77)     18.3787 (3.77)     0.0000 (1.0)      18.3787 (3.77)     0.0000 (1.0)           0;0  0.0544 (0.26)          1           1
test_data_status-data-new[3.60.1]      4.8698 (1.0)       4.8698 (1.0)       4.8698 (1.0)      0.0000 (1.0)       4.8698 (1.0)      0.0000 (1.0)           0;0  0.2053 (1.0)           1           1
test_data_status-data-new[main]        5.1877 (1.07)      5.1877 (1.07)      5.1877 (1.07)     0.0000 (1.0)       5.1877 (1.07)     0.0000 (1.0)           0;0  0.1928 (0.94)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     3.9363 (1.74)     3.9363 (1.74)     3.9363 (1.74)     0.0000 (1.0)      3.9363 (1.74)     0.0000 (1.0)           0;0  0.2540 (0.58)          1           1
test_data_status-data-noop[3.10.0]     4.8441 (2.14)     4.8441 (2.14)     4.8441 (2.14)     0.0000 (1.0)      4.8441 (2.14)     0.0000 (1.0)           0;0  0.2064 (0.47)          1           1
test_data_status-data-noop[3.53.2]     4.7104 (2.08)     4.7104 (2.08)     4.7104 (2.08)     0.0000 (1.0)      4.7104 (2.08)     0.0000 (1.0)           0;0  0.2123 (0.48)          1           1
test_data_status-data-noop[3.60.1]     2.2681 (1.0)      2.2681 (1.0)      2.2681 (1.0)      0.0000 (1.0)      2.2681 (1.0)      0.0000 (1.0)           0;0  0.4409 (1.0)           1           1
test_data_status-data-noop[main]       2.4992 (1.10)     2.4992 (1.10)     2.4992 (1.10)     0.0000 (1.0)      2.4992 (1.10)     0.0000 (1.0)           0;0  0.4001 (0.91)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     6.9809 (1.25)     6.9809 (1.25)     6.9809 (1.25)     0.0000 (1.0)      6.9809 (1.25)     0.0000 (1.0)           0;0  0.1432 (0.80)          1           1
test_data_status_all_flags-data-changed[3.10.0]     7.9184 (1.42)     7.9184 (1.42)     7.9184 (1.42)     0.0000 (1.0)      7.9184 (1.42)     0.0000 (1.0)           0;0  0.1263 (0.71)          1           1
test_data_status_all_flags-data-changed[3.53.2]     7.9709 (1.43)     7.9709 (1.43)     7.9709 (1.43)     0.0000 (1.0)      7.9709 (1.43)     0.0000 (1.0)           0;0  0.1255 (0.70)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.5884 (1.0)      5.5884 (1.0)      5.5884 (1.0)      0.0000 (1.0)      5.5884 (1.0)      0.0000 (1.0)           0;0  0.1789 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       6.0291 (1.08)     6.0291 (1.08)     6.0291 (1.08)     0.0000 (1.0)      6.0291 (1.08)     0.0000 (1.0)           0;0  0.1659 (0.93)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     7.1492 (1.25)     7.1492 (1.25)     7.1492 (1.25)     0.0000 (1.0)      7.1492 (1.25)     0.0000 (1.0)           0;0  0.1399 (0.80)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     7.9198 (1.39)     7.9198 (1.39)     7.9198 (1.39)     0.0000 (1.0)      7.9198 (1.39)     0.0000 (1.0)           0;0  0.1263 (0.72)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     7.9697 (1.40)     7.9697 (1.40)     7.9697 (1.40)     0.0000 (1.0)      7.9697 (1.40)     0.0000 (1.0)           0;0  0.1255 (0.72)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     5.7103 (1.0)      5.7103 (1.0)      5.7103 (1.0)      0.0000 (1.0)      5.7103 (1.0)      0.0000 (1.0)           0;0  0.1751 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       5.8928 (1.03)     5.8928 (1.03)     5.8928 (1.03)     0.0000 (1.0)      5.8928 (1.03)     0.0000 (1.0)           0;0  0.1697 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     21.0624 (2.53)     21.0624 (2.53)     21.0624 (2.53)     0.0000 (1.0)      21.0624 (2.53)     0.0000 (1.0)           0;0  0.0475 (0.39)          1           1
test_data_status_all_flags-data-new[3.10.0]     22.8810 (2.75)     22.8810 (2.75)     22.8810 (2.75)     0.0000 (1.0)      22.8810 (2.75)     0.0000 (1.0)           0;0  0.0437 (0.36)          1           1
test_data_status_all_flags-data-new[3.53.2]     22.7365 (2.74)     22.7365 (2.74)     22.7365 (2.74)     0.0000 (1.0)      22.7365 (2.74)     0.0000 (1.0)           0;0  0.0440 (0.37)          1           1
test_data_status_all_flags-data-new[3.60.1]      8.3123 (1.0)       8.3123 (1.0)       8.3123 (1.0)      0.0000 (1.0)       8.3123 (1.0)      0.0000 (1.0)           0;0  0.1203 (1.0)           1           1
test_data_status_all_flags-data-new[main]        8.8878 (1.07)      8.8878 (1.07)      8.8878 (1.07)     0.0000 (1.0)       8.8878 (1.07)     0.0000 (1.0)           0;0  0.1125 (0.94)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     6.6380 (1.37)     6.6380 (1.37)     6.6380 (1.37)     0.0000 (1.0)      6.6380 (1.37)     0.0000 (1.0)           0;0  0.1506 (0.73)          1           1
test_data_status_all_flags-data-noop[3.10.0]     7.3536 (1.52)     7.3536 (1.52)     7.3536 (1.52)     0.0000 (1.0)      7.3536 (1.52)     0.0000 (1.0)           0;0  0.1360 (0.66)          1           1
test_data_status_all_flags-data-noop[3.53.2]     7.4822 (1.55)     7.4822 (1.55)     7.4822 (1.55)     0.0000 (1.0)      7.4822 (1.55)     0.0000 (1.0)           0;0  0.1337 (0.65)          1           1
test_data_status_all_flags-data-noop[3.60.1]     4.8340 (1.0)      4.8340 (1.0)      4.8340 (1.0)      0.0000 (1.0)      4.8340 (1.0)      0.0000 (1.0)           0;0  0.2069 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       5.4147 (1.12)     5.4147 (1.12)     5.4147 (1.12)     0.0000 (1.0)      5.4147 (1.12)     0.0000 (1.0)           0;0  0.1847 (0.89)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     18.0255 (2.63)     18.0255 (2.63)     18.0255 (2.63)     0.0000 (1.0)      18.0255 (2.63)     0.0000 (1.0)           0;0  0.0555 (0.38)          1           1
test_diff-diff[3.10.0]     19.6228 (2.86)     19.6228 (2.86)     19.6228 (2.86)     0.0000 (1.0)      19.6228 (2.86)     0.0000 (1.0)           0;0  0.0510 (0.35)          1           1
test_diff-diff[3.53.2]     19.2361 (2.81)     19.2361 (2.81)     19.2361 (2.81)     0.0000 (1.0)      19.2361 (2.81)     0.0000 (1.0)           0;0  0.0520 (0.36)          1           1
test_diff-diff[3.60.1]      6.8497 (1.0)       6.8497 (1.0)       6.8497 (1.0)      0.0000 (1.0)       6.8497 (1.0)      0.0000 (1.0)           0;0  0.1460 (1.0)           1           1
test_diff-diff[main]        7.9460 (1.16)      7.9460 (1.16)      7.9460 (1.16)     0.0000 (1.0)       7.9460 (1.16)     0.0000 (1.0)           0;0  0.1258 (0.86)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     6.2263 (1.84)     6.2263 (1.84)     6.2263 (1.84)     0.0000 (1.0)      6.2263 (1.84)     0.0000 (1.0)           0;0  0.1606 (0.54)          1           1
test_diff-diff-changed[3.10.0]     6.8850 (2.04)     6.8850 (2.04)     6.8850 (2.04)     0.0000 (1.0)      6.8850 (2.04)     0.0000 (1.0)           0;0  0.1452 (0.49)          1           1
test_diff-diff-changed[3.53.2]     5.8124 (1.72)     5.8124 (1.72)     5.8124 (1.72)     0.0000 (1.0)      5.8124 (1.72)     0.0000 (1.0)           0;0  0.1720 (0.58)          1           1
test_diff-diff-changed[3.60.1]     3.3782 (1.0)      3.3782 (1.0)      3.3782 (1.0)      0.0000 (1.0)      3.3782 (1.0)      0.0000 (1.0)           0;0  0.2960 (1.0)           1           1
test_diff-diff-changed[main]       4.1958 (1.24)     4.1958 (1.24)     4.1958 (1.24)     0.0000 (1.0)      4.1958 (1.24)     0.0000 (1.0)           0;0  0.2383 (0.81)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.1625 (1.47)     5.1625 (1.47)     5.1625 (1.47)     0.0000 (1.0)      5.1625 (1.47)     0.0000 (1.0)           0;0  0.1937 (0.68)          1           1
test_diff-diff-changed-noop[3.10.0]     5.8765 (1.68)     5.8765 (1.68)     5.8765 (1.68)     0.0000 (1.0)      5.8765 (1.68)     0.0000 (1.0)           0;0  0.1702 (0.60)          1           1
test_diff-diff-changed-noop[3.53.2]     5.5877 (1.59)     5.5877 (1.59)     5.5877 (1.59)     0.0000 (1.0)      5.5877 (1.59)     0.0000 (1.0)           0;0  0.1790 (0.63)          1           1
test_diff-diff-changed-noop[3.60.1]     3.5057 (1.0)      3.5057 (1.0)      3.5057 (1.0)      0.0000 (1.0)      3.5057 (1.0)      0.0000 (1.0)           0;0  0.2853 (1.0)           1           1
test_diff-diff-changed-noop[main]       4.2154 (1.20)     4.2154 (1.20)     4.2154 (1.20)     0.0000 (1.0)      4.2154 (1.20)     0.0000 (1.0)           0;0  0.2372 (0.83)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.2994 (1.25)     4.2994 (1.25)     4.2994 (1.25)     0.0000 (1.0)      4.2994 (1.25)     0.0000 (1.0)           0;0  0.2326 (0.80)          1           1
test_diff-diff-noop[3.10.0]     5.0621 (1.48)     5.0621 (1.48)     5.0621 (1.48)     0.0000 (1.0)      5.0621 (1.48)     0.0000 (1.0)           0;0  0.1975 (0.68)          1           1
test_diff-diff-noop[3.53.2]     5.7847 (1.69)     5.7847 (1.69)     5.7847 (1.69)     0.0000 (1.0)      5.7847 (1.69)     0.0000 (1.0)           0;0  0.1729 (0.59)          1           1
test_diff-diff-noop[3.60.1]     3.4298 (1.0)      3.4298 (1.0)      3.4298 (1.0)      0.0000 (1.0)      3.4298 (1.0)      0.0000 (1.0)           0;0  0.2916 (1.0)           1           1
test_diff-diff-noop[main]       4.1643 (1.21)     4.1643 (1.21)     4.1643 (1.21)     0.0000 (1.0)      4.1643 (1.21)     0.0000 (1.0)           0;0  0.2401 (0.82)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

------------------------------------------------------------------------ benchmark 'test_exp_show-exp': 5 tests ------------------------------------------------------------------------
Name (time in s)                 Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]     1.2542 (1.0)      1.2542 (1.0)      1.2542 (1.0)      0.0000 (1.0)      1.2542 (1.0)      0.0000 (1.0)           0;0  0.7973 (1.0)           1           1
test_exp_show-exp[3.10.0]     5.7484 (4.58)     5.7484 (4.58)     5.7484 (4.58)     0.0000 (1.0)      5.7484 (4.58)     0.0000 (1.0)           0;0  0.1740 (0.22)          1           1
test_exp_show-exp[3.53.2]     3.4530 (2.75)     3.4530 (2.75)     3.4530 (2.75)     0.0000 (1.0)      3.4530 (2.75)     0.0000 (1.0)           0;0  0.2896 (0.36)          1           1
test_exp_show-exp[3.60.1]     3.5141 (2.80)     3.5141 (2.80)     3.5141 (2.80)     0.0000 (1.0)      3.5141 (2.80)     0.0000 (1.0)           0;0  0.2846 (0.36)          1           1
test_exp_show-exp[main]       6.2666 (5.00)     6.2666 (5.00)     6.2666 (5.00)     0.0000 (1.0)      6.2666 (5.00)     0.0000 (1.0)           0;0  0.1596 (0.20)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

---------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests ----------------------------------------------------------------------------
Name (time in s)                  Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     108.5079 (4.61)     108.5079 (4.61)     108.5079 (4.61)     0.0000 (1.0)      108.5079 (4.61)     0.0000 (1.0)           0;0  0.0092 (0.22)          1           1
test_fetch-fetch[3.10.0]     113.8500 (4.84)     113.8500 (4.84)     113.8500 (4.84)     0.0000 (1.0)      113.8500 (4.84)     0.0000 (1.0)           0;0  0.0088 (0.21)          1           1
test_fetch-fetch[3.53.2]      33.2643 (1.41)      33.2643 (1.41)      33.2643 (1.41)     0.0000 (1.0)       33.2643 (1.41)     0.0000 (1.0)           0;0  0.0301 (0.71)          1           1
test_fetch-fetch[3.60.1]      23.6482 (1.01)      23.6482 (1.01)      23.6482 (1.01)     0.0000 (1.0)       23.6482 (1.01)     0.0000 (1.0)           0;0  0.0423 (0.99)          1           1
test_fetch-fetch[main]        23.5271 (1.0)       23.5271 (1.0)       23.5271 (1.0)      0.0000 (1.0)       23.5271 (1.0)      0.0000 (1.0)           0;0  0.0425 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.8871 (1.0)      2.8871 (1.0)      2.8871 (1.0)      0.0000 (1.0)      2.8871 (1.0)      0.0000 (1.0)           0;0  0.3464 (1.0)           1           1
test_gc-gc[3.10.0]     3.1758 (1.10)     3.1758 (1.10)     3.1758 (1.10)     0.0000 (1.0)      3.1758 (1.10)     0.0000 (1.0)           0;0  0.3149 (0.91)          1           1
test_gc-gc[3.53.2]     2.9605 (1.03)     2.9605 (1.03)     2.9605 (1.03)     0.0000 (1.0)      2.9605 (1.03)     0.0000 (1.0)           0;0  0.3378 (0.98)          1           1
test_gc-gc[3.60.1]     3.0630 (1.06)     3.0630 (1.06)     3.0630 (1.06)     0.0000 (1.0)      3.0630 (1.06)     0.0000 (1.0)           0;0  0.3265 (0.94)          1           1
test_gc-gc[main]       2.9192 (1.01)     2.9192 (1.01)     2.9192 (1.01)     0.0000 (1.0)      2.9192 (1.01)     0.0000 (1.0)           0;0  0.3426 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     168.4504 (3.42)     168.4504 (3.42)     168.4504 (3.42)     0.0000 (1.0)      168.4504 (3.42)     0.0000 (1.0)           0;0  0.0059 (0.29)          1           1
test_get-get[3.10.0]     204.8875 (4.16)     204.8875 (4.16)     204.8875 (4.16)     0.0000 (1.0)      204.8875 (4.16)     0.0000 (1.0)           0;0  0.0049 (0.24)          1           1
test_get-get[3.53.2]     147.2453 (2.99)     147.2453 (2.99)     147.2453 (2.99)     0.0000 (1.0)      147.2453 (2.99)     0.0000 (1.0)           0;0  0.0068 (0.33)          1           1
test_get-get[3.60.1]      49.4420 (1.00)      49.4420 (1.00)      49.4420 (1.00)     0.0000 (1.0)       49.4420 (1.00)     0.0000 (1.0)           0;0  0.0202 (1.00)          1           1
test_get-get[main]        49.2288 (1.0)       49.2288 (1.0)       49.2288 (1.0)      0.0000 (1.0)       49.2288 (1.0)      0.0000 (1.0)           0;0  0.0203 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     82.8475 (5.51)     82.8475 (5.51)     82.8475 (5.51)     0.0000 (1.0)      82.8475 (5.51)     0.0000 (1.0)           0;0  0.0121 (0.18)          1           1
test_get_url-get-url[3.10.0]     85.3090 (5.68)     85.3090 (5.68)     85.3090 (5.68)     0.0000 (1.0)      85.3090 (5.68)     0.0000 (1.0)           0;0  0.0117 (0.18)          1           1
test_get_url-get-url[3.53.2]     15.3436 (1.02)     15.3436 (1.02)     15.3436 (1.02)     0.0000 (1.0)      15.3436 (1.02)     0.0000 (1.0)           0;0  0.0652 (0.98)          1           1
test_get_url-get-url[3.60.1]     15.1945 (1.01)     15.1945 (1.01)     15.1945 (1.01)     0.0000 (1.0)      15.1945 (1.01)     0.0000 (1.0)           0;0  0.0658 (0.99)          1           1
test_get_url-get-url[main]       15.0293 (1.0)      15.0293 (1.0)      15.0293 (1.0)      0.0000 (1.0)      15.0293 (1.0)      0.0000 (1.0)           0;0  0.0665 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     170.7739 (1.05)     187.2315 (1.06)     175.2058 (1.02)     3.2152 (1.42)     174.4696 (1.02)     4.3594 (1.31)         24;2  5.7076 (0.98)        100           1
test_help---help[3.10.0]     167.3188 (1.02)     177.4260 (1.0)      171.5906 (1.0)      2.2660 (1.0)      171.3915 (1.0)      3.3178 (1.0)          35;0  5.8278 (1.0)         100           1
test_help---help[3.53.2]     169.9909 (1.04)     199.6582 (1.13)     177.7374 (1.04)     5.5521 (2.45)     176.4379 (1.03)     5.7122 (1.72)         24;8  5.6263 (0.97)        100           1
test_help---help[3.60.1]     170.0753 (1.04)     193.9895 (1.09)     180.3133 (1.05)     4.9360 (2.18)     180.3789 (1.05)     6.0984 (1.84)         33;3  5.5459 (0.95)        100           1
test_help---help[main]       163.4200 (1.0)      185.5841 (1.05)     172.5092 (1.01)     4.3038 (1.90)     172.0235 (1.00)     5.4334 (1.64)         31;2  5.7968 (0.99)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     258.6523 (3.42)     258.6523 (3.42)     258.6523 (3.42)     0.0000 (1.0)      258.6523 (3.42)     0.0000 (1.0)           0;0  0.0039 (0.29)          1           1
test_import-import[3.10.0]     292.3234 (3.86)     292.3234 (3.86)     292.3234 (3.86)     0.0000 (1.0)      292.3234 (3.86)     0.0000 (1.0)           0;0  0.0034 (0.26)          1           1
test_import-import[3.60.1]      75.7261 (1.0)       75.7261 (1.0)       75.7261 (1.0)      0.0000 (1.0)       75.7261 (1.0)      0.0000 (1.0)           0;0  0.0132 (1.0)           1           1
test_import-import[main]        77.5050 (1.02)      77.5050 (1.02)      77.5050 (1.02)     0.0000 (1.0)       77.5050 (1.02)     0.0000 (1.0)           0;0  0.0129 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     190.1912 (4.25)     190.1912 (4.25)     190.1912 (4.25)     0.0000 (1.0)      190.1912 (4.25)     0.0000 (1.0)           0;0  0.0053 (0.24)          1           1
test_import_url-import-url[3.10.0]     194.7415 (4.35)     194.7415 (4.35)     194.7415 (4.35)     0.0000 (1.0)      194.7415 (4.35)     0.0000 (1.0)           0;0  0.0051 (0.23)          1           1
test_import_url-import-url[3.53.2]     110.5278 (2.47)     110.5278 (2.47)     110.5278 (2.47)     0.0000 (1.0)      110.5278 (2.47)     0.0000 (1.0)           0;0  0.0090 (0.41)          1           1
test_import_url-import-url[3.60.1]      44.7769 (1.0)       44.7769 (1.0)       44.7769 (1.0)      0.0000 (1.0)       44.7769 (1.0)      0.0000 (1.0)           0;0  0.0223 (1.0)           1           1
test_import_url-import-url[main]        47.4629 (1.06)      47.4629 (1.06)      47.4629 (1.06)     0.0000 (1.0)       47.4629 (1.06)     0.0000 (1.0)           0;0  0.0211 (0.94)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

----------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     453.4549 (1.04)     498.3249 (1.0)      466.8041 (1.01)      8.0232 (1.0)      465.3940 (1.02)      7.6545 (1.0)          28;6  2.1422 (0.99)        100           1
test_init-init[3.10.0]     446.0102 (1.03)     519.7562 (1.04)     473.1885 (1.03)     10.6736 (1.33)     472.4445 (1.03)     11.6591 (1.52)         29;3  2.1133 (0.97)        100           1
test_init-init[3.53.2]     435.0168 (1.0)      596.6805 (1.20)     459.9704 (1.0)      17.6926 (2.21)     456.4823 (1.0)      10.6839 (1.40)          7;7  2.1741 (1.0)         100           1
test_init-init[3.60.1]     443.1066 (1.02)     503.1058 (1.01)     464.4880 (1.01)      8.9617 (1.12)     463.0041 (1.01)     10.7513 (1.40)         28;3  2.1529 (0.99)        100           1
test_init-init[main]       481.5847 (1.11)     643.6383 (1.29)     507.6962 (1.10)     18.1843 (2.27)     504.3723 (1.10)     12.2984 (1.61)          9;3  1.9697 (0.91)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     562.5845 (1.03)     562.5845 (1.03)     562.5845 (1.03)     0.0000 (1.0)      562.5845 (1.03)     0.0000 (1.0)           0;0  1.7775 (0.97)          1           1
test_list-list[3.10.0]     823.6594 (1.51)     823.6594 (1.51)     823.6594 (1.51)     0.0000 (1.0)      823.6594 (1.51)     0.0000 (1.0)           0;0  1.2141 (0.66)          1           1
test_list-list[3.53.2]     562.5828 (1.03)     562.5828 (1.03)     562.5828 (1.03)     0.0000 (1.0)      562.5828 (1.03)     0.0000 (1.0)           0;0  1.7775 (0.97)          1           1
test_list-list[3.60.1]     581.8735 (1.06)     581.8735 (1.06)     581.8735 (1.06)     0.0000 (1.0)      581.8735 (1.06)     0.0000 (1.0)           0;0  1.7186 (0.94)          1           1
test_list-list[main]       547.0945 (1.0)      547.0945 (1.0)      547.0945 (1.0)      0.0000 (1.0)      547.0945 (1.0)      0.0000 (1.0)           0;0  1.8278 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     389.8580 (1.05)     389.8580 (1.05)     389.8580 (1.05)     0.0000 (1.0)      389.8580 (1.05)     0.0000 (1.0)           0;0  2.5650 (0.95)          1           1
test_list-list-dvc-only[3.10.0]     391.6825 (1.05)     391.6825 (1.05)     391.6825 (1.05)     0.0000 (1.0)      391.6825 (1.05)     0.0000 (1.0)           0;0  2.5531 (0.95)          1           1
test_list-list-dvc-only[3.53.2]     371.7375 (1.0)      371.7375 (1.0)      371.7375 (1.0)      0.0000 (1.0)      371.7375 (1.0)      0.0000 (1.0)           0;0  2.6901 (1.0)           1           1
test_list-list-dvc-only[3.60.1]     371.7757 (1.00)     371.7757 (1.00)     371.7757 (1.00)     0.0000 (1.0)      371.7757 (1.00)     0.0000 (1.0)           0;0  2.6898 (1.00)          1           1
test_list-list-dvc-only[main]       385.1754 (1.04)     385.1754 (1.04)     385.1754 (1.04)     0.0000 (1.0)      385.1754 (1.04)     0.0000 (1.0)           0;0  2.5962 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.1302 (1.0)      2.1302 (1.0)      2.1302 (1.0)      0.0000 (1.0)      2.1302 (1.0)      0.0000 (1.0)           0;0  0.4694 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.2203 (1.04)     2.2203 (1.04)     2.2203 (1.04)     0.0000 (1.0)      2.2203 (1.04)     0.0000 (1.0)           0;0  0.4504 (0.96)          1           1
test_list-list-recursive[3.53.2]     2.4600 (1.15)     2.4600 (1.15)     2.4600 (1.15)     0.0000 (1.0)      2.4600 (1.15)     0.0000 (1.0)           0;0  0.4065 (0.87)          1           1
test_list-list-recursive[3.60.1]     2.4820 (1.17)     2.4820 (1.17)     2.4820 (1.17)     0.0000 (1.0)      2.4820 (1.17)     0.0000 (1.0)           0;0  0.4029 (0.86)          1           1
test_list-list-recursive[main]       2.5489 (1.20)     2.5489 (1.20)     2.5489 (1.20)     0.0000 (1.0)      2.5489 (1.20)     0.0000 (1.0)           0;0  0.3923 (0.84)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     389.1077 (1.06)     389.1077 (1.06)     389.1077 (1.06)     0.0000 (1.0)      389.1077 (1.06)     0.0000 (1.0)           0;0  2.5700 (0.94)          1           1
test_list-list-shallow[3.10.0]     411.9929 (1.12)     411.9929 (1.12)     411.9929 (1.12)     0.0000 (1.0)      411.9929 (1.12)     0.0000 (1.0)           0;0  2.4272 (0.89)          1           1
test_list-list-shallow[3.53.2]     367.4382 (1.0)      367.4382 (1.0)      367.4382 (1.0)      0.0000 (1.0)      367.4382 (1.0)      0.0000 (1.0)           0;0  2.7215 (1.0)           1           1
test_list-list-shallow[3.60.1]     374.8874 (1.02)     374.8874 (1.02)     374.8874 (1.02)     0.0000 (1.0)      374.8874 (1.02)     0.0000 (1.0)           0;0  2.6675 (0.98)          1           1
test_list-list-shallow[main]       383.7600 (1.04)     383.7600 (1.04)     383.7600 (1.04)     0.0000 (1.0)      383.7600 (1.04)     0.0000 (1.0)           0;0  2.6058 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     67.1726 (3.55)     67.1726 (3.55)     67.1726 (3.55)     0.0000 (1.0)      67.1726 (3.55)     0.0000 (1.0)           0;0  0.0149 (0.28)          1           1
test_partial_add-add[3.10.0]     68.5241 (3.62)     68.5241 (3.62)     68.5241 (3.62)     0.0000 (1.0)      68.5241 (3.62)     0.0000 (1.0)           0;0  0.0146 (0.28)          1           1
test_partial_add-add[3.53.2]     60.7701 (3.21)     60.7701 (3.21)     60.7701 (3.21)     0.0000 (1.0)      60.7701 (3.21)     0.0000 (1.0)           0;0  0.0165 (0.31)          1           1
test_partial_add-add[3.60.1]     18.9310 (1.0)      18.9310 (1.0)      18.9310 (1.0)      0.0000 (1.0)      18.9310 (1.0)      0.0000 (1.0)           0;0  0.0528 (1.0)           1           1
test_partial_add-add[main]       19.8343 (1.05)     19.8343 (1.05)     19.8343 (1.05)     0.0000 (1.0)      19.8343 (1.05)     0.0000 (1.0)           0;0  0.0504 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     55.8108 (7.87)     55.8108 (7.87)     55.8108 (7.87)     0.0000 (1.0)      55.8108 (7.87)     0.0000 (1.0)           0;0  0.0179 (0.13)          1           1
test_partial_add-add-partial[3.10.0]     56.8846 (8.02)     56.8846 (8.02)     56.8846 (8.02)     0.0000 (1.0)      56.8846 (8.02)     0.0000 (1.0)           0;0  0.0176 (0.12)          1           1
test_partial_add-add-partial[3.53.2]     51.3274 (7.23)     51.3274 (7.23)     51.3274 (7.23)     0.0000 (1.0)      51.3274 (7.23)     0.0000 (1.0)           0;0  0.0195 (0.14)          1           1
test_partial_add-add-partial[3.60.1]      7.0957 (1.0)       7.0957 (1.0)       7.0957 (1.0)      0.0000 (1.0)       7.0957 (1.0)      0.0000 (1.0)           0;0  0.1409 (1.0)           1           1
test_partial_add-add-partial[main]        7.4163 (1.05)      7.4163 (1.05)      7.4163 (1.05)     0.0000 (1.0)       7.4163 (1.05)     0.0000 (1.0)           0;0  0.1348 (0.96)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.4893 (1.0)      4.4893 (1.0)      4.4893 (1.0)      0.0000 (1.0)      4.4893 (1.0)      0.0000 (1.0)           0;0  0.2228 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     5.7956 (1.29)     5.7956 (1.29)     5.7956 (1.29)     0.0000 (1.0)      5.7956 (1.29)     0.0000 (1.0)           0;0  0.1725 (0.77)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     6.6449 (1.48)     6.6449 (1.48)     6.6449 (1.48)     0.0000 (1.0)      6.6449 (1.48)     0.0000 (1.0)           0;0  0.1505 (0.68)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     6.6686 (1.49)     6.6686 (1.49)     6.6686 (1.49)     0.0000 (1.0)      6.6686 (1.49)     0.0000 (1.0)           0;0  0.1500 (0.67)          1           1
test_partial_add-gc-cloud-noop[main]       5.6786 (1.26)     5.6786 (1.26)     5.6786 (1.26)     0.0000 (1.0)      5.6786 (1.26)     0.0000 (1.0)           0;0  0.1761 (0.79)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.4353 (1.0)      2.4353 (1.0)      2.4353 (1.0)      0.0000 (1.0)      2.4353 (1.0)      0.0000 (1.0)           0;0  0.4106 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.6649 (1.50)     3.6649 (1.50)     3.6649 (1.50)     0.0000 (1.0)      3.6649 (1.50)     0.0000 (1.0)           0;0  0.2729 (0.66)          1           1
test_partial_add-gc-noop[3.53.2]     3.8102 (1.56)     3.8102 (1.56)     3.8102 (1.56)     0.0000 (1.0)      3.8102 (1.56)     0.0000 (1.0)           0;0  0.2625 (0.64)          1           1
test_partial_add-gc-noop[3.60.1]     3.7409 (1.54)     3.7409 (1.54)     3.7409 (1.54)     0.0000 (1.0)      3.7409 (1.54)     0.0000 (1.0)           0;0  0.2673 (0.65)          1           1
test_partial_add-gc-noop[main]       2.7461 (1.13)     2.7461 (1.13)     2.7461 (1.13)     0.0000 (1.0)      2.7461 (1.13)     0.0000 (1.0)           0;0  0.3642 (0.89)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     79.2870 (4.29)     79.2870 (4.29)     79.2870 (4.29)     0.0000 (1.0)      79.2870 (4.29)     0.0000 (1.0)           0;0  0.0126 (0.23)          1           1
test_partial_add-push[3.10.0]     36.7201 (1.98)     36.7201 (1.98)     36.7201 (1.98)     0.0000 (1.0)      36.7201 (1.98)     0.0000 (1.0)           0;0  0.0272 (0.50)          1           1
test_partial_add-push[3.53.2]     19.1168 (1.03)     19.1168 (1.03)     19.1168 (1.03)     0.0000 (1.0)      19.1168 (1.03)     0.0000 (1.0)           0;0  0.0523 (0.97)          1           1
test_partial_add-push[3.60.1]     18.5011 (1.0)      18.5011 (1.0)      18.5011 (1.0)      0.0000 (1.0)      18.5011 (1.0)      0.0000 (1.0)           0;0  0.0541 (1.0)           1           1
test_partial_add-push[main]       18.5479 (1.00)     18.5479 (1.00)     18.5479 (1.00)     0.0000 (1.0)      18.5479 (1.00)     0.0000 (1.0)           0;0  0.0539 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     17.0072 (1.72)     17.0072 (1.72)     17.0072 (1.72)     0.0000 (1.0)      17.0072 (1.72)     0.0000 (1.0)           0;0  0.0588 (0.58)          1           1
test_partial_add-push-partial[3.10.0]      9.9165 (1.0)       9.9165 (1.0)       9.9165 (1.0)      0.0000 (1.0)       9.9165 (1.0)      0.0000 (1.0)           0;0  0.1008 (1.0)           1           1
test_partial_add-push-partial[3.53.2]     10.2577 (1.03)     10.2577 (1.03)     10.2577 (1.03)     0.0000 (1.0)      10.2577 (1.03)     0.0000 (1.0)           0;0  0.0975 (0.97)          1           1
test_partial_add-push-partial[3.60.1]      9.9668 (1.01)      9.9668 (1.01)      9.9668 (1.01)     0.0000 (1.0)       9.9668 (1.01)     0.0000 (1.0)           0;0  0.1003 (0.99)          1           1
test_partial_add-push-partial[main]       10.0811 (1.02)     10.0811 (1.02)     10.0811 (1.02)     0.0000 (1.0)      10.0811 (1.02)     0.0000 (1.0)           0;0  0.0992 (0.98)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     57.6809 (4.09)     57.6809 (4.09)     57.6809 (4.09)     0.0000 (1.0)      57.6809 (4.09)     0.0000 (1.0)           0;0  0.0173 (0.24)          1           1
test_partial_remove-add[3.10.0]     59.0455 (4.19)     59.0455 (4.19)     59.0455 (4.19)     0.0000 (1.0)      59.0455 (4.19)     0.0000 (1.0)           0;0  0.0169 (0.24)          1           1
test_partial_remove-add[3.53.2]     50.6413 (3.59)     50.6413 (3.59)     50.6413 (3.59)     0.0000 (1.0)      50.6413 (3.59)     0.0000 (1.0)           0;0  0.0197 (0.28)          1           1
test_partial_remove-add[3.60.1]     14.0929 (1.0)      14.0929 (1.0)      14.0929 (1.0)      0.0000 (1.0)      14.0929 (1.0)      0.0000 (1.0)           0;0  0.0710 (1.0)           1           1
test_partial_remove-add[main]       15.3634 (1.09)     15.3634 (1.09)     15.3634 (1.09)     0.0000 (1.0)      15.3634 (1.09)     0.0000 (1.0)           0;0  0.0651 (0.92)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     6.0205 (6.45)     6.0205 (6.45)     6.0205 (6.45)     0.0000 (1.0)      6.0205 (6.45)     0.0000 (1.0)           0;0  0.1661 (0.16)          1           1
test_partial_remove-add-update[3.10.0]     6.1829 (6.63)     6.1829 (6.63)     6.1829 (6.63)     0.0000 (1.0)      6.1829 (6.63)     0.0000 (1.0)           0;0  0.1617 (0.15)          1           1
test_partial_remove-add-update[3.53.2]     5.1734 (5.54)     5.1734 (5.54)     5.1734 (5.54)     0.0000 (1.0)      5.1734 (5.54)     0.0000 (1.0)           0;0  0.1933 (0.18)          1           1
test_partial_remove-add-update[3.60.1]     0.9333 (1.0)      0.9333 (1.0)      0.9333 (1.0)      0.0000 (1.0)      0.9333 (1.0)      0.0000 (1.0)           0;0  1.0715 (1.0)           1           1
test_partial_remove-add-update[main]       1.0140 (1.09)     1.0140 (1.09)     1.0140 (1.09)     0.0000 (1.0)      1.0140 (1.09)     0.0000 (1.0)           0;0  0.9862 (0.92)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     2.3323 (1.01)     2.3323 (1.01)     2.3323 (1.01)     0.0000 (1.0)      2.3323 (1.01)     0.0000 (1.0)           0;0  0.4288 (0.99)          1           1
test_partial_remove-gc[3.10.0]     2.6831 (1.16)     2.6831 (1.16)     2.6831 (1.16)     0.0000 (1.0)      2.6831 (1.16)     0.0000 (1.0)           0;0  0.3727 (0.86)          1           1
test_partial_remove-gc[3.53.2]     2.6401 (1.14)     2.6401 (1.14)     2.6401 (1.14)     0.0000 (1.0)      2.6401 (1.14)     0.0000 (1.0)           0;0  0.3788 (0.88)          1           1
test_partial_remove-gc[3.60.1]     2.4384 (1.06)     2.4384 (1.06)     2.4384 (1.06)     0.0000 (1.0)      2.4384 (1.06)     0.0000 (1.0)           0;0  0.4101 (0.95)          1           1
test_partial_remove-gc[main]       2.3101 (1.0)      2.3101 (1.0)      2.3101 (1.0)      0.0000 (1.0)      2.3101 (1.0)      0.0000 (1.0)           0;0  0.4329 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     3.7964 (1.0)      3.7964 (1.0)      3.7964 (1.0)      0.0000 (1.0)      3.7964 (1.0)      0.0000 (1.0)           0;0  0.2634 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     4.2504 (1.12)     4.2504 (1.12)     4.2504 (1.12)     0.0000 (1.0)      4.2504 (1.12)     0.0000 (1.0)           0;0  0.2353 (0.89)          1           1
test_partial_remove-gc-cloud[3.53.2]     3.8008 (1.00)     3.8008 (1.00)     3.8008 (1.00)     0.0000 (1.0)      3.8008 (1.00)     0.0000 (1.0)           0;0  0.2631 (1.00)          1           1
test_partial_remove-gc-cloud[3.60.1]     4.0362 (1.06)     4.0362 (1.06)     4.0362 (1.06)     0.0000 (1.0)      4.0362 (1.06)     0.0000 (1.0)           0;0  0.2478 (0.94)          1           1
test_partial_remove-gc-cloud[main]       3.8648 (1.02)     3.8648 (1.02)     3.8648 (1.02)     0.0000 (1.0)      3.8648 (1.02)     0.0000 (1.0)           0;0  0.2587 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     83.5010 (5.91)     83.5010 (5.91)     83.5010 (5.91)     0.0000 (1.0)      83.5010 (5.91)     0.0000 (1.0)           0;0  0.0120 (0.17)          1           1
test_partial_remove-push[3.10.0]     36.3233 (2.57)     36.3233 (2.57)     36.3233 (2.57)     0.0000 (1.0)      36.3233 (2.57)     0.0000 (1.0)           0;0  0.0275 (0.39)          1           1
test_partial_remove-push[3.53.2]     14.8147 (1.05)     14.8147 (1.05)     14.8147 (1.05)     0.0000 (1.0)      14.8147 (1.05)     0.0000 (1.0)           0;0  0.0675 (0.95)          1           1
test_partial_remove-push[3.60.1]     14.1184 (1.0)      14.1184 (1.0)      14.1184 (1.0)      0.0000 (1.0)      14.1184 (1.0)      0.0000 (1.0)           0;0  0.0708 (1.0)           1           1
test_partial_remove-push[main]       14.3032 (1.01)     14.3032 (1.01)     14.3032 (1.01)     0.0000 (1.0)      14.3032 (1.01)     0.0000 (1.0)           0;0  0.0699 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     1.6398 (1.0)      1.6398 (1.0)      1.6398 (1.0)      0.0000 (1.0)      1.6398 (1.0)      0.0000 (1.0)           0;0  0.6098 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     1.6445 (1.00)     1.6445 (1.00)     1.6445 (1.00)     0.0000 (1.0)      1.6445 (1.00)     0.0000 (1.0)           0;0  0.6081 (1.00)          1           1
test_partial_remove-push-update[3.53.2]     2.1915 (1.34)     2.1915 (1.34)     2.1915 (1.34)     0.0000 (1.0)      2.1915 (1.34)     0.0000 (1.0)           0;0  0.4563 (0.75)          1           1
test_partial_remove-push-update[3.60.1]     2.1896 (1.34)     2.1896 (1.34)     2.1896 (1.34)     0.0000 (1.0)      2.1896 (1.34)     0.0000 (1.0)           0;0  0.4567 (0.75)          1           1
test_partial_remove-push-update[main]       2.1622 (1.32)     2.1622 (1.32)     2.1622 (1.32)     0.0000 (1.0)      2.1622 (1.32)     0.0000 (1.0)           0;0  0.4625 (0.76)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests --------------------------------------------------------------------------------
Name (time in ms)                      Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     621.8655 (1.0)        789.4606 (1.0)        672.5363 (1.0)      72.4603 (29.61)      628.6888 (1.0)      95.8731 (29.32)         1;0  1.4869 (1.0)           5           3
test_plots-plots-diff[3.10.0]     995.2781 (1.60)     1,020.2854 (1.29)     1,005.4821 (1.50)      9.6543 (3.95)     1,003.2660 (1.60)     13.1105 (4.01)          2;0  0.9945 (0.67)          5           3
test_plots-plots-diff[3.53.2]     916.3690 (1.47)       929.7921 (1.18)       921.5881 (1.37)      5.1162 (2.09)       921.0737 (1.47)      6.1302 (1.87)          2;0  1.0851 (0.73)          5           3
test_plots-plots-diff[3.60.1]     907.8241 (1.46)       914.3381 (1.16)       911.2377 (1.35)      2.4470 (1.0)        910.9273 (1.45)      3.2697 (1.0)           2;0  1.0974 (0.74)          5           3
test_plots-plots-diff[main]       911.8884 (1.47)       951.4104 (1.21)       929.6427 (1.38)     15.7169 (6.42)       929.4211 (1.48)     24.5699 (7.51)          2;0  1.0757 (0.72)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       684.0505 (1.0)        751.5719 (1.0)        726.9088 (1.0)      27.8690 (5.87)       732.2517 (1.0)      41.7663 (7.48)          1;0  1.3757 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,264.6223 (1.85)     1,291.8147 (1.72)     1,278.8992 (1.76)     11.5725 (2.44)     1,276.4018 (1.74)     19.8475 (3.55)          2;0  0.7819 (0.57)          5           3
test_plots-plots-diff-json[3.53.2]     1,050.8876 (1.54)     1,087.3175 (1.45)     1,069.1485 (1.47)     16.9818 (3.57)     1,062.7895 (1.45)     31.0689 (5.56)          3;0  0.9353 (0.68)          5           3
test_plots-plots-diff-json[3.60.1]       983.4559 (1.44)       996.5199 (1.33)       989.9565 (1.36)      4.7510 (1.0)        990.2658 (1.35)      5.5864 (1.0)           2;0  1.0101 (0.73)          5           3
test_plots-plots-diff-json[main]         999.1846 (1.46)     1,029.0140 (1.37)     1,012.3116 (1.39)     11.4275 (2.41)     1,012.3550 (1.38)     15.9765 (2.86)          2;0  0.9878 (0.72)          5           3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     475.7510 (1.0)      504.8807 (1.0)      488.8529 (1.0)      11.4320 (3.65)     484.5988 (1.0)      16.4824 (7.78)          2;0  2.0456 (1.0)           5           3
test_plots-plots-show[3.10.0]     829.5159 (1.74)     877.1413 (1.74)     853.0265 (1.74)     18.0274 (5.75)     854.2338 (1.76)     25.4304 (12.01)         2;0  1.1723 (0.57)          5           3
test_plots-plots-show[3.53.2]     756.1241 (1.59)     772.1790 (1.53)     764.8430 (1.56)      6.2325 (1.99)     766.3662 (1.58)      9.1235 (4.31)          2;0  1.3075 (0.64)          5           3
test_plots-plots-show[3.60.1]     763.1150 (1.60)     777.8684 (1.54)     767.4930 (1.57)      6.0157 (1.92)     765.6640 (1.58)      6.2666 (2.96)          1;0  1.3029 (0.64)          5           3
test_plots-plots-show[main]       755.4209 (1.59)     762.6196 (1.51)     757.0253 (1.55)      3.1336 (1.0)      755.6144 (1.56)      2.1178 (1.0)           1;1  1.3210 (0.65)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     488.0518 (1.0)      501.1161 (1.0)      494.9555 (1.0)       6.0511 (1.71)     494.4734 (1.0)      11.4729 (2.74)          3;0  2.0204 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     958.7611 (1.96)     998.3460 (1.99)     970.2055 (1.96)     16.2666 (4.59)     966.5301 (1.95)     16.3716 (3.91)          1;0  1.0307 (0.51)          5           3
test_plots-plots-show-json[3.53.2]     806.8403 (1.65)     821.6922 (1.64)     813.6517 (1.64)      5.2907 (1.49)     813.2592 (1.64)      4.3961 (1.05)          2;0  1.2290 (0.61)          5           3
test_plots-plots-show-json[3.60.1]     809.0367 (1.66)     818.6558 (1.63)     814.4130 (1.65)      3.5411 (1.0)      814.7102 (1.65)      4.1841 (1.0)           2;0  1.2279 (0.61)          5           3
test_plots-plots-show-json[main]       802.9557 (1.65)     831.5835 (1.66)     815.9646 (1.65)     11.4316 (3.23)     818.6836 (1.66)     17.1042 (4.09)          2;0  1.2255 (0.61)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

-------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     90.5224 (4.17)     90.5224 (4.17)     90.5224 (4.17)     0.0000 (1.0)      90.5224 (4.17)     0.0000 (1.0)           0;0  0.0110 (0.24)          1           1
test_push-push[3.10.0]     42.2872 (1.95)     42.2872 (1.95)     42.2872 (1.95)     0.0000 (1.0)      42.2872 (1.95)     0.0000 (1.0)           0;0  0.0236 (0.51)          1           1
test_push-push[3.53.2]     22.3648 (1.03)     22.3648 (1.03)     22.3648 (1.03)     0.0000 (1.0)      22.3648 (1.03)     0.0000 (1.0)           0;0  0.0447 (0.97)          1           1
test_push-push[3.60.1]     21.7220 (1.0)      21.7220 (1.0)      21.7220 (1.0)      0.0000 (1.0)      21.7220 (1.0)      0.0000 (1.0)           0;0  0.0460 (1.0)           1           1
test_push-push[main]       22.0675 (1.02)     22.0675 (1.02)     22.0675 (1.02)     0.0000 (1.0)      22.0675 (1.02)     0.0000 (1.0)           0;0  0.0453 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     103.6577 (4.60)     103.6577 (4.60)     103.6577 (4.60)     0.0000 (1.0)      103.6577 (4.60)     0.0000 (1.0)           0;0  0.0096 (0.22)          1           1
test_sharing-fetch[3.10.0]     108.9574 (4.83)     108.9574 (4.83)     108.9574 (4.83)     0.0000 (1.0)      108.9574 (4.83)     0.0000 (1.0)           0;0  0.0092 (0.21)          1           1
test_sharing-fetch[3.53.2]      32.8683 (1.46)      32.8683 (1.46)      32.8683 (1.46)     0.0000 (1.0)       32.8683 (1.46)     0.0000 (1.0)           0;0  0.0304 (0.69)          1           1
test_sharing-fetch[3.60.1]      22.5777 (1.00)      22.5777 (1.00)      22.5777 (1.00)     0.0000 (1.0)       22.5777 (1.00)     0.0000 (1.0)           0;0  0.0443 (1.00)          1           1
test_sharing-fetch[main]        22.5428 (1.0)       22.5428 (1.0)       22.5428 (1.0)      0.0000 (1.0)       22.5428 (1.0)      0.0000 (1.0)           0;0  0.0444 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2873 (1.0)      1.2873 (1.0)      1.2873 (1.0)      0.0000 (1.0)      1.2873 (1.0)      0.0000 (1.0)           0;0  0.7768 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.6320 (2.82)     3.6320 (2.82)     3.6320 (2.82)     0.0000 (1.0)      3.6320 (2.82)     0.0000 (1.0)           0;0  0.2753 (0.35)          1           1
test_sharing-fetch-noop[3.53.2]     5.6808 (4.41)     5.6808 (4.41)     5.6808 (4.41)     0.0000 (1.0)      5.6808 (4.41)     0.0000 (1.0)           0;0  0.1760 (0.23)          1           1
test_sharing-fetch-noop[3.60.1]     5.7855 (4.49)     5.7855 (4.49)     5.7855 (4.49)     0.0000 (1.0)      5.7855 (4.49)     0.0000 (1.0)           0;0  0.1728 (0.22)          1           1
test_sharing-fetch-noop[main]       5.9081 (4.59)     5.9081 (4.59)     5.9081 (4.59)     0.0000 (1.0)      5.9081 (4.59)     0.0000 (1.0)           0;0  0.1693 (0.22)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     92.1255 (4.20)     92.1255 (4.20)     92.1255 (4.20)     0.0000 (1.0)      92.1255 (4.20)     0.0000 (1.0)           0;0  0.0109 (0.24)          1           1
test_sharing-push[3.10.0]     42.7295 (1.95)     42.7295 (1.95)     42.7295 (1.95)     0.0000 (1.0)      42.7295 (1.95)     0.0000 (1.0)           0;0  0.0234 (0.51)          1           1
test_sharing-push[3.53.2]     22.9621 (1.05)     22.9621 (1.05)     22.9621 (1.05)     0.0000 (1.0)      22.9621 (1.05)     0.0000 (1.0)           0;0  0.0436 (0.96)          1           1
test_sharing-push[3.60.1]     21.9473 (1.0)      21.9473 (1.0)      21.9473 (1.0)      0.0000 (1.0)      21.9473 (1.0)      0.0000 (1.0)           0;0  0.0456 (1.0)           1           1
test_sharing-push[main]       22.1273 (1.01)     22.1273 (1.01)     22.1273 (1.01)     0.0000 (1.0)      22.1273 (1.01)     0.0000 (1.0)           0;0  0.0452 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.1231 (1.03)     2.1231 (1.03)     2.1231 (1.03)     0.0000 (1.0)      2.1231 (1.03)     0.0000 (1.0)           0;0  0.4710 (0.97)          1           1
test_sharing-push-noop[3.10.0]     2.0566 (1.0)      2.0566 (1.0)      2.0566 (1.0)      0.0000 (1.0)      2.0566 (1.0)      0.0000 (1.0)           0;0  0.4862 (1.0)           1           1
test_sharing-push-noop[3.53.2]     5.7278 (2.79)     5.7278 (2.79)     5.7278 (2.79)     0.0000 (1.0)      5.7278 (2.79)     0.0000 (1.0)           0;0  0.1746 (0.36)          1           1
test_sharing-push-noop[3.60.1]     5.9681 (2.90)     5.9681 (2.90)     5.9681 (2.90)     0.0000 (1.0)      5.9681 (2.90)     0.0000 (1.0)           0;0  0.1676 (0.34)          1           1
test_sharing-push-noop[main]       6.1044 (2.97)     6.1044 (2.97)     6.1044 (2.97)     0.0000 (1.0)      6.1044 (2.97)     0.0000 (1.0)           0;0  0.1638 (0.34)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     147.5680 (1.05)     147.5680 (1.05)     147.5680 (1.05)     0.0000 (1.0)      147.5680 (1.05)     0.0000 (1.0)           0;0  0.0068 (0.96)          1           1
test_sharing_azure-fetch[main]       141.0079 (1.0)      141.0079 (1.0)      141.0079 (1.0)      0.0000 (1.0)      141.0079 (1.0)      0.0000 (1.0)           0;0  0.0071 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.2206 (1.01)     6.2206 (1.01)     6.2206 (1.01)     0.0000 (1.0)      6.2206 (1.01)     0.0000 (1.0)           0;0  0.1608 (0.99)          1           1
test_sharing_azure-fetch-noop[main]       6.1634 (1.0)      6.1634 (1.0)      6.1634 (1.0)      0.0000 (1.0)      6.1634 (1.0)      0.0000 (1.0)           0;0  0.1622 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     124.8701 (1.0)      124.8701 (1.0)      124.8701 (1.0)      0.0000 (1.0)      124.8701 (1.0)      0.0000 (1.0)           0;0  0.0080 (1.0)           1           1
test_sharing_azure-push[main]       126.0346 (1.01)     126.0346 (1.01)     126.0346 (1.01)     0.0000 (1.0)      126.0346 (1.01)     0.0000 (1.0)           0;0  0.0079 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     6.2286 (1.0)      6.2286 (1.0)      6.2286 (1.0)      0.0000 (1.0)      6.2286 (1.0)      0.0000 (1.0)           0;0  0.1605 (1.0)           1           1
test_sharing_azure-push-noop[main]       6.3425 (1.02)     6.3425 (1.02)     6.3425 (1.02)     0.0000 (1.0)      6.3425 (1.02)     0.0000 (1.0)           0;0  0.1577 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     444.6777 (1.01)     444.6777 (1.01)     444.6777 (1.01)     0.0000 (1.0)      444.6777 (1.01)     0.0000 (1.0)           0;0  0.0022 (0.99)          1           1
test_sharing_s3-fetch[main]       439.8408 (1.0)      439.8408 (1.0)      439.8408 (1.0)      0.0000 (1.0)      439.8408 (1.0)      0.0000 (1.0)           0;0  0.0023 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.3174 (1.0)      6.3174 (1.0)      6.3174 (1.0)      0.0000 (1.0)      6.3174 (1.0)      0.0000 (1.0)           0;0  0.1583 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       6.4563 (1.02)     6.4563 (1.02)     6.4563 (1.02)     0.0000 (1.0)      6.4563 (1.02)     0.0000 (1.0)           0;0  0.1549 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     470.3102 (1.0)      470.3102 (1.0)      470.3102 (1.0)      0.0000 (1.0)      470.3102 (1.0)      0.0000 (1.0)           0;0  0.0021 (1.0)           1           1
test_sharing_s3-push[main]       474.8553 (1.01)     474.8553 (1.01)     474.8553 (1.01)     0.0000 (1.0)      474.8553 (1.01)     0.0000 (1.0)           0;0  0.0021 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     6.4782 (1.0)      6.4782 (1.0)      6.4782 (1.0)      0.0000 (1.0)      6.4782 (1.0)      0.0000 (1.0)           0;0  0.1544 (1.0)           1           1
test_sharing_s3-push-noop[main]       6.6366 (1.02)     6.6366 (1.02)     6.6366 (1.02)     0.0000 (1.0)      6.6366 (1.02)     0.0000 (1.0)           0;0  0.1507 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     19.1386 (3.73)     19.1386 (3.73)     19.1386 (3.73)     0.0000 (1.0)      19.1386 (3.73)     0.0000 (1.0)           0;0  0.0523 (0.27)          1           1
test_status-status[3.10.0]     19.7298 (3.84)     19.7298 (3.84)     19.7298 (3.84)     0.0000 (1.0)      19.7298 (3.84)     0.0000 (1.0)           0;0  0.0507 (0.26)          1           1
test_status-status[3.53.2]     17.6860 (3.44)     17.6860 (3.44)     17.6860 (3.44)     0.0000 (1.0)      17.6860 (3.44)     0.0000 (1.0)           0;0  0.0565 (0.29)          1           1
test_status-status[3.60.1]      5.1339 (1.0)       5.1339 (1.0)       5.1339 (1.0)      0.0000 (1.0)       5.1339 (1.0)      0.0000 (1.0)           0;0  0.1948 (1.0)           1           1
test_status-status[main]        5.5678 (1.08)      5.5678 (1.08)      5.5678 (1.08)     0.0000 (1.0)       5.5678 (1.08)     0.0000 (1.0)           0;0  0.1796 (0.92)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.9414 (1.87)     4.9414 (1.87)     4.9414 (1.87)     0.0000 (1.0)      4.9414 (1.87)     0.0000 (1.0)           0;0  0.2024 (0.53)          1           1
test_status-status-changed[3.10.0]     5.0802 (1.93)     5.0802 (1.93)     5.0802 (1.93)     0.0000 (1.0)      5.0802 (1.93)     0.0000 (1.0)           0;0  0.1968 (0.52)          1           1
test_status-status-changed[3.53.2]     5.1711 (1.96)     5.1711 (1.96)     5.1711 (1.96)     0.0000 (1.0)      5.1711 (1.96)     0.0000 (1.0)           0;0  0.1934 (0.51)          1           1
test_status-status-changed[3.60.1]     2.6384 (1.0)      2.6384 (1.0)      2.6384 (1.0)      0.0000 (1.0)      2.6384 (1.0)      0.0000 (1.0)           0;0  0.3790 (1.0)           1           1
test_status-status-changed[main]       2.8726 (1.09)     2.8726 (1.09)     2.8726 (1.09)     0.0000 (1.0)      2.8726 (1.09)     0.0000 (1.0)           0;0  0.3481 (0.92)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     4.9507 (1.94)     4.9507 (1.94)     4.9507 (1.94)     0.0000 (1.0)      4.9507 (1.94)     0.0000 (1.0)           0;0  0.2020 (0.52)          1           1
test_status-status-changed-noop[3.10.0]     5.2317 (2.05)     5.2317 (2.05)     5.2317 (2.05)     0.0000 (1.0)      5.2317 (2.05)     0.0000 (1.0)           0;0  0.1911 (0.49)          1           1
test_status-status-changed-noop[3.53.2]     5.1441 (2.02)     5.1441 (2.02)     5.1441 (2.02)     0.0000 (1.0)      5.1441 (2.02)     0.0000 (1.0)           0;0  0.1944 (0.50)          1           1
test_status-status-changed-noop[3.60.1]     2.5499 (1.0)      2.5499 (1.0)      2.5499 (1.0)      0.0000 (1.0)      2.5499 (1.0)      0.0000 (1.0)           0;0  0.3922 (1.0)           1           1
test_status-status-changed-noop[main]       2.7122 (1.06)     2.7122 (1.06)     2.7122 (1.06)     0.0000 (1.0)      2.7122 (1.06)     0.0000 (1.0)           0;0  0.3687 (0.94)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     4.8805 (1.92)     4.8805 (1.92)     4.8805 (1.92)     0.0000 (1.0)      4.8805 (1.92)     0.0000 (1.0)           0;0  0.2049 (0.52)          1           1
test_status-status-noop[3.10.0]     5.0993 (2.01)     5.0993 (2.01)     5.0993 (2.01)     0.0000 (1.0)      5.0993 (2.01)     0.0000 (1.0)           0;0  0.1961 (0.50)          1           1
test_status-status-noop[3.53.2]     4.9813 (1.96)     4.9813 (1.96)     4.9813 (1.96)     0.0000 (1.0)      4.9813 (1.96)     0.0000 (1.0)           0;0  0.2008 (0.51)          1           1
test_status-status-noop[3.60.1]     2.5423 (1.0)      2.5423 (1.0)      2.5423 (1.0)      0.0000 (1.0)      2.5423 (1.0)      0.0000 (1.0)           0;0  0.3933 (1.0)           1           1
test_status-status-noop[main]       2.7646 (1.09)     2.7646 (1.09)     2.7646 (1.09)     0.0000 (1.0)      2.7646 (1.09)     0.0000 (1.0)           0;0  0.3617 (0.92)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     189.1137 (4.22)     189.1137 (4.22)     189.1137 (4.22)     0.0000 (1.0)      189.1137 (4.22)     0.0000 (1.0)           0;0  0.0053 (0.24)          1           1
test_update-import-url[3.10.0]     194.2210 (4.33)     194.2210 (4.33)     194.2210 (4.33)     0.0000 (1.0)      194.2210 (4.33)     0.0000 (1.0)           0;0  0.0051 (0.23)          1           1
test_update-import-url[3.53.2]     113.6676 (2.53)     113.6676 (2.53)     113.6676 (2.53)     0.0000 (1.0)      113.6676 (2.53)     0.0000 (1.0)           0;0  0.0088 (0.39)          1           1
test_update-import-url[3.60.1]      44.8541 (1.0)       44.8541 (1.0)       44.8541 (1.0)      0.0000 (1.0)       44.8541 (1.0)      0.0000 (1.0)           0;0  0.0223 (1.0)           1           1
test_update-import-url[main]        45.9269 (1.02)      45.9269 (1.02)      45.9269 (1.02)     0.0000 (1.0)       45.9269 (1.02)     0.0000 (1.0)           0;0  0.0218 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     175.6766 (5.13)     175.6766 (5.13)     175.6766 (5.13)     0.0000 (1.0)      175.6766 (5.13)     0.0000 (1.0)           0;0  0.0057 (0.19)          1           1
test_update-update[3.10.0]     178.2716 (5.21)     178.2716 (5.21)     178.2716 (5.21)     0.0000 (1.0)      178.2716 (5.21)     0.0000 (1.0)           0;0  0.0056 (0.19)          1           1
test_update-update[3.53.2]     106.3208 (3.11)     106.3208 (3.11)     106.3208 (3.11)     0.0000 (1.0)      106.3208 (3.11)     0.0000 (1.0)           0;0  0.0094 (0.32)          1           1
test_update-update[3.60.1]      34.2252 (1.0)       34.2252 (1.0)       34.2252 (1.0)      0.0000 (1.0)       34.2252 (1.0)      0.0000 (1.0)           0;0  0.0292 (1.0)           1           1
test_update-update[main]        34.7982 (1.02)      34.7982 (1.02)      34.7982 (1.02)     0.0000 (1.0)       34.7982 (1.02)     0.0000 (1.0)           0;0  0.0287 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     16.5746 (2.28)     16.5746 (2.28)     16.5746 (2.28)     0.0000 (1.0)      16.5746 (2.28)     0.0000 (1.0)           0;0  0.0603 (0.44)          1           1
test_update-update-noop[3.10.0]     17.5014 (2.41)     17.5014 (2.41)     17.5014 (2.41)     0.0000 (1.0)      17.5014 (2.41)     0.0000 (1.0)           0;0  0.0571 (0.41)          1           1
test_update-update-noop[3.53.2]     16.9795 (2.34)     16.9795 (2.34)     16.9795 (2.34)     0.0000 (1.0)      16.9795 (2.34)     0.0000 (1.0)           0;0  0.0589 (0.43)          1           1
test_update-update-noop[3.60.1]      7.2585 (1.0)       7.2585 (1.0)       7.2585 (1.0)      0.0000 (1.0)       7.2585 (1.0)      0.0000 (1.0)           0;0  0.1378 (1.0)           1           1
test_update-update-noop[main]        7.8899 (1.09)      7.8899 (1.09)      7.8899 (1.09)     0.0000 (1.0)       7.8899 (1.09)     0.0000 (1.0)           0;0  0.1267 (0.92)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean