Fri Aug  1 00:56:16 UTC 2025
dataset: mnist
project: example-get-started
DVC Plot 

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     89.1512 (3.79)     89.1512 (3.79)     89.1512 (3.79)     0.0000 (1.0)      89.1512 (3.79)     0.0000 (1.0)           0;0  0.0112 (0.26)          1           1
test_add_copy-add[3.10.0]     89.4094 (3.80)     89.4094 (3.80)     89.4094 (3.80)     0.0000 (1.0)      89.4094 (3.80)     0.0000 (1.0)           0;0  0.0112 (0.26)          1           1
test_add_copy-add[3.53.2]     80.2966 (3.41)     80.2966 (3.41)     80.2966 (3.41)     0.0000 (1.0)      80.2966 (3.41)     0.0000 (1.0)           0;0  0.0125 (0.29)          1           1
test_add_copy-add[3.60.1]     23.5218 (1.0)      23.5218 (1.0)      23.5218 (1.0)      0.0000 (1.0)      23.5218 (1.0)      0.0000 (1.0)           0;0  0.0425 (1.0)           1           1
test_add_copy-add[main]       24.1831 (1.03)     24.1831 (1.03)     24.1831 (1.03)     0.0000 (1.0)      24.1831 (1.03)     0.0000 (1.0)           0;0  0.0414 (0.97)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     30.8754 (6.37)     30.8754 (6.37)     30.8754 (6.37)     0.0000 (1.0)      30.8754 (6.37)     0.0000 (1.0)           0;0  0.0324 (0.16)          1           1
test_add_copy-add-noop[3.10.0]     30.5873 (6.31)     30.5873 (6.31)     30.5873 (6.31)     0.0000 (1.0)      30.5873 (6.31)     0.0000 (1.0)           0;0  0.0327 (0.16)          1           1
test_add_copy-add-noop[3.53.2]     29.9950 (6.19)     29.9950 (6.19)     29.9950 (6.19)     0.0000 (1.0)      29.9950 (6.19)     0.0000 (1.0)           0;0  0.0333 (0.16)          1           1
test_add_copy-add-noop[3.60.1]      4.8463 (1.0)       4.8463 (1.0)       4.8463 (1.0)      0.0000 (1.0)       4.8463 (1.0)      0.0000 (1.0)           0;0  0.2063 (1.0)           1           1
test_add_copy-add-noop[main]        4.8484 (1.00)      4.8484 (1.00)      4.8484 (1.00)     0.0000 (1.0)       4.8484 (1.00)     0.0000 (1.0)           0;0  0.2063 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
DVC Plot 

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     66.0363 (4.15)     66.0363 (4.15)     66.0363 (4.15)     0.0000 (1.0)      66.0363 (4.15)     0.0000 (1.0)           0;0  0.0151 (0.24)          1           1
test_add_hardlink-add[3.10.0]     66.9925 (4.21)     66.9925 (4.21)     66.9925 (4.21)     0.0000 (1.0)      66.9925 (4.21)     0.0000 (1.0)           0;0  0.0149 (0.24)          1           1
test_add_hardlink-add[3.53.2]     61.4608 (3.87)     61.4608 (3.87)     61.4608 (3.87)     0.0000 (1.0)      61.4608 (3.87)     0.0000 (1.0)           0;0  0.0163 (0.26)          1           1
test_add_hardlink-add[3.60.1]     15.8995 (1.0)      15.8995 (1.0)      15.8995 (1.0)      0.0000 (1.0)      15.8995 (1.0)      0.0000 (1.0)           0;0  0.0629 (1.0)           1           1
test_add_hardlink-add[main]       16.6863 (1.05)     16.6863 (1.05)     16.6863 (1.05)     0.0000 (1.0)      16.6863 (1.05)     0.0000 (1.0)           0;0  0.0599 (0.95)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     34.5799 (7.94)     34.5799 (7.94)     34.5799 (7.94)     0.0000 (1.0)      34.5799 (7.94)     0.0000 (1.0)           0;0  0.0289 (0.13)          1           1
test_add_hardlink-add-noop[3.10.0]     35.0386 (8.04)     35.0386 (8.04)     35.0386 (8.04)     0.0000 (1.0)      35.0386 (8.04)     0.0000 (1.0)           0;0  0.0285 (0.12)          1           1
test_add_hardlink-add-noop[3.53.2]     33.0934 (7.60)     33.0934 (7.60)     33.0934 (7.60)     0.0000 (1.0)      33.0934 (7.60)     0.0000 (1.0)           0;0  0.0302 (0.13)          1           1
test_add_hardlink-add-noop[3.60.1]      4.3571 (1.0)       4.3571 (1.0)       4.3571 (1.0)      0.0000 (1.0)       4.3571 (1.0)      0.0000 (1.0)           0;0  0.2295 (1.0)           1           1
test_add_hardlink-add-noop[main]        4.3941 (1.01)      4.3941 (1.01)      4.3941 (1.01)     0.0000 (1.0)       4.3941 (1.01)     0.0000 (1.0)           0;0  0.2276 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
DVC Plot 

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     71.4951 (2.05)     71.4951 (2.05)     71.4951 (2.05)     0.0000 (1.0)      71.4951 (2.05)     0.0000 (1.0)           0;0  0.0140 (0.49)          1           1
test_add_symlink-add[3.10.0]     72.4103 (2.08)     72.4103 (2.08)     72.4103 (2.08)     0.0000 (1.0)      72.4103 (2.08)     0.0000 (1.0)           0;0  0.0138 (0.48)          1           1
test_add_symlink-add[3.53.2]     67.3959 (1.93)     67.3959 (1.93)     67.3959 (1.93)     0.0000 (1.0)      67.3959 (1.93)     0.0000 (1.0)           0;0  0.0148 (0.52)          1           1
test_add_symlink-add[3.60.1]     34.8619 (1.0)      34.8619 (1.0)      34.8619 (1.0)      0.0000 (1.0)      34.8619 (1.0)      0.0000 (1.0)           0;0  0.0287 (1.0)           1           1
test_add_symlink-add[main]       36.0672 (1.03)     36.0672 (1.03)     36.0672 (1.03)     0.0000 (1.0)      36.0672 (1.03)     0.0000 (1.0)           0;0  0.0277 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     47.7432 (8.07)     47.7432 (8.07)     47.7432 (8.07)     0.0000 (1.0)      47.7432 (8.07)     0.0000 (1.0)           0;0  0.0209 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     48.2675 (8.16)     48.2675 (8.16)     48.2675 (8.16)     0.0000 (1.0)      48.2675 (8.16)     0.0000 (1.0)           0;0  0.0207 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     47.3219 (8.00)     47.3219 (8.00)     47.3219 (8.00)     0.0000 (1.0)      47.3219 (8.00)     0.0000 (1.0)           0;0  0.0211 (0.13)          1           1
test_add_symlink-add-noop[3.60.1]      5.9181 (1.0)       5.9181 (1.0)       5.9181 (1.0)      0.0000 (1.0)       5.9181 (1.0)      0.0000 (1.0)           0;0  0.1690 (1.0)           1           1
test_add_symlink-add-noop[main]        6.0489 (1.02)      6.0489 (1.02)      6.0489 (1.02)     0.0000 (1.0)       6.0489 (1.02)     0.0000 (1.0)           0;0  0.1653 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
DVC Plot 

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     41.7297 (2.00)     41.7297 (2.00)     41.7297 (2.00)     0.0000 (1.0)      41.7297 (2.00)     0.0000 (1.0)           0;0  0.0240 (0.50)          1           1
test_checkout_copy-checkout[3.10.0]     59.9546 (2.87)     59.9546 (2.87)     59.9546 (2.87)     0.0000 (1.0)      59.9546 (2.87)     0.0000 (1.0)           0;0  0.0167 (0.35)          1           1
test_checkout_copy-checkout[3.53.2]     28.4109 (1.36)     28.4109 (1.36)     28.4109 (1.36)     0.0000 (1.0)      28.4109 (1.36)     0.0000 (1.0)           0;0  0.0352 (0.73)          1           1
test_checkout_copy-checkout[3.60.1]     20.8649 (1.0)      20.8649 (1.0)      20.8649 (1.0)      0.0000 (1.0)      20.8649 (1.0)      0.0000 (1.0)           0;0  0.0479 (1.0)           1           1
test_checkout_copy-checkout[main]       21.5864 (1.03)     21.5864 (1.03)     21.5864 (1.03)     0.0000 (1.0)      21.5864 (1.03)     0.0000 (1.0)           0;0  0.0463 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.4232 (1.65)     5.4232 (1.65)     5.4232 (1.65)     0.0000 (1.0)      5.4232 (1.65)     0.0000 (1.0)           0;0  0.1844 (0.61)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.6436 (1.72)     5.6436 (1.72)     5.6436 (1.72)     0.0000 (1.0)      5.6436 (1.72)     0.0000 (1.0)           0;0  0.1772 (0.58)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.5204 (1.68)     5.5204 (1.68)     5.5204 (1.68)     0.0000 (1.0)      5.5204 (1.68)     0.0000 (1.0)           0;0  0.1811 (0.60)          1           1
test_checkout_copy-checkout-noop[3.60.1]     3.2866 (1.0)      3.2866 (1.0)      3.2866 (1.0)      0.0000 (1.0)      3.2866 (1.0)      0.0000 (1.0)           0;0  0.3043 (1.0)           1           1
test_checkout_copy-checkout-noop[main]       3.3332 (1.01)     3.3332 (1.01)     3.3332 (1.01)     0.0000 (1.0)      3.3332 (1.01)     0.0000 (1.0)           0;0  0.3000 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     8.6142 (2.19)     8.6142 (2.19)     8.6142 (2.19)     0.0000 (1.0)      8.6142 (2.19)     0.0000 (1.0)           0;0  0.1161 (0.46)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.2814 (1.60)     6.2814 (1.60)     6.2814 (1.60)     0.0000 (1.0)      6.2814 (1.60)     0.0000 (1.0)           0;0  0.1592 (0.63)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.2114 (1.58)     6.2114 (1.58)     6.2114 (1.58)     0.0000 (1.0)      6.2114 (1.58)     0.0000 (1.0)           0;0  0.1610 (0.63)          1           1
test_checkout_copy-checkout-update[3.60.1]     3.9575 (1.01)     3.9575 (1.01)     3.9575 (1.01)     0.0000 (1.0)      3.9575 (1.01)     0.0000 (1.0)           0;0  0.2527 (0.99)          1           1
test_checkout_copy-checkout-update[main]       3.9278 (1.0)      3.9278 (1.0)      3.9278 (1.0)      0.0000 (1.0)      3.9278 (1.0)      0.0000 (1.0)           0;0  0.2546 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
DVC Plot 

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     22.0659 (3.03)     22.0659 (3.03)     22.0659 (3.03)     0.0000 (1.0)      22.0659 (3.03)     0.0000 (1.0)           0;0  0.0453 (0.33)          1           1
test_checkout_hardlink-checkout[3.10.0]     15.9313 (2.19)     15.9313 (2.19)     15.9313 (2.19)     0.0000 (1.0)      15.9313 (2.19)     0.0000 (1.0)           0;0  0.0628 (0.46)          1           1
test_checkout_hardlink-checkout[3.53.2]     14.2115 (1.95)     14.2115 (1.95)     14.2115 (1.95)     0.0000 (1.0)      14.2115 (1.95)     0.0000 (1.0)           0;0  0.0704 (0.51)          1           1
test_checkout_hardlink-checkout[3.60.1]      7.2741 (1.0)       7.2741 (1.0)       7.2741 (1.0)      0.0000 (1.0)       7.2741 (1.0)      0.0000 (1.0)           0;0  0.1375 (1.0)           1           1
test_checkout_hardlink-checkout[main]        7.8804 (1.08)      7.8804 (1.08)      7.8804 (1.08)     0.0000 (1.0)       7.8804 (1.08)     0.0000 (1.0)           0;0  0.1269 (0.92)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.3314 (1.64)     5.3314 (1.64)     5.3314 (1.64)     0.0000 (1.0)      5.3314 (1.64)     0.0000 (1.0)           0;0  0.1876 (0.61)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.5360 (1.71)     5.5360 (1.71)     5.5360 (1.71)     0.0000 (1.0)      5.5360 (1.71)     0.0000 (1.0)           0;0  0.1806 (0.59)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.2961 (1.63)     5.2961 (1.63)     5.2961 (1.63)     0.0000 (1.0)      5.2961 (1.63)     0.0000 (1.0)           0;0  0.1888 (0.61)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.2435 (1.0)      3.2435 (1.0)      3.2435 (1.0)      0.0000 (1.0)      3.2435 (1.0)      0.0000 (1.0)           0;0  0.3083 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]       3.4810 (1.07)     3.4810 (1.07)     3.4810 (1.07)     0.0000 (1.0)      3.4810 (1.07)     0.0000 (1.0)           0;0  0.2873 (0.93)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     8.4079 (2.19)     8.4079 (2.19)     8.4079 (2.19)     0.0000 (1.0)      8.4079 (2.19)     0.0000 (1.0)           0;0  0.1189 (0.46)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.3692 (1.66)     6.3692 (1.66)     6.3692 (1.66)     0.0000 (1.0)      6.3692 (1.66)     0.0000 (1.0)           0;0  0.1570 (0.60)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.0890 (1.58)     6.0890 (1.58)     6.0890 (1.58)     0.0000 (1.0)      6.0890 (1.58)     0.0000 (1.0)           0;0  0.1642 (0.63)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     3.8464 (1.0)      3.8464 (1.0)      3.8464 (1.0)      0.0000 (1.0)      3.8464 (1.0)      0.0000 (1.0)           0;0  0.2600 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       3.8564 (1.00)     3.8564 (1.00)     3.8564 (1.00)     0.0000 (1.0)      3.8564 (1.00)     0.0000 (1.0)           0;0  0.2593 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
DVC Plot 

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     25.5806 (2.53)     25.5806 (2.53)     25.5806 (2.53)     0.0000 (1.0)      25.5806 (2.53)     0.0000 (1.0)           0;0  0.0391 (0.39)          1           1
test_checkout_symlink-checkout[3.10.0]     19.3951 (1.92)     19.3951 (1.92)     19.3951 (1.92)     0.0000 (1.0)      19.3951 (1.92)     0.0000 (1.0)           0;0  0.0516 (0.52)          1           1
test_checkout_symlink-checkout[3.53.2]     17.8420 (1.77)     17.8420 (1.77)     17.8420 (1.77)     0.0000 (1.0)      17.8420 (1.77)     0.0000 (1.0)           0;0  0.0560 (0.57)          1           1
test_checkout_symlink-checkout[3.60.1]     10.0965 (1.0)      10.0965 (1.0)      10.0965 (1.0)      0.0000 (1.0)      10.0965 (1.0)      0.0000 (1.0)           0;0  0.0990 (1.0)           1           1
test_checkout_symlink-checkout[main]       10.6280 (1.05)     10.6280 (1.05)     10.6280 (1.05)     0.0000 (1.0)      10.6280 (1.05)     0.0000 (1.0)           0;0  0.0941 (0.95)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.8347 (1.57)     6.8347 (1.57)     6.8347 (1.57)     0.0000 (1.0)      6.8347 (1.57)     0.0000 (1.0)           0;0  0.1463 (0.64)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     6.8995 (1.59)     6.8995 (1.59)     6.8995 (1.59)     0.0000 (1.0)      6.8995 (1.59)     0.0000 (1.0)           0;0  0.1449 (0.63)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.7732 (1.56)     6.7732 (1.56)     6.7732 (1.56)     0.0000 (1.0)      6.7732 (1.56)     0.0000 (1.0)           0;0  0.1476 (0.64)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     4.3528 (1.0)      4.3528 (1.0)      4.3528 (1.0)      0.0000 (1.0)      4.3528 (1.0)      0.0000 (1.0)           0;0  0.2297 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]       4.4256 (1.02)     4.4256 (1.02)     4.4256 (1.02)     0.0000 (1.0)      4.4256 (1.02)     0.0000 (1.0)           0;0  0.2260 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 5 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     11.0845 (1.87)     11.0845 (1.87)     11.0845 (1.87)     0.0000 (1.0)      11.0845 (1.87)     0.0000 (1.0)           0;0  0.0902 (0.53)          1           1
test_checkout_symlink-checkout-update[3.10.0]      8.6181 (1.46)      8.6181 (1.46)      8.6181 (1.46)     0.0000 (1.0)       8.6181 (1.46)     0.0000 (1.0)           0;0  0.1160 (0.69)          1           1
test_checkout_symlink-checkout-update[3.53.2]      8.5015 (1.44)      8.5015 (1.44)      8.5015 (1.44)     0.0000 (1.0)       8.5015 (1.44)     0.0000 (1.0)           0;0  0.1176 (0.70)          1           1
test_checkout_symlink-checkout-update[3.60.1]      5.9224 (1.0)       5.9224 (1.0)       5.9224 (1.0)      0.0000 (1.0)       5.9224 (1.0)      0.0000 (1.0)           0;0  0.1689 (1.0)           1           1
test_checkout_symlink-checkout-update[main]        6.0938 (1.03)      6.0938 (1.03)      6.0938 (1.03)     0.0000 (1.0)       6.0938 (1.03)     0.0000 (1.0)           0;0  0.1641 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
DVC Plot 

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     3.8721 (1.71)     3.8721 (1.71)     3.8721 (1.71)     0.0000 (1.0)      3.8721 (1.71)     0.0000 (1.0)           0;0  0.2583 (0.58)          1           1
test_data_status-data-changed[3.10.0]     4.5939 (2.03)     4.5939 (2.03)     4.5939 (2.03)     0.0000 (1.0)      4.5939 (2.03)     0.0000 (1.0)           0;0  0.2177 (0.49)          1           1
test_data_status-data-changed[3.53.2]     4.5430 (2.01)     4.5430 (2.01)     4.5430 (2.01)     0.0000 (1.0)      4.5430 (2.01)     0.0000 (1.0)           0;0  0.2201 (0.50)          1           1
test_data_status-data-changed[3.60.1]     2.2678 (1.00)     2.2678 (1.00)     2.2678 (1.00)     0.0000 (1.0)      2.2678 (1.00)     0.0000 (1.0)           0;0  0.4410 (1.00)          1           1
test_data_status-data-changed[main]       2.2642 (1.0)      2.2642 (1.0)      2.2642 (1.0)      0.0000 (1.0)      2.2642 (1.0)      0.0000 (1.0)           0;0  0.4417 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.0490 (1.80)     4.0490 (1.80)     4.0490 (1.80)     0.0000 (1.0)      4.0490 (1.80)     0.0000 (1.0)           0;0  0.2470 (0.56)          1           1
test_data_status-data-changed-noop[3.10.0]     4.5381 (2.02)     4.5381 (2.02)     4.5381 (2.02)     0.0000 (1.0)      4.5381 (2.02)     0.0000 (1.0)           0;0  0.2204 (0.50)          1           1
test_data_status-data-changed-noop[3.53.2]     4.4590 (1.98)     4.4590 (1.98)     4.4590 (1.98)     0.0000 (1.0)      4.4590 (1.98)     0.0000 (1.0)           0;0  0.2243 (0.50)          1           1
test_data_status-data-changed-noop[3.60.1]     2.2502 (1.0)      2.2502 (1.0)      2.2502 (1.0)      0.0000 (1.0)      2.2502 (1.0)      0.0000 (1.0)           0;0  0.4444 (1.0)           1           1
test_data_status-data-changed-noop[main]       2.2586 (1.00)     2.2586 (1.00)     2.2586 (1.00)     0.0000 (1.0)      2.2586 (1.00)     0.0000 (1.0)           0;0  0.4428 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     17.8243 (3.74)     17.8243 (3.74)     17.8243 (3.74)     0.0000 (1.0)      17.8243 (3.74)     0.0000 (1.0)           0;0  0.0561 (0.27)          1           1
test_data_status-data-new[3.10.0]     18.5950 (3.90)     18.5950 (3.90)     18.5950 (3.90)     0.0000 (1.0)      18.5950 (3.90)     0.0000 (1.0)           0;0  0.0538 (0.26)          1           1
test_data_status-data-new[3.53.2]     18.4317 (3.87)     18.4317 (3.87)     18.4317 (3.87)     0.0000 (1.0)      18.4317 (3.87)     0.0000 (1.0)           0;0  0.0543 (0.26)          1           1
test_data_status-data-new[3.60.1]      4.7619 (1.0)       4.7619 (1.0)       4.7619 (1.0)      0.0000 (1.0)       4.7619 (1.0)      0.0000 (1.0)           0;0  0.2100 (1.0)           1           1
test_data_status-data-new[main]        4.8352 (1.02)      4.8352 (1.02)      4.8352 (1.02)     0.0000 (1.0)       4.8352 (1.02)     0.0000 (1.0)           0;0  0.2068 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     3.9104 (1.73)     3.9104 (1.73)     3.9104 (1.73)     0.0000 (1.0)      3.9104 (1.73)     0.0000 (1.0)           0;0  0.2557 (0.58)          1           1
test_data_status-data-noop[3.10.0]     4.6088 (2.04)     4.6088 (2.04)     4.6088 (2.04)     0.0000 (1.0)      4.6088 (2.04)     0.0000 (1.0)           0;0  0.2170 (0.49)          1           1
test_data_status-data-noop[3.53.2]     4.5591 (2.02)     4.5591 (2.02)     4.5591 (2.02)     0.0000 (1.0)      4.5591 (2.02)     0.0000 (1.0)           0;0  0.2193 (0.49)          1           1
test_data_status-data-noop[3.60.1]     2.2546 (1.0)      2.2546 (1.0)      2.2546 (1.0)      0.0000 (1.0)      2.2546 (1.0)      0.0000 (1.0)           0;0  0.4435 (1.0)           1           1
test_data_status-data-noop[main]       2.2734 (1.01)     2.2734 (1.01)     2.2734 (1.01)     0.0000 (1.0)      2.2734 (1.01)     0.0000 (1.0)           0;0  0.4399 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
DVC Plot 

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     7.2496 (1.29)     7.2496 (1.29)     7.2496 (1.29)     0.0000 (1.0)      7.2496 (1.29)     0.0000 (1.0)           0;0  0.1379 (0.77)          1           1
test_data_status_all_flags-data-changed[3.10.0]     7.8240 (1.39)     7.8240 (1.39)     7.8240 (1.39)     0.0000 (1.0)      7.8240 (1.39)     0.0000 (1.0)           0;0  0.1278 (0.72)          1           1
test_data_status_all_flags-data-changed[3.53.2]     7.8373 (1.40)     7.8373 (1.40)     7.8373 (1.40)     0.0000 (1.0)      7.8373 (1.40)     0.0000 (1.0)           0;0  0.1276 (0.72)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.6178 (1.0)      5.6178 (1.0)      5.6178 (1.0)      0.0000 (1.0)      5.6178 (1.0)      0.0000 (1.0)           0;0  0.1780 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       5.6316 (1.00)     5.6316 (1.00)     5.6316 (1.00)     0.0000 (1.0)      5.6316 (1.00)     0.0000 (1.0)           0;0  0.1776 (1.00)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     7.2791 (1.29)     7.2791 (1.29)     7.2791 (1.29)     0.0000 (1.0)      7.2791 (1.29)     0.0000 (1.0)           0;0  0.1374 (0.78)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     7.9303 (1.40)     7.9303 (1.40)     7.9303 (1.40)     0.0000 (1.0)      7.9303 (1.40)     0.0000 (1.0)           0;0  0.1261 (0.71)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     7.7744 (1.38)     7.7744 (1.38)     7.7744 (1.38)     0.0000 (1.0)      7.7744 (1.38)     0.0000 (1.0)           0;0  0.1286 (0.73)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     5.6550 (1.00)     5.6550 (1.00)     5.6550 (1.00)     0.0000 (1.0)      5.6550 (1.00)     0.0000 (1.0)           0;0  0.1768 (1.00)          1           1
test_data_status_all_flags-data-changed-noop[main]       5.6534 (1.0)      5.6534 (1.0)      5.6534 (1.0)      0.0000 (1.0)      5.6534 (1.0)      0.0000 (1.0)           0;0  0.1769 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     21.8295 (2.69)     21.8295 (2.69)     21.8295 (2.69)     0.0000 (1.0)      21.8295 (2.69)     0.0000 (1.0)           0;0  0.0458 (0.37)          1           1
test_data_status_all_flags-data-new[3.10.0]     22.3053 (2.75)     22.3053 (2.75)     22.3053 (2.75)     0.0000 (1.0)      22.3053 (2.75)     0.0000 (1.0)           0;0  0.0448 (0.36)          1           1
test_data_status_all_flags-data-new[3.53.2]     22.3658 (2.75)     22.3658 (2.75)     22.3658 (2.75)     0.0000 (1.0)      22.3658 (2.75)     0.0000 (1.0)           0;0  0.0447 (0.36)          1           1
test_data_status_all_flags-data-new[3.60.1]      8.1230 (1.0)       8.1230 (1.0)       8.1230 (1.0)      0.0000 (1.0)       8.1230 (1.0)      0.0000 (1.0)           0;0  0.1231 (1.0)           1           1
test_data_status_all_flags-data-new[main]        8.3752 (1.03)      8.3752 (1.03)      8.3752 (1.03)     0.0000 (1.0)       8.3752 (1.03)     0.0000 (1.0)           0;0  0.1194 (0.97)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     6.4132 (1.31)     6.4132 (1.31)     6.4132 (1.31)     0.0000 (1.0)      6.4132 (1.31)     0.0000 (1.0)           0;0  0.1559 (0.76)          1           1
test_data_status_all_flags-data-noop[3.10.0]     7.2108 (1.48)     7.2108 (1.48)     7.2108 (1.48)     0.0000 (1.0)      7.2108 (1.48)     0.0000 (1.0)           0;0  0.1387 (0.68)          1           1
test_data_status_all_flags-data-noop[3.53.2]     6.9360 (1.42)     6.9360 (1.42)     6.9360 (1.42)     0.0000 (1.0)      6.9360 (1.42)     0.0000 (1.0)           0;0  0.1442 (0.70)          1           1
test_data_status_all_flags-data-noop[3.60.1]     4.8968 (1.00)     4.8968 (1.00)     4.8968 (1.00)     0.0000 (1.0)      4.8968 (1.00)     0.0000 (1.0)           0;0  0.2042 (1.00)          1           1
test_data_status_all_flags-data-noop[main]       4.8833 (1.0)      4.8833 (1.0)      4.8833 (1.0)      0.0000 (1.0)      4.8833 (1.0)      0.0000 (1.0)           0;0  0.2048 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
DVC Plot 

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     17.5419 (2.57)     17.5419 (2.57)     17.5419 (2.57)     0.0000 (1.0)      17.5419 (2.57)     0.0000 (1.0)           0;0  0.0570 (0.39)          1           1
test_diff-diff[3.10.0]     19.1409 (2.81)     19.1409 (2.81)     19.1409 (2.81)     0.0000 (1.0)      19.1409 (2.81)     0.0000 (1.0)           0;0  0.0522 (0.36)          1           1
test_diff-diff[3.53.2]     19.2915 (2.83)     19.2915 (2.83)     19.2915 (2.83)     0.0000 (1.0)      19.2915 (2.83)     0.0000 (1.0)           0;0  0.0518 (0.35)          1           1
test_diff-diff[3.60.1]      6.9253 (1.02)      6.9253 (1.02)      6.9253 (1.02)     0.0000 (1.0)       6.9253 (1.02)     0.0000 (1.0)           0;0  0.1444 (0.98)          1           1
test_diff-diff[main]        6.8184 (1.0)       6.8184 (1.0)       6.8184 (1.0)      0.0000 (1.0)       6.8184 (1.0)      0.0000 (1.0)           0;0  0.1467 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     5.9177 (1.72)     5.9177 (1.72)     5.9177 (1.72)     0.0000 (1.0)      5.9177 (1.72)     0.0000 (1.0)           0;0  0.1690 (0.58)          1           1
test_diff-diff-changed[3.10.0]     6.7431 (1.96)     6.7431 (1.96)     6.7431 (1.96)     0.0000 (1.0)      6.7431 (1.96)     0.0000 (1.0)           0;0  0.1483 (0.51)          1           1
test_diff-diff-changed[3.53.2]     5.6489 (1.64)     5.6489 (1.64)     5.6489 (1.64)     0.0000 (1.0)      5.6489 (1.64)     0.0000 (1.0)           0;0  0.1770 (0.61)          1           1
test_diff-diff-changed[3.60.1]     3.5478 (1.03)     3.5478 (1.03)     3.5478 (1.03)     0.0000 (1.0)      3.5478 (1.03)     0.0000 (1.0)           0;0  0.2819 (0.97)          1           1
test_diff-diff-changed[main]       3.4473 (1.0)      3.4473 (1.0)      3.4473 (1.0)      0.0000 (1.0)      3.4473 (1.0)      0.0000 (1.0)           0;0  0.2901 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.1075 (1.51)     5.1075 (1.51)     5.1075 (1.51)     0.0000 (1.0)      5.1075 (1.51)     0.0000 (1.0)           0;0  0.1958 (0.66)          1           1
test_diff-diff-changed-noop[3.10.0]     5.7358 (1.70)     5.7358 (1.70)     5.7358 (1.70)     0.0000 (1.0)      5.7358 (1.70)     0.0000 (1.0)           0;0  0.1743 (0.59)          1           1
test_diff-diff-changed-noop[3.53.2]     5.5247 (1.64)     5.5247 (1.64)     5.5247 (1.64)     0.0000 (1.0)      5.5247 (1.64)     0.0000 (1.0)           0;0  0.1810 (0.61)          1           1
test_diff-diff-changed-noop[3.60.1]     3.4851 (1.03)     3.4851 (1.03)     3.4851 (1.03)     0.0000 (1.0)      3.4851 (1.03)     0.0000 (1.0)           0;0  0.2869 (0.97)          1           1
test_diff-diff-changed-noop[main]       3.3757 (1.0)      3.3757 (1.0)      3.3757 (1.0)      0.0000 (1.0)      3.3757 (1.0)      0.0000 (1.0)           0;0  0.2962 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     3.9653 (1.17)     3.9653 (1.17)     3.9653 (1.17)     0.0000 (1.0)      3.9653 (1.17)     0.0000 (1.0)           0;0  0.2522 (0.85)          1           1
test_diff-diff-noop[3.10.0]     4.7772 (1.41)     4.7772 (1.41)     4.7772 (1.41)     0.0000 (1.0)      4.7772 (1.41)     0.0000 (1.0)           0;0  0.2093 (0.71)          1           1
test_diff-diff-noop[3.53.2]     5.6781 (1.68)     5.6781 (1.68)     5.6781 (1.68)     0.0000 (1.0)      5.6781 (1.68)     0.0000 (1.0)           0;0  0.1761 (0.59)          1           1
test_diff-diff-noop[3.60.1]     3.4655 (1.03)     3.4655 (1.03)     3.4655 (1.03)     0.0000 (1.0)      3.4655 (1.03)     0.0000 (1.0)           0;0  0.2886 (0.97)          1           1
test_diff-diff-noop[main]       3.3783 (1.0)      3.3783 (1.0)      3.3783 (1.0)      0.0000 (1.0)      3.3783 (1.0)      0.0000 (1.0)           0;0  0.2960 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
DVC Plot 

------------------------------------------------------------------------ benchmark 'test_exp_show-exp': 5 tests ------------------------------------------------------------------------
Name (time in s)                 Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]     1.0955 (1.0)      1.0955 (1.0)      1.0955 (1.0)      0.0000 (1.0)      1.0955 (1.0)      0.0000 (1.0)           0;0  0.9128 (1.0)           1           1
test_exp_show-exp[3.10.0]     5.5678 (5.08)     5.5678 (5.08)     5.5678 (5.08)     0.0000 (1.0)      5.5678 (5.08)     0.0000 (1.0)           0;0  0.1796 (0.20)          1           1
test_exp_show-exp[3.53.2]     3.3066 (3.02)     3.3066 (3.02)     3.3066 (3.02)     0.0000 (1.0)      3.3066 (3.02)     0.0000 (1.0)           0;0  0.3024 (0.33)          1           1
test_exp_show-exp[3.60.1]     3.3339 (3.04)     3.3339 (3.04)     3.3339 (3.04)     0.0000 (1.0)      3.3339 (3.04)     0.0000 (1.0)           0;0  0.2999 (0.33)          1           1
test_exp_show-exp[main]       6.0538 (5.53)     6.0538 (5.53)     6.0538 (5.53)     0.0000 (1.0)      6.0538 (5.53)     0.0000 (1.0)           0;0  0.1652 (0.18)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
DVC Plot 

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     66.1251 (2.83)     66.1251 (2.83)     66.1251 (2.83)     0.0000 (1.0)      66.1251 (2.83)     0.0000 (1.0)           0;0  0.0151 (0.35)          1           1
test_fetch-fetch[3.10.0]     70.9835 (3.04)     70.9835 (3.04)     70.9835 (3.04)     0.0000 (1.0)      70.9835 (3.04)     0.0000 (1.0)           0;0  0.0141 (0.33)          1           1
test_fetch-fetch[3.53.2]     34.0693 (1.46)     34.0693 (1.46)     34.0693 (1.46)     0.0000 (1.0)      34.0693 (1.46)     0.0000 (1.0)           0;0  0.0294 (0.69)          1           1
test_fetch-fetch[3.60.1]     23.4747 (1.01)     23.4747 (1.01)     23.4747 (1.01)     0.0000 (1.0)      23.4747 (1.01)     0.0000 (1.0)           0;0  0.0426 (0.99)          1           1
test_fetch-fetch[main]       23.3538 (1.0)      23.3538 (1.0)      23.3538 (1.0)      0.0000 (1.0)      23.3538 (1.0)      0.0000 (1.0)           0;0  0.0428 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
DVC Plot 

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.8217 (1.0)      2.8217 (1.0)      2.8217 (1.0)      0.0000 (1.0)      2.8217 (1.0)      0.0000 (1.0)           0;0  0.3544 (1.0)           1           1
test_gc-gc[3.10.0]     2.9332 (1.04)     2.9332 (1.04)     2.9332 (1.04)     0.0000 (1.0)      2.9332 (1.04)     0.0000 (1.0)           0;0  0.3409 (0.96)          1           1
test_gc-gc[3.53.2]     2.8940 (1.03)     2.8940 (1.03)     2.8940 (1.03)     0.0000 (1.0)      2.8940 (1.03)     0.0000 (1.0)           0;0  0.3455 (0.98)          1           1
test_gc-gc[3.60.1]     2.8610 (1.01)     2.8610 (1.01)     2.8610 (1.01)     0.0000 (1.0)      2.8610 (1.01)     0.0000 (1.0)           0;0  0.3495 (0.99)          1           1
test_gc-gc[main]       2.8342 (1.00)     2.8342 (1.00)     2.8342 (1.00)     0.0000 (1.0)      2.8342 (1.00)     0.0000 (1.0)           0;0  0.3528 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
DVC Plot 

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     134.5653 (2.72)     134.5653 (2.72)     134.5653 (2.72)     0.0000 (1.0)      134.5653 (2.72)     0.0000 (1.0)           0;0  0.0074 (0.37)          1           1
test_get-get[3.10.0]     162.4165 (3.29)     162.4165 (3.29)     162.4165 (3.29)     0.0000 (1.0)      162.4165 (3.29)     0.0000 (1.0)           0;0  0.0062 (0.30)          1           1
test_get-get[3.53.2]     143.5145 (2.90)     143.5145 (2.90)     143.5145 (2.90)     0.0000 (1.0)      143.5145 (2.90)     0.0000 (1.0)           0;0  0.0070 (0.34)          1           1
test_get-get[3.60.1]      49.4126 (1.0)       49.4126 (1.0)       49.4126 (1.0)      0.0000 (1.0)       49.4126 (1.0)      0.0000 (1.0)           0;0  0.0202 (1.0)           1           1
test_get-get[main]        49.6034 (1.00)      49.6034 (1.00)      49.6034 (1.00)     0.0000 (1.0)       49.6034 (1.00)     0.0000 (1.0)           0;0  0.0202 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
DVC Plot 

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     44.8547 (2.70)     44.8547 (2.70)     44.8547 (2.70)     0.0000 (1.0)      44.8547 (2.70)     0.0000 (1.0)           0;0  0.0223 (0.37)          1           1
test_get_url-get-url[3.10.0]     47.5130 (2.86)     47.5130 (2.86)     47.5130 (2.86)     0.0000 (1.0)      47.5130 (2.86)     0.0000 (1.0)           0;0  0.0210 (0.35)          1           1
test_get_url-get-url[3.53.2]     16.7292 (1.01)     16.7292 (1.01)     16.7292 (1.01)     0.0000 (1.0)      16.7292 (1.01)     0.0000 (1.0)           0;0  0.0598 (0.99)          1           1
test_get_url-get-url[3.60.1]     16.5878 (1.0)      16.5878 (1.0)      16.5878 (1.0)      0.0000 (1.0)      16.5878 (1.0)      0.0000 (1.0)           0;0  0.0603 (1.0)           1           1
test_get_url-get-url[main]       16.7069 (1.01)     16.7069 (1.01)     16.7069 (1.01)     0.0000 (1.0)      16.7069 (1.01)     0.0000 (1.0)           0;0  0.0599 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
DVC Plot 

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     128.7628 (1.02)     146.3543 (1.0)      137.5496 (1.02)     3.7941 (1.0)      137.7296 (1.02)     4.7320 (1.0)          33;0  7.2701 (0.98)        100           1
test_help---help[3.10.0]     126.4538 (1.0)      148.8809 (1.02)     135.0488 (1.0)      4.3411 (1.14)     135.0040 (1.0)      5.4792 (1.16)         35;2  7.4047 (1.0)         100           1
test_help---help[3.53.2]     130.6818 (1.03)     150.1070 (1.03)     137.7875 (1.02)     4.5153 (1.19)     136.9081 (1.01)     6.9491 (1.47)         32;0  7.2576 (0.98)        100           1
test_help---help[3.60.1]     128.1730 (1.01)     157.9995 (1.08)     136.9399 (1.01)     5.4379 (1.43)     136.2246 (1.01)     6.4462 (1.36)         26;3  7.3025 (0.99)        100           1
test_help---help[main]       130.8384 (1.03)     170.7990 (1.17)     139.6139 (1.03)     6.6842 (1.76)     138.5543 (1.03)     5.2490 (1.11)         15;5  7.1626 (0.97)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
DVC Plot 

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     227.2832 (2.88)     227.2832 (2.88)     227.2832 (2.88)     0.0000 (1.0)      227.2832 (2.88)     0.0000 (1.0)           0;0  0.0044 (0.35)          1           1
test_import-import[3.10.0]     253.3838 (3.21)     253.3838 (3.21)     253.3838 (3.21)     0.0000 (1.0)      253.3838 (3.21)     0.0000 (1.0)           0;0  0.0039 (0.31)          1           1
test_import-import[3.60.1]      78.9957 (1.0)       78.9957 (1.0)       78.9957 (1.0)      0.0000 (1.0)       78.9957 (1.0)      0.0000 (1.0)           0;0  0.0127 (1.0)           1           1
test_import-import[main]        79.5574 (1.01)      79.5574 (1.01)      79.5574 (1.01)     0.0000 (1.0)       79.5574 (1.01)     0.0000 (1.0)           0;0  0.0126 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
DVC Plot 

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     153.3006 (3.35)     153.3006 (3.35)     153.3006 (3.35)     0.0000 (1.0)      153.3006 (3.35)     0.0000 (1.0)           0;0  0.0065 (0.30)          1           1
test_import_url-import-url[3.10.0]     156.9746 (3.43)     156.9746 (3.43)     156.9746 (3.43)     0.0000 (1.0)      156.9746 (3.43)     0.0000 (1.0)           0;0  0.0064 (0.29)          1           1
test_import_url-import-url[3.53.2]     117.2781 (2.56)     117.2781 (2.56)     117.2781 (2.56)     0.0000 (1.0)      117.2781 (2.56)     0.0000 (1.0)           0;0  0.0085 (0.39)          1           1
test_import_url-import-url[3.60.1]      45.7436 (1.0)       45.7436 (1.0)       45.7436 (1.0)      0.0000 (1.0)       45.7436 (1.0)      0.0000 (1.0)           0;0  0.0219 (1.0)           1           1
test_import_url-import-url[main]        46.5584 (1.02)      46.5584 (1.02)      46.5584 (1.02)     0.0000 (1.0)       46.5584 (1.02)     0.0000 (1.0)           0;0  0.0215 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
DVC Plot 

----------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     385.5413 (1.01)     426.4204 (1.01)     395.3378 (1.01)      6.0681 (1.43)     394.1395 (1.01)      5.7643 (1.32)         20;5  2.5295 (0.99)        100           1
test_init-init[3.10.0]     396.2972 (1.04)     424.8210 (1.01)     402.1871 (1.03)      4.2571 (1.0)      401.3786 (1.03)      4.3723 (1.0)          25;3  2.4864 (0.97)        100           1
test_init-init[3.53.2]     380.3180 (1.0)      420.9874 (1.0)      389.8096 (1.0)       5.8018 (1.36)     389.2780 (1.0)       6.3035 (1.44)         22;5  2.5654 (1.0)         100           1
test_init-init[3.60.1]     383.5484 (1.01)     426.0710 (1.01)     392.5147 (1.01)      6.4404 (1.51)     391.1516 (1.00)      7.1787 (1.64)         23;4  2.5477 (0.99)        100           1
test_init-init[main]       384.2319 (1.01)     584.0884 (1.39)     399.3433 (1.02)     22.4611 (5.28)     395.3160 (1.02)     10.7609 (2.46)          5;5  2.5041 (0.98)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
DVC Plot 

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     548.8958 (1.04)     548.8958 (1.04)     548.8958 (1.04)     0.0000 (1.0)      548.8958 (1.04)     0.0000 (1.0)           0;0  1.8218 (0.96)          1           1
test_list-list[3.10.0]     659.3249 (1.25)     659.3249 (1.25)     659.3249 (1.25)     0.0000 (1.0)      659.3249 (1.25)     0.0000 (1.0)           0;0  1.5167 (0.80)          1           1
test_list-list[3.53.2]     551.4450 (1.04)     551.4450 (1.04)     551.4450 (1.04)     0.0000 (1.0)      551.4450 (1.04)     0.0000 (1.0)           0;0  1.8134 (0.96)          1           1
test_list-list[3.60.1]     529.4452 (1.0)      529.4452 (1.0)      529.4452 (1.0)      0.0000 (1.0)      529.4452 (1.0)      0.0000 (1.0)           0;0  1.8888 (1.0)           1           1
test_list-list[main]       541.1198 (1.02)     541.1198 (1.02)     541.1198 (1.02)     0.0000 (1.0)      541.1198 (1.02)     0.0000 (1.0)           0;0  1.8480 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     400.5189 (1.02)     400.5189 (1.02)     400.5189 (1.02)     0.0000 (1.0)      400.5189 (1.02)     0.0000 (1.0)           0;0  2.4968 (0.98)          1           1
test_list-list-dvc-only[3.10.0]     405.0366 (1.03)     405.0366 (1.03)     405.0366 (1.03)     0.0000 (1.0)      405.0366 (1.03)     0.0000 (1.0)           0;0  2.4689 (0.97)          1           1
test_list-list-dvc-only[3.53.2]     394.1709 (1.0)      394.1709 (1.0)      394.1709 (1.0)      0.0000 (1.0)      394.1709 (1.0)      0.0000 (1.0)           0;0  2.5370 (1.0)           1           1
test_list-list-dvc-only[3.60.1]     397.0714 (1.01)     397.0714 (1.01)     397.0714 (1.01)     0.0000 (1.0)      397.0714 (1.01)     0.0000 (1.0)           0;0  2.5184 (0.99)          1           1
test_list-list-dvc-only[main]       401.4495 (1.02)     401.4495 (1.02)     401.4495 (1.02)     0.0000 (1.0)      401.4495 (1.02)     0.0000 (1.0)           0;0  2.4910 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.5596 (1.0)      2.5596 (1.0)      2.5596 (1.0)      0.0000 (1.0)      2.5596 (1.0)      0.0000 (1.0)           0;0  0.3907 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.5700 (1.00)     2.5700 (1.00)     2.5700 (1.00)     0.0000 (1.0)      2.5700 (1.00)     0.0000 (1.0)           0;0  0.3891 (1.00)          1           1
test_list-list-recursive[3.53.2]     2.6813 (1.05)     2.6813 (1.05)     2.6813 (1.05)     0.0000 (1.0)      2.6813 (1.05)     0.0000 (1.0)           0;0  0.3730 (0.95)          1           1
test_list-list-recursive[3.60.1]     2.7919 (1.09)     2.7919 (1.09)     2.7919 (1.09)     0.0000 (1.0)      2.7919 (1.09)     0.0000 (1.0)           0;0  0.3582 (0.92)          1           1
test_list-list-recursive[main]       2.9445 (1.15)     2.9445 (1.15)     2.9445 (1.15)     0.0000 (1.0)      2.9445 (1.15)     0.0000 (1.0)           0;0  0.3396 (0.87)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     412.0206 (1.06)     412.0206 (1.06)     412.0206 (1.06)     0.0000 (1.0)      412.0206 (1.06)     0.0000 (1.0)           0;0  2.4271 (0.95)          1           1
test_list-list-shallow[3.10.0]     402.6139 (1.03)     402.6139 (1.03)     402.6139 (1.03)     0.0000 (1.0)      402.6139 (1.03)     0.0000 (1.0)           0;0  2.4838 (0.97)          1           1
test_list-list-shallow[3.53.2]     389.7986 (1.0)      389.7986 (1.0)      389.7986 (1.0)      0.0000 (1.0)      389.7986 (1.0)      0.0000 (1.0)           0;0  2.5654 (1.0)           1           1
test_list-list-shallow[3.60.1]     408.3261 (1.05)     408.3261 (1.05)     408.3261 (1.05)     0.0000 (1.0)      408.3261 (1.05)     0.0000 (1.0)           0;0  2.4490 (0.95)          1           1
test_list-list-shallow[main]       404.9242 (1.04)     404.9242 (1.04)     404.9242 (1.04)     0.0000 (1.0)      404.9242 (1.04)     0.0000 (1.0)           0;0  2.4696 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
DVC Plot 

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     12.2502 (3.11)     12.2502 (3.11)     12.2502 (3.11)     0.0000 (1.0)      12.2502 (3.11)     0.0000 (1.0)           0;0  0.0816 (0.32)          1           1
test_partial_add-add[3.10.0]     12.7142 (3.22)     12.7142 (3.22)     12.7142 (3.22)     0.0000 (1.0)      12.7142 (3.22)     0.0000 (1.0)           0;0  0.0787 (0.31)          1           1
test_partial_add-add[3.53.2]     11.4761 (2.91)     11.4761 (2.91)     11.4761 (2.91)     0.0000 (1.0)      11.4761 (2.91)     0.0000 (1.0)           0;0  0.0871 (0.34)          1           1
test_partial_add-add[3.60.1]      3.9430 (1.0)       3.9430 (1.0)       3.9430 (1.0)      0.0000 (1.0)       3.9430 (1.0)      0.0000 (1.0)           0;0  0.2536 (1.0)           1           1
test_partial_add-add[main]        4.3923 (1.11)      4.3923 (1.11)      4.3923 (1.11)     0.0000 (1.0)       4.3923 (1.11)     0.0000 (1.0)           0;0  0.2277 (0.90)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     82.8831 (3.97)     82.8831 (3.97)     82.8831 (3.97)     0.0000 (1.0)      82.8831 (3.97)     0.0000 (1.0)           0;0  0.0121 (0.25)          1           1
test_partial_add-add-partial[3.10.0]     84.6483 (4.06)     84.6483 (4.06)     84.6483 (4.06)     0.0000 (1.0)      84.6483 (4.06)     0.0000 (1.0)           0;0  0.0118 (0.25)          1           1
test_partial_add-add-partial[3.53.2]     76.7553 (3.68)     76.7553 (3.68)     76.7553 (3.68)     0.0000 (1.0)      76.7553 (3.68)     0.0000 (1.0)           0;0  0.0130 (0.27)          1           1
test_partial_add-add-partial[3.60.1]     20.8651 (1.0)      20.8651 (1.0)      20.8651 (1.0)      0.0000 (1.0)      20.8651 (1.0)      0.0000 (1.0)           0;0  0.0479 (1.0)           1           1
test_partial_add-add-partial[main]       21.0216 (1.01)     21.0216 (1.01)     21.0216 (1.01)     0.0000 (1.0)      21.0216 (1.01)     0.0000 (1.0)           0;0  0.0476 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.5991 (1.0)      4.5991 (1.0)      4.5991 (1.0)      0.0000 (1.0)      4.5991 (1.0)      0.0000 (1.0)           0;0  0.2174 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     6.0066 (1.31)     6.0066 (1.31)     6.0066 (1.31)     0.0000 (1.0)      6.0066 (1.31)     0.0000 (1.0)           0;0  0.1665 (0.77)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     6.9372 (1.51)     6.9372 (1.51)     6.9372 (1.51)     0.0000 (1.0)      6.9372 (1.51)     0.0000 (1.0)           0;0  0.1441 (0.66)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     6.9509 (1.51)     6.9509 (1.51)     6.9509 (1.51)     0.0000 (1.0)      6.9509 (1.51)     0.0000 (1.0)           0;0  0.1439 (0.66)          1           1
test_partial_add-gc-cloud-noop[main]       6.9767 (1.52)     6.9767 (1.52)     6.9767 (1.52)     0.0000 (1.0)      6.9767 (1.52)     0.0000 (1.0)           0;0  0.1433 (0.66)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.5596 (1.0)      2.5596 (1.0)      2.5596 (1.0)      0.0000 (1.0)      2.5596 (1.0)      0.0000 (1.0)           0;0  0.3907 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.8938 (1.52)     3.8938 (1.52)     3.8938 (1.52)     0.0000 (1.0)      3.8938 (1.52)     0.0000 (1.0)           0;0  0.2568 (0.66)          1           1
test_partial_add-gc-noop[3.53.2]     3.9031 (1.52)     3.9031 (1.52)     3.9031 (1.52)     0.0000 (1.0)      3.9031 (1.52)     0.0000 (1.0)           0;0  0.2562 (0.66)          1           1
test_partial_add-gc-noop[3.60.1]     3.8953 (1.52)     3.8953 (1.52)     3.8953 (1.52)     0.0000 (1.0)      3.8953 (1.52)     0.0000 (1.0)           0;0  0.2567 (0.66)          1           1
test_partial_add-gc-noop[main]       3.9299 (1.54)     3.9299 (1.54)     3.9299 (1.54)     0.0000 (1.0)      3.9299 (1.54)     0.0000 (1.0)           0;0  0.2545 (0.65)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-push': 5 tests ------------------------------------------------------------------------
Name (time in s)                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     7.8840 (2.16)     7.8840 (2.16)     7.8840 (2.16)     0.0000 (1.0)      7.8840 (2.16)     0.0000 (1.0)           0;0  0.1268 (0.46)          1           1
test_partial_add-push[3.10.0]     7.0305 (1.92)     7.0305 (1.92)     7.0305 (1.92)     0.0000 (1.0)      7.0305 (1.92)     0.0000 (1.0)           0;0  0.1422 (0.52)          1           1
test_partial_add-push[3.53.2]     3.8435 (1.05)     3.8435 (1.05)     3.8435 (1.05)     0.0000 (1.0)      3.8435 (1.05)     0.0000 (1.0)           0;0  0.2602 (0.95)          1           1
test_partial_add-push[3.60.1]     3.6881 (1.01)     3.6881 (1.01)     3.6881 (1.01)     0.0000 (1.0)      3.6881 (1.01)     0.0000 (1.0)           0;0  0.2711 (0.99)          1           1
test_partial_add-push[main]       3.6554 (1.0)      3.6554 (1.0)      3.6554 (1.0)      0.0000 (1.0)      3.6554 (1.0)      0.0000 (1.0)           0;0  0.2736 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     45.9645 (2.18)     45.9645 (2.18)     45.9645 (2.18)     0.0000 (1.0)      45.9645 (2.18)     0.0000 (1.0)           0;0  0.0218 (0.46)          1           1
test_partial_add-push-partial[3.10.0]     41.2249 (1.96)     41.2249 (1.96)     41.2249 (1.96)     0.0000 (1.0)      41.2249 (1.96)     0.0000 (1.0)           0;0  0.0243 (0.51)          1           1
test_partial_add-push-partial[3.53.2]     21.8433 (1.04)     21.8433 (1.04)     21.8433 (1.04)     0.0000 (1.0)      21.8433 (1.04)     0.0000 (1.0)           0;0  0.0458 (0.96)          1           1
test_partial_add-push-partial[3.60.1]     21.0607 (1.0)      21.0607 (1.0)      21.0607 (1.0)      0.0000 (1.0)      21.0607 (1.0)      0.0000 (1.0)           0;0  0.0475 (1.0)           1           1
test_partial_add-push-partial[main]       21.3781 (1.02)     21.3781 (1.02)     21.3781 (1.02)     0.0000 (1.0)      21.3781 (1.02)     0.0000 (1.0)           0;0  0.0468 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
DVC Plot 

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     86.3470 (3.82)     86.3470 (3.82)     86.3470 (3.82)     0.0000 (1.0)      86.3470 (3.82)     0.0000 (1.0)           0;0  0.0116 (0.26)          1           1
test_partial_remove-add[3.10.0]     87.3529 (3.87)     87.3529 (3.87)     87.3529 (3.87)     0.0000 (1.0)      87.3529 (3.87)     0.0000 (1.0)           0;0  0.0114 (0.26)          1           1
test_partial_remove-add[3.53.2]     77.5341 (3.43)     77.5341 (3.43)     77.5341 (3.43)     0.0000 (1.0)      77.5341 (3.43)     0.0000 (1.0)           0;0  0.0129 (0.29)          1           1
test_partial_remove-add[3.60.1]     22.5793 (1.0)      22.5793 (1.0)      22.5793 (1.0)      0.0000 (1.0)      22.5793 (1.0)      0.0000 (1.0)           0;0  0.0443 (1.0)           1           1
test_partial_remove-add[main]       23.3170 (1.03)     23.3170 (1.03)     23.3170 (1.03)     0.0000 (1.0)      23.3170 (1.03)     0.0000 (1.0)           0;0  0.0429 (0.97)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add-update': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     49.4564 (13.22)    49.4564 (13.22)    49.4564 (13.22)    0.0000 (1.0)      49.4564 (13.22)    0.0000 (1.0)           0;0  0.0202 (0.08)          1           1
test_partial_remove-add-update[3.10.0]     49.1557 (13.14)    49.1557 (13.14)    49.1557 (13.14)    0.0000 (1.0)      49.1557 (13.14)    0.0000 (1.0)           0;0  0.0203 (0.08)          1           1
test_partial_remove-add-update[3.53.2]     44.5611 (11.91)    44.5611 (11.91)    44.5611 (11.91)    0.0000 (1.0)      44.5611 (11.91)    0.0000 (1.0)           0;0  0.0224 (0.08)          1           1
test_partial_remove-add-update[3.60.1]      3.7415 (1.0)       3.7415 (1.0)       3.7415 (1.0)      0.0000 (1.0)       3.7415 (1.0)      0.0000 (1.0)           0;0  0.2673 (1.0)           1           1
test_partial_remove-add-update[main]        3.8474 (1.03)      3.8474 (1.03)      3.8474 (1.03)     0.0000 (1.0)       3.8474 (1.03)     0.0000 (1.0)           0;0  0.2599 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     2.5481 (1.0)      2.5481 (1.0)      2.5481 (1.0)      0.0000 (1.0)      2.5481 (1.0)      0.0000 (1.0)           0;0  0.3924 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.6903 (1.45)     3.6903 (1.45)     3.6903 (1.45)     0.0000 (1.0)      3.6903 (1.45)     0.0000 (1.0)           0;0  0.2710 (0.69)          1           1
test_partial_remove-gc[3.53.2]     3.6668 (1.44)     3.6668 (1.44)     3.6668 (1.44)     0.0000 (1.0)      3.6668 (1.44)     0.0000 (1.0)           0;0  0.2727 (0.69)          1           1
test_partial_remove-gc[3.60.1]     3.6261 (1.42)     3.6261 (1.42)     3.6261 (1.42)     0.0000 (1.0)      3.6261 (1.42)     0.0000 (1.0)           0;0  0.2758 (0.70)          1           1
test_partial_remove-gc[main]       3.6523 (1.43)     3.6523 (1.43)     3.6523 (1.43)     0.0000 (1.0)      3.6523 (1.43)     0.0000 (1.0)           0;0  0.2738 (0.70)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     4.8844 (1.0)      4.8844 (1.0)      4.8844 (1.0)      0.0000 (1.0)      4.8844 (1.0)      0.0000 (1.0)           0;0  0.2047 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     5.9140 (1.21)     5.9140 (1.21)     5.9140 (1.21)     0.0000 (1.0)      5.9140 (1.21)     0.0000 (1.0)           0;0  0.1691 (0.83)          1           1
test_partial_remove-gc-cloud[3.53.2]     6.8259 (1.40)     6.8259 (1.40)     6.8259 (1.40)     0.0000 (1.0)      6.8259 (1.40)     0.0000 (1.0)           0;0  0.1465 (0.72)          1           1
test_partial_remove-gc-cloud[3.60.1]     6.5768 (1.35)     6.5768 (1.35)     6.5768 (1.35)     0.0000 (1.0)      6.5768 (1.35)     0.0000 (1.0)           0;0  0.1520 (0.74)          1           1
test_partial_remove-gc-cloud[main]       6.6140 (1.35)     6.6140 (1.35)     6.6140 (1.35)     0.0000 (1.0)      6.6140 (1.35)     0.0000 (1.0)           0;0  0.1512 (0.74)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     51.6457 (2.36)     51.6457 (2.36)     51.6457 (2.36)     0.0000 (1.0)      51.6457 (2.36)     0.0000 (1.0)           0;0  0.0194 (0.42)          1           1
test_partial_remove-push[3.10.0]     46.2331 (2.11)     46.2331 (2.11)     46.2331 (2.11)     0.0000 (1.0)      46.2331 (2.11)     0.0000 (1.0)           0;0  0.0216 (0.47)          1           1
test_partial_remove-push[3.53.2]     23.0444 (1.05)     23.0444 (1.05)     23.0444 (1.05)     0.0000 (1.0)      23.0444 (1.05)     0.0000 (1.0)           0;0  0.0434 (0.95)          1           1
test_partial_remove-push[3.60.1]     22.3708 (1.02)     22.3708 (1.02)     22.3708 (1.02)     0.0000 (1.0)      22.3708 (1.02)     0.0000 (1.0)           0;0  0.0447 (0.98)          1           1
test_partial_remove-push[main]       21.8778 (1.0)      21.8778 (1.0)      21.8778 (1.0)      0.0000 (1.0)      21.8778 (1.0)      0.0000 (1.0)           0;0  0.0457 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     3.8316 (1.0)      3.8316 (1.0)      3.8316 (1.0)      0.0000 (1.0)      3.8316 (1.0)      0.0000 (1.0)           0;0  0.2610 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     4.0016 (1.04)     4.0016 (1.04)     4.0016 (1.04)     0.0000 (1.0)      4.0016 (1.04)     0.0000 (1.0)           0;0  0.2499 (0.96)          1           1
test_partial_remove-push-update[3.53.2]     7.0905 (1.85)     7.0905 (1.85)     7.0905 (1.85)     0.0000 (1.0)      7.0905 (1.85)     0.0000 (1.0)           0;0  0.1410 (0.54)          1           1
test_partial_remove-push-update[3.60.1]     7.0599 (1.84)     7.0599 (1.84)     7.0599 (1.84)     0.0000 (1.0)      7.0599 (1.84)     0.0000 (1.0)           0;0  0.1416 (0.54)          1           1
test_partial_remove-push-update[main]       7.1397 (1.86)     7.1397 (1.86)     7.1397 (1.86)     0.0000 (1.0)      7.1397 (1.86)     0.0000 (1.0)           0;0  0.1401 (0.54)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
DVC Plot 

----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     484.6743 (1.0)      501.7659 (1.0)      492.1858 (1.0)       8.4253 (1.84)     486.8612 (1.0)      14.9897 (3.03)          2;0  2.0318 (1.0)           5           3
test_plots-plots-diff[3.10.0]     890.3456 (1.84)     928.9141 (1.85)     904.1568 (1.84)     14.7268 (3.22)     898.5222 (1.85)     14.1398 (2.86)          1;0  1.1060 (0.54)          5           3
test_plots-plots-diff[3.53.2]     812.0586 (1.68)     842.5852 (1.68)     823.8627 (1.67)     12.2174 (2.67)     822.2025 (1.69)     17.7281 (3.58)          1;0  1.2138 (0.60)          5           3
test_plots-plots-diff[3.60.1]     805.2230 (1.66)     847.0160 (1.69)     819.7889 (1.67)     17.6464 (3.86)     811.1240 (1.67)     25.7834 (5.21)          1;0  1.2198 (0.60)          5           3
test_plots-plots-diff[main]       815.6367 (1.68)     827.4127 (1.65)     819.7461 (1.67)      4.5675 (1.0)      818.6136 (1.68)      4.9458 (1.0)           1;0  1.2199 (0.60)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       499.6950 (1.0)        511.5378 (1.0)        506.4386 (1.0)       4.7308 (2.47)       507.3483 (1.0)       7.3269 (2.35)          2;0  1.9746 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,138.9208 (2.28)     1,166.1409 (2.28)     1,154.2416 (2.28)     11.2087 (5.86)     1,154.7242 (2.28)     18.5045 (5.94)          2;0  0.8664 (0.44)          5           3
test_plots-plots-diff-json[3.53.2]       889.6476 (1.78)       894.3475 (1.75)       892.0496 (1.76)      1.9133 (1.0)        892.4813 (1.76)      3.1170 (1.0)           2;0  1.1210 (0.57)          5           3
test_plots-plots-diff-json[3.60.1]       883.9551 (1.77)       895.1990 (1.75)       889.1769 (1.76)      5.2066 (2.72)       887.1915 (1.75)      9.5408 (3.06)          2;0  1.1246 (0.57)          5           3
test_plots-plots-diff-json[main]         888.5826 (1.78)       921.8196 (1.80)       905.1732 (1.79)     13.7704 (7.20)       908.6413 (1.79)     22.8488 (7.33)          2;0  1.1048 (0.56)          5           3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     438.7780 (1.0)      448.8480 (1.0)      443.1609 (1.0)       4.1597 (2.85)     443.5696 (1.0)       6.7635 (3.17)          2;0  2.2565 (1.0)           5           3
test_plots-plots-show[3.10.0]     709.6324 (1.62)     715.2018 (1.59)     712.0573 (1.61)      2.1383 (1.47)     712.0396 (1.61)      2.9923 (1.40)          2;0  1.4044 (0.62)          5           3
test_plots-plots-show[3.53.2]     695.1394 (1.58)     698.6741 (1.56)     696.4060 (1.57)      1.4588 (1.0)      696.2306 (1.57)      2.1353 (1.0)           1;0  1.4359 (0.64)          5           3
test_plots-plots-show[3.60.1]     689.0877 (1.57)     696.4917 (1.55)     693.1048 (1.56)      3.0254 (2.07)     693.4726 (1.56)      5.0035 (2.34)          2;0  1.4428 (0.64)          5           3
test_plots-plots-show[main]       688.7385 (1.57)     715.4248 (1.59)     698.4307 (1.58)     11.2197 (7.69)     693.1203 (1.56)     16.7673 (7.85)          1;0  1.4318 (0.63)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     423.8513 (1.0)      437.8237 (1.0)      430.3791 (1.0)      5.9775 (1.24)     432.1479 (1.0)      10.0445 (1.36)          2;0  2.3235 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     853.1391 (2.01)     869.6603 (1.99)     860.2454 (2.00)     6.1355 (1.28)     859.8870 (1.99)      7.3836 (1.0)           2;0  1.1625 (0.50)          5           3
test_plots-plots-show-json[3.53.2]     737.6503 (1.74)     755.6808 (1.73)     746.5949 (1.73)     6.6209 (1.38)     745.5618 (1.73)      8.0765 (1.09)          2;0  1.3394 (0.58)          5           3
test_plots-plots-show-json[3.60.1]     740.8078 (1.75)     758.7644 (1.73)     746.8959 (1.74)     7.8802 (1.64)     742.2765 (1.72)     11.8721 (1.61)          1;0  1.3389 (0.58)          5           3
test_plots-plots-show-json[main]       740.1116 (1.75)     751.0794 (1.72)     744.5037 (1.73)     4.8060 (1.0)      742.8349 (1.72)      8.2473 (1.12)          1;0  1.3432 (0.58)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
DVC Plot 

-------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     51.7094 (2.37)     51.7094 (2.37)     51.7094 (2.37)     0.0000 (1.0)      51.7094 (2.37)     0.0000 (1.0)           0;0  0.0193 (0.42)          1           1
test_push-push[3.10.0]     46.6503 (2.14)     46.6503 (2.14)     46.6503 (2.14)     0.0000 (1.0)      46.6503 (2.14)     0.0000 (1.0)           0;0  0.0214 (0.47)          1           1
test_push-push[3.53.2]     22.3839 (1.03)     22.3839 (1.03)     22.3839 (1.03)     0.0000 (1.0)      22.3839 (1.03)     0.0000 (1.0)           0;0  0.0447 (0.98)          1           1
test_push-push[3.60.1]     22.1023 (1.01)     22.1023 (1.01)     22.1023 (1.01)     0.0000 (1.0)      22.1023 (1.01)     0.0000 (1.0)           0;0  0.0452 (0.99)          1           1
test_push-push[main]       21.8251 (1.0)      21.8251 (1.0)      21.8251 (1.0)      0.0000 (1.0)      21.8251 (1.0)      0.0000 (1.0)           0;0  0.0458 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
DVC Plot 

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     62.8346 (2.73)     62.8346 (2.73)     62.8346 (2.73)     0.0000 (1.0)      62.8346 (2.73)     0.0000 (1.0)           0;0  0.0159 (0.37)          1           1
test_sharing-fetch[3.10.0]     68.3633 (2.97)     68.3633 (2.97)     68.3633 (2.97)     0.0000 (1.0)      68.3633 (2.97)     0.0000 (1.0)           0;0  0.0146 (0.34)          1           1
test_sharing-fetch[3.53.2]     33.2177 (1.44)     33.2177 (1.44)     33.2177 (1.44)     0.0000 (1.0)      33.2177 (1.44)     0.0000 (1.0)           0;0  0.0301 (0.69)          1           1
test_sharing-fetch[3.60.1]     23.0115 (1.0)      23.0115 (1.0)      23.0115 (1.0)      0.0000 (1.0)      23.0115 (1.0)      0.0000 (1.0)           0;0  0.0435 (1.0)           1           1
test_sharing-fetch[main]       23.1036 (1.00)     23.1036 (1.00)     23.1036 (1.00)     0.0000 (1.0)      23.1036 (1.00)     0.0000 (1.0)           0;0  0.0433 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2077 (1.0)      1.2077 (1.0)      1.2077 (1.0)      0.0000 (1.0)      1.2077 (1.0)      0.0000 (1.0)           0;0  0.8280 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.5956 (2.98)     3.5956 (2.98)     3.5956 (2.98)     0.0000 (1.0)      3.5956 (2.98)     0.0000 (1.0)           0;0  0.2781 (0.34)          1           1
test_sharing-fetch-noop[3.53.2]     5.6663 (4.69)     5.6663 (4.69)     5.6663 (4.69)     0.0000 (1.0)      5.6663 (4.69)     0.0000 (1.0)           0;0  0.1765 (0.21)          1           1
test_sharing-fetch-noop[3.60.1]     5.6991 (4.72)     5.6991 (4.72)     5.6991 (4.72)     0.0000 (1.0)      5.6991 (4.72)     0.0000 (1.0)           0;0  0.1755 (0.21)          1           1
test_sharing-fetch-noop[main]       5.7984 (4.80)     5.7984 (4.80)     5.7984 (4.80)     0.0000 (1.0)      5.7984 (4.80)     0.0000 (1.0)           0;0  0.1725 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     51.4887 (2.38)     51.4887 (2.38)     51.4887 (2.38)     0.0000 (1.0)      51.4887 (2.38)     0.0000 (1.0)           0;0  0.0194 (0.42)          1           1
test_sharing-push[3.10.0]     45.6410 (2.11)     45.6410 (2.11)     45.6410 (2.11)     0.0000 (1.0)      45.6410 (2.11)     0.0000 (1.0)           0;0  0.0219 (0.47)          1           1
test_sharing-push[3.53.2]     22.4659 (1.04)     22.4659 (1.04)     22.4659 (1.04)     0.0000 (1.0)      22.4659 (1.04)     0.0000 (1.0)           0;0  0.0445 (0.96)          1           1
test_sharing-push[3.60.1]     21.6425 (1.0)      21.6425 (1.0)      21.6425 (1.0)      0.0000 (1.0)      21.6425 (1.0)      0.0000 (1.0)           0;0  0.0462 (1.0)           1           1
test_sharing-push[main]       21.7198 (1.00)     21.7198 (1.00)     21.7198 (1.00)     0.0000 (1.0)      21.7198 (1.00)     0.0000 (1.0)           0;0  0.0460 (1.00)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.0043 (1.00)     2.0043 (1.00)     2.0043 (1.00)     0.0000 (1.0)      2.0043 (1.00)     0.0000 (1.0)           0;0  0.4989 (1.00)          1           1
test_sharing-push-noop[3.10.0]     1.9979 (1.0)      1.9979 (1.0)      1.9979 (1.0)      0.0000 (1.0)      1.9979 (1.0)      0.0000 (1.0)           0;0  0.5005 (1.0)           1           1
test_sharing-push-noop[3.53.2]     5.8451 (2.93)     5.8451 (2.93)     5.8451 (2.93)     0.0000 (1.0)      5.8451 (2.93)     0.0000 (1.0)           0;0  0.1711 (0.34)          1           1
test_sharing-push-noop[3.60.1]     5.8568 (2.93)     5.8568 (2.93)     5.8568 (2.93)     0.0000 (1.0)      5.8568 (2.93)     0.0000 (1.0)           0;0  0.1707 (0.34)          1           1
test_sharing-push-noop[main]       5.8560 (2.93)     5.8560 (2.93)     5.8560 (2.93)     0.0000 (1.0)      5.8560 (2.93)     0.0000 (1.0)           0;0  0.1708 (0.34)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
DVC Plot 

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     355.0863 (1.03)     355.0863 (1.03)     355.0863 (1.03)     0.0000 (1.0)      355.0863 (1.03)     0.0000 (1.0)           0;0  0.0028 (0.97)          1           1
test_sharing_azure-fetch[main]       343.6986 (1.0)      343.6986 (1.0)      343.6986 (1.0)      0.0000 (1.0)      343.6986 (1.0)      0.0000 (1.0)           0;0  0.0029 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.7497 (1.0)      6.7497 (1.0)      6.7497 (1.0)      0.0000 (1.0)      6.7497 (1.0)      0.0000 (1.0)           0;0  0.1482 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       6.8440 (1.01)     6.8440 (1.01)     6.8440 (1.01)     0.0000 (1.0)      6.8440 (1.01)     0.0000 (1.0)           0;0  0.1461 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     348.5055 (1.0)      348.5055 (1.0)      348.5055 (1.0)      0.0000 (1.0)      348.5055 (1.0)      0.0000 (1.0)           0;0  0.0029 (1.0)           1           1
test_sharing_azure-push[main]       358.8344 (1.03)     358.8344 (1.03)     358.8344 (1.03)     0.0000 (1.0)      358.8344 (1.03)     0.0000 (1.0)           0;0  0.0028 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     8.0338 (1.0)      8.0338 (1.0)      8.0338 (1.0)      0.0000 (1.0)      8.0338 (1.0)      0.0000 (1.0)           0;0  0.1245 (1.0)           1           1
test_sharing_azure-push-noop[main]       8.0825 (1.01)     8.0825 (1.01)     8.0825 (1.01)     0.0000 (1.0)      8.0825 (1.01)     0.0000 (1.0)           0;0  0.1237 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
DVC Plot 

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[3.53.2]     251.5557 (1.01)     251.5557 (1.01)     251.5557 (1.01)     0.0000 (1.0)      251.5557 (1.01)     0.0000 (1.0)           0;0  0.0040 (0.99)          1           1
test_sharing_gs-fetch[main]       248.4236 (1.0)      248.4236 (1.0)      248.4236 (1.0)      0.0000 (1.0)      248.4236 (1.0)      0.0000 (1.0)           0;0  0.0040 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch-noop': 2 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[3.53.2]     14.2615 (1.0)      14.2615 (1.0)      14.2615 (1.0)      0.0000 (1.0)      14.2615 (1.0)      0.0000 (1.0)           0;0  0.0701 (1.0)           1           1
test_sharing_gs-fetch-noop[main]       14.4154 (1.01)     14.4154 (1.01)     14.4154 (1.01)     0.0000 (1.0)      14.4154 (1.01)     0.0000 (1.0)           0;0  0.0694 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[3.53.2]     604.4313 (1.0)      604.4313 (1.0)      604.4313 (1.0)      0.0000 (1.0)      604.4313 (1.0)      0.0000 (1.0)           0;0  0.0017 (1.0)           1           1
test_sharing_gs-push[main]       617.4026 (1.02)     617.4026 (1.02)     617.4026 (1.02)     0.0000 (1.0)      617.4026 (1.02)     0.0000 (1.0)           0;0  0.0016 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[3.53.2]     6.4043 (1.0)      6.4043 (1.0)      6.4043 (1.0)      0.0000 (1.0)      6.4043 (1.0)      0.0000 (1.0)           0;0  0.1561 (1.0)           1           1
test_sharing_gs-push-noop[main]       6.4237 (1.00)     6.4237 (1.00)     6.4237 (1.00)     0.0000 (1.0)      6.4237 (1.00)     0.0000 (1.0)           0;0  0.1557 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
DVC Plot 

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     288.3135 (1.0)      288.3135 (1.0)      288.3135 (1.0)      0.0000 (1.0)      288.3135 (1.0)      0.0000 (1.0)           0;0  0.0035 (1.0)           1           1
test_sharing_s3-fetch[main]       300.5462 (1.04)     300.5462 (1.04)     300.5462 (1.04)     0.0000 (1.0)      300.5462 (1.04)     0.0000 (1.0)           0;0  0.0033 (0.96)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.1492 (1.0)      6.1492 (1.0)      6.1492 (1.0)      0.0000 (1.0)      6.1492 (1.0)      0.0000 (1.0)           0;0  0.1626 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       6.3081 (1.03)     6.3081 (1.03)     6.3081 (1.03)     0.0000 (1.0)      6.3081 (1.03)     0.0000 (1.0)           0;0  0.1585 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     326.5426 (1.02)     326.5426 (1.02)     326.5426 (1.02)     0.0000 (1.0)      326.5426 (1.02)     0.0000 (1.0)           0;0  0.0031 (0.98)          1           1
test_sharing_s3-push[main]       320.2136 (1.0)      320.2136 (1.0)      320.2136 (1.0)      0.0000 (1.0)      320.2136 (1.0)      0.0000 (1.0)           0;0  0.0031 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     6.5771 (1.02)     6.5771 (1.02)     6.5771 (1.02)     0.0000 (1.0)      6.5771 (1.02)     0.0000 (1.0)           0;0  0.1520 (0.98)          1           1
test_sharing_s3-push-noop[main]       6.4450 (1.0)      6.4450 (1.0)      6.4450 (1.0)      0.0000 (1.0)      6.4450 (1.0)      0.0000 (1.0)           0;0  0.1552 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
DVC Plot 

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     19.5256 (3.72)     19.5256 (3.72)     19.5256 (3.72)     0.0000 (1.0)      19.5256 (3.72)     0.0000 (1.0)           0;0  0.0512 (0.27)          1           1
test_status-status[3.10.0]     20.0918 (3.82)     20.0918 (3.82)     20.0918 (3.82)     0.0000 (1.0)      20.0918 (3.82)     0.0000 (1.0)           0;0  0.0498 (0.26)          1           1
test_status-status[3.53.2]     18.3195 (3.49)     18.3195 (3.49)     18.3195 (3.49)     0.0000 (1.0)      18.3195 (3.49)     0.0000 (1.0)           0;0  0.0546 (0.29)          1           1
test_status-status[3.60.1]      5.2532 (1.0)       5.2532 (1.0)       5.2532 (1.0)      0.0000 (1.0)       5.2532 (1.0)      0.0000 (1.0)           0;0  0.1904 (1.0)           1           1
test_status-status[main]        5.2584 (1.00)      5.2584 (1.00)      5.2584 (1.00)     0.0000 (1.0)       5.2584 (1.00)     0.0000 (1.0)           0;0  0.1902 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.7753 (1.80)     4.7753 (1.80)     4.7753 (1.80)     0.0000 (1.0)      4.7753 (1.80)     0.0000 (1.0)           0;0  0.2094 (0.56)          1           1
test_status-status-changed[3.10.0]     5.0076 (1.89)     5.0076 (1.89)     5.0076 (1.89)     0.0000 (1.0)      5.0076 (1.89)     0.0000 (1.0)           0;0  0.1997 (0.53)          1           1
test_status-status-changed[3.53.2]     4.9430 (1.86)     4.9430 (1.86)     4.9430 (1.86)     0.0000 (1.0)      4.9430 (1.86)     0.0000 (1.0)           0;0  0.2023 (0.54)          1           1
test_status-status-changed[3.60.1]     2.7770 (1.05)     2.7770 (1.05)     2.7770 (1.05)     0.0000 (1.0)      2.7770 (1.05)     0.0000 (1.0)           0;0  0.3601 (0.96)          1           1
test_status-status-changed[main]       2.6561 (1.0)      2.6561 (1.0)      2.6561 (1.0)      0.0000 (1.0)      2.6561 (1.0)      0.0000 (1.0)           0;0  0.3765 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     4.8161 (1.83)     4.8161 (1.83)     4.8161 (1.83)     0.0000 (1.0)      4.8161 (1.83)     0.0000 (1.0)           0;0  0.2076 (0.55)          1           1
test_status-status-changed-noop[3.10.0]     4.9866 (1.90)     4.9866 (1.90)     4.9866 (1.90)     0.0000 (1.0)      4.9866 (1.90)     0.0000 (1.0)           0;0  0.2005 (0.53)          1           1
test_status-status-changed-noop[3.53.2]     4.9331 (1.88)     4.9331 (1.88)     4.9331 (1.88)     0.0000 (1.0)      4.9331 (1.88)     0.0000 (1.0)           0;0  0.2027 (0.53)          1           1
test_status-status-changed-noop[3.60.1]     2.6939 (1.02)     2.6939 (1.02)     2.6939 (1.02)     0.0000 (1.0)      2.6939 (1.02)     0.0000 (1.0)           0;0  0.3712 (0.98)          1           1
test_status-status-changed-noop[main]       2.6295 (1.0)      2.6295 (1.0)      2.6295 (1.0)      0.0000 (1.0)      2.6295 (1.0)      0.0000 (1.0)           0;0  0.3803 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     4.7279 (1.84)     4.7279 (1.84)     4.7279 (1.84)     0.0000 (1.0)      4.7279 (1.84)     0.0000 (1.0)           0;0  0.2115 (0.54)          1           1
test_status-status-noop[3.10.0]     4.9875 (1.94)     4.9875 (1.94)     4.9875 (1.94)     0.0000 (1.0)      4.9875 (1.94)     0.0000 (1.0)           0;0  0.2005 (0.52)          1           1
test_status-status-noop[3.53.2]     4.8429 (1.88)     4.8429 (1.88)     4.8429 (1.88)     0.0000 (1.0)      4.8429 (1.88)     0.0000 (1.0)           0;0  0.2065 (0.53)          1           1
test_status-status-noop[3.60.1]     2.6614 (1.04)     2.6614 (1.04)     2.6614 (1.04)     0.0000 (1.0)      2.6614 (1.04)     0.0000 (1.0)           0;0  0.3757 (0.97)          1           1
test_status-status-noop[main]       2.5695 (1.0)      2.5695 (1.0)      2.5695 (1.0)      0.0000 (1.0)      2.5695 (1.0)      0.0000 (1.0)           0;0  0.3892 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
DVC Plot 

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     152.2097 (3.31)     152.2097 (3.31)     152.2097 (3.31)     0.0000 (1.0)      152.2097 (3.31)     0.0000 (1.0)           0;0  0.0066 (0.30)          1           1
test_update-import-url[3.10.0]     157.4650 (3.42)     157.4650 (3.42)     157.4650 (3.42)     0.0000 (1.0)      157.4650 (3.42)     0.0000 (1.0)           0;0  0.0064 (0.29)          1           1
test_update-import-url[3.53.2]     117.1749 (2.54)     117.1749 (2.54)     117.1749 (2.54)     0.0000 (1.0)      117.1749 (2.54)     0.0000 (1.0)           0;0  0.0085 (0.39)          1           1
test_update-import-url[3.60.1]      46.0482 (1.0)       46.0482 (1.0)       46.0482 (1.0)      0.0000 (1.0)       46.0482 (1.0)      0.0000 (1.0)           0;0  0.0217 (1.0)           1           1
test_update-import-url[main]        46.0682 (1.00)      46.0682 (1.00)      46.0682 (1.00)     0.0000 (1.0)       46.0682 (1.00)     0.0000 (1.0)           0;0  0.0217 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     137.8961 (3.91)     137.8961 (3.91)     137.8961 (3.91)     0.0000 (1.0)      137.8961 (3.91)     0.0000 (1.0)           0;0  0.0073 (0.26)          1           1
test_update-update[3.10.0]     141.1900 (4.00)     141.1900 (4.00)     141.1900 (4.00)     0.0000 (1.0)      141.1900 (4.00)     0.0000 (1.0)           0;0  0.0071 (0.25)          1           1
test_update-update[3.53.2]     107.6023 (3.05)     107.6023 (3.05)     107.6023 (3.05)     0.0000 (1.0)      107.6023 (3.05)     0.0000 (1.0)           0;0  0.0093 (0.33)          1           1
test_update-update[3.60.1]      35.2575 (1.0)       35.2575 (1.0)       35.2575 (1.0)      0.0000 (1.0)       35.2575 (1.0)      0.0000 (1.0)           0;0  0.0284 (1.0)           1           1
test_update-update[main]        35.4392 (1.01)      35.4392 (1.01)      35.4392 (1.01)     0.0000 (1.0)       35.4392 (1.01)     0.0000 (1.0)           0;0  0.0282 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     15.7304 (2.04)     15.7304 (2.04)     15.7304 (2.04)     0.0000 (1.0)      15.7304 (2.04)     0.0000 (1.0)           0;0  0.0636 (0.49)          1           1
test_update-update-noop[3.10.0]     16.4879 (2.14)     16.4879 (2.14)     16.4879 (2.14)     0.0000 (1.0)      16.4879 (2.14)     0.0000 (1.0)           0;0  0.0607 (0.47)          1           1
test_update-update-noop[3.53.2]     15.8781 (2.06)     15.8781 (2.06)     15.8781 (2.06)     0.0000 (1.0)      15.8781 (2.06)     0.0000 (1.0)           0;0  0.0630 (0.49)          1           1
test_update-update-noop[3.60.1]      7.7143 (1.0)       7.7143 (1.0)       7.7143 (1.0)      0.0000 (1.0)       7.7143 (1.0)      0.0000 (1.0)           0;0  0.1296 (1.0)           1           1
test_update-update-noop[main]        7.7783 (1.01)      7.7783 (1.01)      7.7783 (1.01)     0.0000 (1.0)       7.7783 (1.01)     0.0000 (1.0)           0;0  0.1286 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean