Wed Jun  4 08:57:21 UTC 2025
dataset: tiny
project: example-get-started

DVC Plot

-------------------------------------------------------------------------------- benchmark 'test_add_copy-add': 4 tests --------------------------------------------------------------------------------
Name (time in ms)                    Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]       744.6842 (1.0)        744.6842 (1.0)        744.6842 (1.0)      0.0000 (1.0)        744.6842 (1.0)      0.0000 (1.0)           0;0  1.3429 (1.0)           1           1
test_add_copy-add[3.10.0]       857.1377 (1.15)       857.1377 (1.15)       857.1377 (1.15)     0.0000 (1.0)        857.1377 (1.15)     0.0000 (1.0)           0;0  1.1667 (0.87)          1           1
test_add_copy-add[3.53.2]       764.9153 (1.03)       764.9153 (1.03)       764.9153 (1.03)     0.0000 (1.0)        764.9153 (1.03)     0.0000 (1.0)           0;0  1.3073 (0.97)          1           1
test_add_copy-add[main]       1,234.3619 (1.66)     1,234.3619 (1.66)     1,234.3619 (1.66)     0.0000 (1.0)      1,234.3619 (1.66)     0.0000 (1.0)           0;0  0.8101 (0.60)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     575.4138 (1.06)     575.4138 (1.06)     575.4138 (1.06)     0.0000 (1.0)      575.4138 (1.06)     0.0000 (1.0)           0;0  1.7379 (0.94)          1           1
test_add_copy-add-noop[3.10.0]     573.1191 (1.06)     573.1191 (1.06)     573.1191 (1.06)     0.0000 (1.0)      573.1191 (1.06)     0.0000 (1.0)           0;0  1.7448 (0.95)          1           1
test_add_copy-add-noop[3.53.2]     542.9589 (1.0)      542.9589 (1.0)      542.9589 (1.0)      0.0000 (1.0)      542.9589 (1.0)      0.0000 (1.0)           0;0  1.8418 (1.0)           1           1
test_add_copy-add-noop[main]       547.3246 (1.01)     547.3246 (1.01)     547.3246 (1.01)     0.0000 (1.0)      547.3246 (1.01)     0.0000 (1.0)           0;0  1.8271 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

-------------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 4 tests --------------------------------------------------------------------------------
Name (time in ms)                        Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]       751.4443 (1.0)        751.4443 (1.0)        751.4443 (1.0)      0.0000 (1.0)        751.4443 (1.0)      0.0000 (1.0)           0;0  1.3308 (1.0)           1           1
test_add_hardlink-add[3.10.0]       855.7553 (1.14)       855.7553 (1.14)       855.7553 (1.14)     0.0000 (1.0)        855.7553 (1.14)     0.0000 (1.0)           0;0  1.1686 (0.88)          1           1
test_add_hardlink-add[3.53.2]       752.4155 (1.00)       752.4155 (1.00)       752.4155 (1.00)     0.0000 (1.0)        752.4155 (1.00)     0.0000 (1.0)           0;0  1.3291 (1.00)          1           1
test_add_hardlink-add[main]       1,244.8197 (1.66)     1,244.8197 (1.66)     1,244.8197 (1.66)     0.0000 (1.0)      1,244.8197 (1.66)     0.0000 (1.0)           0;0  0.8033 (0.60)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     577.1122 (1.04)     577.1122 (1.04)     577.1122 (1.04)     0.0000 (1.0)      577.1122 (1.04)     0.0000 (1.0)           0;0  1.7328 (0.96)          1           1
test_add_hardlink-add-noop[3.10.0]     639.1842 (1.16)     639.1842 (1.16)     639.1842 (1.16)     0.0000 (1.0)      639.1842 (1.16)     0.0000 (1.0)           0;0  1.5645 (0.86)          1           1
test_add_hardlink-add-noop[3.53.2]     552.3536 (1.0)      552.3536 (1.0)      552.3536 (1.0)      0.0000 (1.0)      552.3536 (1.0)      0.0000 (1.0)           0;0  1.8104 (1.0)           1           1
test_add_hardlink-add-noop[main]       582.7240 (1.05)     582.7240 (1.05)     582.7240 (1.05)     0.0000 (1.0)      582.7240 (1.05)     0.0000 (1.0)           0;0  1.7161 (0.95)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

-------------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 4 tests --------------------------------------------------------------------------------
Name (time in ms)                       Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]       743.0141 (1.0)        743.0141 (1.0)        743.0141 (1.0)      0.0000 (1.0)        743.0141 (1.0)      0.0000 (1.0)           0;0  1.3459 (1.0)           1           1
test_add_symlink-add[3.10.0]       861.7241 (1.16)       861.7241 (1.16)       861.7241 (1.16)     0.0000 (1.0)        861.7241 (1.16)     0.0000 (1.0)           0;0  1.1605 (0.86)          1           1
test_add_symlink-add[3.53.2]       751.4285 (1.01)       751.4285 (1.01)       751.4285 (1.01)     0.0000 (1.0)        751.4285 (1.01)     0.0000 (1.0)           0;0  1.3308 (0.99)          1           1
test_add_symlink-add[main]       1,268.4987 (1.71)     1,268.4987 (1.71)     1,268.4987 (1.71)     0.0000 (1.0)      1,268.4987 (1.71)     0.0000 (1.0)           0;0  0.7883 (0.59)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     584.3757 (1.05)     584.3757 (1.05)     584.3757 (1.05)     0.0000 (1.0)      584.3757 (1.05)     0.0000 (1.0)           0;0  1.7112 (0.95)          1           1
test_add_symlink-add-noop[3.10.0]     582.6949 (1.05)     582.6949 (1.05)     582.6949 (1.05)     0.0000 (1.0)      582.6949 (1.05)     0.0000 (1.0)           0;0  1.7162 (0.95)          1           1
test_add_symlink-add-noop[3.53.2]     558.7653 (1.01)     558.7653 (1.01)     558.7653 (1.01)     0.0000 (1.0)      558.7653 (1.01)     0.0000 (1.0)           0;0  1.7897 (0.99)          1           1
test_add_symlink-add-noop[main]       554.8930 (1.0)      554.8930 (1.0)      554.8930 (1.0)      0.0000 (1.0)      554.8930 (1.0)      0.0000 (1.0)           0;0  1.8021 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

-------------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 4 tests --------------------------------------------------------------------------------
Name (time in ms)                              Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]       737.2802 (1.0)        737.2802 (1.0)        737.2802 (1.0)      0.0000 (1.0)        737.2802 (1.0)      0.0000 (1.0)           0;0  1.3563 (1.0)           1           1
test_checkout_copy-checkout[3.10.0]       852.2244 (1.16)       852.2244 (1.16)       852.2244 (1.16)     0.0000 (1.0)        852.2244 (1.16)     0.0000 (1.0)           0;0  1.1734 (0.87)          1           1
test_checkout_copy-checkout[3.53.2]       782.7416 (1.06)       782.7416 (1.06)       782.7416 (1.06)     0.0000 (1.0)        782.7416 (1.06)     0.0000 (1.0)           0;0  1.2776 (0.94)          1           1
test_checkout_copy-checkout[main]       1,254.9293 (1.70)     1,254.9293 (1.70)     1,254.9293 (1.70)     0.0000 (1.0)      1,254.9293 (1.70)     0.0000 (1.0)           0;0  0.7969 (0.59)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     406.8483 (1.02)     406.8483 (1.02)     406.8483 (1.02)     0.0000 (1.0)      406.8483 (1.02)     0.0000 (1.0)           0;0  2.4579 (0.98)          1           1
test_checkout_copy-checkout-noop[3.10.0]     430.4088 (1.08)     430.4088 (1.08)     430.4088 (1.08)     0.0000 (1.0)      430.4088 (1.08)     0.0000 (1.0)           0;0  2.3234 (0.92)          1           1
test_checkout_copy-checkout-noop[3.53.2]     397.0753 (1.0)      397.0753 (1.0)      397.0753 (1.0)      0.0000 (1.0)      397.0753 (1.0)      0.0000 (1.0)           0;0  2.5184 (1.0)           1           1
test_checkout_copy-checkout-noop[main]       401.9208 (1.01)     401.9208 (1.01)     401.9208 (1.01)     0.0000 (1.0)      401.9208 (1.01)     0.0000 (1.0)           0;0  2.4881 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-update': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     453.0273 (1.0)      453.0273 (1.0)      453.0273 (1.0)      0.0000 (1.0)      453.0273 (1.0)      0.0000 (1.0)           0;0  2.2074 (1.0)           1           1
test_checkout_copy-checkout-update[3.10.0]     490.8095 (1.08)     490.8095 (1.08)     490.8095 (1.08)     0.0000 (1.0)      490.8095 (1.08)     0.0000 (1.0)           0;0  2.0375 (0.92)          1           1
test_checkout_copy-checkout-update[3.53.2]     464.9817 (1.03)     464.9817 (1.03)     464.9817 (1.03)     0.0000 (1.0)      464.9817 (1.03)     0.0000 (1.0)           0;0  2.1506 (0.97)          1           1
test_checkout_copy-checkout-update[main]       463.0982 (1.02)     463.0982 (1.02)     463.0982 (1.02)     0.0000 (1.0)      463.0982 (1.02)     0.0000 (1.0)           0;0  2.1594 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

-------------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 4 tests --------------------------------------------------------------------------------
Name (time in ms)                                  Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]       740.6843 (1.02)       740.6843 (1.02)       740.6843 (1.02)     0.0000 (1.0)        740.6843 (1.02)     0.0000 (1.0)           0;0  1.3501 (0.98)          1           1
test_checkout_hardlink-checkout[3.10.0]       791.8865 (1.09)       791.8865 (1.09)       791.8865 (1.09)     0.0000 (1.0)        791.8865 (1.09)     0.0000 (1.0)           0;0  1.2628 (0.92)          1           1
test_checkout_hardlink-checkout[3.53.2]       727.5041 (1.0)        727.5041 (1.0)        727.5041 (1.0)      0.0000 (1.0)        727.5041 (1.0)      0.0000 (1.0)           0;0  1.3746 (1.0)           1           1
test_checkout_hardlink-checkout[main]       1,205.4630 (1.66)     1,205.4630 (1.66)     1,205.4630 (1.66)     0.0000 (1.0)      1,205.4630 (1.66)     0.0000 (1.0)           0;0  0.8296 (0.60)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     411.7189 (1.04)     411.7189 (1.04)     411.7189 (1.04)     0.0000 (1.0)      411.7189 (1.04)     0.0000 (1.0)           0;0  2.4288 (0.96)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     404.0110 (1.02)     404.0110 (1.02)     404.0110 (1.02)     0.0000 (1.0)      404.0110 (1.02)     0.0000 (1.0)           0;0  2.4752 (0.98)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     409.1019 (1.03)     409.1019 (1.03)     409.1019 (1.03)     0.0000 (1.0)      409.1019 (1.03)     0.0000 (1.0)           0;0  2.4444 (0.97)          1           1
test_checkout_hardlink-checkout-noop[main]       397.0110 (1.0)      397.0110 (1.0)      397.0110 (1.0)      0.0000 (1.0)      397.0110 (1.0)      0.0000 (1.0)           0;0  2.5188 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-update': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     445.2772 (1.04)     445.2772 (1.04)     445.2772 (1.04)     0.0000 (1.0)      445.2772 (1.04)     0.0000 (1.0)           0;0  2.2458 (0.96)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     449.6829 (1.05)     449.6829 (1.05)     449.6829 (1.05)     0.0000 (1.0)      449.6829 (1.05)     0.0000 (1.0)           0;0  2.2238 (0.95)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     427.8651 (1.0)      427.8651 (1.0)      427.8651 (1.0)      0.0000 (1.0)      427.8651 (1.0)      0.0000 (1.0)           0;0  2.3372 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       446.2576 (1.04)     446.2576 (1.04)     446.2576 (1.04)     0.0000 (1.0)      446.2576 (1.04)     0.0000 (1.0)           0;0  2.2409 (0.96)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

-------------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 4 tests --------------------------------------------------------------------------------
Name (time in ms)                                 Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]       727.9498 (1.0)        727.9498 (1.0)        727.9498 (1.0)      0.0000 (1.0)        727.9498 (1.0)      0.0000 (1.0)           0;0  1.3737 (1.0)           1           1
test_checkout_symlink-checkout[3.10.0]       861.2814 (1.18)       861.2814 (1.18)       861.2814 (1.18)     0.0000 (1.0)        861.2814 (1.18)     0.0000 (1.0)           0;0  1.1611 (0.85)          1           1
test_checkout_symlink-checkout[3.53.2]       804.4884 (1.11)       804.4884 (1.11)       804.4884 (1.11)     0.0000 (1.0)        804.4884 (1.11)     0.0000 (1.0)           0;0  1.2430 (0.90)          1           1
test_checkout_symlink-checkout[main]       1,284.8799 (1.77)     1,284.8799 (1.77)     1,284.8799 (1.77)     0.0000 (1.0)      1,284.8799 (1.77)     0.0000 (1.0)           0;0  0.7783 (0.57)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     418.2900 (1.0)      418.2900 (1.0)      418.2900 (1.0)      0.0000 (1.0)      418.2900 (1.0)      0.0000 (1.0)           0;0  2.3907 (1.0)           1           1
test_checkout_symlink-checkout-noop[3.10.0]     429.3686 (1.03)     429.3686 (1.03)     429.3686 (1.03)     0.0000 (1.0)      429.3686 (1.03)     0.0000 (1.0)           0;0  2.3290 (0.97)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     451.4995 (1.08)     451.4995 (1.08)     451.4995 (1.08)     0.0000 (1.0)      451.4995 (1.08)     0.0000 (1.0)           0;0  2.2148 (0.93)          1           1
test_checkout_symlink-checkout-noop[main]       444.5902 (1.06)     444.5902 (1.06)     444.5902 (1.06)     0.0000 (1.0)      444.5902 (1.06)     0.0000 (1.0)           0;0  2.2493 (0.94)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     456.7912 (1.0)      456.7912 (1.0)      456.7912 (1.0)      0.0000 (1.0)      456.7912 (1.0)      0.0000 (1.0)           0;0  2.1892 (1.0)           1           1
test_checkout_symlink-checkout-update[3.10.0]     466.2310 (1.02)     466.2310 (1.02)     466.2310 (1.02)     0.0000 (1.0)      466.2310 (1.02)     0.0000 (1.0)           0;0  2.1449 (0.98)          1           1
test_checkout_symlink-checkout-update[3.53.2]     464.5205 (1.02)     464.5205 (1.02)     464.5205 (1.02)     0.0000 (1.0)      464.5205 (1.02)     0.0000 (1.0)           0;0  2.1528 (0.98)          1           1
test_checkout_symlink-checkout-update[main]       466.6515 (1.02)     466.6515 (1.02)     466.6515 (1.02)     0.0000 (1.0)      466.6515 (1.02)     0.0000 (1.0)           0;0  2.1429 (0.98)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     532.3657 (1.21)     532.3657 (1.21)     532.3657 (1.21)     0.0000 (1.0)      532.3657 (1.21)     0.0000 (1.0)           0;0  1.8784 (0.82)          1           1
test_data_status-data-changed[3.10.0]     503.3608 (1.15)     503.3608 (1.15)     503.3608 (1.15)     0.0000 (1.0)      503.3608 (1.15)     0.0000 (1.0)           0;0  1.9866 (0.87)          1           1
test_data_status-data-changed[3.53.2]     446.3501 (1.02)     446.3501 (1.02)     446.3501 (1.02)     0.0000 (1.0)      446.3501 (1.02)     0.0000 (1.0)           0;0  2.2404 (0.98)          1           1
test_data_status-data-changed[main]       439.0385 (1.0)      439.0385 (1.0)      439.0385 (1.0)      0.0000 (1.0)      439.0385 (1.0)      0.0000 (1.0)           0;0  2.2777 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     533.4616 (1.21)     533.4616 (1.21)     533.4616 (1.21)     0.0000 (1.0)      533.4616 (1.21)     0.0000 (1.0)           0;0  1.8745 (0.83)          1           1
test_data_status-data-changed-noop[3.10.0]     498.1385 (1.13)     498.1385 (1.13)     498.1385 (1.13)     0.0000 (1.0)      498.1385 (1.13)     0.0000 (1.0)           0;0  2.0075 (0.89)          1           1
test_data_status-data-changed-noop[3.53.2]     441.7430 (1.0)      441.7430 (1.0)      441.7430 (1.0)      0.0000 (1.0)      441.7430 (1.0)      0.0000 (1.0)           0;0  2.2638 (1.0)           1           1
test_data_status-data-changed-noop[main]       446.9073 (1.01)     446.9073 (1.01)     446.9073 (1.01)     0.0000 (1.0)      446.9073 (1.01)     0.0000 (1.0)           0;0  2.2376 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     909.6756 (1.35)     909.6756 (1.35)     909.6756 (1.35)     0.0000 (1.0)      909.6756 (1.35)     0.0000 (1.0)           0;0  1.0993 (0.74)          1           1
test_data_status-data-new[3.10.0]     818.6554 (1.22)     818.6554 (1.22)     818.6554 (1.22)     0.0000 (1.0)      818.6554 (1.22)     0.0000 (1.0)           0;0  1.2215 (0.82)          1           1
test_data_status-data-new[3.53.2]     672.0456 (1.0)      672.0456 (1.0)      672.0456 (1.0)      0.0000 (1.0)      672.0456 (1.0)      0.0000 (1.0)           0;0  1.4880 (1.0)           1           1
test_data_status-data-new[main]       673.8520 (1.00)     673.8520 (1.00)     673.8520 (1.00)     0.0000 (1.0)      673.8520 (1.00)     0.0000 (1.0)           0;0  1.4840 (1.00)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     532.3084 (1.23)     532.3084 (1.23)     532.3084 (1.23)     0.0000 (1.0)      532.3084 (1.23)     0.0000 (1.0)           0;0  1.8786 (0.81)          1           1
test_data_status-data-noop[3.10.0]     485.2134 (1.12)     485.2134 (1.12)     485.2134 (1.12)     0.0000 (1.0)      485.2134 (1.12)     0.0000 (1.0)           0;0  2.0609 (0.89)          1           1
test_data_status-data-noop[3.53.2]     432.5200 (1.0)      432.5200 (1.0)      432.5200 (1.0)      0.0000 (1.0)      432.5200 (1.0)      0.0000 (1.0)           0;0  2.3120 (1.0)           1           1
test_data_status-data-noop[main]       436.8518 (1.01)     436.8518 (1.01)     436.8518 (1.01)     0.0000 (1.0)      436.8518 (1.01)     0.0000 (1.0)           0;0  2.2891 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     538.7975 (1.17)     538.7975 (1.17)     538.7975 (1.17)     0.0000 (1.0)      538.7975 (1.17)     0.0000 (1.0)           0;0  1.8560 (0.85)          1           1
test_data_status_all_flags-data-changed[3.10.0]     505.5887 (1.10)     505.5887 (1.10)     505.5887 (1.10)     0.0000 (1.0)      505.5887 (1.10)     0.0000 (1.0)           0;0  1.9779 (0.91)          1           1
test_data_status_all_flags-data-changed[3.53.2]     460.9602 (1.00)     460.9602 (1.00)     460.9602 (1.00)     0.0000 (1.0)      460.9602 (1.00)     0.0000 (1.0)           0;0  2.1694 (1.00)          1           1
test_data_status_all_flags-data-changed[main]       459.3979 (1.0)      459.3979 (1.0)      459.3979 (1.0)      0.0000 (1.0)      459.3979 (1.0)      0.0000 (1.0)           0;0  2.1768 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     530.5229 (1.17)     530.5229 (1.17)     530.5229 (1.17)     0.0000 (1.0)      530.5229 (1.17)     0.0000 (1.0)           0;0  1.8849 (0.86)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     511.1188 (1.13)     511.1188 (1.13)     511.1188 (1.13)     0.0000 (1.0)      511.1188 (1.13)     0.0000 (1.0)           0;0  1.9565 (0.89)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     454.0906 (1.0)      454.0906 (1.0)      454.0906 (1.0)      0.0000 (1.0)      454.0906 (1.0)      0.0000 (1.0)           0;0  2.2022 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       461.6292 (1.02)     461.6292 (1.02)     461.6292 (1.02)     0.0000 (1.0)      461.6292 (1.02)     0.0000 (1.0)           0;0  2.1662 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     777.3482 (1.16)     777.3482 (1.16)     777.3482 (1.16)     0.0000 (1.0)      777.3482 (1.16)     0.0000 (1.0)           0;0  1.2864 (0.87)          1           1
test_data_status_all_flags-data-new[3.10.0]     859.8534 (1.28)     859.8534 (1.28)     859.8534 (1.28)     0.0000 (1.0)      859.8534 (1.28)     0.0000 (1.0)           0;0  1.1630 (0.78)          1           1
test_data_status_all_flags-data-new[3.53.2]     673.0099 (1.0)      673.0099 (1.0)      673.0099 (1.0)      0.0000 (1.0)      673.0099 (1.0)      0.0000 (1.0)           0;0  1.4859 (1.0)           1           1
test_data_status_all_flags-data-new[main]       736.5670 (1.09)     736.5670 (1.09)     736.5670 (1.09)     0.0000 (1.0)      736.5670 (1.09)     0.0000 (1.0)           0;0  1.3576 (0.91)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     529.8348 (1.17)     529.8348 (1.17)     529.8348 (1.17)     0.0000 (1.0)      529.8348 (1.17)     0.0000 (1.0)           0;0  1.8874 (0.86)          1           1
test_data_status_all_flags-data-noop[3.10.0]     506.4777 (1.12)     506.4777 (1.12)     506.4777 (1.12)     0.0000 (1.0)      506.4777 (1.12)     0.0000 (1.0)           0;0  1.9744 (0.90)          1           1
test_data_status_all_flags-data-noop[3.53.2]     464.3329 (1.02)     464.3329 (1.02)     464.3329 (1.02)     0.0000 (1.0)      464.3329 (1.02)     0.0000 (1.0)           0;0  2.1536 (0.98)          1           1
test_data_status_all_flags-data-noop[main]       453.5763 (1.0)      453.5763 (1.0)      453.5763 (1.0)      0.0000 (1.0)      453.5763 (1.0)      0.0000 (1.0)           0;0  2.2047 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

---------------------------------------------------------------------------- benchmark 'test_diff-diff': 4 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     749.3830 (1.04)     749.3830 (1.04)     749.3830 (1.04)     0.0000 (1.0)      749.3830 (1.04)     0.0000 (1.0)           0;0  1.3344 (0.96)          1           1
test_diff-diff[3.10.0]     871.2048 (1.21)     871.2048 (1.21)     871.2048 (1.21)     0.0000 (1.0)      871.2048 (1.21)     0.0000 (1.0)           0;0  1.1478 (0.83)          1           1
test_diff-diff[3.53.2]     721.2490 (1.0)      721.2490 (1.0)      721.2490 (1.0)      0.0000 (1.0)      721.2490 (1.0)      0.0000 (1.0)           0;0  1.3865 (1.0)           1           1
test_diff-diff[main]       840.2144 (1.16)     840.2144 (1.16)     840.2144 (1.16)     0.0000 (1.0)      840.2144 (1.16)     0.0000 (1.0)           0;0  1.1902 (0.86)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     579.6206 (1.16)     579.6206 (1.16)     579.6206 (1.16)     0.0000 (1.0)      579.6206 (1.16)     0.0000 (1.0)           0;0  1.7253 (0.86)          1           1
test_diff-diff-changed[3.10.0]     575.7454 (1.15)     575.7454 (1.15)     575.7454 (1.15)     0.0000 (1.0)      575.7454 (1.15)     0.0000 (1.0)           0;0  1.7369 (0.87)          1           1
test_diff-diff-changed[3.53.2]     499.2544 (1.0)      499.2544 (1.0)      499.2544 (1.0)      0.0000 (1.0)      499.2544 (1.0)      0.0000 (1.0)           0;0  2.0030 (1.0)           1           1
test_diff-diff-changed[main]       501.7260 (1.00)     501.7260 (1.00)     501.7260 (1.00)     0.0000 (1.0)      501.7260 (1.00)     0.0000 (1.0)           0;0  1.9931 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     559.8456 (1.11)     559.8456 (1.11)     559.8456 (1.11)     0.0000 (1.0)      559.8456 (1.11)     0.0000 (1.0)           0;0  1.7862 (0.90)          1           1
test_diff-diff-changed-noop[3.10.0]     562.7319 (1.12)     562.7319 (1.12)     562.7319 (1.12)     0.0000 (1.0)      562.7319 (1.12)     0.0000 (1.0)           0;0  1.7770 (0.89)          1           1
test_diff-diff-changed-noop[3.53.2]     503.3469 (1.0)      503.3469 (1.0)      503.3469 (1.0)      0.0000 (1.0)      503.3469 (1.0)      0.0000 (1.0)           0;0  1.9867 (1.0)           1           1
test_diff-diff-changed-noop[main]       507.9613 (1.01)     507.9613 (1.01)     507.9613 (1.01)     0.0000 (1.0)      507.9613 (1.01)     0.0000 (1.0)           0;0  1.9687 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     572.6161 (1.16)     572.6161 (1.16)     572.6161 (1.16)     0.0000 (1.0)      572.6161 (1.16)     0.0000 (1.0)           0;0  1.7464 (0.86)          1           1
test_diff-diff-noop[3.10.0]     548.6315 (1.11)     548.6315 (1.11)     548.6315 (1.11)     0.0000 (1.0)      548.6315 (1.11)     0.0000 (1.0)           0;0  1.8227 (0.90)          1           1
test_diff-diff-noop[3.53.2]     494.2985 (1.0)      494.2985 (1.0)      494.2985 (1.0)      0.0000 (1.0)      494.2985 (1.0)      0.0000 (1.0)           0;0  2.0231 (1.0)           1           1
test_diff-diff-noop[main]       501.7941 (1.02)     501.7941 (1.02)     501.7941 (1.02)     0.0000 (1.0)      501.7941 (1.02)     0.0000 (1.0)           0;0  1.9928 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

------------------------------------------------------------------------ benchmark 'test_exp_show-exp': 4 tests ------------------------------------------------------------------------
Name (time in s)                 Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]     1.0899 (1.0)      1.0899 (1.0)      1.0899 (1.0)      0.0000 (1.0)      1.0899 (1.0)      0.0000 (1.0)           0;0  0.9175 (1.0)           1           1
test_exp_show-exp[3.10.0]     7.6266 (7.00)     7.6266 (7.00)     7.6266 (7.00)     0.0000 (1.0)      7.6266 (7.00)     0.0000 (1.0)           0;0  0.1311 (0.14)          1           1
test_exp_show-exp[3.53.2]     4.1928 (3.85)     4.1928 (3.85)     4.1928 (3.85)     0.0000 (1.0)      4.1928 (3.85)     0.0000 (1.0)           0;0  0.2385 (0.26)          1           1
test_exp_show-exp[main]       5.4514 (5.00)     5.4514 (5.00)     5.4514 (5.00)     0.0000 (1.0)      5.4514 (5.00)     0.0000 (1.0)           0;0  0.1834 (0.20)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

---------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     643.2922 (1.06)     643.2922 (1.06)     643.2922 (1.06)     0.0000 (1.0)      643.2922 (1.06)     0.0000 (1.0)           0;0  1.5545 (0.94)          1           1
test_fetch-fetch[3.10.0]     756.3458 (1.25)     756.3458 (1.25)     756.3458 (1.25)     0.0000 (1.0)      756.3458 (1.25)     0.0000 (1.0)           0;0  1.3221 (0.80)          1           1
test_fetch-fetch[3.53.2]     656.4054 (1.08)     656.4054 (1.08)     656.4054 (1.08)     0.0000 (1.0)      656.4054 (1.08)     0.0000 (1.0)           0;0  1.5234 (0.92)          1           1
test_fetch-fetch[main]       606.8585 (1.0)      606.8585 (1.0)      606.8585 (1.0)      0.0000 (1.0)      606.8585 (1.0)      0.0000 (1.0)           0;0  1.6478 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

---------------------------------------------------------------------------- benchmark 'test_gc-gc': 4 tests ----------------------------------------------------------------------------
Name (time in ms)           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     499.6961 (1.03)     499.6961 (1.03)     499.6961 (1.03)     0.0000 (1.0)      499.6961 (1.03)     0.0000 (1.0)           0;0  2.0012 (0.97)          1           1
test_gc-gc[3.10.0]     604.5274 (1.25)     604.5274 (1.25)     604.5274 (1.25)     0.0000 (1.0)      604.5274 (1.25)     0.0000 (1.0)           0;0  1.6542 (0.80)          1           1
test_gc-gc[3.53.2]     515.0436 (1.07)     515.0436 (1.07)     515.0436 (1.07)     0.0000 (1.0)      515.0436 (1.07)     0.0000 (1.0)           0;0  1.9416 (0.94)          1           1
test_gc-gc[main]       483.4830 (1.0)      483.4830 (1.0)      483.4830 (1.0)      0.0000 (1.0)      483.4830 (1.0)      0.0000 (1.0)           0;0  2.0683 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

---------------------------------------------------------------------------- benchmark 'test_get-get': 4 tests ----------------------------------------------------------------------------
Name (time in ms)             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     516.4431 (1.0)      516.4431 (1.0)      516.4431 (1.0)      0.0000 (1.0)      516.4431 (1.0)      0.0000 (1.0)           0;0  1.9363 (1.0)           1           1
test_get-get[3.10.0]     723.3231 (1.40)     723.3231 (1.40)     723.3231 (1.40)     0.0000 (1.0)      723.3231 (1.40)     0.0000 (1.0)           0;0  1.3825 (0.71)          1           1
test_get-get[3.53.2]     778.6241 (1.51)     778.6241 (1.51)     778.6241 (1.51)     0.0000 (1.0)      778.6241 (1.51)     0.0000 (1.0)           0;0  1.2843 (0.66)          1           1
test_get-get[main]       710.2213 (1.38)     710.2213 (1.38)     710.2213 (1.38)     0.0000 (1.0)      710.2213 (1.38)     0.0000 (1.0)           0;0  1.4080 (0.73)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

---------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     441.9622 (1.03)     441.9622 (1.03)     441.9622 (1.03)     0.0000 (1.0)      441.9622 (1.03)     0.0000 (1.0)           0;0  2.2626 (0.97)          1           1
test_get_url-get-url[3.10.0]     551.8368 (1.29)     551.8368 (1.29)     551.8368 (1.29)     0.0000 (1.0)      551.8368 (1.29)     0.0000 (1.0)           0;0  1.8121 (0.78)          1           1
test_get_url-get-url[3.53.2]     463.9409 (1.08)     463.9409 (1.08)     463.9409 (1.08)     0.0000 (1.0)      463.9409 (1.08)     0.0000 (1.0)           0;0  2.1554 (0.93)          1           1
test_get_url-get-url[main]       429.2901 (1.0)      429.2901 (1.0)      429.2901 (1.0)      0.0000 (1.0)      429.2901 (1.0)      0.0000 (1.0)           0;0  2.3294 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

---------------------------------------------------------------------------- benchmark 'test_help---help': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     126.3082 (1.01)     135.1851 (1.04)     127.5899 (1.01)     1.1550 (1.14)     127.3394 (1.01)     0.7964 (1.14)         10;4  7.8376 (0.99)        100           1
test_help---help[3.10.0]     124.5862 (1.0)      130.2735 (1.0)      126.0120 (1.0)      1.0175 (1.0)      125.7643 (1.0)      0.6987 (1.0)          16;9  7.9358 (1.0)         100           1
test_help---help[3.53.2]     125.6809 (1.01)     138.2345 (1.06)     127.2681 (1.01)     1.7057 (1.68)     127.0189 (1.01)     0.7412 (1.06)          4;5  7.8574 (0.99)        100           1
test_help---help[main]       126.3368 (1.01)     139.8955 (1.07)     127.5542 (1.01)     1.4466 (1.42)     127.3180 (1.01)     0.8667 (1.24)          4;4  7.8398 (0.99)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

-------------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                     Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]       939.3716 (1.0)        939.3716 (1.0)        939.3716 (1.0)      0.0000 (1.0)        939.3716 (1.0)      0.0000 (1.0)           0;0  1.0645 (1.0)           1           1
test_import-import[3.10.0]       969.5005 (1.03)       969.5005 (1.03)       969.5005 (1.03)     0.0000 (1.0)        969.5005 (1.03)     0.0000 (1.0)           0;0  1.0315 (0.97)          1           1
test_import-import[main]       1,353.7813 (1.44)     1,353.7813 (1.44)     1,353.7813 (1.44)     0.0000 (1.0)      1,353.7813 (1.44)     0.0000 (1.0)           0;0  0.7387 (0.69)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

-------------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 4 tests --------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]       799.3009 (1.0)        799.3009 (1.0)        799.3009 (1.0)      0.0000 (1.0)        799.3009 (1.0)      0.0000 (1.0)           0;0  1.2511 (1.0)           1           1
test_import_url-import-url[3.10.0]       923.8290 (1.16)       923.8290 (1.16)       923.8290 (1.16)     0.0000 (1.0)        923.8290 (1.16)     0.0000 (1.0)           0;0  1.0825 (0.87)          1           1
test_import_url-import-url[3.53.2]       814.5600 (1.02)       814.5600 (1.02)       814.5600 (1.02)     0.0000 (1.0)        814.5600 (1.02)     0.0000 (1.0)           0;0  1.2277 (0.98)          1           1
test_import_url-import-url[main]       1,185.7103 (1.48)     1,185.7103 (1.48)     1,185.7103 (1.48)     0.0000 (1.0)      1,185.7103 (1.48)     0.0000 (1.0)           0;0  0.8434 (0.67)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

----------------------------------------------------------------------------- benchmark 'test_init-init': 4 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     423.6999 (1.07)     475.9601 (1.00)     445.3900 (1.03)     10.4714 (1.0)      446.0045 (1.04)     12.6779 (1.0)          26;3  2.2452 (0.97)        100           1
test_init-init[3.10.0]     423.5726 (1.07)     583.6151 (1.23)     454.7123 (1.05)     16.9910 (1.62)     453.6386 (1.06)     12.7294 (1.00)         12;4  2.1992 (0.95)        100           1
test_init-init[3.53.2]     402.9519 (1.02)     473.9880 (1.0)      431.3451 (1.0)      10.8628 (1.04)     430.1974 (1.00)     13.0078 (1.03)         25;3  2.3183 (1.0)         100           1
test_init-init[main]       395.6925 (1.0)      848.5559 (1.79)     431.9003 (1.00)     44.3403 (4.23)     428.8134 (1.0)      16.2551 (1.28)          2;2  2.3153 (1.00)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

---------------------------------------------------------------------------- benchmark 'test_list-list': 4 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     573.6695 (1.09)     573.6695 (1.09)     573.6695 (1.09)     0.0000 (1.0)      573.6695 (1.09)     0.0000 (1.0)           0;0  1.7432 (0.92)          1           1
test_list-list[3.10.0]     657.2678 (1.25)     657.2678 (1.25)     657.2678 (1.25)     0.0000 (1.0)      657.2678 (1.25)     0.0000 (1.0)           0;0  1.5214 (0.80)          1           1
test_list-list[3.53.2]     558.2351 (1.06)     558.2351 (1.06)     558.2351 (1.06)     0.0000 (1.0)      558.2351 (1.06)     0.0000 (1.0)           0;0  1.7914 (0.94)          1           1
test_list-list[main]       526.8372 (1.0)      526.8372 (1.0)      526.8372 (1.0)      0.0000 (1.0)      526.8372 (1.0)      0.0000 (1.0)           0;0  1.8981 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     415.6556 (1.07)     415.6556 (1.07)     415.6556 (1.07)     0.0000 (1.0)      415.6556 (1.07)     0.0000 (1.0)           0;0  2.4058 (0.94)          1           1
test_list-list-dvc-only[3.10.0]     413.0174 (1.06)     413.0174 (1.06)     413.0174 (1.06)     0.0000 (1.0)      413.0174 (1.06)     0.0000 (1.0)           0;0  2.4212 (0.94)          1           1
test_list-list-dvc-only[3.53.2]     394.9764 (1.01)     394.9764 (1.01)     394.9764 (1.01)     0.0000 (1.0)      394.9764 (1.01)     0.0000 (1.0)           0;0  2.5318 (0.99)          1           1
test_list-list-dvc-only[main]       390.0073 (1.0)      390.0073 (1.0)      390.0073 (1.0)      0.0000 (1.0)      390.0073 (1.0)      0.0000 (1.0)           0;0  2.5641 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-recursive': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     421.3419 (1.06)     421.3419 (1.06)     421.3419 (1.06)     0.0000 (1.0)      421.3419 (1.06)     0.0000 (1.0)           0;0  2.3734 (0.94)          1           1
test_list-list-recursive[3.10.0]     422.3751 (1.06)     422.3751 (1.06)     422.3751 (1.06)     0.0000 (1.0)      422.3751 (1.06)     0.0000 (1.0)           0;0  2.3676 (0.94)          1           1
test_list-list-recursive[3.53.2]     397.4718 (1.0)      397.4718 (1.0)      397.4718 (1.0)      0.0000 (1.0)      397.4718 (1.0)      0.0000 (1.0)           0;0  2.5159 (1.0)           1           1
test_list-list-recursive[main]       406.8268 (1.02)     406.8268 (1.02)     406.8268 (1.02)     0.0000 (1.0)      406.8268 (1.02)     0.0000 (1.0)           0;0  2.4580 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     429.7246 (1.10)     429.7246 (1.10)     429.7246 (1.10)     0.0000 (1.0)      429.7246 (1.10)     0.0000 (1.0)           0;0  2.3271 (0.91)          1           1
test_list-list-shallow[3.10.0]     417.0201 (1.07)     417.0201 (1.07)     417.0201 (1.07)     0.0000 (1.0)      417.0201 (1.07)     0.0000 (1.0)           0;0  2.3980 (0.94)          1           1
test_list-list-shallow[3.53.2]     394.1434 (1.01)     394.1434 (1.01)     394.1434 (1.01)     0.0000 (1.0)      394.1434 (1.01)     0.0000 (1.0)           0;0  2.5371 (0.99)          1           1
test_list-list-shallow[main]       391.0271 (1.0)      391.0271 (1.0)      391.0271 (1.0)      0.0000 (1.0)      391.0271 (1.0)      0.0000 (1.0)           0;0  2.5574 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

-------------------------------------------------------------------------------- benchmark 'test_partial_add-add': 4 tests --------------------------------------------------------------------------------
Name (time in ms)                       Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]       731.7849 (1.0)        731.7849 (1.0)        731.7849 (1.0)      0.0000 (1.0)        731.7849 (1.0)      0.0000 (1.0)           0;0  1.3665 (1.0)           1           1
test_partial_add-add[3.10.0]       833.6370 (1.14)       833.6370 (1.14)       833.6370 (1.14)     0.0000 (1.0)        833.6370 (1.14)     0.0000 (1.0)           0;0  1.1996 (0.88)          1           1
test_partial_add-add[3.53.2]       732.9949 (1.00)       732.9949 (1.00)       732.9949 (1.00)     0.0000 (1.0)        732.9949 (1.00)     0.0000 (1.0)           0;0  1.3643 (1.00)          1           1
test_partial_add-add[main]       1,240.3351 (1.69)     1,240.3351 (1.69)     1,240.3351 (1.69)     0.0000 (1.0)      1,240.3351 (1.69)     0.0000 (1.0)           0;0  0.8062 (0.59)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     611.1326 (1.07)     611.1326 (1.07)     611.1326 (1.07)     0.0000 (1.0)      611.1326 (1.07)     0.0000 (1.0)           0;0  1.6363 (0.94)          1           1
test_partial_add-add-partial[3.10.0]     605.5137 (1.06)     605.5137 (1.06)     605.5137 (1.06)     0.0000 (1.0)      605.5137 (1.06)     0.0000 (1.0)           0;0  1.6515 (0.95)          1           1
test_partial_add-add-partial[3.53.2]     593.5246 (1.04)     593.5246 (1.04)     593.5246 (1.04)     0.0000 (1.0)      593.5246 (1.04)     0.0000 (1.0)           0;0  1.6849 (0.97)          1           1
test_partial_add-add-partial[main]       573.0976 (1.0)      573.0976 (1.0)      573.0976 (1.0)      0.0000 (1.0)      573.0976 (1.0)      0.0000 (1.0)           0;0  1.7449 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     409.0160 (1.04)     409.0160 (1.04)     409.0160 (1.04)     0.0000 (1.0)      409.0160 (1.04)     0.0000 (1.0)           0;0  2.4449 (0.96)          1           1
test_partial_add-gc-cloud-noop[3.10.0]     415.6608 (1.06)     415.6608 (1.06)     415.6608 (1.06)     0.0000 (1.0)      415.6608 (1.06)     0.0000 (1.0)           0;0  2.4058 (0.94)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     391.6051 (1.0)      391.6051 (1.0)      391.6051 (1.0)      0.0000 (1.0)      391.6051 (1.0)      0.0000 (1.0)           0;0  2.5536 (1.0)           1           1
test_partial_add-gc-cloud-noop[main]       403.0551 (1.03)     403.0551 (1.03)     403.0551 (1.03)     0.0000 (1.0)      403.0551 (1.03)     0.0000 (1.0)           0;0  2.4811 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     380.7646 (1.0)      380.7646 (1.0)      380.7646 (1.0)      0.0000 (1.0)      380.7646 (1.0)      0.0000 (1.0)           0;0  2.6263 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     398.8817 (1.05)     398.8817 (1.05)     398.8817 (1.05)     0.0000 (1.0)      398.8817 (1.05)     0.0000 (1.0)           0;0  2.5070 (0.95)          1           1
test_partial_add-gc-noop[3.53.2]     381.9175 (1.00)     381.9175 (1.00)     381.9175 (1.00)     0.0000 (1.0)      381.9175 (1.00)     0.0000 (1.0)           0;0  2.6184 (1.00)          1           1
test_partial_add-gc-noop[main]       386.0299 (1.01)     386.0299 (1.01)     386.0299 (1.01)     0.0000 (1.0)      386.0299 (1.01)     0.0000 (1.0)           0;0  2.5905 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-push': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     500.7899 (1.12)     500.7899 (1.12)     500.7899 (1.12)     0.0000 (1.0)      500.7899 (1.12)     0.0000 (1.0)           0;0  1.9968 (0.89)          1           1
test_partial_add-push[3.10.0]     446.8571 (1.0)      446.8571 (1.0)      446.8571 (1.0)      0.0000 (1.0)      446.8571 (1.0)      0.0000 (1.0)           0;0  2.2379 (1.0)           1           1
test_partial_add-push[3.53.2]     477.0703 (1.07)     477.0703 (1.07)     477.0703 (1.07)     0.0000 (1.0)      477.0703 (1.07)     0.0000 (1.0)           0;0  2.0961 (0.94)          1           1
test_partial_add-push[main]       456.5125 (1.02)     456.5125 (1.02)     456.5125 (1.02)     0.0000 (1.0)      456.5125 (1.02)     0.0000 (1.0)           0;0  2.1905 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     421.4350 (1.01)     421.4350 (1.01)     421.4350 (1.01)     0.0000 (1.0)      421.4350 (1.01)     0.0000 (1.0)           0;0  2.3728 (0.99)          1           1
test_partial_add-push-partial[3.10.0]     418.9667 (1.0)      418.9667 (1.0)      418.9667 (1.0)      0.0000 (1.0)      418.9667 (1.0)      0.0000 (1.0)           0;0  2.3868 (1.0)           1           1
test_partial_add-push-partial[3.53.2]     458.1593 (1.09)     458.1593 (1.09)     458.1593 (1.09)     0.0000 (1.0)      458.1593 (1.09)     0.0000 (1.0)           0;0  2.1826 (0.91)          1           1
test_partial_add-push-partial[main]       458.1089 (1.09)     458.1089 (1.09)     458.1089 (1.09)     0.0000 (1.0)      458.1089 (1.09)     0.0000 (1.0)           0;0  2.1829 (0.91)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

-------------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 4 tests --------------------------------------------------------------------------------
Name (time in ms)                          Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]       760.3361 (1.01)       760.3361 (1.01)       760.3361 (1.01)     0.0000 (1.0)        760.3361 (1.01)     0.0000 (1.0)           0;0  1.3152 (0.99)          1           1
test_partial_remove-add[3.10.0]       849.3896 (1.13)       849.3896 (1.13)       849.3896 (1.13)     0.0000 (1.0)        849.3896 (1.13)     0.0000 (1.0)           0;0  1.1773 (0.89)          1           1
test_partial_remove-add[3.53.2]       751.7727 (1.0)        751.7727 (1.0)        751.7727 (1.0)      0.0000 (1.0)        751.7727 (1.0)      0.0000 (1.0)           0;0  1.3302 (1.0)           1           1
test_partial_remove-add[main]       1,224.7957 (1.63)     1,224.7957 (1.63)     1,224.7957 (1.63)     0.0000 (1.0)      1,224.7957 (1.63)     0.0000 (1.0)           0;0  0.8165 (0.61)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-add-update': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     588.4250 (1.10)     588.4250 (1.10)     588.4250 (1.10)     0.0000 (1.0)      588.4250 (1.10)     0.0000 (1.0)           0;0  1.6995 (0.91)          1           1
test_partial_remove-add-update[3.10.0]     576.6488 (1.08)     576.6488 (1.08)     576.6488 (1.08)     0.0000 (1.0)      576.6488 (1.08)     0.0000 (1.0)           0;0  1.7342 (0.93)          1           1
test_partial_remove-add-update[3.53.2]     550.6418 (1.03)     550.6418 (1.03)     550.6418 (1.03)     0.0000 (1.0)      550.6418 (1.03)     0.0000 (1.0)           0;0  1.8161 (0.97)          1           1
test_partial_remove-add-update[main]       535.4972 (1.0)      535.4972 (1.0)      535.4972 (1.0)      0.0000 (1.0)      535.4972 (1.0)      0.0000 (1.0)           0;0  1.8674 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     398.9911 (1.04)     398.9911 (1.04)     398.9911 (1.04)     0.0000 (1.0)      398.9911 (1.04)     0.0000 (1.0)           0;0  2.5063 (0.96)          1           1
test_partial_remove-gc[3.10.0]     406.2816 (1.06)     406.2816 (1.06)     406.2816 (1.06)     0.0000 (1.0)      406.2816 (1.06)     0.0000 (1.0)           0;0  2.4613 (0.95)          1           1
test_partial_remove-gc[3.53.2]     390.3384 (1.01)     390.3384 (1.01)     390.3384 (1.01)     0.0000 (1.0)      390.3384 (1.01)     0.0000 (1.0)           0;0  2.5619 (0.99)          1           1
test_partial_remove-gc[main]       384.7325 (1.0)      384.7325 (1.0)      384.7325 (1.0)      0.0000 (1.0)      384.7325 (1.0)      0.0000 (1.0)           0;0  2.5992 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     420.6867 (1.06)     420.6867 (1.06)     420.6867 (1.06)     0.0000 (1.0)      420.6867 (1.06)     0.0000 (1.0)           0;0  2.3771 (0.94)          1           1
test_partial_remove-gc-cloud[3.10.0]     406.0541 (1.02)     406.0541 (1.02)     406.0541 (1.02)     0.0000 (1.0)      406.0541 (1.02)     0.0000 (1.0)           0;0  2.4627 (0.98)          1           1
test_partial_remove-gc-cloud[3.53.2]     401.4658 (1.01)     401.4658 (1.01)     401.4658 (1.01)     0.0000 (1.0)      401.4658 (1.01)     0.0000 (1.0)           0;0  2.4909 (0.99)          1           1
test_partial_remove-gc-cloud[main]       396.4074 (1.0)      396.4074 (1.0)      396.4074 (1.0)      0.0000 (1.0)      396.4074 (1.0)      0.0000 (1.0)           0;0  2.5227 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     487.3112 (1.08)     487.3112 (1.08)     487.3112 (1.08)     0.0000 (1.0)      487.3112 (1.08)     0.0000 (1.0)           0;0  2.0521 (0.93)          1           1
test_partial_remove-push[3.10.0]     451.7566 (1.0)      451.7566 (1.0)      451.7566 (1.0)      0.0000 (1.0)      451.7566 (1.0)      0.0000 (1.0)           0;0  2.2136 (1.0)           1           1
test_partial_remove-push[3.53.2]     467.7208 (1.04)     467.7208 (1.04)     467.7208 (1.04)     0.0000 (1.0)      467.7208 (1.04)     0.0000 (1.0)           0;0  2.1380 (0.97)          1           1
test_partial_remove-push[main]       473.0149 (1.05)     473.0149 (1.05)     473.0149 (1.05)     0.0000 (1.0)      473.0149 (1.05)     0.0000 (1.0)           0;0  2.1141 (0.96)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-push-update': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                                Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     422.8346 (1.01)     422.8346 (1.01)     422.8346 (1.01)     0.0000 (1.0)      422.8346 (1.01)     0.0000 (1.0)           0;0  2.3650 (0.99)          1           1
test_partial_remove-push-update[3.10.0]     417.8451 (1.0)      417.8451 (1.0)      417.8451 (1.0)      0.0000 (1.0)      417.8451 (1.0)      0.0000 (1.0)           0;0  2.3932 (1.0)           1           1
test_partial_remove-push-update[3.53.2]     424.1291 (1.02)     424.1291 (1.02)     424.1291 (1.02)     0.0000 (1.0)      424.1291 (1.02)     0.0000 (1.0)           0;0  2.3578 (0.99)          1           1
test_partial_remove-push-update[main]       427.0261 (1.02)     427.0261 (1.02)     427.0261 (1.02)     0.0000 (1.0)      427.0261 (1.02)     0.0000 (1.0)           0;0  2.3418 (0.98)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

------------------------------------------------------------------------------ benchmark 'test_plots-plots-diff': 4 tests ------------------------------------------------------------------------------
Name (time in ms)                      Min                   Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     517.2544 (1.0)        561.0679 (1.0)      535.7549 (1.0)      21.4858 (1.0)      521.6973 (1.0)      37.7795 (1.0)           2;0  1.8665 (1.0)           5           3
test_plots-plots-diff[3.10.0]     929.3265 (1.80)     1,011.3248 (1.80)     955.9675 (1.78)     34.4894 (1.61)     940.2387 (1.80)     47.5864 (1.26)          1;0  1.0461 (0.56)          5           3
test_plots-plots-diff[3.53.2]     877.3243 (1.70)       950.0370 (1.69)     903.8618 (1.69)     30.8136 (1.43)     893.5415 (1.71)     48.3952 (1.28)          1;0  1.1064 (0.59)          5           3
test_plots-plots-diff[main]       861.8366 (1.67)       925.0271 (1.65)     893.3293 (1.67)     27.4541 (1.28)     895.8660 (1.72)     49.4754 (1.31)          2;0  1.1194 (0.60)          5           3
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 4 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       536.4477 (1.0)        549.4059 (1.0)        541.5885 (1.0)       5.7060 (1.35)       540.1012 (1.0)       9.9288 (1.48)          1;0  1.8464 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,163.7770 (2.17)     1,174.2945 (2.14)     1,168.6060 (2.16)      4.2181 (1.0)      1,167.7698 (2.16)      6.7086 (1.0)           2;0  0.8557 (0.46)          5           3
test_plots-plots-diff-json[3.53.2]       936.5491 (1.75)       979.1644 (1.78)       957.6376 (1.77)     18.8964 (4.48)       958.6714 (1.77)     34.7942 (5.19)          2;0  1.0442 (0.57)          5           3
test_plots-plots-diff-json[main]         959.7753 (1.79)     1,011.5899 (1.84)       979.6977 (1.81)     23.1090 (5.48)       966.7408 (1.79)     37.9125 (5.65)          1;0  1.0207 (0.55)          5           3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 4 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     433.8332 (1.0)      442.3508 (1.0)      437.8372 (1.0)       4.1044 (1.0)      437.1910 (1.0)       7.9922 (1.0)           1;0  2.2840 (1.0)           5           3
test_plots-plots-show[3.10.0]     832.9945 (1.92)     877.1273 (1.98)     851.3432 (1.94)     19.9071 (4.85)     840.0670 (1.92)     33.5120 (4.19)          1;0  1.1746 (0.51)          5           3
test_plots-plots-show[3.53.2]     762.5199 (1.76)     794.3456 (1.80)     783.4357 (1.79)     14.6492 (3.57)     793.2986 (1.81)     23.1282 (2.89)          1;0  1.2764 (0.56)          5           3
test_plots-plots-show[main]       781.4496 (1.80)     842.4659 (1.90)     810.2343 (1.85)     27.7111 (6.75)     806.9689 (1.85)     51.8969 (6.49)          2;0  1.2342 (0.54)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 4 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     464.1434 (1.0)      502.8469 (1.0)      487.5270 (1.0)      15.2150 (1.0)      489.5830 (1.0)      21.4019 (1.0)           2;0  2.0512 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     900.9407 (1.94)     951.9601 (1.89)     919.5643 (1.89)     20.7551 (1.36)     909.3543 (1.86)     28.3498 (1.32)          1;0  1.0875 (0.53)          5           3
test_plots-plots-show-json[3.53.2]     874.8816 (1.88)     963.7088 (1.92)     919.5777 (1.89)     36.5171 (2.40)     918.3934 (1.88)     61.6907 (2.88)          2;0  1.0875 (0.53)          5           3
test_plots-plots-show-json[main]       809.1215 (1.74)     867.4242 (1.73)     829.4648 (1.70)     24.4044 (1.60)     822.8191 (1.68)     36.3951 (1.70)          1;0  1.2056 (0.59)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

---------------------------------------------------------------------------- benchmark 'test_push-push': 4 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     592.5789 (1.03)     592.5789 (1.03)     592.5789 (1.03)     0.0000 (1.0)      592.5789 (1.03)     0.0000 (1.0)           0;0  1.6875 (0.97)          1           1
test_push-push[3.10.0]     675.9167 (1.17)     675.9167 (1.17)     675.9167 (1.17)     0.0000 (1.0)      675.9167 (1.17)     0.0000 (1.0)           0;0  1.4795 (0.85)          1           1
test_push-push[3.53.2]     629.9802 (1.09)     629.9802 (1.09)     629.9802 (1.09)     0.0000 (1.0)      629.9802 (1.09)     0.0000 (1.0)           0;0  1.5874 (0.92)          1           1
test_push-push[main]       577.4071 (1.0)      577.4071 (1.0)      577.4071 (1.0)      0.0000 (1.0)      577.4071 (1.0)      0.0000 (1.0)           0;0  1.7319 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     446.4643 (1.00)     446.4643 (1.00)     446.4643 (1.00)     0.0000 (1.0)      446.4643 (1.00)     0.0000 (1.0)           0;0  2.2398 (1.00)          1           1
test_sharing-fetch[3.10.0]     485.6755 (1.09)     485.6755 (1.09)     485.6755 (1.09)     0.0000 (1.0)      485.6755 (1.09)     0.0000 (1.0)           0;0  2.0590 (0.92)          1           1
test_sharing-fetch[3.53.2]     447.8557 (1.01)     447.8557 (1.01)     447.8557 (1.01)     0.0000 (1.0)      447.8557 (1.01)     0.0000 (1.0)           0;0  2.2329 (0.99)          1           1
test_sharing-fetch[main]       444.5809 (1.0)      444.5809 (1.0)      444.5809 (1.0)      0.0000 (1.0)      444.5809 (1.0)      0.0000 (1.0)           0;0  2.2493 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     414.9469 (1.0)      414.9469 (1.0)      414.9469 (1.0)      0.0000 (1.0)      414.9469 (1.0)      0.0000 (1.0)           0;0  2.4099 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     415.5844 (1.00)     415.5844 (1.00)     415.5844 (1.00)     0.0000 (1.0)      415.5844 (1.00)     0.0000 (1.0)           0;0  2.4062 (1.00)          1           1
test_sharing-fetch-noop[3.53.2]     444.4623 (1.07)     444.4623 (1.07)     444.4623 (1.07)     0.0000 (1.0)      444.4623 (1.07)     0.0000 (1.0)           0;0  2.2499 (0.93)          1           1
test_sharing-fetch-noop[main]       435.4705 (1.05)     435.4705 (1.05)     435.4705 (1.05)     0.0000 (1.0)      435.4705 (1.05)     0.0000 (1.0)           0;0  2.2964 (0.95)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-push': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                  Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     678.9303 (1.13)     678.9303 (1.13)     678.9303 (1.13)     0.0000 (1.0)      678.9303 (1.13)     0.0000 (1.0)           0;0  1.4729 (0.88)          1           1
test_sharing-push[3.10.0]     699.1358 (1.17)     699.1358 (1.17)     699.1358 (1.17)     0.0000 (1.0)      699.1358 (1.17)     0.0000 (1.0)           0;0  1.4303 (0.86)          1           1
test_sharing-push[3.53.2]     636.2982 (1.06)     636.2982 (1.06)     636.2982 (1.06)     0.0000 (1.0)      636.2982 (1.06)     0.0000 (1.0)           0;0  1.5716 (0.94)          1           1
test_sharing-push[main]       599.7331 (1.0)      599.7331 (1.0)      599.7331 (1.0)      0.0000 (1.0)      599.7331 (1.0)      0.0000 (1.0)           0;0  1.6674 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     413.4583 (1.0)      413.4583 (1.0)      413.4583 (1.0)      0.0000 (1.0)      413.4583 (1.0)      0.0000 (1.0)           0;0  2.4186 (1.0)           1           1
test_sharing-push-noop[3.10.0]     415.4560 (1.00)     415.4560 (1.00)     415.4560 (1.00)     0.0000 (1.0)      415.4560 (1.00)     0.0000 (1.0)           0;0  2.4070 (1.00)          1           1
test_sharing-push-noop[3.53.2]     436.1238 (1.05)     436.1238 (1.05)     436.1238 (1.05)     0.0000 (1.0)      436.1238 (1.05)     0.0000 (1.0)           0;0  2.2929 (0.95)          1           1
test_sharing-push-noop[main]       432.0330 (1.04)     432.0330 (1.04)     432.0330 (1.04)     0.0000 (1.0)      432.0330 (1.04)     0.0000 (1.0)           0;0  2.3146 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

---------------------------------------------------------------------------- benchmark 'test_status-status': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     546.6369 (1.01)     546.6369 (1.01)     546.6369 (1.01)     0.0000 (1.0)      546.6369 (1.01)     0.0000 (1.0)           0;0  1.8294 (0.99)          1           1
test_status-status[3.10.0]     665.0144 (1.23)     665.0144 (1.23)     665.0144 (1.23)     0.0000 (1.0)      665.0144 (1.23)     0.0000 (1.0)           0;0  1.5037 (0.81)          1           1
test_status-status[3.53.2]     564.5343 (1.04)     564.5343 (1.04)     564.5343 (1.04)     0.0000 (1.0)      564.5343 (1.04)     0.0000 (1.0)           0;0  1.7714 (0.96)          1           1
test_status-status[main]       541.0526 (1.0)      541.0526 (1.0)      541.0526 (1.0)      0.0000 (1.0)      541.0526 (1.0)      0.0000 (1.0)           0;0  1.8482 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-changed': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     381.0680 (1.02)     381.0680 (1.02)     381.0680 (1.02)     0.0000 (1.0)      381.0680 (1.02)     0.0000 (1.0)           0;0  2.6242 (0.98)          1           1
test_status-status-changed[3.10.0]     395.0930 (1.05)     395.0930 (1.05)     395.0930 (1.05)     0.0000 (1.0)      395.0930 (1.05)     0.0000 (1.0)           0;0  2.5310 (0.95)          1           1
test_status-status-changed[3.53.2]     374.8133 (1.0)      374.8133 (1.0)      374.8133 (1.0)      0.0000 (1.0)      374.8133 (1.0)      0.0000 (1.0)           0;0  2.6680 (1.0)           1           1
test_status-status-changed[main]       376.3409 (1.00)     376.3409 (1.00)     376.3409 (1.00)     0.0000 (1.0)      376.3409 (1.00)     0.0000 (1.0)           0;0  2.6572 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                                Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     389.7418 (1.04)     389.7418 (1.04)     389.7418 (1.04)     0.0000 (1.0)      389.7418 (1.04)     0.0000 (1.0)           0;0  2.5658 (0.96)          1           1
test_status-status-changed-noop[3.10.0]     390.9111 (1.04)     390.9111 (1.04)     390.9111 (1.04)     0.0000 (1.0)      390.9111 (1.04)     0.0000 (1.0)           0;0  2.5581 (0.96)          1           1
test_status-status-changed-noop[3.53.2]     379.5230 (1.01)     379.5230 (1.01)     379.5230 (1.01)     0.0000 (1.0)      379.5230 (1.01)     0.0000 (1.0)           0;0  2.6349 (0.99)          1           1
test_status-status-changed-noop[main]       376.0765 (1.0)      376.0765 (1.0)      376.0765 (1.0)      0.0000 (1.0)      376.0765 (1.0)      0.0000 (1.0)           0;0  2.6590 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     388.9924 (1.02)     388.9924 (1.02)     388.9924 (1.02)     0.0000 (1.0)      388.9924 (1.02)     0.0000 (1.0)           0;0  2.5707 (0.98)          1           1
test_status-status-noop[3.10.0]     398.0262 (1.04)     398.0262 (1.04)     398.0262 (1.04)     0.0000 (1.0)      398.0262 (1.04)     0.0000 (1.0)           0;0  2.5124 (0.96)          1           1
test_status-status-noop[3.53.2]     383.8852 (1.01)     383.8852 (1.01)     383.8852 (1.01)     0.0000 (1.0)      383.8852 (1.01)     0.0000 (1.0)           0;0  2.6049 (0.99)          1           1
test_status-status-noop[main]       380.9641 (1.0)      380.9641 (1.0)      380.9641 (1.0)      0.0000 (1.0)      380.9641 (1.0)      0.0000 (1.0)           0;0  2.6249 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

-------------------------------------------------------------------------------- benchmark 'test_update-import-url': 4 tests --------------------------------------------------------------------------------
Name (time in ms)                         Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]       807.9721 (1.04)       807.9721 (1.04)       807.9721 (1.04)     0.0000 (1.0)        807.9721 (1.04)     0.0000 (1.0)           0;0  1.2377 (0.97)          1           1
test_update-import-url[3.10.0]       892.8223 (1.14)       892.8223 (1.14)       892.8223 (1.14)     0.0000 (1.0)        892.8223 (1.14)     0.0000 (1.0)           0;0  1.1200 (0.87)          1           1
test_update-import-url[3.53.2]       780.6380 (1.0)        780.6380 (1.0)        780.6380 (1.0)      0.0000 (1.0)        780.6380 (1.0)      0.0000 (1.0)           0;0  1.2810 (1.0)           1           1
test_update-import-url[main]       1,159.6955 (1.49)     1,159.6955 (1.49)     1,159.6955 (1.49)     0.0000 (1.0)      1,159.6955 (1.49)     0.0000 (1.0)           0;0  0.8623 (0.67)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     547.1655 (1.17)     547.1655 (1.17)     547.1655 (1.17)     0.0000 (1.0)      547.1655 (1.17)     0.0000 (1.0)           0;0  1.8276 (0.85)          1           1
test_update-update[3.10.0]     539.0680 (1.16)     539.0680 (1.16)     539.0680 (1.16)     0.0000 (1.0)      539.0680 (1.16)     0.0000 (1.0)           0;0  1.8551 (0.87)          1           1
test_update-update[3.53.2]     492.7717 (1.06)     492.7717 (1.06)     492.7717 (1.06)     0.0000 (1.0)      492.7717 (1.06)     0.0000 (1.0)           0;0  2.0293 (0.95)          1           1
test_update-update[main]       466.4085 (1.0)      466.4085 (1.0)      466.4085 (1.0)      0.0000 (1.0)      466.4085 (1.0)      0.0000 (1.0)           0;0  2.1440 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     430.5612 (1.07)     430.5612 (1.07)     430.5612 (1.07)     0.0000 (1.0)      430.5612 (1.07)     0.0000 (1.0)           0;0  2.3226 (0.93)          1           1
test_update-update-noop[3.10.0]     429.3365 (1.07)     429.3365 (1.07)     429.3365 (1.07)     0.0000 (1.0)      429.3365 (1.07)     0.0000 (1.0)           0;0  2.3292 (0.93)          1           1
test_update-update-noop[3.53.2]     405.0144 (1.01)     405.0144 (1.01)     405.0144 (1.01)     0.0000 (1.0)      405.0144 (1.01)     0.0000 (1.0)           0;0  2.4690 (0.99)          1           1
test_update-update-noop[main]       400.7163 (1.0)      400.7163 (1.0)      400.7163 (1.0)      0.0000 (1.0)      400.7163 (1.0)      0.0000 (1.0)           0;0  2.4955 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean