Tue Aug 27 10:57:04 UTC 2024
dataset: mnist
project: example-get-started

DVC Plot

------------------------------------------ benchmark 'test_add_copy-add': 1 tests ------------------------------------------
Name (time in s)                        Min      Max     Mean  StdDev   Median     IQR  Outliers     OPS  Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[import-opt-2]     34.4128  34.4128  34.4128  0.0000  34.4128  0.0000       0;0  0.0291       1           1
----------------------------------------------------------------------------------------------------------------------------

---------------------------------------- benchmark 'test_add_copy-add-noop': 1 tests ----------------------------------------
Name (time in s)                            Min     Max    Mean  StdDev  Median     IQR  Outliers     OPS  Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[import-opt-2]     9.0659  9.0659  9.0659  0.0000  9.0659  0.0000       0;0  0.1103       1           1
-----------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

------------------------------------------ benchmark 'test_add_hardlink-add': 1 tests ------------------------------------------
Name (time in s)                            Min      Max     Mean  StdDev   Median     IQR  Outliers     OPS  Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[import-opt-2]     45.1324  45.1324  45.1324  0.0000  45.1324  0.0000       0;0  0.0222       1           1
--------------------------------------------------------------------------------------------------------------------------------

---------------------------------------- benchmark 'test_add_hardlink-add-noop': 1 tests ----------------------------------------
Name (time in s)                                Min     Max    Mean  StdDev  Median     IQR  Outliers     OPS  Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[import-opt-2]     9.0250  9.0250  9.0250  0.0000  9.0250  0.0000       0;0  0.1108       1           1
---------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

------------------------------------------ benchmark 'test_add_symlink-add': 1 tests ------------------------------------------
Name (time in s)                           Min      Max     Mean  StdDev   Median     IQR  Outliers     OPS  Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[import-opt-2]     51.4880  51.4880  51.4880  0.0000  51.4880  0.0000       0;0  0.0194       1           1
-------------------------------------------------------------------------------------------------------------------------------

------------------------------------------ benchmark 'test_add_symlink-add-noop': 1 tests ------------------------------------------
Name (time in s)                                Min      Max     Mean  StdDev   Median     IQR  Outliers     OPS  Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[import-opt-2]     10.9675  10.9675  10.9675  0.0000  10.9675  0.0000       0;0  0.0912       1           1
------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

------------------------------------------ benchmark 'test_checkout_copy-checkout': 1 tests ------------------------------------------
Name (time in s)                                  Min      Max     Mean  StdDev   Median     IQR  Outliers     OPS  Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[import-opt-2]     28.5587  28.5587  28.5587  0.0000  28.5587  0.0000       0;0  0.0350       1           1
--------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 1 tests ----------------------------------------
Name (time in s)                                      Min     Max    Mean  StdDev  Median     IQR  Outliers     OPS  Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[import-opt-2]     7.0832  7.0832  7.0832  0.0000  7.0832  0.0000       0;0  0.1412       1           1
---------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------- benchmark 'test_checkout_copy-checkout-update': 1 tests ----------------------------------------
Name (time in s)                                        Min     Max    Mean  StdDev  Median     IQR  Outliers     OPS  Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[import-opt-2]     8.1238  8.1238  8.1238  0.0000  8.1238  0.0000       0;0  0.1231       1           1
-----------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

------------------------------------------ benchmark 'test_checkout_hardlink-checkout': 1 tests ------------------------------------------
Name (time in s)                                      Min      Max     Mean  StdDev   Median     IQR  Outliers     OPS  Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[import-opt-2]     12.5628  12.5628  12.5628  0.0000  12.5628  0.0000       0;0  0.0796       1           1
------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 1 tests ----------------------------------------
Name (time in s)                                          Min     Max    Mean  StdDev  Median     IQR  Outliers     OPS  Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[import-opt-2]     6.8928  6.8928  6.8928  0.0000  6.8928  0.0000       0;0  0.1451       1           1
-------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------- benchmark 'test_checkout_hardlink-checkout-update': 1 tests ----------------------------------------
Name (time in s)                                            Min     Max    Mean  StdDev  Median     IQR  Outliers     OPS  Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[import-opt-2]     7.7498  7.7498  7.7498  0.0000  7.7498  0.0000       0;0  0.1290       1           1
---------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

------------------------------------------ benchmark 'test_checkout_symlink-checkout': 1 tests ------------------------------------------
Name (time in s)                                     Min      Max     Mean  StdDev   Median     IQR  Outliers     OPS  Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[import-opt-2]     16.2493  16.2493  16.2493  0.0000  16.2493  0.0000       0;0  0.0615       1           1
-----------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 1 tests ----------------------------------------
Name (time in s)                                         Min     Max    Mean  StdDev  Median     IQR  Outliers     OPS  Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[import-opt-2]     8.5433  8.5433  8.5433  0.0000  8.5433  0.0000       0;0  0.1171       1           1
------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------ benchmark 'test_checkout_symlink-checkout-update': 1 tests ------------------------------------------
Name (time in s)                                            Min      Max     Mean  StdDev   Median     IQR  Outliers     OPS  Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[import-opt-2]     10.4131  10.4131  10.4131  0.0000  10.4131  0.0000       0;0  0.0960       1           1
------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

---------------------------------------- benchmark 'test_data_status-data-changed': 1 tests ----------------------------------------
Name (time in s)                                   Min     Max    Mean  StdDev  Median     IQR  Outliers     OPS  Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[import-opt-2]     4.8871  4.8871  4.8871  0.0000  4.8871  0.0000       0;0  0.2046       1           1
------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------- benchmark 'test_data_status-data-changed-noop': 1 tests ----------------------------------------
Name (time in s)                                        Min     Max    Mean  StdDev  Median     IQR  Outliers     OPS  Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[import-opt-2]     5.0366  5.0366  5.0366  0.0000  5.0366  0.0000       0;0  0.1985       1           1
-----------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------- benchmark 'test_data_status-data-new': 1 tests ----------------------------------------
Name (time in s)                               Min     Max    Mean  StdDev  Median     IQR  Outliers     OPS  Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[import-opt-2]     9.1688  9.1688  9.1688  0.0000  9.1688  0.0000       0;0  0.1091       1           1
--------------------------------------------------------------------------------------------------------------------------------

---------------------------------------- benchmark 'test_data_status-data-noop': 1 tests ----------------------------------------
Name (time in s)                                Min     Max    Mean  StdDev  Median     IQR  Outliers     OPS  Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[import-opt-2]     4.9407  4.9407  4.9407  0.0000  4.9407  0.0000       0;0  0.2024       1           1
---------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 1 tests ------------------------------------------
Name (time in s)                                              Min      Max     Mean  StdDev   Median     IQR  Outliers     OPS  Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[import-opt-2]     40.6895  40.6895  40.6895  0.0000  40.6895  0.0000       0;0  0.0246       1           1
--------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 1 tests ------------------------------------------
Name (time in s)                                                   Min      Max     Mean  StdDev   Median     IQR  Outliers     OPS  Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[import-opt-2]     40.8431  40.8431  40.8431  0.0000  40.8431  0.0000       0;0  0.0245       1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------ benchmark 'test_data_status_all_flags-data-new': 1 tests ------------------------------------------
Name (time in s)                                          Min      Max     Mean  StdDev   Median     IQR  Outliers     OPS  Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[import-opt-2]     44.8088  44.8088  44.8088  0.0000  44.8088  0.0000       0;0  0.0223       1           1
----------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 1 tests ------------------------------------------
Name (time in s)                                           Min      Max     Mean  StdDev   Median     IQR  Outliers     OPS  Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[import-opt-2]     39.3920  39.3920  39.3920  0.0000  39.3920  0.0000       0;0  0.0254       1           1
-----------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

------------------------------------------ benchmark 'test_diff-diff': 1 tests ------------------------------------------
Name (time in s)                     Min      Max     Mean  StdDev   Median     IQR  Outliers     OPS  Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------
test_diff-diff[import-opt-2]     13.3325  13.3325  13.3325  0.0000  13.3325  0.0000       0;0  0.0750       1           1
-------------------------------------------------------------------------------------------------------------------------

---------------------------------------- benchmark 'test_diff-diff-changed': 1 tests ----------------------------------------
Name (time in s)                            Min     Max    Mean  StdDev  Median     IQR  Outliers     OPS  Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[import-opt-2]     7.0386  7.0386  7.0386  0.0000  7.0386  0.0000       0;0  0.1421       1           1
-----------------------------------------------------------------------------------------------------------------------------

---------------------------------------- benchmark 'test_diff-diff-changed-noop': 1 tests ----------------------------------------
Name (time in s)                                 Min     Max    Mean  StdDev  Median     IQR  Outliers     OPS  Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[import-opt-2]     7.0852  7.0852  7.0852  0.0000  7.0852  0.0000       0;0  0.1411       1           1
----------------------------------------------------------------------------------------------------------------------------------

---------------------------------------- benchmark 'test_diff-diff-noop': 1 tests ----------------------------------------
Name (time in s)                         Min     Max    Mean  StdDev  Median     IQR  Outliers     OPS  Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[import-opt-2]     7.0868  7.0868  7.0868  0.0000  7.0868  0.0000       0;0  0.1411       1           1
--------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

---------------------------------------- benchmark 'test_exp_show-exp': 1 tests ----------------------------------------
Name (time in s)                       Min     Max    Mean  StdDev  Median     IQR  Outliers     OPS  Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[import-opt-2]     7.2094  7.2094  7.2094  0.0000  7.2094  0.0000       0;0  0.1387       1           1
------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

------------------------------------------ benchmark 'test_fetch-fetch': 1 tests ------------------------------------------
Name (time in s)                       Min      Max     Mean  StdDev   Median     IQR  Outliers     OPS  Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[import-opt-2]     33.3798  33.3798  33.3798  0.0000  33.3798  0.0000       0;0  0.0300       1           1
---------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

---------------------------------------- benchmark 'test_gc-gc': 1 tests ----------------------------------------
Name (time in s)                Min     Max    Mean  StdDev  Median     IQR  Outliers     OPS  Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------
test_gc-gc[import-opt-2]     6.3190  6.3190  6.3190  0.0000  6.3190  0.0000       0;0  0.1583       1           1
-----------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

------------------------------------------ benchmark 'test_get-get': 1 tests ------------------------------------------
Name (time in s)                   Min      Max     Mean  StdDev   Median     IQR  Outliers     OPS  Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------
test_get-get[import-opt-2]     34.2473  34.2473  34.2473  0.0000  34.2473  0.0000       0;0  0.0292       1           1
-----------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

------------------------------------------ benchmark 'test_get_url-get-url': 1 tests ------------------------------------------
Name (time in s)                           Min      Max     Mean  StdDev   Median     IQR  Outliers     OPS  Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[import-opt-2]     21.5645  21.5645  21.5645  0.0000  21.5645  0.0000       0;0  0.0464       1           1
-------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

-------------------------------------------- benchmark 'test_help---help': 1 tests --------------------------------------------
Name (time in ms)                       Min       Max      Mean  StdDev    Median     IQR  Outliers     OPS  Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------
test_help---help[import-opt-2]     124.9577  150.7510  130.6914  4.8289  129.4206  5.5245      18;5  7.6516     100           1
-------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

------------------------------------------ benchmark 'test_import-import': 1 tests ------------------------------------------
Name (time in s)                         Min      Max     Mean  StdDev   Median     IQR  Outliers     OPS  Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------
test_import-import[import-opt-2]     73.6421  73.6421  73.6421  0.0000  73.6421  0.0000       0;0  0.0136       1           1
-----------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

------------------------------------------ benchmark 'test_import_url-import-url': 1 tests ------------------------------------------
Name (time in s)                                 Min      Max     Mean  StdDev   Median     IQR  Outliers     OPS  Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[import-opt-2]     68.0825  68.0825  68.0825  0.0000  68.0825  0.0000       0;0  0.0147       1           1
-------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

-------------------------------------------- benchmark 'test_init-init': 1 tests ---------------------------------------------
Name (time in ms)                     Min       Max      Mean   StdDev    Median     IQR  Outliers     OPS  Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------
test_init-init[import-opt-2]     537.4618  641.6907  548.7484  14.4201  546.1741  5.6493       4;5  1.8223     100           1
------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

-------------------------------------------- benchmark 'test_list-list': 1 tests --------------------------------------------
Name (time in ms)                     Min       Max      Mean  StdDev    Median     IQR  Outliers     OPS  Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------
test_list-list[import-opt-2]     720.4858  720.4858  720.4858  0.0000  720.4858  0.0000       0;0  1.3880       1           1
-----------------------------------------------------------------------------------------------------------------------------

-------------------------------------------- benchmark 'test_list-list-dvc-only': 1 tests --------------------------------------------
Name (time in ms)                              Min       Max      Mean  StdDev    Median     IQR  Outliers     OPS  Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[import-opt-2]     570.3872  570.3872  570.3872  0.0000  570.3872  0.0000       0;0  1.7532       1           1
--------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------- benchmark 'test_list-list-recursive': 1 tests ----------------------------------------
Name (time in s)                              Min     Max    Mean  StdDev  Median     IQR  Outliers     OPS  Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[import-opt-2]     5.5660  5.5660  5.5660  0.0000  5.5660  0.0000       0;0  0.1797       1           1
-------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------- benchmark 'test_list-list-shallow': 1 tests --------------------------------------------
Name (time in ms)                             Min       Max      Mean  StdDev    Median     IQR  Outliers     OPS  Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[import-opt-2]     564.0616  564.0616  564.0616  0.0000  564.0616  0.0000       0;0  1.7729       1           1
-------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

---------------------------------------- benchmark 'test_partial_add-add': 1 tests ----------------------------------------
Name (time in s)                          Min     Max    Mean  StdDev  Median     IQR  Outliers     OPS  Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[import-opt-2]     6.3283  6.3283  6.3283  0.0000  6.3283  0.0000       0;0  0.1580       1           1
---------------------------------------------------------------------------------------------------------------------------

------------------------------------------ benchmark 'test_partial_add-add-partial': 1 tests ------------------------------------------
Name (time in s)                                   Min      Max     Mean  StdDev   Median     IQR  Outliers     OPS  Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[import-opt-2]     30.0255  30.0255  30.0255  0.0000  30.0255  0.0000       0;0  0.0333       1           1
---------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 1 tests ------------------------------------------
Name (time in s)                                     Min      Max     Mean  StdDev   Median     IQR  Outliers     OPS  Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[import-opt-2]     24.1305  24.1305  24.1305  0.0000  24.1305  0.0000       0;0  0.0414       1           1
-----------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------ benchmark 'test_partial_add-gc-noop': 1 tests ------------------------------------------
Name (time in s)                               Min      Max     Mean  StdDev   Median     IQR  Outliers     OPS  Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[import-opt-2]     15.2548  15.2548  15.2548  0.0000  15.2548  0.0000       0;0  0.0656       1           1
-----------------------------------------------------------------------------------------------------------------------------------

---------------------------------------- benchmark 'test_partial_add-push': 1 tests ----------------------------------------
Name (time in s)                           Min     Max    Mean  StdDev  Median     IQR  Outliers     OPS  Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[import-opt-2]     5.3474  5.3474  5.3474  0.0000  5.3474  0.0000       0;0  0.1870       1           1
----------------------------------------------------------------------------------------------------------------------------

------------------------------------------ benchmark 'test_partial_add-push-partial': 1 tests ------------------------------------------
Name (time in s)                                    Min      Max     Mean  StdDev   Median     IQR  Outliers     OPS  Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[import-opt-2]     28.8732  28.8732  28.8732  0.0000  28.8732  0.0000       0;0  0.0346       1           1
----------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

------------------------------------------ benchmark 'test_partial_remove-add': 1 tests ------------------------------------------
Name (time in s)                              Min      Max     Mean  StdDev   Median     IQR  Outliers     OPS  Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[import-opt-2]     34.0398  34.0398  34.0398  0.0000  34.0398  0.0000       0;0  0.0294       1           1
----------------------------------------------------------------------------------------------------------------------------------

---------------------------------------- benchmark 'test_partial_remove-add-update': 1 tests ----------------------------------------
Name (time in s)                                    Min     Max    Mean  StdDev  Median     IQR  Outliers     OPS  Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[import-opt-2]     7.8873  7.8873  7.8873  0.0000  7.8873  0.0000       0;0  0.1268       1           1
-------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------ benchmark 'test_partial_remove-gc': 1 tests ------------------------------------------
Name (time in s)                             Min      Max     Mean  StdDev   Median     IQR  Outliers     OPS  Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[import-opt-2]     13.9475  13.9475  13.9475  0.0000  13.9475  0.0000       0;0  0.0717       1           1
---------------------------------------------------------------------------------------------------------------------------------

------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 1 tests ------------------------------------------
Name (time in s)                                   Min      Max     Mean  StdDev   Median     IQR  Outliers     OPS  Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[import-opt-2]     21.5963  21.5963  21.5963  0.0000  21.5963  0.0000       0;0  0.0463       1           1
---------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------ benchmark 'test_partial_remove-push': 1 tests ------------------------------------------
Name (time in s)                               Min      Max     Mean  StdDev   Median     IQR  Outliers     OPS  Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[import-opt-2]     30.8334  30.8334  30.8334  0.0000  30.8334  0.0000       0;0  0.0324       1           1
-----------------------------------------------------------------------------------------------------------------------------------

------------------------------------------ benchmark 'test_partial_remove-push-update': 1 tests ------------------------------------------
Name (time in s)                                      Min      Max     Mean  StdDev   Median     IQR  Outliers     OPS  Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[import-opt-2]     12.2157  12.2157  12.2157  0.0000  12.2157  0.0000       0;0  0.0819       1           1
------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

---------------------------------------- benchmark 'test_plots-plots-diff': 1 tests ----------------------------------------
Name (time in s)                           Min     Max    Mean  StdDev  Median     IQR  Outliers     OPS  Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[import-opt-2]     1.1284  1.1325  1.1307  0.0020  1.1315  0.0038       1;0  0.8844       5           3
----------------------------------------------------------------------------------------------------------------------------

---------------------------------------- benchmark 'test_plots-plots-diff-json': 1 tests ----------------------------------------
Name (time in s)                                Min     Max    Mean  StdDev  Median     IQR  Outliers     OPS  Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[import-opt-2]     1.2084  1.2177  1.2124  0.0037  1.2120  0.0059       2;0  0.8248       5           3
---------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------- benchmark 'test_plots-plots-show': 1 tests --------------------------------------------
Name (time in ms)                            Min       Max      Mean  StdDev    Median     IQR  Outliers     OPS  Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[import-opt-2]     951.6783  958.8260  955.8118  2.9310  956.9412  4.5764       2;0  1.0462       5           3
------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------- benchmark 'test_plots-plots-show-json': 1 tests ----------------------------------------
Name (time in s)                                Min     Max    Mean  StdDev  Median     IQR  Outliers     OPS  Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[import-opt-2]     1.0043  1.0199  1.0101  0.0059  1.0092  0.0062       1;0  0.9900       5           3
---------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

------------------------------------------ benchmark 'test_push-push': 1 tests ------------------------------------------
Name (time in s)                     Min      Max     Mean  StdDev   Median     IQR  Outliers     OPS  Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------
test_push-push[import-opt-2]     31.4907  31.4907  31.4907  0.0000  31.4907  0.0000       0;0  0.0318       1           1
-------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

------------------------------------------ benchmark 'test_sharing-fetch': 1 tests ------------------------------------------
Name (time in s)                         Min      Max     Mean  StdDev   Median     IQR  Outliers     OPS  Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[import-opt-2]     32.3356  32.3356  32.3356  0.0000  32.3356  0.0000       0;0  0.0309       1           1
-----------------------------------------------------------------------------------------------------------------------------

------------------------------------------ benchmark 'test_sharing-fetch-noop': 1 tests ------------------------------------------
Name (time in s)                              Min      Max     Mean  StdDev   Median     IQR  Outliers     OPS  Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[import-opt-2]     10.3917  10.3917  10.3917  0.0000  10.3917  0.0000       0;0  0.0962       1           1
----------------------------------------------------------------------------------------------------------------------------------

------------------------------------------ benchmark 'test_sharing-push': 1 tests ------------------------------------------
Name (time in s)                        Min      Max     Mean  StdDev   Median     IQR  Outliers     OPS  Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------
test_sharing-push[import-opt-2]     31.3314  31.3314  31.3314  0.0000  31.3314  0.0000       0;0  0.0319       1           1
----------------------------------------------------------------------------------------------------------------------------

------------------------------------------ benchmark 'test_sharing-push-noop': 1 tests ------------------------------------------
Name (time in s)                             Min      Max     Mean  StdDev   Median     IQR  Outliers     OPS  Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[import-opt-2]     10.3233  10.3233  10.3233  0.0000  10.3233  0.0000       0;0  0.0969       1           1
---------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

---------------------------------------- benchmark 'test_status-status': 1 tests ----------------------------------------
Name (time in s)                        Min     Max    Mean  StdDev  Median     IQR  Outliers     OPS  Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------
test_status-status[import-opt-2]     8.8218  8.8218  8.8218  0.0000  8.8218  0.0000       0;0  0.1134       1           1
-------------------------------------------------------------------------------------------------------------------------

---------------------------------------- benchmark 'test_status-status-changed': 1 tests ----------------------------------------
Name (time in s)                                Min     Max    Mean  StdDev  Median     IQR  Outliers     OPS  Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[import-opt-2]     4.6753  4.6753  4.6753  0.0000  4.6753  0.0000       0;0  0.2139       1           1
---------------------------------------------------------------------------------------------------------------------------------

---------------------------------------- benchmark 'test_status-status-changed-noop': 1 tests ----------------------------------------
Name (time in s)                                     Min     Max    Mean  StdDev  Median     IQR  Outliers     OPS  Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[import-opt-2]     4.7683  4.7683  4.7683  0.0000  4.7683  0.0000       0;0  0.2097       1           1
--------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------- benchmark 'test_status-status-noop': 1 tests ----------------------------------------
Name (time in s)                             Min     Max    Mean  StdDev  Median     IQR  Outliers     OPS  Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[import-opt-2]     4.7328  4.7328  4.7328  0.0000  4.7328  0.0000       0;0  0.2113       1           1
------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

------------------------------------------ benchmark 'test_update-import-url': 1 tests ------------------------------------------
Name (time in s)                             Min      Max     Mean  StdDev   Median     IQR  Outliers     OPS  Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[import-opt-2]     67.9157  67.9157  67.9157  0.0000  67.9157  0.0000       0;0  0.0147       1           1
---------------------------------------------------------------------------------------------------------------------------------

------------------------------------------ benchmark 'test_update-update': 1 tests ------------------------------------------
Name (time in s)                         Min      Max     Mean  StdDev   Median     IQR  Outliers     OPS  Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------
test_update-update[import-opt-2]     56.1336  56.1336  56.1336  0.0000  56.1336  0.0000       0;0  0.0178       1           1
-----------------------------------------------------------------------------------------------------------------------------

------------------------------------------ benchmark 'test_update-update-noop': 1 tests ------------------------------------------
Name (time in s)                              Min      Max     Mean  StdDev   Median     IQR  Outliers     OPS  Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[import-opt-2]     14.8886  14.8886  14.8886  0.0000  14.8886  0.0000       0;0  0.0672       1           1
----------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean