Fri Jun 27 16:44:42 UTC 2025
dataset: mnist
project: example-get-started

DVC Plot

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[3.60.1]     4.8756 (1.0)      4.8756 (1.0)      4.8756 (1.0)      0.0000 (1.0)      4.8756 (1.0)      0.0000 (1.0)           0;0  0.2051 (1.0)           1           1
test_data_status-data-changed[main]       4.8763 (1.00)     4.8763 (1.00)     4.8763 (1.00)     0.0000 (1.0)      4.8763 (1.00)     0.0000 (1.0)           0;0  0.2051 (1.00)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[3.60.1]     4.7734 (1.0)      4.7734 (1.0)      4.7734 (1.0)      0.0000 (1.0)      4.7734 (1.0)      0.0000 (1.0)           0;0  0.2095 (1.0)           1           1
test_data_status-data-changed-noop[main]       4.8273 (1.01)     4.8273 (1.01)     4.8273 (1.01)     0.0000 (1.0)      4.8273 (1.01)     0.0000 (1.0)           0;0  0.2072 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-new': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[3.60.1]     8.6920 (1.0)      8.6920 (1.0)      8.6920 (1.0)      0.0000 (1.0)      8.6920 (1.0)      0.0000 (1.0)           0;0  0.1150 (1.0)           1           1
test_data_status-data-new[main]       8.6945 (1.00)     8.6945 (1.00)     8.6945 (1.00)     0.0000 (1.0)      8.6945 (1.00)     0.0000 (1.0)           0;0  0.1150 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[3.60.1]     4.8096 (1.01)     4.8096 (1.01)     4.8096 (1.01)     0.0000 (1.0)      4.8096 (1.01)     0.0000 (1.0)           0;0  0.2079 (0.99)          1           1
test_data_status-data-noop[main]       4.7569 (1.0)      4.7569 (1.0)      4.7569 (1.0)      0.0000 (1.0)      4.7569 (1.0)      0.0000 (1.0)           0;0  0.2102 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 2 tests --------------------------------------------------------------------------
Name (time in s)                                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[3.60.1]     11.6125 (1.0)      11.6125 (1.0)      11.6125 (1.0)      0.0000 (1.0)      11.6125 (1.0)      0.0000 (1.0)           0;0  0.0861 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       11.6463 (1.00)     11.6463 (1.00)     11.6463 (1.00)     0.0000 (1.0)      11.6463 (1.00)     0.0000 (1.0)           0;0  0.0859 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed-noop': 2 tests --------------------------------------------------------------------------
Name (time in s)                                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[3.60.1]     11.3230 (1.0)      11.3230 (1.0)      11.3230 (1.0)      0.0000 (1.0)      11.3230 (1.0)      0.0000 (1.0)           0;0  0.0883 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       11.4387 (1.01)     11.4387 (1.01)     11.4387 (1.01)     0.0000 (1.0)      11.4387 (1.01)     0.0000 (1.0)           0;0  0.0874 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 2 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[3.60.1]     15.0334 (1.0)      15.0334 (1.0)      15.0334 (1.0)      0.0000 (1.0)      15.0334 (1.0)      0.0000 (1.0)           0;0  0.0665 (1.0)           1           1
test_data_status_all_flags-data-new[main]       15.3456 (1.02)     15.3456 (1.02)     15.3456 (1.02)     0.0000 (1.0)      15.3456 (1.02)     0.0000 (1.0)           0;0  0.0652 (0.98)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 2 tests --------------------------------------------------------------------------
Name (time in s)                                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[3.60.1]     10.2041 (1.0)      10.2041 (1.0)      10.2041 (1.0)      0.0000 (1.0)      10.2041 (1.0)      0.0000 (1.0)           0;0  0.0980 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       10.2614 (1.01)     10.2614 (1.01)     10.2614 (1.01)     0.0000 (1.0)      10.2614 (1.01)     0.0000 (1.0)           0;0  0.0975 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean