Fri Jun 27 14:12:26 UTC 2025
dataset: mnist
project: example-get-started

DVC Plot

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[3.60.1]     4.8775 (1.0)      4.8775 (1.0)      4.8775 (1.0)      0.0000 (1.0)      4.8775 (1.0)      0.0000 (1.0)           0;0  0.2050 (1.0)           1           1
test_data_status-data-changed[main]       4.9242 (1.01)     4.9242 (1.01)     4.9242 (1.01)     0.0000 (1.0)      4.9242 (1.01)     0.0000 (1.0)           0;0  0.2031 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[3.60.1]     4.8205 (1.0)      4.8205 (1.0)      4.8205 (1.0)      0.0000 (1.0)      4.8205 (1.0)      0.0000 (1.0)           0;0  0.2074 (1.0)           1           1
test_data_status-data-changed-noop[main]       4.8440 (1.00)     4.8440 (1.00)     4.8440 (1.00)     0.0000 (1.0)      4.8440 (1.00)     0.0000 (1.0)           0;0  0.2064 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-new': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[3.60.1]     8.6901 (1.0)      8.6901 (1.0)      8.6901 (1.0)      0.0000 (1.0)      8.6901 (1.0)      0.0000 (1.0)           0;0  0.1151 (1.0)           1           1
test_data_status-data-new[main]       8.7143 (1.00)     8.7143 (1.00)     8.7143 (1.00)     0.0000 (1.0)      8.7143 (1.00)     0.0000 (1.0)           0;0  0.1148 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[3.60.1]     4.7882 (1.0)      4.7882 (1.0)      4.7882 (1.0)      0.0000 (1.0)      4.7882 (1.0)      0.0000 (1.0)           0;0  0.2088 (1.0)           1           1
test_data_status-data-noop[main]       4.8024 (1.00)     4.8024 (1.00)     4.8024 (1.00)     0.0000 (1.0)      4.8024 (1.00)     0.0000 (1.0)           0;0  0.2082 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 2 tests --------------------------------------------------------------------------
Name (time in s)                                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[3.60.1]     31.4600 (1.0)      31.4600 (1.0)      31.4600 (1.0)      0.0000 (1.0)      31.4600 (1.0)      0.0000 (1.0)           0;0  0.0318 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       31.5246 (1.00)     31.5246 (1.00)     31.5246 (1.00)     0.0000 (1.0)      31.5246 (1.00)     0.0000 (1.0)           0;0  0.0317 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed-noop': 2 tests --------------------------------------------------------------------------
Name (time in s)                                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[3.60.1]     31.5721 (1.0)      31.5721 (1.0)      31.5721 (1.0)      0.0000 (1.0)      31.5721 (1.0)      0.0000 (1.0)           0;0  0.0317 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       31.5997 (1.00)     31.5997 (1.00)     31.5997 (1.00)     0.0000 (1.0)      31.5997 (1.00)     0.0000 (1.0)           0;0  0.0316 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 2 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[3.60.1]     35.0943 (1.0)      35.0943 (1.0)      35.0943 (1.0)      0.0000 (1.0)      35.0943 (1.0)      0.0000 (1.0)           0;0  0.0285 (1.0)           1           1
test_data_status_all_flags-data-new[main]       35.6418 (1.02)     35.6418 (1.02)     35.6418 (1.02)     0.0000 (1.0)      35.6418 (1.02)     0.0000 (1.0)           0;0  0.0281 (0.98)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 2 tests --------------------------------------------------------------------------
Name (time in s)                                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[3.60.1]     30.2446 (1.0)      30.2446 (1.0)      30.2446 (1.0)      0.0000 (1.0)      30.2446 (1.0)      0.0000 (1.0)           0;0  0.0331 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       30.6937 (1.01)     30.6937 (1.01)     30.6937 (1.01)     0.0000 (1.0)      30.6937 (1.01)     0.0000 (1.0)           0;0  0.0326 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean