Fri Jun 27 07:16:10 UTC 2025
dataset: mnist
project: example-get-started
DVC Plot 

----------------------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 4 tests -----------------------------------------------------------------------------------------
Name (time in s)                                                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[45fd1025e242a738541a8aca93bbae6e0cb55237]     2.2630 (1.02)     2.2630 (1.02)     2.2630 (1.02)     0.0000 (1.0)      2.2630 (1.02)     0.0000 (1.0)           0;0  0.4419 (0.98)          1           1
test_data_status-data-changed[batch-check-remote-cache]                     2.2456 (1.01)     2.2456 (1.01)     2.2456 (1.01)     0.0000 (1.0)      2.2456 (1.01)     0.0000 (1.0)           0;0  0.4453 (0.99)          1           1
test_data_status-data-changed[c7c7ba69fbe093b0889228119964f357653e6973]     2.2286 (1.0)      2.2286 (1.0)      2.2286 (1.0)      0.0000 (1.0)      2.2286 (1.0)      0.0000 (1.0)           0;0  0.4487 (1.0)           1           1
test_data_status-data-changed[main]                                         2.2921 (1.03)     2.2921 (1.03)     2.2921 (1.03)     0.0000 (1.0)      2.2921 (1.03)     0.0000 (1.0)           0;0  0.4363 (0.97)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 4 tests -----------------------------------------------------------------------------------------
Name (time in s)                                                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[45fd1025e242a738541a8aca93bbae6e0cb55237]     2.2639 (1.02)     2.2639 (1.02)     2.2639 (1.02)     0.0000 (1.0)      2.2639 (1.02)     0.0000 (1.0)           0;0  0.4417 (0.98)          1           1
test_data_status-data-changed-noop[batch-check-remote-cache]                     2.2277 (1.00)     2.2277 (1.00)     2.2277 (1.00)     0.0000 (1.0)      2.2277 (1.00)     0.0000 (1.0)           0;0  0.4489 (1.00)          1           1
test_data_status-data-changed-noop[c7c7ba69fbe093b0889228119964f357653e6973]     2.2207 (1.0)      2.2207 (1.0)      2.2207 (1.0)      0.0000 (1.0)      2.2207 (1.0)      0.0000 (1.0)           0;0  0.4503 (1.0)           1           1
test_data_status-data-changed-noop[main]                                         2.2288 (1.00)     2.2288 (1.00)     2.2288 (1.00)     0.0000 (1.0)      2.2288 (1.00)     0.0000 (1.0)           0;0  0.4487 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 4 tests -----------------------------------------------------------------------------------------
Name (time in s)                                                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[45fd1025e242a738541a8aca93bbae6e0cb55237]     4.8563 (1.01)     4.8563 (1.01)     4.8563 (1.01)     0.0000 (1.0)      4.8563 (1.01)     0.0000 (1.0)           0;0  0.2059 (0.99)          1           1
test_data_status-data-new[batch-check-remote-cache]                     4.8551 (1.00)     4.8551 (1.00)     4.8551 (1.00)     0.0000 (1.0)      4.8551 (1.00)     0.0000 (1.0)           0;0  0.2060 (1.00)          1           1
test_data_status-data-new[c7c7ba69fbe093b0889228119964f357653e6973]     4.8316 (1.0)      4.8316 (1.0)      4.8316 (1.0)      0.0000 (1.0)      4.8316 (1.0)      0.0000 (1.0)           0;0  0.2070 (1.0)           1           1
test_data_status-data-new[main]                                         4.9954 (1.03)     4.9954 (1.03)     4.9954 (1.03)     0.0000 (1.0)      4.9954 (1.03)     0.0000 (1.0)           0;0  0.2002 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 4 tests -----------------------------------------------------------------------------------------
Name (time in s)                                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[45fd1025e242a738541a8aca93bbae6e0cb55237]     2.2526 (1.01)     2.2526 (1.01)     2.2526 (1.01)     0.0000 (1.0)      2.2526 (1.01)     0.0000 (1.0)           0;0  0.4439 (0.99)          1           1
test_data_status-data-noop[batch-check-remote-cache]                     2.2236 (1.0)      2.2236 (1.0)      2.2236 (1.0)      0.0000 (1.0)      2.2236 (1.0)      0.0000 (1.0)           0;0  0.4497 (1.0)           1           1
test_data_status-data-noop[c7c7ba69fbe093b0889228119964f357653e6973]     2.2247 (1.00)     2.2247 (1.00)     2.2247 (1.00)     0.0000 (1.0)      2.2247 (1.00)     0.0000 (1.0)           0;0  0.4495 (1.00)          1           1
test_data_status-data-noop[main]                                         2.2555 (1.01)     2.2555 (1.01)     2.2555 (1.01)     0.0000 (1.0)      2.2555 (1.01)     0.0000 (1.0)           0;0  0.4434 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean