Fri Jun 27 09:20:33 UTC 2025
dataset: mnist
project: example-get-started

DVC Plot

----------------------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 4 tests -----------------------------------------------------------------------------------------
Name (time in s)                                                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[45fd1025e242a738541a8aca93bbae6e0cb55237]     2.2820 (1.01)     2.2820 (1.01)     2.2820 (1.01)     0.0000 (1.0)      2.2820 (1.01)     0.0000 (1.0)           0;0  0.4382 (0.99)          1           1
test_data_status-data-changed[batch-check-remote-cache]                     2.2854 (1.01)     2.2854 (1.01)     2.2854 (1.01)     0.0000 (1.0)      2.2854 (1.01)     0.0000 (1.0)           0;0  0.4376 (0.99)          1           1
test_data_status-data-changed[c7c7ba69fbe093b0889228119964f357653e6973]     2.2598 (1.0)      2.2598 (1.0)      2.2598 (1.0)      0.0000 (1.0)      2.2598 (1.0)      0.0000 (1.0)           0;0  0.4425 (1.0)           1           1
test_data_status-data-changed[main]                                         2.3073 (1.02)     2.3073 (1.02)     2.3073 (1.02)     0.0000 (1.0)      2.3073 (1.02)     0.0000 (1.0)           0;0  0.4334 (0.98)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 4 tests -----------------------------------------------------------------------------------------
Name (time in s)                                                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[45fd1025e242a738541a8aca93bbae6e0cb55237]     2.2882 (1.02)     2.2882 (1.02)     2.2882 (1.02)     0.0000 (1.0)      2.2882 (1.02)     0.0000 (1.0)           0;0  0.4370 (0.98)          1           1
test_data_status-data-changed-noop[batch-check-remote-cache]                     2.2790 (1.01)     2.2790 (1.01)     2.2790 (1.01)     0.0000 (1.0)      2.2790 (1.01)     0.0000 (1.0)           0;0  0.4388 (0.99)          1           1
test_data_status-data-changed-noop[c7c7ba69fbe093b0889228119964f357653e6973]     2.2713 (1.01)     2.2713 (1.01)     2.2713 (1.01)     0.0000 (1.0)      2.2713 (1.01)     0.0000 (1.0)           0;0  0.4403 (0.99)          1           1
test_data_status-data-changed-noop[main]                                         2.2534 (1.0)      2.2534 (1.0)      2.2534 (1.0)      0.0000 (1.0)      2.2534 (1.0)      0.0000 (1.0)           0;0  0.4438 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 4 tests -----------------------------------------------------------------------------------------
Name (time in s)                                                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[45fd1025e242a738541a8aca93bbae6e0cb55237]     4.8995 (1.02)     4.8995 (1.02)     4.8995 (1.02)     0.0000 (1.0)      4.8995 (1.02)     0.0000 (1.0)           0;0  0.2041 (0.98)          1           1
test_data_status-data-new[batch-check-remote-cache]                     4.8618 (1.01)     4.8618 (1.01)     4.8618 (1.01)     0.0000 (1.0)      4.8618 (1.01)     0.0000 (1.0)           0;0  0.2057 (0.99)          1           1
test_data_status-data-new[c7c7ba69fbe093b0889228119964f357653e6973]     4.8005 (1.0)      4.8005 (1.0)      4.8005 (1.0)      0.0000 (1.0)      4.8005 (1.0)      0.0000 (1.0)           0;0  0.2083 (1.0)           1           1
test_data_status-data-new[main]                                         4.9389 (1.03)     4.9389 (1.03)     4.9389 (1.03)     0.0000 (1.0)      4.9389 (1.03)     0.0000 (1.0)           0;0  0.2025 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 4 tests -----------------------------------------------------------------------------------------
Name (time in s)                                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[45fd1025e242a738541a8aca93bbae6e0cb55237]     2.2816 (1.01)     2.2816 (1.01)     2.2816 (1.01)     0.0000 (1.0)      2.2816 (1.01)     0.0000 (1.0)           0;0  0.4383 (0.99)          1           1
test_data_status-data-noop[batch-check-remote-cache]                     2.2533 (1.00)     2.2533 (1.00)     2.2533 (1.00)     0.0000 (1.0)      2.2533 (1.00)     0.0000 (1.0)           0;0  0.4438 (1.00)          1           1
test_data_status-data-noop[c7c7ba69fbe093b0889228119964f357653e6973]     2.2561 (1.00)     2.2561 (1.00)     2.2561 (1.00)     0.0000 (1.0)      2.2561 (1.00)     0.0000 (1.0)           0;0  0.4432 (1.00)          1           1
test_data_status-data-noop[main]                                         2.2483 (1.0)      2.2483 (1.0)      2.2483 (1.0)      0.0000 (1.0)      2.2483 (1.0)      0.0000 (1.0)           0;0  0.4448 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

DVC Plot

------------------------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 4 tests -------------------------------------------------------------------------------------------
Name (time in s)                                                                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[45fd1025e242a738541a8aca93bbae6e0cb55237]     14.1823 (1.0)      14.1823 (1.0)      14.1823 (1.0)      0.0000 (1.0)      14.1823 (1.0)      0.0000 (1.0)           0;0  0.0705 (1.0)           1           1
test_data_status_all_flags-data-changed[batch-check-remote-cache]                     14.3774 (1.01)     14.3774 (1.01)     14.3774 (1.01)     0.0000 (1.0)      14.3774 (1.01)     0.0000 (1.0)           0;0  0.0696 (0.99)          1           1
test_data_status_all_flags-data-changed[c7c7ba69fbe093b0889228119964f357653e6973]     14.6247 (1.03)     14.6247 (1.03)     14.6247 (1.03)     0.0000 (1.0)      14.6247 (1.03)     0.0000 (1.0)           0;0  0.0684 (0.97)          1           1
test_data_status_all_flags-data-changed[main]                                         14.6233 (1.03)     14.6233 (1.03)     14.6233 (1.03)     0.0000 (1.0)      14.6233 (1.03)     0.0000 (1.0)           0;0  0.0684 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed-noop': 4 tests -------------------------------------------------------------------------------------------
Name (time in s)                                                                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[45fd1025e242a738541a8aca93bbae6e0cb55237]     14.6781 (1.03)     14.6781 (1.03)     14.6781 (1.03)     0.0000 (1.0)      14.6781 (1.03)     0.0000 (1.0)           0;0  0.0681 (0.97)          1           1
test_data_status_all_flags-data-changed-noop[batch-check-remote-cache]                     14.6200 (1.03)     14.6200 (1.03)     14.6200 (1.03)     0.0000 (1.0)      14.6200 (1.03)     0.0000 (1.0)           0;0  0.0684 (0.97)          1           1
test_data_status_all_flags-data-changed-noop[c7c7ba69fbe093b0889228119964f357653e6973]     14.1956 (1.0)      14.1956 (1.0)      14.1956 (1.0)      0.0000 (1.0)      14.1956 (1.0)      0.0000 (1.0)           0;0  0.0704 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]                                         14.6291 (1.03)     14.6291 (1.03)     14.6291 (1.03)     0.0000 (1.0)      14.6291 (1.03)     0.0000 (1.0)           0;0  0.0684 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 4 tests -------------------------------------------------------------------------------------------
Name (time in s)                                                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[45fd1025e242a738541a8aca93bbae6e0cb55237]     17.0917 (1.03)     17.0917 (1.03)     17.0917 (1.03)     0.0000 (1.0)      17.0917 (1.03)     0.0000 (1.0)           0;0  0.0585 (0.97)          1           1
test_data_status_all_flags-data-new[batch-check-remote-cache]                     16.7729 (1.01)     16.7729 (1.01)     16.7729 (1.01)     0.0000 (1.0)      16.7729 (1.01)     0.0000 (1.0)           0;0  0.0596 (0.99)          1           1
test_data_status_all_flags-data-new[c7c7ba69fbe093b0889228119964f357653e6973]     16.6351 (1.0)      16.6351 (1.0)      16.6351 (1.0)      0.0000 (1.0)      16.6351 (1.0)      0.0000 (1.0)           0;0  0.0601 (1.0)           1           1
test_data_status_all_flags-data-new[main]                                         17.0013 (1.02)     17.0013 (1.02)     17.0013 (1.02)     0.0000 (1.0)      17.0013 (1.02)     0.0000 (1.0)           0;0  0.0588 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 4 tests -------------------------------------------------------------------------------------------
Name (time in s)                                                                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[45fd1025e242a738541a8aca93bbae6e0cb55237]     13.5578 (1.0)      13.5578 (1.0)      13.5578 (1.0)      0.0000 (1.0)      13.5578 (1.0)      0.0000 (1.0)           0;0  0.0738 (1.0)           1           1
test_data_status_all_flags-data-noop[batch-check-remote-cache]                     13.7196 (1.01)     13.7196 (1.01)     13.7196 (1.01)     0.0000 (1.0)      13.7196 (1.01)     0.0000 (1.0)           0;0  0.0729 (0.99)          1           1
test_data_status_all_flags-data-noop[c7c7ba69fbe093b0889228119964f357653e6973]     13.7711 (1.02)     13.7711 (1.02)     13.7711 (1.02)     0.0000 (1.0)      13.7711 (1.02)     0.0000 (1.0)           0;0  0.0726 (0.98)          1           1
test_data_status_all_flags-data-noop[main]                                         13.9666 (1.03)     13.9666 (1.03)     13.9666 (1.03)     0.0000 (1.0)      13.9666 (1.03)     0.0000 (1.0)           0;0  0.0716 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean