Fri Jun 27 11:06:14 UTC 2025
dataset: mnist
project: example-get-started

----------------------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 4 tests -----------------------------------------------------------------------------------------
Name (time in s)                                                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[45fd1025e242a738541a8aca93bbae6e0cb55237]     2.4032 (1.03)     2.4032 (1.03)     2.4032 (1.03)     0.0000 (1.0)      2.4032 (1.03)     0.0000 (1.0)           0;0  0.4161 (0.97)          1           1
test_data_status-data-changed[batch-check-remote-cache]                     2.3380 (1.0)      2.3380 (1.0)      2.3380 (1.0)      0.0000 (1.0)      2.3380 (1.0)      0.0000 (1.0)           0;0  0.4277 (1.0)           1           1
test_data_status-data-changed[c7c7ba69fbe093b0889228119964f357653e6973]     2.3866 (1.02)     2.3866 (1.02)     2.3866 (1.02)     0.0000 (1.0)      2.3866 (1.02)     0.0000 (1.0)           0;0  0.4190 (0.98)          1           1
test_data_status-data-changed[main]                                         2.3506 (1.01)     2.3506 (1.01)     2.3506 (1.01)     0.0000 (1.0)      2.3506 (1.01)     0.0000 (1.0)           0;0  0.4254 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 4 tests -----------------------------------------------------------------------------------------
Name (time in s)                                                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[45fd1025e242a738541a8aca93bbae6e0cb55237]     2.3851 (1.03)     2.3851 (1.03)     2.3851 (1.03)     0.0000 (1.0)      2.3851 (1.03)     0.0000 (1.0)           0;0  0.4193 (0.97)          1           1
test_data_status-data-changed-noop[batch-check-remote-cache]                     2.3628 (1.02)     2.3628 (1.02)     2.3628 (1.02)     0.0000 (1.0)      2.3628 (1.02)     0.0000 (1.0)           0;0  0.4232 (0.98)          1           1
test_data_status-data-changed-noop[c7c7ba69fbe093b0889228119964f357653e6973]     2.3648 (1.02)     2.3648 (1.02)     2.3648 (1.02)     0.0000 (1.0)      2.3648 (1.02)     0.0000 (1.0)           0;0  0.4229 (0.98)          1           1
test_data_status-data-changed-noop[main]                                         2.3164 (1.0)      2.3164 (1.0)      2.3164 (1.0)      0.0000 (1.0)      2.3164 (1.0)      0.0000 (1.0)           0;0  0.4317 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 4 tests -----------------------------------------------------------------------------------------
Name (time in s)                                                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[45fd1025e242a738541a8aca93bbae6e0cb55237]     5.0051 (1.0)      5.0051 (1.0)      5.0051 (1.0)      0.0000 (1.0)      5.0051 (1.0)      0.0000 (1.0)           0;0  0.1998 (1.0)           1           1
test_data_status-data-new[batch-check-remote-cache]                     5.0405 (1.01)     5.0405 (1.01)     5.0405 (1.01)     0.0000 (1.0)      5.0405 (1.01)     0.0000 (1.0)           0;0  0.1984 (0.99)          1           1
test_data_status-data-new[c7c7ba69fbe093b0889228119964f357653e6973]     5.0390 (1.01)     5.0390 (1.01)     5.0390 (1.01)     0.0000 (1.0)      5.0390 (1.01)     0.0000 (1.0)           0;0  0.1985 (0.99)          1           1
test_data_status-data-new[main]                                         5.1743 (1.03)     5.1743 (1.03)     5.1743 (1.03)     0.0000 (1.0)      5.1743 (1.03)     0.0000 (1.0)           0;0  0.1933 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 4 tests -----------------------------------------------------------------------------------------
Name (time in s)                                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[45fd1025e242a738541a8aca93bbae6e0cb55237]     2.3776 (1.02)     2.3776 (1.02)     2.3776 (1.02)     0.0000 (1.0)      2.3776 (1.02)     0.0000 (1.0)           0;0  0.4206 (0.98)          1           1
test_data_status-data-noop[batch-check-remote-cache]                     2.3576 (1.01)     2.3576 (1.01)     2.3576 (1.01)     0.0000 (1.0)      2.3576 (1.01)     0.0000 (1.0)           0;0  0.4242 (0.99)          1           1
test_data_status-data-noop[c7c7ba69fbe093b0889228119964f357653e6973]     2.3530 (1.01)     2.3530 (1.01)     2.3530 (1.01)     0.0000 (1.0)      2.3530 (1.01)     0.0000 (1.0)           0;0  0.4250 (0.99)          1           1
test_data_status-data-noop[main]                                         2.3270 (1.0)      2.3270 (1.0)      2.3270 (1.0)      0.0000 (1.0)      2.3270 (1.0)      0.0000 (1.0)           0;0  0.4297 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 4 tests -------------------------------------------------------------------------------------------
Name (time in s)                                                                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[45fd1025e242a738541a8aca93bbae6e0cb55237]     14.4362 (1.01)     14.4362 (1.01)     14.4362 (1.01)     0.0000 (1.0)      14.4362 (1.01)     0.0000 (1.0)           0;0  0.0693 (0.99)          1           1
test_data_status_all_flags-data-changed[batch-check-remote-cache]                     14.2665 (1.0)      14.2665 (1.0)      14.2665 (1.0)      0.0000 (1.0)      14.2665 (1.0)      0.0000 (1.0)           0;0  0.0701 (1.0)           1           1
test_data_status_all_flags-data-changed[c7c7ba69fbe093b0889228119964f357653e6973]     14.3610 (1.01)     14.3610 (1.01)     14.3610 (1.01)     0.0000 (1.0)      14.3610 (1.01)     0.0000 (1.0)           0;0  0.0696 (0.99)          1           1
test_data_status_all_flags-data-changed[main]                                         14.3984 (1.01)     14.3984 (1.01)     14.3984 (1.01)     0.0000 (1.0)      14.3984 (1.01)     0.0000 (1.0)           0;0  0.0695 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed-noop': 4 tests -------------------------------------------------------------------------------------------
Name (time in s)                                                                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[45fd1025e242a738541a8aca93bbae6e0cb55237]     14.3794 (1.01)     14.3794 (1.01)     14.3794 (1.01)     0.0000 (1.0)      14.3794 (1.01)     0.0000 (1.0)           0;0  0.0695 (0.99)          1           1
test_data_status_all_flags-data-changed-noop[batch-check-remote-cache]                     14.2270 (1.0)      14.2270 (1.0)      14.2270 (1.0)      0.0000 (1.0)      14.2270 (1.0)      0.0000 (1.0)           0;0  0.0703 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[c7c7ba69fbe093b0889228119964f357653e6973]     14.2312 (1.00)     14.2312 (1.00)     14.2312 (1.00)     0.0000 (1.0)      14.2312 (1.00)     0.0000 (1.0)           0;0  0.0703 (1.00)          1           1
test_data_status_all_flags-data-changed-noop[main]                                         14.2567 (1.00)     14.2567 (1.00)     14.2567 (1.00)     0.0000 (1.0)      14.2567 (1.00)     0.0000 (1.0)           0;0  0.0701 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 4 tests -------------------------------------------------------------------------------------------
Name (time in s)                                                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[45fd1025e242a738541a8aca93bbae6e0cb55237]     16.6988 (1.01)     16.6988 (1.01)     16.6988 (1.01)     0.0000 (1.0)      16.6988 (1.01)     0.0000 (1.0)           0;0  0.0599 (0.99)          1           1
test_data_status_all_flags-data-new[batch-check-remote-cache]                     16.6496 (1.00)     16.6496 (1.00)     16.6496 (1.00)     0.0000 (1.0)      16.6496 (1.00)     0.0000 (1.0)           0;0  0.0601 (1.00)          1           1
test_data_status_all_flags-data-new[c7c7ba69fbe093b0889228119964f357653e6973]     16.6075 (1.0)      16.6075 (1.0)      16.6075 (1.0)      0.0000 (1.0)      16.6075 (1.0)      0.0000 (1.0)           0;0  0.0602 (1.0)           1           1
test_data_status_all_flags-data-new[main]                                         16.9929 (1.02)     16.9929 (1.02)     16.9929 (1.02)     0.0000 (1.0)      16.9929 (1.02)     0.0000 (1.0)           0;0  0.0588 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 4 tests -------------------------------------------------------------------------------------------
Name (time in s)                                                                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[45fd1025e242a738541a8aca93bbae6e0cb55237]     13.9802 (1.01)     13.9802 (1.01)     13.9802 (1.01)     0.0000 (1.0)      13.9802 (1.01)     0.0000 (1.0)           0;0  0.0715 (0.99)          1           1
test_data_status_all_flags-data-noop[batch-check-remote-cache]                     13.8511 (1.0)      13.8511 (1.0)      13.8511 (1.0)      0.0000 (1.0)      13.8511 (1.0)      0.0000 (1.0)           0;0  0.0722 (1.0)           1           1
test_data_status_all_flags-data-noop[c7c7ba69fbe093b0889228119964f357653e6973]     14.3229 (1.03)     14.3229 (1.03)     14.3229 (1.03)     0.0000 (1.0)      14.3229 (1.03)     0.0000 (1.0)           0;0  0.0698 (0.97)          1           1
test_data_status_all_flags-data-noop[main]                                         13.8662 (1.00)     13.8662 (1.00)     13.8662 (1.00)     0.0000 (1.0)      13.8662 (1.00)     0.0000 (1.0)           0;0  0.0721 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean