Fri Jun 27 11:47:16 UTC 2025
dataset: mnist
project: example-get-started

----------------------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 4 tests -----------------------------------------------------------------------------------------
Name (time in s)                                                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[45fd1025e242a738541a8aca93bbae6e0cb55237]     2.3481 (1.0)      2.3481 (1.0)      2.3481 (1.0)      0.0000 (1.0)      2.3481 (1.0)      0.0000 (1.0)           0;0  0.4259 (1.0)           1           1
test_data_status-data-changed[batch-check-remote-cache]                     2.3650 (1.01)     2.3650 (1.01)     2.3650 (1.01)     0.0000 (1.0)      2.3650 (1.01)     0.0000 (1.0)           0;0  0.4228 (0.99)          1           1
test_data_status-data-changed[c7c7ba69fbe093b0889228119964f357653e6973]     2.3655 (1.01)     2.3655 (1.01)     2.3655 (1.01)     0.0000 (1.0)      2.3655 (1.01)     0.0000 (1.0)           0;0  0.4227 (0.99)          1           1
test_data_status-data-changed[main]                                         2.4206 (1.03)     2.4206 (1.03)     2.4206 (1.03)     0.0000 (1.0)      2.4206 (1.03)     0.0000 (1.0)           0;0  0.4131 (0.97)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 4 tests -----------------------------------------------------------------------------------------
Name (time in s)                                                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[45fd1025e242a738541a8aca93bbae6e0cb55237]     2.3835 (1.04)     2.3835 (1.04)     2.3835 (1.04)     0.0000 (1.0)      2.3835 (1.04)     0.0000 (1.0)           0;0  0.4195 (0.96)          1           1
test_data_status-data-changed-noop[batch-check-remote-cache]                     2.2987 (1.0)      2.2987 (1.0)      2.2987 (1.0)      0.0000 (1.0)      2.2987 (1.0)      0.0000 (1.0)           0;0  0.4350 (1.0)           1           1
test_data_status-data-changed-noop[c7c7ba69fbe093b0889228119964f357653e6973]     2.3479 (1.02)     2.3479 (1.02)     2.3479 (1.02)     0.0000 (1.0)      2.3479 (1.02)     0.0000 (1.0)           0;0  0.4259 (0.98)          1           1
test_data_status-data-changed-noop[main]                                         2.3267 (1.01)     2.3267 (1.01)     2.3267 (1.01)     0.0000 (1.0)      2.3267 (1.01)     0.0000 (1.0)           0;0  0.4298 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 4 tests -----------------------------------------------------------------------------------------
Name (time in s)                                                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[45fd1025e242a738541a8aca93bbae6e0cb55237]     4.9256 (1.0)      4.9256 (1.0)      4.9256 (1.0)      0.0000 (1.0)      4.9256 (1.0)      0.0000 (1.0)           0;0  0.2030 (1.0)           1           1
test_data_status-data-new[batch-check-remote-cache]                     4.9552 (1.01)     4.9552 (1.01)     4.9552 (1.01)     0.0000 (1.0)      4.9552 (1.01)     0.0000 (1.0)           0;0  0.2018 (0.99)          1           1
test_data_status-data-new[c7c7ba69fbe093b0889228119964f357653e6973]     4.9533 (1.01)     4.9533 (1.01)     4.9533 (1.01)     0.0000 (1.0)      4.9533 (1.01)     0.0000 (1.0)           0;0  0.2019 (0.99)          1           1
test_data_status-data-new[main]                                         5.0041 (1.02)     5.0041 (1.02)     5.0041 (1.02)     0.0000 (1.0)      5.0041 (1.02)     0.0000 (1.0)           0;0  0.1998 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 4 tests -----------------------------------------------------------------------------------------
Name (time in s)                                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[45fd1025e242a738541a8aca93bbae6e0cb55237]     2.3615 (1.02)     2.3615 (1.02)     2.3615 (1.02)     0.0000 (1.0)      2.3615 (1.02)     0.0000 (1.0)           0;0  0.4235 (0.98)          1           1
test_data_status-data-noop[batch-check-remote-cache]                     2.3253 (1.0)      2.3253 (1.0)      2.3253 (1.0)      0.0000 (1.0)      2.3253 (1.0)      0.0000 (1.0)           0;0  0.4301 (1.0)           1           1
test_data_status-data-noop[c7c7ba69fbe093b0889228119964f357653e6973]     2.3671 (1.02)     2.3671 (1.02)     2.3671 (1.02)     0.0000 (1.0)      2.3671 (1.02)     0.0000 (1.0)           0;0  0.4225 (0.98)          1           1
test_data_status-data-noop[main]                                         2.3467 (1.01)     2.3467 (1.01)     2.3467 (1.01)     0.0000 (1.0)      2.3467 (1.01)     0.0000 (1.0)           0;0  0.4261 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 4 tests -------------------------------------------------------------------------------------------
Name (time in s)                                                                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[45fd1025e242a738541a8aca93bbae6e0cb55237]     14.2083 (1.01)     14.2083 (1.01)     14.2083 (1.01)     0.0000 (1.0)      14.2083 (1.01)     0.0000 (1.0)           0;0  0.0704 (0.99)          1           1
test_data_status_all_flags-data-changed[batch-check-remote-cache]                     14.0848 (1.0)      14.0848 (1.0)      14.0848 (1.0)      0.0000 (1.0)      14.0848 (1.0)      0.0000 (1.0)           0;0  0.0710 (1.0)           1           1
test_data_status_all_flags-data-changed[c7c7ba69fbe093b0889228119964f357653e6973]     14.2145 (1.01)     14.2145 (1.01)     14.2145 (1.01)     0.0000 (1.0)      14.2145 (1.01)     0.0000 (1.0)           0;0  0.0704 (0.99)          1           1
test_data_status_all_flags-data-changed[main]                                         14.3797 (1.02)     14.3797 (1.02)     14.3797 (1.02)     0.0000 (1.0)      14.3797 (1.02)     0.0000 (1.0)           0;0  0.0695 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed-noop': 4 tests -------------------------------------------------------------------------------------------
Name (time in s)                                                                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[45fd1025e242a738541a8aca93bbae6e0cb55237]     14.1163 (1.00)     14.1163 (1.00)     14.1163 (1.00)     0.0000 (1.0)      14.1163 (1.00)     0.0000 (1.0)           0;0  0.0708 (1.00)          1           1
test_data_status_all_flags-data-changed-noop[batch-check-remote-cache]                     14.0984 (1.00)     14.0984 (1.00)     14.0984 (1.00)     0.0000 (1.0)      14.0984 (1.00)     0.0000 (1.0)           0;0  0.0709 (1.00)          1           1
test_data_status_all_flags-data-changed-noop[c7c7ba69fbe093b0889228119964f357653e6973]     14.0490 (1.0)      14.0490 (1.0)      14.0490 (1.0)      0.0000 (1.0)      14.0490 (1.0)      0.0000 (1.0)           0;0  0.0712 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]                                         14.1826 (1.01)     14.1826 (1.01)     14.1826 (1.01)     0.0000 (1.0)      14.1826 (1.01)     0.0000 (1.0)           0;0  0.0705 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 4 tests -------------------------------------------------------------------------------------------
Name (time in s)                                                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[45fd1025e242a738541a8aca93bbae6e0cb55237]     16.7873 (1.02)     16.7873 (1.02)     16.7873 (1.02)     0.0000 (1.0)      16.7873 (1.02)     0.0000 (1.0)           0;0  0.0596 (0.98)          1           1
test_data_status_all_flags-data-new[batch-check-remote-cache]                     16.5041 (1.0)      16.5041 (1.0)      16.5041 (1.0)      0.0000 (1.0)      16.5041 (1.0)      0.0000 (1.0)           0;0  0.0606 (1.0)           1           1
test_data_status_all_flags-data-new[c7c7ba69fbe093b0889228119964f357653e6973]     16.9688 (1.03)     16.9688 (1.03)     16.9688 (1.03)     0.0000 (1.0)      16.9688 (1.03)     0.0000 (1.0)           0;0  0.0589 (0.97)          1           1
test_data_status_all_flags-data-new[main]                                         16.6486 (1.01)     16.6486 (1.01)     16.6486 (1.01)     0.0000 (1.0)      16.6486 (1.01)     0.0000 (1.0)           0;0  0.0601 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 4 tests -------------------------------------------------------------------------------------------
Name (time in s)                                                                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[45fd1025e242a738541a8aca93bbae6e0cb55237]     13.5949 (1.01)     13.5949 (1.01)     13.5949 (1.01)     0.0000 (1.0)      13.5949 (1.01)     0.0000 (1.0)           0;0  0.0736 (0.99)          1           1
test_data_status_all_flags-data-noop[batch-check-remote-cache]                     13.6740 (1.02)     13.6740 (1.02)     13.6740 (1.02)     0.0000 (1.0)      13.6740 (1.02)     0.0000 (1.0)           0;0  0.0731 (0.98)          1           1
test_data_status_all_flags-data-noop[c7c7ba69fbe093b0889228119964f357653e6973]     13.4054 (1.0)      13.4054 (1.0)      13.4054 (1.0)      0.0000 (1.0)      13.4054 (1.0)      0.0000 (1.0)           0;0  0.0746 (1.0)           1           1
test_data_status_all_flags-data-noop[main]                                         13.7428 (1.03)     13.7428 (1.03)     13.7428 (1.03)     0.0000 (1.0)      13.7428 (1.03)     0.0000 (1.0)           0;0  0.0728 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean