Fri Jun 27 08:06:22 UTC 2025
dataset: mnist
project: example-get-started

----------------------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 4 tests -----------------------------------------------------------------------------------------
Name (time in s)                                                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[aac32e1b64f9beaf46fd3dfc01c30a471529a878]     2.3677 (1.01)     2.3677 (1.01)     2.3677 (1.01)     0.0000 (1.0)      2.3677 (1.01)     0.0000 (1.0)           0;0  0.4224 (0.99)          1           1
test_data_status-data-changed[batch-check-remote-cache]                     2.3442 (1.0)      2.3442 (1.0)      2.3442 (1.0)      0.0000 (1.0)      2.3442 (1.0)      0.0000 (1.0)           0;0  0.4266 (1.0)           1           1
test_data_status-data-changed[c7c7ba69fbe093b0889228119964f357653e6973]     2.3802 (1.02)     2.3802 (1.02)     2.3802 (1.02)     0.0000 (1.0)      2.3802 (1.02)     0.0000 (1.0)           0;0  0.4201 (0.98)          1           1
test_data_status-data-changed[main]                                         2.3511 (1.00)     2.3511 (1.00)     2.3511 (1.00)     0.0000 (1.0)      2.3511 (1.00)     0.0000 (1.0)           0;0  0.4253 (1.00)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 4 tests -----------------------------------------------------------------------------------------
Name (time in s)                                                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[aac32e1b64f9beaf46fd3dfc01c30a471529a878]     2.3502 (1.02)     2.3502 (1.02)     2.3502 (1.02)     0.0000 (1.0)      2.3502 (1.02)     0.0000 (1.0)           0;0  0.4255 (0.99)          1           1
test_data_status-data-changed-noop[batch-check-remote-cache]                     2.3150 (1.0)      2.3150 (1.0)      2.3150 (1.0)      0.0000 (1.0)      2.3150 (1.0)      0.0000 (1.0)           0;0  0.4320 (1.0)           1           1
test_data_status-data-changed-noop[c7c7ba69fbe093b0889228119964f357653e6973]     2.4216 (1.05)     2.4216 (1.05)     2.4216 (1.05)     0.0000 (1.0)      2.4216 (1.05)     0.0000 (1.0)           0;0  0.4129 (0.96)          1           1
test_data_status-data-changed-noop[main]                                         2.3543 (1.02)     2.3543 (1.02)     2.3543 (1.02)     0.0000 (1.0)      2.3543 (1.02)     0.0000 (1.0)           0;0  0.4248 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 4 tests -----------------------------------------------------------------------------------------
Name (time in s)                                                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[aac32e1b64f9beaf46fd3dfc01c30a471529a878]     4.9093 (1.0)      4.9093 (1.0)      4.9093 (1.0)      0.0000 (1.0)      4.9093 (1.0)      0.0000 (1.0)           0;0  0.2037 (1.0)           1           1
test_data_status-data-new[batch-check-remote-cache]                     4.9193 (1.00)     4.9193 (1.00)     4.9193 (1.00)     0.0000 (1.0)      4.9193 (1.00)     0.0000 (1.0)           0;0  0.2033 (1.00)          1           1
test_data_status-data-new[c7c7ba69fbe093b0889228119964f357653e6973]     4.9672 (1.01)     4.9672 (1.01)     4.9672 (1.01)     0.0000 (1.0)      4.9672 (1.01)     0.0000 (1.0)           0;0  0.2013 (0.99)          1           1
test_data_status-data-new[main]                                         5.2116 (1.06)     5.2116 (1.06)     5.2116 (1.06)     0.0000 (1.0)      5.2116 (1.06)     0.0000 (1.0)           0;0  0.1919 (0.94)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 4 tests -----------------------------------------------------------------------------------------
Name (time in s)                                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[aac32e1b64f9beaf46fd3dfc01c30a471529a878]     2.2992 (1.0)      2.2992 (1.0)      2.2992 (1.0)      0.0000 (1.0)      2.2992 (1.0)      0.0000 (1.0)           0;0  0.4349 (1.0)           1           1
test_data_status-data-noop[batch-check-remote-cache]                     2.3156 (1.01)     2.3156 (1.01)     2.3156 (1.01)     0.0000 (1.0)      2.3156 (1.01)     0.0000 (1.0)           0;0  0.4319 (0.99)          1           1
test_data_status-data-noop[c7c7ba69fbe093b0889228119964f357653e6973]     2.3088 (1.00)     2.3088 (1.00)     2.3088 (1.00)     0.0000 (1.0)      2.3088 (1.00)     0.0000 (1.0)           0;0  0.4331 (1.00)          1           1
test_data_status-data-noop[main]                                         2.3137 (1.01)     2.3137 (1.01)     2.3137 (1.01)     0.0000 (1.0)      2.3137 (1.01)     0.0000 (1.0)           0;0  0.4322 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 4 tests -------------------------------------------------------------------------------------------
Name (time in s)                                                                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[aac32e1b64f9beaf46fd3dfc01c30a471529a878]     14.2037 (1.00)     14.2037 (1.00)     14.2037 (1.00)     0.0000 (1.0)      14.2037 (1.00)     0.0000 (1.0)           0;0  0.0704 (1.00)          1           1
test_data_status_all_flags-data-changed[batch-check-remote-cache]                     16.3933 (1.16)     16.3933 (1.16)     16.3933 (1.16)     0.0000 (1.0)      16.3933 (1.16)     0.0000 (1.0)           0;0  0.0610 (0.86)          1           1
test_data_status_all_flags-data-changed[c7c7ba69fbe093b0889228119964f357653e6973]     14.2774 (1.01)     14.2774 (1.01)     14.2774 (1.01)     0.0000 (1.0)      14.2774 (1.01)     0.0000 (1.0)           0;0  0.0700 (0.99)          1           1
test_data_status_all_flags-data-changed[main]                                         14.1354 (1.0)      14.1354 (1.0)      14.1354 (1.0)      0.0000 (1.0)      14.1354 (1.0)      0.0000 (1.0)           0;0  0.0707 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed-noop': 4 tests -------------------------------------------------------------------------------------------
Name (time in s)                                                                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[aac32e1b64f9beaf46fd3dfc01c30a471529a878]     14.2207 (1.01)     14.2207 (1.01)     14.2207 (1.01)     0.0000 (1.0)      14.2207 (1.01)     0.0000 (1.0)           0;0  0.0703 (0.99)          1           1
test_data_status_all_flags-data-changed-noop[batch-check-remote-cache]                     16.2764 (1.15)     16.2764 (1.15)     16.2764 (1.15)     0.0000 (1.0)      16.2764 (1.15)     0.0000 (1.0)           0;0  0.0614 (0.87)          1           1
test_data_status_all_flags-data-changed-noop[c7c7ba69fbe093b0889228119964f357653e6973]     14.1306 (1.0)      14.1306 (1.0)      14.1306 (1.0)      0.0000 (1.0)      14.1306 (1.0)      0.0000 (1.0)           0;0  0.0708 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]                                         14.1406 (1.00)     14.1406 (1.00)     14.1406 (1.00)     0.0000 (1.0)      14.1406 (1.00)     0.0000 (1.0)           0;0  0.0707 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 4 tests -------------------------------------------------------------------------------------------
Name (time in s)                                                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[aac32e1b64f9beaf46fd3dfc01c30a471529a878]     16.4991 (1.0)      16.4991 (1.0)      16.4991 (1.0)      0.0000 (1.0)      16.4991 (1.0)      0.0000 (1.0)           0;0  0.0606 (1.0)           1           1
test_data_status_all_flags-data-new[batch-check-remote-cache]                     18.5211 (1.12)     18.5211 (1.12)     18.5211 (1.12)     0.0000 (1.0)      18.5211 (1.12)     0.0000 (1.0)           0;0  0.0540 (0.89)          1           1
test_data_status_all_flags-data-new[c7c7ba69fbe093b0889228119964f357653e6973]     16.5956 (1.01)     16.5956 (1.01)     16.5956 (1.01)     0.0000 (1.0)      16.5956 (1.01)     0.0000 (1.0)           0;0  0.0603 (0.99)          1           1
test_data_status_all_flags-data-new[main]                                         16.8655 (1.02)     16.8655 (1.02)     16.8655 (1.02)     0.0000 (1.0)      16.8655 (1.02)     0.0000 (1.0)           0;0  0.0593 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 4 tests -------------------------------------------------------------------------------------------
Name (time in s)                                                                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[aac32e1b64f9beaf46fd3dfc01c30a471529a878]     13.7045 (1.00)     13.7045 (1.00)     13.7045 (1.00)     0.0000 (1.0)      13.7045 (1.00)     0.0000 (1.0)           0;0  0.0730 (1.00)          1           1
test_data_status_all_flags-data-noop[batch-check-remote-cache]                     16.0630 (1.17)     16.0630 (1.17)     16.0630 (1.17)     0.0000 (1.0)      16.0630 (1.17)     0.0000 (1.0)           0;0  0.0623 (0.85)          1           1
test_data_status_all_flags-data-noop[c7c7ba69fbe093b0889228119964f357653e6973]     13.6852 (1.0)      13.6852 (1.0)      13.6852 (1.0)      0.0000 (1.0)      13.6852 (1.0)      0.0000 (1.0)           0;0  0.0731 (1.0)           1           1
test_data_status_all_flags-data-noop[main]                                         13.8565 (1.01)     13.8565 (1.01)     13.8565 (1.01)     0.0000 (1.0)      13.8565 (1.01)     0.0000 (1.0)           0;0  0.0722 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean