Fri Jun 27 15:34:08 UTC 2025
dataset: mnist
project: example-get-started

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[3.60.1]     2.2876 (1.01)     2.2876 (1.01)     2.2876 (1.01)     0.0000 (1.0)      2.2876 (1.01)     0.0000 (1.0)           0;0  0.4371 (0.99)          1           1
test_data_status-data-changed[main]       2.2697 (1.0)      2.2697 (1.0)      2.2697 (1.0)      0.0000 (1.0)      2.2697 (1.0)      0.0000 (1.0)           0;0  0.4406 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[3.60.1]     2.2759 (1.0)      2.2759 (1.0)      2.2759 (1.0)      0.0000 (1.0)      2.2759 (1.0)      0.0000 (1.0)           0;0  0.4394 (1.0)           1           1
test_data_status-data-changed-noop[main]       2.3567 (1.04)     2.3567 (1.04)     2.3567 (1.04)     0.0000 (1.0)      2.3567 (1.04)     0.0000 (1.0)           0;0  0.4243 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-new': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[3.60.1]     4.8686 (1.0)      4.8686 (1.0)      4.8686 (1.0)      0.0000 (1.0)      4.8686 (1.0)      0.0000 (1.0)           0;0  0.2054 (1.0)           1           1
test_data_status-data-new[main]       5.0419 (1.04)     5.0419 (1.04)     5.0419 (1.04)     0.0000 (1.0)      5.0419 (1.04)     0.0000 (1.0)           0;0  0.1983 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[3.60.1]     2.2753 (1.01)     2.2753 (1.01)     2.2753 (1.01)     0.0000 (1.0)      2.2753 (1.01)     0.0000 (1.0)           0;0  0.4395 (0.99)          1           1
test_data_status-data-noop[main]       2.2533 (1.0)      2.2533 (1.0)      2.2533 (1.0)      0.0000 (1.0)      2.2533 (1.0)      0.0000 (1.0)           0;0  0.4438 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 2 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[3.60.1]     5.4345 (1.0)      5.4345 (1.0)      5.4345 (1.0)      0.0000 (1.0)      5.4345 (1.0)      0.0000 (1.0)           0;0  0.1840 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       5.4873 (1.01)     5.4873 (1.01)     5.4873 (1.01)     0.0000 (1.0)      5.4873 (1.01)     0.0000 (1.0)           0;0  0.1822 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[3.60.1]     5.4898 (1.00)     5.4898 (1.00)     5.4898 (1.00)     0.0000 (1.0)      5.4898 (1.00)     0.0000 (1.0)           0;0  0.1822 (1.00)          1           1
test_data_status_all_flags-data-changed-noop[main]       5.4644 (1.0)      5.4644 (1.0)      5.4644 (1.0)      0.0000 (1.0)      5.4644 (1.0)      0.0000 (1.0)           0;0  0.1830 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-new': 2 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[3.60.1]     7.7372 (1.0)      7.7372 (1.0)      7.7372 (1.0)      0.0000 (1.0)      7.7372 (1.0)      0.0000 (1.0)           0;0  0.1292 (1.0)           1           1
test_data_status_all_flags-data-new[main]       8.1392 (1.05)     8.1392 (1.05)     8.1392 (1.05)     0.0000 (1.0)      8.1392 (1.05)     0.0000 (1.0)           0;0  0.1229 (0.95)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[3.60.1]     4.6772 (1.0)      4.6772 (1.0)      4.6772 (1.0)      0.0000 (1.0)      4.6772 (1.0)      0.0000 (1.0)           0;0  0.2138 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       4.7148 (1.01)     4.7148 (1.01)     4.7148 (1.01)     0.0000 (1.0)      4.7148 (1.01)     0.0000 (1.0)           0;0  0.2121 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean