Fri Jun 27 15:50:14 UTC 2025
dataset: mnist
project: example-get-started

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     3.9197 (1.73)     3.9197 (1.73)     3.9197 (1.73)     0.0000 (1.0)      3.9197 (1.73)     0.0000 (1.0)           0;0  0.2551 (0.58)          1           1
test_data_status-data-changed[3.10.0]     4.5560 (2.01)     4.5560 (2.01)     4.5560 (2.01)     0.0000 (1.0)      4.5560 (2.01)     0.0000 (1.0)           0;0  0.2195 (0.50)          1           1
test_data_status-data-changed[3.53.2]     4.4917 (1.98)     4.4917 (1.98)     4.4917 (1.98)     0.0000 (1.0)      4.4917 (1.98)     0.0000 (1.0)           0;0  0.2226 (0.51)          1           1
test_data_status-data-changed[3.60.1]     2.2703 (1.0)      2.2703 (1.0)      2.2703 (1.0)      0.0000 (1.0)      2.2703 (1.0)      0.0000 (1.0)           0;0  0.4405 (1.0)           1           1
test_data_status-data-changed[main]       2.2713 (1.00)     2.2713 (1.00)     2.2713 (1.00)     0.0000 (1.0)      2.2713 (1.00)     0.0000 (1.0)           0;0  0.4403 (1.00)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.0183 (1.76)     4.0183 (1.76)     4.0183 (1.76)     0.0000 (1.0)      4.0183 (1.76)     0.0000 (1.0)           0;0  0.2489 (0.57)          1           1
test_data_status-data-changed-noop[3.10.0]     4.5435 (1.99)     4.5435 (1.99)     4.5435 (1.99)     0.0000 (1.0)      4.5435 (1.99)     0.0000 (1.0)           0;0  0.2201 (0.50)          1           1
test_data_status-data-changed-noop[3.53.2]     4.4020 (1.93)     4.4020 (1.93)     4.4020 (1.93)     0.0000 (1.0)      4.4020 (1.93)     0.0000 (1.0)           0;0  0.2272 (0.52)          1           1
test_data_status-data-changed-noop[3.60.1]     2.2834 (1.0)      2.2834 (1.0)      2.2834 (1.0)      0.0000 (1.0)      2.2834 (1.0)      0.0000 (1.0)           0;0  0.4379 (1.0)           1           1
test_data_status-data-changed-noop[main]       2.2912 (1.00)     2.2912 (1.00)     2.2912 (1.00)     0.0000 (1.0)      2.2912 (1.00)     0.0000 (1.0)           0;0  0.4365 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     19.5032 (4.01)     19.5032 (4.01)     19.5032 (4.01)     0.0000 (1.0)      19.5032 (4.01)     0.0000 (1.0)           0;0  0.0513 (0.25)          1           1
test_data_status-data-new[3.10.0]     20.2648 (4.16)     20.2648 (4.16)     20.2648 (4.16)     0.0000 (1.0)      20.2648 (4.16)     0.0000 (1.0)           0;0  0.0493 (0.24)          1           1
test_data_status-data-new[3.53.2]     20.1348 (4.14)     20.1348 (4.14)     20.1348 (4.14)     0.0000 (1.0)      20.1348 (4.14)     0.0000 (1.0)           0;0  0.0497 (0.24)          1           1
test_data_status-data-new[3.60.1]      4.8668 (1.0)       4.8668 (1.0)       4.8668 (1.0)      0.0000 (1.0)       4.8668 (1.0)      0.0000 (1.0)           0;0  0.2055 (1.0)           1           1
test_data_status-data-new[main]        4.9141 (1.01)      4.9141 (1.01)      4.9141 (1.01)     0.0000 (1.0)       4.9141 (1.01)     0.0000 (1.0)           0;0  0.2035 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.0397 (1.78)     4.0397 (1.78)     4.0397 (1.78)     0.0000 (1.0)      4.0397 (1.78)     0.0000 (1.0)           0;0  0.2475 (0.56)          1           1
test_data_status-data-noop[3.10.0]     4.6385 (2.05)     4.6385 (2.05)     4.6385 (2.05)     0.0000 (1.0)      4.6385 (2.05)     0.0000 (1.0)           0;0  0.2156 (0.49)          1           1
test_data_status-data-noop[3.53.2]     4.5160 (1.99)     4.5160 (1.99)     4.5160 (1.99)     0.0000 (1.0)      4.5160 (1.99)     0.0000 (1.0)           0;0  0.2214 (0.50)          1           1
test_data_status-data-noop[3.60.1]     2.2674 (1.0)      2.2674 (1.0)      2.2674 (1.0)      0.0000 (1.0)      2.2674 (1.0)      0.0000 (1.0)           0;0  0.4410 (1.0)           1           1
test_data_status-data-noop[main]       2.3255 (1.03)     2.3255 (1.03)     2.3255 (1.03)     0.0000 (1.0)      2.3255 (1.03)     0.0000 (1.0)           0;0  0.4300 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     7.1691 (1.34)     7.1691 (1.34)     7.1691 (1.34)     0.0000 (1.0)      7.1691 (1.34)     0.0000 (1.0)           0;0  0.1395 (0.75)          1           1
test_data_status_all_flags-data-changed[3.10.0]     7.8266 (1.46)     7.8266 (1.46)     7.8266 (1.46)     0.0000 (1.0)      7.8266 (1.46)     0.0000 (1.0)           0;0  0.1278 (0.69)          1           1
test_data_status_all_flags-data-changed[3.53.2]     7.5367 (1.40)     7.5367 (1.40)     7.5367 (1.40)     0.0000 (1.0)      7.5367 (1.40)     0.0000 (1.0)           0;0  0.1327 (0.71)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.3663 (1.0)      5.3663 (1.0)      5.3663 (1.0)      0.0000 (1.0)      5.3663 (1.0)      0.0000 (1.0)           0;0  0.1863 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       5.4098 (1.01)     5.4098 (1.01)     5.4098 (1.01)     0.0000 (1.0)      5.4098 (1.01)     0.0000 (1.0)           0;0  0.1849 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     7.1692 (1.33)     7.1692 (1.33)     7.1692 (1.33)     0.0000 (1.0)      7.1692 (1.33)     0.0000 (1.0)           0;0  0.1395 (0.75)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     7.8554 (1.46)     7.8554 (1.46)     7.8554 (1.46)     0.0000 (1.0)      7.8554 (1.46)     0.0000 (1.0)           0;0  0.1273 (0.69)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     7.6985 (1.43)     7.6985 (1.43)     7.6985 (1.43)     0.0000 (1.0)      7.6985 (1.43)     0.0000 (1.0)           0;0  0.1299 (0.70)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     5.3983 (1.0)      5.3983 (1.0)      5.3983 (1.0)      0.0000 (1.0)      5.3983 (1.0)      0.0000 (1.0)           0;0  0.1852 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       5.4717 (1.01)     5.4717 (1.01)     5.4717 (1.01)     0.0000 (1.0)      5.4717 (1.01)     0.0000 (1.0)           0;0  0.1828 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     23.2308 (2.95)     23.2308 (2.95)     23.2308 (2.95)     0.0000 (1.0)      23.2308 (2.95)     0.0000 (1.0)           0;0  0.0430 (0.34)          1           1
test_data_status_all_flags-data-new[3.10.0]     23.8320 (3.03)     23.8320 (3.03)     23.8320 (3.03)     0.0000 (1.0)      23.8320 (3.03)     0.0000 (1.0)           0;0  0.0420 (0.33)          1           1
test_data_status_all_flags-data-new[3.53.2]     23.3859 (2.97)     23.3859 (2.97)     23.3859 (2.97)     0.0000 (1.0)      23.3859 (2.97)     0.0000 (1.0)           0;0  0.0428 (0.34)          1           1
test_data_status_all_flags-data-new[3.60.1]      7.8741 (1.0)       7.8741 (1.0)       7.8741 (1.0)      0.0000 (1.0)       7.8741 (1.0)      0.0000 (1.0)           0;0  0.1270 (1.0)           1           1
test_data_status_all_flags-data-new[main]        8.0527 (1.02)      8.0527 (1.02)      8.0527 (1.02)     0.0000 (1.0)       8.0527 (1.02)     0.0000 (1.0)           0;0  0.1242 (0.98)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     6.7225 (1.44)     6.7225 (1.44)     6.7225 (1.44)     0.0000 (1.0)      6.7225 (1.44)     0.0000 (1.0)           0;0  0.1488 (0.69)          1           1
test_data_status_all_flags-data-noop[3.10.0]     7.1774 (1.54)     7.1774 (1.54)     7.1774 (1.54)     0.0000 (1.0)      7.1774 (1.54)     0.0000 (1.0)           0;0  0.1393 (0.65)          1           1
test_data_status_all_flags-data-noop[3.53.2]     6.9810 (1.50)     6.9810 (1.50)     6.9810 (1.50)     0.0000 (1.0)      6.9810 (1.50)     0.0000 (1.0)           0;0  0.1432 (0.67)          1           1
test_data_status_all_flags-data-noop[3.60.1]     4.6664 (1.0)      4.6664 (1.0)      4.6664 (1.0)      0.0000 (1.0)      4.6664 (1.0)      0.0000 (1.0)           0;0  0.2143 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       4.6915 (1.01)     4.6915 (1.01)     4.6915 (1.01)     0.0000 (1.0)      4.6915 (1.01)     0.0000 (1.0)           0;0  0.2132 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean