Thu Jun 26 00:40:29 UTC 2025
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     91.9486 (3.93)     91.9486 (3.93)     91.9486 (3.93)     0.0000 (1.0)      91.9486 (3.93)     0.0000 (1.0)           0;0  0.0109 (0.25)          1           1
test_add_copy-add[3.10.0]     93.0878 (3.98)     93.0878 (3.98)     93.0878 (3.98)     0.0000 (1.0)      93.0878 (3.98)     0.0000 (1.0)           0;0  0.0107 (0.25)          1           1
test_add_copy-add[3.53.2]     84.7008 (3.62)     84.7008 (3.62)     84.7008 (3.62)     0.0000 (1.0)      84.7008 (3.62)     0.0000 (1.0)           0;0  0.0118 (0.28)          1           1
test_add_copy-add[main]       23.3940 (1.0)      23.3940 (1.0)      23.3940 (1.0)      0.0000 (1.0)      23.3940 (1.0)      0.0000 (1.0)           0;0  0.0427 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     31.3371 (6.83)     31.3371 (6.83)     31.3371 (6.83)     0.0000 (1.0)      31.3371 (6.83)     0.0000 (1.0)           0;0  0.0319 (0.15)          1           1
test_add_copy-add-noop[3.10.0]     31.7978 (6.93)     31.7978 (6.93)     31.7978 (6.93)     0.0000 (1.0)      31.7978 (6.93)     0.0000 (1.0)           0;0  0.0314 (0.14)          1           1
test_add_copy-add-noop[3.53.2]     30.5287 (6.65)     30.5287 (6.65)     30.5287 (6.65)     0.0000 (1.0)      30.5287 (6.65)     0.0000 (1.0)           0;0  0.0328 (0.15)          1           1
test_add_copy-add-noop[main]        4.5899 (1.0)       4.5899 (1.0)       4.5899 (1.0)      0.0000 (1.0)       4.5899 (1.0)      0.0000 (1.0)           0;0  0.2179 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     71.2495 (4.20)     71.2495 (4.20)     71.2495 (4.20)     0.0000 (1.0)      71.2495 (4.20)     0.0000 (1.0)           0;0  0.0140 (0.24)          1           1
test_add_hardlink-add[3.10.0]     71.4201 (4.21)     71.4201 (4.21)     71.4201 (4.21)     0.0000 (1.0)      71.4201 (4.21)     0.0000 (1.0)           0;0  0.0140 (0.24)          1           1
test_add_hardlink-add[3.53.2]     66.1376 (3.90)     66.1376 (3.90)     66.1376 (3.90)     0.0000 (1.0)      66.1376 (3.90)     0.0000 (1.0)           0;0  0.0151 (0.26)          1           1
test_add_hardlink-add[main]       16.9789 (1.0)      16.9789 (1.0)      16.9789 (1.0)      0.0000 (1.0)      16.9789 (1.0)      0.0000 (1.0)           0;0  0.0589 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     36.1523 (8.35)     36.1523 (8.35)     36.1523 (8.35)     0.0000 (1.0)      36.1523 (8.35)     0.0000 (1.0)           0;0  0.0277 (0.12)          1           1
test_add_hardlink-add-noop[3.10.0]     36.4816 (8.42)     36.4816 (8.42)     36.4816 (8.42)     0.0000 (1.0)      36.4816 (8.42)     0.0000 (1.0)           0;0  0.0274 (0.12)          1           1
test_add_hardlink-add-noop[3.53.2]     34.3185 (7.92)     34.3185 (7.92)     34.3185 (7.92)     0.0000 (1.0)      34.3185 (7.92)     0.0000 (1.0)           0;0  0.0291 (0.13)          1           1
test_add_hardlink-add-noop[main]        4.3319 (1.0)       4.3319 (1.0)       4.3319 (1.0)      0.0000 (1.0)       4.3319 (1.0)      0.0000 (1.0)           0;0  0.2308 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     76.6968 (2.14)     76.6968 (2.14)     76.6968 (2.14)     0.0000 (1.0)      76.6968 (2.14)     0.0000 (1.0)           0;0  0.0130 (0.47)          1           1
test_add_symlink-add[3.10.0]     77.3821 (2.15)     77.3821 (2.15)     77.3821 (2.15)     0.0000 (1.0)      77.3821 (2.15)     0.0000 (1.0)           0;0  0.0129 (0.46)          1           1
test_add_symlink-add[3.53.2]     72.1711 (2.01)     72.1711 (2.01)     72.1711 (2.01)     0.0000 (1.0)      72.1711 (2.01)     0.0000 (1.0)           0;0  0.0139 (0.50)          1           1
test_add_symlink-add[main]       35.9119 (1.0)      35.9119 (1.0)      35.9119 (1.0)      0.0000 (1.0)      35.9119 (1.0)      0.0000 (1.0)           0;0  0.0278 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     48.6888 (8.48)     48.6888 (8.48)     48.6888 (8.48)     0.0000 (1.0)      48.6888 (8.48)     0.0000 (1.0)           0;0  0.0205 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     49.9845 (8.71)     49.9845 (8.71)     49.9845 (8.71)     0.0000 (1.0)      49.9845 (8.71)     0.0000 (1.0)           0;0  0.0200 (0.11)          1           1
test_add_symlink-add-noop[3.53.2]     48.0544 (8.37)     48.0544 (8.37)     48.0544 (8.37)     0.0000 (1.0)      48.0544 (8.37)     0.0000 (1.0)           0;0  0.0208 (0.12)          1           1
test_add_symlink-add-noop[main]        5.7389 (1.0)       5.7389 (1.0)       5.7389 (1.0)      0.0000 (1.0)       5.7389 (1.0)      0.0000 (1.0)           0;0  0.1742 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     42.6712 (1.99)     42.6712 (1.99)     42.6712 (1.99)     0.0000 (1.0)      42.6712 (1.99)     0.0000 (1.0)           0;0  0.0234 (0.50)          1           1
test_checkout_copy-checkout[3.10.0]     61.3352 (2.85)     61.3352 (2.85)     61.3352 (2.85)     0.0000 (1.0)      61.3352 (2.85)     0.0000 (1.0)           0;0  0.0163 (0.35)          1           1
test_checkout_copy-checkout[3.53.2]     29.5954 (1.38)     29.5954 (1.38)     29.5954 (1.38)     0.0000 (1.0)      29.5954 (1.38)     0.0000 (1.0)           0;0  0.0338 (0.73)          1           1
test_checkout_copy-checkout[main]       21.4914 (1.0)      21.4914 (1.0)      21.4914 (1.0)      0.0000 (1.0)      21.4914 (1.0)      0.0000 (1.0)           0;0  0.0465 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.3649 (1.56)     5.3649 (1.56)     5.3649 (1.56)     0.0000 (1.0)      5.3649 (1.56)     0.0000 (1.0)           0;0  0.1864 (0.64)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.6288 (1.63)     5.6288 (1.63)     5.6288 (1.63)     0.0000 (1.0)      5.6288 (1.63)     0.0000 (1.0)           0;0  0.1777 (0.61)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.4715 (1.59)     5.4715 (1.59)     5.4715 (1.59)     0.0000 (1.0)      5.4715 (1.59)     0.0000 (1.0)           0;0  0.1828 (0.63)          1           1
test_checkout_copy-checkout-noop[main]       3.4490 (1.0)      3.4490 (1.0)      3.4490 (1.0)      0.0000 (1.0)      3.4490 (1.0)      0.0000 (1.0)           0;0  0.2899 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     8.6264 (2.16)     8.6264 (2.16)     8.6264 (2.16)     0.0000 (1.0)      8.6264 (2.16)     0.0000 (1.0)           0;0  0.1159 (0.46)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.3633 (1.60)     6.3633 (1.60)     6.3633 (1.60)     0.0000 (1.0)      6.3633 (1.60)     0.0000 (1.0)           0;0  0.1572 (0.63)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.2636 (1.57)     6.2636 (1.57)     6.2636 (1.57)     0.0000 (1.0)      6.2636 (1.57)     0.0000 (1.0)           0;0  0.1597 (0.64)          1           1
test_checkout_copy-checkout-update[main]       3.9845 (1.0)      3.9845 (1.0)      3.9845 (1.0)      0.0000 (1.0)      3.9845 (1.0)      0.0000 (1.0)           0;0  0.2510 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     24.0755 (3.15)     24.0755 (3.15)     24.0755 (3.15)     0.0000 (1.0)      24.0755 (3.15)     0.0000 (1.0)           0;0  0.0415 (0.32)          1           1
test_checkout_hardlink-checkout[3.10.0]     17.1687 (2.24)     17.1687 (2.24)     17.1687 (2.24)     0.0000 (1.0)      17.1687 (2.24)     0.0000 (1.0)           0;0  0.0582 (0.45)          1           1
test_checkout_hardlink-checkout[3.53.2]     16.1724 (2.11)     16.1724 (2.11)     16.1724 (2.11)     0.0000 (1.0)      16.1724 (2.11)     0.0000 (1.0)           0;0  0.0618 (0.47)          1           1
test_checkout_hardlink-checkout[main]        7.6502 (1.0)       7.6502 (1.0)       7.6502 (1.0)      0.0000 (1.0)       7.6502 (1.0)      0.0000 (1.0)           0;0  0.1307 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.3231 (1.65)     5.3231 (1.65)     5.3231 (1.65)     0.0000 (1.0)      5.3231 (1.65)     0.0000 (1.0)           0;0  0.1879 (0.61)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.5357 (1.71)     5.5357 (1.71)     5.5357 (1.71)     0.0000 (1.0)      5.5357 (1.71)     0.0000 (1.0)           0;0  0.1806 (0.58)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.2966 (1.64)     5.2966 (1.64)     5.2966 (1.64)     0.0000 (1.0)      5.2966 (1.64)     0.0000 (1.0)           0;0  0.1888 (0.61)          1           1
test_checkout_hardlink-checkout-noop[main]       3.2339 (1.0)      3.2339 (1.0)      3.2339 (1.0)      0.0000 (1.0)      3.2339 (1.0)      0.0000 (1.0)           0;0  0.3092 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     8.4111 (2.18)     8.4111 (2.18)     8.4111 (2.18)     0.0000 (1.0)      8.4111 (2.18)     0.0000 (1.0)           0;0  0.1189 (0.46)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.1896 (1.60)     6.1896 (1.60)     6.1896 (1.60)     0.0000 (1.0)      6.1896 (1.60)     0.0000 (1.0)           0;0  0.1616 (0.62)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.1267 (1.59)     6.1267 (1.59)     6.1267 (1.59)     0.0000 (1.0)      6.1267 (1.59)     0.0000 (1.0)           0;0  0.1632 (0.63)          1           1
test_checkout_hardlink-checkout-update[main]       3.8643 (1.0)      3.8643 (1.0)      3.8643 (1.0)      0.0000 (1.0)      3.8643 (1.0)      0.0000 (1.0)           0;0  0.2588 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     26.9015 (2.46)     26.9015 (2.46)     26.9015 (2.46)     0.0000 (1.0)      26.9015 (2.46)     0.0000 (1.0)           0;0  0.0372 (0.41)          1           1
test_checkout_symlink-checkout[3.10.0]     20.9665 (1.92)     20.9665 (1.92)     20.9665 (1.92)     0.0000 (1.0)      20.9665 (1.92)     0.0000 (1.0)           0;0  0.0477 (0.52)          1           1
test_checkout_symlink-checkout[3.53.2]     19.4507 (1.78)     19.4507 (1.78)     19.4507 (1.78)     0.0000 (1.0)      19.4507 (1.78)     0.0000 (1.0)           0;0  0.0514 (0.56)          1           1
test_checkout_symlink-checkout[main]       10.9203 (1.0)      10.9203 (1.0)      10.9203 (1.0)      0.0000 (1.0)      10.9203 (1.0)      0.0000 (1.0)           0;0  0.0916 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.5724 (1.58)     6.5724 (1.58)     6.5724 (1.58)     0.0000 (1.0)      6.5724 (1.58)     0.0000 (1.0)           0;0  0.1522 (0.63)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     6.7306 (1.61)     6.7306 (1.61)     6.7306 (1.61)     0.0000 (1.0)      6.7306 (1.61)     0.0000 (1.0)           0;0  0.1486 (0.62)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.4469 (1.55)     6.4469 (1.55)     6.4469 (1.55)     0.0000 (1.0)      6.4469 (1.55)     0.0000 (1.0)           0;0  0.1551 (0.65)          1           1
test_checkout_symlink-checkout-noop[main]       4.1690 (1.0)      4.1690 (1.0)      4.1690 (1.0)      0.0000 (1.0)      4.1690 (1.0)      0.0000 (1.0)           0;0  0.2399 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 4 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     10.6039 (1.88)     10.6039 (1.88)     10.6039 (1.88)     0.0000 (1.0)      10.6039 (1.88)     0.0000 (1.0)           0;0  0.0943 (0.53)          1           1
test_checkout_symlink-checkout-update[3.10.0]      8.3660 (1.48)      8.3660 (1.48)      8.3660 (1.48)     0.0000 (1.0)       8.3660 (1.48)     0.0000 (1.0)           0;0  0.1195 (0.67)          1           1
test_checkout_symlink-checkout-update[3.53.2]      8.1810 (1.45)      8.1810 (1.45)      8.1810 (1.45)     0.0000 (1.0)       8.1810 (1.45)     0.0000 (1.0)           0;0  0.1222 (0.69)          1           1
test_checkout_symlink-checkout-update[main]        5.6399 (1.0)       5.6399 (1.0)       5.6399 (1.0)      0.0000 (1.0)       5.6399 (1.0)      0.0000 (1.0)           0;0  0.1773 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     3.9189 (1.77)     3.9189 (1.77)     3.9189 (1.77)     0.0000 (1.0)      3.9189 (1.77)     0.0000 (1.0)           0;0  0.2552 (0.57)          1           1
test_data_status-data-changed[3.10.0]     4.6817 (2.11)     4.6817 (2.11)     4.6817 (2.11)     0.0000 (1.0)      4.6817 (2.11)     0.0000 (1.0)           0;0  0.2136 (0.47)          1           1
test_data_status-data-changed[3.53.2]     4.4267 (2.00)     4.4267 (2.00)     4.4267 (2.00)     0.0000 (1.0)      4.4267 (2.00)     0.0000 (1.0)           0;0  0.2259 (0.50)          1           1
test_data_status-data-changed[main]       2.2150 (1.0)      2.2150 (1.0)      2.2150 (1.0)      0.0000 (1.0)      2.2150 (1.0)      0.0000 (1.0)           0;0  0.4515 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     3.8595 (1.75)     3.8595 (1.75)     3.8595 (1.75)     0.0000 (1.0)      3.8595 (1.75)     0.0000 (1.0)           0;0  0.2591 (0.57)          1           1
test_data_status-data-changed-noop[3.10.0]     4.5036 (2.04)     4.5036 (2.04)     4.5036 (2.04)     0.0000 (1.0)      4.5036 (2.04)     0.0000 (1.0)           0;0  0.2220 (0.49)          1           1
test_data_status-data-changed-noop[3.53.2]     4.4107 (2.00)     4.4107 (2.00)     4.4107 (2.00)     0.0000 (1.0)      4.4107 (2.00)     0.0000 (1.0)           0;0  0.2267 (0.50)          1           1
test_data_status-data-changed-noop[main]       2.2068 (1.0)      2.2068 (1.0)      2.2068 (1.0)      0.0000 (1.0)      2.2068 (1.0)      0.0000 (1.0)           0;0  0.4532 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 4 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     19.2514 (3.92)     19.2514 (3.92)     19.2514 (3.92)     0.0000 (1.0)      19.2514 (3.92)     0.0000 (1.0)           0;0  0.0519 (0.26)          1           1
test_data_status-data-new[3.10.0]     20.0797 (4.09)     20.0797 (4.09)     20.0797 (4.09)     0.0000 (1.0)      20.0797 (4.09)     0.0000 (1.0)           0;0  0.0498 (0.24)          1           1
test_data_status-data-new[3.53.2]     19.9652 (4.06)     19.9652 (4.06)     19.9652 (4.06)     0.0000 (1.0)      19.9652 (4.06)     0.0000 (1.0)           0;0  0.0501 (0.25)          1           1
test_data_status-data-new[main]        4.9116 (1.0)       4.9116 (1.0)       4.9116 (1.0)      0.0000 (1.0)       4.9116 (1.0)      0.0000 (1.0)           0;0  0.2036 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     3.9252 (1.72)     3.9252 (1.72)     3.9252 (1.72)     0.0000 (1.0)      3.9252 (1.72)     0.0000 (1.0)           0;0  0.2548 (0.58)          1           1
test_data_status-data-noop[3.10.0]     4.4696 (1.96)     4.4696 (1.96)     4.4696 (1.96)     0.0000 (1.0)      4.4696 (1.96)     0.0000 (1.0)           0;0  0.2237 (0.51)          1           1
test_data_status-data-noop[3.53.2]     4.2959 (1.88)     4.2959 (1.88)     4.2959 (1.88)     0.0000 (1.0)      4.2959 (1.88)     0.0000 (1.0)           0;0  0.2328 (0.53)          1           1
test_data_status-data-noop[main]       2.2861 (1.0)      2.2861 (1.0)      2.2861 (1.0)      0.0000 (1.0)      2.2861 (1.0)      0.0000 (1.0)           0;0  0.4374 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 4 tests --------------------------------------------------------------------------
Name (time in s)                                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     15.6450 (1.10)     15.6450 (1.10)     15.6450 (1.10)     0.0000 (1.0)      15.6450 (1.10)     0.0000 (1.0)           0;0  0.0639 (0.91)          1           1
test_data_status_all_flags-data-changed[3.10.0]     16.1890 (1.14)     16.1890 (1.14)     16.1890 (1.14)     0.0000 (1.0)      16.1890 (1.14)     0.0000 (1.0)           0;0  0.0618 (0.88)          1           1
test_data_status_all_flags-data-changed[3.53.2]     16.1082 (1.14)     16.1082 (1.14)     16.1082 (1.14)     0.0000 (1.0)      16.1082 (1.14)     0.0000 (1.0)           0;0  0.0621 (0.88)          1           1
test_data_status_all_flags-data-changed[main]       14.1690 (1.0)      14.1690 (1.0)      14.1690 (1.0)      0.0000 (1.0)      14.1690 (1.0)      0.0000 (1.0)           0;0  0.0706 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     15.7395 (1.12)     15.7395 (1.12)     15.7395 (1.12)     0.0000 (1.0)      15.7395 (1.12)     0.0000 (1.0)           0;0  0.0635 (0.89)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     16.2980 (1.16)     16.2980 (1.16)     16.2980 (1.16)     0.0000 (1.0)      16.2980 (1.16)     0.0000 (1.0)           0;0  0.0614 (0.86)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     16.2441 (1.16)     16.2441 (1.16)     16.2441 (1.16)     0.0000 (1.0)      16.2441 (1.16)     0.0000 (1.0)           0;0  0.0616 (0.86)          1           1
test_data_status_all_flags-data-changed-noop[main]       14.0465 (1.0)      14.0465 (1.0)      14.0465 (1.0)      0.0000 (1.0)      14.0465 (1.0)      0.0000 (1.0)           0;0  0.0712 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 4 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     31.6177 (1.84)     31.6177 (1.84)     31.6177 (1.84)     0.0000 (1.0)      31.6177 (1.84)     0.0000 (1.0)           0;0  0.0316 (0.54)          1           1
test_data_status_all_flags-data-new[3.10.0]     32.5778 (1.90)     32.5778 (1.90)     32.5778 (1.90)     0.0000 (1.0)      32.5778 (1.90)     0.0000 (1.0)           0;0  0.0307 (0.53)          1           1
test_data_status_all_flags-data-new[3.53.2]     31.9629 (1.86)     31.9629 (1.86)     31.9629 (1.86)     0.0000 (1.0)      31.9629 (1.86)     0.0000 (1.0)           0;0  0.0313 (0.54)          1           1
test_data_status_all_flags-data-new[main]       17.1542 (1.0)      17.1542 (1.0)      17.1542 (1.0)      0.0000 (1.0)      17.1542 (1.0)      0.0000 (1.0)           0;0  0.0583 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     15.1262 (1.11)     15.1262 (1.11)     15.1262 (1.11)     0.0000 (1.0)      15.1262 (1.11)     0.0000 (1.0)           0;0  0.0661 (0.90)          1           1
test_data_status_all_flags-data-noop[3.10.0]     15.5679 (1.14)     15.5679 (1.14)     15.5679 (1.14)     0.0000 (1.0)      15.5679 (1.14)     0.0000 (1.0)           0;0  0.0642 (0.88)          1           1
test_data_status_all_flags-data-noop[3.53.2]     15.4638 (1.13)     15.4638 (1.13)     15.4638 (1.13)     0.0000 (1.0)      15.4638 (1.13)     0.0000 (1.0)           0;0  0.0647 (0.88)          1           1
test_data_status_all_flags-data-noop[main]       13.6359 (1.0)      13.6359 (1.0)      13.6359 (1.0)      0.0000 (1.0)      13.6359 (1.0)      0.0000 (1.0)           0;0  0.0733 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 4 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     19.3002 (2.68)     19.3002 (2.68)     19.3002 (2.68)     0.0000 (1.0)      19.3002 (2.68)     0.0000 (1.0)           0;0  0.0518 (0.37)          1           1
test_diff-diff[3.10.0]     20.1606 (2.80)     20.1606 (2.80)     20.1606 (2.80)     0.0000 (1.0)      20.1606 (2.80)     0.0000 (1.0)           0;0  0.0496 (0.36)          1           1
test_diff-diff[3.53.2]     20.5344 (2.85)     20.5344 (2.85)     20.5344 (2.85)     0.0000 (1.0)      20.5344 (2.85)     0.0000 (1.0)           0;0  0.0487 (0.35)          1           1
test_diff-diff[main]        7.2087 (1.0)       7.2087 (1.0)       7.2087 (1.0)      0.0000 (1.0)       7.2087 (1.0)      0.0000 (1.0)           0;0  0.1387 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     6.0939 (1.76)     6.0939 (1.76)     6.0939 (1.76)     0.0000 (1.0)      6.0939 (1.76)     0.0000 (1.0)           0;0  0.1641 (0.57)          1           1
test_diff-diff-changed[3.10.0]     6.8082 (1.97)     6.8082 (1.97)     6.8082 (1.97)     0.0000 (1.0)      6.8082 (1.97)     0.0000 (1.0)           0;0  0.1469 (0.51)          1           1
test_diff-diff-changed[3.53.2]     5.5732 (1.61)     5.5732 (1.61)     5.5732 (1.61)     0.0000 (1.0)      5.5732 (1.61)     0.0000 (1.0)           0;0  0.1794 (0.62)          1           1
test_diff-diff-changed[main]       3.4543 (1.0)      3.4543 (1.0)      3.4543 (1.0)      0.0000 (1.0)      3.4543 (1.0)      0.0000 (1.0)           0;0  0.2895 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.0533 (1.51)     5.0533 (1.51)     5.0533 (1.51)     0.0000 (1.0)      5.0533 (1.51)     0.0000 (1.0)           0;0  0.1979 (0.66)          1           1
test_diff-diff-changed-noop[3.10.0]     5.6768 (1.70)     5.6768 (1.70)     5.6768 (1.70)     0.0000 (1.0)      5.6768 (1.70)     0.0000 (1.0)           0;0  0.1762 (0.59)          1           1
test_diff-diff-changed-noop[3.53.2]     5.4792 (1.64)     5.4792 (1.64)     5.4792 (1.64)     0.0000 (1.0)      5.4792 (1.64)     0.0000 (1.0)           0;0  0.1825 (0.61)          1           1
test_diff-diff-changed-noop[main]       3.3451 (1.0)      3.3451 (1.0)      3.3451 (1.0)      0.0000 (1.0)      3.3451 (1.0)      0.0000 (1.0)           0;0  0.2989 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.2592 (1.28)     4.2592 (1.28)     4.2592 (1.28)     0.0000 (1.0)      4.2592 (1.28)     0.0000 (1.0)           0;0  0.2348 (0.78)          1           1
test_diff-diff-noop[3.10.0]     4.7026 (1.41)     4.7026 (1.41)     4.7026 (1.41)     0.0000 (1.0)      4.7026 (1.41)     0.0000 (1.0)           0;0  0.2126 (0.71)          1           1
test_diff-diff-noop[3.53.2]     5.6027 (1.68)     5.6027 (1.68)     5.6027 (1.68)     0.0000 (1.0)      5.6027 (1.68)     0.0000 (1.0)           0;0  0.1785 (0.59)          1           1
test_diff-diff-noop[main]       3.3256 (1.0)      3.3256 (1.0)      3.3256 (1.0)      0.0000 (1.0)      3.3256 (1.0)      0.0000 (1.0)           0;0  0.3007 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]      1.0782 (1.0)       1.0782 (1.0)       1.0782 (1.0)      0.0000 (1.0)       1.0782 (1.0)      0.0000 (1.0)           0;0  0.9275 (1.0)           1           1
test_exp_show-exp[3.10.0]     10.2355 (9.49)     10.2355 (9.49)     10.2355 (9.49)     0.0000 (1.0)      10.2355 (9.49)     0.0000 (1.0)           0;0  0.0977 (0.11)          1           1
test_exp_show-exp[3.53.2]      5.6397 (5.23)      5.6397 (5.23)      5.6397 (5.23)     0.0000 (1.0)       5.6397 (5.23)     0.0000 (1.0)           0;0  0.1773 (0.19)          1           1
test_exp_show-exp[main]       11.7578 (10.90)    11.7578 (10.90)    11.7578 (10.90)    0.0000 (1.0)      11.7578 (10.90)    0.0000 (1.0)           0;0  0.0851 (0.09)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 4 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     67.7213 (2.85)     67.7213 (2.85)     67.7213 (2.85)     0.0000 (1.0)      67.7213 (2.85)     0.0000 (1.0)           0;0  0.0148 (0.35)          1           1
test_fetch-fetch[3.10.0]     74.6383 (3.14)     74.6383 (3.14)     74.6383 (3.14)     0.0000 (1.0)      74.6383 (3.14)     0.0000 (1.0)           0;0  0.0134 (0.32)          1           1
test_fetch-fetch[3.53.2]     36.5770 (1.54)     36.5770 (1.54)     36.5770 (1.54)     0.0000 (1.0)      36.5770 (1.54)     0.0000 (1.0)           0;0  0.0273 (0.65)          1           1
test_fetch-fetch[main]       23.7944 (1.0)      23.7944 (1.0)      23.7944 (1.0)      0.0000 (1.0)      23.7944 (1.0)      0.0000 (1.0)           0;0  0.0420 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 4 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.8597 (1.02)     2.8597 (1.02)     2.8597 (1.02)     0.0000 (1.0)      2.8597 (1.02)     0.0000 (1.0)           0;0  0.3497 (0.98)          1           1
test_gc-gc[3.10.0]     2.9510 (1.06)     2.9510 (1.06)     2.9510 (1.06)     0.0000 (1.0)      2.9510 (1.06)     0.0000 (1.0)           0;0  0.3389 (0.95)          1           1
test_gc-gc[3.53.2]     2.9000 (1.04)     2.9000 (1.04)     2.9000 (1.04)     0.0000 (1.0)      2.9000 (1.04)     0.0000 (1.0)           0;0  0.3448 (0.96)          1           1
test_gc-gc[main]       2.7965 (1.0)      2.7965 (1.0)      2.7965 (1.0)      0.0000 (1.0)      2.7965 (1.0)      0.0000 (1.0)           0;0  0.3576 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 4 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     132.3228 (2.65)     132.3228 (2.65)     132.3228 (2.65)     0.0000 (1.0)      132.3228 (2.65)     0.0000 (1.0)           0;0  0.0076 (0.38)          1           1
test_get-get[3.10.0]     159.6389 (3.20)     159.6389 (3.20)     159.6389 (3.20)     0.0000 (1.0)      159.6389 (3.20)     0.0000 (1.0)           0;0  0.0063 (0.31)          1           1
test_get-get[3.53.2]     141.3256 (2.83)     141.3256 (2.83)     141.3256 (2.83)     0.0000 (1.0)      141.3256 (2.83)     0.0000 (1.0)           0;0  0.0071 (0.35)          1           1
test_get-get[main]        49.9104 (1.0)       49.9104 (1.0)       49.9104 (1.0)      0.0000 (1.0)       49.9104 (1.0)      0.0000 (1.0)           0;0  0.0200 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     45.7764 (2.71)     45.7764 (2.71)     45.7764 (2.71)     0.0000 (1.0)      45.7764 (2.71)     0.0000 (1.0)           0;0  0.0218 (0.37)          1           1
test_get_url-get-url[3.10.0]     48.9596 (2.90)     48.9596 (2.90)     48.9596 (2.90)     0.0000 (1.0)      48.9596 (2.90)     0.0000 (1.0)           0;0  0.0204 (0.35)          1           1
test_get_url-get-url[3.53.2]     16.8950 (1.0)      16.8950 (1.0)      16.8950 (1.0)      0.0000 (1.0)      16.8950 (1.0)      0.0000 (1.0)           0;0  0.0592 (1.0)           1           1
test_get_url-get-url[main]       17.0027 (1.01)     17.0027 (1.01)     17.0027 (1.01)     0.0000 (1.0)      17.0027 (1.01)     0.0000 (1.0)           0;0  0.0588 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     123.7261 (1.0)      146.0274 (1.06)     125.7340 (1.0)      2.7391 (1.69)     124.8982 (1.0)      1.5799 (1.0)         10;10  7.9533 (1.0)         100           1
test_help---help[3.10.0]     125.9750 (1.02)     143.0285 (1.03)     129.0969 (1.03)     2.3271 (1.44)     128.6876 (1.03)     2.3808 (1.51)         14;4  7.7461 (0.97)        100           1
test_help---help[3.53.2]     126.2660 (1.02)     174.5392 (1.26)     131.6391 (1.05)     6.5897 (4.07)     130.3856 (1.04)     2.6575 (1.68)          5;9  7.5965 (0.96)        100           1
test_help---help[main]       128.0061 (1.03)     138.3076 (1.0)      130.9857 (1.04)     1.6190 (1.0)      130.7976 (1.05)     1.7851 (1.13)         24;3  7.6344 (0.96)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     228.7769 (3.00)     228.7769 (3.00)     228.7769 (3.00)     0.0000 (1.0)      228.7769 (3.00)     0.0000 (1.0)           0;0  0.0044 (0.33)          1           1
test_import-import[3.10.0]     256.3056 (3.36)     256.3056 (3.36)     256.3056 (3.36)     0.0000 (1.0)      256.3056 (3.36)     0.0000 (1.0)           0;0  0.0039 (0.30)          1           1
test_import-import[main]        76.2387 (1.0)       76.2387 (1.0)       76.2387 (1.0)      0.0000 (1.0)       76.2387 (1.0)      0.0000 (1.0)           0;0  0.0131 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 4 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     157.7788 (3.36)     157.7788 (3.36)     157.7788 (3.36)     0.0000 (1.0)      157.7788 (3.36)     0.0000 (1.0)           0;0  0.0063 (0.30)          1           1
test_import_url-import-url[3.10.0]     163.3806 (3.48)     163.3806 (3.48)     163.3806 (3.48)     0.0000 (1.0)      163.3806 (3.48)     0.0000 (1.0)           0;0  0.0061 (0.29)          1           1
test_import_url-import-url[3.53.2]     120.4698 (2.57)     120.4698 (2.57)     120.4698 (2.57)     0.0000 (1.0)      120.4698 (2.57)     0.0000 (1.0)           0;0  0.0083 (0.39)          1           1
test_import_url-import-url[main]        46.8891 (1.0)       46.8891 (1.0)       46.8891 (1.0)      0.0000 (1.0)       46.8891 (1.0)      0.0000 (1.0)           0;0  0.0213 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_init-init': 4 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     386.3599 (1.03)     407.7303 (1.0)      396.8507 (1.01)      4.2172 (1.0)      396.2013 (1.02)     5.1370 (1.0)          29;3  2.5198 (0.99)        100           1
test_init-init[3.10.0]     394.2204 (1.05)     428.0617 (1.05)     405.9656 (1.03)      6.5719 (1.56)     405.4603 (1.04)     7.9339 (1.54)         28;3  2.4633 (0.97)        100           1
test_init-init[3.53.2]     378.9811 (1.01)     463.1954 (1.14)     395.6538 (1.01)     10.0106 (2.37)     394.1256 (1.01)     8.4768 (1.65)         18;5  2.5275 (0.99)        100           1
test_init-init[main]       376.0180 (1.0)      519.2303 (1.27)     393.4623 (1.0)      19.6155 (4.65)     390.0717 (1.0)      9.4002 (1.83)          8;8  2.5415 (1.0)         100           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 4 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     568.1358 (1.10)     568.1358 (1.10)     568.1358 (1.10)     0.0000 (1.0)      568.1358 (1.10)     0.0000 (1.0)           0;0  1.7601 (0.91)          1           1
test_list-list[3.10.0]     644.8534 (1.25)     644.8534 (1.25)     644.8534 (1.25)     0.0000 (1.0)      644.8534 (1.25)     0.0000 (1.0)           0;0  1.5507 (0.80)          1           1
test_list-list[3.53.2]     559.5687 (1.08)     559.5687 (1.08)     559.5687 (1.08)     0.0000 (1.0)      559.5687 (1.08)     0.0000 (1.0)           0;0  1.7871 (0.92)          1           1
test_list-list[main]       516.9792 (1.0)      516.9792 (1.0)      516.9792 (1.0)      0.0000 (1.0)      516.9792 (1.0)      0.0000 (1.0)           0;0  1.9343 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     408.7469 (1.05)     408.7469 (1.05)     408.7469 (1.05)     0.0000 (1.0)      408.7469 (1.05)     0.0000 (1.0)           0;0  2.4465 (0.95)          1           1
test_list-list-dvc-only[3.10.0]     407.7574 (1.05)     407.7574 (1.05)     407.7574 (1.05)     0.0000 (1.0)      407.7574 (1.05)     0.0000 (1.0)           0;0  2.4524 (0.95)          1           1
test_list-list-dvc-only[3.53.2]     393.3008 (1.01)     393.3008 (1.01)     393.3008 (1.01)     0.0000 (1.0)      393.3008 (1.01)     0.0000 (1.0)           0;0  2.5426 (0.99)          1           1
test_list-list-dvc-only[main]       388.8541 (1.0)      388.8541 (1.0)      388.8541 (1.0)      0.0000 (1.0)      388.8541 (1.0)      0.0000 (1.0)           0;0  2.5717 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 4 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.6106 (1.0)      2.6106 (1.0)      2.6106 (1.0)      0.0000 (1.0)      2.6106 (1.0)      0.0000 (1.0)           0;0  0.3831 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.6540 (1.02)     2.6540 (1.02)     2.6540 (1.02)     0.0000 (1.0)      2.6540 (1.02)     0.0000 (1.0)           0;0  0.3768 (0.98)          1           1
test_list-list-recursive[3.53.2]     2.7272 (1.04)     2.7272 (1.04)     2.7272 (1.04)     0.0000 (1.0)      2.7272 (1.04)     0.0000 (1.0)           0;0  0.3667 (0.96)          1           1
test_list-list-recursive[main]       2.7844 (1.07)     2.7844 (1.07)     2.7844 (1.07)     0.0000 (1.0)      2.7844 (1.07)     0.0000 (1.0)           0;0  0.3591 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     407.7295 (1.05)     407.7295 (1.05)     407.7295 (1.05)     0.0000 (1.0)      407.7295 (1.05)     0.0000 (1.0)           0;0  2.4526 (0.95)          1           1
test_list-list-shallow[3.10.0]     408.1428 (1.05)     408.1428 (1.05)     408.1428 (1.05)     0.0000 (1.0)      408.1428 (1.05)     0.0000 (1.0)           0;0  2.4501 (0.95)          1           1
test_list-list-shallow[3.53.2]     387.2021 (1.0)      387.2021 (1.0)      387.2021 (1.0)      0.0000 (1.0)      387.2021 (1.0)      0.0000 (1.0)           0;0  2.5826 (1.0)           1           1
test_list-list-shallow[main]       388.6165 (1.00)     388.6165 (1.00)     388.6165 (1.00)     0.0000 (1.0)      388.6165 (1.00)     0.0000 (1.0)           0;0  2.5732 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     12.8459 (2.78)     12.8459 (2.78)     12.8459 (2.78)     0.0000 (1.0)      12.8459 (2.78)     0.0000 (1.0)           0;0  0.0778 (0.36)          1           1
test_partial_add-add[3.10.0]     13.2385 (2.87)     13.2385 (2.87)     13.2385 (2.87)     0.0000 (1.0)      13.2385 (2.87)     0.0000 (1.0)           0;0  0.0755 (0.35)          1           1
test_partial_add-add[3.53.2]     11.7840 (2.55)     11.7840 (2.55)     11.7840 (2.55)     0.0000 (1.0)      11.7840 (2.55)     0.0000 (1.0)           0;0  0.0849 (0.39)          1           1
test_partial_add-add[main]        4.6138 (1.0)       4.6138 (1.0)       4.6138 (1.0)      0.0000 (1.0)       4.6138 (1.0)      0.0000 (1.0)           0;0  0.2167 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 4 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     86.9648 (4.21)     86.9648 (4.21)     86.9648 (4.21)     0.0000 (1.0)      86.9648 (4.21)     0.0000 (1.0)           0;0  0.0115 (0.24)          1           1
test_partial_add-add-partial[3.10.0]     87.5131 (4.23)     87.5131 (4.23)     87.5131 (4.23)     0.0000 (1.0)      87.5131 (4.23)     0.0000 (1.0)           0;0  0.0114 (0.24)          1           1
test_partial_add-add-partial[3.53.2]     79.8545 (3.86)     79.8545 (3.86)     79.8545 (3.86)     0.0000 (1.0)      79.8545 (3.86)     0.0000 (1.0)           0;0  0.0125 (0.26)          1           1
test_partial_add-add-partial[main]       20.6729 (1.0)      20.6729 (1.0)      20.6729 (1.0)      0.0000 (1.0)      20.6729 (1.0)      0.0000 (1.0)           0;0  0.0484 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.8572 (1.0)      4.8572 (1.0)      4.8572 (1.0)      0.0000 (1.0)      4.8572 (1.0)      0.0000 (1.0)           0;0  0.2059 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     6.3319 (1.30)     6.3319 (1.30)     6.3319 (1.30)     0.0000 (1.0)      6.3319 (1.30)     0.0000 (1.0)           0;0  0.1579 (0.77)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     6.9872 (1.44)     6.9872 (1.44)     6.9872 (1.44)     0.0000 (1.0)      6.9872 (1.44)     0.0000 (1.0)           0;0  0.1431 (0.70)          1           1
test_partial_add-gc-cloud-noop[main]       7.0268 (1.45)     7.0268 (1.45)     7.0268 (1.45)     0.0000 (1.0)      7.0268 (1.45)     0.0000 (1.0)           0;0  0.1423 (0.69)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.5207 (1.0)      2.5207 (1.0)      2.5207 (1.0)      0.0000 (1.0)      2.5207 (1.0)      0.0000 (1.0)           0;0  0.3967 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.8235 (1.52)     3.8235 (1.52)     3.8235 (1.52)     0.0000 (1.0)      3.8235 (1.52)     0.0000 (1.0)           0;0  0.2615 (0.66)          1           1
test_partial_add-gc-noop[3.53.2]     3.8136 (1.51)     3.8136 (1.51)     3.8136 (1.51)     0.0000 (1.0)      3.8136 (1.51)     0.0000 (1.0)           0;0  0.2622 (0.66)          1           1
test_partial_add-gc-noop[main]       3.9022 (1.55)     3.9022 (1.55)     3.9022 (1.55)     0.0000 (1.0)      3.9022 (1.55)     0.0000 (1.0)           0;0  0.2563 (0.65)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-push': 4 tests ------------------------------------------------------------------------
Name (time in s)                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     7.7377 (2.09)     7.7377 (2.09)     7.7377 (2.09)     0.0000 (1.0)      7.7377 (2.09)     0.0000 (1.0)           0;0  0.1292 (0.48)          1           1
test_partial_add-push[3.10.0]     7.0321 (1.90)     7.0321 (1.90)     7.0321 (1.90)     0.0000 (1.0)      7.0321 (1.90)     0.0000 (1.0)           0;0  0.1422 (0.53)          1           1
test_partial_add-push[3.53.2]     3.7643 (1.02)     3.7643 (1.02)     3.7643 (1.02)     0.0000 (1.0)      3.7643 (1.02)     0.0000 (1.0)           0;0  0.2657 (0.98)          1           1
test_partial_add-push[main]       3.6942 (1.0)      3.6942 (1.0)      3.6942 (1.0)      0.0000 (1.0)      3.6942 (1.0)      0.0000 (1.0)           0;0  0.2707 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 4 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     45.7808 (2.19)     45.7808 (2.19)     45.7808 (2.19)     0.0000 (1.0)      45.7808 (2.19)     0.0000 (1.0)           0;0  0.0218 (0.46)          1           1
test_partial_add-push-partial[3.10.0]     40.9065 (1.96)     40.9065 (1.96)     40.9065 (1.96)     0.0000 (1.0)      40.9065 (1.96)     0.0000 (1.0)           0;0  0.0244 (0.51)          1           1
test_partial_add-push-partial[3.53.2]     21.1968 (1.02)     21.1968 (1.02)     21.1968 (1.02)     0.0000 (1.0)      21.1968 (1.02)     0.0000 (1.0)           0;0  0.0472 (0.98)          1           1
test_partial_add-push-partial[main]       20.8770 (1.0)      20.8770 (1.0)      20.8770 (1.0)      0.0000 (1.0)      20.8770 (1.0)      0.0000 (1.0)           0;0  0.0479 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     91.7180 (3.90)     91.7180 (3.90)     91.7180 (3.90)     0.0000 (1.0)      91.7180 (3.90)     0.0000 (1.0)           0;0  0.0109 (0.26)          1           1
test_partial_remove-add[3.10.0]     92.4731 (3.93)     92.4731 (3.93)     92.4731 (3.93)     0.0000 (1.0)      92.4731 (3.93)     0.0000 (1.0)           0;0  0.0108 (0.25)          1           1
test_partial_remove-add[3.53.2]     83.5899 (3.56)     83.5899 (3.56)     83.5899 (3.56)     0.0000 (1.0)      83.5899 (3.56)     0.0000 (1.0)           0;0  0.0120 (0.28)          1           1
test_partial_remove-add[main]       23.5085 (1.0)      23.5085 (1.0)      23.5085 (1.0)      0.0000 (1.0)      23.5085 (1.0)      0.0000 (1.0)           0;0  0.0425 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add-update': 4 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     51.4419 (13.56)    51.4419 (13.56)    51.4419 (13.56)    0.0000 (1.0)      51.4419 (13.56)    0.0000 (1.0)           0;0  0.0194 (0.07)          1           1
test_partial_remove-add-update[3.10.0]     51.7654 (13.65)    51.7654 (13.65)    51.7654 (13.65)    0.0000 (1.0)      51.7654 (13.65)    0.0000 (1.0)           0;0  0.0193 (0.07)          1           1
test_partial_remove-add-update[3.53.2]     46.7524 (12.33)    46.7524 (12.33)    46.7524 (12.33)    0.0000 (1.0)      46.7524 (12.33)    0.0000 (1.0)           0;0  0.0214 (0.08)          1           1
test_partial_remove-add-update[main]        3.7928 (1.0)       3.7928 (1.0)       3.7928 (1.0)      0.0000 (1.0)       3.7928 (1.0)      0.0000 (1.0)           0;0  0.2637 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     2.5357 (1.0)      2.5357 (1.0)      2.5357 (1.0)      0.0000 (1.0)      2.5357 (1.0)      0.0000 (1.0)           0;0  0.3944 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.6699 (1.45)     3.6699 (1.45)     3.6699 (1.45)     0.0000 (1.0)      3.6699 (1.45)     0.0000 (1.0)           0;0  0.2725 (0.69)          1           1
test_partial_remove-gc[3.53.2]     3.6765 (1.45)     3.6765 (1.45)     3.6765 (1.45)     0.0000 (1.0)      3.6765 (1.45)     0.0000 (1.0)           0;0  0.2720 (0.69)          1           1
test_partial_remove-gc[main]       3.6704 (1.45)     3.6704 (1.45)     3.6704 (1.45)     0.0000 (1.0)      3.6704 (1.45)     0.0000 (1.0)           0;0  0.2725 (0.69)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 4 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     4.8883 (1.0)      4.8883 (1.0)      4.8883 (1.0)      0.0000 (1.0)      4.8883 (1.0)      0.0000 (1.0)           0;0  0.2046 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     6.2473 (1.28)     6.2473 (1.28)     6.2473 (1.28)     0.0000 (1.0)      6.2473 (1.28)     0.0000 (1.0)           0;0  0.1601 (0.78)          1           1
test_partial_remove-gc-cloud[3.53.2]     6.8410 (1.40)     6.8410 (1.40)     6.8410 (1.40)     0.0000 (1.0)      6.8410 (1.40)     0.0000 (1.0)           0;0  0.1462 (0.71)          1           1
test_partial_remove-gc-cloud[main]       6.7052 (1.37)     6.7052 (1.37)     6.7052 (1.37)     0.0000 (1.0)      6.7052 (1.37)     0.0000 (1.0)           0;0  0.1491 (0.73)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     51.8020 (2.28)     51.8020 (2.28)     51.8020 (2.28)     0.0000 (1.0)      51.8020 (2.28)     0.0000 (1.0)           0;0  0.0193 (0.44)          1           1
test_partial_remove-push[3.10.0]     45.6047 (2.00)     45.6047 (2.00)     45.6047 (2.00)     0.0000 (1.0)      45.6047 (2.00)     0.0000 (1.0)           0;0  0.0219 (0.50)          1           1
test_partial_remove-push[3.53.2]     23.2163 (1.02)     23.2163 (1.02)     23.2163 (1.02)     0.0000 (1.0)      23.2163 (1.02)     0.0000 (1.0)           0;0  0.0431 (0.98)          1           1
test_partial_remove-push[main]       22.7668 (1.0)      22.7668 (1.0)      22.7668 (1.0)      0.0000 (1.0)      22.7668 (1.0)      0.0000 (1.0)           0;0  0.0439 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     3.9719 (1.0)      3.9719 (1.0)      3.9719 (1.0)      0.0000 (1.0)      3.9719 (1.0)      0.0000 (1.0)           0;0  0.2518 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     3.9974 (1.01)     3.9974 (1.01)     3.9974 (1.01)     0.0000 (1.0)      3.9974 (1.01)     0.0000 (1.0)           0;0  0.2502 (0.99)          1           1
test_partial_remove-push-update[3.53.2]     7.3180 (1.84)     7.3180 (1.84)     7.3180 (1.84)     0.0000 (1.0)      7.3180 (1.84)     0.0000 (1.0)           0;0  0.1366 (0.54)          1           1
test_partial_remove-push-update[main]       7.1142 (1.79)     7.1142 (1.79)     7.1142 (1.79)     0.0000 (1.0)      7.1142 (1.79)     0.0000 (1.0)           0;0  0.1406 (0.56)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 4 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     508.0081 (1.0)      514.5228 (1.0)      512.2422 (1.0)       2.6052 (1.0)      512.8958 (1.0)       3.3871 (1.0)           1;0  1.9522 (1.0)           5           3
test_plots-plots-diff[3.10.0]     902.6560 (1.78)     923.4863 (1.79)     910.4083 (1.78)      8.4184 (3.23)     910.7562 (1.78)     11.5834 (3.42)          1;0  1.0984 (0.56)          5           3
test_plots-plots-diff[3.53.2]     826.8282 (1.63)     861.8835 (1.68)     838.5111 (1.64)     13.9687 (5.36)     834.8033 (1.63)     16.4226 (4.85)          1;0  1.1926 (0.61)          5           3
test_plots-plots-diff[main]       825.4211 (1.62)     854.5123 (1.66)     841.7138 (1.64)     13.6623 (5.24)     846.5702 (1.65)     25.4243 (7.51)          1;0  1.1881 (0.61)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 4 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       527.9770 (1.0)        571.6328 (1.0)        544.1118 (1.0)      17.0841 (1.0)        541.5621 (1.0)      21.7403 (1.0)           1;0  1.8379 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,139.5212 (2.16)     1,180.4695 (2.07)     1,158.9312 (2.13)     19.2694 (1.13)     1,150.1425 (2.12)     35.0022 (1.61)          3;0  0.8629 (0.47)          5           3
test_plots-plots-diff-json[3.53.2]       897.0152 (1.70)       945.8623 (1.65)       913.9421 (1.68)     20.2555 (1.19)       908.3115 (1.68)     29.3207 (1.35)          1;0  1.0942 (0.60)          5           3
test_plots-plots-diff-json[main]         887.5314 (1.68)       945.1906 (1.65)       909.2165 (1.67)     22.8461 (1.34)       905.8654 (1.67)     31.2637 (1.44)          1;0  1.0998 (0.60)          5           3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 4 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     420.8598 (1.0)      443.6920 (1.0)      434.0096 (1.0)       9.1061 (1.30)     432.5465 (1.0)      13.2620 (1.41)          2;0  2.3041 (1.0)           5           3
test_plots-plots-show[3.10.0]     735.7223 (1.75)     751.5348 (1.69)     745.4748 (1.72)      7.5162 (1.07)     750.5120 (1.74)     12.6908 (1.35)          1;0  1.3414 (0.58)          5           3
test_plots-plots-show[3.53.2]     706.7273 (1.68)     724.4054 (1.63)     713.7085 (1.64)      6.9964 (1.0)      714.4173 (1.65)      9.4339 (1.0)           1;0  1.4011 (0.61)          5           3
test_plots-plots-show[main]       706.8370 (1.68)     779.1836 (1.76)     738.1862 (1.70)     30.1584 (4.31)     724.8894 (1.68)     47.9194 (5.08)          2;0  1.3547 (0.59)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 4 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     441.1049 (1.0)      483.5529 (1.0)      457.5062 (1.0)      17.2367 (3.15)     450.5129 (1.0)      25.1767 (4.74)          1;0  2.1858 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     878.4224 (1.99)     896.2271 (1.85)     883.5418 (1.93)      7.3517 (1.34)     879.9006 (1.95)      7.4712 (1.41)          1;0  1.1318 (0.52)          5           3
test_plots-plots-show-json[3.53.2]     747.0972 (1.69)     773.9246 (1.60)     759.2228 (1.66)     10.0525 (1.84)     757.3188 (1.68)     13.1750 (2.48)          2;0  1.3171 (0.60)          5           3
test_plots-plots-show-json[main]       756.9282 (1.72)     771.7831 (1.60)     765.8002 (1.67)      5.4728 (1.0)      767.1604 (1.70)      5.3148 (1.0)           2;0  1.3058 (0.60)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 4 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     52.1120 (2.37)     52.1120 (2.37)     52.1120 (2.37)     0.0000 (1.0)      52.1120 (2.37)     0.0000 (1.0)           0;0  0.0192 (0.42)          1           1
test_push-push[3.10.0]     46.5333 (2.12)     46.5333 (2.12)     46.5333 (2.12)     0.0000 (1.0)      46.5333 (2.12)     0.0000 (1.0)           0;0  0.0215 (0.47)          1           1
test_push-push[3.53.2]     22.5972 (1.03)     22.5972 (1.03)     22.5972 (1.03)     0.0000 (1.0)      22.5972 (1.03)     0.0000 (1.0)           0;0  0.0443 (0.97)          1           1
test_push-push[main]       21.9798 (1.0)      21.9798 (1.0)      21.9798 (1.0)      0.0000 (1.0)      21.9798 (1.0)      0.0000 (1.0)           0;0  0.0455 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 4 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     66.4524 (2.84)     66.4524 (2.84)     66.4524 (2.84)     0.0000 (1.0)      66.4524 (2.84)     0.0000 (1.0)           0;0  0.0150 (0.35)          1           1
test_sharing-fetch[3.10.0]     72.0884 (3.08)     72.0884 (3.08)     72.0884 (3.08)     0.0000 (1.0)      72.0884 (3.08)     0.0000 (1.0)           0;0  0.0139 (0.32)          1           1
test_sharing-fetch[3.53.2]     35.7258 (1.53)     35.7258 (1.53)     35.7258 (1.53)     0.0000 (1.0)      35.7258 (1.53)     0.0000 (1.0)           0;0  0.0280 (0.66)          1           1
test_sharing-fetch[main]       23.4210 (1.0)      23.4210 (1.0)      23.4210 (1.0)      0.0000 (1.0)      23.4210 (1.0)      0.0000 (1.0)           0;0  0.0427 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2602 (1.0)      1.2602 (1.0)      1.2602 (1.0)      0.0000 (1.0)      1.2602 (1.0)      0.0000 (1.0)           0;0  0.7935 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.6166 (2.87)     3.6166 (2.87)     3.6166 (2.87)     0.0000 (1.0)      3.6166 (2.87)     0.0000 (1.0)           0;0  0.2765 (0.35)          1           1
test_sharing-fetch-noop[3.53.2]     5.7856 (4.59)     5.7856 (4.59)     5.7856 (4.59)     0.0000 (1.0)      5.7856 (4.59)     0.0000 (1.0)           0;0  0.1728 (0.22)          1           1
test_sharing-fetch-noop[main]       5.9064 (4.69)     5.9064 (4.69)     5.9064 (4.69)     0.0000 (1.0)      5.9064 (4.69)     0.0000 (1.0)           0;0  0.1693 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     52.0647 (2.34)     52.0647 (2.34)     52.0647 (2.34)     0.0000 (1.0)      52.0647 (2.34)     0.0000 (1.0)           0;0  0.0192 (0.43)          1           1
test_sharing-push[3.10.0]     46.7084 (2.10)     46.7084 (2.10)     46.7084 (2.10)     0.0000 (1.0)      46.7084 (2.10)     0.0000 (1.0)           0;0  0.0214 (0.48)          1           1
test_sharing-push[3.53.2]     23.0496 (1.03)     23.0496 (1.03)     23.0496 (1.03)     0.0000 (1.0)      23.0496 (1.03)     0.0000 (1.0)           0;0  0.0434 (0.97)          1           1
test_sharing-push[main]       22.2760 (1.0)      22.2760 (1.0)      22.2760 (1.0)      0.0000 (1.0)      22.2760 (1.0)      0.0000 (1.0)           0;0  0.0449 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.0851 (1.0)      2.0851 (1.0)      2.0851 (1.0)      0.0000 (1.0)      2.0851 (1.0)      0.0000 (1.0)           0;0  0.4796 (1.0)           1           1
test_sharing-push-noop[3.10.0]     2.1625 (1.04)     2.1625 (1.04)     2.1625 (1.04)     0.0000 (1.0)      2.1625 (1.04)     0.0000 (1.0)           0;0  0.4624 (0.96)          1           1
test_sharing-push-noop[3.53.2]     5.9989 (2.88)     5.9989 (2.88)     5.9989 (2.88)     0.0000 (1.0)      5.9989 (2.88)     0.0000 (1.0)           0;0  0.1667 (0.35)          1           1
test_sharing-push-noop[main]       6.0661 (2.91)     6.0661 (2.91)     6.0661 (2.91)     0.0000 (1.0)      6.0661 (2.91)     0.0000 (1.0)           0;0  0.1649 (0.34)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 4 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     20.9562 (3.89)     20.9562 (3.89)     20.9562 (3.89)     0.0000 (1.0)      20.9562 (3.89)     0.0000 (1.0)           0;0  0.0477 (0.26)          1           1
test_status-status[3.10.0]     21.0864 (3.91)     21.0864 (3.91)     21.0864 (3.91)     0.0000 (1.0)      21.0864 (3.91)     0.0000 (1.0)           0;0  0.0474 (0.26)          1           1
test_status-status[3.53.2]     19.7755 (3.67)     19.7755 (3.67)     19.7755 (3.67)     0.0000 (1.0)      19.7755 (3.67)     0.0000 (1.0)           0;0  0.0506 (0.27)          1           1
test_status-status[main]        5.3892 (1.0)       5.3892 (1.0)       5.3892 (1.0)      0.0000 (1.0)       5.3892 (1.0)      0.0000 (1.0)           0;0  0.1856 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.6313 (1.69)     4.6313 (1.69)     4.6313 (1.69)     0.0000 (1.0)      4.6313 (1.69)     0.0000 (1.0)           0;0  0.2159 (0.59)          1           1
test_status-status-changed[3.10.0]     4.8948 (1.78)     4.8948 (1.78)     4.8948 (1.78)     0.0000 (1.0)      4.8948 (1.78)     0.0000 (1.0)           0;0  0.2043 (0.56)          1           1
test_status-status-changed[3.53.2]     4.7909 (1.74)     4.7909 (1.74)     4.7909 (1.74)     0.0000 (1.0)      4.7909 (1.74)     0.0000 (1.0)           0;0  0.2087 (0.57)          1           1
test_status-status-changed[main]       2.7471 (1.0)      2.7471 (1.0)      2.7471 (1.0)      0.0000 (1.0)      2.7471 (1.0)      0.0000 (1.0)           0;0  0.3640 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     4.7432 (1.81)     4.7432 (1.81)     4.7432 (1.81)     0.0000 (1.0)      4.7432 (1.81)     0.0000 (1.0)           0;0  0.2108 (0.55)          1           1
test_status-status-changed-noop[3.10.0]     4.8966 (1.86)     4.8966 (1.86)     4.8966 (1.86)     0.0000 (1.0)      4.8966 (1.86)     0.0000 (1.0)           0;0  0.2042 (0.54)          1           1
test_status-status-changed-noop[3.53.2]     4.7917 (1.82)     4.7917 (1.82)     4.7917 (1.82)     0.0000 (1.0)      4.7917 (1.82)     0.0000 (1.0)           0;0  0.2087 (0.55)          1           1
test_status-status-changed-noop[main]       2.6272 (1.0)      2.6272 (1.0)      2.6272 (1.0)      0.0000 (1.0)      2.6272 (1.0)      0.0000 (1.0)           0;0  0.3806 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     4.6724 (1.76)     4.6724 (1.76)     4.6724 (1.76)     0.0000 (1.0)      4.6724 (1.76)     0.0000 (1.0)           0;0  0.2140 (0.57)          1           1
test_status-status-noop[3.10.0]     4.8748 (1.84)     4.8748 (1.84)     4.8748 (1.84)     0.0000 (1.0)      4.8748 (1.84)     0.0000 (1.0)           0;0  0.2051 (0.54)          1           1
test_status-status-noop[3.53.2]     4.8446 (1.82)     4.8446 (1.82)     4.8446 (1.82)     0.0000 (1.0)      4.8446 (1.82)     0.0000 (1.0)           0;0  0.2064 (0.55)          1           1
test_status-status-noop[main]       2.6557 (1.0)      2.6557 (1.0)      2.6557 (1.0)      0.0000 (1.0)      2.6557 (1.0)      0.0000 (1.0)           0;0  0.3765 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 4 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     163.9082 (3.47)     163.9082 (3.47)     163.9082 (3.47)     0.0000 (1.0)      163.9082 (3.47)     0.0000 (1.0)           0;0  0.0061 (0.29)          1           1
test_update-import-url[3.10.0]     167.2294 (3.54)     167.2294 (3.54)     167.2294 (3.54)     0.0000 (1.0)      167.2294 (3.54)     0.0000 (1.0)           0;0  0.0060 (0.28)          1           1
test_update-import-url[3.53.2]     125.3250 (2.65)     125.3250 (2.65)     125.3250 (2.65)     0.0000 (1.0)      125.3250 (2.65)     0.0000 (1.0)           0;0  0.0080 (0.38)          1           1
test_update-import-url[main]        47.2465 (1.0)       47.2465 (1.0)       47.2465 (1.0)      0.0000 (1.0)       47.2465 (1.0)      0.0000 (1.0)           0;0  0.0212 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     142.7299 (3.98)     142.7299 (3.98)     142.7299 (3.98)     0.0000 (1.0)      142.7299 (3.98)     0.0000 (1.0)           0;0  0.0070 (0.25)          1           1
test_update-update[3.10.0]     149.6134 (4.17)     149.6134 (4.17)     149.6134 (4.17)     0.0000 (1.0)      149.6134 (4.17)     0.0000 (1.0)           0;0  0.0067 (0.24)          1           1
test_update-update[3.53.2]     113.8185 (3.17)     113.8185 (3.17)     113.8185 (3.17)     0.0000 (1.0)      113.8185 (3.17)     0.0000 (1.0)           0;0  0.0088 (0.32)          1           1
test_update-update[main]        35.8563 (1.0)       35.8563 (1.0)       35.8563 (1.0)      0.0000 (1.0)       35.8563 (1.0)      0.0000 (1.0)           0;0  0.0279 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     15.9046 (2.02)     15.9046 (2.02)     15.9046 (2.02)     0.0000 (1.0)      15.9046 (2.02)     0.0000 (1.0)           0;0  0.0629 (0.50)          1           1
test_update-update-noop[3.10.0]     17.1599 (2.17)     17.1599 (2.17)     17.1599 (2.17)     0.0000 (1.0)      17.1599 (2.17)     0.0000 (1.0)           0;0  0.0583 (0.46)          1           1
test_update-update-noop[3.53.2]     16.1701 (2.05)     16.1701 (2.05)     16.1701 (2.05)     0.0000 (1.0)      16.1701 (2.05)     0.0000 (1.0)           0;0  0.0618 (0.49)          1           1
test_update-update-noop[main]        7.8910 (1.0)       7.8910 (1.0)       7.8910 (1.0)      0.0000 (1.0)       7.8910 (1.0)      0.0000 (1.0)           0;0  0.1267 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean