Thu Nov  6 00:53:08 UTC 2025
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     60.5601 (4.29)     60.5601 (4.29)     60.5601 (4.29)     0.0000 (1.0)      60.5601 (4.29)     0.0000 (1.0)           0;0  0.0165 (0.23)          1           1
test_add_copy-add[3.10.0]     61.2001 (4.34)     61.2001 (4.34)     61.2001 (4.34)     0.0000 (1.0)      61.2001 (4.34)     0.0000 (1.0)           0;0  0.0163 (0.23)          1           1
test_add_copy-add[3.53.2]     54.6241 (3.87)     54.6241 (3.87)     54.6241 (3.87)     0.0000 (1.0)      54.6241 (3.87)     0.0000 (1.0)           0;0  0.0183 (0.26)          1           1
test_add_copy-add[3.60.1]     14.1052 (1.0)      14.1052 (1.0)      14.1052 (1.0)      0.0000 (1.0)      14.1052 (1.0)      0.0000 (1.0)           0;0  0.0709 (1.0)           1           1
test_add_copy-add[main]       15.1799 (1.08)     15.1799 (1.08)     15.1799 (1.08)     0.0000 (1.0)      15.1799 (1.08)     0.0000 (1.0)           0;0  0.0659 (0.93)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     21.4676 (5.82)     21.4676 (5.82)     21.4676 (5.82)     0.0000 (1.0)      21.4676 (5.82)     0.0000 (1.0)           0;0  0.0466 (0.17)          1           1
test_add_copy-add-noop[3.10.0]     21.5702 (5.85)     21.5702 (5.85)     21.5702 (5.85)     0.0000 (1.0)      21.5702 (5.85)     0.0000 (1.0)           0;0  0.0464 (0.17)          1           1
test_add_copy-add-noop[3.53.2]     20.7260 (5.62)     20.7260 (5.62)     20.7260 (5.62)     0.0000 (1.0)      20.7260 (5.62)     0.0000 (1.0)           0;0  0.0482 (0.18)          1           1
test_add_copy-add-noop[3.60.1]      3.6898 (1.0)       3.6898 (1.0)       3.6898 (1.0)      0.0000 (1.0)       3.6898 (1.0)      0.0000 (1.0)           0;0  0.2710 (1.0)           1           1
test_add_copy-add-noop[main]        3.7877 (1.03)      3.7877 (1.03)      3.7877 (1.03)     0.0000 (1.0)       3.7877 (1.03)     0.0000 (1.0)           0;0  0.2640 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     64.7578 (4.13)     64.7578 (4.13)     64.7578 (4.13)     0.0000 (1.0)      64.7578 (4.13)     0.0000 (1.0)           0;0  0.0154 (0.24)          1           1
test_add_hardlink-add[3.10.0]     66.1758 (4.22)     66.1758 (4.22)     66.1758 (4.22)     0.0000 (1.0)      66.1758 (4.22)     0.0000 (1.0)           0;0  0.0151 (0.24)          1           1
test_add_hardlink-add[3.53.2]     60.6569 (3.87)     60.6569 (3.87)     60.6569 (3.87)     0.0000 (1.0)      60.6569 (3.87)     0.0000 (1.0)           0;0  0.0165 (0.26)          1           1
test_add_hardlink-add[3.60.1]     15.6761 (1.0)      15.6761 (1.0)      15.6761 (1.0)      0.0000 (1.0)      15.6761 (1.0)      0.0000 (1.0)           0;0  0.0638 (1.0)           1           1
test_add_hardlink-add[main]       16.7855 (1.07)     16.7855 (1.07)     16.7855 (1.07)     0.0000 (1.0)      16.7855 (1.07)     0.0000 (1.0)           0;0  0.0596 (0.93)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     33.7372 (8.09)     33.7372 (8.09)     33.7372 (8.09)     0.0000 (1.0)      33.7372 (8.09)     0.0000 (1.0)           0;0  0.0296 (0.12)          1           1
test_add_hardlink-add-noop[3.10.0]     34.2311 (8.20)     34.2311 (8.20)     34.2311 (8.20)     0.0000 (1.0)      34.2311 (8.20)     0.0000 (1.0)           0;0  0.0292 (0.12)          1           1
test_add_hardlink-add-noop[3.53.2]     32.2345 (7.73)     32.2345 (7.73)     32.2345 (7.73)     0.0000 (1.0)      32.2345 (7.73)     0.0000 (1.0)           0;0  0.0310 (0.13)          1           1
test_add_hardlink-add-noop[3.60.1]      4.1726 (1.0)       4.1726 (1.0)       4.1726 (1.0)      0.0000 (1.0)       4.1726 (1.0)      0.0000 (1.0)           0;0  0.2397 (1.0)           1           1
test_add_hardlink-add-noop[main]        4.3773 (1.05)      4.3773 (1.05)      4.3773 (1.05)     0.0000 (1.0)       4.3773 (1.05)     0.0000 (1.0)           0;0  0.2285 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     69.4013 (2.04)     69.4013 (2.04)     69.4013 (2.04)     0.0000 (1.0)      69.4013 (2.04)     0.0000 (1.0)           0;0  0.0144 (0.49)          1           1
test_add_symlink-add[3.10.0]     69.7440 (2.05)     69.7440 (2.05)     69.7440 (2.05)     0.0000 (1.0)      69.7440 (2.05)     0.0000 (1.0)           0;0  0.0143 (0.49)          1           1
test_add_symlink-add[3.53.2]     64.7677 (1.90)     64.7677 (1.90)     64.7677 (1.90)     0.0000 (1.0)      64.7677 (1.90)     0.0000 (1.0)           0;0  0.0154 (0.53)          1           1
test_add_symlink-add[3.60.1]     34.0767 (1.0)      34.0767 (1.0)      34.0767 (1.0)      0.0000 (1.0)      34.0767 (1.0)      0.0000 (1.0)           0;0  0.0293 (1.0)           1           1
test_add_symlink-add[main]       36.8492 (1.08)     36.8492 (1.08)     36.8492 (1.08)     0.0000 (1.0)      36.8492 (1.08)     0.0000 (1.0)           0;0  0.0271 (0.92)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     46.1385 (8.36)     46.1385 (8.36)     46.1385 (8.36)     0.0000 (1.0)      46.1385 (8.36)     0.0000 (1.0)           0;0  0.0217 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     47.0085 (8.52)     47.0085 (8.52)     47.0085 (8.52)     0.0000 (1.0)      47.0085 (8.52)     0.0000 (1.0)           0;0  0.0213 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     45.8058 (8.30)     45.8058 (8.30)     45.8058 (8.30)     0.0000 (1.0)      45.8058 (8.30)     0.0000 (1.0)           0;0  0.0218 (0.12)          1           1
test_add_symlink-add-noop[3.60.1]      5.5185 (1.0)       5.5185 (1.0)       5.5185 (1.0)      0.0000 (1.0)       5.5185 (1.0)      0.0000 (1.0)           0;0  0.1812 (1.0)           1           1
test_add_symlink-add-noop[main]        5.5646 (1.01)      5.5646 (1.01)      5.5646 (1.01)     0.0000 (1.0)       5.5646 (1.01)     0.0000 (1.0)           0;0  0.1797 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     40.5582 (1.92)     40.5582 (1.92)     40.5582 (1.92)     0.0000 (1.0)      40.5582 (1.92)     0.0000 (1.0)           0;0  0.0247 (0.52)          1           1
test_checkout_copy-checkout[3.10.0]     56.4676 (2.68)     56.4676 (2.68)     56.4676 (2.68)     0.0000 (1.0)      56.4676 (2.68)     0.0000 (1.0)           0;0  0.0177 (0.37)          1           1
test_checkout_copy-checkout[3.53.2]     28.5131 (1.35)     28.5131 (1.35)     28.5131 (1.35)     0.0000 (1.0)      28.5131 (1.35)     0.0000 (1.0)           0;0  0.0351 (0.74)          1           1
test_checkout_copy-checkout[3.60.1]     21.0788 (1.0)      21.0788 (1.0)      21.0788 (1.0)      0.0000 (1.0)      21.0788 (1.0)      0.0000 (1.0)           0;0  0.0474 (1.0)           1           1
test_checkout_copy-checkout[main]       22.2870 (1.06)     22.2870 (1.06)     22.2870 (1.06)     0.0000 (1.0)      22.2870 (1.06)     0.0000 (1.0)           0;0  0.0449 (0.95)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.6325 (1.71)     5.6325 (1.71)     5.6325 (1.71)     0.0000 (1.0)      5.6325 (1.71)     0.0000 (1.0)           0;0  0.1775 (0.58)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.9082 (1.80)     5.9082 (1.80)     5.9082 (1.80)     0.0000 (1.0)      5.9082 (1.80)     0.0000 (1.0)           0;0  0.1693 (0.56)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.8352 (1.77)     5.8352 (1.77)     5.8352 (1.77)     0.0000 (1.0)      5.8352 (1.77)     0.0000 (1.0)           0;0  0.1714 (0.56)          1           1
test_checkout_copy-checkout-noop[3.60.1]     3.2882 (1.0)      3.2882 (1.0)      3.2882 (1.0)      0.0000 (1.0)      3.2882 (1.0)      0.0000 (1.0)           0;0  0.3041 (1.0)           1           1
test_checkout_copy-checkout-noop[main]       3.6191 (1.10)     3.6191 (1.10)     3.6191 (1.10)     0.0000 (1.0)      3.6191 (1.10)     0.0000 (1.0)           0;0  0.2763 (0.91)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     7.9276 (1.98)     7.9276 (1.98)     7.9276 (1.98)     0.0000 (1.0)      7.9276 (1.98)     0.0000 (1.0)           0;0  0.1261 (0.50)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.6967 (1.67)     6.6967 (1.67)     6.6967 (1.67)     0.0000 (1.0)      6.6967 (1.67)     0.0000 (1.0)           0;0  0.1493 (0.60)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.5273 (1.63)     6.5273 (1.63)     6.5273 (1.63)     0.0000 (1.0)      6.5273 (1.63)     0.0000 (1.0)           0;0  0.1532 (0.61)          1           1
test_checkout_copy-checkout-update[3.60.1]     4.0013 (1.0)      4.0013 (1.0)      4.0013 (1.0)      0.0000 (1.0)      4.0013 (1.0)      0.0000 (1.0)           0;0  0.2499 (1.0)           1           1
test_checkout_copy-checkout-update[main]       4.5080 (1.13)     4.5080 (1.13)     4.5080 (1.13)     0.0000 (1.0)      4.5080 (1.13)     0.0000 (1.0)           0;0  0.2218 (0.89)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     20.6903 (2.78)     20.6903 (2.78)     20.6903 (2.78)     0.0000 (1.0)      20.6903 (2.78)     0.0000 (1.0)           0;0  0.0483 (0.36)          1           1
test_checkout_hardlink-checkout[3.10.0]     15.4873 (2.08)     15.4873 (2.08)     15.4873 (2.08)     0.0000 (1.0)      15.4873 (2.08)     0.0000 (1.0)           0;0  0.0646 (0.48)          1           1
test_checkout_hardlink-checkout[3.53.2]     14.0408 (1.89)     14.0408 (1.89)     14.0408 (1.89)     0.0000 (1.0)      14.0408 (1.89)     0.0000 (1.0)           0;0  0.0712 (0.53)          1           1
test_checkout_hardlink-checkout[3.60.1]      7.4375 (1.0)       7.4375 (1.0)       7.4375 (1.0)      0.0000 (1.0)       7.4375 (1.0)      0.0000 (1.0)           0;0  0.1345 (1.0)           1           1
test_checkout_hardlink-checkout[main]        8.4125 (1.13)      8.4125 (1.13)      8.4125 (1.13)     0.0000 (1.0)       8.4125 (1.13)     0.0000 (1.0)           0;0  0.1189 (0.88)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.5898 (1.72)     5.5898 (1.72)     5.5898 (1.72)     0.0000 (1.0)      5.5898 (1.72)     0.0000 (1.0)           0;0  0.1789 (0.58)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.6800 (1.75)     5.6800 (1.75)     5.6800 (1.75)     0.0000 (1.0)      5.6800 (1.75)     0.0000 (1.0)           0;0  0.1761 (0.57)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.5192 (1.70)     5.5192 (1.70)     5.5192 (1.70)     0.0000 (1.0)      5.5192 (1.70)     0.0000 (1.0)           0;0  0.1812 (0.59)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.2528 (1.0)      3.2528 (1.0)      3.2528 (1.0)      0.0000 (1.0)      3.2528 (1.0)      0.0000 (1.0)           0;0  0.3074 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]       3.4321 (1.06)     3.4321 (1.06)     3.4321 (1.06)     0.0000 (1.0)      3.4321 (1.06)     0.0000 (1.0)           0;0  0.2914 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     7.8380 (2.02)     7.8380 (2.02)     7.8380 (2.02)     0.0000 (1.0)      7.8380 (2.02)     0.0000 (1.0)           0;0  0.1276 (0.49)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.3760 (1.65)     6.3760 (1.65)     6.3760 (1.65)     0.0000 (1.0)      6.3760 (1.65)     0.0000 (1.0)           0;0  0.1568 (0.61)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.3664 (1.64)     6.3664 (1.64)     6.3664 (1.64)     0.0000 (1.0)      6.3664 (1.64)     0.0000 (1.0)           0;0  0.1571 (0.61)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     3.8737 (1.0)      3.8737 (1.0)      3.8737 (1.0)      0.0000 (1.0)      3.8737 (1.0)      0.0000 (1.0)           0;0  0.2581 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       4.3470 (1.12)     4.3470 (1.12)     4.3470 (1.12)     0.0000 (1.0)      4.3470 (1.12)     0.0000 (1.0)           0;0  0.2300 (0.89)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     23.0347 (2.22)     23.0347 (2.22)     23.0347 (2.22)     0.0000 (1.0)      23.0347 (2.22)     0.0000 (1.0)           0;0  0.0434 (0.45)          1           1
test_checkout_symlink-checkout[3.10.0]     17.4056 (1.68)     17.4056 (1.68)     17.4056 (1.68)     0.0000 (1.0)      17.4056 (1.68)     0.0000 (1.0)           0;0  0.0575 (0.60)          1           1
test_checkout_symlink-checkout[3.53.2]     15.8887 (1.53)     15.8887 (1.53)     15.8887 (1.53)     0.0000 (1.0)      15.8887 (1.53)     0.0000 (1.0)           0;0  0.0629 (0.65)          1           1
test_checkout_symlink-checkout[3.60.1]     10.3850 (1.0)      10.3850 (1.0)      10.3850 (1.0)      0.0000 (1.0)      10.3850 (1.0)      0.0000 (1.0)           0;0  0.0963 (1.0)           1           1
test_checkout_symlink-checkout[main]       11.7256 (1.13)     11.7256 (1.13)     11.7256 (1.13)     0.0000 (1.0)      11.7256 (1.13)     0.0000 (1.0)           0;0  0.0853 (0.89)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     5.7665 (1.31)     5.7665 (1.31)     5.7665 (1.31)     0.0000 (1.0)      5.7665 (1.31)     0.0000 (1.0)           0;0  0.1734 (0.76)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     5.6799 (1.29)     5.6799 (1.29)     5.6799 (1.29)     0.0000 (1.0)      5.6799 (1.29)     0.0000 (1.0)           0;0  0.1761 (0.77)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     5.5332 (1.26)     5.5332 (1.26)     5.5332 (1.26)     0.0000 (1.0)      5.5332 (1.26)     0.0000 (1.0)           0;0  0.1807 (0.79)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     4.3879 (1.0)      4.3879 (1.0)      4.3879 (1.0)      0.0000 (1.0)      4.3879 (1.0)      0.0000 (1.0)           0;0  0.2279 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]       4.6858 (1.07)     4.6858 (1.07)     4.6858 (1.07)     0.0000 (1.0)      4.6858 (1.07)     0.0000 (1.0)           0;0  0.2134 (0.94)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     9.2573 (1.53)     9.2573 (1.53)     9.2573 (1.53)     0.0000 (1.0)      9.2573 (1.53)     0.0000 (1.0)           0;0  0.1080 (0.65)          1           1
test_checkout_symlink-checkout-update[3.10.0]     7.5501 (1.25)     7.5501 (1.25)     7.5501 (1.25)     0.0000 (1.0)      7.5501 (1.25)     0.0000 (1.0)           0;0  0.1324 (0.80)          1           1
test_checkout_symlink-checkout-update[3.53.2]     7.5296 (1.24)     7.5296 (1.24)     7.5296 (1.24)     0.0000 (1.0)      7.5296 (1.24)     0.0000 (1.0)           0;0  0.1328 (0.80)          1           1
test_checkout_symlink-checkout-update[3.60.1]     6.0604 (1.0)      6.0604 (1.0)      6.0604 (1.0)      0.0000 (1.0)      6.0604 (1.0)      0.0000 (1.0)           0;0  0.1650 (1.0)           1           1
test_checkout_symlink-checkout-update[main]       6.6927 (1.10)     6.6927 (1.10)     6.6927 (1.10)     0.0000 (1.0)      6.6927 (1.10)     0.0000 (1.0)           0;0  0.1494 (0.91)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.0296 (1.74)     4.0296 (1.74)     4.0296 (1.74)     0.0000 (1.0)      4.0296 (1.74)     0.0000 (1.0)           0;0  0.2482 (0.58)          1           1
test_data_status-data-changed[3.10.0]     4.7073 (2.03)     4.7073 (2.03)     4.7073 (2.03)     0.0000 (1.0)      4.7073 (2.03)     0.0000 (1.0)           0;0  0.2124 (0.49)          1           1
test_data_status-data-changed[3.53.2]     4.5986 (1.98)     4.5986 (1.98)     4.5986 (1.98)     0.0000 (1.0)      4.5986 (1.98)     0.0000 (1.0)           0;0  0.2175 (0.50)          1           1
test_data_status-data-changed[3.60.1]     2.3216 (1.0)      2.3216 (1.0)      2.3216 (1.0)      0.0000 (1.0)      2.3216 (1.0)      0.0000 (1.0)           0;0  0.4307 (1.0)           1           1
test_data_status-data-changed[main]       2.5544 (1.10)     2.5544 (1.10)     2.5544 (1.10)     0.0000 (1.0)      2.5544 (1.10)     0.0000 (1.0)           0;0  0.3915 (0.91)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.0686 (1.76)     4.0686 (1.76)     4.0686 (1.76)     0.0000 (1.0)      4.0686 (1.76)     0.0000 (1.0)           0;0  0.2458 (0.57)          1           1
test_data_status-data-changed-noop[3.10.0]     4.8252 (2.08)     4.8252 (2.08)     4.8252 (2.08)     0.0000 (1.0)      4.8252 (2.08)     0.0000 (1.0)           0;0  0.2072 (0.48)          1           1
test_data_status-data-changed-noop[3.53.2]     4.7441 (2.05)     4.7441 (2.05)     4.7441 (2.05)     0.0000 (1.0)      4.7441 (2.05)     0.0000 (1.0)           0;0  0.2108 (0.49)          1           1
test_data_status-data-changed-noop[3.60.1]     2.3165 (1.0)      2.3165 (1.0)      2.3165 (1.0)      0.0000 (1.0)      2.3165 (1.0)      0.0000 (1.0)           0;0  0.4317 (1.0)           1           1
test_data_status-data-changed-noop[main]       2.5655 (1.11)     2.5655 (1.11)     2.5655 (1.11)     0.0000 (1.0)      2.5655 (1.11)     0.0000 (1.0)           0;0  0.3898 (0.90)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     18.2575 (3.81)     18.2575 (3.81)     18.2575 (3.81)     0.0000 (1.0)      18.2575 (3.81)     0.0000 (1.0)           0;0  0.0548 (0.26)          1           1
test_data_status-data-new[3.10.0]     19.1113 (3.98)     19.1113 (3.98)     19.1113 (3.98)     0.0000 (1.0)      19.1113 (3.98)     0.0000 (1.0)           0;0  0.0523 (0.25)          1           1
test_data_status-data-new[3.53.2]     18.4912 (3.86)     18.4912 (3.86)     18.4912 (3.86)     0.0000 (1.0)      18.4912 (3.86)     0.0000 (1.0)           0;0  0.0541 (0.26)          1           1
test_data_status-data-new[3.60.1]      4.7964 (1.0)       4.7964 (1.0)       4.7964 (1.0)      0.0000 (1.0)       4.7964 (1.0)      0.0000 (1.0)           0;0  0.2085 (1.0)           1           1
test_data_status-data-new[main]        5.1212 (1.07)      5.1212 (1.07)      5.1212 (1.07)     0.0000 (1.0)       5.1212 (1.07)     0.0000 (1.0)           0;0  0.1953 (0.94)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.1999 (1.83)     4.1999 (1.83)     4.1999 (1.83)     0.0000 (1.0)      4.1999 (1.83)     0.0000 (1.0)           0;0  0.2381 (0.55)          1           1
test_data_status-data-noop[3.10.0]     4.8264 (2.10)     4.8264 (2.10)     4.8264 (2.10)     0.0000 (1.0)      4.8264 (2.10)     0.0000 (1.0)           0;0  0.2072 (0.48)          1           1
test_data_status-data-noop[3.53.2]     4.6863 (2.04)     4.6863 (2.04)     4.6863 (2.04)     0.0000 (1.0)      4.6863 (2.04)     0.0000 (1.0)           0;0  0.2134 (0.49)          1           1
test_data_status-data-noop[3.60.1]     2.2936 (1.0)      2.2936 (1.0)      2.2936 (1.0)      0.0000 (1.0)      2.2936 (1.0)      0.0000 (1.0)           0;0  0.4360 (1.0)           1           1
test_data_status-data-noop[main]       2.6359 (1.15)     2.6359 (1.15)     2.6359 (1.15)     0.0000 (1.0)      2.6359 (1.15)     0.0000 (1.0)           0;0  0.3794 (0.87)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     7.1167 (1.31)     7.1167 (1.31)     7.1167 (1.31)     0.0000 (1.0)      7.1167 (1.31)     0.0000 (1.0)           0;0  0.1405 (0.76)          1           1
test_data_status_all_flags-data-changed[3.10.0]     7.6416 (1.41)     7.6416 (1.41)     7.6416 (1.41)     0.0000 (1.0)      7.6416 (1.41)     0.0000 (1.0)           0;0  0.1309 (0.71)          1           1
test_data_status_all_flags-data-changed[3.53.2]     7.9343 (1.47)     7.9343 (1.47)     7.9343 (1.47)     0.0000 (1.0)      7.9343 (1.47)     0.0000 (1.0)           0;0  0.1260 (0.68)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.4146 (1.0)      5.4146 (1.0)      5.4146 (1.0)      0.0000 (1.0)      5.4146 (1.0)      0.0000 (1.0)           0;0  0.1847 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       5.8652 (1.08)     5.8652 (1.08)     5.8652 (1.08)     0.0000 (1.0)      5.8652 (1.08)     0.0000 (1.0)           0;0  0.1705 (0.92)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     6.9622 (1.26)     6.9622 (1.26)     6.9622 (1.26)     0.0000 (1.0)      6.9622 (1.26)     0.0000 (1.0)           0;0  0.1436 (0.79)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     7.8553 (1.42)     7.8553 (1.42)     7.8553 (1.42)     0.0000 (1.0)      7.8553 (1.42)     0.0000 (1.0)           0;0  0.1273 (0.70)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     7.7082 (1.39)     7.7082 (1.39)     7.7082 (1.39)     0.0000 (1.0)      7.7082 (1.39)     0.0000 (1.0)           0;0  0.1297 (0.72)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     5.5269 (1.0)      5.5269 (1.0)      5.5269 (1.0)      0.0000 (1.0)      5.5269 (1.0)      0.0000 (1.0)           0;0  0.1809 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       5.8287 (1.05)     5.8287 (1.05)     5.8287 (1.05)     0.0000 (1.0)      5.8287 (1.05)     0.0000 (1.0)           0;0  0.1716 (0.95)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     21.6448 (2.69)     21.6448 (2.69)     21.6448 (2.69)     0.0000 (1.0)      21.6448 (2.69)     0.0000 (1.0)           0;0  0.0462 (0.37)          1           1
test_data_status_all_flags-data-new[3.10.0]     22.2660 (2.76)     22.2660 (2.76)     22.2660 (2.76)     0.0000 (1.0)      22.2660 (2.76)     0.0000 (1.0)           0;0  0.0449 (0.36)          1           1
test_data_status_all_flags-data-new[3.53.2]     22.0116 (2.73)     22.0116 (2.73)     22.0116 (2.73)     0.0000 (1.0)      22.0116 (2.73)     0.0000 (1.0)           0;0  0.0454 (0.37)          1           1
test_data_status_all_flags-data-new[3.60.1]      8.0530 (1.0)       8.0530 (1.0)       8.0530 (1.0)      0.0000 (1.0)       8.0530 (1.0)      0.0000 (1.0)           0;0  0.1242 (1.0)           1           1
test_data_status_all_flags-data-new[main]        8.4085 (1.04)      8.4085 (1.04)      8.4085 (1.04)     0.0000 (1.0)       8.4085 (1.04)     0.0000 (1.0)           0;0  0.1189 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     6.4694 (1.35)     6.4694 (1.35)     6.4694 (1.35)     0.0000 (1.0)      6.4694 (1.35)     0.0000 (1.0)           0;0  0.1546 (0.74)          1           1
test_data_status_all_flags-data-noop[3.10.0]     7.1810 (1.50)     7.1810 (1.50)     7.1810 (1.50)     0.0000 (1.0)      7.1810 (1.50)     0.0000 (1.0)           0;0  0.1393 (0.67)          1           1
test_data_status_all_flags-data-noop[3.53.2]     7.1310 (1.49)     7.1310 (1.49)     7.1310 (1.49)     0.0000 (1.0)      7.1310 (1.49)     0.0000 (1.0)           0;0  0.1402 (0.67)          1           1
test_data_status_all_flags-data-noop[3.60.1]     4.7878 (1.0)      4.7878 (1.0)      4.7878 (1.0)      0.0000 (1.0)      4.7878 (1.0)      0.0000 (1.0)           0;0  0.2089 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       5.1125 (1.07)     5.1125 (1.07)     5.1125 (1.07)     0.0000 (1.0)      5.1125 (1.07)     0.0000 (1.0)           0;0  0.1956 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     17.9957 (2.66)     17.9957 (2.66)     17.9957 (2.66)     0.0000 (1.0)      17.9957 (2.66)     0.0000 (1.0)           0;0  0.0556 (0.38)          1           1
test_diff-diff[3.10.0]     18.9261 (2.80)     18.9261 (2.80)     18.9261 (2.80)     0.0000 (1.0)      18.9261 (2.80)     0.0000 (1.0)           0;0  0.0528 (0.36)          1           1
test_diff-diff[3.53.2]     18.8331 (2.78)     18.8331 (2.78)     18.8331 (2.78)     0.0000 (1.0)      18.8331 (2.78)     0.0000 (1.0)           0;0  0.0531 (0.36)          1           1
test_diff-diff[3.60.1]      6.7638 (1.0)       6.7638 (1.0)       6.7638 (1.0)      0.0000 (1.0)       6.7638 (1.0)      0.0000 (1.0)           0;0  0.1478 (1.0)           1           1
test_diff-diff[main]        7.7878 (1.15)      7.7878 (1.15)      7.7878 (1.15)     0.0000 (1.0)       7.7878 (1.15)     0.0000 (1.0)           0;0  0.1284 (0.87)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     6.0325 (1.81)     6.0325 (1.81)     6.0325 (1.81)     0.0000 (1.0)      6.0325 (1.81)     0.0000 (1.0)           0;0  0.1658 (0.55)          1           1
test_diff-diff-changed[3.10.0]     6.6967 (2.01)     6.6967 (2.01)     6.6967 (2.01)     0.0000 (1.0)      6.6967 (2.01)     0.0000 (1.0)           0;0  0.1493 (0.50)          1           1
test_diff-diff-changed[3.53.2]     5.8063 (1.74)     5.8063 (1.74)     5.8063 (1.74)     0.0000 (1.0)      5.8063 (1.74)     0.0000 (1.0)           0;0  0.1722 (0.57)          1           1
test_diff-diff-changed[3.60.1]     3.3380 (1.0)      3.3380 (1.0)      3.3380 (1.0)      0.0000 (1.0)      3.3380 (1.0)      0.0000 (1.0)           0;0  0.2996 (1.0)           1           1
test_diff-diff-changed[main]       4.1040 (1.23)     4.1040 (1.23)     4.1040 (1.23)     0.0000 (1.0)      4.1040 (1.23)     0.0000 (1.0)           0;0  0.2437 (0.81)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.2520 (1.59)     5.2520 (1.59)     5.2520 (1.59)     0.0000 (1.0)      5.2520 (1.59)     0.0000 (1.0)           0;0  0.1904 (0.63)          1           1
test_diff-diff-changed-noop[3.10.0]     5.7788 (1.75)     5.7788 (1.75)     5.7788 (1.75)     0.0000 (1.0)      5.7788 (1.75)     0.0000 (1.0)           0;0  0.1730 (0.57)          1           1
test_diff-diff-changed-noop[3.53.2]     5.6617 (1.71)     5.6617 (1.71)     5.6617 (1.71)     0.0000 (1.0)      5.6617 (1.71)     0.0000 (1.0)           0;0  0.1766 (0.58)          1           1
test_diff-diff-changed-noop[3.60.1]     3.3107 (1.0)      3.3107 (1.0)      3.3107 (1.0)      0.0000 (1.0)      3.3107 (1.0)      0.0000 (1.0)           0;0  0.3021 (1.0)           1           1
test_diff-diff-changed-noop[main]       4.2083 (1.27)     4.2083 (1.27)     4.2083 (1.27)     0.0000 (1.0)      4.2083 (1.27)     0.0000 (1.0)           0;0  0.2376 (0.79)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.1046 (1.23)     4.1046 (1.23)     4.1046 (1.23)     0.0000 (1.0)      4.1046 (1.23)     0.0000 (1.0)           0;0  0.2436 (0.81)          1           1
test_diff-diff-noop[3.10.0]     4.8825 (1.46)     4.8825 (1.46)     4.8825 (1.46)     0.0000 (1.0)      4.8825 (1.46)     0.0000 (1.0)           0;0  0.2048 (0.68)          1           1
test_diff-diff-noop[3.53.2]     5.6342 (1.69)     5.6342 (1.69)     5.6342 (1.69)     0.0000 (1.0)      5.6342 (1.69)     0.0000 (1.0)           0;0  0.1775 (0.59)          1           1
test_diff-diff-noop[3.60.1]     3.3387 (1.0)      3.3387 (1.0)      3.3387 (1.0)      0.0000 (1.0)      3.3387 (1.0)      0.0000 (1.0)           0;0  0.2995 (1.0)           1           1
test_diff-diff-noop[main]       4.2428 (1.27)     4.2428 (1.27)     4.2428 (1.27)     0.0000 (1.0)      4.2428 (1.27)     0.0000 (1.0)           0;0  0.2357 (0.79)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]      1.2785 (1.0)       1.2785 (1.0)       1.2785 (1.0)      0.0000 (1.0)       1.2785 (1.0)      0.0000 (1.0)           0;0  0.7821 (1.0)           1           1
test_exp_show-exp[3.10.0]     12.8038 (10.01)    12.8038 (10.01)    12.8038 (10.01)    0.0000 (1.0)      12.8038 (10.01)    0.0000 (1.0)           0;0  0.0781 (0.10)          1           1
test_exp_show-exp[3.53.2]      7.1140 (5.56)      7.1140 (5.56)      7.1140 (5.56)     0.0000 (1.0)       7.1140 (5.56)     0.0000 (1.0)           0;0  0.1406 (0.18)          1           1
test_exp_show-exp[3.60.1]      9.2932 (7.27)      9.2932 (7.27)      9.2932 (7.27)     0.0000 (1.0)       9.2932 (7.27)     0.0000 (1.0)           0;0  0.1076 (0.14)          1           1
test_exp_show-exp[main]       11.9775 (9.37)     11.9775 (9.37)     11.9775 (9.37)     0.0000 (1.0)      11.9775 (9.37)     0.0000 (1.0)           0;0  0.0835 (0.11)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     49.0042 (3.17)     49.0042 (3.17)     49.0042 (3.17)     0.0000 (1.0)      49.0042 (3.17)     0.0000 (1.0)           0;0  0.0204 (0.32)          1           1
test_fetch-fetch[3.10.0]     53.7035 (3.47)     53.7035 (3.47)     53.7035 (3.47)     0.0000 (1.0)      53.7035 (3.47)     0.0000 (1.0)           0;0  0.0186 (0.29)          1           1
test_fetch-fetch[3.53.2]     22.9182 (1.48)     22.9182 (1.48)     22.9182 (1.48)     0.0000 (1.0)      22.9182 (1.48)     0.0000 (1.0)           0;0  0.0436 (0.68)          1           1
test_fetch-fetch[3.60.1]     15.4771 (1.00)     15.4771 (1.00)     15.4771 (1.00)     0.0000 (1.0)      15.4771 (1.00)     0.0000 (1.0)           0;0  0.0646 (1.00)          1           1
test_fetch-fetch[main]       15.4732 (1.0)      15.4732 (1.0)      15.4732 (1.0)      0.0000 (1.0)      15.4732 (1.0)      0.0000 (1.0)           0;0  0.0646 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.9605 (1.0)      2.9605 (1.0)      2.9605 (1.0)      0.0000 (1.0)      2.9605 (1.0)      0.0000 (1.0)           0;0  0.3378 (1.0)           1           1
test_gc-gc[3.10.0]     3.0749 (1.04)     3.0749 (1.04)     3.0749 (1.04)     0.0000 (1.0)      3.0749 (1.04)     0.0000 (1.0)           0;0  0.3252 (0.96)          1           1
test_gc-gc[3.53.2]     2.9923 (1.01)     2.9923 (1.01)     2.9923 (1.01)     0.0000 (1.0)      2.9923 (1.01)     0.0000 (1.0)           0;0  0.3342 (0.99)          1           1
test_gc-gc[3.60.1]     2.9769 (1.01)     2.9769 (1.01)     2.9769 (1.01)     0.0000 (1.0)      2.9769 (1.01)     0.0000 (1.0)           0;0  0.3359 (0.99)          1           1
test_gc-gc[main]       3.1350 (1.06)     3.1350 (1.06)     3.1350 (1.06)     0.0000 (1.0)      3.1350 (1.06)     0.0000 (1.0)           0;0  0.3190 (0.94)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     131.4247 (2.65)     131.4247 (2.65)     131.4247 (2.65)     0.0000 (1.0)      131.4247 (2.65)     0.0000 (1.0)           0;0  0.0076 (0.38)          1           1
test_get-get[3.10.0]     161.1498 (3.25)     161.1498 (3.25)     161.1498 (3.25)     0.0000 (1.0)      161.1498 (3.25)     0.0000 (1.0)           0;0  0.0062 (0.31)          1           1
test_get-get[3.53.2]     145.9304 (2.94)     145.9304 (2.94)     145.9304 (2.94)     0.0000 (1.0)      145.9304 (2.94)     0.0000 (1.0)           0;0  0.0069 (0.34)          1           1
test_get-get[3.60.1]      49.7171 (1.00)      49.7171 (1.00)      49.7171 (1.00)     0.0000 (1.0)       49.7171 (1.00)     0.0000 (1.0)           0;0  0.0201 (1.00)          1           1
test_get-get[main]        49.6465 (1.0)       49.6465 (1.0)       49.6465 (1.0)      0.0000 (1.0)       49.6465 (1.0)      0.0000 (1.0)           0;0  0.0201 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     40.4416 (2.42)     40.4416 (2.42)     40.4416 (2.42)     0.0000 (1.0)      40.4416 (2.42)     0.0000 (1.0)           0;0  0.0247 (0.41)          1           1
test_get_url-get-url[3.10.0]     43.8005 (2.63)     43.8005 (2.63)     43.8005 (2.63)     0.0000 (1.0)      43.8005 (2.63)     0.0000 (1.0)           0;0  0.0228 (0.38)          1           1
test_get_url-get-url[3.53.2]     16.6776 (1.0)      16.6776 (1.0)      16.6776 (1.0)      0.0000 (1.0)      16.6776 (1.0)      0.0000 (1.0)           0;0  0.0600 (1.0)           1           1
test_get_url-get-url[3.60.1]     16.6951 (1.00)     16.6951 (1.00)     16.6951 (1.00)     0.0000 (1.0)      16.6951 (1.00)     0.0000 (1.0)           0;0  0.0599 (1.00)          1           1
test_get_url-get-url[main]       16.8381 (1.01)     16.8381 (1.01)     16.8381 (1.01)     0.0000 (1.0)      16.8381 (1.01)     0.0000 (1.0)           0;0  0.0594 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     146.8546 (1.05)     151.5177 (1.03)     148.3510 (1.05)     0.8128 (1.0)      148.2232 (1.06)     0.9257 (1.20)         24;4  6.7408 (0.96)        100           1
test_help---help[3.10.0]     141.6533 (1.02)     147.3090 (1.0)      143.8445 (1.02)     0.9438 (1.16)     143.7460 (1.02)     0.9116 (1.18)         20;8  6.9519 (0.98)        100           1
test_help---help[3.53.2]     145.6348 (1.05)     152.7902 (1.04)     147.1074 (1.04)     0.9980 (1.23)     146.9711 (1.05)     0.7732 (1.0)          18;5  6.7978 (0.96)        100           1
test_help---help[3.60.1]     146.3542 (1.05)     157.0188 (1.07)     147.8003 (1.04)     1.0781 (1.33)     147.7108 (1.05)     0.7825 (1.01)          7;1  6.7659 (0.96)        100           1
test_help---help[main]       139.2661 (1.0)      176.3819 (1.20)     141.6830 (1.0)      6.1437 (7.56)     140.3173 (1.0)      0.8731 (1.13)          4;7  7.0580 (1.0)         100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     214.6920 (2.91)     214.6920 (2.91)     214.6920 (2.91)     0.0000 (1.0)      214.6920 (2.91)     0.0000 (1.0)           0;0  0.0047 (0.34)          1           1
test_import-import[3.10.0]     244.3541 (3.32)     244.3541 (3.32)     244.3541 (3.32)     0.0000 (1.0)      244.3541 (3.32)     0.0000 (1.0)           0;0  0.0041 (0.30)          1           1
test_import-import[3.60.1]      73.6741 (1.0)       73.6741 (1.0)       73.6741 (1.0)      0.0000 (1.0)       73.6741 (1.0)      0.0000 (1.0)           0;0  0.0136 (1.0)           1           1
test_import-import[main]        74.4425 (1.01)      74.4425 (1.01)      74.4425 (1.01)     0.0000 (1.0)       74.4425 (1.01)     0.0000 (1.0)           0;0  0.0134 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     150.7094 (3.31)     150.7094 (3.31)     150.7094 (3.31)     0.0000 (1.0)      150.7094 (3.31)     0.0000 (1.0)           0;0  0.0066 (0.30)          1           1
test_import_url-import-url[3.10.0]     155.2957 (3.41)     155.2957 (3.41)     155.2957 (3.41)     0.0000 (1.0)      155.2957 (3.41)     0.0000 (1.0)           0;0  0.0064 (0.29)          1           1
test_import_url-import-url[3.53.2]     117.8253 (2.59)     117.8253 (2.59)     117.8253 (2.59)     0.0000 (1.0)      117.8253 (2.59)     0.0000 (1.0)           0;0  0.0085 (0.39)          1           1
test_import_url-import-url[3.60.1]      45.5170 (1.0)       45.5170 (1.0)       45.5170 (1.0)      0.0000 (1.0)       45.5170 (1.0)      0.0000 (1.0)           0;0  0.0220 (1.0)           1           1
test_import_url-import-url[main]        47.3405 (1.04)      47.3405 (1.04)      47.3405 (1.04)     0.0000 (1.0)       47.3405 (1.04)     0.0000 (1.0)           0;0  0.0211 (0.96)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     429.3878 (1.04)     472.4944 (1.06)     441.9165 (1.04)      7.5173 (1.10)     441.4259 (1.04)      6.4984 (1.0)          24;7  2.2629 (0.96)        100           1
test_init-init[3.10.0]     436.4621 (1.06)     479.0666 (1.07)     448.8893 (1.06)      9.2932 (1.36)     446.9318 (1.06)      8.4818 (1.31)         23;8  2.2277 (0.95)        100           1
test_init-init[3.53.2]     411.0777 (1.0)      452.2193 (1.01)     426.0040 (1.00)      7.7236 (1.13)     425.5543 (1.01)     11.2278 (1.73)         28;1  2.3474 (1.00)        100           1
test_init-init[3.60.1]     412.9030 (1.00)     446.8691 (1.0)      424.9204 (1.0)       6.8335 (1.0)      423.1087 (1.0)       8.6865 (1.34)         27;1  2.3534 (1.0)         100           1
test_init-init[main]       443.1714 (1.08)     554.4176 (1.24)     460.9156 (1.08)     13.3272 (1.95)     458.9989 (1.08)      9.4210 (1.45)          6;3  2.1696 (0.92)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     647.6781 (1.11)     647.6781 (1.11)     647.6781 (1.11)     0.0000 (1.0)      647.6781 (1.11)     0.0000 (1.0)           0;0  1.5440 (0.90)          1           1
test_list-list[3.10.0]     761.7697 (1.31)     761.7697 (1.31)     761.7697 (1.31)     0.0000 (1.0)      761.7697 (1.31)     0.0000 (1.0)           0;0  1.3127 (0.76)          1           1
test_list-list[3.53.2]     629.8423 (1.08)     629.8423 (1.08)     629.8423 (1.08)     0.0000 (1.0)      629.8423 (1.08)     0.0000 (1.0)           0;0  1.5877 (0.92)          1           1
test_list-list[3.60.1]     580.9854 (1.0)      580.9854 (1.0)      580.9854 (1.0)      0.0000 (1.0)      580.9854 (1.0)      0.0000 (1.0)           0;0  1.7212 (1.0)           1           1
test_list-list[main]       602.4140 (1.04)     602.4140 (1.04)     602.4140 (1.04)     0.0000 (1.0)      602.4140 (1.04)     0.0000 (1.0)           0;0  1.6600 (0.96)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     458.9023 (1.09)     458.9023 (1.09)     458.9023 (1.09)     0.0000 (1.0)      458.9023 (1.09)     0.0000 (1.0)           0;0  2.1791 (0.92)          1           1
test_list-list-dvc-only[3.10.0]     450.5451 (1.07)     450.5451 (1.07)     450.5451 (1.07)     0.0000 (1.0)      450.5451 (1.07)     0.0000 (1.0)           0;0  2.2195 (0.94)          1           1
test_list-list-dvc-only[3.53.2]     422.2368 (1.0)      422.2368 (1.0)      422.2368 (1.0)      0.0000 (1.0)      422.2368 (1.0)      0.0000 (1.0)           0;0  2.3683 (1.0)           1           1
test_list-list-dvc-only[3.60.1]     426.1749 (1.01)     426.1749 (1.01)     426.1749 (1.01)     0.0000 (1.0)      426.1749 (1.01)     0.0000 (1.0)           0;0  2.3465 (0.99)          1           1
test_list-list-dvc-only[main]       427.8766 (1.01)     427.8766 (1.01)     427.8766 (1.01)     0.0000 (1.0)      427.8766 (1.01)     0.0000 (1.0)           0;0  2.3371 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.4629 (1.0)      2.4629 (1.0)      2.4629 (1.0)      0.0000 (1.0)      2.4629 (1.0)      0.0000 (1.0)           0;0  0.4060 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.4820 (1.01)     2.4820 (1.01)     2.4820 (1.01)     0.0000 (1.0)      2.4820 (1.01)     0.0000 (1.0)           0;0  0.4029 (0.99)          1           1
test_list-list-recursive[3.53.2]     2.6086 (1.06)     2.6086 (1.06)     2.6086 (1.06)     0.0000 (1.0)      2.6086 (1.06)     0.0000 (1.0)           0;0  0.3834 (0.94)          1           1
test_list-list-recursive[3.60.1]     2.6629 (1.08)     2.6629 (1.08)     2.6629 (1.08)     0.0000 (1.0)      2.6629 (1.08)     0.0000 (1.0)           0;0  0.3755 (0.92)          1           1
test_list-list-recursive[main]       2.6547 (1.08)     2.6547 (1.08)     2.6547 (1.08)     0.0000 (1.0)      2.6547 (1.08)     0.0000 (1.0)           0;0  0.3767 (0.93)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     455.1668 (1.08)     455.1668 (1.08)     455.1668 (1.08)     0.0000 (1.0)      455.1668 (1.08)     0.0000 (1.0)           0;0  2.1970 (0.92)          1           1
test_list-list-shallow[3.10.0]     451.7784 (1.08)     451.7784 (1.08)     451.7784 (1.08)     0.0000 (1.0)      451.7784 (1.08)     0.0000 (1.0)           0;0  2.2135 (0.93)          1           1
test_list-list-shallow[3.53.2]     425.7909 (1.01)     425.7909 (1.01)     425.7909 (1.01)     0.0000 (1.0)      425.7909 (1.01)     0.0000 (1.0)           0;0  2.3486 (0.99)          1           1
test_list-list-shallow[3.60.1]     423.1586 (1.01)     423.1586 (1.01)     423.1586 (1.01)     0.0000 (1.0)      423.1586 (1.01)     0.0000 (1.0)           0;0  2.3632 (0.99)          1           1
test_list-list-shallow[main]       420.0722 (1.0)      420.0722 (1.0)      420.0722 (1.0)      0.0000 (1.0)      420.0722 (1.0)      0.0000 (1.0)           0;0  2.3805 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     71.3684 (3.73)     71.3684 (3.73)     71.3684 (3.73)     0.0000 (1.0)      71.3684 (3.73)     0.0000 (1.0)           0;0  0.0140 (0.27)          1           1
test_partial_add-add[3.10.0]     70.8417 (3.70)     70.8417 (3.70)     70.8417 (3.70)     0.0000 (1.0)      70.8417 (3.70)     0.0000 (1.0)           0;0  0.0141 (0.27)          1           1
test_partial_add-add[3.53.2]     64.1436 (3.35)     64.1436 (3.35)     64.1436 (3.35)     0.0000 (1.0)      64.1436 (3.35)     0.0000 (1.0)           0;0  0.0156 (0.30)          1           1
test_partial_add-add[3.60.1]     19.1543 (1.0)      19.1543 (1.0)      19.1543 (1.0)      0.0000 (1.0)      19.1543 (1.0)      0.0000 (1.0)           0;0  0.0522 (1.0)           1           1
test_partial_add-add[main]       19.8919 (1.04)     19.8919 (1.04)     19.8919 (1.04)     0.0000 (1.0)      19.8919 (1.04)     0.0000 (1.0)           0;0  0.0503 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     59.3229 (8.15)     59.3229 (8.15)     59.3229 (8.15)     0.0000 (1.0)      59.3229 (8.15)     0.0000 (1.0)           0;0  0.0169 (0.12)          1           1
test_partial_add-add-partial[3.10.0]     60.0332 (8.24)     60.0332 (8.24)     60.0332 (8.24)     0.0000 (1.0)      60.0332 (8.24)     0.0000 (1.0)           0;0  0.0167 (0.12)          1           1
test_partial_add-add-partial[3.53.2]     54.5148 (7.48)     54.5148 (7.48)     54.5148 (7.48)     0.0000 (1.0)      54.5148 (7.48)     0.0000 (1.0)           0;0  0.0183 (0.13)          1           1
test_partial_add-add-partial[3.60.1]      7.2833 (1.0)       7.2833 (1.0)       7.2833 (1.0)      0.0000 (1.0)       7.2833 (1.0)      0.0000 (1.0)           0;0  0.1373 (1.0)           1           1
test_partial_add-add-partial[main]        7.7996 (1.07)      7.7996 (1.07)      7.7996 (1.07)     0.0000 (1.0)       7.7996 (1.07)     0.0000 (1.0)           0;0  0.1282 (0.93)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.7310 (1.0)      4.7310 (1.0)      4.7310 (1.0)      0.0000 (1.0)      4.7310 (1.0)      0.0000 (1.0)           0;0  0.2114 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     6.1499 (1.30)     6.1499 (1.30)     6.1499 (1.30)     0.0000 (1.0)      6.1499 (1.30)     0.0000 (1.0)           0;0  0.1626 (0.77)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     7.0947 (1.50)     7.0947 (1.50)     7.0947 (1.50)     0.0000 (1.0)      7.0947 (1.50)     0.0000 (1.0)           0;0  0.1410 (0.67)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     7.0329 (1.49)     7.0329 (1.49)     7.0329 (1.49)     0.0000 (1.0)      7.0329 (1.49)     0.0000 (1.0)           0;0  0.1422 (0.67)          1           1
test_partial_add-gc-cloud-noop[main]       7.1155 (1.50)     7.1155 (1.50)     7.1155 (1.50)     0.0000 (1.0)      7.1155 (1.50)     0.0000 (1.0)           0;0  0.1405 (0.66)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.6554 (1.0)      2.6554 (1.0)      2.6554 (1.0)      0.0000 (1.0)      2.6554 (1.0)      0.0000 (1.0)           0;0  0.3766 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.9281 (1.48)     3.9281 (1.48)     3.9281 (1.48)     0.0000 (1.0)      3.9281 (1.48)     0.0000 (1.0)           0;0  0.2546 (0.68)          1           1
test_partial_add-gc-noop[3.53.2]     4.0334 (1.52)     4.0334 (1.52)     4.0334 (1.52)     0.0000 (1.0)      4.0334 (1.52)     0.0000 (1.0)           0;0  0.2479 (0.66)          1           1
test_partial_add-gc-noop[3.60.1]     4.0342 (1.52)     4.0342 (1.52)     4.0342 (1.52)     0.0000 (1.0)      4.0342 (1.52)     0.0000 (1.0)           0;0  0.2479 (0.66)          1           1
test_partial_add-gc-noop[main]       4.1086 (1.55)     4.1086 (1.55)     4.1086 (1.55)     0.0000 (1.0)      4.1086 (1.55)     0.0000 (1.0)           0;0  0.2434 (0.65)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     41.1344 (2.23)     41.1344 (2.23)     41.1344 (2.23)     0.0000 (1.0)      41.1344 (2.23)     0.0000 (1.0)           0;0  0.0243 (0.45)          1           1
test_partial_add-push[3.10.0]     35.6737 (1.93)     35.6737 (1.93)     35.6737 (1.93)     0.0000 (1.0)      35.6737 (1.93)     0.0000 (1.0)           0;0  0.0280 (0.52)          1           1
test_partial_add-push[3.53.2]     19.5451 (1.06)     19.5451 (1.06)     19.5451 (1.06)     0.0000 (1.0)      19.5451 (1.06)     0.0000 (1.0)           0;0  0.0512 (0.94)          1           1
test_partial_add-push[3.60.1]     18.7227 (1.01)     18.7227 (1.01)     18.7227 (1.01)     0.0000 (1.0)      18.7227 (1.01)     0.0000 (1.0)           0;0  0.0534 (0.99)          1           1
test_partial_add-push[main]       18.4521 (1.0)      18.4521 (1.0)      18.4521 (1.0)      0.0000 (1.0)      18.4521 (1.0)      0.0000 (1.0)           0;0  0.0542 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     10.6386 (1.07)     10.6386 (1.07)     10.6386 (1.07)     0.0000 (1.0)      10.6386 (1.07)     0.0000 (1.0)           0;0  0.0940 (0.93)          1           1
test_partial_add-push-partial[3.10.0]      9.9320 (1.0)       9.9320 (1.0)       9.9320 (1.0)      0.0000 (1.0)       9.9320 (1.0)      0.0000 (1.0)           0;0  0.1007 (1.0)           1           1
test_partial_add-push-partial[3.53.2]     10.3782 (1.04)     10.3782 (1.04)     10.3782 (1.04)     0.0000 (1.0)      10.3782 (1.04)     0.0000 (1.0)           0;0  0.0964 (0.96)          1           1
test_partial_add-push-partial[3.60.1]      9.9711 (1.00)      9.9711 (1.00)      9.9711 (1.00)     0.0000 (1.0)       9.9711 (1.00)     0.0000 (1.0)           0;0  0.1003 (1.00)          1           1
test_partial_add-push-partial[main]       10.1929 (1.03)     10.1929 (1.03)     10.1929 (1.03)     0.0000 (1.0)      10.1929 (1.03)     0.0000 (1.0)           0;0  0.0981 (0.97)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     83.4649 (3.73)     83.4649 (3.73)     83.4649 (3.73)     0.0000 (1.0)      83.4649 (3.73)     0.0000 (1.0)           0;0  0.0120 (0.27)          1           1
test_partial_remove-add[3.10.0]     84.5017 (3.78)     84.5017 (3.78)     84.5017 (3.78)     0.0000 (1.0)      84.5017 (3.78)     0.0000 (1.0)           0;0  0.0118 (0.26)          1           1
test_partial_remove-add[3.53.2]     75.6474 (3.38)     75.6474 (3.38)     75.6474 (3.38)     0.0000 (1.0)      75.6474 (3.38)     0.0000 (1.0)           0;0  0.0132 (0.30)          1           1
test_partial_remove-add[3.60.1]     22.3583 (1.0)      22.3583 (1.0)      22.3583 (1.0)      0.0000 (1.0)      22.3583 (1.0)      0.0000 (1.0)           0;0  0.0447 (1.0)           1           1
test_partial_remove-add[main]       23.3915 (1.05)     23.3915 (1.05)     23.3915 (1.05)     0.0000 (1.0)      23.3915 (1.05)     0.0000 (1.0)           0;0  0.0428 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     8.0204 (7.62)     8.0204 (7.62)     8.0204 (7.62)     0.0000 (1.0)      8.0204 (7.62)     0.0000 (1.0)           0;0  0.1247 (0.13)          1           1
test_partial_remove-add-update[3.10.0]     8.5261 (8.10)     8.5261 (8.10)     8.5261 (8.10)     0.0000 (1.0)      8.5261 (8.10)     0.0000 (1.0)           0;0  0.1173 (0.12)          1           1
test_partial_remove-add-update[3.53.2]     7.3550 (6.99)     7.3550 (6.99)     7.3550 (6.99)     0.0000 (1.0)      7.3550 (6.99)     0.0000 (1.0)           0;0  0.1360 (0.14)          1           1
test_partial_remove-add-update[3.60.1]     1.0527 (1.0)      1.0527 (1.0)      1.0527 (1.0)      0.0000 (1.0)      1.0527 (1.0)      0.0000 (1.0)           0;0  0.9500 (1.0)           1           1
test_partial_remove-add-update[main]       1.0920 (1.04)     1.0920 (1.04)     1.0920 (1.04)     0.0000 (1.0)      1.0920 (1.04)     0.0000 (1.0)           0;0  0.9157 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     3.3994 (1.0)      3.3994 (1.0)      3.3994 (1.0)      0.0000 (1.0)      3.3994 (1.0)      0.0000 (1.0)           0;0  0.2942 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.7857 (1.11)     3.7857 (1.11)     3.7857 (1.11)     0.0000 (1.0)      3.7857 (1.11)     0.0000 (1.0)           0;0  0.2642 (0.90)          1           1
test_partial_remove-gc[3.53.2]     3.8304 (1.13)     3.8304 (1.13)     3.8304 (1.13)     0.0000 (1.0)      3.8304 (1.13)     0.0000 (1.0)           0;0  0.2611 (0.89)          1           1
test_partial_remove-gc[3.60.1]     3.8338 (1.13)     3.8338 (1.13)     3.8338 (1.13)     0.0000 (1.0)      3.8338 (1.13)     0.0000 (1.0)           0;0  0.2608 (0.89)          1           1
test_partial_remove-gc[main]       3.7566 (1.11)     3.7566 (1.11)     3.7566 (1.11)     0.0000 (1.0)      3.7566 (1.11)     0.0000 (1.0)           0;0  0.2662 (0.90)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     4.8921 (1.02)     4.8921 (1.02)     4.8921 (1.02)     0.0000 (1.0)      4.8921 (1.02)     0.0000 (1.0)           0;0  0.2044 (0.98)          1           1
test_partial_remove-gc-cloud[3.10.0]     5.3750 (1.12)     5.3750 (1.12)     5.3750 (1.12)     0.0000 (1.0)      5.3750 (1.12)     0.0000 (1.0)           0;0  0.1860 (0.89)          1           1
test_partial_remove-gc-cloud[3.53.2]     5.1781 (1.08)     5.1781 (1.08)     5.1781 (1.08)     0.0000 (1.0)      5.1781 (1.08)     0.0000 (1.0)           0;0  0.1931 (0.93)          1           1
test_partial_remove-gc-cloud[3.60.1]     4.9153 (1.02)     4.9153 (1.02)     4.9153 (1.02)     0.0000 (1.0)      4.9153 (1.02)     0.0000 (1.0)           0;0  0.2034 (0.98)          1           1
test_partial_remove-gc-cloud[main]       4.7991 (1.0)      4.7991 (1.0)      4.7991 (1.0)      0.0000 (1.0)      4.7991 (1.0)      0.0000 (1.0)           0;0  0.2084 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     47.5726 (2.19)     47.5726 (2.19)     47.5726 (2.19)     0.0000 (1.0)      47.5726 (2.19)     0.0000 (1.0)           0;0  0.0210 (0.46)          1           1
test_partial_remove-push[3.10.0]     41.7982 (1.93)     41.7982 (1.93)     41.7982 (1.93)     0.0000 (1.0)      41.7982 (1.93)     0.0000 (1.0)           0;0  0.0239 (0.52)          1           1
test_partial_remove-push[3.53.2]     23.2298 (1.07)     23.2298 (1.07)     23.2298 (1.07)     0.0000 (1.0)      23.2298 (1.07)     0.0000 (1.0)           0;0  0.0430 (0.93)          1           1
test_partial_remove-push[3.60.1]     21.9015 (1.01)     21.9015 (1.01)     21.9015 (1.01)     0.0000 (1.0)      21.9015 (1.01)     0.0000 (1.0)           0;0  0.0457 (0.99)          1           1
test_partial_remove-push[main]       21.7114 (1.0)      21.7114 (1.0)      21.7114 (1.0)      0.0000 (1.0)      21.7114 (1.0)      0.0000 (1.0)           0;0  0.0461 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     1.7967 (1.0)      1.7967 (1.0)      1.7967 (1.0)      0.0000 (1.0)      1.7967 (1.0)      0.0000 (1.0)           0;0  0.5566 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     1.8327 (1.02)     1.8327 (1.02)     1.8327 (1.02)     0.0000 (1.0)      1.8327 (1.02)     0.0000 (1.0)           0;0  0.5456 (0.98)          1           1
test_partial_remove-push-update[3.53.2]     2.5226 (1.40)     2.5226 (1.40)     2.5226 (1.40)     0.0000 (1.0)      2.5226 (1.40)     0.0000 (1.0)           0;0  0.3964 (0.71)          1           1
test_partial_remove-push-update[3.60.1]     2.6673 (1.48)     2.6673 (1.48)     2.6673 (1.48)     0.0000 (1.0)      2.6673 (1.48)     0.0000 (1.0)           0;0  0.3749 (0.67)          1           1
test_partial_remove-push-update[main]       2.5414 (1.41)     2.5414 (1.41)     2.5414 (1.41)     0.0000 (1.0)      2.5414 (1.41)     0.0000 (1.0)           0;0  0.3935 (0.71)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     561.4123 (1.0)      569.4052 (1.0)      566.6297 (1.0)       3.3069 (1.0)      568.1992 (1.0)       4.5907 (1.0)           1;0  1.7648 (1.0)           5           3
test_plots-plots-diff[3.10.0]     954.9819 (1.70)     965.0311 (1.69)     958.7540 (1.69)      4.0485 (1.22)     956.6512 (1.68)      5.4030 (1.18)          1;0  1.0430 (0.59)          5           3
test_plots-plots-diff[3.53.2]     893.7497 (1.59)     922.8218 (1.62)     905.7574 (1.60)     12.7884 (3.87)     901.8299 (1.59)     22.3699 (4.87)          1;0  1.1040 (0.63)          5           3
test_plots-plots-diff[3.60.1]     903.1406 (1.61)     923.5722 (1.62)     912.2604 (1.61)      9.3560 (2.83)     908.5936 (1.60)     16.9417 (3.69)          1;0  1.0962 (0.62)          5           3
test_plots-plots-diff[main]       893.4290 (1.59)     919.1162 (1.61)     906.6842 (1.60)      9.4982 (2.87)     905.3045 (1.59)     11.8587 (2.58)          2;0  1.1029 (0.62)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       582.4062 (1.0)        586.4661 (1.0)        583.7165 (1.0)      1.6720 (1.0)        583.0983 (1.0)       2.1701 (1.0)           1;0  1.7132 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,183.9677 (2.03)     1,191.5495 (2.03)     1,187.9740 (2.04)     2.9768 (1.78)     1,188.8790 (2.04)      4.4231 (2.04)          2;0  0.8418 (0.49)          5           3
test_plots-plots-diff-json[3.53.2]       964.1830 (1.66)       972.5508 (1.66)       970.1385 (1.66)     3.5466 (2.12)       972.1573 (1.67)      4.1563 (1.92)          1;0  1.0308 (0.60)          5           3
test_plots-plots-diff-json[3.60.1]       973.8687 (1.67)       989.5917 (1.69)       981.1253 (1.68)     6.3246 (3.78)       978.5516 (1.68)      9.5544 (4.40)          2;0  1.0192 (0.59)          5           3
test_plots-plots-diff-json[main]         974.0907 (1.67)       991.1630 (1.69)       983.4925 (1.68)     7.1123 (4.25)       981.8300 (1.68)     11.5074 (5.30)          2;0  1.0168 (0.59)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     450.0649 (1.0)      459.3245 (1.0)      454.8741 (1.0)       3.8481 (1.0)      453.5295 (1.0)       6.1446 (1.16)          2;0  2.1984 (1.0)           5           3
test_plots-plots-show[3.10.0]     771.9844 (1.72)     794.6288 (1.73)     783.4434 (1.72)     10.5104 (2.73)     778.6533 (1.72)     18.6380 (3.51)          3;0  1.2764 (0.58)          5           3
test_plots-plots-show[3.53.2]     743.2819 (1.65)     754.7394 (1.64)     747.1692 (1.64)      4.7298 (1.23)     746.1303 (1.65)      6.6126 (1.25)          1;0  1.3384 (0.61)          5           3
test_plots-plots-show[3.60.1]     747.5334 (1.66)     758.0771 (1.65)     751.4101 (1.65)      4.1673 (1.08)     751.3218 (1.66)      5.3042 (1.0)           1;0  1.3308 (0.61)          5           3
test_plots-plots-show[main]       742.3509 (1.65)     785.0407 (1.71)     755.4297 (1.66)     18.2687 (4.75)     744.5203 (1.64)     23.7619 (4.48)          1;0  1.3237 (0.60)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     473.1596 (1.0)      484.3775 (1.0)      478.2578 (1.0)      4.4342 (1.69)     479.2779 (1.0)       6.4911 (1.43)          2;0  2.0909 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     900.5538 (1.90)     906.0699 (1.87)     903.5194 (1.89)     2.6313 (1.0)      903.9425 (1.89)      5.0863 (1.12)          1;0  1.1068 (0.53)          5           3
test_plots-plots-show-json[3.53.2]     800.4681 (1.69)     823.7879 (1.70)     808.0614 (1.69)     9.5170 (3.62)     806.3840 (1.68)     11.9833 (2.64)          1;0  1.2375 (0.59)          5           3
test_plots-plots-show-json[3.60.1]     799.7812 (1.69)     808.2490 (1.67)     803.4797 (1.68)     3.6544 (1.39)     802.6679 (1.67)      6.3992 (1.41)          2;0  1.2446 (0.60)          5           3
test_plots-plots-show-json[main]       800.7580 (1.69)     808.4055 (1.67)     803.9069 (1.68)     3.0595 (1.16)     802.8695 (1.68)      4.5454 (1.0)           2;0  1.2439 (0.59)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     49.9981 (2.26)     49.9981 (2.26)     49.9981 (2.26)     0.0000 (1.0)      49.9981 (2.26)     0.0000 (1.0)           0;0  0.0200 (0.44)          1           1
test_push-push[3.10.0]     44.3846 (2.00)     44.3846 (2.00)     44.3846 (2.00)     0.0000 (1.0)      44.3846 (2.00)     0.0000 (1.0)           0;0  0.0225 (0.50)          1           1
test_push-push[3.53.2]     23.1707 (1.05)     23.1707 (1.05)     23.1707 (1.05)     0.0000 (1.0)      23.1707 (1.05)     0.0000 (1.0)           0;0  0.0432 (0.96)          1           1
test_push-push[3.60.1]     22.1499 (1.0)      22.1499 (1.0)      22.1499 (1.0)      0.0000 (1.0)      22.1499 (1.0)      0.0000 (1.0)           0;0  0.0451 (1.0)           1           1
test_push-push[main]       22.8374 (1.03)     22.8374 (1.03)     22.8374 (1.03)     0.0000 (1.0)      22.8374 (1.03)     0.0000 (1.0)           0;0  0.0438 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     60.4556 (2.68)     60.4556 (2.68)     60.4556 (2.68)     0.0000 (1.0)      60.4556 (2.68)     0.0000 (1.0)           0;0  0.0165 (0.37)          1           1
test_sharing-fetch[3.10.0]     65.3260 (2.90)     65.3260 (2.90)     65.3260 (2.90)     0.0000 (1.0)      65.3260 (2.90)     0.0000 (1.0)           0;0  0.0153 (0.34)          1           1
test_sharing-fetch[3.53.2]     33.9197 (1.51)     33.9197 (1.51)     33.9197 (1.51)     0.0000 (1.0)      33.9197 (1.51)     0.0000 (1.0)           0;0  0.0295 (0.66)          1           1
test_sharing-fetch[3.60.1]     22.5208 (1.0)      22.5208 (1.0)      22.5208 (1.0)      0.0000 (1.0)      22.5208 (1.0)      0.0000 (1.0)           0;0  0.0444 (1.0)           1           1
test_sharing-fetch[main]       22.6838 (1.01)     22.6838 (1.01)     22.6838 (1.01)     0.0000 (1.0)      22.6838 (1.01)     0.0000 (1.0)           0;0  0.0441 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2907 (1.0)      1.2907 (1.0)      1.2907 (1.0)      0.0000 (1.0)      1.2907 (1.0)      0.0000 (1.0)           0;0  0.7748 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.6472 (2.83)     3.6472 (2.83)     3.6472 (2.83)     0.0000 (1.0)      3.6472 (2.83)     0.0000 (1.0)           0;0  0.2742 (0.35)          1           1
test_sharing-fetch-noop[3.53.2]     5.9395 (4.60)     5.9395 (4.60)     5.9395 (4.60)     0.0000 (1.0)      5.9395 (4.60)     0.0000 (1.0)           0;0  0.1684 (0.22)          1           1
test_sharing-fetch-noop[3.60.1]     5.9561 (4.61)     5.9561 (4.61)     5.9561 (4.61)     0.0000 (1.0)      5.9561 (4.61)     0.0000 (1.0)           0;0  0.1679 (0.22)          1           1
test_sharing-fetch-noop[main]       6.0231 (4.67)     6.0231 (4.67)     6.0231 (4.67)     0.0000 (1.0)      6.0231 (4.67)     0.0000 (1.0)           0;0  0.1660 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     47.7000 (2.17)     47.7000 (2.17)     47.7000 (2.17)     0.0000 (1.0)      47.7000 (2.17)     0.0000 (1.0)           0;0  0.0210 (0.46)          1           1
test_sharing-push[3.10.0]     42.5840 (1.94)     42.5840 (1.94)     42.5840 (1.94)     0.0000 (1.0)      42.5840 (1.94)     0.0000 (1.0)           0;0  0.0235 (0.52)          1           1
test_sharing-push[3.53.2]     23.5448 (1.07)     23.5448 (1.07)     23.5448 (1.07)     0.0000 (1.0)      23.5448 (1.07)     0.0000 (1.0)           0;0  0.0425 (0.93)          1           1
test_sharing-push[3.60.1]     21.9703 (1.0)      21.9703 (1.0)      21.9703 (1.0)      0.0000 (1.0)      21.9703 (1.0)      0.0000 (1.0)           0;0  0.0455 (1.0)           1           1
test_sharing-push[main]       22.2915 (1.01)     22.2915 (1.01)     22.2915 (1.01)     0.0000 (1.0)      22.2915 (1.01)     0.0000 (1.0)           0;0  0.0449 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.0953 (1.0)      2.0953 (1.0)      2.0953 (1.0)      0.0000 (1.0)      2.0953 (1.0)      0.0000 (1.0)           0;0  0.4773 (1.0)           1           1
test_sharing-push-noop[3.10.0]     2.1522 (1.03)     2.1522 (1.03)     2.1522 (1.03)     0.0000 (1.0)      2.1522 (1.03)     0.0000 (1.0)           0;0  0.4646 (0.97)          1           1
test_sharing-push-noop[3.53.2]     6.1466 (2.93)     6.1466 (2.93)     6.1466 (2.93)     0.0000 (1.0)      6.1466 (2.93)     0.0000 (1.0)           0;0  0.1627 (0.34)          1           1
test_sharing-push-noop[3.60.1]     6.0104 (2.87)     6.0104 (2.87)     6.0104 (2.87)     0.0000 (1.0)      6.0104 (2.87)     0.0000 (1.0)           0;0  0.1664 (0.35)          1           1
test_sharing-push-noop[main]       6.1784 (2.95)     6.1784 (2.95)     6.1784 (2.95)     0.0000 (1.0)      6.1784 (2.95)     0.0000 (1.0)           0;0  0.1619 (0.34)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     228.0079 (1.05)     228.0079 (1.05)     228.0079 (1.05)     0.0000 (1.0)      228.0079 (1.05)     0.0000 (1.0)           0;0  0.0044 (0.95)          1           1
test_sharing_azure-fetch[main]       217.5844 (1.0)      217.5844 (1.0)      217.5844 (1.0)      0.0000 (1.0)      217.5844 (1.0)      0.0000 (1.0)           0;0  0.0046 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.2396 (1.0)      6.2396 (1.0)      6.2396 (1.0)      0.0000 (1.0)      6.2396 (1.0)      0.0000 (1.0)           0;0  0.1603 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       6.4191 (1.03)     6.4191 (1.03)     6.4191 (1.03)     0.0000 (1.0)      6.4191 (1.03)     0.0000 (1.0)           0;0  0.1558 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     225.3963 (1.0)      225.3963 (1.0)      225.3963 (1.0)      0.0000 (1.0)      225.3963 (1.0)      0.0000 (1.0)           0;0  0.0044 (1.0)           1           1
test_sharing_azure-push[main]       227.4284 (1.01)     227.4284 (1.01)     227.4284 (1.01)     0.0000 (1.0)      227.4284 (1.01)     0.0000 (1.0)           0;0  0.0044 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     7.1635 (1.02)     7.1635 (1.02)     7.1635 (1.02)     0.0000 (1.0)      7.1635 (1.02)     0.0000 (1.0)           0;0  0.1396 (0.98)          1           1
test_sharing_azure-push-noop[main]       7.0375 (1.0)      7.0375 (1.0)      7.0375 (1.0)      0.0000 (1.0)      7.0375 (1.0)      0.0000 (1.0)           0;0  0.1421 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[3.53.2]     225.7674 (1.02)     225.7674 (1.02)     225.7674 (1.02)     0.0000 (1.0)      225.7674 (1.02)     0.0000 (1.0)           0;0  0.0044 (0.98)          1           1
test_sharing_gs-fetch[main]       222.3319 (1.0)      222.3319 (1.0)      222.3319 (1.0)      0.0000 (1.0)      222.3319 (1.0)      0.0000 (1.0)           0;0  0.0045 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[3.53.2]     6.4488 (1.0)      6.4488 (1.0)      6.4488 (1.0)      0.0000 (1.0)      6.4488 (1.0)      0.0000 (1.0)           0;0  0.1551 (1.0)           1           1
test_sharing_gs-fetch-noop[main]       6.6110 (1.03)     6.6110 (1.03)     6.6110 (1.03)     0.0000 (1.0)      6.6110 (1.03)     0.0000 (1.0)           0;0  0.1513 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[3.53.2]     560.4282 (1.01)     560.4282 (1.01)     560.4282 (1.01)     0.0000 (1.0)      560.4282 (1.01)     0.0000 (1.0)           0;0  0.0018 (1.00)          1           1
test_sharing_gs-push[main]       557.6295 (1.0)      557.6295 (1.0)      557.6295 (1.0)      0.0000 (1.0)      557.6295 (1.0)      0.0000 (1.0)           0;0  0.0018 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[3.53.2]     6.5959 (1.0)      6.5959 (1.0)      6.5959 (1.0)      0.0000 (1.0)      6.5959 (1.0)      0.0000 (1.0)           0;0  0.1516 (1.0)           1           1
test_sharing_gs-push-noop[main]       6.6394 (1.01)     6.6394 (1.01)     6.6394 (1.01)     0.0000 (1.0)      6.6394 (1.01)     0.0000 (1.0)           0;0  0.1506 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     411.5222 (1.0)      411.5222 (1.0)      411.5222 (1.0)      0.0000 (1.0)      411.5222 (1.0)      0.0000 (1.0)           0;0  0.0024 (1.0)           1           1
test_sharing_s3-fetch[main]       417.0058 (1.01)     417.0058 (1.01)     417.0058 (1.01)     0.0000 (1.0)      417.0058 (1.01)     0.0000 (1.0)           0;0  0.0024 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     5.3901 (1.0)      5.3901 (1.0)      5.3901 (1.0)      0.0000 (1.0)      5.3901 (1.0)      0.0000 (1.0)           0;0  0.1855 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       5.6448 (1.05)     5.6448 (1.05)     5.6448 (1.05)     0.0000 (1.0)      5.6448 (1.05)     0.0000 (1.0)           0;0  0.1772 (0.95)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     515.9958 (1.0)      515.9958 (1.0)      515.9958 (1.0)      0.0000 (1.0)      515.9958 (1.0)      0.0000 (1.0)           0;0  0.0019 (1.0)           1           1
test_sharing_s3-push[main]       516.8649 (1.00)     516.8649 (1.00)     516.8649 (1.00)     0.0000 (1.0)      516.8649 (1.00)     0.0000 (1.0)           0;0  0.0019 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     5.8164 (1.0)      5.8164 (1.0)      5.8164 (1.0)      0.0000 (1.0)      5.8164 (1.0)      0.0000 (1.0)           0;0  0.1719 (1.0)           1           1
test_sharing_s3-push-noop[main]       5.9407 (1.02)     5.9407 (1.02)     5.9407 (1.02)     0.0000 (1.0)      5.9407 (1.02)     0.0000 (1.0)           0;0  0.1683 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     19.5677 (3.89)     19.5677 (3.89)     19.5677 (3.89)     0.0000 (1.0)      19.5677 (3.89)     0.0000 (1.0)           0;0  0.0511 (0.26)          1           1
test_status-status[3.10.0]     20.0405 (3.98)     20.0405 (3.98)     20.0405 (3.98)     0.0000 (1.0)      20.0405 (3.98)     0.0000 (1.0)           0;0  0.0499 (0.25)          1           1
test_status-status[3.53.2]     18.4300 (3.66)     18.4300 (3.66)     18.4300 (3.66)     0.0000 (1.0)      18.4300 (3.66)     0.0000 (1.0)           0;0  0.0543 (0.27)          1           1
test_status-status[3.60.1]      5.0317 (1.0)       5.0317 (1.0)       5.0317 (1.0)      0.0000 (1.0)       5.0317 (1.0)      0.0000 (1.0)           0;0  0.1987 (1.0)           1           1
test_status-status[main]        5.3644 (1.07)      5.3644 (1.07)      5.3644 (1.07)     0.0000 (1.0)       5.3644 (1.07)     0.0000 (1.0)           0;0  0.1864 (0.94)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.8614 (1.79)     4.8614 (1.79)     4.8614 (1.79)     0.0000 (1.0)      4.8614 (1.79)     0.0000 (1.0)           0;0  0.2057 (0.56)          1           1
test_status-status-changed[3.10.0]     5.3146 (1.95)     5.3146 (1.95)     5.3146 (1.95)     0.0000 (1.0)      5.3146 (1.95)     0.0000 (1.0)           0;0  0.1882 (0.51)          1           1
test_status-status-changed[3.53.2]     5.1871 (1.90)     5.1871 (1.90)     5.1871 (1.90)     0.0000 (1.0)      5.1871 (1.90)     0.0000 (1.0)           0;0  0.1928 (0.53)          1           1
test_status-status-changed[3.60.1]     2.7233 (1.0)      2.7233 (1.0)      2.7233 (1.0)      0.0000 (1.0)      2.7233 (1.0)      0.0000 (1.0)           0;0  0.3672 (1.0)           1           1
test_status-status-changed[main]       2.9186 (1.07)     2.9186 (1.07)     2.9186 (1.07)     0.0000 (1.0)      2.9186 (1.07)     0.0000 (1.0)           0;0  0.3426 (0.93)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     5.0890 (1.94)     5.0890 (1.94)     5.0890 (1.94)     0.0000 (1.0)      5.0890 (1.94)     0.0000 (1.0)           0;0  0.1965 (0.52)          1           1
test_status-status-changed-noop[3.10.0]     5.0446 (1.92)     5.0446 (1.92)     5.0446 (1.92)     0.0000 (1.0)      5.0446 (1.92)     0.0000 (1.0)           0;0  0.1982 (0.52)          1           1
test_status-status-changed-noop[3.53.2]     4.9699 (1.89)     4.9699 (1.89)     4.9699 (1.89)     0.0000 (1.0)      4.9699 (1.89)     0.0000 (1.0)           0;0  0.2012 (0.53)          1           1
test_status-status-changed-noop[3.60.1]     2.6250 (1.0)      2.6250 (1.0)      2.6250 (1.0)      0.0000 (1.0)      2.6250 (1.0)      0.0000 (1.0)           0;0  0.3810 (1.0)           1           1
test_status-status-changed-noop[main]       2.8244 (1.08)     2.8244 (1.08)     2.8244 (1.08)     0.0000 (1.0)      2.8244 (1.08)     0.0000 (1.0)           0;0  0.3541 (0.93)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     5.0658 (1.94)     5.0658 (1.94)     5.0658 (1.94)     0.0000 (1.0)      5.0658 (1.94)     0.0000 (1.0)           0;0  0.1974 (0.52)          1           1
test_status-status-noop[3.10.0]     5.1916 (1.99)     5.1916 (1.99)     5.1916 (1.99)     0.0000 (1.0)      5.1916 (1.99)     0.0000 (1.0)           0;0  0.1926 (0.50)          1           1
test_status-status-noop[3.53.2]     5.0125 (1.92)     5.0125 (1.92)     5.0125 (1.92)     0.0000 (1.0)      5.0125 (1.92)     0.0000 (1.0)           0;0  0.1995 (0.52)          1           1
test_status-status-noop[3.60.1]     2.6124 (1.0)      2.6124 (1.0)      2.6124 (1.0)      0.0000 (1.0)      2.6124 (1.0)      0.0000 (1.0)           0;0  0.3828 (1.0)           1           1
test_status-status-noop[main]       2.7971 (1.07)     2.7971 (1.07)     2.7971 (1.07)     0.0000 (1.0)      2.7971 (1.07)     0.0000 (1.0)           0;0  0.3575 (0.93)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     149.3573 (3.29)     149.3573 (3.29)     149.3573 (3.29)     0.0000 (1.0)      149.3573 (3.29)     0.0000 (1.0)           0;0  0.0067 (0.30)          1           1
test_update-import-url[3.10.0]     152.9017 (3.37)     152.9017 (3.37)     152.9017 (3.37)     0.0000 (1.0)      152.9017 (3.37)     0.0000 (1.0)           0;0  0.0065 (0.30)          1           1
test_update-import-url[3.53.2]     115.0629 (2.54)     115.0629 (2.54)     115.0629 (2.54)     0.0000 (1.0)      115.0629 (2.54)     0.0000 (1.0)           0;0  0.0087 (0.39)          1           1
test_update-import-url[3.60.1]      45.3512 (1.0)       45.3512 (1.0)       45.3512 (1.0)      0.0000 (1.0)       45.3512 (1.0)      0.0000 (1.0)           0;0  0.0221 (1.0)           1           1
test_update-import-url[main]        46.3900 (1.02)      46.3900 (1.02)      46.3900 (1.02)     0.0000 (1.0)       46.3900 (1.02)     0.0000 (1.0)           0;0  0.0216 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     133.8068 (3.83)     133.8068 (3.83)     133.8068 (3.83)     0.0000 (1.0)      133.8068 (3.83)     0.0000 (1.0)           0;0  0.0075 (0.26)          1           1
test_update-update[3.10.0]     137.6784 (3.94)     137.6784 (3.94)     137.6784 (3.94)     0.0000 (1.0)      137.6784 (3.94)     0.0000 (1.0)           0;0  0.0073 (0.25)          1           1
test_update-update[3.53.2]     108.0369 (3.09)     108.0369 (3.09)     108.0369 (3.09)     0.0000 (1.0)      108.0369 (3.09)     0.0000 (1.0)           0;0  0.0093 (0.32)          1           1
test_update-update[3.60.1]      34.9209 (1.0)       34.9209 (1.0)       34.9209 (1.0)      0.0000 (1.0)       34.9209 (1.0)      0.0000 (1.0)           0;0  0.0286 (1.0)           1           1
test_update-update[main]        36.0636 (1.03)      36.0636 (1.03)      36.0636 (1.03)     0.0000 (1.0)       36.0636 (1.03)     0.0000 (1.0)           0;0  0.0277 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     16.4783 (2.14)     16.4783 (2.14)     16.4783 (2.14)     0.0000 (1.0)      16.4783 (2.14)     0.0000 (1.0)           0;0  0.0607 (0.47)          1           1
test_update-update-noop[3.10.0]     17.5204 (2.28)     17.5204 (2.28)     17.5204 (2.28)     0.0000 (1.0)      17.5204 (2.28)     0.0000 (1.0)           0;0  0.0571 (0.44)          1           1
test_update-update-noop[3.53.2]     16.8831 (2.20)     16.8831 (2.20)     16.8831 (2.20)     0.0000 (1.0)      16.8831 (2.20)     0.0000 (1.0)           0;0  0.0592 (0.46)          1           1
test_update-update-noop[3.60.1]      7.6843 (1.0)       7.6843 (1.0)       7.6843 (1.0)      0.0000 (1.0)       7.6843 (1.0)      0.0000 (1.0)           0;0  0.1301 (1.0)           1           1
test_update-update-noop[main]        8.3443 (1.09)      8.3443 (1.09)      8.3443 (1.09)     0.0000 (1.0)       8.3443 (1.09)     0.0000 (1.0)           0;0  0.1198 (0.92)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean