Sat Oct 11 00:59:03 UTC 2025
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     85.0464 (3.73)     85.0464 (3.73)     85.0464 (3.73)     0.0000 (1.0)      85.0464 (3.73)     0.0000 (1.0)           0;0  0.0118 (0.27)          1           1
test_add_copy-add[3.10.0]     86.0076 (3.77)     86.0076 (3.77)     86.0076 (3.77)     0.0000 (1.0)      86.0076 (3.77)     0.0000 (1.0)           0;0  0.0116 (0.26)          1           1
test_add_copy-add[3.53.2]     75.8039 (3.33)     75.8039 (3.33)     75.8039 (3.33)     0.0000 (1.0)      75.8039 (3.33)     0.0000 (1.0)           0;0  0.0132 (0.30)          1           1
test_add_copy-add[3.60.1]     22.7915 (1.0)      22.7915 (1.0)      22.7915 (1.0)      0.0000 (1.0)      22.7915 (1.0)      0.0000 (1.0)           0;0  0.0439 (1.0)           1           1
test_add_copy-add[main]       23.8117 (1.04)     23.8117 (1.04)     23.8117 (1.04)     0.0000 (1.0)      23.8117 (1.04)     0.0000 (1.0)           0;0  0.0420 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     27.3743 (6.24)     27.3743 (6.24)     27.3743 (6.24)     0.0000 (1.0)      27.3743 (6.24)     0.0000 (1.0)           0;0  0.0365 (0.16)          1           1
test_add_copy-add-noop[3.10.0]     28.3148 (6.45)     28.3148 (6.45)     28.3148 (6.45)     0.0000 (1.0)      28.3148 (6.45)     0.0000 (1.0)           0;0  0.0353 (0.15)          1           1
test_add_copy-add-noop[3.53.2]     26.7144 (6.09)     26.7144 (6.09)     26.7144 (6.09)     0.0000 (1.0)      26.7144 (6.09)     0.0000 (1.0)           0;0  0.0374 (0.16)          1           1
test_add_copy-add-noop[3.60.1]      4.3879 (1.0)       4.3879 (1.0)       4.3879 (1.0)      0.0000 (1.0)       4.3879 (1.0)      0.0000 (1.0)           0;0  0.2279 (1.0)           1           1
test_add_copy-add-noop[main]        4.8205 (1.10)      4.8205 (1.10)      4.8205 (1.10)     0.0000 (1.0)       4.8205 (1.10)     0.0000 (1.0)           0;0  0.2074 (0.91)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     65.4574 (4.14)     65.4574 (4.14)     65.4574 (4.14)     0.0000 (1.0)      65.4574 (4.14)     0.0000 (1.0)           0;0  0.0153 (0.24)          1           1
test_add_hardlink-add[3.10.0]     65.5327 (4.14)     65.5327 (4.14)     65.5327 (4.14)     0.0000 (1.0)      65.5327 (4.14)     0.0000 (1.0)           0;0  0.0153 (0.24)          1           1
test_add_hardlink-add[3.53.2]     60.6487 (3.84)     60.6487 (3.84)     60.6487 (3.84)     0.0000 (1.0)      60.6487 (3.84)     0.0000 (1.0)           0;0  0.0165 (0.26)          1           1
test_add_hardlink-add[3.60.1]     15.8105 (1.0)      15.8105 (1.0)      15.8105 (1.0)      0.0000 (1.0)      15.8105 (1.0)      0.0000 (1.0)           0;0  0.0632 (1.0)           1           1
test_add_hardlink-add[main]       17.3148 (1.10)     17.3148 (1.10)     17.3148 (1.10)     0.0000 (1.0)      17.3148 (1.10)     0.0000 (1.0)           0;0  0.0578 (0.91)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     32.6682 (7.40)     32.6682 (7.40)     32.6682 (7.40)     0.0000 (1.0)      32.6682 (7.40)     0.0000 (1.0)           0;0  0.0306 (0.14)          1           1
test_add_hardlink-add-noop[3.10.0]     33.4745 (7.58)     33.4745 (7.58)     33.4745 (7.58)     0.0000 (1.0)      33.4745 (7.58)     0.0000 (1.0)           0;0  0.0299 (0.13)          1           1
test_add_hardlink-add-noop[3.53.2]     31.4732 (7.13)     31.4732 (7.13)     31.4732 (7.13)     0.0000 (1.0)      31.4732 (7.13)     0.0000 (1.0)           0;0  0.0318 (0.14)          1           1
test_add_hardlink-add-noop[3.60.1]      4.4134 (1.0)       4.4134 (1.0)       4.4134 (1.0)      0.0000 (1.0)       4.4134 (1.0)      0.0000 (1.0)           0;0  0.2266 (1.0)           1           1
test_add_hardlink-add-noop[main]        4.8182 (1.09)      4.8182 (1.09)      4.8182 (1.09)     0.0000 (1.0)       4.8182 (1.09)     0.0000 (1.0)           0;0  0.2075 (0.92)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     69.3476 (2.01)     69.3476 (2.01)     69.3476 (2.01)     0.0000 (1.0)      69.3476 (2.01)     0.0000 (1.0)           0;0  0.0144 (0.50)          1           1
test_add_symlink-add[3.10.0]     70.0798 (2.03)     70.0798 (2.03)     70.0798 (2.03)     0.0000 (1.0)      70.0798 (2.03)     0.0000 (1.0)           0;0  0.0143 (0.49)          1           1
test_add_symlink-add[3.53.2]     65.0509 (1.89)     65.0509 (1.89)     65.0509 (1.89)     0.0000 (1.0)      65.0509 (1.89)     0.0000 (1.0)           0;0  0.0154 (0.53)          1           1
test_add_symlink-add[3.60.1]     34.4603 (1.0)      34.4603 (1.0)      34.4603 (1.0)      0.0000 (1.0)      34.4603 (1.0)      0.0000 (1.0)           0;0  0.0290 (1.0)           1           1
test_add_symlink-add[main]       35.2522 (1.02)     35.2522 (1.02)     35.2522 (1.02)     0.0000 (1.0)      35.2522 (1.02)     0.0000 (1.0)           0;0  0.0284 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     45.6989 (7.98)     45.6989 (7.98)     45.6989 (7.98)     0.0000 (1.0)      45.6989 (7.98)     0.0000 (1.0)           0;0  0.0219 (0.13)          1           1
test_add_symlink-add-noop[3.10.0]     46.8509 (8.18)     46.8509 (8.18)     46.8509 (8.18)     0.0000 (1.0)      46.8509 (8.18)     0.0000 (1.0)           0;0  0.0213 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     45.4580 (7.94)     45.4580 (7.94)     45.4580 (7.94)     0.0000 (1.0)      45.4580 (7.94)     0.0000 (1.0)           0;0  0.0220 (0.13)          1           1
test_add_symlink-add-noop[3.60.1]      5.7263 (1.0)       5.7263 (1.0)       5.7263 (1.0)      0.0000 (1.0)       5.7263 (1.0)      0.0000 (1.0)           0;0  0.1746 (1.0)           1           1
test_add_symlink-add-noop[main]        6.1487 (1.07)      6.1487 (1.07)      6.1487 (1.07)     0.0000 (1.0)       6.1487 (1.07)     0.0000 (1.0)           0;0  0.1626 (0.93)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     41.6932 (1.95)     41.6932 (1.95)     41.6932 (1.95)     0.0000 (1.0)      41.6932 (1.95)     0.0000 (1.0)           0;0  0.0240 (0.51)          1           1
test_checkout_copy-checkout[3.10.0]     61.6374 (2.88)     61.6374 (2.88)     61.6374 (2.88)     0.0000 (1.0)      61.6374 (2.88)     0.0000 (1.0)           0;0  0.0162 (0.35)          1           1
test_checkout_copy-checkout[3.53.2]     28.2488 (1.32)     28.2488 (1.32)     28.2488 (1.32)     0.0000 (1.0)      28.2488 (1.32)     0.0000 (1.0)           0;0  0.0354 (0.76)          1           1
test_checkout_copy-checkout[3.60.1]     21.4332 (1.0)      21.4332 (1.0)      21.4332 (1.0)      0.0000 (1.0)      21.4332 (1.0)      0.0000 (1.0)           0;0  0.0467 (1.0)           1           1
test_checkout_copy-checkout[main]       22.4996 (1.05)     22.4996 (1.05)     22.4996 (1.05)     0.0000 (1.0)      22.4996 (1.05)     0.0000 (1.0)           0;0  0.0444 (0.95)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.6815 (1.58)     5.6815 (1.58)     5.6815 (1.58)     0.0000 (1.0)      5.6815 (1.58)     0.0000 (1.0)           0;0  0.1760 (0.63)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.9924 (1.66)     5.9924 (1.66)     5.9924 (1.66)     0.0000 (1.0)      5.9924 (1.66)     0.0000 (1.0)           0;0  0.1669 (0.60)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.7829 (1.61)     5.7829 (1.61)     5.7829 (1.61)     0.0000 (1.0)      5.7829 (1.61)     0.0000 (1.0)           0;0  0.1729 (0.62)          1           1
test_checkout_copy-checkout-noop[3.60.1]     3.6009 (1.0)      3.6009 (1.0)      3.6009 (1.0)      0.0000 (1.0)      3.6009 (1.0)      0.0000 (1.0)           0;0  0.2777 (1.0)           1           1
test_checkout_copy-checkout-noop[main]       3.7646 (1.05)     3.7646 (1.05)     3.7646 (1.05)     0.0000 (1.0)      3.7646 (1.05)     0.0000 (1.0)           0;0  0.2656 (0.96)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     8.1060 (1.89)     8.1060 (1.89)     8.1060 (1.89)     0.0000 (1.0)      8.1060 (1.89)     0.0000 (1.0)           0;0  0.1234 (0.53)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.7308 (1.57)     6.7308 (1.57)     6.7308 (1.57)     0.0000 (1.0)      6.7308 (1.57)     0.0000 (1.0)           0;0  0.1486 (0.64)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.7307 (1.57)     6.7307 (1.57)     6.7307 (1.57)     0.0000 (1.0)      6.7307 (1.57)     0.0000 (1.0)           0;0  0.1486 (0.64)          1           1
test_checkout_copy-checkout-update[3.60.1]     4.2923 (1.0)      4.2923 (1.0)      4.2923 (1.0)      0.0000 (1.0)      4.2923 (1.0)      0.0000 (1.0)           0;0  0.2330 (1.0)           1           1
test_checkout_copy-checkout-update[main]       4.5869 (1.07)     4.5869 (1.07)     4.5869 (1.07)     0.0000 (1.0)      4.5869 (1.07)     0.0000 (1.0)           0;0  0.2180 (0.94)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     21.8959 (3.01)     21.8959 (3.01)     21.8959 (3.01)     0.0000 (1.0)      21.8959 (3.01)     0.0000 (1.0)           0;0  0.0457 (0.33)          1           1
test_checkout_hardlink-checkout[3.10.0]     16.4703 (2.26)     16.4703 (2.26)     16.4703 (2.26)     0.0000 (1.0)      16.4703 (2.26)     0.0000 (1.0)           0;0  0.0607 (0.44)          1           1
test_checkout_hardlink-checkout[3.53.2]     14.6854 (2.02)     14.6854 (2.02)     14.6854 (2.02)     0.0000 (1.0)      14.6854 (2.02)     0.0000 (1.0)           0;0  0.0681 (0.50)          1           1
test_checkout_hardlink-checkout[3.60.1]      7.2854 (1.0)       7.2854 (1.0)       7.2854 (1.0)      0.0000 (1.0)       7.2854 (1.0)      0.0000 (1.0)           0;0  0.1373 (1.0)           1           1
test_checkout_hardlink-checkout[main]        8.0320 (1.10)      8.0320 (1.10)      8.0320 (1.10)     0.0000 (1.0)       8.0320 (1.10)     0.0000 (1.0)           0;0  0.1245 (0.91)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.6905 (1.68)     5.6905 (1.68)     5.6905 (1.68)     0.0000 (1.0)      5.6905 (1.68)     0.0000 (1.0)           0;0  0.1757 (0.59)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.8240 (1.72)     5.8240 (1.72)     5.8240 (1.72)     0.0000 (1.0)      5.8240 (1.72)     0.0000 (1.0)           0;0  0.1717 (0.58)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.6491 (1.67)     5.6491 (1.67)     5.6491 (1.67)     0.0000 (1.0)      5.6491 (1.67)     0.0000 (1.0)           0;0  0.1770 (0.60)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.3774 (1.0)      3.3774 (1.0)      3.3774 (1.0)      0.0000 (1.0)      3.3774 (1.0)      0.0000 (1.0)           0;0  0.2961 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]       3.6535 (1.08)     3.6535 (1.08)     3.6535 (1.08)     0.0000 (1.0)      3.6535 (1.08)     0.0000 (1.0)           0;0  0.2737 (0.92)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     7.8348 (1.96)     7.8348 (1.96)     7.8348 (1.96)     0.0000 (1.0)      7.8348 (1.96)     0.0000 (1.0)           0;0  0.1276 (0.51)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.6693 (1.67)     6.6693 (1.67)     6.6693 (1.67)     0.0000 (1.0)      6.6693 (1.67)     0.0000 (1.0)           0;0  0.1499 (0.60)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.4016 (1.60)     6.4016 (1.60)     6.4016 (1.60)     0.0000 (1.0)      6.4016 (1.60)     0.0000 (1.0)           0;0  0.1562 (0.62)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     3.9898 (1.0)      3.9898 (1.0)      3.9898 (1.0)      0.0000 (1.0)      3.9898 (1.0)      0.0000 (1.0)           0;0  0.2506 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       4.6020 (1.15)     4.6020 (1.15)     4.6020 (1.15)     0.0000 (1.0)      4.6020 (1.15)     0.0000 (1.0)           0;0  0.2173 (0.87)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     24.8229 (2.46)     24.8229 (2.46)     24.8229 (2.46)     0.0000 (1.0)      24.8229 (2.46)     0.0000 (1.0)           0;0  0.0403 (0.41)          1           1
test_checkout_symlink-checkout[3.10.0]     19.2529 (1.91)     19.2529 (1.91)     19.2529 (1.91)     0.0000 (1.0)      19.2529 (1.91)     0.0000 (1.0)           0;0  0.0519 (0.52)          1           1
test_checkout_symlink-checkout[3.53.2]     17.4168 (1.73)     17.4168 (1.73)     17.4168 (1.73)     0.0000 (1.0)      17.4168 (1.73)     0.0000 (1.0)           0;0  0.0574 (0.58)          1           1
test_checkout_symlink-checkout[3.60.1]     10.0802 (1.0)      10.0802 (1.0)      10.0802 (1.0)      0.0000 (1.0)      10.0802 (1.0)      0.0000 (1.0)           0;0  0.0992 (1.0)           1           1
test_checkout_symlink-checkout[main]       11.2734 (1.12)     11.2734 (1.12)     11.2734 (1.12)     0.0000 (1.0)      11.2734 (1.12)     0.0000 (1.0)           0;0  0.0887 (0.89)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.8005 (1.57)     6.8005 (1.57)     6.8005 (1.57)     0.0000 (1.0)      6.8005 (1.57)     0.0000 (1.0)           0;0  0.1470 (0.64)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     6.8721 (1.59)     6.8721 (1.59)     6.8721 (1.59)     0.0000 (1.0)      6.8721 (1.59)     0.0000 (1.0)           0;0  0.1455 (0.63)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.6596 (1.54)     6.6596 (1.54)     6.6596 (1.54)     0.0000 (1.0)      6.6596 (1.54)     0.0000 (1.0)           0;0  0.1502 (0.65)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     4.3292 (1.0)      4.3292 (1.0)      4.3292 (1.0)      0.0000 (1.0)      4.3292 (1.0)      0.0000 (1.0)           0;0  0.2310 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]       4.6358 (1.07)     4.6358 (1.07)     4.6358 (1.07)     0.0000 (1.0)      4.6358 (1.07)     0.0000 (1.0)           0;0  0.2157 (0.93)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 5 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     10.0550 (1.72)     10.0550 (1.72)     10.0550 (1.72)     0.0000 (1.0)      10.0550 (1.72)     0.0000 (1.0)           0;0  0.0995 (0.58)          1           1
test_checkout_symlink-checkout-update[3.10.0]      8.7387 (1.49)      8.7387 (1.49)      8.7387 (1.49)     0.0000 (1.0)       8.7387 (1.49)     0.0000 (1.0)           0;0  0.1144 (0.67)          1           1
test_checkout_symlink-checkout-update[3.53.2]      8.4404 (1.44)      8.4404 (1.44)      8.4404 (1.44)     0.0000 (1.0)       8.4404 (1.44)     0.0000 (1.0)           0;0  0.1185 (0.69)          1           1
test_checkout_symlink-checkout-update[3.60.1]      5.8496 (1.0)       5.8496 (1.0)       5.8496 (1.0)      0.0000 (1.0)       5.8496 (1.0)      0.0000 (1.0)           0;0  0.1710 (1.0)           1           1
test_checkout_symlink-checkout-update[main]        6.4439 (1.10)      6.4439 (1.10)      6.4439 (1.10)     0.0000 (1.0)       6.4439 (1.10)     0.0000 (1.0)           0;0  0.1552 (0.91)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.1369 (1.76)     4.1369 (1.76)     4.1369 (1.76)     0.0000 (1.0)      4.1369 (1.76)     0.0000 (1.0)           0;0  0.2417 (0.57)          1           1
test_data_status-data-changed[3.10.0]     4.7084 (2.00)     4.7084 (2.00)     4.7084 (2.00)     0.0000 (1.0)      4.7084 (2.00)     0.0000 (1.0)           0;0  0.2124 (0.50)          1           1
test_data_status-data-changed[3.53.2]     4.5019 (1.92)     4.5019 (1.92)     4.5019 (1.92)     0.0000 (1.0)      4.5019 (1.92)     0.0000 (1.0)           0;0  0.2221 (0.52)          1           1
test_data_status-data-changed[3.60.1]     2.3506 (1.0)      2.3506 (1.0)      2.3506 (1.0)      0.0000 (1.0)      2.3506 (1.0)      0.0000 (1.0)           0;0  0.4254 (1.0)           1           1
test_data_status-data-changed[main]       2.5469 (1.08)     2.5469 (1.08)     2.5469 (1.08)     0.0000 (1.0)      2.5469 (1.08)     0.0000 (1.0)           0;0  0.3926 (0.92)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.0681 (1.76)     4.0681 (1.76)     4.0681 (1.76)     0.0000 (1.0)      4.0681 (1.76)     0.0000 (1.0)           0;0  0.2458 (0.57)          1           1
test_data_status-data-changed-noop[3.10.0]     4.7292 (2.05)     4.7292 (2.05)     4.7292 (2.05)     0.0000 (1.0)      4.7292 (2.05)     0.0000 (1.0)           0;0  0.2115 (0.49)          1           1
test_data_status-data-changed-noop[3.53.2]     4.7815 (2.07)     4.7815 (2.07)     4.7815 (2.07)     0.0000 (1.0)      4.7815 (2.07)     0.0000 (1.0)           0;0  0.2091 (0.48)          1           1
test_data_status-data-changed-noop[3.60.1]     2.3086 (1.0)      2.3086 (1.0)      2.3086 (1.0)      0.0000 (1.0)      2.3086 (1.0)      0.0000 (1.0)           0;0  0.4332 (1.0)           1           1
test_data_status-data-changed-noop[main]       2.5592 (1.11)     2.5592 (1.11)     2.5592 (1.11)     0.0000 (1.0)      2.5592 (1.11)     0.0000 (1.0)           0;0  0.3908 (0.90)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     18.4101 (3.75)     18.4101 (3.75)     18.4101 (3.75)     0.0000 (1.0)      18.4101 (3.75)     0.0000 (1.0)           0;0  0.0543 (0.27)          1           1
test_data_status-data-new[3.10.0]     19.4125 (3.95)     19.4125 (3.95)     19.4125 (3.95)     0.0000 (1.0)      19.4125 (3.95)     0.0000 (1.0)           0;0  0.0515 (0.25)          1           1
test_data_status-data-new[3.53.2]     19.0014 (3.87)     19.0014 (3.87)     19.0014 (3.87)     0.0000 (1.0)      19.0014 (3.87)     0.0000 (1.0)           0;0  0.0526 (0.26)          1           1
test_data_status-data-new[3.60.1]      4.9128 (1.0)       4.9128 (1.0)       4.9128 (1.0)      0.0000 (1.0)       4.9128 (1.0)      0.0000 (1.0)           0;0  0.2036 (1.0)           1           1
test_data_status-data-new[main]        5.0862 (1.04)      5.0862 (1.04)      5.0862 (1.04)     0.0000 (1.0)       5.0862 (1.04)     0.0000 (1.0)           0;0  0.1966 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.1890 (1.81)     4.1890 (1.81)     4.1890 (1.81)     0.0000 (1.0)      4.1890 (1.81)     0.0000 (1.0)           0;0  0.2387 (0.55)          1           1
test_data_status-data-noop[3.10.0]     4.7956 (2.07)     4.7956 (2.07)     4.7956 (2.07)     0.0000 (1.0)      4.7956 (2.07)     0.0000 (1.0)           0;0  0.2085 (0.48)          1           1
test_data_status-data-noop[3.53.2]     4.7084 (2.03)     4.7084 (2.03)     4.7084 (2.03)     0.0000 (1.0)      4.7084 (2.03)     0.0000 (1.0)           0;0  0.2124 (0.49)          1           1
test_data_status-data-noop[3.60.1]     2.3202 (1.0)      2.3202 (1.0)      2.3202 (1.0)      0.0000 (1.0)      2.3202 (1.0)      0.0000 (1.0)           0;0  0.4310 (1.0)           1           1
test_data_status-data-noop[main]       2.6036 (1.12)     2.6036 (1.12)     2.6036 (1.12)     0.0000 (1.0)      2.6036 (1.12)     0.0000 (1.0)           0;0  0.3841 (0.89)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     7.3851 (1.32)     7.3851 (1.32)     7.3851 (1.32)     0.0000 (1.0)      7.3851 (1.32)     0.0000 (1.0)           0;0  0.1354 (0.76)          1           1
test_data_status_all_flags-data-changed[3.10.0]     7.8948 (1.41)     7.8948 (1.41)     7.8948 (1.41)     0.0000 (1.0)      7.8948 (1.41)     0.0000 (1.0)           0;0  0.1267 (0.71)          1           1
test_data_status_all_flags-data-changed[3.53.2]     7.8588 (1.41)     7.8588 (1.41)     7.8588 (1.41)     0.0000 (1.0)      7.8588 (1.41)     0.0000 (1.0)           0;0  0.1272 (0.71)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.5835 (1.0)      5.5835 (1.0)      5.5835 (1.0)      0.0000 (1.0)      5.5835 (1.0)      0.0000 (1.0)           0;0  0.1791 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       5.9962 (1.07)     5.9962 (1.07)     5.9962 (1.07)     0.0000 (1.0)      5.9962 (1.07)     0.0000 (1.0)           0;0  0.1668 (0.93)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     7.4252 (1.32)     7.4252 (1.32)     7.4252 (1.32)     0.0000 (1.0)      7.4252 (1.32)     0.0000 (1.0)           0;0  0.1347 (0.76)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     7.9173 (1.41)     7.9173 (1.41)     7.9173 (1.41)     0.0000 (1.0)      7.9173 (1.41)     0.0000 (1.0)           0;0  0.1263 (0.71)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     7.7407 (1.38)     7.7407 (1.38)     7.7407 (1.38)     0.0000 (1.0)      7.7407 (1.38)     0.0000 (1.0)           0;0  0.1292 (0.73)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     5.6221 (1.0)      5.6221 (1.0)      5.6221 (1.0)      0.0000 (1.0)      5.6221 (1.0)      0.0000 (1.0)           0;0  0.1779 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       6.0489 (1.08)     6.0489 (1.08)     6.0489 (1.08)     0.0000 (1.0)      6.0489 (1.08)     0.0000 (1.0)           0;0  0.1653 (0.93)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     21.0072 (2.65)     21.0072 (2.65)     21.0072 (2.65)     0.0000 (1.0)      21.0072 (2.65)     0.0000 (1.0)           0;0  0.0476 (0.38)          1           1
test_data_status_all_flags-data-new[3.10.0]     21.9221 (2.76)     21.9221 (2.76)     21.9221 (2.76)     0.0000 (1.0)      21.9221 (2.76)     0.0000 (1.0)           0;0  0.0456 (0.36)          1           1
test_data_status_all_flags-data-new[3.53.2]     21.6439 (2.73)     21.6439 (2.73)     21.6439 (2.73)     0.0000 (1.0)      21.6439 (2.73)     0.0000 (1.0)           0;0  0.0462 (0.37)          1           1
test_data_status_all_flags-data-new[3.60.1]      7.9397 (1.0)       7.9397 (1.0)       7.9397 (1.0)      0.0000 (1.0)       7.9397 (1.0)      0.0000 (1.0)           0;0  0.1259 (1.0)           1           1
test_data_status_all_flags-data-new[main]        8.5182 (1.07)      8.5182 (1.07)      8.5182 (1.07)     0.0000 (1.0)       8.5182 (1.07)     0.0000 (1.0)           0;0  0.1174 (0.93)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     6.6602 (1.35)     6.6602 (1.35)     6.6602 (1.35)     0.0000 (1.0)      6.6602 (1.35)     0.0000 (1.0)           0;0  0.1501 (0.74)          1           1
test_data_status_all_flags-data-noop[3.10.0]     7.3654 (1.50)     7.3654 (1.50)     7.3654 (1.50)     0.0000 (1.0)      7.3654 (1.50)     0.0000 (1.0)           0;0  0.1358 (0.67)          1           1
test_data_status_all_flags-data-noop[3.53.2]     7.0260 (1.43)     7.0260 (1.43)     7.0260 (1.43)     0.0000 (1.0)      7.0260 (1.43)     0.0000 (1.0)           0;0  0.1423 (0.70)          1           1
test_data_status_all_flags-data-noop[3.60.1]     4.9178 (1.0)      4.9178 (1.0)      4.9178 (1.0)      0.0000 (1.0)      4.9178 (1.0)      0.0000 (1.0)           0;0  0.2033 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       5.3245 (1.08)     5.3245 (1.08)     5.3245 (1.08)     0.0000 (1.0)      5.3245 (1.08)     0.0000 (1.0)           0;0  0.1878 (0.92)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     18.3333 (2.70)     18.3333 (2.70)     18.3333 (2.70)     0.0000 (1.0)      18.3333 (2.70)     0.0000 (1.0)           0;0  0.0545 (0.37)          1           1
test_diff-diff[3.10.0]     19.1978 (2.83)     19.1978 (2.83)     19.1978 (2.83)     0.0000 (1.0)      19.1978 (2.83)     0.0000 (1.0)           0;0  0.0521 (0.35)          1           1
test_diff-diff[3.53.2]     18.9970 (2.80)     18.9970 (2.80)     18.9970 (2.80)     0.0000 (1.0)      18.9970 (2.80)     0.0000 (1.0)           0;0  0.0526 (0.36)          1           1
test_diff-diff[3.60.1]      6.7890 (1.0)       6.7890 (1.0)       6.7890 (1.0)      0.0000 (1.0)       6.7890 (1.0)      0.0000 (1.0)           0;0  0.1473 (1.0)           1           1
test_diff-diff[main]        7.6526 (1.13)      7.6526 (1.13)      7.6526 (1.13)     0.0000 (1.0)       7.6526 (1.13)     0.0000 (1.0)           0;0  0.1307 (0.89)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     6.0699 (1.83)     6.0699 (1.83)     6.0699 (1.83)     0.0000 (1.0)      6.0699 (1.83)     0.0000 (1.0)           0;0  0.1647 (0.55)          1           1
test_diff-diff-changed[3.10.0]     6.7101 (2.03)     6.7101 (2.03)     6.7101 (2.03)     0.0000 (1.0)      6.7101 (2.03)     0.0000 (1.0)           0;0  0.1490 (0.49)          1           1
test_diff-diff-changed[3.53.2]     5.5953 (1.69)     5.5953 (1.69)     5.5953 (1.69)     0.0000 (1.0)      5.5953 (1.69)     0.0000 (1.0)           0;0  0.1787 (0.59)          1           1
test_diff-diff-changed[3.60.1]     3.3119 (1.0)      3.3119 (1.0)      3.3119 (1.0)      0.0000 (1.0)      3.3119 (1.0)      0.0000 (1.0)           0;0  0.3019 (1.0)           1           1
test_diff-diff-changed[main]       4.1423 (1.25)     4.1423 (1.25)     4.1423 (1.25)     0.0000 (1.0)      4.1423 (1.25)     0.0000 (1.0)           0;0  0.2414 (0.80)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.2707 (1.59)     5.2707 (1.59)     5.2707 (1.59)     0.0000 (1.0)      5.2707 (1.59)     0.0000 (1.0)           0;0  0.1897 (0.63)          1           1
test_diff-diff-changed-noop[3.10.0]     5.6599 (1.70)     5.6599 (1.70)     5.6599 (1.70)     0.0000 (1.0)      5.6599 (1.70)     0.0000 (1.0)           0;0  0.1767 (0.59)          1           1
test_diff-diff-changed-noop[3.53.2]     5.4313 (1.64)     5.4313 (1.64)     5.4313 (1.64)     0.0000 (1.0)      5.4313 (1.64)     0.0000 (1.0)           0;0  0.1841 (0.61)          1           1
test_diff-diff-changed-noop[3.60.1]     3.3197 (1.0)      3.3197 (1.0)      3.3197 (1.0)      0.0000 (1.0)      3.3197 (1.0)      0.0000 (1.0)           0;0  0.3012 (1.0)           1           1
test_diff-diff-changed-noop[main]       4.1229 (1.24)     4.1229 (1.24)     4.1229 (1.24)     0.0000 (1.0)      4.1229 (1.24)     0.0000 (1.0)           0;0  0.2426 (0.81)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.0395 (1.22)     4.0395 (1.22)     4.0395 (1.22)     0.0000 (1.0)      4.0395 (1.22)     0.0000 (1.0)           0;0  0.2476 (0.82)          1           1
test_diff-diff-noop[3.10.0]     4.8354 (1.46)     4.8354 (1.46)     4.8354 (1.46)     0.0000 (1.0)      4.8354 (1.46)     0.0000 (1.0)           0;0  0.2068 (0.68)          1           1
test_diff-diff-noop[3.53.2]     5.5636 (1.68)     5.5636 (1.68)     5.5636 (1.68)     0.0000 (1.0)      5.5636 (1.68)     0.0000 (1.0)           0;0  0.1797 (0.59)          1           1
test_diff-diff-noop[3.60.1]     3.3086 (1.0)      3.3086 (1.0)      3.3086 (1.0)      0.0000 (1.0)      3.3086 (1.0)      0.0000 (1.0)           0;0  0.3022 (1.0)           1           1
test_diff-diff-noop[main]       4.1444 (1.25)     4.1444 (1.25)     4.1444 (1.25)     0.0000 (1.0)      4.1444 (1.25)     0.0000 (1.0)           0;0  0.2413 (0.80)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 5 tests ----------------------------------------------------------------------------------
Name (time in ms)                     Min                    Max                   Mean            StdDev                 Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]        975.5659 (1.0)         975.5659 (1.0)         975.5659 (1.0)      0.0000 (1.0)         975.5659 (1.0)      0.0000 (1.0)           0;0  1.0250 (1.0)           1           1
test_exp_show-exp[3.10.0]     11,357.4591 (11.64)    11,357.4591 (11.64)    11,357.4591 (11.64)    0.0000 (1.0)      11,357.4591 (11.64)    0.0000 (1.0)           0;0  0.0880 (0.09)          1           1
test_exp_show-exp[3.53.2]      6,151.5134 (6.31)      6,151.5134 (6.31)      6,151.5134 (6.31)     0.0000 (1.0)       6,151.5134 (6.31)     0.0000 (1.0)           0;0  0.1626 (0.16)          1           1
test_exp_show-exp[3.60.1]      6,043.9797 (6.20)      6,043.9797 (6.20)      6,043.9797 (6.20)     0.0000 (1.0)       6,043.9797 (6.20)     0.0000 (1.0)           0;0  0.1655 (0.16)          1           1
test_exp_show-exp[main]       12,382.6621 (12.69)    12,382.6621 (12.69)    12,382.6621 (12.69)    0.0000 (1.0)      12,382.6621 (12.69)    0.0000 (1.0)           0;0  0.0808 (0.08)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     66.3019 (2.82)     66.3019 (2.82)     66.3019 (2.82)     0.0000 (1.0)      66.3019 (2.82)     0.0000 (1.0)           0;0  0.0151 (0.35)          1           1
test_fetch-fetch[3.10.0]     71.6496 (3.04)     71.6496 (3.04)     71.6496 (3.04)     0.0000 (1.0)      71.6496 (3.04)     0.0000 (1.0)           0;0  0.0140 (0.33)          1           1
test_fetch-fetch[3.53.2]     33.9825 (1.44)     33.9825 (1.44)     33.9825 (1.44)     0.0000 (1.0)      33.9825 (1.44)     0.0000 (1.0)           0;0  0.0294 (0.69)          1           1
test_fetch-fetch[3.60.1]     23.5336 (1.0)      23.5336 (1.0)      23.5336 (1.0)      0.0000 (1.0)      23.5336 (1.0)      0.0000 (1.0)           0;0  0.0425 (1.0)           1           1
test_fetch-fetch[main]       23.6147 (1.00)     23.6147 (1.00)     23.6147 (1.00)     0.0000 (1.0)      23.6147 (1.00)     0.0000 (1.0)           0;0  0.0423 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.8293 (1.0)      2.8293 (1.0)      2.8293 (1.0)      0.0000 (1.0)      2.8293 (1.0)      0.0000 (1.0)           0;0  0.3534 (1.0)           1           1
test_gc-gc[3.10.0]     2.9636 (1.05)     2.9636 (1.05)     2.9636 (1.05)     0.0000 (1.0)      2.9636 (1.05)     0.0000 (1.0)           0;0  0.3374 (0.95)          1           1
test_gc-gc[3.53.2]     2.8327 (1.00)     2.8327 (1.00)     2.8327 (1.00)     0.0000 (1.0)      2.8327 (1.00)     0.0000 (1.0)           0;0  0.3530 (1.00)          1           1
test_gc-gc[3.60.1]     2.8368 (1.00)     2.8368 (1.00)     2.8368 (1.00)     0.0000 (1.0)      2.8368 (1.00)     0.0000 (1.0)           0;0  0.3525 (1.00)          1           1
test_gc-gc[main]       2.8396 (1.00)     2.8396 (1.00)     2.8396 (1.00)     0.0000 (1.0)      2.8396 (1.00)     0.0000 (1.0)           0;0  0.3522 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     132.4494 (2.67)     132.4494 (2.67)     132.4494 (2.67)     0.0000 (1.0)      132.4494 (2.67)     0.0000 (1.0)           0;0  0.0076 (0.37)          1           1
test_get-get[3.10.0]     161.2883 (3.25)     161.2883 (3.25)     161.2883 (3.25)     0.0000 (1.0)      161.2883 (3.25)     0.0000 (1.0)           0;0  0.0062 (0.31)          1           1
test_get-get[3.53.2]     141.4166 (2.85)     141.4166 (2.85)     141.4166 (2.85)     0.0000 (1.0)      141.4166 (2.85)     0.0000 (1.0)           0;0  0.0071 (0.35)          1           1
test_get-get[3.60.1]      49.5838 (1.0)       49.5838 (1.0)       49.5838 (1.0)      0.0000 (1.0)       49.5838 (1.0)      0.0000 (1.0)           0;0  0.0202 (1.0)           1           1
test_get-get[main]        49.8598 (1.01)      49.8598 (1.01)      49.8598 (1.01)     0.0000 (1.0)       49.8598 (1.01)     0.0000 (1.0)           0;0  0.0201 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     36.1211 (4.08)     36.1211 (4.08)     36.1211 (4.08)     0.0000 (1.0)      36.1211 (4.08)     0.0000 (1.0)           0;0  0.0277 (0.24)          1           1
test_get_url-get-url[3.10.0]     39.0392 (4.41)     39.0392 (4.41)     39.0392 (4.41)     0.0000 (1.0)      39.0392 (4.41)     0.0000 (1.0)           0;0  0.0256 (0.23)          1           1
test_get_url-get-url[3.53.2]      8.8471 (1.0)       8.8471 (1.0)       8.8471 (1.0)      0.0000 (1.0)       8.8471 (1.0)      0.0000 (1.0)           0;0  0.1130 (1.0)           1           1
test_get_url-get-url[3.60.1]      8.8872 (1.00)      8.8872 (1.00)      8.8872 (1.00)     0.0000 (1.0)       8.8872 (1.00)     0.0000 (1.0)           0;0  0.1125 (1.00)          1           1
test_get_url-get-url[main]        9.0348 (1.02)      9.0348 (1.02)      9.0348 (1.02)     0.0000 (1.0)       9.0348 (1.02)     0.0000 (1.0)           0;0  0.1107 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     124.4030 (1.06)     129.7852 (1.01)     126.8375 (1.06)     1.1868 (1.0)      126.7832 (1.07)     1.6742 (1.15)         36;0  7.8841 (0.94)        100           1
test_help---help[3.10.0]     122.6067 (1.05)     129.0720 (1.0)      125.0225 (1.04)     1.3224 (1.11)     124.9692 (1.05)     1.4561 (1.0)          30;4  7.9986 (0.96)        100           1
test_help---help[3.53.2]     124.6092 (1.07)     143.3577 (1.11)     127.7855 (1.07)     2.3009 (1.94)     127.3321 (1.07)     2.2036 (1.51)         13;4  7.8256 (0.94)        100           1
test_help---help[3.60.1]     125.1512 (1.07)     131.7710 (1.02)     127.7330 (1.07)     1.3885 (1.17)     127.5737 (1.07)     1.5461 (1.06)         26;4  7.8288 (0.94)        100           1
test_help---help[main]       116.8364 (1.0)      146.6087 (1.14)     119.8007 (1.0)      4.4608 (3.76)     118.8034 (1.0)      2.0052 (1.38)          6;9  8.3472 (1.0)         100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     223.9732 (2.92)     223.9732 (2.92)     223.9732 (2.92)     0.0000 (1.0)      223.9732 (2.92)     0.0000 (1.0)           0;0  0.0045 (0.34)          1           1
test_import-import[3.10.0]     254.9081 (3.32)     254.9081 (3.32)     254.9081 (3.32)     0.0000 (1.0)      254.9081 (3.32)     0.0000 (1.0)           0;0  0.0039 (0.30)          1           1
test_import-import[3.60.1]      76.7474 (1.0)       76.7474 (1.0)       76.7474 (1.0)      0.0000 (1.0)       76.7474 (1.0)      0.0000 (1.0)           0;0  0.0130 (1.0)           1           1
test_import-import[main]        77.9067 (1.02)      77.9067 (1.02)      77.9067 (1.02)     0.0000 (1.0)       77.9067 (1.02)     0.0000 (1.0)           0;0  0.0128 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     153.9990 (3.32)     153.9990 (3.32)     153.9990 (3.32)     0.0000 (1.0)      153.9990 (3.32)     0.0000 (1.0)           0;0  0.0065 (0.30)          1           1
test_import_url-import-url[3.10.0]     155.9832 (3.36)     155.9832 (3.36)     155.9832 (3.36)     0.0000 (1.0)      155.9832 (3.36)     0.0000 (1.0)           0;0  0.0064 (0.30)          1           1
test_import_url-import-url[3.53.2]     115.3164 (2.49)     115.3164 (2.49)     115.3164 (2.49)     0.0000 (1.0)      115.3164 (2.49)     0.0000 (1.0)           0;0  0.0087 (0.40)          1           1
test_import_url-import-url[3.60.1]      46.3937 (1.0)       46.3937 (1.0)       46.3937 (1.0)      0.0000 (1.0)       46.3937 (1.0)      0.0000 (1.0)           0;0  0.0216 (1.0)           1           1
test_import_url-import-url[main]        48.0695 (1.04)      48.0695 (1.04)      48.0695 (1.04)     0.0000 (1.0)       48.0695 (1.04)     0.0000 (1.0)           0;0  0.0208 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     391.5567 (1.00)     417.6502 (1.01)     403.7439 (1.01)      5.4872 (1.06)     403.4902 (1.01)      6.6592 (1.09)         31;2  2.4768 (0.99)        100           1
test_init-init[3.10.0]     400.9606 (1.03)     432.6047 (1.04)     414.5568 (1.03)      6.9482 (1.35)     413.0599 (1.03)      8.6390 (1.41)         31;1  2.4122 (0.97)        100           1
test_init-init[3.53.2]     392.2447 (1.00)     414.6385 (1.0)      400.7592 (1.0)       5.1659 (1.0)      399.3552 (1.0)       7.6193 (1.25)         37;0  2.4953 (1.0)         100           1
test_init-init[3.60.1]     390.3793 (1.0)      420.1965 (1.01)     402.4468 (1.00)      5.7543 (1.11)     401.7296 (1.01)      6.1114 (1.0)          26;5  2.4848 (1.00)        100           1
test_init-init[main]       421.1905 (1.08)     627.3917 (1.51)     436.7075 (1.09)     21.4823 (4.16)     433.1770 (1.08)     10.2682 (1.68)          4;4  2.2899 (0.92)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     590.9450 (1.11)     590.9450 (1.11)     590.9450 (1.11)     0.0000 (1.0)      590.9450 (1.11)     0.0000 (1.0)           0;0  1.6922 (0.90)          1           1
test_list-list[3.10.0]     655.6552 (1.24)     655.6552 (1.24)     655.6552 (1.24)     0.0000 (1.0)      655.6552 (1.24)     0.0000 (1.0)           0;0  1.5252 (0.81)          1           1
test_list-list[3.53.2]     565.6811 (1.07)     565.6811 (1.07)     565.6811 (1.07)     0.0000 (1.0)      565.6811 (1.07)     0.0000 (1.0)           0;0  1.7678 (0.94)          1           1
test_list-list[3.60.1]     530.3255 (1.0)      530.3255 (1.0)      530.3255 (1.0)      0.0000 (1.0)      530.3255 (1.0)      0.0000 (1.0)           0;0  1.8856 (1.0)           1           1
test_list-list[main]       542.2523 (1.02)     542.2523 (1.02)     542.2523 (1.02)     0.0000 (1.0)      542.2523 (1.02)     0.0000 (1.0)           0;0  1.8442 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     431.4246 (1.10)     431.4246 (1.10)     431.4246 (1.10)     0.0000 (1.0)      431.4246 (1.10)     0.0000 (1.0)           0;0  2.3179 (0.91)          1           1
test_list-list-dvc-only[3.10.0]     413.2214 (1.05)     413.2214 (1.05)     413.2214 (1.05)     0.0000 (1.0)      413.2214 (1.05)     0.0000 (1.0)           0;0  2.4200 (0.95)          1           1
test_list-list-dvc-only[3.53.2]     393.1663 (1.0)      393.1663 (1.0)      393.1663 (1.0)      0.0000 (1.0)      393.1663 (1.0)      0.0000 (1.0)           0;0  2.5435 (1.0)           1           1
test_list-list-dvc-only[3.60.1]     398.8957 (1.01)     398.8957 (1.01)     398.8957 (1.01)     0.0000 (1.0)      398.8957 (1.01)     0.0000 (1.0)           0;0  2.5069 (0.99)          1           1
test_list-list-dvc-only[main]       396.2065 (1.01)     396.2065 (1.01)     396.2065 (1.01)     0.0000 (1.0)      396.2065 (1.01)     0.0000 (1.0)           0;0  2.5239 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.7185 (1.0)      2.7185 (1.0)      2.7185 (1.0)      0.0000 (1.0)      2.7185 (1.0)      0.0000 (1.0)           0;0  0.3679 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.7558 (1.01)     2.7558 (1.01)     2.7558 (1.01)     0.0000 (1.0)      2.7558 (1.01)     0.0000 (1.0)           0;0  0.3629 (0.99)          1           1
test_list-list-recursive[3.53.2]     2.8030 (1.03)     2.8030 (1.03)     2.8030 (1.03)     0.0000 (1.0)      2.8030 (1.03)     0.0000 (1.0)           0;0  0.3568 (0.97)          1           1
test_list-list-recursive[3.60.1]     2.7643 (1.02)     2.7643 (1.02)     2.7643 (1.02)     0.0000 (1.0)      2.7643 (1.02)     0.0000 (1.0)           0;0  0.3618 (0.98)          1           1
test_list-list-recursive[main]       2.8414 (1.05)     2.8414 (1.05)     2.8414 (1.05)     0.0000 (1.0)      2.8414 (1.05)     0.0000 (1.0)           0;0  0.3519 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     424.1544 (1.08)     424.1544 (1.08)     424.1544 (1.08)     0.0000 (1.0)      424.1544 (1.08)     0.0000 (1.0)           0;0  2.3576 (0.92)          1           1
test_list-list-shallow[3.10.0]     421.6679 (1.08)     421.6679 (1.08)     421.6679 (1.08)     0.0000 (1.0)      421.6679 (1.08)     0.0000 (1.0)           0;0  2.3715 (0.93)          1           1
test_list-list-shallow[3.53.2]     392.9414 (1.00)     392.9414 (1.00)     392.9414 (1.00)     0.0000 (1.0)      392.9414 (1.00)     0.0000 (1.0)           0;0  2.5449 (1.00)          1           1
test_list-list-shallow[3.60.1]     391.9496 (1.0)      391.9496 (1.0)      391.9496 (1.0)      0.0000 (1.0)      391.9496 (1.0)      0.0000 (1.0)           0;0  2.5513 (1.0)           1           1
test_list-list-shallow[main]       401.3843 (1.02)     401.3843 (1.02)     401.3843 (1.02)     0.0000 (1.0)      401.3843 (1.02)     0.0000 (1.0)           0;0  2.4914 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     72.6322 (3.69)     72.6322 (3.69)     72.6322 (3.69)     0.0000 (1.0)      72.6322 (3.69)     0.0000 (1.0)           0;0  0.0138 (0.27)          1           1
test_partial_add-add[3.10.0]     74.8752 (3.81)     74.8752 (3.81)     74.8752 (3.81)     0.0000 (1.0)      74.8752 (3.81)     0.0000 (1.0)           0;0  0.0134 (0.26)          1           1
test_partial_add-add[3.53.2]     65.4229 (3.33)     65.4229 (3.33)     65.4229 (3.33)     0.0000 (1.0)      65.4229 (3.33)     0.0000 (1.0)           0;0  0.0153 (0.30)          1           1
test_partial_add-add[3.60.1]     19.6663 (1.0)      19.6663 (1.0)      19.6663 (1.0)      0.0000 (1.0)      19.6663 (1.0)      0.0000 (1.0)           0;0  0.0508 (1.0)           1           1
test_partial_add-add[main]       20.6802 (1.05)     20.6802 (1.05)     20.6802 (1.05)     0.0000 (1.0)      20.6802 (1.05)     0.0000 (1.0)           0;0  0.0484 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     60.3354 (7.70)     60.3354 (7.70)     60.3354 (7.70)     0.0000 (1.0)      60.3354 (7.70)     0.0000 (1.0)           0;0  0.0166 (0.13)          1           1
test_partial_add-add-partial[3.10.0]     62.6827 (8.00)     62.6827 (8.00)     62.6827 (8.00)     0.0000 (1.0)      62.6827 (8.00)     0.0000 (1.0)           0;0  0.0160 (0.13)          1           1
test_partial_add-add-partial[3.53.2]     55.1510 (7.03)     55.1510 (7.03)     55.1510 (7.03)     0.0000 (1.0)      55.1510 (7.03)     0.0000 (1.0)           0;0  0.0181 (0.14)          1           1
test_partial_add-add-partial[3.60.1]      7.8400 (1.0)       7.8400 (1.0)       7.8400 (1.0)      0.0000 (1.0)       7.8400 (1.0)      0.0000 (1.0)           0;0  0.1276 (1.0)           1           1
test_partial_add-add-partial[main]        7.9111 (1.01)      7.9111 (1.01)      7.9111 (1.01)     0.0000 (1.0)       7.9111 (1.01)     0.0000 (1.0)           0;0  0.1264 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.4460 (1.0)      4.4460 (1.0)      4.4460 (1.0)      0.0000 (1.0)      4.4460 (1.0)      0.0000 (1.0)           0;0  0.2249 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     5.7999 (1.30)     5.7999 (1.30)     5.7999 (1.30)     0.0000 (1.0)      5.7999 (1.30)     0.0000 (1.0)           0;0  0.1724 (0.77)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     6.6564 (1.50)     6.6564 (1.50)     6.6564 (1.50)     0.0000 (1.0)      6.6564 (1.50)     0.0000 (1.0)           0;0  0.1502 (0.67)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     6.4496 (1.45)     6.4496 (1.45)     6.4496 (1.45)     0.0000 (1.0)      6.4496 (1.45)     0.0000 (1.0)           0;0  0.1550 (0.69)          1           1
test_partial_add-gc-cloud-noop[main]       6.6013 (1.48)     6.6013 (1.48)     6.6013 (1.48)     0.0000 (1.0)      6.6013 (1.48)     0.0000 (1.0)           0;0  0.1515 (0.67)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.4312 (1.0)      2.4312 (1.0)      2.4312 (1.0)      0.0000 (1.0)      2.4312 (1.0)      0.0000 (1.0)           0;0  0.4113 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.7191 (1.53)     3.7191 (1.53)     3.7191 (1.53)     0.0000 (1.0)      3.7191 (1.53)     0.0000 (1.0)           0;0  0.2689 (0.65)          1           1
test_partial_add-gc-noop[3.53.2]     3.6533 (1.50)     3.6533 (1.50)     3.6533 (1.50)     0.0000 (1.0)      3.6533 (1.50)     0.0000 (1.0)           0;0  0.2737 (0.67)          1           1
test_partial_add-gc-noop[3.60.1]     3.7000 (1.52)     3.7000 (1.52)     3.7000 (1.52)     0.0000 (1.0)      3.7000 (1.52)     0.0000 (1.0)           0;0  0.2703 (0.66)          1           1
test_partial_add-gc-noop[main]       3.7107 (1.53)     3.7107 (1.53)     3.7107 (1.53)     0.0000 (1.0)      3.7107 (1.53)     0.0000 (1.0)           0;0  0.2695 (0.66)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     43.7997 (2.27)     43.7997 (2.27)     43.7997 (2.27)     0.0000 (1.0)      43.7997 (2.27)     0.0000 (1.0)           0;0  0.0228 (0.44)          1           1
test_partial_add-push[3.10.0]     39.7166 (2.06)     39.7166 (2.06)     39.7166 (2.06)     0.0000 (1.0)      39.7166 (2.06)     0.0000 (1.0)           0;0  0.0252 (0.49)          1           1
test_partial_add-push[3.53.2]     19.3426 (1.00)     19.3426 (1.00)     19.3426 (1.00)     0.0000 (1.0)      19.3426 (1.00)     0.0000 (1.0)           0;0  0.0517 (1.00)          1           1
test_partial_add-push[3.60.1]     19.3087 (1.00)     19.3087 (1.00)     19.3087 (1.00)     0.0000 (1.0)      19.3087 (1.00)     0.0000 (1.0)           0;0  0.0518 (1.00)          1           1
test_partial_add-push[main]       19.2931 (1.0)      19.2931 (1.0)      19.2931 (1.0)      0.0000 (1.0)      19.2931 (1.0)      0.0000 (1.0)           0;0  0.0518 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     11.2807 (1.12)     11.2807 (1.12)     11.2807 (1.12)     0.0000 (1.0)      11.2807 (1.12)     0.0000 (1.0)           0;0  0.0886 (0.90)          1           1
test_partial_add-push-partial[3.10.0]     10.7866 (1.07)     10.7866 (1.07)     10.7866 (1.07)     0.0000 (1.0)      10.7866 (1.07)     0.0000 (1.0)           0;0  0.0927 (0.94)          1           1
test_partial_add-push-partial[3.53.2]     10.7247 (1.06)     10.7247 (1.06)     10.7247 (1.06)     0.0000 (1.0)      10.7247 (1.06)     0.0000 (1.0)           0;0  0.0932 (0.94)          1           1
test_partial_add-push-partial[3.60.1]     10.1375 (1.00)     10.1375 (1.00)     10.1375 (1.00)     0.0000 (1.0)      10.1375 (1.00)     0.0000 (1.0)           0;0  0.0986 (1.00)          1           1
test_partial_add-push-partial[main]       10.1080 (1.0)      10.1080 (1.0)      10.1080 (1.0)      0.0000 (1.0)      10.1080 (1.0)      0.0000 (1.0)           0;0  0.0989 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     83.7022 (3.71)     83.7022 (3.71)     83.7022 (3.71)     0.0000 (1.0)      83.7022 (3.71)     0.0000 (1.0)           0;0  0.0119 (0.27)          1           1
test_partial_remove-add[3.10.0]     84.9119 (3.76)     84.9119 (3.76)     84.9119 (3.76)     0.0000 (1.0)      84.9119 (3.76)     0.0000 (1.0)           0;0  0.0118 (0.27)          1           1
test_partial_remove-add[3.53.2]     75.6129 (3.35)     75.6129 (3.35)     75.6129 (3.35)     0.0000 (1.0)      75.6129 (3.35)     0.0000 (1.0)           0;0  0.0132 (0.30)          1           1
test_partial_remove-add[3.60.1]     22.5581 (1.0)      22.5581 (1.0)      22.5581 (1.0)      0.0000 (1.0)      22.5581 (1.0)      0.0000 (1.0)           0;0  0.0443 (1.0)           1           1
test_partial_remove-add[main]       23.7692 (1.05)     23.7692 (1.05)     23.7692 (1.05)     0.0000 (1.0)      23.7692 (1.05)     0.0000 (1.0)           0;0  0.0421 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     8.2145 (8.00)     8.2145 (8.00)     8.2145 (8.00)     0.0000 (1.0)      8.2145 (8.00)     0.0000 (1.0)           0;0  0.1217 (0.13)          1           1
test_partial_remove-add-update[3.10.0]     8.7156 (8.48)     8.7156 (8.48)     8.7156 (8.48)     0.0000 (1.0)      8.7156 (8.48)     0.0000 (1.0)           0;0  0.1147 (0.12)          1           1
test_partial_remove-add-update[3.53.2]     7.6511 (7.45)     7.6511 (7.45)     7.6511 (7.45)     0.0000 (1.0)      7.6511 (7.45)     0.0000 (1.0)           0;0  0.1307 (0.13)          1           1
test_partial_remove-add-update[3.60.1]     1.0274 (1.0)      1.0274 (1.0)      1.0274 (1.0)      0.0000 (1.0)      1.0274 (1.0)      0.0000 (1.0)           0;0  0.9734 (1.0)           1           1
test_partial_remove-add-update[main]       1.0575 (1.03)     1.0575 (1.03)     1.0575 (1.03)     0.0000 (1.0)      1.0575 (1.03)     0.0000 (1.0)           0;0  0.9457 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     3.1282 (1.0)      3.1282 (1.0)      3.1282 (1.0)      0.0000 (1.0)      3.1282 (1.0)      0.0000 (1.0)           0;0  0.3197 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.4765 (1.11)     3.4765 (1.11)     3.4765 (1.11)     0.0000 (1.0)      3.4765 (1.11)     0.0000 (1.0)           0;0  0.2876 (0.90)          1           1
test_partial_remove-gc[3.53.2]     3.4888 (1.12)     3.4888 (1.12)     3.4888 (1.12)     0.0000 (1.0)      3.4888 (1.12)     0.0000 (1.0)           0;0  0.2866 (0.90)          1           1
test_partial_remove-gc[3.60.1]     3.7191 (1.19)     3.7191 (1.19)     3.7191 (1.19)     0.0000 (1.0)      3.7191 (1.19)     0.0000 (1.0)           0;0  0.2689 (0.84)          1           1
test_partial_remove-gc[main]       3.5910 (1.15)     3.5910 (1.15)     3.5910 (1.15)     0.0000 (1.0)      3.5910 (1.15)     0.0000 (1.0)           0;0  0.2785 (0.87)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     4.8306 (1.01)     4.8306 (1.01)     4.8306 (1.01)     0.0000 (1.0)      4.8306 (1.01)     0.0000 (1.0)           0;0  0.2070 (0.99)          1           1
test_partial_remove-gc-cloud[3.10.0]     5.2306 (1.09)     5.2306 (1.09)     5.2306 (1.09)     0.0000 (1.0)      5.2306 (1.09)     0.0000 (1.0)           0;0  0.1912 (0.91)          1           1
test_partial_remove-gc-cloud[3.53.2]     5.0788 (1.06)     5.0788 (1.06)     5.0788 (1.06)     0.0000 (1.0)      5.0788 (1.06)     0.0000 (1.0)           0;0  0.1969 (0.94)          1           1
test_partial_remove-gc-cloud[3.60.1]     4.8214 (1.01)     4.8214 (1.01)     4.8214 (1.01)     0.0000 (1.0)      4.8214 (1.01)     0.0000 (1.0)           0;0  0.2074 (0.99)          1           1
test_partial_remove-gc-cloud[main]       4.7846 (1.0)      4.7846 (1.0)      4.7846 (1.0)      0.0000 (1.0)      4.7846 (1.0)      0.0000 (1.0)           0;0  0.2090 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     51.8697 (2.37)     51.8697 (2.37)     51.8697 (2.37)     0.0000 (1.0)      51.8697 (2.37)     0.0000 (1.0)           0;0  0.0193 (0.42)          1           1
test_partial_remove-push[3.10.0]     46.8302 (2.14)     46.8302 (2.14)     46.8302 (2.14)     0.0000 (1.0)      46.8302 (2.14)     0.0000 (1.0)           0;0  0.0214 (0.47)          1           1
test_partial_remove-push[3.53.2]     22.8655 (1.04)     22.8655 (1.04)     22.8655 (1.04)     0.0000 (1.0)      22.8655 (1.04)     0.0000 (1.0)           0;0  0.0437 (0.96)          1           1
test_partial_remove-push[3.60.1]     21.9479 (1.00)     21.9479 (1.00)     21.9479 (1.00)     0.0000 (1.0)      21.9479 (1.00)     0.0000 (1.0)           0;0  0.0456 (1.00)          1           1
test_partial_remove-push[main]       21.9216 (1.0)      21.9216 (1.0)      21.9216 (1.0)      0.0000 (1.0)      21.9216 (1.0)      0.0000 (1.0)           0;0  0.0456 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     1.8177 (1.01)     1.8177 (1.01)     1.8177 (1.01)     0.0000 (1.0)      1.8177 (1.01)     0.0000 (1.0)           0;0  0.5501 (0.99)          1           1
test_partial_remove-push-update[3.10.0]     1.8078 (1.0)      1.8078 (1.0)      1.8078 (1.0)      0.0000 (1.0)      1.8078 (1.0)      0.0000 (1.0)           0;0  0.5532 (1.0)           1           1
test_partial_remove-push-update[3.53.2]     2.4773 (1.37)     2.4773 (1.37)     2.4773 (1.37)     0.0000 (1.0)      2.4773 (1.37)     0.0000 (1.0)           0;0  0.4037 (0.73)          1           1
test_partial_remove-push-update[3.60.1]     2.4439 (1.35)     2.4439 (1.35)     2.4439 (1.35)     0.0000 (1.0)      2.4439 (1.35)     0.0000 (1.0)           0;0  0.4092 (0.74)          1           1
test_partial_remove-push-update[main]       2.6774 (1.48)     2.6774 (1.48)     2.6774 (1.48)     0.0000 (1.0)      2.6774 (1.48)     0.0000 (1.0)           0;0  0.3735 (0.68)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     495.2184 (1.0)      502.0393 (1.0)      497.7838 (1.0)      2.6283 (1.77)     497.3215 (1.0)       3.1953 (2.94)          1;0  2.0089 (1.0)           5           3
test_plots-plots-diff[3.10.0]     893.9532 (1.81)     914.5125 (1.82)     905.5240 (1.82)     8.6828 (5.85)     908.8439 (1.83)     14.3617 (13.22)         2;0  1.1043 (0.55)          5           3
test_plots-plots-diff[3.53.2]     817.2301 (1.65)     834.7084 (1.66)     823.1572 (1.65)     7.7240 (5.21)     818.8912 (1.65)     11.9410 (11.00)         1;0  1.2148 (0.60)          5           3
test_plots-plots-diff[3.60.1]     826.3794 (1.67)     830.4839 (1.65)     828.7668 (1.66)     1.4833 (1.0)      828.9963 (1.67)      1.0860 (1.0)           2;1  1.2066 (0.60)          5           3
test_plots-plots-diff[main]       817.3414 (1.65)     829.7225 (1.65)     823.5996 (1.65)     5.7700 (3.89)     821.5630 (1.65)     10.5961 (9.76)          3;0  1.2142 (0.60)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests --------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       510.7004 (1.0)        514.0520 (1.0)        512.4632 (1.0)      1.5058 (1.0)        513.1003 (1.0)      2.6519 (1.0)           2;0  1.9514 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,124.1223 (2.20)     1,137.4908 (2.21)     1,132.3466 (2.21)     5.4791 (3.64)     1,134.3347 (2.21)     8.2525 (3.11)          1;0  0.8831 (0.45)          5           3
test_plots-plots-diff-json[3.53.2]       897.5851 (1.76)       903.9840 (1.76)       900.8273 (1.76)     2.7941 (1.86)       902.0669 (1.76)     4.7008 (1.77)          2;0  1.1101 (0.57)          5           3
test_plots-plots-diff-json[3.60.1]       901.1423 (1.76)       913.4953 (1.78)       908.3237 (1.77)     4.6767 (3.11)       909.0562 (1.77)     6.0532 (2.28)          2;0  1.1009 (0.56)          5           3
test_plots-plots-diff-json[main]         896.2690 (1.75)       915.6175 (1.78)       905.4010 (1.77)     7.1426 (4.74)       903.6960 (1.76)     8.6903 (3.28)          2;0  1.1045 (0.57)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     412.1141 (1.0)      430.2171 (1.0)      422.0656 (1.0)      8.0869 (2.87)     422.4077 (1.0)      14.8600 (3.23)          2;0  2.3693 (1.0)           5           3
test_plots-plots-show[3.10.0]     726.2153 (1.76)     732.5972 (1.70)     729.9637 (1.73)     2.8150 (1.0)      731.5594 (1.73)      4.6046 (1.0)           1;0  1.3699 (0.58)          5           3
test_plots-plots-show[3.53.2]     705.0855 (1.71)     714.7632 (1.66)     709.8734 (1.68)     4.0266 (1.43)     710.2263 (1.68)      6.8933 (1.50)          2;0  1.4087 (0.59)          5           3
test_plots-plots-show[3.60.1]     714.3747 (1.73)     733.3615 (1.70)     722.5144 (1.71)     6.9628 (2.47)     721.4100 (1.71)      7.6520 (1.66)          2;0  1.3841 (0.58)          5           3
test_plots-plots-show[main]       701.5757 (1.70)     717.6359 (1.67)     708.6537 (1.68)     7.0314 (2.50)     707.0512 (1.67)     12.5250 (2.72)          2;0  1.4111 (0.60)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     428.7847 (1.0)      439.1717 (1.0)      433.5103 (1.0)      4.4663 (1.54)     433.4126 (1.0)      7.9053 (1.76)          2;0  2.3068 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     857.1371 (2.00)     869.2971 (1.98)     860.7978 (1.99)     5.1651 (1.78)     857.8686 (1.98)     6.5048 (1.45)          1;0  1.1617 (0.50)          5           3
test_plots-plots-show-json[3.53.2]     755.4226 (1.76)     769.7121 (1.75)     761.7777 (1.76)     5.7268 (1.97)     762.4111 (1.76)     8.8751 (1.98)          2;0  1.3127 (0.57)          5           3
test_plots-plots-show-json[3.60.1]     751.9196 (1.75)     759.1247 (1.73)     756.0569 (1.74)     2.9070 (1.0)      755.8553 (1.74)     4.4898 (1.0)           2;0  1.3227 (0.57)          5           3
test_plots-plots-show-json[main]       754.6988 (1.76)     766.9146 (1.75)     761.3270 (1.76)     5.0875 (1.75)     763.0866 (1.76)     8.3595 (1.86)          2;0  1.3135 (0.57)          5           3
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     53.1228 (2.38)     53.1228 (2.38)     53.1228 (2.38)     0.0000 (1.0)      53.1228 (2.38)     0.0000 (1.0)           0;0  0.0188 (0.42)          1           1
test_push-push[3.10.0]     46.8475 (2.10)     46.8475 (2.10)     46.8475 (2.10)     0.0000 (1.0)      46.8475 (2.10)     0.0000 (1.0)           0;0  0.0213 (0.48)          1           1
test_push-push[3.53.2]     23.0300 (1.03)     23.0300 (1.03)     23.0300 (1.03)     0.0000 (1.0)      23.0300 (1.03)     0.0000 (1.0)           0;0  0.0434 (0.97)          1           1
test_push-push[3.60.1]     22.3158 (1.0)      22.3158 (1.0)      22.3158 (1.0)      0.0000 (1.0)      22.3158 (1.0)      0.0000 (1.0)           0;0  0.0448 (1.0)           1           1
test_push-push[main]       22.5840 (1.01)     22.5840 (1.01)     22.5840 (1.01)     0.0000 (1.0)      22.5840 (1.01)     0.0000 (1.0)           0;0  0.0443 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     66.1500 (2.86)     66.1500 (2.86)     66.1500 (2.86)     0.0000 (1.0)      66.1500 (2.86)     0.0000 (1.0)           0;0  0.0151 (0.35)          1           1
test_sharing-fetch[3.10.0]     70.2457 (3.04)     70.2457 (3.04)     70.2457 (3.04)     0.0000 (1.0)      70.2457 (3.04)     0.0000 (1.0)           0;0  0.0142 (0.33)          1           1
test_sharing-fetch[3.53.2]     33.6722 (1.46)     33.6722 (1.46)     33.6722 (1.46)     0.0000 (1.0)      33.6722 (1.46)     0.0000 (1.0)           0;0  0.0297 (0.69)          1           1
test_sharing-fetch[3.60.1]     23.4005 (1.01)     23.4005 (1.01)     23.4005 (1.01)     0.0000 (1.0)      23.4005 (1.01)     0.0000 (1.0)           0;0  0.0427 (0.99)          1           1
test_sharing-fetch[main]       23.1031 (1.0)      23.1031 (1.0)      23.1031 (1.0)      0.0000 (1.0)      23.1031 (1.0)      0.0000 (1.0)           0;0  0.0433 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2289 (1.0)      1.2289 (1.0)      1.2289 (1.0)      0.0000 (1.0)      1.2289 (1.0)      0.0000 (1.0)           0;0  0.8138 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.5640 (2.90)     3.5640 (2.90)     3.5640 (2.90)     0.0000 (1.0)      3.5640 (2.90)     0.0000 (1.0)           0;0  0.2806 (0.34)          1           1
test_sharing-fetch-noop[3.53.2]     5.6827 (4.62)     5.6827 (4.62)     5.6827 (4.62)     0.0000 (1.0)      5.6827 (4.62)     0.0000 (1.0)           0;0  0.1760 (0.22)          1           1
test_sharing-fetch-noop[3.60.1]     5.8122 (4.73)     5.8122 (4.73)     5.8122 (4.73)     0.0000 (1.0)      5.8122 (4.73)     0.0000 (1.0)           0;0  0.1721 (0.21)          1           1
test_sharing-fetch-noop[main]       5.8203 (4.74)     5.8203 (4.74)     5.8203 (4.74)     0.0000 (1.0)      5.8203 (4.74)     0.0000 (1.0)           0;0  0.1718 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     54.2733 (2.46)     54.2733 (2.46)     54.2733 (2.46)     0.0000 (1.0)      54.2733 (2.46)     0.0000 (1.0)           0;0  0.0184 (0.41)          1           1
test_sharing-push[3.10.0]     48.2702 (2.19)     48.2702 (2.19)     48.2702 (2.19)     0.0000 (1.0)      48.2702 (2.19)     0.0000 (1.0)           0;0  0.0207 (0.46)          1           1
test_sharing-push[3.53.2]     23.0282 (1.04)     23.0282 (1.04)     23.0282 (1.04)     0.0000 (1.0)      23.0282 (1.04)     0.0000 (1.0)           0;0  0.0434 (0.96)          1           1
test_sharing-push[3.60.1]     22.0712 (1.0)      22.0712 (1.0)      22.0712 (1.0)      0.0000 (1.0)      22.0712 (1.0)      0.0000 (1.0)           0;0  0.0453 (1.0)           1           1
test_sharing-push[main]       22.2272 (1.01)     22.2272 (1.01)     22.2272 (1.01)     0.0000 (1.0)      22.2272 (1.01)     0.0000 (1.0)           0;0  0.0450 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.0651 (1.00)     2.0651 (1.00)     2.0651 (1.00)     0.0000 (1.0)      2.0651 (1.00)     0.0000 (1.0)           0;0  0.4842 (1.00)          1           1
test_sharing-push-noop[3.10.0]     2.0633 (1.0)      2.0633 (1.0)      2.0633 (1.0)      0.0000 (1.0)      2.0633 (1.0)      0.0000 (1.0)           0;0  0.4847 (1.0)           1           1
test_sharing-push-noop[3.53.2]     5.8523 (2.84)     5.8523 (2.84)     5.8523 (2.84)     0.0000 (1.0)      5.8523 (2.84)     0.0000 (1.0)           0;0  0.1709 (0.35)          1           1
test_sharing-push-noop[3.60.1]     6.0049 (2.91)     6.0049 (2.91)     6.0049 (2.91)     0.0000 (1.0)      6.0049 (2.91)     0.0000 (1.0)           0;0  0.1665 (0.34)          1           1
test_sharing-push-noop[main]       5.9752 (2.90)     5.9752 (2.90)     5.9752 (2.90)     0.0000 (1.0)      5.9752 (2.90)     0.0000 (1.0)           0;0  0.1674 (0.35)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     342.6662 (1.02)     342.6662 (1.02)     342.6662 (1.02)     0.0000 (1.0)      342.6662 (1.02)     0.0000 (1.0)           0;0  0.0029 (0.98)          1           1
test_sharing_azure-fetch[main]       334.8109 (1.0)      334.8109 (1.0)      334.8109 (1.0)      0.0000 (1.0)      334.8109 (1.0)      0.0000 (1.0)           0;0  0.0030 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.6458 (1.0)      6.6458 (1.0)      6.6458 (1.0)      0.0000 (1.0)      6.6458 (1.0)      0.0000 (1.0)           0;0  0.1505 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       6.6576 (1.00)     6.6576 (1.00)     6.6576 (1.00)     0.0000 (1.0)      6.6576 (1.00)     0.0000 (1.0)           0;0  0.1502 (1.00)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     346.1201 (1.00)     346.1201 (1.00)     346.1201 (1.00)     0.0000 (1.0)      346.1201 (1.00)     0.0000 (1.0)           0;0  0.0029 (1.00)          1           1
test_sharing_azure-push[main]       344.7851 (1.0)      344.7851 (1.0)      344.7851 (1.0)      0.0000 (1.0)      344.7851 (1.0)      0.0000 (1.0)           0;0  0.0029 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     7.7100 (1.0)      7.7100 (1.0)      7.7100 (1.0)      0.0000 (1.0)      7.7100 (1.0)      0.0000 (1.0)           0;0  0.1297 (1.0)           1           1
test_sharing_azure-push-noop[main]       7.9680 (1.03)     7.9680 (1.03)     7.9680 (1.03)     0.0000 (1.0)      7.9680 (1.03)     0.0000 (1.0)           0;0  0.1255 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[3.53.2]     215.0850 (1.01)     215.0850 (1.01)     215.0850 (1.01)     0.0000 (1.0)      215.0850 (1.01)     0.0000 (1.0)           0;0  0.0046 (0.99)          1           1
test_sharing_gs-fetch[main]       213.0190 (1.0)      213.0190 (1.0)      213.0190 (1.0)      0.0000 (1.0)      213.0190 (1.0)      0.0000 (1.0)           0;0  0.0047 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch-noop': 2 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[3.53.2]     12.6117 (1.0)      12.6117 (1.0)      12.6117 (1.0)      0.0000 (1.0)      12.6117 (1.0)      0.0000 (1.0)           0;0  0.0793 (1.0)           1           1
test_sharing_gs-fetch-noop[main]       13.2360 (1.05)     13.2360 (1.05)     13.2360 (1.05)     0.0000 (1.0)      13.2360 (1.05)     0.0000 (1.0)           0;0  0.0756 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[3.53.2]     507.6394 (1.0)      507.6394 (1.0)      507.6394 (1.0)      0.0000 (1.0)      507.6394 (1.0)      0.0000 (1.0)           0;0  0.0020 (1.0)           1           1
test_sharing_gs-push[main]       509.6788 (1.00)     509.6788 (1.00)     509.6788 (1.00)     0.0000 (1.0)      509.6788 (1.00)     0.0000 (1.0)           0;0  0.0020 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[3.53.2]     6.4141 (1.0)      6.4141 (1.0)      6.4141 (1.0)      0.0000 (1.0)      6.4141 (1.0)      0.0000 (1.0)           0;0  0.1559 (1.0)           1           1
test_sharing_gs-push-noop[main]       6.4827 (1.01)     6.4827 (1.01)     6.4827 (1.01)     0.0000 (1.0)      6.4827 (1.01)     0.0000 (1.0)           0;0  0.1543 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     495.3433 (1.0)      495.3433 (1.0)      495.3433 (1.0)      0.0000 (1.0)      495.3433 (1.0)      0.0000 (1.0)           0;0  0.0020 (1.0)           1           1
test_sharing_s3-fetch[main]       502.4568 (1.01)     502.4568 (1.01)     502.4568 (1.01)     0.0000 (1.0)      502.4568 (1.01)     0.0000 (1.0)           0;0  0.0020 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.3909 (1.0)      6.3909 (1.0)      6.3909 (1.0)      0.0000 (1.0)      6.3909 (1.0)      0.0000 (1.0)           0;0  0.1565 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       6.5434 (1.02)     6.5434 (1.02)     6.5434 (1.02)     0.0000 (1.0)      6.5434 (1.02)     0.0000 (1.0)           0;0  0.1528 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     664.9863 (1.02)     664.9863 (1.02)     664.9863 (1.02)     0.0000 (1.0)      664.9863 (1.02)     0.0000 (1.0)           0;0  0.0015 (0.98)          1           1
test_sharing_s3-push[main]       652.6125 (1.0)      652.6125 (1.0)      652.6125 (1.0)      0.0000 (1.0)      652.6125 (1.0)      0.0000 (1.0)           0;0  0.0015 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     6.8134 (1.0)      6.8134 (1.0)      6.8134 (1.0)      0.0000 (1.0)      6.8134 (1.0)      0.0000 (1.0)           0;0  0.1468 (1.0)           1           1
test_sharing_s3-push-noop[main]       6.9289 (1.02)     6.9289 (1.02)     6.9289 (1.02)     0.0000 (1.0)      6.9289 (1.02)     0.0000 (1.0)           0;0  0.1443 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     19.5577 (3.82)     19.5577 (3.82)     19.5577 (3.82)     0.0000 (1.0)      19.5577 (3.82)     0.0000 (1.0)           0;0  0.0511 (0.26)          1           1
test_status-status[3.10.0]     19.5074 (3.81)     19.5074 (3.81)     19.5074 (3.81)     0.0000 (1.0)      19.5074 (3.81)     0.0000 (1.0)           0;0  0.0513 (0.26)          1           1
test_status-status[3.53.2]     17.9200 (3.50)     17.9200 (3.50)     17.9200 (3.50)     0.0000 (1.0)      17.9200 (3.50)     0.0000 (1.0)           0;0  0.0558 (0.29)          1           1
test_status-status[3.60.1]      5.1260 (1.0)       5.1260 (1.0)       5.1260 (1.0)      0.0000 (1.0)       5.1260 (1.0)      0.0000 (1.0)           0;0  0.1951 (1.0)           1           1
test_status-status[main]        5.6061 (1.09)      5.6061 (1.09)      5.6061 (1.09)     0.0000 (1.0)       5.6061 (1.09)     0.0000 (1.0)           0;0  0.1784 (0.91)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.9599 (1.83)     4.9599 (1.83)     4.9599 (1.83)     0.0000 (1.0)      4.9599 (1.83)     0.0000 (1.0)           0;0  0.2016 (0.55)          1           1
test_status-status-changed[3.10.0]     5.1729 (1.91)     5.1729 (1.91)     5.1729 (1.91)     0.0000 (1.0)      5.1729 (1.91)     0.0000 (1.0)           0;0  0.1933 (0.52)          1           1
test_status-status-changed[3.53.2]     4.9144 (1.81)     4.9144 (1.81)     4.9144 (1.81)     0.0000 (1.0)      4.9144 (1.81)     0.0000 (1.0)           0;0  0.2035 (0.55)          1           1
test_status-status-changed[3.60.1]     2.7084 (1.0)      2.7084 (1.0)      2.7084 (1.0)      0.0000 (1.0)      2.7084 (1.0)      0.0000 (1.0)           0;0  0.3692 (1.0)           1           1
test_status-status-changed[main]       3.1955 (1.18)     3.1955 (1.18)     3.1955 (1.18)     0.0000 (1.0)      3.1955 (1.18)     0.0000 (1.0)           0;0  0.3129 (0.85)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     4.8070 (1.84)     4.8070 (1.84)     4.8070 (1.84)     0.0000 (1.0)      4.8070 (1.84)     0.0000 (1.0)           0;0  0.2080 (0.54)          1           1
test_status-status-changed-noop[3.10.0]     4.9322 (1.89)     4.9322 (1.89)     4.9322 (1.89)     0.0000 (1.0)      4.9322 (1.89)     0.0000 (1.0)           0;0  0.2027 (0.53)          1           1
test_status-status-changed-noop[3.53.2]     4.7827 (1.83)     4.7827 (1.83)     4.7827 (1.83)     0.0000 (1.0)      4.7827 (1.83)     0.0000 (1.0)           0;0  0.2091 (0.55)          1           1
test_status-status-changed-noop[3.60.1]     2.6107 (1.0)      2.6107 (1.0)      2.6107 (1.0)      0.0000 (1.0)      2.6107 (1.0)      0.0000 (1.0)           0;0  0.3830 (1.0)           1           1
test_status-status-changed-noop[main]       2.8760 (1.10)     2.8760 (1.10)     2.8760 (1.10)     0.0000 (1.0)      2.8760 (1.10)     0.0000 (1.0)           0;0  0.3477 (0.91)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     4.8495 (1.87)     4.8495 (1.87)     4.8495 (1.87)     0.0000 (1.0)      4.8495 (1.87)     0.0000 (1.0)           0;0  0.2062 (0.54)          1           1
test_status-status-noop[3.10.0]     5.0752 (1.95)     5.0752 (1.95)     5.0752 (1.95)     0.0000 (1.0)      5.0752 (1.95)     0.0000 (1.0)           0;0  0.1970 (0.51)          1           1
test_status-status-noop[3.53.2]     4.9055 (1.89)     4.9055 (1.89)     4.9055 (1.89)     0.0000 (1.0)      4.9055 (1.89)     0.0000 (1.0)           0;0  0.2039 (0.53)          1           1
test_status-status-noop[3.60.1]     2.5998 (1.0)      2.5998 (1.0)      2.5998 (1.0)      0.0000 (1.0)      2.5998 (1.0)      0.0000 (1.0)           0;0  0.3846 (1.0)           1           1
test_status-status-noop[main]       2.8430 (1.09)     2.8430 (1.09)     2.8430 (1.09)     0.0000 (1.0)      2.8430 (1.09)     0.0000 (1.0)           0;0  0.3517 (0.91)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     153.8307 (3.27)     153.8307 (3.27)     153.8307 (3.27)     0.0000 (1.0)      153.8307 (3.27)     0.0000 (1.0)           0;0  0.0065 (0.31)          1           1
test_update-import-url[3.10.0]     158.2604 (3.37)     158.2604 (3.37)     158.2604 (3.37)     0.0000 (1.0)      158.2604 (3.37)     0.0000 (1.0)           0;0  0.0063 (0.30)          1           1
test_update-import-url[3.53.2]     116.5178 (2.48)     116.5178 (2.48)     116.5178 (2.48)     0.0000 (1.0)      116.5178 (2.48)     0.0000 (1.0)           0;0  0.0086 (0.40)          1           1
test_update-import-url[3.60.1]      47.0214 (1.0)       47.0214 (1.0)       47.0214 (1.0)      0.0000 (1.0)       47.0214 (1.0)      0.0000 (1.0)           0;0  0.0213 (1.0)           1           1
test_update-import-url[main]        48.5520 (1.03)      48.5520 (1.03)      48.5520 (1.03)     0.0000 (1.0)       48.5520 (1.03)     0.0000 (1.0)           0;0  0.0206 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     137.2572 (3.78)     137.2572 (3.78)     137.2572 (3.78)     0.0000 (1.0)      137.2572 (3.78)     0.0000 (1.0)           0;0  0.0073 (0.26)          1           1
test_update-update[3.10.0]     141.7010 (3.91)     141.7010 (3.91)     141.7010 (3.91)     0.0000 (1.0)      141.7010 (3.91)     0.0000 (1.0)           0;0  0.0071 (0.26)          1           1
test_update-update[3.53.2]     108.4752 (2.99)     108.4752 (2.99)     108.4752 (2.99)     0.0000 (1.0)      108.4752 (2.99)     0.0000 (1.0)           0;0  0.0092 (0.33)          1           1
test_update-update[3.60.1]      36.2766 (1.0)       36.2766 (1.0)       36.2766 (1.0)      0.0000 (1.0)       36.2766 (1.0)      0.0000 (1.0)           0;0  0.0276 (1.0)           1           1
test_update-update[main]        37.1813 (1.02)      37.1813 (1.02)      37.1813 (1.02)     0.0000 (1.0)       37.1813 (1.02)     0.0000 (1.0)           0;0  0.0269 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     16.0621 (2.04)     16.0621 (2.04)     16.0621 (2.04)     0.0000 (1.0)      16.0621 (2.04)     0.0000 (1.0)           0;0  0.0623 (0.49)          1           1
test_update-update-noop[3.10.0]     16.7339 (2.13)     16.7339 (2.13)     16.7339 (2.13)     0.0000 (1.0)      16.7339 (2.13)     0.0000 (1.0)           0;0  0.0598 (0.47)          1           1
test_update-update-noop[3.53.2]     16.3801 (2.08)     16.3801 (2.08)     16.3801 (2.08)     0.0000 (1.0)      16.3801 (2.08)     0.0000 (1.0)           0;0  0.0610 (0.48)          1           1
test_update-update-noop[3.60.1]      7.8707 (1.0)       7.8707 (1.0)       7.8707 (1.0)      0.0000 (1.0)       7.8707 (1.0)      0.0000 (1.0)           0;0  0.1271 (1.0)           1           1
test_update-update-noop[main]        8.6594 (1.10)      8.6594 (1.10)      8.6594 (1.10)     0.0000 (1.0)       8.6594 (1.10)     0.0000 (1.0)           0;0  0.1155 (0.91)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean