Preprocessing library ttrie-0.1.2...
In-place registering ttrie-0.1.2...
Preprocessing benchmark 'bench' for ttrie-0.1.2...
Running 1 benchmarks...
Benchmark bench: RUNNING...
threads = [1,2,4,6,8,10,12,14,16]
numTransactions = 200000
sizes = [(1,1),(2,1),(3,1),(4,1),(5,1)]
numPrefill = 1000000
ops = (10,70,10,10)
Generating 1000000 random keys to prefill...
Generating 200000 random transactions...
warming up
estimating clock resolution...
mean is 1.658233 us (320001 iterations)
found 557778 outliers among 319999 samples (174.3%)
  248997 (77.8%) low severe
  308781 (96.5%) high severe
estimating cost of a clock call...
mean is 201.2976 ns (11 iterations)
found 1 outliers among 11 samples (9.1%)
  1 (9.1%) high mild

Running a subject "1/200000/unordered-containers"
Collecting 99 more samples in 100.7 s.Collecting 98 more samples in 99.7 s.Collecting 97 more samples in 98.7 s.Collecting 96 more samples in 97.7 s.Collecting 95 more samples in 96.6 s.Collecting 94 more samples in 95.6 s.Collecting 93 more samples in 94.6 s.Collecting 92 more samples in 93.6 s.Collecting 91 more samples in 92.6 s.Collecting 90 more samples in 91.6 s.Collecting 89 more samples in 90.5 s.Collecting 88 more samples in 89.5 s.Collecting 87 more samples in 88.5 s.Collecting 86 more samples in 87.5 s.Collecting 85 more samples in 86.5 s.Collecting 84 more samples in 85.5 s.Collecting 83 more samples in 84.4 s.Collecting 82 more samples in 83.4 s.Collecting 81 more samples in 82.4 s.Collecting 80 more samples in 81.4 s.Collecting 79 more samples in 80.4 s.Collecting 78 more samples in 79.4 s.Collecting 77 more samples in 78.3 s.Collecting 76 more samples in 77.3 s.Collecting 75 more samples in 76.3 s.Collecting 74 more samples in 75.3 s.Collecting 73 more samples in 74.3 s.Collecting 72 more samples in 73.2 s.Collecting 71 more samples in 72.2 s.Collecting 70 more samples in 71.2 s.Collecting 69 more samples in 70.2 s.Collecting 68 more samples in 69.2 s.Collecting 67 more samples in 68.2 s.Collecting 66 more samples in 67.1 s.Collecting 65 more samples in 66.1 s.Collecting 64 more samples in 65.1 s.Collecting 63 more samples in 64.1 s.Collecting 62 more samples in 63.1 s.Collecting 61 more samples in 62.1 s.Collecting 60 more samples in 61.0 s.Collecting 59 more samples in 60.0 s.Collecting 58 more samples in 59.0 s.Collecting 57 more samples in 58.0 s.Collecting 56 more samples in 57.0 s.Collecting 55 more samples in 56.0 s.Collecting 54 more samples in 54.9 s.Collecting 53 more samples in 53.9 s.Collecting 52 more samples in 52.9 s.Collecting 51 more samples in 51.9 s.Collecting 50 more samples in 50.9 s.Collecting 49 more samples in 49.8 s.Collecting 48 more samples in 48.8 s.Collecting 47 more samples in 47.8 s.Collecting 46 more samples in 46.8 s.Collecting 45 more samples in 45.8 s.Collecting 44 more samples in 44.8 s.Collecting 43 more samples in 43.7 s.Collecting 42 more samples in 42.7 s.Collecting 41 more samples in 41.7 s.Collecting 40 more samples in 40.7 s.Collecting 39 more samples in 39.7 s.Collecting 38 more samples in 38.7 s.Collecting 37 more samples in 37.6 s.Collecting 36 more samples in 36.6 s.Collecting 35 more samples in 35.6 s.Collecting 34 more samples in 34.6 s.Collecting 33 more samples in 33.6 s.Collecting 32 more samples in 32.6 s.Collecting 31 more samples in 31.5 s.Collecting 30 more samples in 30.5 s.Collecting 29 more samples in 29.5 s.Collecting 28 more samples in 28.5 s.Collecting 27 more samples in 27.5 s.Collecting 26 more samples in 26.5 s.Collecting 25 more samples in 25.4 s.Collecting 24 more samples in 24.4 s.Collecting 23 more samples in 23.4 s.Collecting 22 more samples in 22.4 s.Collecting 21 more samples in 21.4 s.Collecting 20 more samples in 20.3 s.Collecting 19 more samples in 19.3 s.Collecting 18 more samples in 18.3 s.Collecting 17 more samples in 17.3 s.Collecting 16 more samples in 16.3 s.Collecting 15 more samples in 15.3 s.Collecting 14 more samples in 14.2 s.Collecting 13 more samples in 13.2 s.Collecting 12 more samples in 12.2 s.Collecting 11 more samples in 11.2 s.Collecting 10 more samples in 10.2 s.Collecting 9 more samples in 9.2 s.Collecting 8 more samples in 8.1 s.Collecting 7 more samples in 7.1 s.Collecting 6 more samples in 6.1 s.Collecting 5 more samples in 5.1 s.Collecting 4 more samples in 4.1 s.Collecting 3 more samples in 3.1 s.Collecting 2 more samples in 2.0 s.Collecting 1 more samples in 1.0 s.mean: 1.122751 s, lower bound: 1.101965 s, upper bound: 1.146735 s, confidence: 0.950
std dev: 114.1633 ms, lower bound: 97.99972 ms, upper bound: 139.4706 ms, confidence: 0.950
found 3 outliers among 100 samples (3.0%)
  3 (3.0%) high mild
variance introduced by outliers: 80.008%
variance is severely inflated by outliers
commits: 200000
retries: 0
allocated bytes: 115394120

Running a subject "1/200000/stm-containers"
Collecting 99 more samples in 343.0 s.Collecting 98 more samples in 339.6 s.Collecting 97 more samples in 336.1 s.Collecting 96 more samples in 332.6 s.Collecting 95 more samples in 329.2 s.Collecting 94 more samples in 325.7 s.Collecting 93 more samples in 322.2 s.Collecting 92 more samples in 318.8 s.Collecting 91 more samples in 315.3 s.Collecting 90 more samples in 311.9 s.Collecting 89 more samples in 308.4 s.Collecting 88 more samples in 304.9 s.Collecting 87 more samples in 301.5 s.Collecting 86 more samples in 298.0 s.Collecting 85 more samples in 294.5 s.Collecting 84 more samples in 291.1 s.Collecting 83 more samples in 287.6 s.Collecting 82 more samples in 284.1 s.Collecting 81 more samples in 280.7 s.Collecting 80 more samples in 277.2 s.Collecting 79 more samples in 273.7 s.Collecting 78 more samples in 270.3 s.Collecting 77 more samples in 266.8 s.Collecting 76 more samples in 263.3 s.Collecting 75 more samples in 259.9 s.Collecting 74 more samples in 256.4 s.Collecting 73 more samples in 252.9 s.Collecting 72 more samples in 249.5 s.Collecting 71 more samples in 246.0 s.Collecting 70 more samples in 242.6 s.Collecting 69 more samples in 239.1 s.Collecting 68 more samples in 235.6 s.Collecting 67 more samples in 232.2 s.Collecting 66 more samples in 228.7 s.Collecting 65 more samples in 225.2 s.Collecting 64 more samples in 221.8 s.Collecting 63 more samples in 218.3 s.Collecting 62 more samples in 214.8 s.Collecting 61 more samples in 211.4 s.Collecting 60 more samples in 207.9 s.Collecting 59 more samples in 204.4 s.Collecting 58 more samples in 201.0 s.Collecting 57 more samples in 197.5 s.Collecting 56 more samples in 194.0 s.Collecting 55 more samples in 190.6 s.Collecting 54 more samples in 187.1 s.Collecting 53 more samples in 183.6 s.Collecting 52 more samples in 180.2 s.Collecting 51 more samples in 176.7 s.Collecting 50 more samples in 173.3 s.Collecting 49 more samples in 169.8 s.Collecting 48 more samples in 166.3 s.Collecting 47 more samples in 162.9 s.Collecting 46 more samples in 159.4 s.Collecting 45 more samples in 155.9 s.Collecting 44 more samples in 152.5 s.Collecting 43 more samples in 149.0 s.Collecting 42 more samples in 145.5 s.Collecting 41 more samples in 142.1 s.Collecting 40 more samples in 138.6 s.Collecting 39 more samples in 135.1 s.Collecting 38 more samples in 131.7 s.Collecting 37 more samples in 128.2 s.Collecting 36 more samples in 124.7 s.Collecting 35 more samples in 121.3 s.Collecting 34 more samples in 117.8 s.Collecting 33 more samples in 114.3 s.Collecting 32 more samples in 110.9 s.Collecting 31 more samples in 107.4 s.Collecting 30 more samples in 104.0 s.Collecting 29 more samples in 100.5 s.Collecting 28 more samples in 97.0 s.Collecting 27 more samples in 93.6 s.Collecting 26 more samples in 90.1 s.Collecting 25 more samples in 86.6 s.Collecting 24 more samples in 83.2 s.Collecting 23 more samples in 79.7 s.Collecting 22 more samples in 76.2 s.Collecting 21 more samples in 72.8 s.Collecting 20 more samples in 69.3 s.Collecting 19 more samples in 65.8 s.Collecting 18 more samples in 62.4 s.Collecting 17 more samples in 58.9 s.Collecting 16 more samples in 55.4 s.Collecting 15 more samples in 52.0 s.Collecting 14 more samples in 48.5 s.Collecting 13 more samples in 45.0 s.Collecting 12 more samples in 41.6 s.Collecting 11 more samples in 38.1 s.Collecting 10 more samples in 34.7 s.Collecting 9 more samples in 31.2 s.Collecting 8 more samples in 27.7 s.Collecting 7 more samples in 24.3 s.Collecting 6 more samples in 20.8 s.Collecting 5 more samples in 17.3 s.Collecting 4 more samples in 13.9 s.Collecting 3 more samples in 10.4 s.Collecting 2 more samples in 6.9 s.Collecting 1 more samples in 3.5 s.mean: 2.960235 s, lower bound: 2.894006 s, upper bound: 3.028445 s, confidence: 0.950
std dev: 342.7256 ms, lower bound: 306.8969 ms, upper bound: 389.0002 ms, confidence: 0.950
variance introduced by outliers: 84.158%
variance is severely inflated by outliers
commits: 200000
retries: 0
allocated bytes: 835465528

Running a subject "1/200000/ttrie"
Collecting 99 more samples in 121.0 s.Collecting 98 more samples in 119.7 s.Collecting 97 more samples in 118.5 s.Collecting 96 more samples in 117.3 s.Collecting 95 more samples in 116.1 s.Collecting 94 more samples in 114.8 s.Collecting 93 more samples in 113.6 s.Collecting 92 more samples in 112.4 s.Collecting 91 more samples in 111.2 s.Collecting 90 more samples in 110.0 s.Collecting 89 more samples in 108.7 s.Collecting 88 more samples in 107.5 s.Collecting 87 more samples in 106.3 s.Collecting 86 more samples in 105.1 s.Collecting 85 more samples in 103.8 s.Collecting 84 more samples in 102.6 s.Collecting 83 more samples in 101.4 s.Collecting 82 more samples in 100.2 s.Collecting 81 more samples in 99.0 s.Collecting 80 more samples in 97.7 s.Collecting 79 more samples in 96.5 s.Collecting 78 more samples in 95.3 s.Collecting 77 more samples in 94.1 s.Collecting 76 more samples in 92.9 s.Collecting 75 more samples in 91.6 s.Collecting 74 more samples in 90.4 s.Collecting 73 more samples in 89.2 s.Collecting 72 more samples in 88.0 s.Collecting 71 more samples in 86.7 s.Collecting 70 more samples in 85.5 s.Collecting 69 more samples in 84.3 s.Collecting 68 more samples in 83.1 s.Collecting 67 more samples in 81.9 s.Collecting 66 more samples in 80.6 s.Collecting 65 more samples in 79.4 s.Collecting 64 more samples in 78.2 s.Collecting 63 more samples in 77.0 s.Collecting 62 more samples in 75.7 s.Collecting 61 more samples in 74.5 s.Collecting 60 more samples in 73.3 s.Collecting 59 more samples in 72.1 s.Collecting 58 more samples in 70.9 s.Collecting 57 more samples in 69.6 s.Collecting 56 more samples in 68.4 s.Collecting 55 more samples in 67.2 s.Collecting 54 more samples in 66.0 s.Collecting 53 more samples in 64.8 s.Collecting 52 more samples in 63.5 s.Collecting 51 more samples in 62.3 s.Collecting 50 more samples in 61.1 s.Collecting 49 more samples in 59.9 s.Collecting 48 more samples in 58.6 s.Collecting 47 more samples in 57.4 s.Collecting 46 more samples in 56.2 s.Collecting 45 more samples in 55.0 s.Collecting 44 more samples in 53.8 s.Collecting 43 more samples in 52.5 s.Collecting 42 more samples in 51.3 s.Collecting 41 more samples in 50.1 s.Collecting 40 more samples in 48.9 s.Collecting 39 more samples in 47.6 s.Collecting 38 more samples in 46.4 s.Collecting 37 more samples in 45.2 s.Collecting 36 more samples in 44.0 s.Collecting 35 more samples in 42.8 s.Collecting 34 more samples in 41.5 s.Collecting 33 more samples in 40.3 s.Collecting 32 more samples in 39.1 s.Collecting 31 more samples in 37.9 s.Collecting 30 more samples in 36.7 s.Collecting 29 more samples in 35.4 s.Collecting 28 more samples in 34.2 s.Collecting 27 more samples in 33.0 s.Collecting 26 more samples in 31.8 s.Collecting 25 more samples in 30.5 s.Collecting 24 more samples in 29.3 s.Collecting 23 more samples in 28.1 s.Collecting 22 more samples in 26.9 s.Collecting 21 more samples in 25.7 s.Collecting 20 more samples in 24.4 s.Collecting 19 more samples in 23.2 s.Collecting 18 more samples in 22.0 s.Collecting 17 more samples in 20.8 s.Collecting 16 more samples in 19.5 s.Collecting 15 more samples in 18.3 s.Collecting 14 more samples in 17.1 s.Collecting 13 more samples in 15.9 s.Collecting 12 more samples in 14.7 s.Collecting 11 more samples in 13.4 s.Collecting 10 more samples in 12.2 s.Collecting 9 more samples in 11.0 s.Collecting 8 more samples in 9.8 s.Collecting 7 more samples in 8.6 s.Collecting 6 more samples in 7.3 s.Collecting 5 more samples in 6.1 s.Collecting 4 more samples in 4.9 s.Collecting 3 more samples in 3.7 s.Collecting 2 more samples in 2.4 s.Collecting 1 more samples in 1.2 s.mean: 1.188649 s, lower bound: 1.168286 s, upper bound: 1.209143 s, confidence: 0.950
std dev: 105.8520 ms, lower bound: 96.43009 ms, upper bound: 117.3099 ms, confidence: 0.950
variance introduced by outliers: 74.862%
variance is severely inflated by outliers
commits: 200000
retries: 0
allocated bytes: 229712584

Running a subject "2/100000/unordered-containers"
Collecting 99 more samples in 65.7 s.Collecting 98 more samples in 65.0 s.Collecting 97 more samples in 64.4 s.Collecting 96 more samples in 63.7 s.Collecting 95 more samples in 63.0 s.Collecting 94 more samples in 62.4 s.Collecting 93 more samples in 61.7 s.Collecting 92 more samples in 61.0 s.Collecting 91 more samples in 60.4 s.Collecting 90 more samples in 59.7 s.Collecting 89 more samples in 59.0 s.Collecting 88 more samples in 58.4 s.Collecting 87 more samples in 57.7 s.Collecting 86 more samples in 57.1 s.Collecting 85 more samples in 56.4 s.Collecting 84 more samples in 55.7 s.Collecting 83 more samples in 55.1 s.Collecting 82 more samples in 54.4 s.Collecting 81 more samples in 53.7 s.Collecting 80 more samples in 53.1 s.Collecting 79 more samples in 52.4 s.Collecting 78 more samples in 51.7 s.Collecting 77 more samples in 51.1 s.Collecting 76 more samples in 50.4 s.Collecting 75 more samples in 49.8 s.Collecting 74 more samples in 49.1 s.Collecting 73 more samples in 48.4 s.Collecting 72 more samples in 47.8 s.Collecting 71 more samples in 47.1 s.Collecting 70 more samples in 46.4 s.Collecting 69 more samples in 45.8 s.Collecting 68 more samples in 45.1 s.Collecting 67 more samples in 44.5 s.Collecting 66 more samples in 43.8 s.Collecting 65 more samples in 43.1 s.Collecting 64 more samples in 42.5 s.Collecting 63 more samples in 41.8 s.Collecting 62 more samples in 41.1 s.Collecting 61 more samples in 40.5 s.Collecting 60 more samples in 39.8 s.Collecting 59 more samples in 39.1 s.Collecting 58 more samples in 38.5 s.Collecting 57 more samples in 37.8 s.Collecting 56 more samples in 37.2 s.Collecting 55 more samples in 36.5 s.Collecting 54 more samples in 35.8 s.Collecting 53 more samples in 35.2 s.Collecting 52 more samples in 34.5 s.Collecting 51 more samples in 33.8 s.Collecting 50 more samples in 33.2 s.Collecting 49 more samples in 32.5 s.Collecting 48 more samples in 31.8 s.Collecting 47 more samples in 31.2 s.Collecting 46 more samples in 30.5 s.Collecting 45 more samples in 29.9 s.Collecting 44 more samples in 29.2 s.Collecting 43 more samples in 28.5 s.Collecting 42 more samples in 27.9 s.Collecting 41 more samples in 27.2 s.Collecting 40 more samples in 26.5 s.Collecting 39 more samples in 25.9 s.Collecting 38 more samples in 25.2 s.Collecting 37 more samples in 24.5 s.Collecting 36 more samples in 23.9 s.Collecting 35 more samples in 23.2 s.Collecting 34 more samples in 22.6 s.Collecting 33 more samples in 21.9 s.Collecting 32 more samples in 21.2 s.Collecting 31 more samples in 20.6 s.Collecting 30 more samples in 19.9 s.Collecting 29 more samples in 19.2 s.Collecting 28 more samples in 18.6 s.Collecting 27 more samples in 17.9 s.Collecting 26 more samples in 17.2 s.Collecting 25 more samples in 16.6 s.Collecting 24 more samples in 15.9 s.Collecting 23 more samples in 15.3 s.Collecting 22 more samples in 14.6 s.Collecting 21 more samples in 13.9 s.Collecting 20 more samples in 13.3 s.Collecting 19 more samples in 12.6 s.Collecting 18 more samples in 11.9 s.Collecting 17 more samples in 11.3 s.Collecting 16 more samples in 10.6 s.Collecting 15 more samples in 10.0 s.Collecting 14 more samples in 9.3 s.Collecting 13 more samples in 8.6 s.Collecting 12 more samples in 8.0 s.Collecting 11 more samples in 7.3 s.Collecting 10 more samples in 6.6 s.Collecting 9 more samples in 6.0 s.Collecting 8 more samples in 5.3 s.Collecting 7 more samples in 4.6 s.Collecting 6 more samples in 4.0 s.Collecting 5 more samples in 3.3 s.Collecting 4 more samples in 2.7 s.Collecting 3 more samples in 2.0 s.Collecting 2 more samples in 1.3 s.Collecting 1 more samples in 0.7 s.mean: 673.1433 ms, lower bound: 656.5315 ms, upper bound: 693.4646 ms, confidence: 0.950
std dev: 94.35810 ms, lower bound: 77.11743 ms, upper bound: 123.8677 ms, confidence: 0.950
found 2 outliers among 100 samples (2.0%)
  2 (2.0%) high mild
variance introduced by outliers: 88.370%
variance is severely inflated by outliers
commits: 200000
retries: 82629
allocated bytes: 183576344

Running a subject "2/100000/stm-containers"
Collecting 99 more samples in 188.5 s.Collecting 98 more samples in 186.6 s.Collecting 97 more samples in 184.7 s.Collecting 96 more samples in 182.8 s.Collecting 95 more samples in 180.9 s.Collecting 94 more samples in 179.0 s.Collecting 93 more samples in 177.1 s.Collecting 92 more samples in 175.2 s.Collecting 91 more samples in 173.3 s.Collecting 90 more samples in 171.4 s.Collecting 89 more samples in 169.5 s.Collecting 88 more samples in 167.6 s.Collecting 87 more samples in 165.7 s.Collecting 86 more samples in 163.8 s.Collecting 85 more samples in 161.9 s.Collecting 84 more samples in 160.0 s.Collecting 83 more samples in 158.1 s.Collecting 82 more samples in 156.2 s.Collecting 81 more samples in 154.3 s.Collecting 80 more samples in 152.4 s.Collecting 79 more samples in 150.5 s.Collecting 78 more samples in 148.5 s.Collecting 77 more samples in 146.6 s.Collecting 76 more samples in 144.7 s.Collecting 75 more samples in 142.8 s.Collecting 74 more samples in 140.9 s.Collecting 73 more samples in 139.0 s.Collecting 72 more samples in 137.1 s.Collecting 71 more samples in 135.2 s.Collecting 70 more samples in 133.3 s.Collecting 69 more samples in 131.4 s.Collecting 68 more samples in 129.5 s.Collecting 67 more samples in 127.6 s.Collecting 66 more samples in 125.7 s.Collecting 65 more samples in 123.8 s.Collecting 64 more samples in 121.9 s.Collecting 63 more samples in 120.0 s.Collecting 62 more samples in 118.1 s.Collecting 61 more samples in 116.2 s.Collecting 60 more samples in 114.3 s.Collecting 59 more samples in 112.4 s.Collecting 58 more samples in 110.5 s.Collecting 57 more samples in 108.6 s.Collecting 56 more samples in 106.6 s.Collecting 55 more samples in 104.7 s.Collecting 54 more samples in 102.8 s.Collecting 53 more samples in 100.9 s.Collecting 52 more samples in 99.0 s.Collecting 51 more samples in 97.1 s.Collecting 50 more samples in 95.2 s.Collecting 49 more samples in 93.3 s.Collecting 48 more samples in 91.4 s.Collecting 47 more samples in 89.5 s.Collecting 46 more samples in 87.6 s.Collecting 45 more samples in 85.7 s.Collecting 44 more samples in 83.8 s.Collecting 43 more samples in 81.9 s.Collecting 42 more samples in 80.0 s.Collecting 41 more samples in 78.1 s.Collecting 40 more samples in 76.2 s.Collecting 39 more samples in 74.3 s.Collecting 38 more samples in 72.4 s.Collecting 37 more samples in 70.5 s.Collecting 36 more samples in 68.6 s.Collecting 35 more samples in 66.7 s.Collecting 34 more samples in 64.8 s.Collecting 33 more samples in 62.8 s.Collecting 32 more samples in 60.9 s.Collecting 31 more samples in 59.0 s.Collecting 30 more samples in 57.1 s.Collecting 29 more samples in 55.2 s.Collecting 28 more samples in 53.3 s.Collecting 27 more samples in 51.4 s.Collecting 26 more samples in 49.5 s.Collecting 25 more samples in 47.6 s.Collecting 24 more samples in 45.7 s.Collecting 23 more samples in 43.8 s.Collecting 22 more samples in 41.9 s.Collecting 21 more samples in 40.0 s.Collecting 20 more samples in 38.1 s.Collecting 19 more samples in 36.2 s.Collecting 18 more samples in 34.3 s.Collecting 17 more samples in 32.4 s.Collecting 16 more samples in 30.5 s.Collecting 15 more samples in 28.6 s.Collecting 14 more samples in 26.7 s.Collecting 13 more samples in 24.8 s.Collecting 12 more samples in 22.9 s.Collecting 11 more samples in 20.9 s.Collecting 10 more samples in 19.0 s.Collecting 9 more samples in 17.1 s.Collecting 8 more samples in 15.2 s.Collecting 7 more samples in 13.3 s.Collecting 6 more samples in 11.4 s.Collecting 5 more samples in 9.5 s.Collecting 4 more samples in 7.6 s.Collecting 3 more samples in 5.7 s.Collecting 2 more samples in 3.8 s.Collecting 1 more samples in 1.9 s.mean: 1.726638 s, lower bound: 1.701564 s, upper bound: 1.752872 s, confidence: 0.950
std dev: 131.7033 ms, lower bound: 117.6754 ms, upper bound: 149.2036 ms, confidence: 0.950
variance introduced by outliers: 68.684%
variance is severely inflated by outliers
commits: 200000
retries: 51
allocated bytes: 834552120

Running a subject "2/100000/ttrie"
Collecting 99 more samples in 66.3 s.Collecting 98 more samples in 65.7 s.Collecting 97 more samples in 65.0 s.Collecting 96 more samples in 64.3 s.Collecting 95 more samples in 63.7 s.Collecting 94 more samples in 63.0 s.Collecting 93 more samples in 62.3 s.Collecting 92 more samples in 61.6 s.Collecting 91 more samples in 61.0 s.Collecting 90 more samples in 60.3 s.Collecting 89 more samples in 59.6 s.Collecting 88 more samples in 59.0 s.Collecting 87 more samples in 58.3 s.Collecting 86 more samples in 57.6 s.Collecting 85 more samples in 57.0 s.Collecting 84 more samples in 56.3 s.Collecting 83 more samples in 55.6 s.Collecting 82 more samples in 54.9 s.Collecting 81 more samples in 54.3 s.Collecting 80 more samples in 53.6 s.Collecting 79 more samples in 52.9 s.Collecting 78 more samples in 52.3 s.Collecting 77 more samples in 51.6 s.Collecting 76 more samples in 50.9 s.Collecting 75 more samples in 50.3 s.Collecting 74 more samples in 49.6 s.Collecting 73 more samples in 48.9 s.Collecting 72 more samples in 48.2 s.Collecting 71 more samples in 47.6 s.Collecting 70 more samples in 46.9 s.Collecting 69 more samples in 46.2 s.Collecting 68 more samples in 45.6 s.Collecting 67 more samples in 44.9 s.Collecting 66 more samples in 44.2 s.Collecting 65 more samples in 43.6 s.Collecting 64 more samples in 42.9 s.Collecting 63 more samples in 42.2 s.Collecting 62 more samples in 41.5 s.Collecting 61 more samples in 40.9 s.Collecting 60 more samples in 40.2 s.Collecting 59 more samples in 39.5 s.Collecting 58 more samples in 38.9 s.Collecting 57 more samples in 38.2 s.Collecting 56 more samples in 37.5 s.Collecting 55 more samples in 36.9 s.Collecting 54 more samples in 36.2 s.Collecting 53 more samples in 35.5 s.Collecting 52 more samples in 34.8 s.Collecting 51 more samples in 34.2 s.Collecting 50 more samples in 33.5 s.Collecting 49 more samples in 32.8 s.Collecting 48 more samples in 32.2 s.Collecting 47 more samples in 31.5 s.Collecting 46 more samples in 30.8 s.Collecting 45 more samples in 30.2 s.Collecting 44 more samples in 29.5 s.Collecting 43 more samples in 28.8 s.Collecting 42 more samples in 28.1 s.Collecting 41 more samples in 27.5 s.Collecting 40 more samples in 26.8 s.Collecting 39 more samples in 26.1 s.Collecting 38 more samples in 25.5 s.Collecting 37 more samples in 24.8 s.Collecting 36 more samples in 24.1 s.Collecting 35 more samples in 23.5 s.Collecting 34 more samples in 22.8 s.Collecting 33 more samples in 22.1 s.Collecting 32 more samples in 21.4 s.Collecting 31 more samples in 20.8 s.Collecting 30 more samples in 20.1 s.Collecting 29 more samples in 19.4 s.Collecting 28 more samples in 18.8 s.Collecting 27 more samples in 18.1 s.Collecting 26 more samples in 17.4 s.Collecting 25 more samples in 16.8 s.Collecting 24 more samples in 16.1 s.Collecting 23 more samples in 15.4 s.Collecting 22 more samples in 14.7 s.Collecting 21 more samples in 14.1 s.Collecting 20 more samples in 13.4 s.Collecting 19 more samples in 12.7 s.Collecting 18 more samples in 12.1 s.Collecting 17 more samples in 11.4 s.Collecting 16 more samples in 10.7 s.Collecting 15 more samples in 10.1 s.Collecting 14 more samples in 9.4 s.Collecting 13 more samples in 8.7 s.Collecting 12 more samples in 8.0 s.Collecting 11 more samples in 7.4 s.Collecting 10 more samples in 6.7 s.Collecting 9 more samples in 6.0 s.Collecting 8 more samples in 5.4 s.Collecting 7 more samples in 4.7 s.Collecting 6 more samples in 4.0 s.Collecting 5 more samples in 3.4 s.Collecting 4 more samples in 2.7 s.Collecting 3 more samples in 2.0 s.Collecting 2 more samples in 1.3 s.Collecting 1 more samples in 0.7 s.mean: 622.5607 ms, lower bound: 609.6190 ms, upper bound: 636.6503 ms, confidence: 0.950
std dev: 69.21796 ms, lower bound: 62.89970 ms, upper bound: 84.60563 ms, confidence: 0.950
variance introduced by outliers: 83.108%
variance is severely inflated by outliers
commits: 200000
retries: 0
allocated bytes: 229739408

Running a subject "4/50000/unordered-containers"
Collecting 99 more samples in 47.9 s.Collecting 98 more samples in 47.4 s.Collecting 97 more samples in 46.9 s.Collecting 96 more samples in 46.4 s.Collecting 95 more samples in 45.9 s.Collecting 94 more samples in 45.5 s.Collecting 93 more samples in 45.0 s.Collecting 92 more samples in 44.5 s.Collecting 91 more samples in 44.0 s.Collecting 90 more samples in 43.5 s.Collecting 89 more samples in 43.0 s.Collecting 88 more samples in 42.6 s.Collecting 87 more samples in 42.1 s.Collecting 86 more samples in 41.6 s.Collecting 85 more samples in 41.1 s.Collecting 84 more samples in 40.6 s.Collecting 83 more samples in 40.1 s.Collecting 82 more samples in 39.6 s.Collecting 81 more samples in 39.2 s.Collecting 80 more samples in 38.7 s.Collecting 79 more samples in 38.2 s.Collecting 78 more samples in 37.7 s.Collecting 77 more samples in 37.2 s.Collecting 76 more samples in 36.7 s.Collecting 75 more samples in 36.3 s.Collecting 74 more samples in 35.8 s.Collecting 73 more samples in 35.3 s.Collecting 72 more samples in 34.8 s.Collecting 71 more samples in 34.3 s.Collecting 70 more samples in 33.8 s.Collecting 69 more samples in 33.4 s.Collecting 68 more samples in 32.9 s.Collecting 67 more samples in 32.4 s.Collecting 66 more samples in 31.9 s.Collecting 65 more samples in 31.4 s.Collecting 64 more samples in 30.9 s.Collecting 63 more samples in 30.5 s.Collecting 62 more samples in 30.0 s.Collecting 61 more samples in 29.5 s.Collecting 60 more samples in 29.0 s.Collecting 59 more samples in 28.5 s.Collecting 58 more samples in 28.0 s.Collecting 57 more samples in 27.6 s.Collecting 56 more samples in 27.1 s.Collecting 55 more samples in 26.6 s.Collecting 54 more samples in 26.1 s.Collecting 53 more samples in 25.6 s.Collecting 52 more samples in 25.1 s.Collecting 51 more samples in 24.7 s.Collecting 50 more samples in 24.2 s.Collecting 49 more samples in 23.7 s.Collecting 48 more samples in 23.2 s.Collecting 47 more samples in 22.7 s.Collecting 46 more samples in 22.2 s.Collecting 45 more samples in 21.8 s.Collecting 44 more samples in 21.3 s.Collecting 43 more samples in 20.8 s.Collecting 42 more samples in 20.3 s.Collecting 41 more samples in 19.8 s.Collecting 40 more samples in 19.3 s.Collecting 39 more samples in 18.9 s.Collecting 38 more samples in 18.4 s.Collecting 37 more samples in 17.9 s.Collecting 36 more samples in 17.4 s.Collecting 35 more samples in 16.9 s.Collecting 34 more samples in 16.4 s.Collecting 33 more samples in 16.0 s.Collecting 32 more samples in 15.5 s.Collecting 31 more samples in 15.0 s.Collecting 30 more samples in 14.5 s.Collecting 29 more samples in 14.0 s.Collecting 28 more samples in 13.5 s.Collecting 27 more samples in 13.1 s.Collecting 26 more samples in 12.6 s.Collecting 25 more samples in 12.1 s.Collecting 24 more samples in 11.6 s.Collecting 23 more samples in 11.1 s.Collecting 22 more samples in 10.6 s.Collecting 21 more samples in 10.2 s.Collecting 20 more samples in 9.7 s.Collecting 19 more samples in 9.2 s.Collecting 18 more samples in 8.7 s.Collecting 17 more samples in 8.2 s.Collecting 16 more samples in 7.7 s.Collecting 15 more samples in 7.3 s.Collecting 14 more samples in 6.8 s.Collecting 13 more samples in 6.3 s.Collecting 12 more samples in 5.8 s.Collecting 11 more samples in 5.3 s.Collecting 10 more samples in 4.8 s.Collecting 9 more samples in 4.4 s.Collecting 8 more samples in 3.9 s.Collecting 7 more samples in 3.4 s.Collecting 6 more samples in 2.9 s.Collecting 5 more samples in 2.4 s.Collecting 4 more samples in 1.9 s.Collecting 3 more samples in 1.5 s.Collecting 2 more samples in 1.0 s.Collecting 1 more samples in 0.5 s.mean: 465.2467 ms, lower bound: 454.9128 ms, upper bound: 475.7978 ms, confidence: 0.950
std dev: 53.48019 ms, lower bound: 50.05509 ms, upper bound: 57.66582 ms, confidence: 0.950
variance introduced by outliers: 83.166%
variance is severely inflated by outliers
commits: 200000
retries: 204101
allocated bytes: 288091384

Running a subject "4/50000/stm-containers"
Collecting 99 more samples in 90.6 s.Collecting 98 more samples in 89.7 s.Collecting 97 more samples in 88.7 s.Collecting 96 more samples in 87.8 s.Collecting 95 more samples in 86.9 s.Collecting 94 more samples in 86.0 s.Collecting 93 more samples in 85.1 s.Collecting 92 more samples in 84.2 s.Collecting 91 more samples in 83.3 s.Collecting 90 more samples in 82.3 s.Collecting 89 more samples in 81.4 s.Collecting 88 more samples in 80.5 s.Collecting 87 more samples in 79.6 s.Collecting 86 more samples in 78.7 s.Collecting 85 more samples in 77.8 s.Collecting 84 more samples in 76.9 s.Collecting 83 more samples in 75.9 s.Collecting 82 more samples in 75.0 s.Collecting 81 more samples in 74.1 s.Collecting 80 more samples in 73.2 s.Collecting 79 more samples in 72.3 s.Collecting 78 more samples in 71.4 s.Collecting 77 more samples in 70.4 s.Collecting 76 more samples in 69.5 s.Collecting 75 more samples in 68.6 s.Collecting 74 more samples in 67.7 s.Collecting 73 more samples in 66.8 s.Collecting 72 more samples in 65.9 s.Collecting 71 more samples in 65.0 s.Collecting 70 more samples in 64.0 s.Collecting 69 more samples in 63.1 s.Collecting 68 more samples in 62.2 s.Collecting 67 more samples in 61.3 s.Collecting 66 more samples in 60.4 s.Collecting 65 more samples in 59.5 s.Collecting 64 more samples in 58.6 s.Collecting 63 more samples in 57.6 s.Collecting 62 more samples in 56.7 s.Collecting 61 more samples in 55.8 s.Collecting 60 more samples in 54.9 s.Collecting 59 more samples in 54.0 s.Collecting 58 more samples in 53.1 s.Collecting 57 more samples in 52.2 s.Collecting 56 more samples in 51.2 s.Collecting 55 more samples in 50.3 s.Collecting 54 more samples in 49.4 s.Collecting 53 more samples in 48.5 s.Collecting 52 more samples in 47.6 s.Collecting 51 more samples in 46.7 s.Collecting 50 more samples in 45.7 s.Collecting 49 more samples in 44.8 s.Collecting 48 more samples in 43.9 s.Collecting 47 more samples in 43.0 s.Collecting 46 more samples in 42.1 s.Collecting 45 more samples in 41.2 s.Collecting 44 more samples in 40.3 s.Collecting 43 more samples in 39.3 s.Collecting 42 more samples in 38.4 s.Collecting 41 more samples in 37.5 s.Collecting 40 more samples in 36.6 s.Collecting 39 more samples in 35.7 s.Collecting 38 more samples in 34.8 s.Collecting 37 more samples in 33.9 s.Collecting 36 more samples in 32.9 s.Collecting 35 more samples in 32.0 s.Collecting 34 more samples in 31.1 s.Collecting 33 more samples in 30.2 s.Collecting 32 more samples in 29.3 s.Collecting 31 more samples in 28.4 s.Collecting 30 more samples in 27.4 s.Collecting 29 more samples in 26.5 s.Collecting 28 more samples in 25.6 s.Collecting 27 more samples in 24.7 s.Collecting 26 more samples in 23.8 s.Collecting 25 more samples in 22.9 s.Collecting 24 more samples in 22.0 s.Collecting 23 more samples in 21.0 s.Collecting 22 more samples in 20.1 s.Collecting 21 more samples in 19.2 s.Collecting 20 more samples in 18.3 s.Collecting 19 more samples in 17.4 s.Collecting 18 more samples in 16.5 s.Collecting 17 more samples in 15.6 s.Collecting 16 more samples in 14.6 s.Collecting 15 more samples in 13.7 s.Collecting 14 more samples in 12.8 s.Collecting 13 more samples in 11.9 s.Collecting 12 more samples in 11.0 s.Collecting 11 more samples in 10.1 s.Collecting 10 more samples in 9.1 s.Collecting 9 more samples in 8.2 s.Collecting 8 more samples in 7.3 s.Collecting 7 more samples in 6.4 s.Collecting 6 more samples in 5.5 s.Collecting 5 more samples in 4.6 s.Collecting 4 more samples in 3.7 s.Collecting 3 more samples in 2.7 s.Collecting 2 more samples in 1.8 s.Collecting 1 more samples in 0.9 s.mean: 961.7036 ms, lower bound: 945.4635 ms, upper bound: 980.0828 ms, confidence: 0.950
std dev: 88.24917 ms, lower bound: 75.81459 ms, upper bound: 106.4152 ms, confidence: 0.950
found 5 outliers among 100 samples (5.0%)
  5 (5.0%) high mild
variance introduced by outliers: 75.900%
variance is severely inflated by outliers
commits: 200000
retries: 585
allocated bytes: 834744232

Running a subject "4/50000/ttrie"
Collecting 99 more samples in 32.2 s.Collecting 98 more samples in 31.9 s.Collecting 97 more samples in 31.6 s.Collecting 96 more samples in 31.2 s.Collecting 95 more samples in 30.9 s.Collecting 94 more samples in 30.6 s.Collecting 93 more samples in 30.3 s.Collecting 92 more samples in 29.9 s.Collecting 91 more samples in 29.6 s.Collecting 90 more samples in 29.3 s.Collecting 89 more samples in 29.0 s.Collecting 88 more samples in 28.6 s.Collecting 87 more samples in 28.3 s.Collecting 86 more samples in 28.0 s.Collecting 85 more samples in 27.7 s.Collecting 84 more samples in 27.3 s.Collecting 83 more samples in 27.0 s.Collecting 82 more samples in 26.7 s.Collecting 81 more samples in 26.4 s.Collecting 80 more samples in 26.0 s.Collecting 79 more samples in 25.7 s.Collecting 78 more samples in 25.4 s.Collecting 77 more samples in 25.1 s.Collecting 76 more samples in 24.7 s.Collecting 75 more samples in 24.4 s.Collecting 74 more samples in 24.1 s.Collecting 73 more samples in 23.8 s.Collecting 72 more samples in 23.4 s.Collecting 71 more samples in 23.1 s.Collecting 70 more samples in 22.8 s.Collecting 69 more samples in 22.5 s.Collecting 68 more samples in 22.1 s.Collecting 67 more samples in 21.8 s.Collecting 66 more samples in 21.5 s.Collecting 65 more samples in 21.2 s.Collecting 64 more samples in 20.8 s.Collecting 63 more samples in 20.5 s.Collecting 62 more samples in 20.2 s.Collecting 61 more samples in 19.9 s.Collecting 60 more samples in 19.5 s.Collecting 59 more samples in 19.2 s.Collecting 58 more samples in 18.9 s.Collecting 57 more samples in 18.6 s.Collecting 56 more samples in 18.2 s.Collecting 55 more samples in 17.9 s.Collecting 54 more samples in 17.6 s.Collecting 53 more samples in 17.3 s.Collecting 52 more samples in 16.9 s.Collecting 51 more samples in 16.6 s.Collecting 50 more samples in 16.3 s.Collecting 49 more samples in 15.9 s.Collecting 48 more samples in 15.6 s.Collecting 47 more samples in 15.3 s.Collecting 46 more samples in 15.0 s.Collecting 45 more samples in 14.6 s.Collecting 44 more samples in 14.3 s.Collecting 43 more samples in 14.0 s.Collecting 42 more samples in 13.7 s.Collecting 41 more samples in 13.3 s.Collecting 40 more samples in 13.0 s.Collecting 39 more samples in 12.7 s.Collecting 38 more samples in 12.4 s.Collecting 37 more samples in 12.0 s.Collecting 36 more samples in 11.7 s.Collecting 35 more samples in 11.4 s.Collecting 34 more samples in 11.1 s.Collecting 33 more samples in 10.7 s.Collecting 32 more samples in 10.4 s.Collecting 31 more samples in 10.1 s.Collecting 30 more samples in 9.8 s.Collecting 29 more samples in 9.4 s.Collecting 28 more samples in 9.1 s.Collecting 27 more samples in 8.8 s.Collecting 26 more samples in 8.5 s.Collecting 25 more samples in 8.1 s.Collecting 24 more samples in 7.8 s.Collecting 23 more samples in 7.5 s.Collecting 22 more samples in 7.2 s.Collecting 21 more samples in 6.8 s.Collecting 20 more samples in 6.5 s.Collecting 19 more samples in 6.2 s.Collecting 18 more samples in 5.9 s.Collecting 17 more samples in 5.5 s.Collecting 16 more samples in 5.2 s.Collecting 15 more samples in 4.9 s.Collecting 14 more samples in 4.6 s.Collecting 13 more samples in 4.2 s.Collecting 12 more samples in 3.9 s.Collecting 11 more samples in 3.6 s.Collecting 10 more samples in 3.3 s.Collecting 9 more samples in 2.9 s.Collecting 8 more samples in 2.6 s.Collecting 7 more samples in 2.3 s.Collecting 6 more samples in 2.0 s.Collecting 5 more samples in 1.6 s.Collecting 4 more samples in 1.3 s.Collecting 3 more samples in 1.0 s.Collecting 2 more samples in 0.7 s.Collecting 1 more samples in 0.3 s.mean: 339.1621 ms, lower bound: 334.9773 ms, upper bound: 344.4842 ms, confidence: 0.950
std dev: 24.06061 ms, lower bound: 18.33367 ms, upper bound: 32.59838 ms, confidence: 0.950
found 12 outliers among 100 samples (12.0%)
  5 (5.0%) low mild
  4 (4.0%) high mild
  3 (3.0%) high severe
variance introduced by outliers: 65.606%
variance is severely inflated by outliers
commits: 200000
retries: 3
allocated bytes: 229751560

Running a subject "6/33333/unordered-containers"
Collecting 99 more samples in 49.1 s.Collecting 98 more samples in 48.6 s.Collecting 97 more samples in 48.1 s.Collecting 96 more samples in 47.6 s.Collecting 95 more samples in 47.1 s.Collecting 94 more samples in 46.6 s.Collecting 93 more samples in 46.1 s.Collecting 92 more samples in 45.6 s.Collecting 91 more samples in 45.1 s.Collecting 90 more samples in 44.6 s.Collecting 89 more samples in 44.1 s.Collecting 88 more samples in 43.7 s.Collecting 87 more samples in 43.2 s.Collecting 86 more samples in 42.7 s.Collecting 85 more samples in 42.2 s.Collecting 84 more samples in 41.7 s.Collecting 83 more samples in 41.2 s.Collecting 82 more samples in 40.7 s.Collecting 81 more samples in 40.2 s.Collecting 80 more samples in 39.7 s.Collecting 79 more samples in 39.2 s.Collecting 78 more samples in 38.7 s.Collecting 77 more samples in 38.2 s.Collecting 76 more samples in 37.7 s.Collecting 75 more samples in 37.2 s.Collecting 74 more samples in 36.7 s.Collecting 73 more samples in 36.2 s.Collecting 72 more samples in 35.7 s.Collecting 71 more samples in 35.2 s.Collecting 70 more samples in 34.7 s.Collecting 69 more samples in 34.2 s.Collecting 68 more samples in 33.7 s.Collecting 67 more samples in 33.2 s.Collecting 66 more samples in 32.7 s.Collecting 65 more samples in 32.2 s.Collecting 64 more samples in 31.7 s.Collecting 63 more samples in 31.3 s.Collecting 62 more samples in 30.8 s.Collecting 61 more samples in 30.3 s.Collecting 60 more samples in 29.8 s.Collecting 59 more samples in 29.3 s.Collecting 58 more samples in 28.8 s.Collecting 57 more samples in 28.3 s.Collecting 56 more samples in 27.8 s.Collecting 55 more samples in 27.3 s.Collecting 54 more samples in 26.8 s.Collecting 53 more samples in 26.3 s.Collecting 52 more samples in 25.8 s.Collecting 51 more samples in 25.3 s.Collecting 50 more samples in 24.8 s.Collecting 49 more samples in 24.3 s.Collecting 48 more samples in 23.8 s.Collecting 47 more samples in 23.3 s.Collecting 46 more samples in 22.8 s.Collecting 45 more samples in 22.3 s.Collecting 44 more samples in 21.8 s.Collecting 43 more samples in 21.3 s.Collecting 42 more samples in 20.8 s.Collecting 41 more samples in 20.3 s.Collecting 40 more samples in 19.8 s.Collecting 39 more samples in 19.3 s.Collecting 38 more samples in 18.9 s.Collecting 37 more samples in 18.4 s.Collecting 36 more samples in 17.9 s.Collecting 35 more samples in 17.4 s.Collecting 34 more samples in 16.9 s.Collecting 33 more samples in 16.4 s.Collecting 32 more samples in 15.9 s.Collecting 31 more samples in 15.4 s.Collecting 30 more samples in 14.9 s.Collecting 29 more samples in 14.4 s.Collecting 28 more samples in 13.9 s.Collecting 27 more samples in 13.4 s.Collecting 26 more samples in 12.9 s.Collecting 25 more samples in 12.4 s.Collecting 24 more samples in 11.9 s.Collecting 23 more samples in 11.4 s.Collecting 22 more samples in 10.9 s.Collecting 21 more samples in 10.4 s.Collecting 20 more samples in 9.9 s.Collecting 19 more samples in 9.4 s.Collecting 18 more samples in 8.9 s.Collecting 17 more samples in 8.4 s.Collecting 16 more samples in 7.9 s.Collecting 15 more samples in 7.4 s.Collecting 14 more samples in 6.9 s.Collecting 13 more samples in 6.4 s.Collecting 12 more samples in 6.0 s.Collecting 11 more samples in 5.5 s.Collecting 10 more samples in 5.0 s.Collecting 9 more samples in 4.5 s.Collecting 8 more samples in 4.0 s.Collecting 7 more samples in 3.5 s.Collecting 6 more samples in 3.0 s.Collecting 5 more samples in 2.5 s.Collecting 4 more samples in 2.0 s.Collecting 3 more samples in 1.5 s.Collecting 2 more samples in 1.0 s.Collecting 1 more samples in 0.5 s.mean: 444.3272 ms, lower bound: 437.0418 ms, upper bound: 450.8385 ms, confidence: 0.950
std dev: 35.09612 ms, lower bound: 29.79010 ms, upper bound: 41.71670 ms, confidence: 0.950
found 11 outliers among 100 samples (11.0%)
  1 (1.0%) low severe
  9 (9.0%) low mild
variance introduced by outliers: 70.702%
variance is severely inflated by outliers
commits: 200000
retries: 314239
allocated bytes: 392719528

Running a subject "6/33333/stm-containers"
Collecting 99 more samples in 70.4 s.Collecting 98 more samples in 69.7 s.Collecting 97 more samples in 69.0 s.Collecting 96 more samples in 68.3 s.Collecting 95 more samples in 67.6 s.Collecting 94 more samples in 66.9 s.Collecting 93 more samples in 66.2 s.Collecting 92 more samples in 65.4 s.Collecting 91 more samples in 64.7 s.Collecting 90 more samples in 64.0 s.Collecting 89 more samples in 63.3 s.Collecting 88 more samples in 62.6 s.Collecting 87 more samples in 61.9 s.Collecting 86 more samples in 61.2 s.Collecting 85 more samples in 60.5 s.Collecting 84 more samples in 59.8 s.Collecting 83 more samples in 59.0 s.Collecting 82 more samples in 58.3 s.Collecting 81 more samples in 57.6 s.Collecting 80 more samples in 56.9 s.Collecting 79 more samples in 56.2 s.Collecting 78 more samples in 55.5 s.Collecting 77 more samples in 54.8 s.Collecting 76 more samples in 54.1 s.Collecting 75 more samples in 53.4 s.Collecting 74 more samples in 52.6 s.Collecting 73 more samples in 51.9 s.Collecting 72 more samples in 51.2 s.Collecting 71 more samples in 50.5 s.Collecting 70 more samples in 49.8 s.Collecting 69 more samples in 49.1 s.Collecting 68 more samples in 48.4 s.Collecting 67 more samples in 47.7 s.Collecting 66 more samples in 47.0 s.Collecting 65 more samples in 46.2 s.Collecting 64 more samples in 45.5 s.Collecting 63 more samples in 44.8 s.Collecting 62 more samples in 44.1 s.Collecting 61 more samples in 43.4 s.Collecting 60 more samples in 42.7 s.Collecting 59 more samples in 42.0 s.Collecting 58 more samples in 41.3 s.Collecting 57 more samples in 40.6 s.Collecting 56 more samples in 39.8 s.Collecting 55 more samples in 39.1 s.Collecting 54 more samples in 38.4 s.Collecting 53 more samples in 37.7 s.Collecting 52 more samples in 37.0 s.Collecting 51 more samples in 36.3 s.Collecting 50 more samples in 35.6 s.Collecting 49 more samples in 34.9 s.Collecting 48 more samples in 34.1 s.Collecting 47 more samples in 33.4 s.Collecting 46 more samples in 32.7 s.Collecting 45 more samples in 32.0 s.Collecting 44 more samples in 31.3 s.Collecting 43 more samples in 30.6 s.Collecting 42 more samples in 29.9 s.Collecting 41 more samples in 29.2 s.Collecting 40 more samples in 28.5 s.Collecting 39 more samples in 27.7 s.Collecting 38 more samples in 27.0 s.Collecting 37 more samples in 26.3 s.Collecting 36 more samples in 25.6 s.Collecting 35 more samples in 24.9 s.Collecting 34 more samples in 24.2 s.Collecting 33 more samples in 23.5 s.Collecting 32 more samples in 22.8 s.Collecting 31 more samples in 22.1 s.Collecting 30 more samples in 21.3 s.Collecting 29 more samples in 20.6 s.Collecting 28 more samples in 19.9 s.Collecting 27 more samples in 19.2 s.Collecting 26 more samples in 18.5 s.Collecting 25 more samples in 17.8 s.Collecting 24 more samples in 17.1 s.Collecting 23 more samples in 16.4 s.Collecting 22 more samples in 15.7 s.Collecting 21 more samples in 14.9 s.Collecting 20 more samples in 14.2 s.Collecting 19 more samples in 13.5 s.Collecting 18 more samples in 12.8 s.Collecting 17 more samples in 12.1 s.Collecting 16 more samples in 11.4 s.Collecting 15 more samples in 10.7 s.Collecting 14 more samples in 10.0 s.Collecting 13 more samples in 9.2 s.Collecting 12 more samples in 8.5 s.Collecting 11 more samples in 7.8 s.Collecting 10 more samples in 7.1 s.Collecting 9 more samples in 6.4 s.Collecting 8 more samples in 5.7 s.Collecting 7 more samples in 5.0 s.Collecting 6 more samples in 4.3 s.Collecting 5 more samples in 3.6 s.Collecting 4 more samples in 2.8 s.Collecting 3 more samples in 2.1 s.Collecting 2 more samples in 1.4 s.Collecting 1 more samples in 0.7 s.mean: 752.6259 ms, lower bound: 737.7229 ms, upper bound: 768.3171 ms, confidence: 0.950
std dev: 78.24216 ms, lower bound: 68.22243 ms, upper bound: 91.48394 ms, confidence: 0.950
found 5 outliers among 100 samples (5.0%)
  5 (5.0%) high mild
variance introduced by outliers: 81.028%
variance is severely inflated by outliers
commits: 200000
retries: 1033
allocated bytes: 834759304

Running a subject "6/33333/ttrie"
Collecting 99 more samples in 22.1 s.Collecting 98 more samples in 21.8 s.Collecting 97 more samples in 21.6 s.Collecting 96 more samples in 21.4 s.Collecting 95 more samples in 21.2 s.Collecting 94 more samples in 20.9 s.Collecting 93 more samples in 20.7 s.Collecting 92 more samples in 20.5 s.Collecting 91 more samples in 20.3 s.Collecting 90 more samples in 20.0 s.Collecting 89 more samples in 19.8 s.Collecting 88 more samples in 19.6 s.Collecting 87 more samples in 19.4 s.Collecting 86 more samples in 19.2 s.Collecting 85 more samples in 18.9 s.Collecting 84 more samples in 18.7 s.Collecting 83 more samples in 18.5 s.Collecting 82 more samples in 18.3 s.Collecting 81 more samples in 18.0 s.Collecting 80 more samples in 17.8 s.Collecting 79 more samples in 17.6 s.Collecting 78 more samples in 17.4 s.Collecting 77 more samples in 17.2 s.Collecting 76 more samples in 16.9 s.Collecting 75 more samples in 16.7 s.Collecting 74 more samples in 16.5 s.Collecting 73 more samples in 16.3 s.Collecting 72 more samples in 16.0 s.Collecting 71 more samples in 15.8 s.Collecting 70 more samples in 15.6 s.Collecting 69 more samples in 15.4 s.Collecting 68 more samples in 15.1 s.Collecting 67 more samples in 14.9 s.Collecting 66 more samples in 14.7 s.Collecting 65 more samples in 14.5 s.Collecting 64 more samples in 14.3 s.Collecting 63 more samples in 14.0 s.Collecting 62 more samples in 13.8 s.Collecting 61 more samples in 13.6 s.Collecting 60 more samples in 13.4 s.Collecting 59 more samples in 13.1 s.Collecting 58 more samples in 12.9 s.Collecting 57 more samples in 12.7 s.Collecting 56 more samples in 12.5 s.Collecting 55 more samples in 12.3 s.Collecting 54 more samples in 12.0 s.Collecting 53 more samples in 11.8 s.Collecting 52 more samples in 11.6 s.Collecting 51 more samples in 11.4 s.Collecting 50 more samples in 11.1 s.Collecting 49 more samples in 10.9 s.Collecting 48 more samples in 10.7 s.Collecting 47 more samples in 10.5 s.Collecting 46 more samples in 10.2 s.Collecting 45 more samples in 10.0 s.Collecting 44 more samples in 9.8 s.Collecting 43 more samples in 9.6 s.Collecting 42 more samples in 9.4 s.Collecting 41 more samples in 9.1 s.Collecting 40 more samples in 8.9 s.Collecting 39 more samples in 8.7 s.Collecting 38 more samples in 8.5 s.Collecting 37 more samples in 8.2 s.Collecting 36 more samples in 8.0 s.Collecting 35 more samples in 7.8 s.Collecting 34 more samples in 7.6 s.Collecting 33 more samples in 7.4 s.Collecting 32 more samples in 7.1 s.Collecting 31 more samples in 6.9 s.Collecting 30 more samples in 6.7 s.Collecting 29 more samples in 6.5 s.Collecting 28 more samples in 6.2 s.Collecting 27 more samples in 6.0 s.Collecting 26 more samples in 5.8 s.Collecting 25 more samples in 5.6 s.Collecting 24 more samples in 5.3 s.Collecting 23 more samples in 5.1 s.Collecting 22 more samples in 4.9 s.Collecting 21 more samples in 4.7 s.Collecting 20 more samples in 4.5 s.Collecting 19 more samples in 4.2 s.Collecting 18 more samples in 4.0 s.Collecting 17 more samples in 3.8 s.Collecting 16 more samples in 3.6 s.Collecting 15 more samples in 3.3 s.Collecting 14 more samples in 3.1 s.Collecting 13 more samples in 2.9 s.Collecting 12 more samples in 2.7 s.Collecting 11 more samples in 2.5 s.Collecting 10 more samples in 2.2 s.Collecting 9 more samples in 2.0 s.Collecting 8 more samples in 1.8 s.Collecting 7 more samples in 1.6 s.Collecting 6 more samples in 1.3 s.Collecting 5 more samples in 1.1 s.Collecting 4 more samples in 0.9 s.Collecting 3 more samples in 0.7 s.Collecting 2 more samples in 0.4 s.Collecting 1 more samples in 0.2 s.mean: 233.7070 ms, lower bound: 229.2886 ms, upper bound: 241.4889 ms, confidence: 0.950
std dev: 29.12860 ms, lower bound: 19.01196 ms, upper bound: 43.73361 ms, confidence: 0.950
found 11 outliers among 100 samples (11.0%)
  6 (6.0%) high mild
  5 (5.0%) high severe
variance introduced by outliers: 86.239%
variance is severely inflated by outliers
commits: 200000
retries: 3
allocated bytes: 229779672

Running a subject "8/25000/unordered-containers"
Collecting 99 more samples in 47.9 s.Collecting 98 more samples in 47.4 s.Collecting 97 more samples in 46.9 s.Collecting 96 more samples in 46.4 s.Collecting 95 more samples in 45.9 s.Collecting 94 more samples in 45.4 s.Collecting 93 more samples in 45.0 s.Collecting 92 more samples in 44.5 s.Collecting 91 more samples in 44.0 s.Collecting 90 more samples in 43.5 s.Collecting 89 more samples in 43.0 s.Collecting 88 more samples in 42.5 s.Collecting 87 more samples in 42.1 s.Collecting 86 more samples in 41.6 s.Collecting 85 more samples in 41.1 s.Collecting 84 more samples in 40.6 s.Collecting 83 more samples in 40.1 s.Collecting 82 more samples in 39.6 s.Collecting 81 more samples in 39.2 s.Collecting 80 more samples in 38.7 s.Collecting 79 more samples in 38.2 s.Collecting 78 more samples in 37.7 s.Collecting 77 more samples in 37.2 s.Collecting 76 more samples in 36.7 s.Collecting 75 more samples in 36.3 s.Collecting 74 more samples in 35.8 s.Collecting 73 more samples in 35.3 s.Collecting 72 more samples in 34.8 s.Collecting 71 more samples in 34.3 s.Collecting 70 more samples in 33.8 s.Collecting 69 more samples in 33.4 s.Collecting 68 more samples in 32.9 s.Collecting 67 more samples in 32.4 s.Collecting 66 more samples in 31.9 s.Collecting 65 more samples in 31.4 s.Collecting 64 more samples in 30.9 s.Collecting 63 more samples in 30.5 s.Collecting 62 more samples in 30.0 s.Collecting 61 more samples in 29.5 s.Collecting 60 more samples in 29.0 s.Collecting 59 more samples in 28.5 s.Collecting 58 more samples in 28.0 s.Collecting 57 more samples in 27.6 s.Collecting 56 more samples in 27.1 s.Collecting 55 more samples in 26.6 s.Collecting 54 more samples in 26.1 s.Collecting 53 more samples in 25.6 s.Collecting 52 more samples in 25.1 s.Collecting 51 more samples in 24.7 s.Collecting 50 more samples in 24.2 s.Collecting 49 more samples in 23.7 s.Collecting 48 more samples in 23.2 s.Collecting 47 more samples in 22.7 s.Collecting 46 more samples in 22.2 s.Collecting 45 more samples in 21.8 s.Collecting 44 more samples in 21.3 s.Collecting 43 more samples in 20.8 s.Collecting 42 more samples in 20.3 s.Collecting 41 more samples in 19.8 s.Collecting 40 more samples in 19.3 s.Collecting 39 more samples in 18.9 s.Collecting 38 more samples in 18.4 s.Collecting 37 more samples in 17.9 s.Collecting 36 more samples in 17.4 s.Collecting 35 more samples in 16.9 s.Collecting 34 more samples in 16.4 s.Collecting 33 more samples in 16.0 s.Collecting 32 more samples in 15.5 s.Collecting 31 more samples in 15.0 s.Collecting 30 more samples in 14.5 s.Collecting 29 more samples in 14.0 s.Collecting 28 more samples in 13.5 s.Collecting 27 more samples in 13.1 s.Collecting 26 more samples in 12.6 s.Collecting 25 more samples in 12.1 s.Collecting 24 more samples in 11.6 s.Collecting 23 more samples in 11.1 s.Collecting 22 more samples in 10.6 s.Collecting 21 more samples in 10.2 s.Collecting 20 more samples in 9.7 s.Collecting 19 more samples in 9.2 s.Collecting 18 more samples in 8.7 s.Collecting 17 more samples in 8.2 s.Collecting 16 more samples in 7.7 s.Collecting 15 more samples in 7.3 s.Collecting 14 more samples in 6.8 s.Collecting 13 more samples in 6.3 s.Collecting 12 more samples in 5.8 s.Collecting 11 more samples in 5.3 s.Collecting 10 more samples in 4.8 s.Collecting 9 more samples in 4.4 s.Collecting 8 more samples in 3.9 s.Collecting 7 more samples in 3.4 s.Collecting 6 more samples in 2.9 s.Collecting 5 more samples in 2.4 s.Collecting 4 more samples in 1.9 s.Collecting 3 more samples in 1.5 s.Collecting 2 more samples in 1.0 s.Collecting 1 more samples in 0.5 s.mean: 442.3134 ms, lower bound: 437.1281 ms, upper bound: 446.9671 ms, confidence: 0.950
std dev: 25.03333 ms, lower bound: 20.67133 ms, upper bound: 31.09295 ms, confidence: 0.950
found 6 outliers among 100 samples (6.0%)
  4 (4.0%) low mild
  2 (2.0%) high mild
variance introduced by outliers: 54.470%
variance is severely inflated by outliers
commits: 200000
retries: 462041
allocated bytes: 597682192

Running a subject "8/25000/stm-containers"
Collecting 99 more samples in 75.8 s.Collecting 98 more samples in 75.1 s.Collecting 97 more samples in 74.3 s.Collecting 96 more samples in 73.5 s.Collecting 95 more samples in 72.8 s.Collecting 94 more samples in 72.0 s.Collecting 93 more samples in 71.2 s.Collecting 92 more samples in 70.5 s.Collecting 91 more samples in 69.7 s.Collecting 90 more samples in 68.9 s.Collecting 89 more samples in 68.2 s.Collecting 88 more samples in 67.4 s.Collecting 87 more samples in 66.6 s.Collecting 86 more samples in 65.9 s.Collecting 85 more samples in 65.1 s.Collecting 84 more samples in 64.3 s.Collecting 83 more samples in 63.6 s.Collecting 82 more samples in 62.8 s.Collecting 81 more samples in 62.0 s.Collecting 80 more samples in 61.3 s.Collecting 79 more samples in 60.5 s.Collecting 78 more samples in 59.7 s.Collecting 77 more samples in 59.0 s.Collecting 76 more samples in 58.2 s.Collecting 75 more samples in 57.4 s.Collecting 74 more samples in 56.7 s.Collecting 73 more samples in 55.9 s.Collecting 72 more samples in 55.1 s.Collecting 71 more samples in 54.4 s.Collecting 70 more samples in 53.6 s.Collecting 69 more samples in 52.8 s.Collecting 68 more samples in 52.1 s.Collecting 67 more samples in 51.3 s.Collecting 66 more samples in 50.5 s.Collecting 65 more samples in 49.8 s.Collecting 64 more samples in 49.0 s.Collecting 63 more samples in 48.3 s.Collecting 62 more samples in 47.5 s.Collecting 61 more samples in 46.7 s.Collecting 60 more samples in 46.0 s.Collecting 59 more samples in 45.2 s.Collecting 58 more samples in 44.4 s.Collecting 57 more samples in 43.7 s.Collecting 56 more samples in 42.9 s.Collecting 55 more samples in 42.1 s.Collecting 54 more samples in 41.4 s.Collecting 53 more samples in 40.6 s.Collecting 52 more samples in 39.8 s.Collecting 51 more samples in 39.1 s.Collecting 50 more samples in 38.3 s.Collecting 49 more samples in 37.5 s.Collecting 48 more samples in 36.8 s.Collecting 47 more samples in 36.0 s.Collecting 46 more samples in 35.2 s.Collecting 45 more samples in 34.5 s.Collecting 44 more samples in 33.7 s.Collecting 43 more samples in 32.9 s.Collecting 42 more samples in 32.2 s.Collecting 41 more samples in 31.4 s.Collecting 40 more samples in 30.6 s.Collecting 39 more samples in 29.9 s.Collecting 38 more samples in 29.1 s.Collecting 37 more samples in 28.3 s.Collecting 36 more samples in 27.6 s.Collecting 35 more samples in 26.8 s.Collecting 34 more samples in 26.0 s.Collecting 33 more samples in 25.3 s.Collecting 32 more samples in 24.5 s.Collecting 31 more samples in 23.7 s.Collecting 30 more samples in 23.0 s.Collecting 29 more samples in 22.2 s.Collecting 28 more samples in 21.4 s.Collecting 27 more samples in 20.7 s.Collecting 26 more samples in 19.9 s.Collecting 25 more samples in 19.1 s.Collecting 24 more samples in 18.4 s.Collecting 23 more samples in 17.6 s.Collecting 22 more samples in 16.8 s.Collecting 21 more samples in 16.1 s.Collecting 20 more samples in 15.3 s.Collecting 19 more samples in 14.6 s.Collecting 18 more samples in 13.8 s.Collecting 17 more samples in 13.0 s.Collecting 16 more samples in 12.3 s.Collecting 15 more samples in 11.5 s.Collecting 14 more samples in 10.7 s.Collecting 13 more samples in 10.0 s.Collecting 12 more samples in 9.2 s.Collecting 11 more samples in 8.4 s.Collecting 10 more samples in 7.7 s.Collecting 9 more samples in 6.9 s.Collecting 8 more samples in 6.1 s.Collecting 7 more samples in 5.4 s.Collecting 6 more samples in 4.6 s.Collecting 5 more samples in 3.8 s.Collecting 4 more samples in 3.1 s.Collecting 3 more samples in 2.3 s.Collecting 2 more samples in 1.5 s.Collecting 1 more samples in 0.8 s.mean: 632.4414 ms, lower bound: 617.2187 ms, upper bound: 648.7417 ms, confidence: 0.950
std dev: 81.42158 ms, lower bound: 71.75669 ms, upper bound: 102.7509 ms, confidence: 0.950
found 1 outliers among 100 samples (1.0%)
variance introduced by outliers: 86.286%
variance is severely inflated by outliers
commits: 200000
retries: 1334
allocated bytes: 835455304

Running a subject "8/25000/ttrie"
Collecting 100 more samples in 17.9 s.Collecting 99 more samples in 17.7 s.Collecting 98 more samples in 17.5 s.Collecting 97 more samples in 17.3 s.Collecting 96 more samples in 17.1 s.Collecting 95 more samples in 17.0 s.Collecting 94 more samples in 16.8 s.Collecting 93 more samples in 16.6 s.Collecting 92 more samples in 16.4 s.Collecting 91 more samples in 16.2 s.Collecting 90 more samples in 16.1 s.Collecting 89 more samples in 15.9 s.Collecting 88 more samples in 15.7 s.Collecting 87 more samples in 15.5 s.Collecting 86 more samples in 15.4 s.Collecting 85 more samples in 15.2 s.Collecting 84 more samples in 15.0 s.Collecting 83 more samples in 14.8 s.Collecting 82 more samples in 14.6 s.Collecting 81 more samples in 14.5 s.Collecting 80 more samples in 14.3 s.Collecting 79 more samples in 14.1 s.Collecting 78 more samples in 13.9 s.Collecting 77 more samples in 13.7 s.Collecting 76 more samples in 13.6 s.Collecting 75 more samples in 13.4 s.Collecting 74 more samples in 13.2 s.Collecting 73 more samples in 13.0 s.Collecting 72 more samples in 12.9 s.Collecting 71 more samples in 12.7 s.Collecting 70 more samples in 12.5 s.Collecting 69 more samples in 12.3 s.Collecting 68 more samples in 12.1 s.Collecting 67 more samples in 12.0 s.Collecting 66 more samples in 11.8 s.Collecting 65 more samples in 11.6 s.Collecting 64 more samples in 11.4 s.Collecting 63 more samples in 11.2 s.Collecting 62 more samples in 11.1 s.Collecting 61 more samples in 10.9 s.Collecting 60 more samples in 10.7 s.Collecting 59 more samples in 10.5 s.Collecting 58 more samples in 10.4 s.Collecting 57 more samples in 10.2 s.Collecting 56 more samples in 10.0 s.Collecting 55 more samples in 9.8 s.Collecting 54 more samples in 9.6 s.Collecting 53 more samples in 9.5 s.Collecting 52 more samples in 9.3 s.Collecting 51 more samples in 9.1 s.Collecting 50 more samples in 8.9 s.Collecting 49 more samples in 8.7 s.Collecting 48 more samples in 8.6 s.Collecting 47 more samples in 8.4 s.Collecting 46 more samples in 8.2 s.Collecting 45 more samples in 8.0 s.Collecting 44 more samples in 7.9 s.Collecting 43 more samples in 7.7 s.Collecting 42 more samples in 7.5 s.Collecting 41 more samples in 7.3 s.Collecting 40 more samples in 7.1 s.Collecting 39 more samples in 7.0 s.Collecting 38 more samples in 6.8 s.Collecting 37 more samples in 6.6 s.Collecting 36 more samples in 6.4 s.Collecting 35 more samples in 6.2 s.Collecting 34 more samples in 6.1 s.Collecting 33 more samples in 5.9 s.Collecting 32 more samples in 5.7 s.Collecting 31 more samples in 5.5 s.Collecting 30 more samples in 5.4 s.Collecting 29 more samples in 5.2 s.Collecting 28 more samples in 5.0 s.Collecting 27 more samples in 4.8 s.Collecting 26 more samples in 4.6 s.Collecting 25 more samples in 4.5 s.Collecting 24 more samples in 4.3 s.Collecting 23 more samples in 4.1 s.Collecting 22 more samples in 3.9 s.Collecting 21 more samples in 3.7 s.Collecting 20 more samples in 3.6 s.Collecting 19 more samples in 3.4 s.Collecting 18 more samples in 3.2 s.Collecting 17 more samples in 3.0 s.Collecting 16 more samples in 2.9 s.Collecting 15 more samples in 2.7 s.Collecting 14 more samples in 2.5 s.Collecting 13 more samples in 2.3 s.Collecting 12 more samples in 2.1 s.Collecting 11 more samples in 2.0 s.Collecting 10 more samples in 1.8 s.Collecting 9 more samples in 1.6 s.Collecting 8 more samples in 1.4 s.Collecting 7 more samples in 1.2 s.Collecting 6 more samples in 1.1 s.Collecting 5 more samples in 0.9 s.Collecting 4 more samples in 0.7 s.Collecting 3 more samples in 0.5 s.Collecting 2 more samples in 0.4 s.Collecting 1 more samples in 0.2 s.mean: 184.4788 ms, lower bound: 180.4693 ms, upper bound: 191.0881 ms, confidence: 0.950
std dev: 25.96619 ms, lower bound: 17.64130 ms, upper bound: 37.25747 ms, confidence: 0.950
found 14 outliers among 100 samples (14.0%)
  8 (8.0%) high mild
  5 (5.0%) high severe
variance introduced by outliers: 88.375%
variance is severely inflated by outliers
commits: 200000
retries: 3
allocated bytes: 229779688

Running a subject "10/20000/unordered-containers"
Collecting 99 more samples in 53.1 s.Collecting 98 more samples in 52.5 s.Collecting 97 more samples in 52.0 s.Collecting 96 more samples in 51.4 s.Collecting 95 more samples in 50.9 s.Collecting 94 more samples in 50.4 s.Collecting 93 more samples in 49.8 s.Collecting 92 more samples in 49.3 s.Collecting 91 more samples in 48.8 s.Collecting 90 more samples in 48.2 s.Collecting 89 more samples in 47.7 s.Collecting 88 more samples in 47.2 s.Collecting 87 more samples in 46.6 s.Collecting 86 more samples in 46.1 s.Collecting 85 more samples in 45.6 s.Collecting 84 more samples in 45.0 s.Collecting 83 more samples in 44.5 s.Collecting 82 more samples in 43.9 s.Collecting 81 more samples in 43.4 s.Collecting 80 more samples in 42.9 s.Collecting 79 more samples in 42.3 s.Collecting 78 more samples in 41.8 s.Collecting 77 more samples in 41.3 s.Collecting 76 more samples in 40.7 s.Collecting 75 more samples in 40.2 s.Collecting 74 more samples in 39.7 s.Collecting 73 more samples in 39.1 s.Collecting 72 more samples in 38.6 s.Collecting 71 more samples in 38.0 s.Collecting 70 more samples in 37.5 s.Collecting 69 more samples in 37.0 s.Collecting 68 more samples in 36.4 s.Collecting 67 more samples in 35.9 s.Collecting 66 more samples in 35.4 s.Collecting 65 more samples in 34.8 s.Collecting 64 more samples in 34.3 s.Collecting 63 more samples in 33.8 s.Collecting 62 more samples in 33.2 s.Collecting 61 more samples in 32.7 s.Collecting 60 more samples in 32.2 s.Collecting 59 more samples in 31.6 s.Collecting 58 more samples in 31.1 s.Collecting 57 more samples in 30.5 s.Collecting 56 more samples in 30.0 s.Collecting 55 more samples in 29.5 s.Collecting 54 more samples in 28.9 s.Collecting 53 more samples in 28.4 s.Collecting 52 more samples in 27.9 s.Collecting 51 more samples in 27.3 s.Collecting 50 more samples in 26.8 s.Collecting 49 more samples in 26.3 s.Collecting 48 more samples in 25.7 s.Collecting 47 more samples in 25.2 s.Collecting 46 more samples in 24.7 s.Collecting 45 more samples in 24.1 s.Collecting 44 more samples in 23.6 s.Collecting 43 more samples in 23.0 s.Collecting 42 more samples in 22.5 s.Collecting 41 more samples in 22.0 s.Collecting 40 more samples in 21.4 s.Collecting 39 more samples in 20.9 s.Collecting 38 more samples in 20.4 s.Collecting 37 more samples in 19.8 s.Collecting 36 more samples in 19.3 s.Collecting 35 more samples in 18.8 s.Collecting 34 more samples in 18.2 s.Collecting 33 more samples in 17.7 s.Collecting 32 more samples in 17.1 s.Collecting 31 more samples in 16.6 s.Collecting 30 more samples in 16.1 s.Collecting 29 more samples in 15.5 s.Collecting 28 more samples in 15.0 s.Collecting 27 more samples in 14.5 s.Collecting 26 more samples in 13.9 s.Collecting 25 more samples in 13.4 s.Collecting 24 more samples in 12.9 s.Collecting 23 more samples in 12.3 s.Collecting 22 more samples in 11.8 s.Collecting 21 more samples in 11.3 s.Collecting 20 more samples in 10.7 s.Collecting 19 more samples in 10.2 s.Collecting 18 more samples in 9.6 s.Collecting 17 more samples in 9.1 s.Collecting 16 more samples in 8.6 s.Collecting 15 more samples in 8.0 s.Collecting 14 more samples in 7.5 s.Collecting 13 more samples in 7.0 s.Collecting 12 more samples in 6.4 s.Collecting 11 more samples in 5.9 s.Collecting 10 more samples in 5.4 s.Collecting 9 more samples in 4.8 s.Collecting 8 more samples in 4.3 s.Collecting 7 more samples in 3.8 s.Collecting 6 more samples in 3.2 s.Collecting 5 more samples in 2.7 s.Collecting 4 more samples in 2.1 s.Collecting 3 more samples in 1.6 s.Collecting 2 more samples in 1.1 s.Collecting 1 more samples in 0.5 s.mean: 467.7557 ms, lower bound: 459.6981 ms, upper bound: 481.9449 ms, confidence: 0.950
std dev: 53.30927 ms, lower bound: 35.39172 ms, upper bound: 80.32743 ms, confidence: 0.950
found 12 outliers among 100 samples (12.0%)
  3 (3.0%) low mild
  5 (5.0%) high mild
  4 (4.0%) high severe
variance introduced by outliers: 83.151%
variance is severely inflated by outliers
commits: 200000
retries: 559216
allocated bytes: 726939952

Running a subject "10/20000/stm-containers"
Collecting 99 more samples in 46.0 s.Collecting 98 more samples in 45.5 s.Collecting 97 more samples in 45.0 s.Collecting 96 more samples in 44.6 s.Collecting 95 more samples in 44.1 s.Collecting 94 more samples in 43.6 s.Collecting 93 more samples in 43.2 s.Collecting 92 more samples in 42.7 s.Collecting 91 more samples in 42.3 s.Collecting 90 more samples in 41.8 s.Collecting 89 more samples in 41.3 s.Collecting 88 more samples in 40.9 s.Collecting 87 more samples in 40.4 s.Collecting 86 more samples in 39.9 s.Collecting 85 more samples in 39.5 s.Collecting 84 more samples in 39.0 s.Collecting 83 more samples in 38.5 s.Collecting 82 more samples in 38.1 s.Collecting 81 more samples in 37.6 s.Collecting 80 more samples in 37.1 s.Collecting 79 more samples in 36.7 s.Collecting 78 more samples in 36.2 s.Collecting 77 more samples in 35.8 s.Collecting 76 more samples in 35.3 s.Collecting 75 more samples in 34.8 s.Collecting 74 more samples in 34.4 s.Collecting 73 more samples in 33.9 s.Collecting 72 more samples in 33.4 s.Collecting 71 more samples in 33.0 s.Collecting 70 more samples in 32.5 s.Collecting 69 more samples in 32.0 s.Collecting 68 more samples in 31.6 s.Collecting 67 more samples in 31.1 s.Collecting 66 more samples in 30.6 s.Collecting 65 more samples in 30.2 s.Collecting 64 more samples in 29.7 s.Collecting 63 more samples in 29.3 s.Collecting 62 more samples in 28.8 s.Collecting 61 more samples in 28.3 s.Collecting 60 more samples in 27.9 s.Collecting 59 more samples in 27.4 s.Collecting 58 more samples in 26.9 s.Collecting 57 more samples in 26.5 s.Collecting 56 more samples in 26.0 s.Collecting 55 more samples in 25.5 s.Collecting 54 more samples in 25.1 s.Collecting 53 more samples in 24.6 s.Collecting 52 more samples in 24.1 s.Collecting 51 more samples in 23.7 s.Collecting 50 more samples in 23.2 s.Collecting 49 more samples in 22.8 s.Collecting 48 more samples in 22.3 s.Collecting 47 more samples in 21.8 s.Collecting 46 more samples in 21.4 s.Collecting 45 more samples in 20.9 s.Collecting 44 more samples in 20.4 s.Collecting 43 more samples in 20.0 s.Collecting 42 more samples in 19.5 s.Collecting 41 more samples in 19.0 s.Collecting 40 more samples in 18.6 s.Collecting 39 more samples in 18.1 s.Collecting 38 more samples in 17.6 s.Collecting 37 more samples in 17.2 s.Collecting 36 more samples in 16.7 s.Collecting 35 more samples in 16.3 s.Collecting 34 more samples in 15.8 s.Collecting 33 more samples in 15.3 s.Collecting 32 more samples in 14.9 s.Collecting 31 more samples in 14.4 s.Collecting 30 more samples in 13.9 s.Collecting 29 more samples in 13.5 s.Collecting 28 more samples in 13.0 s.Collecting 27 more samples in 12.5 s.Collecting 26 more samples in 12.1 s.Collecting 25 more samples in 11.6 s.Collecting 24 more samples in 11.1 s.Collecting 23 more samples in 10.7 s.Collecting 22 more samples in 10.2 s.Collecting 21 more samples in 9.8 s.Collecting 20 more samples in 9.3 s.Collecting 19 more samples in 8.8 s.Collecting 18 more samples in 8.4 s.Collecting 17 more samples in 7.9 s.Collecting 16 more samples in 7.4 s.Collecting 15 more samples in 7.0 s.Collecting 14 more samples in 6.5 s.Collecting 13 more samples in 6.0 s.Collecting 12 more samples in 5.6 s.Collecting 11 more samples in 5.1 s.Collecting 10 more samples in 4.6 s.Collecting 9 more samples in 4.2 s.Collecting 8 more samples in 3.7 s.Collecting 7 more samples in 3.3 s.Collecting 6 more samples in 2.8 s.Collecting 5 more samples in 2.3 s.Collecting 4 more samples in 1.9 s.Collecting 3 more samples in 1.4 s.Collecting 2 more samples in 0.9 s.Collecting 1 more samples in 0.5 s.mean: 555.2481 ms, lower bound: 542.9797 ms, upper bound: 568.5499 ms, confidence: 0.950
std dev: 65.49794 ms, lower bound: 56.81670 ms, upper bound: 85.32818 ms, confidence: 0.950
found 1 outliers among 100 samples (1.0%)
variance introduced by outliers: 84.189%
variance is severely inflated by outliers
commits: 200000
retries: 1574
allocated bytes: 835396528

Running a subject "10/20000/ttrie"
Collecting 100 more samples in 15.1 s.Collecting 99 more samples in 15.0 s.Collecting 98 more samples in 14.8 s.Collecting 97 more samples in 14.7 s.Collecting 96 more samples in 14.5 s.Collecting 95 more samples in 14.4 s.Collecting 94 more samples in 14.2 s.Collecting 93 more samples in 14.1 s.Collecting 92 more samples in 13.9 s.Collecting 91 more samples in 13.8 s.Collecting 90 more samples in 13.6 s.Collecting 89 more samples in 13.5 s.Collecting 88 more samples in 13.3 s.Collecting 87 more samples in 13.2 s.Collecting 86 more samples in 13.0 s.Collecting 85 more samples in 12.8 s.Collecting 84 more samples in 12.7 s.Collecting 83 more samples in 12.5 s.Collecting 82 more samples in 12.4 s.Collecting 81 more samples in 12.2 s.Collecting 80 more samples in 12.1 s.Collecting 79 more samples in 11.9 s.Collecting 78 more samples in 11.8 s.Collecting 77 more samples in 11.6 s.Collecting 76 more samples in 11.5 s.Collecting 75 more samples in 11.3 s.Collecting 74 more samples in 11.2 s.Collecting 73 more samples in 11.0 s.Collecting 72 more samples in 10.9 s.Collecting 71 more samples in 10.7 s.Collecting 70 more samples in 10.6 s.Collecting 69 more samples in 10.4 s.Collecting 68 more samples in 10.3 s.Collecting 67 more samples in 10.1 s.Collecting 66 more samples in 10.0 s.Collecting 65 more samples in 9.8 s.Collecting 64 more samples in 9.7 s.Collecting 63 more samples in 9.5 s.Collecting 62 more samples in 9.4 s.Collecting 61 more samples in 9.2 s.Collecting 60 more samples in 9.1 s.Collecting 59 more samples in 8.9 s.Collecting 58 more samples in 8.8 s.Collecting 57 more samples in 8.6 s.Collecting 56 more samples in 8.5 s.Collecting 55 more samples in 8.3 s.Collecting 54 more samples in 8.2 s.Collecting 53 more samples in 8.0 s.Collecting 52 more samples in 7.9 s.Collecting 51 more samples in 7.7 s.Collecting 50 more samples in 7.6 s.Collecting 49 more samples in 7.4 s.Collecting 48 more samples in 7.3 s.Collecting 47 more samples in 7.1 s.Collecting 46 more samples in 7.0 s.Collecting 45 more samples in 6.8 s.Collecting 44 more samples in 6.7 s.Collecting 43 more samples in 6.5 s.Collecting 42 more samples in 6.3 s.Collecting 41 more samples in 6.2 s.Collecting 40 more samples in 6.0 s.Collecting 39 more samples in 5.9 s.Collecting 38 more samples in 5.7 s.Collecting 37 more samples in 5.6 s.Collecting 36 more samples in 5.4 s.Collecting 35 more samples in 5.3 s.Collecting 34 more samples in 5.1 s.Collecting 33 more samples in 5.0 s.Collecting 32 more samples in 4.8 s.Collecting 31 more samples in 4.7 s.Collecting 30 more samples in 4.5 s.Collecting 29 more samples in 4.4 s.Collecting 28 more samples in 4.2 s.Collecting 27 more samples in 4.1 s.Collecting 26 more samples in 3.9 s.Collecting 25 more samples in 3.8 s.Collecting 24 more samples in 3.6 s.Collecting 23 more samples in 3.5 s.Collecting 22 more samples in 3.3 s.Collecting 21 more samples in 3.2 s.Collecting 20 more samples in 3.0 s.Collecting 19 more samples in 2.9 s.Collecting 18 more samples in 2.7 s.Collecting 17 more samples in 2.6 s.Collecting 16 more samples in 2.4 s.Collecting 15 more samples in 2.3 s.Collecting 14 more samples in 2.1 s.Collecting 13 more samples in 2.0 s.Collecting 12 more samples in 1.8 s.Collecting 11 more samples in 1.7 s.Collecting 10 more samples in 1.5 s.Collecting 9 more samples in 1.4 s.Collecting 8 more samples in 1.2 s.Collecting 7 more samples in 1.1 s.Collecting 6 more samples in 0.9 s.Collecting 5 more samples in 0.8 s.Collecting 4 more samples in 0.6 s.Collecting 3 more samples in 0.5 s.Collecting 2 more samples in 0.3 s.Collecting 1 more samples in 0.2 s.mean: 148.0133 ms, lower bound: 145.2379 ms, upper bound: 152.5051 ms, confidence: 0.950
std dev: 17.78940 ms, lower bound: 12.32763 ms, upper bound: 28.67366 ms, confidence: 0.950
found 6 outliers among 100 samples (6.0%)
  3 (3.0%) high mild
  3 (3.0%) high severe
variance introduced by outliers: 85.200%
variance is severely inflated by outliers
commits: 200000
retries: 9
allocated bytes: 229794544

Running a subject "12/16666/unordered-containers"
Collecting 99 more samples in 48.9 s.Collecting 98 more samples in 48.4 s.Collecting 97 more samples in 47.9 s.Collecting 96 more samples in 47.4 s.Collecting 95 more samples in 46.9 s.Collecting 94 more samples in 46.4 s.Collecting 93 more samples in 45.9 s.Collecting 92 more samples in 45.4 s.Collecting 91 more samples in 44.9 s.Collecting 90 more samples in 44.4 s.Collecting 89 more samples in 43.9 s.Collecting 88 more samples in 43.4 s.Collecting 87 more samples in 42.9 s.Collecting 86 more samples in 42.5 s.Collecting 85 more samples in 42.0 s.Collecting 84 more samples in 41.5 s.Collecting 83 more samples in 41.0 s.Collecting 82 more samples in 40.5 s.Collecting 81 more samples in 40.0 s.Collecting 80 more samples in 39.5 s.Collecting 79 more samples in 39.0 s.Collecting 78 more samples in 38.5 s.Collecting 77 more samples in 38.0 s.Collecting 76 more samples in 37.5 s.Collecting 75 more samples in 37.0 s.Collecting 74 more samples in 36.5 s.Collecting 73 more samples in 36.0 s.Collecting 72 more samples in 35.5 s.Collecting 71 more samples in 35.1 s.Collecting 70 more samples in 34.6 s.Collecting 69 more samples in 34.1 s.Collecting 68 more samples in 33.6 s.Collecting 67 more samples in 33.1 s.Collecting 66 more samples in 32.6 s.Collecting 65 more samples in 32.1 s.Collecting 64 more samples in 31.6 s.Collecting 63 more samples in 31.1 s.Collecting 62 more samples in 30.6 s.Collecting 61 more samples in 30.1 s.Collecting 60 more samples in 29.6 s.Collecting 59 more samples in 29.1 s.Collecting 58 more samples in 28.6 s.Collecting 57 more samples in 28.1 s.Collecting 56 more samples in 27.6 s.Collecting 55 more samples in 27.2 s.Collecting 54 more samples in 26.7 s.Collecting 53 more samples in 26.2 s.Collecting 52 more samples in 25.7 s.Collecting 51 more samples in 25.2 s.Collecting 50 more samples in 24.7 s.Collecting 49 more samples in 24.2 s.Collecting 48 more samples in 23.7 s.Collecting 47 more samples in 23.2 s.Collecting 46 more samples in 22.7 s.Collecting 45 more samples in 22.2 s.Collecting 44 more samples in 21.7 s.Collecting 43 more samples in 21.2 s.Collecting 42 more samples in 20.7 s.Collecting 41 more samples in 20.2 s.Collecting 40 more samples in 19.7 s.Collecting 39 more samples in 19.3 s.Collecting 38 more samples in 18.8 s.Collecting 37 more samples in 18.3 s.Collecting 36 more samples in 17.8 s.Collecting 35 more samples in 17.3 s.Collecting 34 more samples in 16.8 s.Collecting 33 more samples in 16.3 s.Collecting 32 more samples in 15.8 s.Collecting 31 more samples in 15.3 s.Collecting 30 more samples in 14.8 s.Collecting 29 more samples in 14.3 s.Collecting 28 more samples in 13.8 s.Collecting 27 more samples in 13.3 s.Collecting 26 more samples in 12.8 s.Collecting 25 more samples in 12.3 s.Collecting 24 more samples in 11.8 s.Collecting 23 more samples in 11.4 s.Collecting 22 more samples in 10.9 s.Collecting 21 more samples in 10.4 s.Collecting 20 more samples in 9.9 s.Collecting 19 more samples in 9.4 s.Collecting 18 more samples in 8.9 s.Collecting 17 more samples in 8.4 s.Collecting 16 more samples in 7.9 s.Collecting 15 more samples in 7.4 s.Collecting 14 more samples in 6.9 s.Collecting 13 more samples in 6.4 s.Collecting 12 more samples in 5.9 s.Collecting 11 more samples in 5.4 s.Collecting 10 more samples in 4.9 s.Collecting 9 more samples in 4.4 s.Collecting 8 more samples in 3.9 s.Collecting 7 more samples in 3.5 s.Collecting 6 more samples in 3.0 s.Collecting 5 more samples in 2.5 s.Collecting 4 more samples in 2.0 s.Collecting 3 more samples in 1.5 s.Collecting 2 more samples in 1.0 s.Collecting 1 more samples in 0.5 s.mean: 482.3351 ms, lower bound: 474.6926 ms, upper bound: 494.2453 ms, confidence: 0.950
std dev: 48.27097 ms, lower bound: 32.56850 ms, upper bound: 73.21295 ms, confidence: 0.950
found 7 outliers among 100 samples (7.0%)
  5 (5.0%) high mild
  2 (2.0%) high severe
variance introduced by outliers: 79.002%
variance is severely inflated by outliers
commits: 200000
retries: 771771
allocated bytes: 780051432

Running a subject "12/16666/stm-containers"
Collecting 99 more samples in 55.0 s.Collecting 98 more samples in 54.5 s.Collecting 97 more samples in 53.9 s.Collecting 96 more samples in 53.4 s.Collecting 95 more samples in 52.8 s.Collecting 94 more samples in 52.2 s.Collecting 93 more samples in 51.7 s.Collecting 92 more samples in 51.1 s.Collecting 91 more samples in 50.6 s.Collecting 90 more samples in 50.0 s.Collecting 89 more samples in 49.5 s.Collecting 88 more samples in 48.9 s.Collecting 87 more samples in 48.4 s.Collecting 86 more samples in 47.8 s.Collecting 85 more samples in 47.2 s.Collecting 84 more samples in 46.7 s.Collecting 83 more samples in 46.1 s.Collecting 82 more samples in 45.6 s.Collecting 81 more samples in 45.0 s.Collecting 80 more samples in 44.5 s.Collecting 79 more samples in 43.9 s.Collecting 78 more samples in 43.3 s.Collecting 77 more samples in 42.8 s.Collecting 76 more samples in 42.2 s.Collecting 75 more samples in 41.7 s.Collecting 74 more samples in 41.1 s.Collecting 73 more samples in 40.6 s.Collecting 72 more samples in 40.0 s.Collecting 71 more samples in 39.5 s.Collecting 70 more samples in 38.9 s.Collecting 69 more samples in 38.3 s.Collecting 68 more samples in 37.8 s.Collecting 67 more samples in 37.2 s.Collecting 66 more samples in 36.7 s.Collecting 65 more samples in 36.1 s.Collecting 64 more samples in 35.6 s.Collecting 63 more samples in 35.0 s.Collecting 62 more samples in 34.5 s.Collecting 61 more samples in 33.9 s.Collecting 60 more samples in 33.3 s.Collecting 59 more samples in 32.8 s.Collecting 58 more samples in 32.2 s.Collecting 57 more samples in 31.7 s.Collecting 56 more samples in 31.1 s.Collecting 55 more samples in 30.6 s.Collecting 54 more samples in 30.0 s.Collecting 53 more samples in 29.5 s.Collecting 52 more samples in 28.9 s.Collecting 51 more samples in 28.3 s.Collecting 50 more samples in 27.8 s.Collecting 49 more samples in 27.2 s.Collecting 48 more samples in 26.7 s.Collecting 47 more samples in 26.1 s.Collecting 46 more samples in 25.6 s.Collecting 45 more samples in 25.0 s.Collecting 44 more samples in 24.5 s.Collecting 43 more samples in 23.9 s.Collecting 42 more samples in 23.3 s.Collecting 41 more samples in 22.8 s.Collecting 40 more samples in 22.2 s.Collecting 39 more samples in 21.7 s.Collecting 38 more samples in 21.1 s.Collecting 37 more samples in 20.6 s.Collecting 36 more samples in 20.0 s.Collecting 35 more samples in 19.5 s.Collecting 34 more samples in 18.9 s.Collecting 33 more samples in 18.3 s.Collecting 32 more samples in 17.8 s.Collecting 31 more samples in 17.2 s.Collecting 30 more samples in 16.7 s.Collecting 29 more samples in 16.1 s.Collecting 28 more samples in 15.6 s.Collecting 27 more samples in 15.0 s.Collecting 26 more samples in 14.4 s.Collecting 25 more samples in 13.9 s.Collecting 24 more samples in 13.3 s.Collecting 23 more samples in 12.8 s.Collecting 22 more samples in 12.2 s.Collecting 21 more samples in 11.7 s.Collecting 20 more samples in 11.1 s.Collecting 19 more samples in 10.6 s.Collecting 18 more samples in 10.0 s.Collecting 17 more samples in 9.4 s.Collecting 16 more samples in 8.9 s.Collecting 15 more samples in 8.3 s.Collecting 14 more samples in 7.8 s.Collecting 13 more samples in 7.2 s.Collecting 12 more samples in 6.7 s.Collecting 11 more samples in 6.1 s.Collecting 10 more samples in 5.6 s.Collecting 9 more samples in 5.0 s.Collecting 8 more samples in 4.4 s.Collecting 7 more samples in 3.9 s.Collecting 6 more samples in 3.3 s.Collecting 5 more samples in 2.8 s.Collecting 4 more samples in 2.2 s.Collecting 3 more samples in 1.7 s.Collecting 2 more samples in 1.1 s.Collecting 1 more samples in 0.6 s.mean: 513.9403 ms, lower bound: 502.6648 ms, upper bound: 526.0788 ms, confidence: 0.950
std dev: 60.07850 ms, lower bound: 51.73142 ms, upper bound: 71.75588 ms, confidence: 0.950
found 4 outliers among 100 samples (4.0%)
  4 (4.0%) high mild
variance introduced by outliers: 84.174%
variance is severely inflated by outliers
commits: 200000
retries: 1670
allocated bytes: 835981184

Running a subject "12/16666/ttrie"
Collecting 100 more samples in 18.6 s.Collecting 99 more samples in 18.4 s.Collecting 98 more samples in 18.2 s.Collecting 97 more samples in 18.0 s.Collecting 96 more samples in 17.9 s.Collecting 95 more samples in 17.7 s.Collecting 94 more samples in 17.5 s.Collecting 93 more samples in 17.3 s.Collecting 92 more samples in 17.1 s.Collecting 91 more samples in 16.9 s.Collecting 90 more samples in 16.7 s.Collecting 89 more samples in 16.6 s.Collecting 88 more samples in 16.4 s.Collecting 87 more samples in 16.2 s.Collecting 86 more samples in 16.0 s.Collecting 85 more samples in 15.8 s.Collecting 84 more samples in 15.6 s.Collecting 83 more samples in 15.4 s.Collecting 82 more samples in 15.3 s.Collecting 81 more samples in 15.1 s.Collecting 80 more samples in 14.9 s.Collecting 79 more samples in 14.7 s.Collecting 78 more samples in 14.5 s.Collecting 77 more samples in 14.3 s.Collecting 76 more samples in 14.1 s.Collecting 75 more samples in 14.0 s.Collecting 74 more samples in 13.8 s.Collecting 73 more samples in 13.6 s.Collecting 72 more samples in 13.4 s.Collecting 71 more samples in 13.2 s.Collecting 70 more samples in 13.0 s.Collecting 69 more samples in 12.8 s.Collecting 68 more samples in 12.6 s.Collecting 67 more samples in 12.5 s.Collecting 66 more samples in 12.3 s.Collecting 65 more samples in 12.1 s.Collecting 64 more samples in 11.9 s.Collecting 63 more samples in 11.7 s.Collecting 62 more samples in 11.5 s.Collecting 61 more samples in 11.3 s.Collecting 60 more samples in 11.2 s.Collecting 59 more samples in 11.0 s.Collecting 58 more samples in 10.8 s.Collecting 57 more samples in 10.6 s.Collecting 56 more samples in 10.4 s.Collecting 55 more samples in 10.2 s.Collecting 54 more samples in 10.0 s.Collecting 53 more samples in 9.9 s.Collecting 52 more samples in 9.7 s.Collecting 51 more samples in 9.5 s.Collecting 50 more samples in 9.3 s.Collecting 49 more samples in 9.1 s.Collecting 48 more samples in 8.9 s.Collecting 47 more samples in 8.7 s.Collecting 46 more samples in 8.6 s.Collecting 45 more samples in 8.4 s.Collecting 44 more samples in 8.2 s.Collecting 43 more samples in 8.0 s.Collecting 42 more samples in 7.8 s.Collecting 41 more samples in 7.6 s.Collecting 40 more samples in 7.4 s.Collecting 39 more samples in 7.3 s.Collecting 38 more samples in 7.1 s.Collecting 37 more samples in 6.9 s.Collecting 36 more samples in 6.7 s.Collecting 35 more samples in 6.5 s.Collecting 34 more samples in 6.3 s.Collecting 33 more samples in 6.1 s.Collecting 32 more samples in 6.0 s.Collecting 31 more samples in 5.8 s.Collecting 30 more samples in 5.6 s.Collecting 29 more samples in 5.4 s.Collecting 28 more samples in 5.2 s.Collecting 27 more samples in 5.0 s.Collecting 26 more samples in 4.8 s.Collecting 25 more samples in 4.7 s.Collecting 24 more samples in 4.5 s.Collecting 23 more samples in 4.3 s.Collecting 22 more samples in 4.1 s.Collecting 21 more samples in 3.9 s.Collecting 20 more samples in 3.7 s.Collecting 19 more samples in 3.5 s.Collecting 18 more samples in 3.3 s.Collecting 17 more samples in 3.2 s.Collecting 16 more samples in 3.0 s.Collecting 15 more samples in 2.8 s.Collecting 14 more samples in 2.6 s.Collecting 13 more samples in 2.4 s.Collecting 12 more samples in 2.2 s.Collecting 11 more samples in 2.0 s.Collecting 10 more samples in 1.9 s.Collecting 9 more samples in 1.7 s.Collecting 8 more samples in 1.5 s.Collecting 7 more samples in 1.3 s.Collecting 6 more samples in 1.1 s.Collecting 5 more samples in 0.9 s.Collecting 4 more samples in 0.7 s.Collecting 3 more samples in 0.6 s.Collecting 2 more samples in 0.4 s.Collecting 1 more samples in 0.2 s.mean: 134.6010 ms, lower bound: 131.6284 ms, upper bound: 138.3756 ms, confidence: 0.950
std dev: 17.13310 ms, lower bound: 13.85012 ms, upper bound: 22.49005 ms, confidence: 0.950
found 6 outliers among 100 samples (6.0%)
  4 (4.0%) high mild
  2 (2.0%) high severe
variance introduced by outliers: 86.270%
variance is severely inflated by outliers
commits: 200000
retries: 6
allocated bytes: 229813472

Running a subject "14/14285/unordered-containers"
Collecting 99 more samples in 52.1 s.Collecting 98 more samples in 51.6 s.Collecting 97 more samples in 51.1 s.Collecting 96 more samples in 50.5 s.Collecting 95 more samples in 50.0 s.Collecting 94 more samples in 49.5 s.Collecting 93 more samples in 48.9 s.Collecting 92 more samples in 48.4 s.Collecting 91 more samples in 47.9 s.Collecting 90 more samples in 47.4 s.Collecting 89 more samples in 46.8 s.Collecting 88 more samples in 46.3 s.Collecting 87 more samples in 45.8 s.Collecting 86 more samples in 45.3 s.Collecting 85 more samples in 44.7 s.Collecting 84 more samples in 44.2 s.Collecting 83 more samples in 43.7 s.Collecting 82 more samples in 43.2 s.Collecting 81 more samples in 42.6 s.Collecting 80 more samples in 42.1 s.Collecting 79 more samples in 41.6 s.Collecting 78 more samples in 41.1 s.Collecting 77 more samples in 40.5 s.Collecting 76 more samples in 40.0 s.Collecting 75 more samples in 39.5 s.Collecting 74 more samples in 38.9 s.Collecting 73 more samples in 38.4 s.Collecting 72 more samples in 37.9 s.Collecting 71 more samples in 37.4 s.Collecting 70 more samples in 36.8 s.Collecting 69 more samples in 36.3 s.Collecting 68 more samples in 35.8 s.Collecting 67 more samples in 35.3 s.Collecting 66 more samples in 34.7 s.Collecting 65 more samples in 34.2 s.Collecting 64 more samples in 33.7 s.Collecting 63 more samples in 33.2 s.Collecting 62 more samples in 32.6 s.Collecting 61 more samples in 32.1 s.Collecting 60 more samples in 31.6 s.Collecting 59 more samples in 31.1 s.Collecting 58 more samples in 30.5 s.Collecting 57 more samples in 30.0 s.Collecting 56 more samples in 29.5 s.Collecting 55 more samples in 28.9 s.Collecting 54 more samples in 28.4 s.Collecting 53 more samples in 27.9 s.Collecting 52 more samples in 27.4 s.Collecting 51 more samples in 26.8 s.Collecting 50 more samples in 26.3 s.Collecting 49 more samples in 25.8 s.Collecting 48 more samples in 25.3 s.Collecting 47 more samples in 24.7 s.Collecting 46 more samples in 24.2 s.Collecting 45 more samples in 23.7 s.Collecting 44 more samples in 23.2 s.Collecting 43 more samples in 22.6 s.Collecting 42 more samples in 22.1 s.Collecting 41 more samples in 21.6 s.Collecting 40 more samples in 21.1 s.Collecting 39 more samples in 20.5 s.Collecting 38 more samples in 20.0 s.Collecting 37 more samples in 19.5 s.Collecting 36 more samples in 18.9 s.Collecting 35 more samples in 18.4 s.Collecting 34 more samples in 17.9 s.Collecting 33 more samples in 17.4 s.Collecting 32 more samples in 16.8 s.Collecting 31 more samples in 16.3 s.Collecting 30 more samples in 15.8 s.Collecting 29 more samples in 15.3 s.Collecting 28 more samples in 14.7 s.Collecting 27 more samples in 14.2 s.Collecting 26 more samples in 13.7 s.Collecting 25 more samples in 13.2 s.Collecting 24 more samples in 12.6 s.Collecting 23 more samples in 12.1 s.Collecting 22 more samples in 11.6 s.Collecting 21 more samples in 11.1 s.Collecting 20 more samples in 10.5 s.Collecting 19 more samples in 10.0 s.Collecting 18 more samples in 9.5 s.Collecting 17 more samples in 8.9 s.Collecting 16 more samples in 8.4 s.Collecting 15 more samples in 7.9 s.Collecting 14 more samples in 7.4 s.Collecting 13 more samples in 6.8 s.Collecting 12 more samples in 6.3 s.Collecting 11 more samples in 5.8 s.Collecting 10 more samples in 5.3 s.Collecting 9 more samples in 4.7 s.Collecting 8 more samples in 4.2 s.Collecting 7 more samples in 3.7 s.Collecting 6 more samples in 3.2 s.Collecting 5 more samples in 2.6 s.Collecting 4 more samples in 2.1 s.Collecting 3 more samples in 1.6 s.Collecting 2 more samples in 1.1 s.Collecting 1 more samples in 0.5 s.mean: 503.4637 ms, lower bound: 495.9116 ms, upper bound: 513.0729 ms, confidence: 0.950
std dev: 43.18514 ms, lower bound: 35.07451 ms, upper bound: 55.75531 ms, confidence: 0.950
found 7 outliers among 100 samples (7.0%)
  5 (5.0%) high mild
  2 (2.0%) high severe
variance introduced by outliers: 73.805%
variance is severely inflated by outliers
commits: 200000
retries: 794867
allocated bytes: 815672800

Running a subject "14/14285/stm-containers"
Collecting 99 more samples in 49.6 s.Collecting 98 more samples in 49.1 s.Collecting 97 more samples in 48.6 s.Collecting 96 more samples in 48.1 s.Collecting 95 more samples in 47.6 s.Collecting 94 more samples in 47.1 s.Collecting 93 more samples in 46.6 s.Collecting 92 more samples in 46.1 s.Collecting 91 more samples in 45.6 s.Collecting 90 more samples in 45.1 s.Collecting 89 more samples in 44.6 s.Collecting 88 more samples in 44.1 s.Collecting 87 more samples in 43.6 s.Collecting 86 more samples in 43.1 s.Collecting 85 more samples in 42.6 s.Collecting 84 more samples in 42.1 s.Collecting 83 more samples in 41.6 s.Collecting 82 more samples in 41.1 s.Collecting 81 more samples in 40.6 s.Collecting 80 more samples in 40.1 s.Collecting 79 more samples in 39.6 s.Collecting 78 more samples in 39.1 s.Collecting 77 more samples in 38.6 s.Collecting 76 more samples in 38.1 s.Collecting 75 more samples in 37.6 s.Collecting 74 more samples in 37.1 s.Collecting 73 more samples in 36.6 s.Collecting 72 more samples in 36.1 s.Collecting 71 more samples in 35.6 s.Collecting 70 more samples in 35.1 s.Collecting 69 more samples in 34.6 s.Collecting 68 more samples in 34.1 s.Collecting 67 more samples in 33.6 s.Collecting 66 more samples in 33.1 s.Collecting 65 more samples in 32.6 s.Collecting 64 more samples in 32.1 s.Collecting 63 more samples in 31.6 s.Collecting 62 more samples in 31.0 s.Collecting 61 more samples in 30.5 s.Collecting 60 more samples in 30.0 s.Collecting 59 more samples in 29.5 s.Collecting 58 more samples in 29.0 s.Collecting 57 more samples in 28.5 s.Collecting 56 more samples in 28.0 s.Collecting 55 more samples in 27.5 s.Collecting 54 more samples in 27.0 s.Collecting 53 more samples in 26.5 s.Collecting 52 more samples in 26.0 s.Collecting 51 more samples in 25.5 s.Collecting 50 more samples in 25.0 s.Collecting 49 more samples in 24.5 s.Collecting 48 more samples in 24.0 s.Collecting 47 more samples in 23.5 s.Collecting 46 more samples in 23.0 s.Collecting 45 more samples in 22.5 s.Collecting 44 more samples in 22.0 s.Collecting 43 more samples in 21.5 s.Collecting 42 more samples in 21.0 s.Collecting 41 more samples in 20.5 s.Collecting 40 more samples in 20.0 s.Collecting 39 more samples in 19.5 s.Collecting 38 more samples in 19.0 s.Collecting 37 more samples in 18.5 s.Collecting 36 more samples in 18.0 s.Collecting 35 more samples in 17.5 s.Collecting 34 more samples in 17.0 s.Collecting 33 more samples in 16.5 s.Collecting 32 more samples in 16.0 s.Collecting 31 more samples in 15.5 s.Collecting 30 more samples in 15.0 s.Collecting 29 more samples in 14.5 s.Collecting 28 more samples in 14.0 s.Collecting 27 more samples in 13.5 s.Collecting 26 more samples in 13.0 s.Collecting 25 more samples in 12.5 s.Collecting 24 more samples in 12.0 s.Collecting 23 more samples in 11.5 s.Collecting 22 more samples in 11.0 s.Collecting 21 more samples in 10.5 s.Collecting 20 more samples in 10.0 s.Collecting 19 more samples in 9.5 s.Collecting 18 more samples in 9.0 s.Collecting 17 more samples in 8.5 s.Collecting 16 more samples in 8.0 s.Collecting 15 more samples in 7.5 s.Collecting 14 more samples in 7.0 s.Collecting 13 more samples in 6.5 s.Collecting 12 more samples in 6.0 s.Collecting 11 more samples in 5.5 s.Collecting 10 more samples in 5.0 s.Collecting 9 more samples in 4.5 s.Collecting 8 more samples in 4.0 s.Collecting 7 more samples in 3.5 s.Collecting 6 more samples in 3.0 s.Collecting 5 more samples in 2.5 s.Collecting 4 more samples in 2.0 s.Collecting 3 more samples in 1.5 s.Collecting 2 more samples in 1.0 s.Collecting 1 more samples in 0.5 s.mean: 487.0100 ms, lower bound: 474.5450 ms, upper bound: 501.0798 ms, confidence: 0.950
std dev: 67.58031 ms, lower bound: 57.64869 ms, upper bound: 88.44514 ms, confidence: 0.950
found 1 outliers among 100 samples (1.0%)
variance introduced by outliers: 88.357%
variance is severely inflated by outliers
commits: 200000
retries: 1857
allocated bytes: 836119816

Running a subject "14/14285/ttrie"
Collecting 100 more samples in 10.9 s.Collecting 99 more samples in 10.8 s.Collecting 98 more samples in 10.7 s.Collecting 97 more samples in 10.6 s.Collecting 96 more samples in 10.5 s.Collecting 95 more samples in 10.4 s.Collecting 94 more samples in 10.3 s.Collecting 93 more samples in 10.2 s.Collecting 92 more samples in 10.1 s.Collecting 91 more samples in 10.0 s.Collecting 90 more samples in 9.9 s.Collecting 89 more samples in 9.7 s.Collecting 88 more samples in 9.6 s.Collecting 87 more samples in 9.5 s.Collecting 86 more samples in 9.4 s.Collecting 85 more samples in 9.3 s.Collecting 84 more samples in 9.2 s.Collecting 83 more samples in 9.1 s.Collecting 82 more samples in 9.0 s.Collecting 81 more samples in 8.9 s.Collecting 80 more samples in 8.8 s.Collecting 79 more samples in 8.6 s.Collecting 78 more samples in 8.5 s.Collecting 77 more samples in 8.4 s.Collecting 76 more samples in 8.3 s.Collecting 75 more samples in 8.2 s.Collecting 74 more samples in 8.1 s.Collecting 73 more samples in 8.0 s.Collecting 72 more samples in 7.9 s.Collecting 71 more samples in 7.8 s.Collecting 70 more samples in 7.7 s.Collecting 69 more samples in 7.6 s.Collecting 68 more samples in 7.4 s.Collecting 67 more samples in 7.3 s.Collecting 66 more samples in 7.2 s.Collecting 65 more samples in 7.1 s.Collecting 64 more samples in 7.0 s.Collecting 63 more samples in 6.9 s.Collecting 62 more samples in 6.8 s.Collecting 61 more samples in 6.7 s.Collecting 60 more samples in 6.6 s.Collecting 59 more samples in 6.5 s.Collecting 58 more samples in 6.3 s.Collecting 57 more samples in 6.2 s.Collecting 56 more samples in 6.1 s.Collecting 55 more samples in 6.0 s.Collecting 54 more samples in 5.9 s.Collecting 53 more samples in 5.8 s.Collecting 52 more samples in 5.7 s.Collecting 51 more samples in 5.6 s.Collecting 50 more samples in 5.5 s.Collecting 49 more samples in 5.4 s.Collecting 48 more samples in 5.3 s.Collecting 47 more samples in 5.1 s.Collecting 46 more samples in 5.0 s.Collecting 45 more samples in 4.9 s.Collecting 44 more samples in 4.8 s.Collecting 43 more samples in 4.7 s.Collecting 42 more samples in 4.6 s.Collecting 41 more samples in 4.5 s.Collecting 40 more samples in 4.4 s.Collecting 39 more samples in 4.3 s.Collecting 38 more samples in 4.2 s.Collecting 37 more samples in 4.0 s.Collecting 36 more samples in 3.9 s.Collecting 35 more samples in 3.8 s.Collecting 34 more samples in 3.7 s.Collecting 33 more samples in 3.6 s.Collecting 32 more samples in 3.5 s.Collecting 31 more samples in 3.4 s.Collecting 30 more samples in 3.3 s.Collecting 29 more samples in 3.2 s.Collecting 28 more samples in 3.1 s.Collecting 27 more samples in 3.0 s.Collecting 26 more samples in 2.8 s.Collecting 25 more samples in 2.7 s.Collecting 24 more samples in 2.6 s.Collecting 23 more samples in 2.5 s.Collecting 22 more samples in 2.4 s.Collecting 21 more samples in 2.3 s.Collecting 20 more samples in 2.2 s.Collecting 19 more samples in 2.1 s.Collecting 18 more samples in 2.0 s.Collecting 17 more samples in 1.9 s.Collecting 16 more samples in 1.8 s.Collecting 15 more samples in 1.6 s.Collecting 14 more samples in 1.5 s.Collecting 13 more samples in 1.4 s.Collecting 12 more samples in 1.3 s.Collecting 11 more samples in 1.2 s.Collecting 10 more samples in 1.1 s.Collecting 9 more samples in 1.0 s.Collecting 8 more samples in 0.9 s.Collecting 7 more samples in 0.8 s.Collecting 6 more samples in 0.7 s.Collecting 5 more samples in 0.5 s.Collecting 4 more samples in 0.4 s.Collecting 3 more samples in 0.3 s.Collecting 2 more samples in 0.2 s.Collecting 1 more samples in 0.1 s.mean: 126.3690 ms, lower bound: 122.6783 ms, upper bound: 130.8996 ms, confidence: 0.950
std dev: 20.85027 ms, lower bound: 17.49883 ms, upper bound: 25.47321 ms, confidence: 0.950
found 5 outliers among 100 samples (5.0%)
  5 (5.0%) high mild
variance introduced by outliers: 91.514%
variance is severely inflated by outliers
commits: 200000
retries: 6
allocated bytes: 229829176

Running a subject "16/12500/unordered-containers"
Collecting 99 more samples in 46.5 s.Collecting 98 more samples in 46.0 s.Collecting 97 more samples in 45.6 s.Collecting 96 more samples in 45.1 s.Collecting 95 more samples in 44.6 s.Collecting 94 more samples in 44.2 s.Collecting 93 more samples in 43.7 s.Collecting 92 more samples in 43.2 s.Collecting 91 more samples in 42.8 s.Collecting 90 more samples in 42.3 s.Collecting 89 more samples in 41.8 s.Collecting 88 more samples in 41.3 s.Collecting 87 more samples in 40.9 s.Collecting 86 more samples in 40.4 s.Collecting 85 more samples in 39.9 s.Collecting 84 more samples in 39.5 s.Collecting 83 more samples in 39.0 s.Collecting 82 more samples in 38.5 s.Collecting 81 more samples in 38.1 s.Collecting 80 more samples in 37.6 s.Collecting 79 more samples in 37.1 s.Collecting 78 more samples in 36.6 s.Collecting 77 more samples in 36.2 s.Collecting 76 more samples in 35.7 s.Collecting 75 more samples in 35.2 s.Collecting 74 more samples in 34.8 s.Collecting 73 more samples in 34.3 s.Collecting 72 more samples in 33.8 s.Collecting 71 more samples in 33.4 s.Collecting 70 more samples in 32.9 s.Collecting 69 more samples in 32.4 s.Collecting 68 more samples in 31.9 s.Collecting 67 more samples in 31.5 s.Collecting 66 more samples in 31.0 s.Collecting 65 more samples in 30.5 s.Collecting 64 more samples in 30.1 s.Collecting 63 more samples in 29.6 s.Collecting 62 more samples in 29.1 s.Collecting 61 more samples in 28.7 s.Collecting 60 more samples in 28.2 s.Collecting 59 more samples in 27.7 s.Collecting 58 more samples in 27.2 s.Collecting 57 more samples in 26.8 s.Collecting 56 more samples in 26.3 s.Collecting 55 more samples in 25.8 s.Collecting 54 more samples in 25.4 s.Collecting 53 more samples in 24.9 s.Collecting 52 more samples in 24.4 s.Collecting 51 more samples in 24.0 s.Collecting 50 more samples in 23.5 s.Collecting 49 more samples in 23.0 s.Collecting 48 more samples in 22.5 s.Collecting 47 more samples in 22.1 s.Collecting 46 more samples in 21.6 s.Collecting 45 more samples in 21.1 s.Collecting 44 more samples in 20.7 s.Collecting 43 more samples in 20.2 s.Collecting 42 more samples in 19.7 s.Collecting 41 more samples in 19.3 s.Collecting 40 more samples in 18.8 s.Collecting 39 more samples in 18.3 s.Collecting 38 more samples in 17.9 s.Collecting 37 more samples in 17.4 s.Collecting 36 more samples in 16.9 s.Collecting 35 more samples in 16.4 s.Collecting 34 more samples in 16.0 s.Collecting 33 more samples in 15.5 s.Collecting 32 more samples in 15.0 s.Collecting 31 more samples in 14.6 s.Collecting 30 more samples in 14.1 s.Collecting 29 more samples in 13.6 s.Collecting 28 more samples in 13.2 s.Collecting 27 more samples in 12.7 s.Collecting 26 more samples in 12.2 s.Collecting 25 more samples in 11.7 s.Collecting 24 more samples in 11.3 s.Collecting 23 more samples in 10.8 s.Collecting 22 more samples in 10.3 s.Collecting 21 more samples in 9.9 s.Collecting 20 more samples in 9.4 s.Collecting 19 more samples in 8.9 s.Collecting 18 more samples in 8.5 s.Collecting 17 more samples in 8.0 s.Collecting 16 more samples in 7.5 s.Collecting 15 more samples in 7.0 s.Collecting 14 more samples in 6.6 s.Collecting 13 more samples in 6.1 s.Collecting 12 more samples in 5.6 s.Collecting 11 more samples in 5.2 s.Collecting 10 more samples in 4.7 s.Collecting 9 more samples in 4.2 s.Collecting 8 more samples in 3.8 s.Collecting 7 more samples in 3.3 s.Collecting 6 more samples in 2.8 s.Collecting 5 more samples in 2.3 s.Collecting 4 more samples in 1.9 s.Collecting 3 more samples in 1.4 s.Collecting 2 more samples in 0.9 s.Collecting 1 more samples in 0.5 s.mean: 568.8847 ms, lower bound: 556.7779 ms, upper bound: 582.8609 ms, confidence: 0.950
std dev: 66.40197 ms, lower bound: 57.13713 ms, upper bound: 81.29645 ms, confidence: 0.950
found 1 outliers among 100 samples (1.0%)
variance introduced by outliers: 84.171%
variance is severely inflated by outliers
commits: 200000
retries: 961508
allocated bytes: 805480784

Running a subject "16/12500/stm-containers"
Collecting 99 more samples in 44.8 s.Collecting 98 more samples in 44.4 s.Collecting 97 more samples in 43.9 s.Collecting 96 more samples in 43.4 s.Collecting 95 more samples in 43.0 s.Collecting 94 more samples in 42.5 s.Collecting 93 more samples in 42.1 s.Collecting 92 more samples in 41.6 s.Collecting 91 more samples in 41.2 s.Collecting 90 more samples in 40.7 s.Collecting 89 more samples in 40.3 s.Collecting 88 more samples in 39.8 s.Collecting 87 more samples in 39.4 s.Collecting 86 more samples in 38.9 s.Collecting 85 more samples in 38.5 s.Collecting 84 more samples in 38.0 s.Collecting 83 more samples in 37.6 s.Collecting 82 more samples in 37.1 s.Collecting 81 more samples in 36.7 s.Collecting 80 more samples in 36.2 s.Collecting 79 more samples in 35.8 s.Collecting 78 more samples in 35.3 s.Collecting 77 more samples in 34.8 s.Collecting 76 more samples in 34.4 s.Collecting 75 more samples in 33.9 s.Collecting 74 more samples in 33.5 s.Collecting 73 more samples in 33.0 s.Collecting 72 more samples in 32.6 s.Collecting 71 more samples in 32.1 s.Collecting 70 more samples in 31.7 s.Collecting 69 more samples in 31.2 s.Collecting 68 more samples in 30.8 s.Collecting 67 more samples in 30.3 s.Collecting 66 more samples in 29.9 s.Collecting 65 more samples in 29.4 s.Collecting 64 more samples in 29.0 s.Collecting 63 more samples in 28.5 s.Collecting 62 more samples in 28.1 s.Collecting 61 more samples in 27.6 s.Collecting 60 more samples in 27.2 s.Collecting 59 more samples in 26.7 s.Collecting 58 more samples in 26.2 s.Collecting 57 more samples in 25.8 s.Collecting 56 more samples in 25.3 s.Collecting 55 more samples in 24.9 s.Collecting 54 more samples in 24.4 s.Collecting 53 more samples in 24.0 s.Collecting 52 more samples in 23.5 s.Collecting 51 more samples in 23.1 s.Collecting 50 more samples in 22.6 s.Collecting 49 more samples in 22.2 s.Collecting 48 more samples in 21.7 s.Collecting 47 more samples in 21.3 s.Collecting 46 more samples in 20.8 s.Collecting 45 more samples in 20.4 s.Collecting 44 more samples in 19.9 s.Collecting 43 more samples in 19.5 s.Collecting 42 more samples in 19.0 s.Collecting 41 more samples in 18.6 s.Collecting 40 more samples in 18.1 s.Collecting 39 more samples in 17.7 s.Collecting 38 more samples in 17.2 s.Collecting 37 more samples in 16.7 s.Collecting 36 more samples in 16.3 s.Collecting 35 more samples in 15.8 s.Collecting 34 more samples in 15.4 s.Collecting 33 more samples in 14.9 s.Collecting 32 more samples in 14.5 s.Collecting 31 more samples in 14.0 s.Collecting 30 more samples in 13.6 s.Collecting 29 more samples in 13.1 s.Collecting 28 more samples in 12.7 s.Collecting 27 more samples in 12.2 s.Collecting 26 more samples in 11.8 s.Collecting 25 more samples in 11.3 s.Collecting 24 more samples in 10.9 s.Collecting 23 more samples in 10.4 s.Collecting 22 more samples in 10.0 s.Collecting 21 more samples in 9.5 s.Collecting 20 more samples in 9.1 s.Collecting 19 more samples in 8.6 s.Collecting 18 more samples in 8.1 s.Collecting 17 more samples in 7.7 s.Collecting 16 more samples in 7.2 s.Collecting 15 more samples in 6.8 s.Collecting 14 more samples in 6.3 s.Collecting 13 more samples in 5.9 s.Collecting 12 more samples in 5.4 s.Collecting 11 more samples in 5.0 s.Collecting 10 more samples in 4.5 s.Collecting 9 more samples in 4.1 s.Collecting 8 more samples in 3.6 s.Collecting 7 more samples in 3.2 s.Collecting 6 more samples in 2.7 s.Collecting 5 more samples in 2.3 s.Collecting 4 more samples in 1.8 s.Collecting 3 more samples in 1.4 s.Collecting 2 more samples in 0.9 s.Collecting 1 more samples in 0.5 s.mean: 500.5200 ms, lower bound: 490.0436 ms, upper bound: 510.8871 ms, confidence: 0.950
std dev: 53.23219 ms, lower bound: 46.66747 ms, upper bound: 61.00003 ms, confidence: 0.950
found 1 outliers among 100 samples (1.0%)
variance introduced by outliers: 81.071%
variance is severely inflated by outliers
commits: 200000
retries: 2130
allocated bytes: 836144128

Running a subject "16/12500/ttrie"
Collecting 100 more samples in 13.2 s.Collecting 99 more samples in 13.1 s.Collecting 98 more samples in 12.9 s.Collecting 97 more samples in 12.8 s.Collecting 96 more samples in 12.7 s.Collecting 95 more samples in 12.6 s.Collecting 94 more samples in 12.4 s.Collecting 93 more samples in 12.3 s.Collecting 92 more samples in 12.2 s.Collecting 91 more samples in 12.0 s.Collecting 90 more samples in 11.9 s.Collecting 89 more samples in 11.8 s.Collecting 88 more samples in 11.6 s.Collecting 87 more samples in 11.5 s.Collecting 86 more samples in 11.4 s.Collecting 85 more samples in 11.2 s.Collecting 84 more samples in 11.1 s.Collecting 83 more samples in 11.0 s.Collecting 82 more samples in 10.8 s.Collecting 81 more samples in 10.7 s.Collecting 80 more samples in 10.6 s.Collecting 79 more samples in 10.4 s.Collecting 78 more samples in 10.3 s.Collecting 77 more samples in 10.2 s.Collecting 76 more samples in 10.0 s.Collecting 75 more samples in 9.9 s.Collecting 74 more samples in 9.8 s.Collecting 73 more samples in 9.6 s.Collecting 72 more samples in 9.5 s.Collecting 71 more samples in 9.4 s.Collecting 70 more samples in 9.2 s.Collecting 69 more samples in 9.1 s.Collecting 68 more samples in 9.0 s.Collecting 67 more samples in 8.9 s.Collecting 66 more samples in 8.7 s.Collecting 65 more samples in 8.6 s.Collecting 64 more samples in 8.5 s.Collecting 63 more samples in 8.3 s.Collecting 62 more samples in 8.2 s.Collecting 61 more samples in 8.1 s.Collecting 60 more samples in 7.9 s.Collecting 59 more samples in 7.8 s.Collecting 58 more samples in 7.7 s.Collecting 57 more samples in 7.5 s.Collecting 56 more samples in 7.4 s.Collecting 55 more samples in 7.3 s.Collecting 54 more samples in 7.1 s.Collecting 53 more samples in 7.0 s.Collecting 52 more samples in 6.9 s.Collecting 51 more samples in 6.7 s.Collecting 50 more samples in 6.6 s.Collecting 49 more samples in 6.5 s.Collecting 48 more samples in 6.3 s.Collecting 47 more samples in 6.2 s.Collecting 46 more samples in 6.1 s.Collecting 45 more samples in 5.9 s.Collecting 44 more samples in 5.8 s.Collecting 43 more samples in 5.7 s.Collecting 42 more samples in 5.5 s.Collecting 41 more samples in 5.4 s.Collecting 40 more samples in 5.3 s.Collecting 39 more samples in 5.2 s.Collecting 38 more samples in 5.0 s.Collecting 37 more samples in 4.9 s.Collecting 36 more samples in 4.8 s.Collecting 35 more samples in 4.6 s.Collecting 34 more samples in 4.5 s.Collecting 33 more samples in 4.4 s.Collecting 32 more samples in 4.2 s.Collecting 31 more samples in 4.1 s.Collecting 30 more samples in 4.0 s.Collecting 29 more samples in 3.8 s.Collecting 28 more samples in 3.7 s.Collecting 27 more samples in 3.6 s.Collecting 26 more samples in 3.4 s.Collecting 25 more samples in 3.3 s.Collecting 24 more samples in 3.2 s.Collecting 23 more samples in 3.0 s.Collecting 22 more samples in 2.9 s.Collecting 21 more samples in 2.8 s.Collecting 20 more samples in 2.6 s.Collecting 19 more samples in 2.5 s.Collecting 18 more samples in 2.4 s.Collecting 17 more samples in 2.2 s.Collecting 16 more samples in 2.1 s.Collecting 15 more samples in 2.0 s.Collecting 14 more samples in 1.8 s.Collecting 13 more samples in 1.7 s.Collecting 12 more samples in 1.6 s.Collecting 11 more samples in 1.5 s.Collecting 10 more samples in 1.3 s.Collecting 9 more samples in 1.2 s.Collecting 8 more samples in 1.1 s.Collecting 7 more samples in 0.9 s.Collecting 6 more samples in 0.8 s.Collecting 5 more samples in 0.7 s.Collecting 4 more samples in 0.5 s.Collecting 3 more samples in 0.4 s.Collecting 2 more samples in 0.3 s.Collecting 1 more samples in 0.1 s.mean: 122.0229 ms, lower bound: 118.2624 ms, upper bound: 127.9879 ms, confidence: 0.950
std dev: 23.77847 ms, lower bound: 17.19361 ms, upper bound: 40.30643 ms, confidence: 0.950
found 5 outliers among 100 samples (5.0%)
  4 (4.0%) high mild
  1 (1.0%) high severe
variance introduced by outliers: 93.636%
variance is severely inflated by outliers
commits: 200000
retries: 9
allocated bytes: 229817432
Benchmark bench: FINISH