Preprocessing library ttrie-0.1.2...
In-place registering ttrie-0.1.2...
Preprocessing benchmark 'bench' for ttrie-0.1.2...
Running 1 benchmarks...
Benchmark bench: RUNNING...
threads = [1,2,4,6,8,10,12,14,16]
numTransactions = 200000
sizes = [(1,1),(2,1),(3,1),(4,1),(5,1)]
numPrefill = 1000000
ops = (10,10,10,70)
Generating 1000000 random keys to prefill...
Generating 200000 random transactions...
warming up
estimating clock resolution...
mean is 1.695090 us (320001 iterations)
found 561628 outliers among 319999 samples (175.5%)
  246671 (77.1%) low severe
  314957 (98.4%) high severe
estimating cost of a clock call...
mean is 195.1321 ns (11 iterations)

Running a subject "1/200000/unordered-containers"
Collecting 99 more samples in 237.1 s.Collecting 98 more samples in 234.7 s.Collecting 97 more samples in 232.3 s.Collecting 96 more samples in 229.9 s.Collecting 95 more samples in 227.5 s.Collecting 94 more samples in 225.1 s.Collecting 93 more samples in 222.7 s.Collecting 92 more samples in 220.3 s.Collecting 91 more samples in 217.9 s.Collecting 90 more samples in 215.5 s.Collecting 89 more samples in 213.1 s.Collecting 88 more samples in 210.7 s.Collecting 87 more samples in 208.3 s.Collecting 86 more samples in 206.0 s.Collecting 85 more samples in 203.6 s.Collecting 84 more samples in 201.2 s.Collecting 83 more samples in 198.8 s.Collecting 82 more samples in 196.4 s.Collecting 81 more samples in 194.0 s.Collecting 80 more samples in 191.6 s.Collecting 79 more samples in 189.2 s.Collecting 78 more samples in 186.8 s.Collecting 77 more samples in 184.4 s.Collecting 76 more samples in 182.0 s.Collecting 75 more samples in 179.6 s.Collecting 74 more samples in 177.2 s.Collecting 73 more samples in 174.8 s.Collecting 72 more samples in 172.4 s.Collecting 71 more samples in 170.0 s.Collecting 70 more samples in 167.6 s.Collecting 69 more samples in 165.2 s.Collecting 68 more samples in 162.8 s.Collecting 67 more samples in 160.5 s.Collecting 66 more samples in 158.1 s.Collecting 65 more samples in 155.7 s.Collecting 64 more samples in 153.3 s.Collecting 63 more samples in 150.9 s.Collecting 62 more samples in 148.5 s.Collecting 61 more samples in 146.1 s.Collecting 60 more samples in 143.7 s.Collecting 59 more samples in 141.3 s.Collecting 58 more samples in 138.9 s.Collecting 57 more samples in 136.5 s.Collecting 56 more samples in 134.1 s.Collecting 55 more samples in 131.7 s.Collecting 54 more samples in 129.3 s.Collecting 53 more samples in 126.9 s.Collecting 52 more samples in 124.5 s.Collecting 51 more samples in 122.1 s.Collecting 50 more samples in 119.7 s.Collecting 49 more samples in 117.3 s.Collecting 48 more samples in 115.0 s.Collecting 47 more samples in 112.6 s.Collecting 46 more samples in 110.2 s.Collecting 45 more samples in 107.8 s.Collecting 44 more samples in 105.4 s.Collecting 43 more samples in 103.0 s.Collecting 42 more samples in 100.6 s.Collecting 41 more samples in 98.2 s.Collecting 40 more samples in 95.8 s.Collecting 39 more samples in 93.4 s.Collecting 38 more samples in 91.0 s.Collecting 37 more samples in 88.6 s.Collecting 36 more samples in 86.2 s.Collecting 35 more samples in 83.8 s.Collecting 34 more samples in 81.4 s.Collecting 33 more samples in 79.0 s.Collecting 32 more samples in 76.6 s.Collecting 31 more samples in 74.2 s.Collecting 30 more samples in 71.8 s.Collecting 29 more samples in 69.4 s.Collecting 28 more samples in 67.1 s.Collecting 27 more samples in 64.7 s.Collecting 26 more samples in 62.3 s.Collecting 25 more samples in 59.9 s.Collecting 24 more samples in 57.5 s.Collecting 23 more samples in 55.1 s.Collecting 22 more samples in 52.7 s.Collecting 21 more samples in 50.3 s.Collecting 20 more samples in 47.9 s.Collecting 19 more samples in 45.5 s.Collecting 18 more samples in 43.1 s.Collecting 17 more samples in 40.7 s.Collecting 16 more samples in 38.3 s.Collecting 15 more samples in 35.9 s.Collecting 14 more samples in 33.5 s.Collecting 13 more samples in 31.1 s.Collecting 12 more samples in 28.7 s.Collecting 11 more samples in 26.3 s.Collecting 10 more samples in 23.9 s.Collecting 9 more samples in 21.6 s.Collecting 8 more samples in 19.2 s.Collecting 7 more samples in 16.8 s.Collecting 6 more samples in 14.4 s.Collecting 5 more samples in 12.0 s.Collecting 4 more samples in 9.6 s.Collecting 3 more samples in 7.2 s.Collecting 2 more samples in 4.8 s.Collecting 1 more samples in 2.4 s.mean: 2.346207 s, lower bound: 2.268640 s, upper bound: 2.456920 s, confidence: 0.950
std dev: 469.4464 ms, lower bound: 355.9426 ms, upper bound: 646.5309 ms, confidence: 0.950
found 9 outliers among 100 samples (9.0%)
  5 (5.0%) high mild
  4 (4.0%) high severe
variance introduced by outliers: 94.648%
variance is severely inflated by outliers
commits: 200000
retries: 0
allocated bytes: 416564000

Running a subject "1/200000/stm-containers"
Collecting 99 more samples in 364.8 s.Collecting 98 more samples in 361.1 s.Collecting 97 more samples in 357.4 s.Collecting 96 more samples in 353.7 s.Collecting 95 more samples in 350.0 s.Collecting 94 more samples in 346.3 s.Collecting 93 more samples in 342.7 s.Collecting 92 more samples in 339.0 s.Collecting 91 more samples in 335.3 s.Collecting 90 more samples in 331.6 s.Collecting 89 more samples in 327.9 s.Collecting 88 more samples in 324.2 s.Collecting 87 more samples in 320.6 s.Collecting 86 more samples in 316.9 s.Collecting 85 more samples in 313.2 s.Collecting 84 more samples in 309.5 s.Collecting 83 more samples in 305.8 s.Collecting 82 more samples in 302.1 s.Collecting 81 more samples in 298.4 s.Collecting 80 more samples in 294.8 s.Collecting 79 more samples in 291.1 s.Collecting 78 more samples in 287.4 s.Collecting 77 more samples in 283.7 s.Collecting 76 more samples in 280.0 s.Collecting 75 more samples in 276.3 s.Collecting 74 more samples in 272.7 s.Collecting 73 more samples in 269.0 s.Collecting 72 more samples in 265.3 s.Collecting 71 more samples in 261.6 s.Collecting 70 more samples in 257.9 s.Collecting 69 more samples in 254.2 s.Collecting 68 more samples in 250.6 s.Collecting 67 more samples in 246.9 s.Collecting 66 more samples in 243.2 s.Collecting 65 more samples in 239.5 s.Collecting 64 more samples in 235.8 s.Collecting 63 more samples in 232.1 s.Collecting 62 more samples in 228.4 s.Collecting 61 more samples in 224.8 s.Collecting 60 more samples in 221.1 s.Collecting 59 more samples in 217.4 s.Collecting 58 more samples in 213.7 s.Collecting 57 more samples in 210.0 s.Collecting 56 more samples in 206.3 s.Collecting 55 more samples in 202.7 s.Collecting 54 more samples in 199.0 s.Collecting 53 more samples in 195.3 s.Collecting 52 more samples in 191.6 s.Collecting 51 more samples in 187.9 s.Collecting 50 more samples in 184.2 s.Collecting 49 more samples in 180.5 s.Collecting 48 more samples in 176.9 s.Collecting 47 more samples in 173.2 s.Collecting 46 more samples in 169.5 s.Collecting 45 more samples in 165.8 s.Collecting 44 more samples in 162.1 s.Collecting 43 more samples in 158.4 s.Collecting 42 more samples in 154.8 s.Collecting 41 more samples in 151.1 s.Collecting 40 more samples in 147.4 s.Collecting 39 more samples in 143.7 s.Collecting 38 more samples in 140.0 s.Collecting 37 more samples in 136.3 s.Collecting 36 more samples in 132.6 s.Collecting 35 more samples in 129.0 s.Collecting 34 more samples in 125.3 s.Collecting 33 more samples in 121.6 s.Collecting 32 more samples in 117.9 s.Collecting 31 more samples in 114.2 s.Collecting 30 more samples in 110.5 s.Collecting 29 more samples in 106.9 s.Collecting 28 more samples in 103.2 s.Collecting 27 more samples in 99.5 s.Collecting 26 more samples in 95.8 s.Collecting 25 more samples in 92.1 s.Collecting 24 more samples in 88.4 s.Collecting 23 more samples in 84.7 s.Collecting 22 more samples in 81.1 s.Collecting 21 more samples in 77.4 s.Collecting 20 more samples in 73.7 s.Collecting 19 more samples in 70.0 s.Collecting 18 more samples in 66.3 s.Collecting 17 more samples in 62.6 s.Collecting 16 more samples in 59.0 s.Collecting 15 more samples in 55.3 s.Collecting 14 more samples in 51.6 s.Collecting 13 more samples in 47.9 s.Collecting 12 more samples in 44.2 s.Collecting 11 more samples in 40.5 s.Collecting 10 more samples in 36.8 s.Collecting 9 more samples in 33.2 s.Collecting 8 more samples in 29.5 s.Collecting 7 more samples in 25.8 s.Collecting 6 more samples in 22.1 s.Collecting 5 more samples in 18.4 s.Collecting 4 more samples in 14.7 s.Collecting 3 more samples in 11.1 s.Collecting 2 more samples in 7.4 s.Collecting 1 more samples in 3.7 s.mean: 2.916114 s, lower bound: 2.856993 s, upper bound: 2.975079 s, confidence: 0.950
std dev: 302.4508 ms, lower bound: 263.7769 ms, upper bound: 353.9382 ms, confidence: 0.950
variance introduced by outliers: 80.047%
variance is severely inflated by outliers
commits: 200000
retries: 0
allocated bytes: 910843400

Running a subject "1/200000/ttrie"
Collecting 99 more samples in 127.4 s.Collecting 98 more samples in 126.1 s.Collecting 97 more samples in 124.8 s.Collecting 96 more samples in 123.5 s.Collecting 95 more samples in 122.2 s.Collecting 94 more samples in 120.9 s.Collecting 93 more samples in 119.6 s.Collecting 92 more samples in 118.4 s.Collecting 91 more samples in 117.1 s.Collecting 90 more samples in 115.8 s.Collecting 89 more samples in 114.5 s.Collecting 88 more samples in 113.2 s.Collecting 87 more samples in 111.9 s.Collecting 86 more samples in 110.6 s.Collecting 85 more samples in 109.3 s.Collecting 84 more samples in 108.1 s.Collecting 83 more samples in 106.8 s.Collecting 82 more samples in 105.5 s.Collecting 81 more samples in 104.2 s.Collecting 80 more samples in 102.9 s.Collecting 79 more samples in 101.6 s.Collecting 78 more samples in 100.3 s.Collecting 77 more samples in 99.1 s.Collecting 76 more samples in 97.8 s.Collecting 75 more samples in 96.5 s.Collecting 74 more samples in 95.2 s.Collecting 73 more samples in 93.9 s.Collecting 72 more samples in 92.6 s.Collecting 71 more samples in 91.3 s.Collecting 70 more samples in 90.0 s.Collecting 69 more samples in 88.8 s.Collecting 68 more samples in 87.5 s.Collecting 67 more samples in 86.2 s.Collecting 66 more samples in 84.9 s.Collecting 65 more samples in 83.6 s.Collecting 64 more samples in 82.3 s.Collecting 63 more samples in 81.0 s.Collecting 62 more samples in 79.8 s.Collecting 61 more samples in 78.5 s.Collecting 60 more samples in 77.2 s.Collecting 59 more samples in 75.9 s.Collecting 58 more samples in 74.6 s.Collecting 57 more samples in 73.3 s.Collecting 56 more samples in 72.0 s.Collecting 55 more samples in 70.8 s.Collecting 54 more samples in 69.5 s.Collecting 53 more samples in 68.2 s.Collecting 52 more samples in 66.9 s.Collecting 51 more samples in 65.6 s.Collecting 50 more samples in 64.3 s.Collecting 49 more samples in 63.0 s.Collecting 48 more samples in 61.7 s.Collecting 47 more samples in 60.5 s.Collecting 46 more samples in 59.2 s.Collecting 45 more samples in 57.9 s.Collecting 44 more samples in 56.6 s.Collecting 43 more samples in 55.3 s.Collecting 42 more samples in 54.0 s.Collecting 41 more samples in 52.7 s.Collecting 40 more samples in 51.5 s.Collecting 39 more samples in 50.2 s.Collecting 38 more samples in 48.9 s.Collecting 37 more samples in 47.6 s.Collecting 36 more samples in 46.3 s.Collecting 35 more samples in 45.0 s.Collecting 34 more samples in 43.7 s.Collecting 33 more samples in 42.5 s.Collecting 32 more samples in 41.2 s.Collecting 31 more samples in 39.9 s.Collecting 30 more samples in 38.6 s.Collecting 29 more samples in 37.3 s.Collecting 28 more samples in 36.0 s.Collecting 27 more samples in 34.7 s.Collecting 26 more samples in 33.4 s.Collecting 25 more samples in 32.2 s.Collecting 24 more samples in 30.9 s.Collecting 23 more samples in 29.6 s.Collecting 22 more samples in 28.3 s.Collecting 21 more samples in 27.0 s.Collecting 20 more samples in 25.7 s.Collecting 19 more samples in 24.4 s.Collecting 18 more samples in 23.2 s.Collecting 17 more samples in 21.9 s.Collecting 16 more samples in 20.6 s.Collecting 15 more samples in 19.3 s.Collecting 14 more samples in 18.0 s.Collecting 13 more samples in 16.7 s.Collecting 12 more samples in 15.4 s.Collecting 11 more samples in 14.2 s.Collecting 10 more samples in 12.9 s.Collecting 9 more samples in 11.6 s.Collecting 8 more samples in 10.3 s.Collecting 7 more samples in 9.0 s.Collecting 6 more samples in 7.7 s.Collecting 5 more samples in 6.4 s.Collecting 4 more samples in 5.1 s.Collecting 3 more samples in 3.9 s.Collecting 2 more samples in 2.6 s.Collecting 1 more samples in 1.3 s.mean: 1.135236 s, lower bound: 1.118364 s, upper bound: 1.151791 s, confidence: 0.950
std dev: 86.08684 ms, lower bound: 78.40054 ms, upper bound: 95.56673 ms, confidence: 0.950
variance introduced by outliers: 68.669%
variance is severely inflated by outliers
commits: 200000
retries: 0
allocated bytes: 225225376

Running a subject "2/100000/unordered-containers"
Collecting 99 more samples in 169.8 s.Collecting 98 more samples in 168.1 s.Collecting 97 more samples in 166.4 s.Collecting 96 more samples in 164.7 s.Collecting 95 more samples in 163.0 s.Collecting 94 more samples in 161.2 s.Collecting 93 more samples in 159.5 s.Collecting 92 more samples in 157.8 s.Collecting 91 more samples in 156.1 s.Collecting 90 more samples in 154.4 s.Collecting 89 more samples in 152.7 s.Collecting 88 more samples in 150.9 s.Collecting 87 more samples in 149.2 s.Collecting 86 more samples in 147.5 s.Collecting 85 more samples in 145.8 s.Collecting 84 more samples in 144.1 s.Collecting 83 more samples in 142.4 s.Collecting 82 more samples in 140.7 s.Collecting 81 more samples in 138.9 s.Collecting 80 more samples in 137.2 s.Collecting 79 more samples in 135.5 s.Collecting 78 more samples in 133.8 s.Collecting 77 more samples in 132.1 s.Collecting 76 more samples in 130.4 s.Collecting 75 more samples in 128.6 s.Collecting 74 more samples in 126.9 s.Collecting 73 more samples in 125.2 s.Collecting 72 more samples in 123.5 s.Collecting 71 more samples in 121.8 s.Collecting 70 more samples in 120.1 s.Collecting 69 more samples in 118.4 s.Collecting 68 more samples in 116.6 s.Collecting 67 more samples in 114.9 s.Collecting 66 more samples in 113.2 s.Collecting 65 more samples in 111.5 s.Collecting 64 more samples in 109.8 s.Collecting 63 more samples in 108.1 s.Collecting 62 more samples in 106.3 s.Collecting 61 more samples in 104.6 s.Collecting 60 more samples in 102.9 s.Collecting 59 more samples in 101.2 s.Collecting 58 more samples in 99.5 s.Collecting 57 more samples in 97.8 s.Collecting 56 more samples in 96.1 s.Collecting 55 more samples in 94.3 s.Collecting 54 more samples in 92.6 s.Collecting 53 more samples in 90.9 s.Collecting 52 more samples in 89.2 s.Collecting 51 more samples in 87.5 s.Collecting 50 more samples in 85.8 s.Collecting 49 more samples in 84.1 s.Collecting 48 more samples in 82.3 s.Collecting 47 more samples in 80.6 s.Collecting 46 more samples in 78.9 s.Collecting 45 more samples in 77.2 s.Collecting 44 more samples in 75.5 s.Collecting 43 more samples in 73.8 s.Collecting 42 more samples in 72.0 s.Collecting 41 more samples in 70.3 s.Collecting 40 more samples in 68.6 s.Collecting 39 more samples in 66.9 s.Collecting 38 more samples in 65.2 s.Collecting 37 more samples in 63.5 s.Collecting 36 more samples in 61.8 s.Collecting 35 more samples in 60.0 s.Collecting 34 more samples in 58.3 s.Collecting 33 more samples in 56.6 s.Collecting 32 more samples in 54.9 s.Collecting 31 more samples in 53.2 s.Collecting 30 more samples in 51.5 s.Collecting 29 more samples in 49.7 s.Collecting 28 more samples in 48.0 s.Collecting 27 more samples in 46.3 s.Collecting 26 more samples in 44.6 s.Collecting 25 more samples in 42.9 s.Collecting 24 more samples in 41.2 s.Collecting 23 more samples in 39.5 s.Collecting 22 more samples in 37.7 s.Collecting 21 more samples in 36.0 s.Collecting 20 more samples in 34.3 s.Collecting 19 more samples in 32.6 s.Collecting 18 more samples in 30.9 s.Collecting 17 more samples in 29.2 s.Collecting 16 more samples in 27.4 s.Collecting 15 more samples in 25.7 s.Collecting 14 more samples in 24.0 s.Collecting 13 more samples in 22.3 s.Collecting 12 more samples in 20.6 s.Collecting 11 more samples in 18.9 s.Collecting 10 more samples in 17.2 s.Collecting 9 more samples in 15.4 s.Collecting 8 more samples in 13.7 s.Collecting 7 more samples in 12.0 s.Collecting 6 more samples in 10.3 s.Collecting 5 more samples in 8.6 s.Collecting 4 more samples in 6.9 s.Collecting 3 more samples in 5.1 s.Collecting 2 more samples in 3.4 s.Collecting 1 more samples in 1.7 s.mean: 1.593982 s, lower bound: 1.553336 s, upper bound: 1.639896 s, confidence: 0.950
std dev: 220.6071 ms, lower bound: 196.2276 ms, upper bound: 254.4056 ms, confidence: 0.950
variance introduced by outliers: 88.354%
variance is severely inflated by outliers
commits: 200000
retries: 153494
allocated bytes: 826948136

Running a subject "2/100000/stm-containers"
Collecting 99 more samples in 203.6 s.Collecting 98 more samples in 201.5 s.Collecting 97 more samples in 199.5 s.Collecting 96 more samples in 197.4 s.Collecting 95 more samples in 195.4 s.Collecting 94 more samples in 193.3 s.Collecting 93 more samples in 191.2 s.Collecting 92 more samples in 189.2 s.Collecting 91 more samples in 187.1 s.Collecting 90 more samples in 185.1 s.Collecting 89 more samples in 183.0 s.Collecting 88 more samples in 181.0 s.Collecting 87 more samples in 178.9 s.Collecting 86 more samples in 176.8 s.Collecting 85 more samples in 174.8 s.Collecting 84 more samples in 172.7 s.Collecting 83 more samples in 170.7 s.Collecting 82 more samples in 168.6 s.Collecting 81 more samples in 166.6 s.Collecting 80 more samples in 164.5 s.Collecting 79 more samples in 162.5 s.Collecting 78 more samples in 160.4 s.Collecting 77 more samples in 158.3 s.Collecting 76 more samples in 156.3 s.Collecting 75 more samples in 154.2 s.Collecting 74 more samples in 152.2 s.Collecting 73 more samples in 150.1 s.Collecting 72 more samples in 148.1 s.Collecting 71 more samples in 146.0 s.Collecting 70 more samples in 143.9 s.Collecting 69 more samples in 141.9 s.Collecting 68 more samples in 139.8 s.Collecting 67 more samples in 137.8 s.Collecting 66 more samples in 135.7 s.Collecting 65 more samples in 133.7 s.Collecting 64 more samples in 131.6 s.Collecting 63 more samples in 129.6 s.Collecting 62 more samples in 127.5 s.Collecting 61 more samples in 125.4 s.Collecting 60 more samples in 123.4 s.Collecting 59 more samples in 121.3 s.Collecting 58 more samples in 119.3 s.Collecting 57 more samples in 117.2 s.Collecting 56 more samples in 115.2 s.Collecting 55 more samples in 113.1 s.Collecting 54 more samples in 111.0 s.Collecting 53 more samples in 109.0 s.Collecting 52 more samples in 106.9 s.Collecting 51 more samples in 104.9 s.Collecting 50 more samples in 102.8 s.Collecting 49 more samples in 100.8 s.Collecting 48 more samples in 98.7 s.Collecting 47 more samples in 96.7 s.Collecting 46 more samples in 94.6 s.Collecting 45 more samples in 92.5 s.Collecting 44 more samples in 90.5 s.Collecting 43 more samples in 88.4 s.Collecting 42 more samples in 86.4 s.Collecting 41 more samples in 84.3 s.Collecting 40 more samples in 82.3 s.Collecting 39 more samples in 80.2 s.Collecting 38 more samples in 78.1 s.Collecting 37 more samples in 76.1 s.Collecting 36 more samples in 74.0 s.Collecting 35 more samples in 72.0 s.Collecting 34 more samples in 69.9 s.Collecting 33 more samples in 67.9 s.Collecting 32 more samples in 65.8 s.Collecting 31 more samples in 63.7 s.Collecting 30 more samples in 61.7 s.Collecting 29 more samples in 59.6 s.Collecting 28 more samples in 57.6 s.Collecting 27 more samples in 55.5 s.Collecting 26 more samples in 53.5 s.Collecting 25 more samples in 51.4 s.Collecting 24 more samples in 49.4 s.Collecting 23 more samples in 47.3 s.Collecting 22 more samples in 45.2 s.Collecting 21 more samples in 43.2 s.Collecting 20 more samples in 41.1 s.Collecting 19 more samples in 39.1 s.Collecting 18 more samples in 37.0 s.Collecting 17 more samples in 35.0 s.Collecting 16 more samples in 32.9 s.Collecting 15 more samples in 30.8 s.Collecting 14 more samples in 28.8 s.Collecting 13 more samples in 26.7 s.Collecting 12 more samples in 24.7 s.Collecting 11 more samples in 22.6 s.Collecting 10 more samples in 20.6 s.Collecting 9 more samples in 18.5 s.Collecting 8 more samples in 16.5 s.Collecting 7 more samples in 14.4 s.Collecting 6 more samples in 12.3 s.Collecting 5 more samples in 10.3 s.Collecting 4 more samples in 8.2 s.Collecting 3 more samples in 6.2 s.Collecting 2 more samples in 4.1 s.Collecting 1 more samples in 2.1 s.mean: 1.400750 s, lower bound: 1.377940 s, upper bound: 1.429524 s, confidence: 0.950
std dev: 130.0049 ms, lower bound: 101.6009 ms, upper bound: 184.8362 ms, confidence: 0.950
found 3 outliers among 100 samples (3.0%)
  3 (3.0%) high severe
variance introduced by outliers: 76.896%
variance is severely inflated by outliers
commits: 200000
retries: 52
allocated bytes: 906316552

Running a subject "2/100000/ttrie"
Collecting 99 more samples in 62.5 s.Collecting 98 more samples in 61.8 s.Collecting 97 more samples in 61.2 s.Collecting 96 more samples in 60.6 s.Collecting 95 more samples in 59.9 s.Collecting 94 more samples in 59.3 s.Collecting 93 more samples in 58.7 s.Collecting 92 more samples in 58.0 s.Collecting 91 more samples in 57.4 s.Collecting 90 more samples in 56.8 s.Collecting 89 more samples in 56.1 s.Collecting 88 more samples in 55.5 s.Collecting 87 more samples in 54.9 s.Collecting 86 more samples in 54.3 s.Collecting 85 more samples in 53.6 s.Collecting 84 more samples in 53.0 s.Collecting 83 more samples in 52.4 s.Collecting 82 more samples in 51.7 s.Collecting 81 more samples in 51.1 s.Collecting 80 more samples in 50.5 s.Collecting 79 more samples in 49.8 s.Collecting 78 more samples in 49.2 s.Collecting 77 more samples in 48.6 s.Collecting 76 more samples in 47.9 s.Collecting 75 more samples in 47.3 s.Collecting 74 more samples in 46.7 s.Collecting 73 more samples in 46.1 s.Collecting 72 more samples in 45.4 s.Collecting 71 more samples in 44.8 s.Collecting 70 more samples in 44.2 s.Collecting 69 more samples in 43.5 s.Collecting 68 more samples in 42.9 s.Collecting 67 more samples in 42.3 s.Collecting 66 more samples in 41.6 s.Collecting 65 more samples in 41.0 s.Collecting 64 more samples in 40.4 s.Collecting 63 more samples in 39.7 s.Collecting 62 more samples in 39.1 s.Collecting 61 more samples in 38.5 s.Collecting 60 more samples in 37.9 s.Collecting 59 more samples in 37.2 s.Collecting 58 more samples in 36.6 s.Collecting 57 more samples in 36.0 s.Collecting 56 more samples in 35.3 s.Collecting 55 more samples in 34.7 s.Collecting 54 more samples in 34.1 s.Collecting 53 more samples in 33.4 s.Collecting 52 more samples in 32.8 s.Collecting 51 more samples in 32.2 s.Collecting 50 more samples in 31.5 s.Collecting 49 more samples in 30.9 s.Collecting 48 more samples in 30.3 s.Collecting 47 more samples in 29.6 s.Collecting 46 more samples in 29.0 s.Collecting 45 more samples in 28.4 s.Collecting 44 more samples in 27.8 s.Collecting 43 more samples in 27.1 s.Collecting 42 more samples in 26.5 s.Collecting 41 more samples in 25.9 s.Collecting 40 more samples in 25.2 s.Collecting 39 more samples in 24.6 s.Collecting 38 more samples in 24.0 s.Collecting 37 more samples in 23.3 s.Collecting 36 more samples in 22.7 s.Collecting 35 more samples in 22.1 s.Collecting 34 more samples in 21.4 s.Collecting 33 more samples in 20.8 s.Collecting 32 more samples in 20.2 s.Collecting 31 more samples in 19.6 s.Collecting 30 more samples in 18.9 s.Collecting 29 more samples in 18.3 s.Collecting 28 more samples in 17.7 s.Collecting 27 more samples in 17.0 s.Collecting 26 more samples in 16.4 s.Collecting 25 more samples in 15.8 s.Collecting 24 more samples in 15.1 s.Collecting 23 more samples in 14.5 s.Collecting 22 more samples in 13.9 s.Collecting 21 more samples in 13.2 s.Collecting 20 more samples in 12.6 s.Collecting 19 more samples in 12.0 s.Collecting 18 more samples in 11.4 s.Collecting 17 more samples in 10.7 s.Collecting 16 more samples in 10.1 s.Collecting 15 more samples in 9.5 s.Collecting 14 more samples in 8.8 s.Collecting 13 more samples in 8.2 s.Collecting 12 more samples in 7.6 s.Collecting 11 more samples in 6.9 s.Collecting 10 more samples in 6.3 s.Collecting 9 more samples in 5.7 s.Collecting 8 more samples in 5.0 s.Collecting 7 more samples in 4.4 s.Collecting 6 more samples in 3.8 s.Collecting 5 more samples in 3.2 s.Collecting 4 more samples in 2.5 s.Collecting 3 more samples in 1.9 s.Collecting 2 more samples in 1.3 s.Collecting 1 more samples in 0.6 s.mean: 586.6291 ms, lower bound: 578.3111 ms, upper bound: 594.9825 ms, confidence: 0.950
std dev: 42.83016 ms, lower bound: 39.20773 ms, upper bound: 47.42617 ms, confidence: 0.950
variance introduced by outliers: 66.645%
variance is severely inflated by outliers
commits: 200000
retries: 0
allocated bytes: 225241048

Running a subject "4/50000/unordered-containers"
Collecting 99 more samples in 138.5 s.Collecting 98 more samples in 137.1 s.Collecting 97 more samples in 135.7 s.Collecting 96 more samples in 134.3 s.Collecting 95 more samples in 132.9 s.Collecting 94 more samples in 131.5 s.Collecting 93 more samples in 130.1 s.Collecting 92 more samples in 128.7 s.Collecting 91 more samples in 127.3 s.Collecting 90 more samples in 125.9 s.Collecting 89 more samples in 124.5 s.Collecting 88 more samples in 123.1 s.Collecting 87 more samples in 121.7 s.Collecting 86 more samples in 120.3 s.Collecting 85 more samples in 118.9 s.Collecting 84 more samples in 117.5 s.Collecting 83 more samples in 116.1 s.Collecting 82 more samples in 114.7 s.Collecting 81 more samples in 113.3 s.Collecting 80 more samples in 111.9 s.Collecting 79 more samples in 110.5 s.Collecting 78 more samples in 109.1 s.Collecting 77 more samples in 107.7 s.Collecting 76 more samples in 106.3 s.Collecting 75 more samples in 104.9 s.Collecting 74 more samples in 103.5 s.Collecting 73 more samples in 102.1 s.Collecting 72 more samples in 100.7 s.Collecting 71 more samples in 99.3 s.Collecting 70 more samples in 97.9 s.Collecting 69 more samples in 96.5 s.Collecting 68 more samples in 95.1 s.Collecting 67 more samples in 93.7 s.Collecting 66 more samples in 92.3 s.Collecting 65 more samples in 90.9 s.Collecting 64 more samples in 89.5 s.Collecting 63 more samples in 88.1 s.Collecting 62 more samples in 86.7 s.Collecting 61 more samples in 85.3 s.Collecting 60 more samples in 83.9 s.Collecting 59 more samples in 82.5 s.Collecting 58 more samples in 81.1 s.Collecting 57 more samples in 79.7 s.Collecting 56 more samples in 78.3 s.Collecting 55 more samples in 76.9 s.Collecting 54 more samples in 75.5 s.Collecting 53 more samples in 74.1 s.Collecting 52 more samples in 72.7 s.Collecting 51 more samples in 71.3 s.Collecting 50 more samples in 69.9 s.Collecting 49 more samples in 68.5 s.Collecting 48 more samples in 67.1 s.Collecting 47 more samples in 65.7 s.Collecting 46 more samples in 64.3 s.Collecting 45 more samples in 62.9 s.Collecting 44 more samples in 61.5 s.Collecting 43 more samples in 60.1 s.Collecting 42 more samples in 58.7 s.Collecting 41 more samples in 57.3 s.Collecting 40 more samples in 55.9 s.Collecting 39 more samples in 54.5 s.Collecting 38 more samples in 53.1 s.Collecting 37 more samples in 51.7 s.Collecting 36 more samples in 50.3 s.Collecting 35 more samples in 48.9 s.Collecting 34 more samples in 47.6 s.Collecting 33 more samples in 46.2 s.Collecting 32 more samples in 44.8 s.Collecting 31 more samples in 43.4 s.Collecting 30 more samples in 42.0 s.Collecting 29 more samples in 40.6 s.Collecting 28 more samples in 39.2 s.Collecting 27 more samples in 37.8 s.Collecting 26 more samples in 36.4 s.Collecting 25 more samples in 35.0 s.Collecting 24 more samples in 33.6 s.Collecting 23 more samples in 32.2 s.Collecting 22 more samples in 30.8 s.Collecting 21 more samples in 29.4 s.Collecting 20 more samples in 28.0 s.Collecting 19 more samples in 26.6 s.Collecting 18 more samples in 25.2 s.Collecting 17 more samples in 23.8 s.Collecting 16 more samples in 22.4 s.Collecting 15 more samples in 21.0 s.Collecting 14 more samples in 19.6 s.Collecting 13 more samples in 18.2 s.Collecting 12 more samples in 16.8 s.Collecting 11 more samples in 15.4 s.Collecting 10 more samples in 14.0 s.Collecting 9 more samples in 12.6 s.Collecting 8 more samples in 11.2 s.Collecting 7 more samples in 9.8 s.Collecting 6 more samples in 8.4 s.Collecting 5 more samples in 7.0 s.Collecting 4 more samples in 5.6 s.Collecting 3 more samples in 4.2 s.Collecting 2 more samples in 2.8 s.Collecting 1 more samples in 1.4 s.mean: 1.324834 s, lower bound: 1.297892 s, upper bound: 1.350333 s, confidence: 0.950
std dev: 134.8505 ms, lower bound: 121.9487 ms, upper bound: 151.7543 ms, confidence: 0.950
variance introduced by outliers: 80.011%
variance is severely inflated by outliers
commits: 200000
retries: 427094
allocated bytes: 1654713808

Running a subject "4/50000/stm-containers"
Collecting 99 more samples in 95.9 s.Collecting 98 more samples in 95.0 s.Collecting 97 more samples in 94.0 s.Collecting 96 more samples in 93.0 s.Collecting 95 more samples in 92.1 s.Collecting 94 more samples in 91.1 s.Collecting 93 more samples in 90.1 s.Collecting 92 more samples in 89.1 s.Collecting 91 more samples in 88.2 s.Collecting 90 more samples in 87.2 s.Collecting 89 more samples in 86.2 s.Collecting 88 more samples in 85.3 s.Collecting 87 more samples in 84.3 s.Collecting 86 more samples in 83.3 s.Collecting 85 more samples in 82.4 s.Collecting 84 more samples in 81.4 s.Collecting 83 more samples in 80.4 s.Collecting 82 more samples in 79.5 s.Collecting 81 more samples in 78.5 s.Collecting 80 more samples in 77.5 s.Collecting 79 more samples in 76.6 s.Collecting 78 more samples in 75.6 s.Collecting 77 more samples in 74.6 s.Collecting 76 more samples in 73.6 s.Collecting 75 more samples in 72.7 s.Collecting 74 more samples in 71.7 s.Collecting 73 more samples in 70.7 s.Collecting 72 more samples in 69.8 s.Collecting 71 more samples in 68.8 s.Collecting 70 more samples in 67.8 s.Collecting 69 more samples in 66.9 s.Collecting 68 more samples in 65.9 s.Collecting 67 more samples in 64.9 s.Collecting 66 more samples in 64.0 s.Collecting 65 more samples in 63.0 s.Collecting 64 more samples in 62.0 s.Collecting 63 more samples in 61.0 s.Collecting 62 more samples in 60.1 s.Collecting 61 more samples in 59.1 s.Collecting 60 more samples in 58.1 s.Collecting 59 more samples in 57.2 s.Collecting 58 more samples in 56.2 s.Collecting 57 more samples in 55.2 s.Collecting 56 more samples in 54.3 s.Collecting 55 more samples in 53.3 s.Collecting 54 more samples in 52.3 s.Collecting 53 more samples in 51.4 s.Collecting 52 more samples in 50.4 s.Collecting 51 more samples in 49.4 s.Collecting 50 more samples in 48.4 s.Collecting 49 more samples in 47.5 s.Collecting 48 more samples in 46.5 s.Collecting 47 more samples in 45.5 s.Collecting 46 more samples in 44.6 s.Collecting 45 more samples in 43.6 s.Collecting 44 more samples in 42.6 s.Collecting 43 more samples in 41.7 s.Collecting 42 more samples in 40.7 s.Collecting 41 more samples in 39.7 s.Collecting 40 more samples in 38.8 s.Collecting 39 more samples in 37.8 s.Collecting 38 more samples in 36.8 s.Collecting 37 more samples in 35.9 s.Collecting 36 more samples in 34.9 s.Collecting 35 more samples in 33.9 s.Collecting 34 more samples in 32.9 s.Collecting 33 more samples in 32.0 s.Collecting 32 more samples in 31.0 s.Collecting 31 more samples in 30.0 s.Collecting 30 more samples in 29.1 s.Collecting 29 more samples in 28.1 s.Collecting 28 more samples in 27.1 s.Collecting 27 more samples in 26.2 s.Collecting 26 more samples in 25.2 s.Collecting 25 more samples in 24.2 s.Collecting 24 more samples in 23.3 s.Collecting 23 more samples in 22.3 s.Collecting 22 more samples in 21.3 s.Collecting 21 more samples in 20.3 s.Collecting 20 more samples in 19.4 s.Collecting 19 more samples in 18.4 s.Collecting 18 more samples in 17.4 s.Collecting 17 more samples in 16.5 s.Collecting 16 more samples in 15.5 s.Collecting 15 more samples in 14.5 s.Collecting 14 more samples in 13.6 s.Collecting 13 more samples in 12.6 s.Collecting 12 more samples in 11.6 s.Collecting 11 more samples in 10.7 s.Collecting 10 more samples in 9.7 s.Collecting 9 more samples in 8.7 s.Collecting 8 more samples in 7.8 s.Collecting 7 more samples in 6.8 s.Collecting 6 more samples in 5.8 s.Collecting 5 more samples in 4.8 s.Collecting 4 more samples in 3.9 s.Collecting 3 more samples in 2.9 s.Collecting 2 more samples in 1.9 s.Collecting 1 more samples in 1.0 s.mean: 1.037719 s, lower bound: 1.019883 s, upper bound: 1.059449 s, confidence: 0.950
std dev: 100.3361 ms, lower bound: 81.66096 ms, upper bound: 138.7751 ms, confidence: 0.950
found 4 outliers among 100 samples (4.0%)
  3 (3.0%) high mild
  1 (1.0%) high severe
variance introduced by outliers: 77.957%
variance is severely inflated by outliers
commits: 200000
retries: 598
allocated bytes: 905218984

Running a subject "4/50000/ttrie"
Collecting 99 more samples in 30.3 s.Collecting 98 more samples in 30.0 s.Collecting 97 more samples in 29.7 s.Collecting 96 more samples in 29.4 s.Collecting 95 more samples in 29.1 s.Collecting 94 more samples in 28.8 s.Collecting 93 more samples in 28.5 s.Collecting 92 more samples in 28.2 s.Collecting 91 more samples in 27.8 s.Collecting 90 more samples in 27.5 s.Collecting 89 more samples in 27.2 s.Collecting 88 more samples in 26.9 s.Collecting 87 more samples in 26.6 s.Collecting 86 more samples in 26.3 s.Collecting 85 more samples in 26.0 s.Collecting 84 more samples in 25.7 s.Collecting 83 more samples in 25.4 s.Collecting 82 more samples in 25.1 s.Collecting 81 more samples in 24.8 s.Collecting 80 more samples in 24.5 s.Collecting 79 more samples in 24.2 s.Collecting 78 more samples in 23.9 s.Collecting 77 more samples in 23.6 s.Collecting 76 more samples in 23.3 s.Collecting 75 more samples in 23.0 s.Collecting 74 more samples in 22.6 s.Collecting 73 more samples in 22.3 s.Collecting 72 more samples in 22.0 s.Collecting 71 more samples in 21.7 s.Collecting 70 more samples in 21.4 s.Collecting 69 more samples in 21.1 s.Collecting 68 more samples in 20.8 s.Collecting 67 more samples in 20.5 s.Collecting 66 more samples in 20.2 s.Collecting 65 more samples in 19.9 s.Collecting 64 more samples in 19.6 s.Collecting 63 more samples in 19.3 s.Collecting 62 more samples in 19.0 s.Collecting 61 more samples in 18.7 s.Collecting 60 more samples in 18.4 s.Collecting 59 more samples in 18.1 s.Collecting 58 more samples in 17.7 s.Collecting 57 more samples in 17.4 s.Collecting 56 more samples in 17.1 s.Collecting 55 more samples in 16.8 s.Collecting 54 more samples in 16.5 s.Collecting 53 more samples in 16.2 s.Collecting 52 more samples in 15.9 s.Collecting 51 more samples in 15.6 s.Collecting 50 more samples in 15.3 s.Collecting 49 more samples in 15.0 s.Collecting 48 more samples in 14.7 s.Collecting 47 more samples in 14.4 s.Collecting 46 more samples in 14.1 s.Collecting 45 more samples in 13.8 s.Collecting 44 more samples in 13.5 s.Collecting 43 more samples in 13.2 s.Collecting 42 more samples in 12.9 s.Collecting 41 more samples in 12.5 s.Collecting 40 more samples in 12.2 s.Collecting 39 more samples in 11.9 s.Collecting 38 more samples in 11.6 s.Collecting 37 more samples in 11.3 s.Collecting 36 more samples in 11.0 s.Collecting 35 more samples in 10.7 s.Collecting 34 more samples in 10.4 s.Collecting 33 more samples in 10.1 s.Collecting 32 more samples in 9.8 s.Collecting 31 more samples in 9.5 s.Collecting 30 more samples in 9.2 s.Collecting 29 more samples in 8.9 s.Collecting 28 more samples in 8.6 s.Collecting 27 more samples in 8.3 s.Collecting 26 more samples in 8.0 s.Collecting 25 more samples in 7.7 s.Collecting 24 more samples in 7.3 s.Collecting 23 more samples in 7.0 s.Collecting 22 more samples in 6.7 s.Collecting 21 more samples in 6.4 s.Collecting 20 more samples in 6.1 s.Collecting 19 more samples in 5.8 s.Collecting 18 more samples in 5.5 s.Collecting 17 more samples in 5.2 s.Collecting 16 more samples in 4.9 s.Collecting 15 more samples in 4.6 s.Collecting 14 more samples in 4.3 s.Collecting 13 more samples in 4.0 s.Collecting 12 more samples in 3.7 s.Collecting 11 more samples in 3.4 s.Collecting 10 more samples in 3.1 s.Collecting 9 more samples in 2.8 s.Collecting 8 more samples in 2.4 s.Collecting 7 more samples in 2.1 s.Collecting 6 more samples in 1.8 s.Collecting 5 more samples in 1.5 s.Collecting 4 more samples in 1.2 s.Collecting 3 more samples in 0.9 s.Collecting 2 more samples in 0.6 s.Collecting 1 more samples in 0.3 s.mean: 325.7615 ms, lower bound: 322.3715 ms, upper bound: 332.5253 ms, confidence: 0.950
std dev: 23.66627 ms, lower bound: 12.74654 ms, upper bound: 41.66018 ms, confidence: 0.950
found 7 outliers among 100 samples (7.0%)
  4 (4.0%) low mild
  2 (2.0%) high severe
variance introduced by outliers: 66.631%
variance is severely inflated by outliers
commits: 200000
retries: 0
allocated bytes: 225276400

Running a subject "6/33333/unordered-containers"
Collecting 99 more samples in 144.2 s.Collecting 98 more samples in 142.7 s.Collecting 97 more samples in 141.3 s.Collecting 96 more samples in 139.8 s.Collecting 95 more samples in 138.3 s.Collecting 94 more samples in 136.9 s.Collecting 93 more samples in 135.4 s.Collecting 92 more samples in 134.0 s.Collecting 91 more samples in 132.5 s.Collecting 90 more samples in 131.1 s.Collecting 89 more samples in 129.6 s.Collecting 88 more samples in 128.2 s.Collecting 87 more samples in 126.7 s.Collecting 86 more samples in 125.2 s.Collecting 85 more samples in 123.8 s.Collecting 84 more samples in 122.3 s.Collecting 83 more samples in 120.9 s.Collecting 82 more samples in 119.4 s.Collecting 81 more samples in 118.0 s.Collecting 80 more samples in 116.5 s.Collecting 79 more samples in 115.0 s.Collecting 78 more samples in 113.6 s.Collecting 77 more samples in 112.1 s.Collecting 76 more samples in 110.7 s.Collecting 75 more samples in 109.2 s.Collecting 74 more samples in 107.8 s.Collecting 73 more samples in 106.3 s.Collecting 72 more samples in 104.9 s.Collecting 71 more samples in 103.4 s.Collecting 70 more samples in 101.9 s.Collecting 69 more samples in 100.5 s.Collecting 68 more samples in 99.0 s.Collecting 67 more samples in 97.6 s.Collecting 66 more samples in 96.1 s.Collecting 65 more samples in 94.7 s.Collecting 64 more samples in 93.2 s.Collecting 63 more samples in 91.7 s.Collecting 62 more samples in 90.3 s.Collecting 61 more samples in 88.8 s.Collecting 60 more samples in 87.4 s.Collecting 59 more samples in 85.9 s.Collecting 58 more samples in 84.5 s.Collecting 57 more samples in 83.0 s.Collecting 56 more samples in 81.6 s.Collecting 55 more samples in 80.1 s.Collecting 54 more samples in 78.6 s.Collecting 53 more samples in 77.2 s.Collecting 52 more samples in 75.7 s.Collecting 51 more samples in 74.3 s.Collecting 50 more samples in 72.8 s.Collecting 49 more samples in 71.4 s.Collecting 48 more samples in 69.9 s.Collecting 47 more samples in 68.4 s.Collecting 46 more samples in 67.0 s.Collecting 45 more samples in 65.5 s.Collecting 44 more samples in 64.1 s.Collecting 43 more samples in 62.6 s.Collecting 42 more samples in 61.2 s.Collecting 41 more samples in 59.7 s.Collecting 40 more samples in 58.3 s.Collecting 39 more samples in 56.8 s.Collecting 38 more samples in 55.3 s.Collecting 37 more samples in 53.9 s.Collecting 36 more samples in 52.4 s.Collecting 35 more samples in 51.0 s.Collecting 34 more samples in 49.5 s.Collecting 33 more samples in 48.1 s.Collecting 32 more samples in 46.6 s.Collecting 31 more samples in 45.1 s.Collecting 30 more samples in 43.7 s.Collecting 29 more samples in 42.2 s.Collecting 28 more samples in 40.8 s.Collecting 27 more samples in 39.3 s.Collecting 26 more samples in 37.9 s.Collecting 25 more samples in 36.4 s.Collecting 24 more samples in 35.0 s.Collecting 23 more samples in 33.5 s.Collecting 22 more samples in 32.0 s.Collecting 21 more samples in 30.6 s.Collecting 20 more samples in 29.1 s.Collecting 19 more samples in 27.7 s.Collecting 18 more samples in 26.2 s.Collecting 17 more samples in 24.8 s.Collecting 16 more samples in 23.3 s.Collecting 15 more samples in 21.8 s.Collecting 14 more samples in 20.4 s.Collecting 13 more samples in 18.9 s.Collecting 12 more samples in 17.5 s.Collecting 11 more samples in 16.0 s.Collecting 10 more samples in 14.6 s.Collecting 9 more samples in 13.1 s.Collecting 8 more samples in 11.7 s.Collecting 7 more samples in 10.2 s.Collecting 6 more samples in 8.7 s.Collecting 5 more samples in 7.3 s.Collecting 4 more samples in 5.8 s.Collecting 3 more samples in 4.4 s.Collecting 2 more samples in 2.9 s.Collecting 1 more samples in 1.5 s.mean: 1.322731 s, lower bound: 1.302009 s, upper bound: 1.340921 s, confidence: 0.950
std dev: 99.67488 ms, lower bound: 85.86814 ms, upper bound: 115.9189 ms, confidence: 0.950
found 6 outliers among 100 samples (6.0%)
  6 (6.0%) low mild
variance introduced by outliers: 68.652%
variance is severely inflated by outliers
commits: 200000
retries: 656056
allocated bytes: 2414862448

Running a subject "6/33333/stm-containers"
Collecting 99 more samples in 97.5 s.Collecting 98 more samples in 96.5 s.Collecting 97 more samples in 95.5 s.Collecting 96 more samples in 94.5 s.Collecting 95 more samples in 93.5 s.Collecting 94 more samples in 92.6 s.Collecting 93 more samples in 91.6 s.Collecting 92 more samples in 90.6 s.Collecting 91 more samples in 89.6 s.Collecting 90 more samples in 88.6 s.Collecting 89 more samples in 87.6 s.Collecting 88 more samples in 86.7 s.Collecting 87 more samples in 85.7 s.Collecting 86 more samples in 84.7 s.Collecting 85 more samples in 83.7 s.Collecting 84 more samples in 82.7 s.Collecting 83 more samples in 81.7 s.Collecting 82 more samples in 80.7 s.Collecting 81 more samples in 79.8 s.Collecting 80 more samples in 78.8 s.Collecting 79 more samples in 77.8 s.Collecting 78 more samples in 76.8 s.Collecting 77 more samples in 75.8 s.Collecting 76 more samples in 74.8 s.Collecting 75 more samples in 73.9 s.Collecting 74 more samples in 72.9 s.Collecting 73 more samples in 71.9 s.Collecting 72 more samples in 70.9 s.Collecting 71 more samples in 69.9 s.Collecting 70 more samples in 68.9 s.Collecting 69 more samples in 67.9 s.Collecting 68 more samples in 67.0 s.Collecting 67 more samples in 66.0 s.Collecting 66 more samples in 65.0 s.Collecting 65 more samples in 64.0 s.Collecting 64 more samples in 63.0 s.Collecting 63 more samples in 62.0 s.Collecting 62 more samples in 61.1 s.Collecting 61 more samples in 60.1 s.Collecting 60 more samples in 59.1 s.Collecting 59 more samples in 58.1 s.Collecting 58 more samples in 57.1 s.Collecting 57 more samples in 56.1 s.Collecting 56 more samples in 55.1 s.Collecting 55 more samples in 54.2 s.Collecting 54 more samples in 53.2 s.Collecting 53 more samples in 52.2 s.Collecting 52 more samples in 51.2 s.Collecting 51 more samples in 50.2 s.Collecting 50 more samples in 49.2 s.Collecting 49 more samples in 48.3 s.Collecting 48 more samples in 47.3 s.Collecting 47 more samples in 46.3 s.Collecting 46 more samples in 45.3 s.Collecting 45 more samples in 44.3 s.Collecting 44 more samples in 43.3 s.Collecting 43 more samples in 42.3 s.Collecting 42 more samples in 41.4 s.Collecting 41 more samples in 40.4 s.Collecting 40 more samples in 39.4 s.Collecting 39 more samples in 38.4 s.Collecting 38 more samples in 37.4 s.Collecting 37 more samples in 36.4 s.Collecting 36 more samples in 35.4 s.Collecting 35 more samples in 34.5 s.Collecting 34 more samples in 33.5 s.Collecting 33 more samples in 32.5 s.Collecting 32 more samples in 31.5 s.Collecting 31 more samples in 30.5 s.Collecting 30 more samples in 29.5 s.Collecting 29 more samples in 28.6 s.Collecting 28 more samples in 27.6 s.Collecting 27 more samples in 26.6 s.Collecting 26 more samples in 25.6 s.Collecting 25 more samples in 24.6 s.Collecting 24 more samples in 23.6 s.Collecting 23 more samples in 22.6 s.Collecting 22 more samples in 21.7 s.Collecting 21 more samples in 20.7 s.Collecting 20 more samples in 19.7 s.Collecting 19 more samples in 18.7 s.Collecting 18 more samples in 17.7 s.Collecting 17 more samples in 16.7 s.Collecting 16 more samples in 15.8 s.Collecting 15 more samples in 14.8 s.Collecting 14 more samples in 13.8 s.Collecting 13 more samples in 12.8 s.Collecting 12 more samples in 11.8 s.Collecting 11 more samples in 10.8 s.Collecting 10 more samples in 9.8 s.Collecting 9 more samples in 8.9 s.Collecting 8 more samples in 7.9 s.Collecting 7 more samples in 6.9 s.Collecting 6 more samples in 5.9 s.Collecting 5 more samples in 4.9 s.Collecting 4 more samples in 3.9 s.Collecting 3 more samples in 3.0 s.Collecting 2 more samples in 2.0 s.Collecting 1 more samples in 1.0 s.mean: 786.5997 ms, lower bound: 771.4809 ms, upper bound: 802.6174 ms, confidence: 0.950
std dev: 79.48464 ms, lower bound: 70.29271 ms, upper bound: 91.44159 ms, confidence: 0.950
found 2 outliers among 100 samples (2.0%)
  2 (2.0%) high mild
variance introduced by outliers: 79.996%
variance is severely inflated by outliers
commits: 200000
retries: 1079
allocated bytes: 905774824

Running a subject "6/33333/ttrie"
Collecting 99 more samples in 23.4 s.Collecting 98 more samples in 23.2 s.Collecting 97 more samples in 22.9 s.Collecting 96 more samples in 22.7 s.Collecting 95 more samples in 22.5 s.Collecting 94 more samples in 22.2 s.Collecting 93 more samples in 22.0 s.Collecting 92 more samples in 21.8 s.Collecting 91 more samples in 21.5 s.Collecting 90 more samples in 21.3 s.Collecting 89 more samples in 21.1 s.Collecting 88 more samples in 20.8 s.Collecting 87 more samples in 20.6 s.Collecting 86 more samples in 20.3 s.Collecting 85 more samples in 20.1 s.Collecting 84 more samples in 19.9 s.Collecting 83 more samples in 19.6 s.Collecting 82 more samples in 19.4 s.Collecting 81 more samples in 19.2 s.Collecting 80 more samples in 18.9 s.Collecting 79 more samples in 18.7 s.Collecting 78 more samples in 18.5 s.Collecting 77 more samples in 18.2 s.Collecting 76 more samples in 18.0 s.Collecting 75 more samples in 17.7 s.Collecting 74 more samples in 17.5 s.Collecting 73 more samples in 17.3 s.Collecting 72 more samples in 17.0 s.Collecting 71 more samples in 16.8 s.Collecting 70 more samples in 16.6 s.Collecting 69 more samples in 16.3 s.Collecting 68 more samples in 16.1 s.Collecting 67 more samples in 15.9 s.Collecting 66 more samples in 15.6 s.Collecting 65 more samples in 15.4 s.Collecting 64 more samples in 15.1 s.Collecting 63 more samples in 14.9 s.Collecting 62 more samples in 14.7 s.Collecting 61 more samples in 14.4 s.Collecting 60 more samples in 14.2 s.Collecting 59 more samples in 14.0 s.Collecting 58 more samples in 13.7 s.Collecting 57 more samples in 13.5 s.Collecting 56 more samples in 13.2 s.Collecting 55 more samples in 13.0 s.Collecting 54 more samples in 12.8 s.Collecting 53 more samples in 12.5 s.Collecting 52 more samples in 12.3 s.Collecting 51 more samples in 12.1 s.Collecting 50 more samples in 11.8 s.Collecting 49 more samples in 11.6 s.Collecting 48 more samples in 11.4 s.Collecting 47 more samples in 11.1 s.Collecting 46 more samples in 10.9 s.Collecting 45 more samples in 10.6 s.Collecting 44 more samples in 10.4 s.Collecting 43 more samples in 10.2 s.Collecting 42 more samples in 9.9 s.Collecting 41 more samples in 9.7 s.Collecting 40 more samples in 9.5 s.Collecting 39 more samples in 9.2 s.Collecting 38 more samples in 9.0 s.Collecting 37 more samples in 8.8 s.Collecting 36 more samples in 8.5 s.Collecting 35 more samples in 8.3 s.Collecting 34 more samples in 8.0 s.Collecting 33 more samples in 7.8 s.Collecting 32 more samples in 7.6 s.Collecting 31 more samples in 7.3 s.Collecting 30 more samples in 7.1 s.Collecting 29 more samples in 6.9 s.Collecting 28 more samples in 6.6 s.Collecting 27 more samples in 6.4 s.Collecting 26 more samples in 6.2 s.Collecting 25 more samples in 5.9 s.Collecting 24 more samples in 5.7 s.Collecting 23 more samples in 5.4 s.Collecting 22 more samples in 5.2 s.Collecting 21 more samples in 5.0 s.Collecting 20 more samples in 4.7 s.Collecting 19 more samples in 4.5 s.Collecting 18 more samples in 4.3 s.Collecting 17 more samples in 4.0 s.Collecting 16 more samples in 3.8 s.Collecting 15 more samples in 3.5 s.Collecting 14 more samples in 3.3 s.Collecting 13 more samples in 3.1 s.Collecting 12 more samples in 2.8 s.Collecting 11 more samples in 2.6 s.Collecting 10 more samples in 2.4 s.Collecting 9 more samples in 2.1 s.Collecting 8 more samples in 1.9 s.Collecting 7 more samples in 1.7 s.Collecting 6 more samples in 1.4 s.Collecting 5 more samples in 1.2 s.Collecting 4 more samples in 0.9 s.Collecting 3 more samples in 0.7 s.Collecting 2 more samples in 0.5 s.Collecting 1 more samples in 0.2 s.mean: 226.6107 ms, lower bound: 225.6395 ms, upper bound: 227.9267 ms, confidence: 0.950
std dev: 5.761985 ms, lower bound: 4.525468 ms, upper bound: 8.923260 ms, confidence: 0.950
found 6 outliers among 100 samples (6.0%)
  5 (5.0%) high mild
  1 (1.0%) high severe
variance introduced by outliers: 19.033%
variance is moderately inflated by outliers
commits: 200000
retries: 0
allocated bytes: 225295952

Running a subject "8/25000/unordered-containers"
Collecting 99 more samples in 146.1 s.Collecting 98 more samples in 144.6 s.Collecting 97 more samples in 143.1 s.Collecting 96 more samples in 141.6 s.Collecting 95 more samples in 140.2 s.Collecting 94 more samples in 138.7 s.Collecting 93 more samples in 137.2 s.Collecting 92 more samples in 135.7 s.Collecting 91 more samples in 134.3 s.Collecting 90 more samples in 132.8 s.Collecting 89 more samples in 131.3 s.Collecting 88 more samples in 129.8 s.Collecting 87 more samples in 128.4 s.Collecting 86 more samples in 126.9 s.Collecting 85 more samples in 125.4 s.Collecting 84 more samples in 123.9 s.Collecting 83 more samples in 122.5 s.Collecting 82 more samples in 121.0 s.Collecting 81 more samples in 119.5 s.Collecting 80 more samples in 118.0 s.Collecting 79 more samples in 116.6 s.Collecting 78 more samples in 115.1 s.Collecting 77 more samples in 113.6 s.Collecting 76 more samples in 112.1 s.Collecting 75 more samples in 110.6 s.Collecting 74 more samples in 109.2 s.Collecting 73 more samples in 107.7 s.Collecting 72 more samples in 106.2 s.Collecting 71 more samples in 104.7 s.Collecting 70 more samples in 103.3 s.Collecting 69 more samples in 101.8 s.Collecting 68 more samples in 100.3 s.Collecting 67 more samples in 98.8 s.Collecting 66 more samples in 97.4 s.Collecting 65 more samples in 95.9 s.Collecting 64 more samples in 94.4 s.Collecting 63 more samples in 92.9 s.Collecting 62 more samples in 91.5 s.Collecting 61 more samples in 90.0 s.Collecting 60 more samples in 88.5 s.Collecting 59 more samples in 87.0 s.Collecting 58 more samples in 85.6 s.Collecting 57 more samples in 84.1 s.Collecting 56 more samples in 82.6 s.Collecting 55 more samples in 81.1 s.Collecting 54 more samples in 79.7 s.Collecting 53 more samples in 78.2 s.Collecting 52 more samples in 76.7 s.Collecting 51 more samples in 75.2 s.Collecting 50 more samples in 73.8 s.Collecting 49 more samples in 72.3 s.Collecting 48 more samples in 70.8 s.Collecting 47 more samples in 69.3 s.Collecting 46 more samples in 67.9 s.Collecting 45 more samples in 66.4 s.Collecting 44 more samples in 64.9 s.Collecting 43 more samples in 63.4 s.Collecting 42 more samples in 62.0 s.Collecting 41 more samples in 60.5 s.Collecting 40 more samples in 59.0 s.Collecting 39 more samples in 57.5 s.Collecting 38 more samples in 56.1 s.Collecting 37 more samples in 54.6 s.Collecting 36 more samples in 53.1 s.Collecting 35 more samples in 51.6 s.Collecting 34 more samples in 50.2 s.Collecting 33 more samples in 48.7 s.Collecting 32 more samples in 47.2 s.Collecting 31 more samples in 45.7 s.Collecting 30 more samples in 44.3 s.Collecting 29 more samples in 42.8 s.Collecting 28 more samples in 41.3 s.Collecting 27 more samples in 39.8 s.Collecting 26 more samples in 38.4 s.Collecting 25 more samples in 36.9 s.Collecting 24 more samples in 35.4 s.Collecting 23 more samples in 33.9 s.Collecting 22 more samples in 32.5 s.Collecting 21 more samples in 31.0 s.Collecting 20 more samples in 29.5 s.Collecting 19 more samples in 28.0 s.Collecting 18 more samples in 26.6 s.Collecting 17 more samples in 25.1 s.Collecting 16 more samples in 23.6 s.Collecting 15 more samples in 22.1 s.Collecting 14 more samples in 20.7 s.Collecting 13 more samples in 19.2 s.Collecting 12 more samples in 17.7 s.Collecting 11 more samples in 16.2 s.Collecting 10 more samples in 14.8 s.Collecting 9 more samples in 13.3 s.Collecting 8 more samples in 11.8 s.Collecting 7 more samples in 10.3 s.Collecting 6 more samples in 8.9 s.Collecting 5 more samples in 7.4 s.Collecting 4 more samples in 5.9 s.Collecting 3 more samples in 4.4 s.Collecting 2 more samples in 3.0 s.Collecting 1 more samples in 1.5 s.mean: 1.319291 s, lower bound: 1.307809 s, upper bound: 1.330570 s, confidence: 0.950
std dev: 58.57892 ms, lower bound: 50.36628 ms, upper bound: 70.00250 ms, confidence: 0.950
found 6 outliers among 100 samples (6.0%)
  2 (2.0%) low mild
  4 (4.0%) high mild
variance introduced by outliers: 42.466%
variance is moderately inflated by outliers
commits: 200000
retries: 936850
allocated bytes: 3165885320

Running a subject "8/25000/stm-containers"
Collecting 99 more samples in 74.6 s.Collecting 98 more samples in 73.9 s.Collecting 97 more samples in 73.1 s.Collecting 96 more samples in 72.4 s.Collecting 95 more samples in 71.6 s.Collecting 94 more samples in 70.9 s.Collecting 93 more samples in 70.1 s.Collecting 92 more samples in 69.3 s.Collecting 91 more samples in 68.6 s.Collecting 90 more samples in 67.8 s.Collecting 89 more samples in 67.1 s.Collecting 88 more samples in 66.3 s.Collecting 87 more samples in 65.6 s.Collecting 86 more samples in 64.8 s.Collecting 85 more samples in 64.1 s.Collecting 84 more samples in 63.3 s.Collecting 83 more samples in 62.6 s.Collecting 82 more samples in 61.8 s.Collecting 81 more samples in 61.1 s.Collecting 80 more samples in 60.3 s.Collecting 79 more samples in 59.5 s.Collecting 78 more samples in 58.8 s.Collecting 77 more samples in 58.0 s.Collecting 76 more samples in 57.3 s.Collecting 75 more samples in 56.5 s.Collecting 74 more samples in 55.8 s.Collecting 73 more samples in 55.0 s.Collecting 72 more samples in 54.3 s.Collecting 71 more samples in 53.5 s.Collecting 70 more samples in 52.8 s.Collecting 69 more samples in 52.0 s.Collecting 68 more samples in 51.3 s.Collecting 67 more samples in 50.5 s.Collecting 66 more samples in 49.7 s.Collecting 65 more samples in 49.0 s.Collecting 64 more samples in 48.2 s.Collecting 63 more samples in 47.5 s.Collecting 62 more samples in 46.7 s.Collecting 61 more samples in 46.0 s.Collecting 60 more samples in 45.2 s.Collecting 59 more samples in 44.5 s.Collecting 58 more samples in 43.7 s.Collecting 57 more samples in 43.0 s.Collecting 56 more samples in 42.2 s.Collecting 55 more samples in 41.5 s.Collecting 54 more samples in 40.7 s.Collecting 53 more samples in 39.9 s.Collecting 52 more samples in 39.2 s.Collecting 51 more samples in 38.4 s.Collecting 50 more samples in 37.7 s.Collecting 49 more samples in 36.9 s.Collecting 48 more samples in 36.2 s.Collecting 47 more samples in 35.4 s.Collecting 46 more samples in 34.7 s.Collecting 45 more samples in 33.9 s.Collecting 44 more samples in 33.2 s.Collecting 43 more samples in 32.4 s.Collecting 42 more samples in 31.7 s.Collecting 41 more samples in 30.9 s.Collecting 40 more samples in 30.1 s.Collecting 39 more samples in 29.4 s.Collecting 38 more samples in 28.6 s.Collecting 37 more samples in 27.9 s.Collecting 36 more samples in 27.1 s.Collecting 35 more samples in 26.4 s.Collecting 34 more samples in 25.6 s.Collecting 33 more samples in 24.9 s.Collecting 32 more samples in 24.1 s.Collecting 31 more samples in 23.4 s.Collecting 30 more samples in 22.6 s.Collecting 29 more samples in 21.9 s.Collecting 28 more samples in 21.1 s.Collecting 27 more samples in 20.4 s.Collecting 26 more samples in 19.6 s.Collecting 25 more samples in 18.8 s.Collecting 24 more samples in 18.1 s.Collecting 23 more samples in 17.3 s.Collecting 22 more samples in 16.6 s.Collecting 21 more samples in 15.8 s.Collecting 20 more samples in 15.1 s.Collecting 19 more samples in 14.3 s.Collecting 18 more samples in 13.6 s.Collecting 17 more samples in 12.8 s.Collecting 16 more samples in 12.1 s.Collecting 15 more samples in 11.3 s.Collecting 14 more samples in 10.6 s.Collecting 13 more samples in 9.8 s.Collecting 12 more samples in 9.0 s.Collecting 11 more samples in 8.3 s.Collecting 10 more samples in 7.5 s.Collecting 9 more samples in 6.8 s.Collecting 8 more samples in 6.0 s.Collecting 7 more samples in 5.3 s.Collecting 6 more samples in 4.5 s.Collecting 5 more samples in 3.8 s.Collecting 4 more samples in 3.0 s.Collecting 3 more samples in 2.3 s.Collecting 2 more samples in 1.5 s.Collecting 1 more samples in 0.8 s.mean: 679.4386 ms, lower bound: 663.7142 ms, upper bound: 706.2086 ms, confidence: 0.950
std dev: 102.1363 ms, lower bound: 67.73785 ms, upper bound: 188.3363 ms, confidence: 0.950
found 2 outliers among 100 samples (2.0%)
  1 (1.0%) high severe
variance introduced by outliers: 89.440%
variance is severely inflated by outliers
commits: 200000
retries: 1344
allocated bytes: 906430072

Running a subject "8/25000/ttrie"
Collecting 100 more samples in 18.5 s.Collecting 99 more samples in 18.3 s.Collecting 98 more samples in 18.1 s.Collecting 97 more samples in 17.9 s.Collecting 96 more samples in 17.8 s.Collecting 95 more samples in 17.6 s.Collecting 94 more samples in 17.4 s.Collecting 93 more samples in 17.2 s.Collecting 92 more samples in 17.0 s.Collecting 91 more samples in 16.8 s.Collecting 90 more samples in 16.6 s.Collecting 89 more samples in 16.5 s.Collecting 88 more samples in 16.3 s.Collecting 87 more samples in 16.1 s.Collecting 86 more samples in 15.9 s.Collecting 85 more samples in 15.7 s.Collecting 84 more samples in 15.5 s.Collecting 83 more samples in 15.3 s.Collecting 82 more samples in 15.2 s.Collecting 81 more samples in 15.0 s.Collecting 80 more samples in 14.8 s.Collecting 79 more samples in 14.6 s.Collecting 78 more samples in 14.4 s.Collecting 77 more samples in 14.2 s.Collecting 76 more samples in 14.1 s.Collecting 75 more samples in 13.9 s.Collecting 74 more samples in 13.7 s.Collecting 73 more samples in 13.5 s.Collecting 72 more samples in 13.3 s.Collecting 71 more samples in 13.1 s.Collecting 70 more samples in 12.9 s.Collecting 69 more samples in 12.8 s.Collecting 68 more samples in 12.6 s.Collecting 67 more samples in 12.4 s.Collecting 66 more samples in 12.2 s.Collecting 65 more samples in 12.0 s.Collecting 64 more samples in 11.8 s.Collecting 63 more samples in 11.7 s.Collecting 62 more samples in 11.5 s.Collecting 61 more samples in 11.3 s.Collecting 60 more samples in 11.1 s.Collecting 59 more samples in 10.9 s.Collecting 58 more samples in 10.7 s.Collecting 57 more samples in 10.5 s.Collecting 56 more samples in 10.4 s.Collecting 55 more samples in 10.2 s.Collecting 54 more samples in 10.0 s.Collecting 53 more samples in 9.8 s.Collecting 52 more samples in 9.6 s.Collecting 51 more samples in 9.4 s.Collecting 50 more samples in 9.2 s.Collecting 49 more samples in 9.1 s.Collecting 48 more samples in 8.9 s.Collecting 47 more samples in 8.7 s.Collecting 46 more samples in 8.5 s.Collecting 45 more samples in 8.3 s.Collecting 44 more samples in 8.1 s.Collecting 43 more samples in 8.0 s.Collecting 42 more samples in 7.8 s.Collecting 41 more samples in 7.6 s.Collecting 40 more samples in 7.4 s.Collecting 39 more samples in 7.2 s.Collecting 38 more samples in 7.0 s.Collecting 37 more samples in 6.8 s.Collecting 36 more samples in 6.7 s.Collecting 35 more samples in 6.5 s.Collecting 34 more samples in 6.3 s.Collecting 33 more samples in 6.1 s.Collecting 32 more samples in 5.9 s.Collecting 31 more samples in 5.7 s.Collecting 30 more samples in 5.5 s.Collecting 29 more samples in 5.4 s.Collecting 28 more samples in 5.2 s.Collecting 27 more samples in 5.0 s.Collecting 26 more samples in 4.8 s.Collecting 25 more samples in 4.6 s.Collecting 24 more samples in 4.4 s.Collecting 23 more samples in 4.3 s.Collecting 22 more samples in 4.1 s.Collecting 21 more samples in 3.9 s.Collecting 20 more samples in 3.7 s.Collecting 19 more samples in 3.5 s.Collecting 18 more samples in 3.3 s.Collecting 17 more samples in 3.1 s.Collecting 16 more samples in 3.0 s.Collecting 15 more samples in 2.8 s.Collecting 14 more samples in 2.6 s.Collecting 13 more samples in 2.4 s.Collecting 12 more samples in 2.2 s.Collecting 11 more samples in 2.0 s.Collecting 10 more samples in 1.8 s.Collecting 9 more samples in 1.7 s.Collecting 8 more samples in 1.5 s.Collecting 7 more samples in 1.3 s.Collecting 6 more samples in 1.1 s.Collecting 5 more samples in 0.9 s.Collecting 4 more samples in 0.7 s.Collecting 3 more samples in 0.6 s.Collecting 2 more samples in 0.4 s.Collecting 1 more samples in 0.2 s.mean: 174.2361 ms, lower bound: 172.2368 ms, upper bound: 176.6390 ms, confidence: 0.950
std dev: 11.18180 ms, lower bound: 9.302605 ms, upper bound: 13.92097 ms, confidence: 0.950
found 9 outliers among 100 samples (9.0%)
  8 (8.0%) high mild
  1 (1.0%) high severe
variance introduced by outliers: 60.542%
variance is severely inflated by outliers
commits: 200000
retries: 2
allocated bytes: 225295176

Running a subject "10/20000/unordered-containers"
Collecting 99 more samples in 127.3 s.Collecting 98 more samples in 126.0 s.Collecting 97 more samples in 124.7 s.Collecting 96 more samples in 123.4 s.Collecting 95 more samples in 122.2 s.Collecting 94 more samples in 120.9 s.Collecting 93 more samples in 119.6 s.Collecting 92 more samples in 118.3 s.Collecting 91 more samples in 117.0 s.Collecting 90 more samples in 115.7 s.Collecting 89 more samples in 114.4 s.Collecting 88 more samples in 113.2 s.Collecting 87 more samples in 111.9 s.Collecting 86 more samples in 110.6 s.Collecting 85 more samples in 109.3 s.Collecting 84 more samples in 108.0 s.Collecting 83 more samples in 106.7 s.Collecting 82 more samples in 105.4 s.Collecting 81 more samples in 104.2 s.Collecting 80 more samples in 102.9 s.Collecting 79 more samples in 101.6 s.Collecting 78 more samples in 100.3 s.Collecting 77 more samples in 99.0 s.Collecting 76 more samples in 97.7 s.Collecting 75 more samples in 96.4 s.Collecting 74 more samples in 95.2 s.Collecting 73 more samples in 93.9 s.Collecting 72 more samples in 92.6 s.Collecting 71 more samples in 91.3 s.Collecting 70 more samples in 90.0 s.Collecting 69 more samples in 88.7 s.Collecting 68 more samples in 87.4 s.Collecting 67 more samples in 86.2 s.Collecting 66 more samples in 84.9 s.Collecting 65 more samples in 83.6 s.Collecting 64 more samples in 82.3 s.Collecting 63 more samples in 81.0 s.Collecting 62 more samples in 79.7 s.Collecting 61 more samples in 78.4 s.Collecting 60 more samples in 77.2 s.Collecting 59 more samples in 75.9 s.Collecting 58 more samples in 74.6 s.Collecting 57 more samples in 73.3 s.Collecting 56 more samples in 72.0 s.Collecting 55 more samples in 70.7 s.Collecting 54 more samples in 69.4 s.Collecting 53 more samples in 68.2 s.Collecting 52 more samples in 66.9 s.Collecting 51 more samples in 65.6 s.Collecting 50 more samples in 64.3 s.Collecting 49 more samples in 63.0 s.Collecting 48 more samples in 61.7 s.Collecting 47 more samples in 60.4 s.Collecting 46 more samples in 59.1 s.Collecting 45 more samples in 57.9 s.Collecting 44 more samples in 56.6 s.Collecting 43 more samples in 55.3 s.Collecting 42 more samples in 54.0 s.Collecting 41 more samples in 52.7 s.Collecting 40 more samples in 51.4 s.Collecting 39 more samples in 50.1 s.Collecting 38 more samples in 48.9 s.Collecting 37 more samples in 47.6 s.Collecting 36 more samples in 46.3 s.Collecting 35 more samples in 45.0 s.Collecting 34 more samples in 43.7 s.Collecting 33 more samples in 42.4 s.Collecting 32 more samples in 41.1 s.Collecting 31 more samples in 39.9 s.Collecting 30 more samples in 38.6 s.Collecting 29 more samples in 37.3 s.Collecting 28 more samples in 36.0 s.Collecting 27 more samples in 34.7 s.Collecting 26 more samples in 33.4 s.Collecting 25 more samples in 32.1 s.Collecting 24 more samples in 30.9 s.Collecting 23 more samples in 29.6 s.Collecting 22 more samples in 28.3 s.Collecting 21 more samples in 27.0 s.Collecting 20 more samples in 25.7 s.Collecting 19 more samples in 24.4 s.Collecting 18 more samples in 23.1 s.Collecting 17 more samples in 21.9 s.Collecting 16 more samples in 20.6 s.Collecting 15 more samples in 19.3 s.Collecting 14 more samples in 18.0 s.Collecting 13 more samples in 16.7 s.Collecting 12 more samples in 15.4 s.Collecting 11 more samples in 14.1 s.Collecting 10 more samples in 12.9 s.Collecting 9 more samples in 11.6 s.Collecting 8 more samples in 10.3 s.Collecting 7 more samples in 9.0 s.Collecting 6 more samples in 7.7 s.Collecting 5 more samples in 6.4 s.Collecting 4 more samples in 5.1 s.Collecting 3 more samples in 3.9 s.Collecting 2 more samples in 2.6 s.Collecting 1 more samples in 1.3 s.mean: 1.303340 s, lower bound: 1.292114 s, upper bound: 1.314593 s, confidence: 0.950
std dev: 57.95301 ms, lower bound: 51.00190 ms, upper bound: 68.32291 ms, confidence: 0.950
found 1 outliers among 100 samples (1.0%)
variance introduced by outliers: 42.470%
variance is moderately inflated by outliers
commits: 200000
retries: 1167163
allocated bytes: 3587822648

Running a subject "10/20000/stm-containers"
Collecting 99 more samples in 58.9 s.Collecting 98 more samples in 58.3 s.Collecting 97 more samples in 57.7 s.Collecting 96 more samples in 57.1 s.Collecting 95 more samples in 56.5 s.Collecting 94 more samples in 55.9 s.Collecting 93 more samples in 55.3 s.Collecting 92 more samples in 54.7 s.Collecting 91 more samples in 54.1 s.Collecting 90 more samples in 53.5 s.Collecting 89 more samples in 52.9 s.Collecting 88 more samples in 52.3 s.Collecting 87 more samples in 51.7 s.Collecting 86 more samples in 51.1 s.Collecting 85 more samples in 50.5 s.Collecting 84 more samples in 49.9 s.Collecting 83 more samples in 49.4 s.Collecting 82 more samples in 48.8 s.Collecting 81 more samples in 48.2 s.Collecting 80 more samples in 47.6 s.Collecting 79 more samples in 47.0 s.Collecting 78 more samples in 46.4 s.Collecting 77 more samples in 45.8 s.Collecting 76 more samples in 45.2 s.Collecting 75 more samples in 44.6 s.Collecting 74 more samples in 44.0 s.Collecting 73 more samples in 43.4 s.Collecting 72 more samples in 42.8 s.Collecting 71 more samples in 42.2 s.Collecting 70 more samples in 41.6 s.Collecting 69 more samples in 41.0 s.Collecting 68 more samples in 40.4 s.Collecting 67 more samples in 39.8 s.Collecting 66 more samples in 39.2 s.Collecting 65 more samples in 38.6 s.Collecting 64 more samples in 38.1 s.Collecting 63 more samples in 37.5 s.Collecting 62 more samples in 36.9 s.Collecting 61 more samples in 36.3 s.Collecting 60 more samples in 35.7 s.Collecting 59 more samples in 35.1 s.Collecting 58 more samples in 34.5 s.Collecting 57 more samples in 33.9 s.Collecting 56 more samples in 33.3 s.Collecting 55 more samples in 32.7 s.Collecting 54 more samples in 32.1 s.Collecting 53 more samples in 31.5 s.Collecting 52 more samples in 30.9 s.Collecting 51 more samples in 30.3 s.Collecting 50 more samples in 29.7 s.Collecting 49 more samples in 29.1 s.Collecting 48 more samples in 28.5 s.Collecting 47 more samples in 27.9 s.Collecting 46 more samples in 27.4 s.Collecting 45 more samples in 26.8 s.Collecting 44 more samples in 26.2 s.Collecting 43 more samples in 25.6 s.Collecting 42 more samples in 25.0 s.Collecting 41 more samples in 24.4 s.Collecting 40 more samples in 23.8 s.Collecting 39 more samples in 23.2 s.Collecting 38 more samples in 22.6 s.Collecting 37 more samples in 22.0 s.Collecting 36 more samples in 21.4 s.Collecting 35 more samples in 20.8 s.Collecting 34 more samples in 20.2 s.Collecting 33 more samples in 19.6 s.Collecting 32 more samples in 19.0 s.Collecting 31 more samples in 18.4 s.Collecting 30 more samples in 17.8 s.Collecting 29 more samples in 17.2 s.Collecting 28 more samples in 16.6 s.Collecting 27 more samples in 16.1 s.Collecting 26 more samples in 15.5 s.Collecting 25 more samples in 14.9 s.Collecting 24 more samples in 14.3 s.Collecting 23 more samples in 13.7 s.Collecting 22 more samples in 13.1 s.Collecting 21 more samples in 12.5 s.Collecting 20 more samples in 11.9 s.Collecting 19 more samples in 11.3 s.Collecting 18 more samples in 10.7 s.Collecting 17 more samples in 10.1 s.Collecting 16 more samples in 9.5 s.Collecting 15 more samples in 8.9 s.Collecting 14 more samples in 8.3 s.Collecting 13 more samples in 7.7 s.Collecting 12 more samples in 7.1 s.Collecting 11 more samples in 6.5 s.Collecting 10 more samples in 5.9 s.Collecting 9 more samples in 5.4 s.Collecting 8 more samples in 4.8 s.Collecting 7 more samples in 4.2 s.Collecting 6 more samples in 3.6 s.Collecting 5 more samples in 3.0 s.Collecting 4 more samples in 2.4 s.Collecting 3 more samples in 1.8 s.Collecting 2 more samples in 1.2 s.Collecting 1 more samples in 0.6 s.mean: 588.7643 ms, lower bound: 576.1165 ms, upper bound: 600.7629 ms, confidence: 0.950
std dev: 62.99754 ms, lower bound: 55.48234 ms, upper bound: 71.62726 ms, confidence: 0.950
found 6 outliers among 100 samples (6.0%)
  4 (4.0%) low mild
  2 (2.0%) high mild
variance introduced by outliers: 81.082%
variance is severely inflated by outliers
commits: 200000
retries: 1569
allocated bytes: 906513464

Running a subject "10/20000/ttrie"
Collecting 100 more samples in 17.7 s.Collecting 99 more samples in 17.5 s.Collecting 98 more samples in 17.3 s.Collecting 97 more samples in 17.1 s.Collecting 96 more samples in 17.0 s.Collecting 95 more samples in 16.8 s.Collecting 94 more samples in 16.6 s.Collecting 93 more samples in 16.4 s.Collecting 92 more samples in 16.2 s.Collecting 91 more samples in 16.1 s.Collecting 90 more samples in 15.9 s.Collecting 89 more samples in 15.7 s.Collecting 88 more samples in 15.5 s.Collecting 87 more samples in 15.4 s.Collecting 86 more samples in 15.2 s.Collecting 85 more samples in 15.0 s.Collecting 84 more samples in 14.8 s.Collecting 83 more samples in 14.7 s.Collecting 82 more samples in 14.5 s.Collecting 81 more samples in 14.3 s.Collecting 80 more samples in 14.1 s.Collecting 79 more samples in 13.9 s.Collecting 78 more samples in 13.8 s.Collecting 77 more samples in 13.6 s.Collecting 76 more samples in 13.4 s.Collecting 75 more samples in 13.2 s.Collecting 74 more samples in 13.1 s.Collecting 73 more samples in 12.9 s.Collecting 72 more samples in 12.7 s.Collecting 71 more samples in 12.5 s.Collecting 70 more samples in 12.4 s.Collecting 69 more samples in 12.2 s.Collecting 68 more samples in 12.0 s.Collecting 67 more samples in 11.8 s.Collecting 66 more samples in 11.7 s.Collecting 65 more samples in 11.5 s.Collecting 64 more samples in 11.3 s.Collecting 63 more samples in 11.1 s.Collecting 62 more samples in 10.9 s.Collecting 61 more samples in 10.8 s.Collecting 60 more samples in 10.6 s.Collecting 59 more samples in 10.4 s.Collecting 58 more samples in 10.2 s.Collecting 57 more samples in 10.1 s.Collecting 56 more samples in 9.9 s.Collecting 55 more samples in 9.7 s.Collecting 54 more samples in 9.5 s.Collecting 53 more samples in 9.4 s.Collecting 52 more samples in 9.2 s.Collecting 51 more samples in 9.0 s.Collecting 50 more samples in 8.8 s.Collecting 49 more samples in 8.7 s.Collecting 48 more samples in 8.5 s.Collecting 47 more samples in 8.3 s.Collecting 46 more samples in 8.1 s.Collecting 45 more samples in 7.9 s.Collecting 44 more samples in 7.8 s.Collecting 43 more samples in 7.6 s.Collecting 42 more samples in 7.4 s.Collecting 41 more samples in 7.2 s.Collecting 40 more samples in 7.1 s.Collecting 39 more samples in 6.9 s.Collecting 38 more samples in 6.7 s.Collecting 37 more samples in 6.5 s.Collecting 36 more samples in 6.4 s.Collecting 35 more samples in 6.2 s.Collecting 34 more samples in 6.0 s.Collecting 33 more samples in 5.8 s.Collecting 32 more samples in 5.7 s.Collecting 31 more samples in 5.5 s.Collecting 30 more samples in 5.3 s.Collecting 29 more samples in 5.1 s.Collecting 28 more samples in 4.9 s.Collecting 27 more samples in 4.8 s.Collecting 26 more samples in 4.6 s.Collecting 25 more samples in 4.4 s.Collecting 24 more samples in 4.2 s.Collecting 23 more samples in 4.1 s.Collecting 22 more samples in 3.9 s.Collecting 21 more samples in 3.7 s.Collecting 20 more samples in 3.5 s.Collecting 19 more samples in 3.4 s.Collecting 18 more samples in 3.2 s.Collecting 17 more samples in 3.0 s.Collecting 16 more samples in 2.8 s.Collecting 15 more samples in 2.6 s.Collecting 14 more samples in 2.5 s.Collecting 13 more samples in 2.3 s.Collecting 12 more samples in 2.1 s.Collecting 11 more samples in 1.9 s.Collecting 10 more samples in 1.8 s.Collecting 9 more samples in 1.6 s.Collecting 8 more samples in 1.4 s.Collecting 7 more samples in 1.2 s.Collecting 6 more samples in 1.1 s.Collecting 5 more samples in 0.9 s.Collecting 4 more samples in 0.7 s.Collecting 3 more samples in 0.5 s.Collecting 2 more samples in 0.4 s.Collecting 1 more samples in 0.2 s.mean: 145.8977 ms, lower bound: 143.5511 ms, upper bound: 150.3067 ms, confidence: 0.950
std dev: 16.00549 ms, lower bound: 9.951897 ms, upper bound: 28.02562 ms, confidence: 0.950
found 21 outliers among 100 samples (21.0%)
  3 (3.0%) low mild
  10 (10.0%) high mild
  8 (8.0%) high severe
variance introduced by outliers: 82.106%
variance is severely inflated by outliers
commits: 200000
retries: 1
allocated bytes: 225310432

Running a subject "12/16666/unordered-containers"
Collecting 99 more samples in 141.4 s.Collecting 98 more samples in 140.0 s.Collecting 97 more samples in 138.6 s.Collecting 96 more samples in 137.2 s.Collecting 95 more samples in 135.7 s.Collecting 94 more samples in 134.3 s.Collecting 93 more samples in 132.9 s.Collecting 92 more samples in 131.4 s.Collecting 91 more samples in 130.0 s.Collecting 90 more samples in 128.6 s.Collecting 89 more samples in 127.2 s.Collecting 88 more samples in 125.7 s.Collecting 87 more samples in 124.3 s.Collecting 86 more samples in 122.9 s.Collecting 85 more samples in 121.4 s.Collecting 84 more samples in 120.0 s.Collecting 83 more samples in 118.6 s.Collecting 82 more samples in 117.2 s.Collecting 81 more samples in 115.7 s.Collecting 80 more samples in 114.3 s.Collecting 79 more samples in 112.9 s.Collecting 78 more samples in 111.4 s.Collecting 77 more samples in 110.0 s.Collecting 76 more samples in 108.6 s.Collecting 75 more samples in 107.2 s.Collecting 74 more samples in 105.7 s.Collecting 73 more samples in 104.3 s.Collecting 72 more samples in 102.9 s.Collecting 71 more samples in 101.4 s.Collecting 70 more samples in 100.0 s.Collecting 69 more samples in 98.6 s.Collecting 68 more samples in 97.2 s.Collecting 67 more samples in 95.7 s.Collecting 66 more samples in 94.3 s.Collecting 65 more samples in 92.9 s.Collecting 64 more samples in 91.4 s.Collecting 63 more samples in 90.0 s.Collecting 62 more samples in 88.6 s.Collecting 61 more samples in 87.1 s.Collecting 60 more samples in 85.7 s.Collecting 59 more samples in 84.3 s.Collecting 58 more samples in 82.9 s.Collecting 57 more samples in 81.4 s.Collecting 56 more samples in 80.0 s.Collecting 55 more samples in 78.6 s.Collecting 54 more samples in 77.1 s.Collecting 53 more samples in 75.7 s.Collecting 52 more samples in 74.3 s.Collecting 51 more samples in 72.9 s.Collecting 50 more samples in 71.4 s.Collecting 49 more samples in 70.0 s.Collecting 48 more samples in 68.6 s.Collecting 47 more samples in 67.1 s.Collecting 46 more samples in 65.7 s.Collecting 45 more samples in 64.3 s.Collecting 44 more samples in 62.9 s.Collecting 43 more samples in 61.4 s.Collecting 42 more samples in 60.0 s.Collecting 41 more samples in 58.6 s.Collecting 40 more samples in 57.1 s.Collecting 39 more samples in 55.7 s.Collecting 38 more samples in 54.3 s.Collecting 37 more samples in 52.9 s.Collecting 36 more samples in 51.4 s.Collecting 35 more samples in 50.0 s.Collecting 34 more samples in 48.6 s.Collecting 33 more samples in 47.1 s.Collecting 32 more samples in 45.7 s.Collecting 31 more samples in 44.3 s.Collecting 30 more samples in 42.9 s.Collecting 29 more samples in 41.4 s.Collecting 28 more samples in 40.0 s.Collecting 27 more samples in 38.6 s.Collecting 26 more samples in 37.1 s.Collecting 25 more samples in 35.7 s.Collecting 24 more samples in 34.3 s.Collecting 23 more samples in 32.9 s.Collecting 22 more samples in 31.4 s.Collecting 21 more samples in 30.0 s.Collecting 20 more samples in 28.6 s.Collecting 19 more samples in 27.1 s.Collecting 18 more samples in 25.7 s.Collecting 17 more samples in 24.3 s.Collecting 16 more samples in 22.9 s.Collecting 15 more samples in 21.4 s.Collecting 14 more samples in 20.0 s.Collecting 13 more samples in 18.6 s.Collecting 12 more samples in 17.1 s.Collecting 11 more samples in 15.7 s.Collecting 10 more samples in 14.3 s.Collecting 9 more samples in 12.9 s.Collecting 8 more samples in 11.4 s.Collecting 7 more samples in 10.0 s.Collecting 6 more samples in 8.6 s.Collecting 5 more samples in 7.1 s.Collecting 4 more samples in 5.7 s.Collecting 3 more samples in 4.3 s.Collecting 2 more samples in 2.9 s.Collecting 1 more samples in 1.4 s.mean: 1.328674 s, lower bound: 1.314875 s, upper bound: 1.345947 s, confidence: 0.950
std dev: 79.07591 ms, lower bound: 65.04512 ms, upper bound: 112.4040 ms, confidence: 0.950
found 2 outliers among 100 samples (2.0%)
  1 (1.0%) high severe
variance introduced by outliers: 56.516%
variance is severely inflated by outliers
commits: 200000
retries: 1268381
allocated bytes: 3624447016

Running a subject "12/16666/stm-containers"
Collecting 99 more samples in 52.3 s.Collecting 98 more samples in 51.8 s.Collecting 97 more samples in 51.3 s.Collecting 96 more samples in 50.7 s.Collecting 95 more samples in 50.2 s.Collecting 94 more samples in 49.7 s.Collecting 93 more samples in 49.1 s.Collecting 92 more samples in 48.6 s.Collecting 91 more samples in 48.1 s.Collecting 90 more samples in 47.6 s.Collecting 89 more samples in 47.0 s.Collecting 88 more samples in 46.5 s.Collecting 87 more samples in 46.0 s.Collecting 86 more samples in 45.4 s.Collecting 85 more samples in 44.9 s.Collecting 84 more samples in 44.4 s.Collecting 83 more samples in 43.9 s.Collecting 82 more samples in 43.3 s.Collecting 81 more samples in 42.8 s.Collecting 80 more samples in 42.3 s.Collecting 79 more samples in 41.7 s.Collecting 78 more samples in 41.2 s.Collecting 77 more samples in 40.7 s.Collecting 76 more samples in 40.2 s.Collecting 75 more samples in 39.6 s.Collecting 74 more samples in 39.1 s.Collecting 73 more samples in 38.6 s.Collecting 72 more samples in 38.0 s.Collecting 71 more samples in 37.5 s.Collecting 70 more samples in 37.0 s.Collecting 69 more samples in 36.5 s.Collecting 68 more samples in 35.9 s.Collecting 67 more samples in 35.4 s.Collecting 66 more samples in 34.9 s.Collecting 65 more samples in 34.3 s.Collecting 64 more samples in 33.8 s.Collecting 63 more samples in 33.3 s.Collecting 62 more samples in 32.8 s.Collecting 61 more samples in 32.2 s.Collecting 60 more samples in 31.7 s.Collecting 59 more samples in 31.2 s.Collecting 58 more samples in 30.6 s.Collecting 57 more samples in 30.1 s.Collecting 56 more samples in 29.6 s.Collecting 55 more samples in 29.1 s.Collecting 54 more samples in 28.5 s.Collecting 53 more samples in 28.0 s.Collecting 52 more samples in 27.5 s.Collecting 51 more samples in 26.9 s.Collecting 50 more samples in 26.4 s.Collecting 49 more samples in 25.9 s.Collecting 48 more samples in 25.4 s.Collecting 47 more samples in 24.8 s.Collecting 46 more samples in 24.3 s.Collecting 45 more samples in 23.8 s.Collecting 44 more samples in 23.2 s.Collecting 43 more samples in 22.7 s.Collecting 42 more samples in 22.2 s.Collecting 41 more samples in 21.7 s.Collecting 40 more samples in 21.1 s.Collecting 39 more samples in 20.6 s.Collecting 38 more samples in 20.1 s.Collecting 37 more samples in 19.5 s.Collecting 36 more samples in 19.0 s.Collecting 35 more samples in 18.5 s.Collecting 34 more samples in 18.0 s.Collecting 33 more samples in 17.4 s.Collecting 32 more samples in 16.9 s.Collecting 31 more samples in 16.4 s.Collecting 30 more samples in 15.9 s.Collecting 29 more samples in 15.3 s.Collecting 28 more samples in 14.8 s.Collecting 27 more samples in 14.3 s.Collecting 26 more samples in 13.7 s.Collecting 25 more samples in 13.2 s.Collecting 24 more samples in 12.7 s.Collecting 23 more samples in 12.2 s.Collecting 22 more samples in 11.6 s.Collecting 21 more samples in 11.1 s.Collecting 20 more samples in 10.6 s.Collecting 19 more samples in 10.0 s.Collecting 18 more samples in 9.5 s.Collecting 17 more samples in 9.0 s.Collecting 16 more samples in 8.5 s.Collecting 15 more samples in 7.9 s.Collecting 14 more samples in 7.4 s.Collecting 13 more samples in 6.9 s.Collecting 12 more samples in 6.3 s.Collecting 11 more samples in 5.8 s.Collecting 10 more samples in 5.3 s.Collecting 9 more samples in 4.8 s.Collecting 8 more samples in 4.2 s.Collecting 7 more samples in 3.7 s.Collecting 6 more samples in 3.2 s.Collecting 5 more samples in 2.6 s.Collecting 4 more samples in 2.1 s.Collecting 3 more samples in 1.6 s.Collecting 2 more samples in 1.1 s.Collecting 1 more samples in 0.5 s.mean: 564.5360 ms, lower bound: 549.5780 ms, upper bound: 592.6511 ms, confidence: 0.950
std dev: 101.2594 ms, lower bound: 64.61140 ms, upper bound: 192.4210 ms, confidence: 0.950
found 6 outliers among 100 samples (6.0%)
  5 (5.0%) high mild
  1 (1.0%) high severe
variance introduced by outliers: 92.580%
variance is severely inflated by outliers
commits: 200000
retries: 1773
allocated bytes: 906511000

Running a subject "12/16666/ttrie"
Collecting 100 more samples in 10.9 s.Collecting 99 more samples in 10.8 s.Collecting 98 more samples in 10.7 s.Collecting 97 more samples in 10.6 s.Collecting 96 more samples in 10.5 s.Collecting 95 more samples in 10.4 s.Collecting 94 more samples in 10.3 s.Collecting 93 more samples in 10.2 s.Collecting 92 more samples in 10.1 s.Collecting 91 more samples in 10.0 s.Collecting 90 more samples in 9.8 s.Collecting 89 more samples in 9.7 s.Collecting 88 more samples in 9.6 s.Collecting 87 more samples in 9.5 s.Collecting 86 more samples in 9.4 s.Collecting 85 more samples in 9.3 s.Collecting 84 more samples in 9.2 s.Collecting 83 more samples in 9.1 s.Collecting 82 more samples in 9.0 s.Collecting 81 more samples in 8.9 s.Collecting 80 more samples in 8.7 s.Collecting 79 more samples in 8.6 s.Collecting 78 more samples in 8.5 s.Collecting 77 more samples in 8.4 s.Collecting 76 more samples in 8.3 s.Collecting 75 more samples in 8.2 s.Collecting 74 more samples in 8.1 s.Collecting 73 more samples in 8.0 s.Collecting 72 more samples in 7.9 s.Collecting 71 more samples in 7.8 s.Collecting 70 more samples in 7.7 s.Collecting 69 more samples in 7.5 s.Collecting 68 more samples in 7.4 s.Collecting 67 more samples in 7.3 s.Collecting 66 more samples in 7.2 s.Collecting 65 more samples in 7.1 s.Collecting 64 more samples in 7.0 s.Collecting 63 more samples in 6.9 s.Collecting 62 more samples in 6.8 s.Collecting 61 more samples in 6.7 s.Collecting 60 more samples in 6.6 s.Collecting 59 more samples in 6.5 s.Collecting 58 more samples in 6.3 s.Collecting 57 more samples in 6.2 s.Collecting 56 more samples in 6.1 s.Collecting 55 more samples in 6.0 s.Collecting 54 more samples in 5.9 s.Collecting 53 more samples in 5.8 s.Collecting 52 more samples in 5.7 s.Collecting 51 more samples in 5.6 s.Collecting 50 more samples in 5.5 s.Collecting 49 more samples in 5.4 s.Collecting 48 more samples in 5.2 s.Collecting 47 more samples in 5.1 s.Collecting 46 more samples in 5.0 s.Collecting 45 more samples in 4.9 s.Collecting 44 more samples in 4.8 s.Collecting 43 more samples in 4.7 s.Collecting 42 more samples in 4.6 s.Collecting 41 more samples in 4.5 s.Collecting 40 more samples in 4.4 s.Collecting 39 more samples in 4.3 s.Collecting 38 more samples in 4.2 s.Collecting 37 more samples in 4.0 s.Collecting 36 more samples in 3.9 s.Collecting 35 more samples in 3.8 s.Collecting 34 more samples in 3.7 s.Collecting 33 more samples in 3.6 s.Collecting 32 more samples in 3.5 s.Collecting 31 more samples in 3.4 s.Collecting 30 more samples in 3.3 s.Collecting 29 more samples in 3.2 s.Collecting 28 more samples in 3.1 s.Collecting 27 more samples in 3.0 s.Collecting 26 more samples in 2.8 s.Collecting 25 more samples in 2.7 s.Collecting 24 more samples in 2.6 s.Collecting 23 more samples in 2.5 s.Collecting 22 more samples in 2.4 s.Collecting 21 more samples in 2.3 s.Collecting 20 more samples in 2.2 s.Collecting 19 more samples in 2.1 s.Collecting 18 more samples in 2.0 s.Collecting 17 more samples in 1.9 s.Collecting 16 more samples in 1.7 s.Collecting 15 more samples in 1.6 s.Collecting 14 more samples in 1.5 s.Collecting 13 more samples in 1.4 s.Collecting 12 more samples in 1.3 s.Collecting 11 more samples in 1.2 s.Collecting 10 more samples in 1.1 s.Collecting 9 more samples in 1.0 s.Collecting 8 more samples in 0.9 s.Collecting 7 more samples in 0.8 s.Collecting 6 more samples in 0.7 s.Collecting 5 more samples in 0.5 s.Collecting 4 more samples in 0.4 s.Collecting 3 more samples in 0.3 s.Collecting 2 more samples in 0.2 s.Collecting 1 more samples in 0.1 s.mean: 135.3412 ms, lower bound: 132.0677 ms, upper bound: 139.4819 ms, confidence: 0.950
std dev: 18.77769 ms, lower bound: 15.28008 ms, upper bound: 23.24364 ms, confidence: 0.950
found 8 outliers among 100 samples (8.0%)
  5 (5.0%) high mild
  3 (3.0%) high severe
variance introduced by outliers: 88.357%
variance is severely inflated by outliers
commits: 200000
retries: 3
allocated bytes: 225316312

Running a subject "14/14285/unordered-containers"
Collecting 99 more samples in 137.9 s.Collecting 98 more samples in 136.5 s.Collecting 97 more samples in 135.1 s.Collecting 96 more samples in 133.7 s.Collecting 95 more samples in 132.3 s.Collecting 94 more samples in 130.9 s.Collecting 93 more samples in 129.5 s.Collecting 92 more samples in 128.1 s.Collecting 91 more samples in 126.7 s.Collecting 90 more samples in 125.3 s.Collecting 89 more samples in 123.9 s.Collecting 88 more samples in 122.5 s.Collecting 87 more samples in 121.2 s.Collecting 86 more samples in 119.8 s.Collecting 85 more samples in 118.4 s.Collecting 84 more samples in 117.0 s.Collecting 83 more samples in 115.6 s.Collecting 82 more samples in 114.2 s.Collecting 81 more samples in 112.8 s.Collecting 80 more samples in 111.4 s.Collecting 79 more samples in 110.0 s.Collecting 78 more samples in 108.6 s.Collecting 77 more samples in 107.2 s.Collecting 76 more samples in 105.8 s.Collecting 75 more samples in 104.4 s.Collecting 74 more samples in 103.1 s.Collecting 73 more samples in 101.7 s.Collecting 72 more samples in 100.3 s.Collecting 71 more samples in 98.9 s.Collecting 70 more samples in 97.5 s.Collecting 69 more samples in 96.1 s.Collecting 68 more samples in 94.7 s.Collecting 67 more samples in 93.3 s.Collecting 66 more samples in 91.9 s.Collecting 65 more samples in 90.5 s.Collecting 64 more samples in 89.1 s.Collecting 63 more samples in 87.7 s.Collecting 62 more samples in 86.3 s.Collecting 61 more samples in 84.9 s.Collecting 60 more samples in 83.6 s.Collecting 59 more samples in 82.2 s.Collecting 58 more samples in 80.8 s.Collecting 57 more samples in 79.4 s.Collecting 56 more samples in 78.0 s.Collecting 55 more samples in 76.6 s.Collecting 54 more samples in 75.2 s.Collecting 53 more samples in 73.8 s.Collecting 52 more samples in 72.4 s.Collecting 51 more samples in 71.0 s.Collecting 50 more samples in 69.6 s.Collecting 49 more samples in 68.2 s.Collecting 48 more samples in 66.8 s.Collecting 47 more samples in 65.5 s.Collecting 46 more samples in 64.1 s.Collecting 45 more samples in 62.7 s.Collecting 44 more samples in 61.3 s.Collecting 43 more samples in 59.9 s.Collecting 42 more samples in 58.5 s.Collecting 41 more samples in 57.1 s.Collecting 40 more samples in 55.7 s.Collecting 39 more samples in 54.3 s.Collecting 38 more samples in 52.9 s.Collecting 37 more samples in 51.5 s.Collecting 36 more samples in 50.1 s.Collecting 35 more samples in 48.7 s.Collecting 34 more samples in 47.3 s.Collecting 33 more samples in 46.0 s.Collecting 32 more samples in 44.6 s.Collecting 31 more samples in 43.2 s.Collecting 30 more samples in 41.8 s.Collecting 29 more samples in 40.4 s.Collecting 28 more samples in 39.0 s.Collecting 27 more samples in 37.6 s.Collecting 26 more samples in 36.2 s.Collecting 25 more samples in 34.8 s.Collecting 24 more samples in 33.4 s.Collecting 23 more samples in 32.0 s.Collecting 22 more samples in 30.6 s.Collecting 21 more samples in 29.2 s.Collecting 20 more samples in 27.9 s.Collecting 19 more samples in 26.5 s.Collecting 18 more samples in 25.1 s.Collecting 17 more samples in 23.7 s.Collecting 16 more samples in 22.3 s.Collecting 15 more samples in 20.9 s.Collecting 14 more samples in 19.5 s.Collecting 13 more samples in 18.1 s.Collecting 12 more samples in 16.7 s.Collecting 11 more samples in 15.3 s.Collecting 10 more samples in 13.9 s.Collecting 9 more samples in 12.5 s.Collecting 8 more samples in 11.1 s.Collecting 7 more samples in 9.7 s.Collecting 6 more samples in 8.4 s.Collecting 5 more samples in 7.0 s.Collecting 4 more samples in 5.6 s.Collecting 3 more samples in 4.2 s.Collecting 2 more samples in 2.8 s.Collecting 1 more samples in 1.4 s.mean: 1.346246 s, lower bound: 1.328777 s, upper bound: 1.366442 s, confidence: 0.950
std dev: 95.96352 ms, lower bound: 80.75532 ms, upper bound: 118.6759 ms, confidence: 0.950
found 3 outliers among 100 samples (3.0%)
  3 (3.0%) high mild
variance introduced by outliers: 65.620%
variance is severely inflated by outliers
commits: 200000
retries: 1343853
allocated bytes: 3763570800

Running a subject "14/14285/stm-containers"
Collecting 99 more samples in 62.8 s.Collecting 98 more samples in 62.2 s.Collecting 97 more samples in 61.6 s.Collecting 96 more samples in 60.9 s.Collecting 95 more samples in 60.3 s.Collecting 94 more samples in 59.7 s.Collecting 93 more samples in 59.0 s.Collecting 92 more samples in 58.4 s.Collecting 91 more samples in 57.8 s.Collecting 90 more samples in 57.1 s.Collecting 89 more samples in 56.5 s.Collecting 88 more samples in 55.9 s.Collecting 87 more samples in 55.2 s.Collecting 86 more samples in 54.6 s.Collecting 85 more samples in 54.0 s.Collecting 84 more samples in 53.3 s.Collecting 83 more samples in 52.7 s.Collecting 82 more samples in 52.0 s.Collecting 81 more samples in 51.4 s.Collecting 80 more samples in 50.8 s.Collecting 79 more samples in 50.1 s.Collecting 78 more samples in 49.5 s.Collecting 77 more samples in 48.9 s.Collecting 76 more samples in 48.2 s.Collecting 75 more samples in 47.6 s.Collecting 74 more samples in 47.0 s.Collecting 73 more samples in 46.3 s.Collecting 72 more samples in 45.7 s.Collecting 71 more samples in 45.1 s.Collecting 70 more samples in 44.4 s.Collecting 69 more samples in 43.8 s.Collecting 68 more samples in 43.2 s.Collecting 67 more samples in 42.5 s.Collecting 66 more samples in 41.9 s.Collecting 65 more samples in 41.3 s.Collecting 64 more samples in 40.6 s.Collecting 63 more samples in 40.0 s.Collecting 62 more samples in 39.4 s.Collecting 61 more samples in 38.7 s.Collecting 60 more samples in 38.1 s.Collecting 59 more samples in 37.4 s.Collecting 58 more samples in 36.8 s.Collecting 57 more samples in 36.2 s.Collecting 56 more samples in 35.5 s.Collecting 55 more samples in 34.9 s.Collecting 54 more samples in 34.3 s.Collecting 53 more samples in 33.6 s.Collecting 52 more samples in 33.0 s.Collecting 51 more samples in 32.4 s.Collecting 50 more samples in 31.7 s.Collecting 49 more samples in 31.1 s.Collecting 48 more samples in 30.5 s.Collecting 47 more samples in 29.8 s.Collecting 46 more samples in 29.2 s.Collecting 45 more samples in 28.6 s.Collecting 44 more samples in 27.9 s.Collecting 43 more samples in 27.3 s.Collecting 42 more samples in 26.7 s.Collecting 41 more samples in 26.0 s.Collecting 40 more samples in 25.4 s.Collecting 39 more samples in 24.8 s.Collecting 38 more samples in 24.1 s.Collecting 37 more samples in 23.5 s.Collecting 36 more samples in 22.9 s.Collecting 35 more samples in 22.2 s.Collecting 34 more samples in 21.6 s.Collecting 33 more samples in 20.9 s.Collecting 32 more samples in 20.3 s.Collecting 31 more samples in 19.7 s.Collecting 30 more samples in 19.0 s.Collecting 29 more samples in 18.4 s.Collecting 28 more samples in 17.8 s.Collecting 27 more samples in 17.1 s.Collecting 26 more samples in 16.5 s.Collecting 25 more samples in 15.9 s.Collecting 24 more samples in 15.2 s.Collecting 23 more samples in 14.6 s.Collecting 22 more samples in 14.0 s.Collecting 21 more samples in 13.3 s.Collecting 20 more samples in 12.7 s.Collecting 19 more samples in 12.1 s.Collecting 18 more samples in 11.4 s.Collecting 17 more samples in 10.8 s.Collecting 16 more samples in 10.2 s.Collecting 15 more samples in 9.5 s.Collecting 14 more samples in 8.9 s.Collecting 13 more samples in 8.3 s.Collecting 12 more samples in 7.6 s.Collecting 11 more samples in 7.0 s.Collecting 10 more samples in 6.3 s.Collecting 9 more samples in 5.7 s.Collecting 8 more samples in 5.1 s.Collecting 7 more samples in 4.4 s.Collecting 6 more samples in 3.8 s.Collecting 5 more samples in 3.2 s.Collecting 4 more samples in 2.5 s.Collecting 3 more samples in 1.9 s.Collecting 2 more samples in 1.3 s.Collecting 1 more samples in 0.6 s.mean: 528.0993 ms, lower bound: 515.2986 ms, upper bound: 541.4020 ms, confidence: 0.950
std dev: 67.21256 ms, lower bound: 58.18035 ms, upper bound: 80.81952 ms, confidence: 0.950
found 5 outliers among 100 samples (5.0%)
  3 (3.0%) low mild
  2 (2.0%) high mild
variance introduced by outliers: 86.270%
variance is severely inflated by outliers
commits: 200000
retries: 1970
allocated bytes: 907308784

Running a subject "14/14285/ttrie"
Collecting 100 more samples in 12.6 s.Collecting 99 more samples in 12.5 s.Collecting 98 more samples in 12.4 s.Collecting 97 more samples in 12.2 s.Collecting 96 more samples in 12.1 s.Collecting 95 more samples in 12.0 s.Collecting 94 more samples in 11.9 s.Collecting 93 more samples in 11.7 s.Collecting 92 more samples in 11.6 s.Collecting 91 more samples in 11.5 s.Collecting 90 more samples in 11.4 s.Collecting 89 more samples in 11.2 s.Collecting 88 more samples in 11.1 s.Collecting 87 more samples in 11.0 s.Collecting 86 more samples in 10.9 s.Collecting 85 more samples in 10.7 s.Collecting 84 more samples in 10.6 s.Collecting 83 more samples in 10.5 s.Collecting 82 more samples in 10.4 s.Collecting 81 more samples in 10.2 s.Collecting 80 more samples in 10.1 s.Collecting 79 more samples in 10.0 s.Collecting 78 more samples in 9.8 s.Collecting 77 more samples in 9.7 s.Collecting 76 more samples in 9.6 s.Collecting 75 more samples in 9.5 s.Collecting 74 more samples in 9.3 s.Collecting 73 more samples in 9.2 s.Collecting 72 more samples in 9.1 s.Collecting 71 more samples in 9.0 s.Collecting 70 more samples in 8.8 s.Collecting 69 more samples in 8.7 s.Collecting 68 more samples in 8.6 s.Collecting 67 more samples in 8.5 s.Collecting 66 more samples in 8.3 s.Collecting 65 more samples in 8.2 s.Collecting 64 more samples in 8.1 s.Collecting 63 more samples in 8.0 s.Collecting 62 more samples in 7.8 s.Collecting 61 more samples in 7.7 s.Collecting 60 more samples in 7.6 s.Collecting 59 more samples in 7.5 s.Collecting 58 more samples in 7.3 s.Collecting 57 more samples in 7.2 s.Collecting 56 more samples in 7.1 s.Collecting 55 more samples in 6.9 s.Collecting 54 more samples in 6.8 s.Collecting 53 more samples in 6.7 s.Collecting 52 more samples in 6.6 s.Collecting 51 more samples in 6.4 s.Collecting 50 more samples in 6.3 s.Collecting 49 more samples in 6.2 s.Collecting 48 more samples in 6.1 s.Collecting 47 more samples in 5.9 s.Collecting 46 more samples in 5.8 s.Collecting 45 more samples in 5.7 s.Collecting 44 more samples in 5.6 s.Collecting 43 more samples in 5.4 s.Collecting 42 more samples in 5.3 s.Collecting 41 more samples in 5.2 s.Collecting 40 more samples in 5.1 s.Collecting 39 more samples in 4.9 s.Collecting 38 more samples in 4.8 s.Collecting 37 more samples in 4.7 s.Collecting 36 more samples in 4.5 s.Collecting 35 more samples in 4.4 s.Collecting 34 more samples in 4.3 s.Collecting 33 more samples in 4.2 s.Collecting 32 more samples in 4.0 s.Collecting 31 more samples in 3.9 s.Collecting 30 more samples in 3.8 s.Collecting 29 more samples in 3.7 s.Collecting 28 more samples in 3.5 s.Collecting 27 more samples in 3.4 s.Collecting 26 more samples in 3.3 s.Collecting 25 more samples in 3.2 s.Collecting 24 more samples in 3.0 s.Collecting 23 more samples in 2.9 s.Collecting 22 more samples in 2.8 s.Collecting 21 more samples in 2.7 s.Collecting 20 more samples in 2.5 s.Collecting 19 more samples in 2.4 s.Collecting 18 more samples in 2.3 s.Collecting 17 more samples in 2.1 s.Collecting 16 more samples in 2.0 s.Collecting 15 more samples in 1.9 s.Collecting 14 more samples in 1.8 s.Collecting 13 more samples in 1.6 s.Collecting 12 more samples in 1.5 s.Collecting 11 more samples in 1.4 s.Collecting 10 more samples in 1.3 s.Collecting 9 more samples in 1.1 s.Collecting 8 more samples in 1.0 s.Collecting 7 more samples in 0.9 s.Collecting 6 more samples in 0.8 s.Collecting 5 more samples in 0.6 s.Collecting 4 more samples in 0.5 s.Collecting 3 more samples in 0.4 s.Collecting 2 more samples in 0.3 s.Collecting 1 more samples in 0.1 s.mean: 115.5058 ms, lower bound: 112.5713 ms, upper bound: 119.1186 ms, confidence: 0.950
std dev: 16.70131 ms, lower bound: 13.99821 ms, upper bound: 20.07350 ms, confidence: 0.950
found 10 outliers among 100 samples (10.0%)
  8 (8.0%) high mild
  2 (2.0%) high severe
variance introduced by outliers: 89.395%
variance is severely inflated by outliers
commits: 200000
retries: 5
allocated bytes: 225324712

Running a subject "16/12500/unordered-containers"
Collecting 99 more samples in 149.1 s.Collecting 98 more samples in 147.6 s.Collecting 97 more samples in 146.1 s.Collecting 96 more samples in 144.6 s.Collecting 95 more samples in 143.1 s.Collecting 94 more samples in 141.6 s.Collecting 93 more samples in 140.1 s.Collecting 92 more samples in 138.6 s.Collecting 91 more samples in 137.1 s.Collecting 90 more samples in 135.6 s.Collecting 89 more samples in 134.1 s.Collecting 88 more samples in 132.6 s.Collecting 87 more samples in 131.0 s.Collecting 86 more samples in 129.5 s.Collecting 85 more samples in 128.0 s.Collecting 84 more samples in 126.5 s.Collecting 83 more samples in 125.0 s.Collecting 82 more samples in 123.5 s.Collecting 81 more samples in 122.0 s.Collecting 80 more samples in 120.5 s.Collecting 79 more samples in 119.0 s.Collecting 78 more samples in 117.5 s.Collecting 77 more samples in 116.0 s.Collecting 76 more samples in 114.5 s.Collecting 75 more samples in 113.0 s.Collecting 74 more samples in 111.5 s.Collecting 73 more samples in 110.0 s.Collecting 72 more samples in 108.5 s.Collecting 71 more samples in 106.9 s.Collecting 70 more samples in 105.4 s.Collecting 69 more samples in 103.9 s.Collecting 68 more samples in 102.4 s.Collecting 67 more samples in 100.9 s.Collecting 66 more samples in 99.4 s.Collecting 65 more samples in 97.9 s.Collecting 64 more samples in 96.4 s.Collecting 63 more samples in 94.9 s.Collecting 62 more samples in 93.4 s.Collecting 61 more samples in 91.9 s.Collecting 60 more samples in 90.4 s.Collecting 59 more samples in 88.9 s.Collecting 58 more samples in 87.4 s.Collecting 57 more samples in 85.9 s.Collecting 56 more samples in 84.4 s.Collecting 55 more samples in 82.8 s.Collecting 54 more samples in 81.3 s.Collecting 53 more samples in 79.8 s.Collecting 52 more samples in 78.3 s.Collecting 51 more samples in 76.8 s.Collecting 50 more samples in 75.3 s.Collecting 49 more samples in 73.8 s.Collecting 48 more samples in 72.3 s.Collecting 47 more samples in 70.8 s.Collecting 46 more samples in 69.3 s.Collecting 45 more samples in 67.8 s.Collecting 44 more samples in 66.3 s.Collecting 43 more samples in 64.8 s.Collecting 42 more samples in 63.3 s.Collecting 41 more samples in 61.8 s.Collecting 40 more samples in 60.3 s.Collecting 39 more samples in 58.7 s.Collecting 38 more samples in 57.2 s.Collecting 37 more samples in 55.7 s.Collecting 36 more samples in 54.2 s.Collecting 35 more samples in 52.7 s.Collecting 34 more samples in 51.2 s.Collecting 33 more samples in 49.7 s.Collecting 32 more samples in 48.2 s.Collecting 31 more samples in 46.7 s.Collecting 30 more samples in 45.2 s.Collecting 29 more samples in 43.7 s.Collecting 28 more samples in 42.2 s.Collecting 27 more samples in 40.7 s.Collecting 26 more samples in 39.2 s.Collecting 25 more samples in 37.7 s.Collecting 24 more samples in 36.2 s.Collecting 23 more samples in 34.6 s.Collecting 22 more samples in 33.1 s.Collecting 21 more samples in 31.6 s.Collecting 20 more samples in 30.1 s.Collecting 19 more samples in 28.6 s.Collecting 18 more samples in 27.1 s.Collecting 17 more samples in 25.6 s.Collecting 16 more samples in 24.1 s.Collecting 15 more samples in 22.6 s.Collecting 14 more samples in 21.1 s.Collecting 13 more samples in 19.6 s.Collecting 12 more samples in 18.1 s.Collecting 11 more samples in 16.6 s.Collecting 10 more samples in 15.1 s.Collecting 9 more samples in 13.6 s.Collecting 8 more samples in 12.1 s.Collecting 7 more samples in 10.5 s.Collecting 6 more samples in 9.0 s.Collecting 5 more samples in 7.5 s.Collecting 4 more samples in 6.0 s.Collecting 3 more samples in 4.5 s.Collecting 2 more samples in 3.0 s.Collecting 1 more samples in 1.5 s.mean: 1.454235 s, lower bound: 1.429300 s, upper bound: 1.483455 s, confidence: 0.950
std dev: 138.0457 ms, lower bound: 115.1364 ms, upper bound: 169.7462 ms, confidence: 0.950
found 4 outliers among 100 samples (4.0%)
  4 (4.0%) high mild
variance introduced by outliers: 77.918%
variance is severely inflated by outliers
commits: 200000
retries: 1308767
allocated bytes: 3921268256

Running a subject "16/12500/stm-containers"
Collecting 99 more samples in 53.1 s.Collecting 98 more samples in 52.5 s.Collecting 97 more samples in 52.0 s.Collecting 96 more samples in 51.5 s.Collecting 95 more samples in 50.9 s.Collecting 94 more samples in 50.4 s.Collecting 93 more samples in 49.9 s.Collecting 92 more samples in 49.3 s.Collecting 91 more samples in 48.8 s.Collecting 90 more samples in 48.3 s.Collecting 89 more samples in 47.7 s.Collecting 88 more samples in 47.2 s.Collecting 87 more samples in 46.6 s.Collecting 86 more samples in 46.1 s.Collecting 85 more samples in 45.6 s.Collecting 84 more samples in 45.0 s.Collecting 83 more samples in 44.5 s.Collecting 82 more samples in 44.0 s.Collecting 81 more samples in 43.4 s.Collecting 80 more samples in 42.9 s.Collecting 79 more samples in 42.4 s.Collecting 78 more samples in 41.8 s.Collecting 77 more samples in 41.3 s.Collecting 76 more samples in 40.7 s.Collecting 75 more samples in 40.2 s.Collecting 74 more samples in 39.7 s.Collecting 73 more samples in 39.1 s.Collecting 72 more samples in 38.6 s.Collecting 71 more samples in 38.1 s.Collecting 70 more samples in 37.5 s.Collecting 69 more samples in 37.0 s.Collecting 68 more samples in 36.5 s.Collecting 67 more samples in 35.9 s.Collecting 66 more samples in 35.4 s.Collecting 65 more samples in 34.8 s.Collecting 64 more samples in 34.3 s.Collecting 63 more samples in 33.8 s.Collecting 62 more samples in 33.2 s.Collecting 61 more samples in 32.7 s.Collecting 60 more samples in 32.2 s.Collecting 59 more samples in 31.6 s.Collecting 58 more samples in 31.1 s.Collecting 57 more samples in 30.6 s.Collecting 56 more samples in 30.0 s.Collecting 55 more samples in 29.5 s.Collecting 54 more samples in 29.0 s.Collecting 53 more samples in 28.4 s.Collecting 52 more samples in 27.9 s.Collecting 51 more samples in 27.3 s.Collecting 50 more samples in 26.8 s.Collecting 49 more samples in 26.3 s.Collecting 48 more samples in 25.7 s.Collecting 47 more samples in 25.2 s.Collecting 46 more samples in 24.7 s.Collecting 45 more samples in 24.1 s.Collecting 44 more samples in 23.6 s.Collecting 43 more samples in 23.1 s.Collecting 42 more samples in 22.5 s.Collecting 41 more samples in 22.0 s.Collecting 40 more samples in 21.4 s.Collecting 39 more samples in 20.9 s.Collecting 38 more samples in 20.4 s.Collecting 37 more samples in 19.8 s.Collecting 36 more samples in 19.3 s.Collecting 35 more samples in 18.8 s.Collecting 34 more samples in 18.2 s.Collecting 33 more samples in 17.7 s.Collecting 32 more samples in 17.2 s.Collecting 31 more samples in 16.6 s.Collecting 30 more samples in 16.1 s.Collecting 29 more samples in 15.5 s.Collecting 28 more samples in 15.0 s.Collecting 27 more samples in 14.5 s.Collecting 26 more samples in 13.9 s.Collecting 25 more samples in 13.4 s.Collecting 24 more samples in 12.9 s.Collecting 23 more samples in 12.3 s.Collecting 22 more samples in 11.8 s.Collecting 21 more samples in 11.3 s.Collecting 20 more samples in 10.7 s.Collecting 19 more samples in 10.2 s.Collecting 18 more samples in 9.7 s.Collecting 17 more samples in 9.1 s.Collecting 16 more samples in 8.6 s.Collecting 15 more samples in 8.0 s.Collecting 14 more samples in 7.5 s.Collecting 13 more samples in 7.0 s.Collecting 12 more samples in 6.4 s.Collecting 11 more samples in 5.9 s.Collecting 10 more samples in 5.4 s.Collecting 9 more samples in 4.8 s.Collecting 8 more samples in 4.3 s.Collecting 7 more samples in 3.8 s.Collecting 6 more samples in 3.2 s.Collecting 5 more samples in 2.7 s.Collecting 4 more samples in 2.1 s.Collecting 3 more samples in 1.6 s.Collecting 2 more samples in 1.1 s.Collecting 1 more samples in 0.5 s.mean: 523.3142 ms, lower bound: 511.3289 ms, upper bound: 534.8000 ms, confidence: 0.950
std dev: 59.93379 ms, lower bound: 52.66852 ms, upper bound: 68.34505 ms, confidence: 0.950
found 5 outliers among 100 samples (5.0%)
  3 (3.0%) low mild
  2 (2.0%) high mild
variance introduced by outliers: 83.159%
variance is severely inflated by outliers
commits: 200000
retries: 2618
allocated bytes: 907958328

Running a subject "16/12500/ttrie"
Collecting 100 more samples in 15.8 s.Collecting 99 more samples in 15.6 s.Collecting 98 more samples in 15.5 s.Collecting 97 more samples in 15.3 s.Collecting 96 more samples in 15.1 s.Collecting 95 more samples in 15.0 s.Collecting 94 more samples in 14.8 s.Collecting 93 more samples in 14.7 s.Collecting 92 more samples in 14.5 s.Collecting 91 more samples in 14.3 s.Collecting 90 more samples in 14.2 s.Collecting 89 more samples in 14.0 s.Collecting 88 more samples in 13.9 s.Collecting 87 more samples in 13.7 s.Collecting 86 more samples in 13.6 s.Collecting 85 more samples in 13.4 s.Collecting 84 more samples in 13.2 s.Collecting 83 more samples in 13.1 s.Collecting 82 more samples in 12.9 s.Collecting 81 more samples in 12.8 s.Collecting 80 more samples in 12.6 s.Collecting 79 more samples in 12.5 s.Collecting 78 more samples in 12.3 s.Collecting 77 more samples in 12.1 s.Collecting 76 more samples in 12.0 s.Collecting 75 more samples in 11.8 s.Collecting 74 more samples in 11.7 s.Collecting 73 more samples in 11.5 s.Collecting 72 more samples in 11.4 s.Collecting 71 more samples in 11.2 s.Collecting 70 more samples in 11.0 s.Collecting 69 more samples in 10.9 s.Collecting 68 more samples in 10.7 s.Collecting 67 more samples in 10.6 s.Collecting 66 more samples in 10.4 s.Collecting 65 more samples in 10.2 s.Collecting 64 more samples in 10.1 s.Collecting 63 more samples in 9.9 s.Collecting 62 more samples in 9.8 s.Collecting 61 more samples in 9.6 s.Collecting 60 more samples in 9.5 s.Collecting 59 more samples in 9.3 s.Collecting 58 more samples in 9.1 s.Collecting 57 more samples in 9.0 s.Collecting 56 more samples in 8.8 s.Collecting 55 more samples in 8.7 s.Collecting 54 more samples in 8.5 s.Collecting 53 more samples in 8.4 s.Collecting 52 more samples in 8.2 s.Collecting 51 more samples in 8.0 s.Collecting 50 more samples in 7.9 s.Collecting 49 more samples in 7.7 s.Collecting 48 more samples in 7.6 s.Collecting 47 more samples in 7.4 s.Collecting 46 more samples in 7.3 s.Collecting 45 more samples in 7.1 s.Collecting 44 more samples in 6.9 s.Collecting 43 more samples in 6.8 s.Collecting 42 more samples in 6.6 s.Collecting 41 more samples in 6.5 s.Collecting 40 more samples in 6.3 s.Collecting 39 more samples in 6.1 s.Collecting 38 more samples in 6.0 s.Collecting 37 more samples in 5.8 s.Collecting 36 more samples in 5.7 s.Collecting 35 more samples in 5.5 s.Collecting 34 more samples in 5.4 s.Collecting 33 more samples in 5.2 s.Collecting 32 more samples in 5.0 s.Collecting 31 more samples in 4.9 s.Collecting 30 more samples in 4.7 s.Collecting 29 more samples in 4.6 s.Collecting 28 more samples in 4.4 s.Collecting 27 more samples in 4.3 s.Collecting 26 more samples in 4.1 s.Collecting 25 more samples in 3.9 s.Collecting 24 more samples in 3.8 s.Collecting 23 more samples in 3.6 s.Collecting 22 more samples in 3.5 s.Collecting 21 more samples in 3.3 s.Collecting 20 more samples in 3.2 s.Collecting 19 more samples in 3.0 s.Collecting 18 more samples in 2.8 s.Collecting 17 more samples in 2.7 s.Collecting 16 more samples in 2.5 s.Collecting 15 more samples in 2.4 s.Collecting 14 more samples in 2.2 s.Collecting 13 more samples in 2.0 s.Collecting 12 more samples in 1.9 s.Collecting 11 more samples in 1.7 s.Collecting 10 more samples in 1.6 s.Collecting 9 more samples in 1.4 s.Collecting 8 more samples in 1.3 s.Collecting 7 more samples in 1.1 s.Collecting 6 more samples in 0.9 s.Collecting 5 more samples in 0.8 s.Collecting 4 more samples in 0.6 s.Collecting 3 more samples in 0.5 s.Collecting 2 more samples in 0.3 s.Collecting 1 more samples in 0.2 s.mean: 109.3092 ms, lower bound: 106.5889 ms, upper bound: 113.1968 ms, confidence: 0.950
std dev: 16.55235 ms, lower bound: 12.61645 ms, upper bound: 23.30406 ms, confidence: 0.950
found 5 outliers among 100 samples (5.0%)
  2 (2.0%) high mild
  3 (3.0%) high severe
variance introduced by outliers: 90.436%
variance is severely inflated by outliers
commits: 200000
retries: 3
allocated bytes: 225323600
Benchmark bench: FINISH