Preprocessing library ttrie-0.1.2... In-place registering ttrie-0.1.2... Preprocessing benchmark 'bench' for ttrie-0.1.2... Running 1 benchmarks... Benchmark bench: RUNNING... threads = [1,2,4,6,8,10,12,14,16] numTransactions = 200000 sizes = [(1,1),(2,1),(3,1),(4,1),(5,1)] numPrefill = 1000000 ops = (25,25,25,25) Generating 1000000 random keys to prefill... Generating 200000 random transactions... warming up estimating clock resolution... mean is 1.710955 us (320001 iterations) found 27842 outliers among 319999 samples (8.7%) 30 (9.4e-3%) low severe 27812 (8.7%) high severe estimating cost of a clock call... mean is 198.9226 ns (11 iterations) Running a subject "1/200000/unordered-containers" Collecting 99 more samples in 183.2 s.Collecting 98 more samples in 181.3 s.Collecting 97 more samples in 179.5 s.Collecting 96 more samples in 177.6 s.Collecting 95 more samples in 175.8 s.Collecting 94 more samples in 173.9 s.Collecting 93 more samples in 172.1 s.Collecting 92 more samples in 170.2 s.Collecting 91 more samples in 168.4 s.Collecting 90 more samples in 166.5 s.Collecting 89 more samples in 164.7 s.Collecting 88 more samples in 162.8 s.Collecting 87 more samples in 161.0 s.Collecting 86 more samples in 159.1 s.Collecting 85 more samples in 157.3 s.Collecting 84 more samples in 155.4 s.Collecting 83 more samples in 153.6 s.Collecting 82 more samples in 151.7 s.Collecting 81 more samples in 149.9 s.Collecting 80 more samples in 148.0 s.Collecting 79 more samples in 146.2 s.Collecting 78 more samples in 144.3 s.Collecting 77 more samples in 142.5 s.Collecting 76 more samples in 140.6 s.Collecting 75 more samples in 138.8 s.Collecting 74 more samples in 136.9 s.Collecting 73 more samples in 135.1 s.Collecting 72 more samples in 133.2 s.Collecting 71 more samples in 131.4 s.Collecting 70 more samples in 129.5 s.Collecting 69 more samples in 127.7 s.Collecting 68 more samples in 125.8 s.Collecting 67 more samples in 124.0 s.Collecting 66 more samples in 122.1 s.Collecting 65 more samples in 120.3 s.Collecting 64 more samples in 118.4 s.Collecting 63 more samples in 116.6 s.Collecting 62 more samples in 114.7 s.Collecting 61 more samples in 112.9 s.Collecting 60 more samples in 111.0 s.Collecting 59 more samples in 109.2 s.Collecting 58 more samples in 107.3 s.Collecting 57 more samples in 105.5 s.Collecting 56 more samples in 103.6 s.Collecting 55 more samples in 101.8 s.Collecting 54 more samples in 99.9 s.Collecting 53 more samples in 98.1 s.Collecting 52 more samples in 96.2 s.Collecting 51 more samples in 94.4 s.Collecting 50 more samples in 92.5 s.Collecting 49 more samples in 90.7 s.Collecting 48 more samples in 88.8 s.Collecting 47 more samples in 87.0 s.Collecting 46 more samples in 85.1 s.Collecting 45 more samples in 83.3 s.Collecting 44 more samples in 81.4 s.Collecting 43 more samples in 79.6 s.Collecting 42 more samples in 77.7 s.Collecting 41 more samples in 75.9 s.Collecting 40 more samples in 74.0 s.Collecting 39 more samples in 72.2 s.Collecting 38 more samples in 70.3 s.Collecting 37 more samples in 68.5 s.Collecting 36 more samples in 66.6 s.Collecting 35 more samples in 64.8 s.Collecting 34 more samples in 62.9 s.Collecting 33 more samples in 61.1 s.Collecting 32 more samples in 59.2 s.Collecting 31 more samples in 57.4 s.Collecting 30 more samples in 55.5 s.Collecting 29 more samples in 53.7 s.Collecting 28 more samples in 51.8 s.Collecting 27 more samples in 50.0 s.Collecting 26 more samples in 48.1 s.Collecting 25 more samples in 46.3 s.Collecting 24 more samples in 44.4 s.Collecting 23 more samples in 42.6 s.Collecting 22 more samples in 40.7 s.Collecting 21 more samples in 38.9 s.Collecting 20 more samples in 37.0 s.Collecting 19 more samples in 35.2 s.Collecting 18 more samples in 33.3 s.Collecting 17 more samples in 31.5 s.Collecting 16 more samples in 29.6 s.Collecting 15 more samples in 27.8 s.Collecting 14 more samples in 25.9 s.Collecting 13 more samples in 24.1 s.Collecting 12 more samples in 22.2 s.Collecting 11 more samples in 20.4 s.Collecting 10 more samples in 18.5 s.Collecting 9 more samples in 16.7 s.Collecting 8 more samples in 14.8 s.Collecting 7 more samples in 13.0 s.Collecting 6 more samples in 11.1 s.Collecting 5 more samples in 9.3 s.Collecting 4 more samples in 7.4 s.Collecting 3 more samples in 5.6 s.Collecting 2 more samples in 3.7 s.Collecting 1 more samples in 1.9 s.mean: 1.739956 s, lower bound: 1.679475 s, upper bound: 1.816434 s, confidence: 0.950 std dev: 345.9187 ms, lower bound: 282.4770 ms, upper bound: 427.5217 ms, confidence: 0.950 found 8 outliers among 100 samples (8.0%) 7 (7.0%) high mild 1 (1.0%) high severe variance introduced by outliers: 94.643% variance is severely inflated by outliers commits: 200000 retries: 0 allocated bytes: 281110656 Running a subject "1/200000/stm-containers" Collecting 99 more samples in 346.1 s.Collecting 98 more samples in 342.6 s.Collecting 97 more samples in 339.1 s.Collecting 96 more samples in 335.6 s.Collecting 95 more samples in 332.1 s.Collecting 94 more samples in 328.6 s.Collecting 93 more samples in 325.1 s.Collecting 92 more samples in 321.6 s.Collecting 91 more samples in 318.1 s.Collecting 90 more samples in 314.6 s.Collecting 89 more samples in 311.1 s.Collecting 88 more samples in 307.6 s.Collecting 87 more samples in 304.1 s.Collecting 86 more samples in 300.6 s.Collecting 85 more samples in 297.1 s.Collecting 84 more samples in 293.6 s.Collecting 83 more samples in 290.1 s.Collecting 82 more samples in 286.6 s.Collecting 81 more samples in 283.1 s.Collecting 80 more samples in 279.7 s.Collecting 79 more samples in 276.2 s.Collecting 78 more samples in 272.7 s.Collecting 77 more samples in 269.2 s.Collecting 76 more samples in 265.7 s.Collecting 75 more samples in 262.2 s.Collecting 74 more samples in 258.7 s.Collecting 73 more samples in 255.2 s.Collecting 72 more samples in 251.7 s.Collecting 71 more samples in 248.2 s.Collecting 70 more samples in 244.7 s.Collecting 69 more samples in 241.2 s.Collecting 68 more samples in 237.7 s.Collecting 67 more samples in 234.2 s.Collecting 66 more samples in 230.7 s.Collecting 65 more samples in 227.2 s.Collecting 64 more samples in 223.7 s.Collecting 63 more samples in 220.2 s.Collecting 62 more samples in 216.7 s.Collecting 61 more samples in 213.2 s.Collecting 60 more samples in 209.7 s.Collecting 59 more samples in 206.2 s.Collecting 58 more samples in 202.7 s.Collecting 57 more samples in 199.3 s.Collecting 56 more samples in 195.8 s.Collecting 55 more samples in 192.3 s.Collecting 54 more samples in 188.8 s.Collecting 53 more samples in 185.3 s.Collecting 52 more samples in 181.8 s.Collecting 51 more samples in 178.3 s.Collecting 50 more samples in 174.8 s.Collecting 49 more samples in 171.3 s.Collecting 48 more samples in 167.8 s.Collecting 47 more samples in 164.3 s.Collecting 46 more samples in 160.8 s.Collecting 45 more samples in 157.3 s.Collecting 44 more samples in 153.8 s.Collecting 43 more samples in 150.3 s.Collecting 42 more samples in 146.8 s.Collecting 41 more samples in 143.3 s.Collecting 40 more samples in 139.8 s.Collecting 39 more samples in 136.3 s.Collecting 38 more samples in 132.8 s.Collecting 37 more samples in 129.3 s.Collecting 36 more samples in 125.8 s.Collecting 35 more samples in 122.3 s.Collecting 34 more samples in 118.9 s.Collecting 33 more samples in 115.4 s.Collecting 32 more samples in 111.9 s.Collecting 31 more samples in 108.4 s.Collecting 30 more samples in 104.9 s.Collecting 29 more samples in 101.4 s.Collecting 28 more samples in 97.9 s.Collecting 27 more samples in 94.4 s.Collecting 26 more samples in 90.9 s.Collecting 25 more samples in 87.4 s.Collecting 24 more samples in 83.9 s.Collecting 23 more samples in 80.4 s.Collecting 22 more samples in 76.9 s.Collecting 21 more samples in 73.4 s.Collecting 20 more samples in 69.9 s.Collecting 19 more samples in 66.4 s.Collecting 18 more samples in 62.9 s.Collecting 17 more samples in 59.4 s.Collecting 16 more samples in 55.9 s.Collecting 15 more samples in 52.4 s.Collecting 14 more samples in 48.9 s.Collecting 13 more samples in 45.4 s.Collecting 12 more samples in 41.9 s.Collecting 11 more samples in 38.5 s.Collecting 10 more samples in 35.0 s.Collecting 9 more samples in 31.5 s.Collecting 8 more samples in 28.0 s.Collecting 7 more samples in 24.5 s.Collecting 6 more samples in 21.0 s.Collecting 5 more samples in 17.5 s.Collecting 4 more samples in 14.0 s.Collecting 3 more samples in 10.5 s.Collecting 2 more samples in 7.0 s.Collecting 1 more samples in 3.5 s.mean: 2.629407 s, lower bound: 2.584898 s, upper bound: 2.688000 s, confidence: 0.950 std dev: 261.3994 ms, lower bound: 208.2050 ms, upper bound: 324.0522 ms, confidence: 0.950 found 12 outliers among 100 samples (12.0%) 5 (5.0%) high mild 7 (7.0%) high severe variance introduced by outliers: 78.988% variance is severely inflated by outliers commits: 200000 retries: 0 allocated bytes: 830602904 Running a subject "1/200000/ttrie" Collecting 99 more samples in 126.6 s.Collecting 98 more samples in 125.3 s.Collecting 97 more samples in 124.0 s.Collecting 96 more samples in 122.7 s.Collecting 95 more samples in 121.4 s.Collecting 94 more samples in 120.2 s.Collecting 93 more samples in 118.9 s.Collecting 92 more samples in 117.6 s.Collecting 91 more samples in 116.3 s.Collecting 90 more samples in 115.1 s.Collecting 89 more samples in 113.8 s.Collecting 88 more samples in 112.5 s.Collecting 87 more samples in 111.2 s.Collecting 86 more samples in 109.9 s.Collecting 85 more samples in 108.7 s.Collecting 84 more samples in 107.4 s.Collecting 83 more samples in 106.1 s.Collecting 82 more samples in 104.8 s.Collecting 81 more samples in 103.6 s.Collecting 80 more samples in 102.3 s.Collecting 79 more samples in 101.0 s.Collecting 78 more samples in 99.7 s.Collecting 77 more samples in 98.4 s.Collecting 76 more samples in 97.2 s.Collecting 75 more samples in 95.9 s.Collecting 74 more samples in 94.6 s.Collecting 73 more samples in 93.3 s.Collecting 72 more samples in 92.0 s.Collecting 71 more samples in 90.8 s.Collecting 70 more samples in 89.5 s.Collecting 69 more samples in 88.2 s.Collecting 68 more samples in 86.9 s.Collecting 67 more samples in 85.7 s.Collecting 66 more samples in 84.4 s.Collecting 65 more samples in 83.1 s.Collecting 64 more samples in 81.8 s.Collecting 63 more samples in 80.5 s.Collecting 62 more samples in 79.3 s.Collecting 61 more samples in 78.0 s.Collecting 60 more samples in 76.7 s.Collecting 59 more samples in 75.4 s.Collecting 58 more samples in 74.1 s.Collecting 57 more samples in 72.9 s.Collecting 56 more samples in 71.6 s.Collecting 55 more samples in 70.3 s.Collecting 54 more samples in 69.0 s.Collecting 53 more samples in 67.8 s.Collecting 52 more samples in 66.5 s.Collecting 51 more samples in 65.2 s.Collecting 50 more samples in 63.9 s.Collecting 49 more samples in 62.6 s.Collecting 48 more samples in 61.4 s.Collecting 47 more samples in 60.1 s.Collecting 46 more samples in 58.8 s.Collecting 45 more samples in 57.5 s.Collecting 44 more samples in 56.2 s.Collecting 43 more samples in 55.0 s.Collecting 42 more samples in 53.7 s.Collecting 41 more samples in 52.4 s.Collecting 40 more samples in 51.1 s.Collecting 39 more samples in 49.9 s.Collecting 38 more samples in 48.6 s.Collecting 37 more samples in 47.3 s.Collecting 36 more samples in 46.0 s.Collecting 35 more samples in 44.7 s.Collecting 34 more samples in 43.5 s.Collecting 33 more samples in 42.2 s.Collecting 32 more samples in 40.9 s.Collecting 31 more samples in 39.6 s.Collecting 30 more samples in 38.4 s.Collecting 29 more samples in 37.1 s.Collecting 28 more samples in 35.8 s.Collecting 27 more samples in 34.5 s.Collecting 26 more samples in 33.2 s.Collecting 25 more samples in 32.0 s.Collecting 24 more samples in 30.7 s.Collecting 23 more samples in 29.4 s.Collecting 22 more samples in 28.1 s.Collecting 21 more samples in 26.8 s.Collecting 20 more samples in 25.6 s.Collecting 19 more samples in 24.3 s.Collecting 18 more samples in 23.0 s.Collecting 17 more samples in 21.7 s.Collecting 16 more samples in 20.5 s.Collecting 15 more samples in 19.2 s.Collecting 14 more samples in 17.9 s.Collecting 13 more samples in 16.6 s.Collecting 12 more samples in 15.3 s.Collecting 11 more samples in 14.1 s.Collecting 10 more samples in 12.8 s.Collecting 9 more samples in 11.5 s.Collecting 8 more samples in 10.2 s.Collecting 7 more samples in 8.9 s.Collecting 6 more samples in 7.7 s.Collecting 5 more samples in 6.4 s.Collecting 4 more samples in 5.1 s.Collecting 3 more samples in 3.8 s.Collecting 2 more samples in 2.6 s.Collecting 1 more samples in 1.3 s.mean: 1.254100 s, lower bound: 1.238850 s, upper bound: 1.269708 s, confidence: 0.950 std dev: 78.75346 ms, lower bound: 68.52228 ms, upper bound: 96.15285 ms, confidence: 0.950 found 2 outliers among 100 samples (2.0%) 2 (2.0%) high mild variance introduced by outliers: 59.526% variance is severely inflated by outliers commits: 200000 retries: 0 allocated bytes: 252606664 Running a subject "2/100000/unordered-containers" Collecting 99 more samples in 103.8 s.Collecting 98 more samples in 102.8 s.Collecting 97 more samples in 101.7 s.Collecting 96 more samples in 100.7 s.Collecting 95 more samples in 99.6 s.Collecting 94 more samples in 98.6 s.Collecting 93 more samples in 97.5 s.Collecting 92 more samples in 96.5 s.Collecting 91 more samples in 95.4 s.Collecting 90 more samples in 94.4 s.Collecting 89 more samples in 93.3 s.Collecting 88 more samples in 92.3 s.Collecting 87 more samples in 91.2 s.Collecting 86 more samples in 90.2 s.Collecting 85 more samples in 89.1 s.Collecting 84 more samples in 88.1 s.Collecting 83 more samples in 87.0 s.Collecting 82 more samples in 86.0 s.Collecting 81 more samples in 84.9 s.Collecting 80 more samples in 83.9 s.Collecting 79 more samples in 82.8 s.Collecting 78 more samples in 81.8 s.Collecting 77 more samples in 80.7 s.Collecting 76 more samples in 79.7 s.Collecting 75 more samples in 78.6 s.Collecting 74 more samples in 77.6 s.Collecting 73 more samples in 76.5 s.Collecting 72 more samples in 75.5 s.Collecting 71 more samples in 74.5 s.Collecting 70 more samples in 73.4 s.Collecting 69 more samples in 72.4 s.Collecting 68 more samples in 71.3 s.Collecting 67 more samples in 70.3 s.Collecting 66 more samples in 69.2 s.Collecting 65 more samples in 68.2 s.Collecting 64 more samples in 67.1 s.Collecting 63 more samples in 66.1 s.Collecting 62 more samples in 65.0 s.Collecting 61 more samples in 64.0 s.Collecting 60 more samples in 62.9 s.Collecting 59 more samples in 61.9 s.Collecting 58 more samples in 60.8 s.Collecting 57 more samples in 59.8 s.Collecting 56 more samples in 58.7 s.Collecting 55 more samples in 57.7 s.Collecting 54 more samples in 56.6 s.Collecting 53 more samples in 55.6 s.Collecting 52 more samples in 54.5 s.Collecting 51 more samples in 53.5 s.Collecting 50 more samples in 52.4 s.Collecting 49 more samples in 51.4 s.Collecting 48 more samples in 50.3 s.Collecting 47 more samples in 49.3 s.Collecting 46 more samples in 48.2 s.Collecting 45 more samples in 47.2 s.Collecting 44 more samples in 46.1 s.Collecting 43 more samples in 45.1 s.Collecting 42 more samples in 44.0 s.Collecting 41 more samples in 43.0 s.Collecting 40 more samples in 41.9 s.Collecting 39 more samples in 40.9 s.Collecting 38 more samples in 39.8 s.Collecting 37 more samples in 38.8 s.Collecting 36 more samples in 37.8 s.Collecting 35 more samples in 36.7 s.Collecting 34 more samples in 35.7 s.Collecting 33 more samples in 34.6 s.Collecting 32 more samples in 33.6 s.Collecting 31 more samples in 32.5 s.Collecting 30 more samples in 31.5 s.Collecting 29 more samples in 30.4 s.Collecting 28 more samples in 29.4 s.Collecting 27 more samples in 28.3 s.Collecting 26 more samples in 27.3 s.Collecting 25 more samples in 26.2 s.Collecting 24 more samples in 25.2 s.Collecting 23 more samples in 24.1 s.Collecting 22 more samples in 23.1 s.Collecting 21 more samples in 22.0 s.Collecting 20 more samples in 21.0 s.Collecting 19 more samples in 19.9 s.Collecting 18 more samples in 18.9 s.Collecting 17 more samples in 17.8 s.Collecting 16 more samples in 16.8 s.Collecting 15 more samples in 15.7 s.Collecting 14 more samples in 14.7 s.Collecting 13 more samples in 13.6 s.Collecting 12 more samples in 12.6 s.Collecting 11 more samples in 11.5 s.Collecting 10 more samples in 10.5 s.Collecting 9 more samples in 9.4 s.Collecting 8 more samples in 8.4 s.Collecting 7 more samples in 7.3 s.Collecting 6 more samples in 6.3 s.Collecting 5 more samples in 5.2 s.Collecting 4 more samples in 4.2 s.Collecting 3 more samples in 3.1 s.Collecting 2 more samples in 2.1 s.Collecting 1 more samples in 1.0 s.mean: 1.243785 s, lower bound: 1.205146 s, upper bound: 1.285989 s, confidence: 0.950 std dev: 205.8376 ms, lower bound: 185.7639 ms, upper bound: 231.0726 ms, confidence: 0.950 variance introduced by outliers: 91.517% variance is severely inflated by outliers commits: 200000 retries: 122433 allocated bytes: 550833400 Running a subject "2/100000/stm-containers" Collecting 99 more samples in 148.0 s.Collecting 98 more samples in 146.5 s.Collecting 97 more samples in 145.0 s.Collecting 96 more samples in 143.5 s.Collecting 95 more samples in 142.0 s.Collecting 94 more samples in 140.5 s.Collecting 93 more samples in 139.0 s.Collecting 92 more samples in 137.5 s.Collecting 91 more samples in 136.0 s.Collecting 90 more samples in 134.6 s.Collecting 89 more samples in 133.1 s.Collecting 88 more samples in 131.6 s.Collecting 87 more samples in 130.1 s.Collecting 86 more samples in 128.6 s.Collecting 85 more samples in 127.1 s.Collecting 84 more samples in 125.6 s.Collecting 83 more samples in 124.1 s.Collecting 82 more samples in 122.6 s.Collecting 81 more samples in 121.1 s.Collecting 80 more samples in 119.6 s.Collecting 79 more samples in 118.1 s.Collecting 78 more samples in 116.6 s.Collecting 77 more samples in 115.1 s.Collecting 76 more samples in 113.6 s.Collecting 75 more samples in 112.1 s.Collecting 74 more samples in 110.6 s.Collecting 73 more samples in 109.1 s.Collecting 72 more samples in 107.6 s.Collecting 71 more samples in 106.1 s.Collecting 70 more samples in 104.7 s.Collecting 69 more samples in 103.2 s.Collecting 68 more samples in 101.7 s.Collecting 67 more samples in 100.2 s.Collecting 66 more samples in 98.7 s.Collecting 65 more samples in 97.2 s.Collecting 64 more samples in 95.7 s.Collecting 63 more samples in 94.2 s.Collecting 62 more samples in 92.7 s.Collecting 61 more samples in 91.2 s.Collecting 60 more samples in 89.7 s.Collecting 59 more samples in 88.2 s.Collecting 58 more samples in 86.7 s.Collecting 57 more samples in 85.2 s.Collecting 56 more samples in 83.7 s.Collecting 55 more samples in 82.2 s.Collecting 54 more samples in 80.7 s.Collecting 53 more samples in 79.2 s.Collecting 52 more samples in 77.7 s.Collecting 51 more samples in 76.2 s.Collecting 50 more samples in 74.8 s.Collecting 49 more samples in 73.3 s.Collecting 48 more samples in 71.8 s.Collecting 47 more samples in 70.3 s.Collecting 46 more samples in 68.8 s.Collecting 45 more samples in 67.3 s.Collecting 44 more samples in 65.8 s.Collecting 43 more samples in 64.3 s.Collecting 42 more samples in 62.8 s.Collecting 41 more samples in 61.3 s.Collecting 40 more samples in 59.8 s.Collecting 39 more samples in 58.3 s.Collecting 38 more samples in 56.8 s.Collecting 37 more samples in 55.3 s.Collecting 36 more samples in 53.8 s.Collecting 35 more samples in 52.3 s.Collecting 34 more samples in 50.8 s.Collecting 33 more samples in 49.3 s.Collecting 32 more samples in 47.8 s.Collecting 31 more samples in 46.3 s.Collecting 30 more samples in 44.9 s.Collecting 29 more samples in 43.4 s.Collecting 28 more samples in 41.9 s.Collecting 27 more samples in 40.4 s.Collecting 26 more samples in 38.9 s.Collecting 25 more samples in 37.4 s.Collecting 24 more samples in 35.9 s.Collecting 23 more samples in 34.4 s.Collecting 22 more samples in 32.9 s.Collecting 21 more samples in 31.4 s.Collecting 20 more samples in 29.9 s.Collecting 19 more samples in 28.4 s.Collecting 18 more samples in 26.9 s.Collecting 17 more samples in 25.4 s.Collecting 16 more samples in 23.9 s.Collecting 15 more samples in 22.4 s.Collecting 14 more samples in 20.9 s.Collecting 13 more samples in 19.4 s.Collecting 12 more samples in 17.9 s.Collecting 11 more samples in 16.4 s.Collecting 10 more samples in 15.0 s.Collecting 9 more samples in 13.5 s.Collecting 8 more samples in 12.0 s.Collecting 7 more samples in 10.5 s.Collecting 6 more samples in 9.0 s.Collecting 5 more samples in 7.5 s.Collecting 4 more samples in 6.0 s.Collecting 3 more samples in 4.5 s.Collecting 2 more samples in 3.0 s.Collecting 1 more samples in 1.5 s.mean: 1.287130 s, lower bound: 1.267760 s, upper bound: 1.321700 s, confidence: 0.950 std dev: 129.5338 ms, lower bound: 75.60848 ms, upper bound: 208.7661 ms, confidence: 0.950 found 3 outliers among 100 samples (3.0%) 2 (2.0%) high severe variance introduced by outliers: 79.988% variance is severely inflated by outliers commits: 200000 retries: 68 allocated bytes: 826553472 Running a subject "2/100000/ttrie" Collecting 99 more samples in 58.4 s.Collecting 98 more samples in 57.8 s.Collecting 97 more samples in 57.2 s.Collecting 96 more samples in 56.6 s.Collecting 95 more samples in 56.0 s.Collecting 94 more samples in 55.4 s.Collecting 93 more samples in 54.8 s.Collecting 92 more samples in 54.3 s.Collecting 91 more samples in 53.7 s.Collecting 90 more samples in 53.1 s.Collecting 89 more samples in 52.5 s.Collecting 88 more samples in 51.9 s.Collecting 87 more samples in 51.3 s.Collecting 86 more samples in 50.7 s.Collecting 85 more samples in 50.1 s.Collecting 84 more samples in 49.5 s.Collecting 83 more samples in 48.9 s.Collecting 82 more samples in 48.4 s.Collecting 81 more samples in 47.8 s.Collecting 80 more samples in 47.2 s.Collecting 79 more samples in 46.6 s.Collecting 78 more samples in 46.0 s.Collecting 77 more samples in 45.4 s.Collecting 76 more samples in 44.8 s.Collecting 75 more samples in 44.2 s.Collecting 74 more samples in 43.6 s.Collecting 73 more samples in 43.0 s.Collecting 72 more samples in 42.5 s.Collecting 71 more samples in 41.9 s.Collecting 70 more samples in 41.3 s.Collecting 69 more samples in 40.7 s.Collecting 68 more samples in 40.1 s.Collecting 67 more samples in 39.5 s.Collecting 66 more samples in 38.9 s.Collecting 65 more samples in 38.3 s.Collecting 64 more samples in 37.7 s.Collecting 63 more samples in 37.2 s.Collecting 62 more samples in 36.6 s.Collecting 61 more samples in 36.0 s.Collecting 60 more samples in 35.4 s.Collecting 59 more samples in 34.8 s.Collecting 58 more samples in 34.2 s.Collecting 57 more samples in 33.6 s.Collecting 56 more samples in 33.0 s.Collecting 55 more samples in 32.4 s.Collecting 54 more samples in 31.8 s.Collecting 53 more samples in 31.3 s.Collecting 52 more samples in 30.7 s.Collecting 51 more samples in 30.1 s.Collecting 50 more samples in 29.5 s.Collecting 49 more samples in 28.9 s.Collecting 48 more samples in 28.3 s.Collecting 47 more samples in 27.7 s.Collecting 46 more samples in 27.1 s.Collecting 45 more samples in 26.5 s.Collecting 44 more samples in 25.9 s.Collecting 43 more samples in 25.4 s.Collecting 42 more samples in 24.8 s.Collecting 41 more samples in 24.2 s.Collecting 40 more samples in 23.6 s.Collecting 39 more samples in 23.0 s.Collecting 38 more samples in 22.4 s.Collecting 37 more samples in 21.8 s.Collecting 36 more samples in 21.2 s.Collecting 35 more samples in 20.6 s.Collecting 34 more samples in 20.1 s.Collecting 33 more samples in 19.5 s.Collecting 32 more samples in 18.9 s.Collecting 31 more samples in 18.3 s.Collecting 30 more samples in 17.7 s.Collecting 29 more samples in 17.1 s.Collecting 28 more samples in 16.5 s.Collecting 27 more samples in 15.9 s.Collecting 26 more samples in 15.3 s.Collecting 25 more samples in 14.7 s.Collecting 24 more samples in 14.2 s.Collecting 23 more samples in 13.6 s.Collecting 22 more samples in 13.0 s.Collecting 21 more samples in 12.4 s.Collecting 20 more samples in 11.8 s.Collecting 19 more samples in 11.2 s.Collecting 18 more samples in 10.6 s.Collecting 17 more samples in 10.0 s.Collecting 16 more samples in 9.4 s.Collecting 15 more samples in 8.8 s.Collecting 14 more samples in 8.3 s.Collecting 13 more samples in 7.7 s.Collecting 12 more samples in 7.1 s.Collecting 11 more samples in 6.5 s.Collecting 10 more samples in 5.9 s.Collecting 9 more samples in 5.3 s.Collecting 8 more samples in 4.7 s.Collecting 7 more samples in 4.1 s.Collecting 6 more samples in 3.5 s.Collecting 5 more samples in 2.9 s.Collecting 4 more samples in 2.4 s.Collecting 3 more samples in 1.8 s.Collecting 2 more samples in 1.2 s.Collecting 1 more samples in 0.6 s.mean: 660.6599 ms, lower bound: 648.8509 ms, upper bound: 672.9090 ms, confidence: 0.950 std dev: 61.61479 ms, lower bound: 56.33686 ms, upper bound: 68.49579 ms, confidence: 0.950 variance introduced by outliers: 76.907% variance is severely inflated by outliers commits: 200000 retries: 0 allocated bytes: 252648584 Running a subject "4/50000/unordered-containers" Collecting 99 more samples in 98.4 s.Collecting 98 more samples in 97.4 s.Collecting 97 more samples in 96.5 s.Collecting 96 more samples in 95.5 s.Collecting 95 more samples in 94.5 s.Collecting 94 more samples in 93.5 s.Collecting 93 more samples in 92.5 s.Collecting 92 more samples in 91.5 s.Collecting 91 more samples in 90.5 s.Collecting 90 more samples in 89.5 s.Collecting 89 more samples in 88.5 s.Collecting 88 more samples in 87.5 s.Collecting 87 more samples in 86.5 s.Collecting 86 more samples in 85.5 s.Collecting 85 more samples in 84.5 s.Collecting 84 more samples in 83.5 s.Collecting 83 more samples in 82.5 s.Collecting 82 more samples in 81.5 s.Collecting 81 more samples in 80.5 s.Collecting 80 more samples in 79.5 s.Collecting 79 more samples in 78.6 s.Collecting 78 more samples in 77.6 s.Collecting 77 more samples in 76.6 s.Collecting 76 more samples in 75.6 s.Collecting 75 more samples in 74.6 s.Collecting 74 more samples in 73.6 s.Collecting 73 more samples in 72.6 s.Collecting 72 more samples in 71.6 s.Collecting 71 more samples in 70.6 s.Collecting 70 more samples in 69.6 s.Collecting 69 more samples in 68.6 s.Collecting 68 more samples in 67.6 s.Collecting 67 more samples in 66.6 s.Collecting 66 more samples in 65.6 s.Collecting 65 more samples in 64.6 s.Collecting 64 more samples in 63.6 s.Collecting 63 more samples in 62.6 s.Collecting 62 more samples in 61.6 s.Collecting 61 more samples in 60.7 s.Collecting 60 more samples in 59.7 s.Collecting 59 more samples in 58.7 s.Collecting 58 more samples in 57.7 s.Collecting 57 more samples in 56.7 s.Collecting 56 more samples in 55.7 s.Collecting 55 more samples in 54.7 s.Collecting 54 more samples in 53.7 s.Collecting 53 more samples in 52.7 s.Collecting 52 more samples in 51.7 s.Collecting 51 more samples in 50.7 s.Collecting 50 more samples in 49.7 s.Collecting 49 more samples in 48.7 s.Collecting 48 more samples in 47.7 s.Collecting 47 more samples in 46.7 s.Collecting 46 more samples in 45.7 s.Collecting 45 more samples in 44.7 s.Collecting 44 more samples in 43.8 s.Collecting 43 more samples in 42.8 s.Collecting 42 more samples in 41.8 s.Collecting 41 more samples in 40.8 s.Collecting 40 more samples in 39.8 s.Collecting 39 more samples in 38.8 s.Collecting 38 more samples in 37.8 s.Collecting 37 more samples in 36.8 s.Collecting 36 more samples in 35.8 s.Collecting 35 more samples in 34.8 s.Collecting 34 more samples in 33.8 s.Collecting 33 more samples in 32.8 s.Collecting 32 more samples in 31.8 s.Collecting 31 more samples in 30.8 s.Collecting 30 more samples in 29.8 s.Collecting 29 more samples in 28.8 s.Collecting 28 more samples in 27.8 s.Collecting 27 more samples in 26.8 s.Collecting 26 more samples in 25.9 s.Collecting 25 more samples in 24.9 s.Collecting 24 more samples in 23.9 s.Collecting 23 more samples in 22.9 s.Collecting 22 more samples in 21.9 s.Collecting 21 more samples in 20.9 s.Collecting 20 more samples in 19.9 s.Collecting 19 more samples in 18.9 s.Collecting 18 more samples in 17.9 s.Collecting 17 more samples in 16.9 s.Collecting 16 more samples in 15.9 s.Collecting 15 more samples in 14.9 s.Collecting 14 more samples in 13.9 s.Collecting 13 more samples in 12.9 s.Collecting 12 more samples in 11.9 s.Collecting 11 more samples in 10.9 s.Collecting 10 more samples in 9.9 s.Collecting 9 more samples in 8.9 s.Collecting 8 more samples in 8.0 s.Collecting 7 more samples in 7.0 s.Collecting 6 more samples in 6.0 s.Collecting 5 more samples in 5.0 s.Collecting 4 more samples in 4.0 s.Collecting 3 more samples in 3.0 s.Collecting 2 more samples in 2.0 s.Collecting 1 more samples in 1.0 s.mean: 1.008245 s, lower bound: 984.0660 ms, upper bound: 1.035419 s, confidence: 0.950 std dev: 131.3167 ms, lower bound: 108.5867 ms, upper bound: 160.5884 ms, confidence: 0.950 found 12 outliers among 100 samples (12.0%) 4 (4.0%) low mild 5 (5.0%) high mild 3 (3.0%) high severe variance introduced by outliers: 87.287% variance is severely inflated by outliers commits: 200000 retries: 349156 allocated bytes: 1027697296 Running a subject "4/50000/stm-containers" Collecting 99 more samples in 80.7 s.Collecting 98 more samples in 79.9 s.Collecting 97 more samples in 79.1 s.Collecting 96 more samples in 78.3 s.Collecting 95 more samples in 77.5 s.Collecting 94 more samples in 76.6 s.Collecting 93 more samples in 75.8 s.Collecting 92 more samples in 75.0 s.Collecting 91 more samples in 74.2 s.Collecting 90 more samples in 73.4 s.Collecting 89 more samples in 72.6 s.Collecting 88 more samples in 71.7 s.Collecting 87 more samples in 70.9 s.Collecting 86 more samples in 70.1 s.Collecting 85 more samples in 69.3 s.Collecting 84 more samples in 68.5 s.Collecting 83 more samples in 67.7 s.Collecting 82 more samples in 66.9 s.Collecting 81 more samples in 66.0 s.Collecting 80 more samples in 65.2 s.Collecting 79 more samples in 64.4 s.Collecting 78 more samples in 63.6 s.Collecting 77 more samples in 62.8 s.Collecting 76 more samples in 62.0 s.Collecting 75 more samples in 61.1 s.Collecting 74 more samples in 60.3 s.Collecting 73 more samples in 59.5 s.Collecting 72 more samples in 58.7 s.Collecting 71 more samples in 57.9 s.Collecting 70 more samples in 57.1 s.Collecting 69 more samples in 56.3 s.Collecting 68 more samples in 55.4 s.Collecting 67 more samples in 54.6 s.Collecting 66 more samples in 53.8 s.Collecting 65 more samples in 53.0 s.Collecting 64 more samples in 52.2 s.Collecting 63 more samples in 51.4 s.Collecting 62 more samples in 50.5 s.Collecting 61 more samples in 49.7 s.Collecting 60 more samples in 48.9 s.Collecting 59 more samples in 48.1 s.Collecting 58 more samples in 47.3 s.Collecting 57 more samples in 46.5 s.Collecting 56 more samples in 45.7 s.Collecting 55 more samples in 44.8 s.Collecting 54 more samples in 44.0 s.Collecting 53 more samples in 43.2 s.Collecting 52 more samples in 42.4 s.Collecting 51 more samples in 41.6 s.Collecting 50 more samples in 40.8 s.Collecting 49 more samples in 40.0 s.Collecting 48 more samples in 39.1 s.Collecting 47 more samples in 38.3 s.Collecting 46 more samples in 37.5 s.Collecting 45 more samples in 36.7 s.Collecting 44 more samples in 35.9 s.Collecting 43 more samples in 35.1 s.Collecting 42 more samples in 34.2 s.Collecting 41 more samples in 33.4 s.Collecting 40 more samples in 32.6 s.Collecting 39 more samples in 31.8 s.Collecting 38 more samples in 31.0 s.Collecting 37 more samples in 30.2 s.Collecting 36 more samples in 29.4 s.Collecting 35 more samples in 28.5 s.Collecting 34 more samples in 27.7 s.Collecting 33 more samples in 26.9 s.Collecting 32 more samples in 26.1 s.Collecting 31 more samples in 25.3 s.Collecting 30 more samples in 24.5 s.Collecting 29 more samples in 23.6 s.Collecting 28 more samples in 22.8 s.Collecting 27 more samples in 22.0 s.Collecting 26 more samples in 21.2 s.Collecting 25 more samples in 20.4 s.Collecting 24 more samples in 19.6 s.Collecting 23 more samples in 18.8 s.Collecting 22 more samples in 17.9 s.Collecting 21 more samples in 17.1 s.Collecting 20 more samples in 16.3 s.Collecting 19 more samples in 15.5 s.Collecting 18 more samples in 14.7 s.Collecting 17 more samples in 13.9 s.Collecting 16 more samples in 13.0 s.Collecting 15 more samples in 12.2 s.Collecting 14 more samples in 11.4 s.Collecting 13 more samples in 10.6 s.Collecting 12 more samples in 9.8 s.Collecting 11 more samples in 9.0 s.Collecting 10 more samples in 8.2 s.Collecting 9 more samples in 7.3 s.Collecting 8 more samples in 6.5 s.Collecting 7 more samples in 5.7 s.Collecting 6 more samples in 4.9 s.Collecting 5 more samples in 4.1 s.Collecting 4 more samples in 3.3 s.Collecting 3 more samples in 2.4 s.Collecting 2 more samples in 1.6 s.Collecting 1 more samples in 0.8 s.mean: 900.5115 ms, lower bound: 870.2652 ms, upper bound: 932.3042 ms, confidence: 0.950 std dev: 159.7153 ms, lower bound: 138.6221 ms, upper bound: 204.1130 ms, confidence: 0.950 found 1 outliers among 100 samples (1.0%) 1 (1.0%) high severe variance introduced by outliers: 92.570% variance is severely inflated by outliers commits: 200000 retries: 380 allocated bytes: 824736736 Running a subject "4/50000/ttrie" Collecting 99 more samples in 36.5 s.Collecting 98 more samples in 36.1 s.Collecting 97 more samples in 35.7 s.Collecting 96 more samples in 35.3 s.Collecting 95 more samples in 35.0 s.Collecting 94 more samples in 34.6 s.Collecting 93 more samples in 34.2 s.Collecting 92 more samples in 33.9 s.Collecting 91 more samples in 33.5 s.Collecting 90 more samples in 33.1 s.Collecting 89 more samples in 32.8 s.Collecting 88 more samples in 32.4 s.Collecting 87 more samples in 32.0 s.Collecting 86 more samples in 31.7 s.Collecting 85 more samples in 31.3 s.Collecting 84 more samples in 30.9 s.Collecting 83 more samples in 30.6 s.Collecting 82 more samples in 30.2 s.Collecting 81 more samples in 29.8 s.Collecting 80 more samples in 29.5 s.Collecting 79 more samples in 29.1 s.Collecting 78 more samples in 28.7 s.Collecting 77 more samples in 28.4 s.Collecting 76 more samples in 28.0 s.Collecting 75 more samples in 27.6 s.Collecting 74 more samples in 27.2 s.Collecting 73 more samples in 26.9 s.Collecting 72 more samples in 26.5 s.Collecting 71 more samples in 26.1 s.Collecting 70 more samples in 25.8 s.Collecting 69 more samples in 25.4 s.Collecting 68 more samples in 25.0 s.Collecting 67 more samples in 24.7 s.Collecting 66 more samples in 24.3 s.Collecting 65 more samples in 23.9 s.Collecting 64 more samples in 23.6 s.Collecting 63 more samples in 23.2 s.Collecting 62 more samples in 22.8 s.Collecting 61 more samples in 22.5 s.Collecting 60 more samples in 22.1 s.Collecting 59 more samples in 21.7 s.Collecting 58 more samples in 21.4 s.Collecting 57 more samples in 21.0 s.Collecting 56 more samples in 20.6 s.Collecting 55 more samples in 20.3 s.Collecting 54 more samples in 19.9 s.Collecting 53 more samples in 19.5 s.Collecting 52 more samples in 19.1 s.Collecting 51 more samples in 18.8 s.Collecting 50 more samples in 18.4 s.Collecting 49 more samples in 18.0 s.Collecting 48 more samples in 17.7 s.Collecting 47 more samples in 17.3 s.Collecting 46 more samples in 16.9 s.Collecting 45 more samples in 16.6 s.Collecting 44 more samples in 16.2 s.Collecting 43 more samples in 15.8 s.Collecting 42 more samples in 15.5 s.Collecting 41 more samples in 15.1 s.Collecting 40 more samples in 14.7 s.Collecting 39 more samples in 14.4 s.Collecting 38 more samples in 14.0 s.Collecting 37 more samples in 13.6 s.Collecting 36 more samples in 13.3 s.Collecting 35 more samples in 12.9 s.Collecting 34 more samples in 12.5 s.Collecting 33 more samples in 12.2 s.Collecting 32 more samples in 11.8 s.Collecting 31 more samples in 11.4 s.Collecting 30 more samples in 11.0 s.Collecting 29 more samples in 10.7 s.Collecting 28 more samples in 10.3 s.Collecting 27 more samples in 9.9 s.Collecting 26 more samples in 9.6 s.Collecting 25 more samples in 9.2 s.Collecting 24 more samples in 8.8 s.Collecting 23 more samples in 8.5 s.Collecting 22 more samples in 8.1 s.Collecting 21 more samples in 7.7 s.Collecting 20 more samples in 7.4 s.Collecting 19 more samples in 7.0 s.Collecting 18 more samples in 6.6 s.Collecting 17 more samples in 6.3 s.Collecting 16 more samples in 5.9 s.Collecting 15 more samples in 5.5 s.Collecting 14 more samples in 5.2 s.Collecting 13 more samples in 4.8 s.Collecting 12 more samples in 4.4 s.Collecting 11 more samples in 4.1 s.Collecting 10 more samples in 3.7 s.Collecting 9 more samples in 3.3 s.Collecting 8 more samples in 2.9 s.Collecting 7 more samples in 2.6 s.Collecting 6 more samples in 2.2 s.Collecting 5 more samples in 1.8 s.Collecting 4 more samples in 1.5 s.Collecting 3 more samples in 1.1 s.Collecting 2 more samples in 0.7 s.Collecting 1 more samples in 0.4 s.mean: 375.9436 ms, lower bound: 372.4649 ms, upper bound: 382.4699 ms, confidence: 0.950 std dev: 23.64318 ms, lower bound: 14.38237 ms, upper bound: 42.47453 ms, confidence: 0.950 found 4 outliers among 100 samples (4.0%) 2 (2.0%) high severe variance introduced by outliers: 59.530% variance is severely inflated by outliers commits: 200000 retries: 1 allocated bytes: 252688832 Running a subject "6/33333/unordered-containers" Collecting 99 more samples in 112.0 s.Collecting 98 more samples in 110.9 s.Collecting 97 more samples in 109.7 s.Collecting 96 more samples in 108.6 s.Collecting 95 more samples in 107.5 s.Collecting 94 more samples in 106.3 s.Collecting 93 more samples in 105.2 s.Collecting 92 more samples in 104.1 s.Collecting 91 more samples in 102.9 s.Collecting 90 more samples in 101.8 s.Collecting 89 more samples in 100.7 s.Collecting 88 more samples in 99.5 s.Collecting 87 more samples in 98.4 s.Collecting 86 more samples in 97.3 s.Collecting 85 more samples in 96.2 s.Collecting 84 more samples in 95.0 s.Collecting 83 more samples in 93.9 s.Collecting 82 more samples in 92.8 s.Collecting 81 more samples in 91.6 s.Collecting 80 more samples in 90.5 s.Collecting 79 more samples in 89.4 s.Collecting 78 more samples in 88.2 s.Collecting 77 more samples in 87.1 s.Collecting 76 more samples in 86.0 s.Collecting 75 more samples in 84.8 s.Collecting 74 more samples in 83.7 s.Collecting 73 more samples in 82.6 s.Collecting 72 more samples in 81.4 s.Collecting 71 more samples in 80.3 s.Collecting 70 more samples in 79.2 s.Collecting 69 more samples in 78.1 s.Collecting 68 more samples in 76.9 s.Collecting 67 more samples in 75.8 s.Collecting 66 more samples in 74.7 s.Collecting 65 more samples in 73.5 s.Collecting 64 more samples in 72.4 s.Collecting 63 more samples in 71.3 s.Collecting 62 more samples in 70.1 s.Collecting 61 more samples in 69.0 s.Collecting 60 more samples in 67.9 s.Collecting 59 more samples in 66.7 s.Collecting 58 more samples in 65.6 s.Collecting 57 more samples in 64.5 s.Collecting 56 more samples in 63.3 s.Collecting 55 more samples in 62.2 s.Collecting 54 more samples in 61.1 s.Collecting 53 more samples in 60.0 s.Collecting 52 more samples in 58.8 s.Collecting 51 more samples in 57.7 s.Collecting 50 more samples in 56.6 s.Collecting 49 more samples in 55.4 s.Collecting 48 more samples in 54.3 s.Collecting 47 more samples in 53.2 s.Collecting 46 more samples in 52.0 s.Collecting 45 more samples in 50.9 s.Collecting 44 more samples in 49.8 s.Collecting 43 more samples in 48.6 s.Collecting 42 more samples in 47.5 s.Collecting 41 more samples in 46.4 s.Collecting 40 more samples in 45.2 s.Collecting 39 more samples in 44.1 s.Collecting 38 more samples in 43.0 s.Collecting 37 more samples in 41.9 s.Collecting 36 more samples in 40.7 s.Collecting 35 more samples in 39.6 s.Collecting 34 more samples in 38.5 s.Collecting 33 more samples in 37.3 s.Collecting 32 more samples in 36.2 s.Collecting 31 more samples in 35.1 s.Collecting 30 more samples in 33.9 s.Collecting 29 more samples in 32.8 s.Collecting 28 more samples in 31.7 s.Collecting 27 more samples in 30.5 s.Collecting 26 more samples in 29.4 s.Collecting 25 more samples in 28.3 s.Collecting 24 more samples in 27.1 s.Collecting 23 more samples in 26.0 s.Collecting 22 more samples in 24.9 s.Collecting 21 more samples in 23.8 s.Collecting 20 more samples in 22.6 s.Collecting 19 more samples in 21.5 s.Collecting 18 more samples in 20.4 s.Collecting 17 more samples in 19.2 s.Collecting 16 more samples in 18.1 s.Collecting 15 more samples in 17.0 s.Collecting 14 more samples in 15.8 s.Collecting 13 more samples in 14.7 s.Collecting 12 more samples in 13.6 s.Collecting 11 more samples in 12.4 s.Collecting 10 more samples in 11.3 s.Collecting 9 more samples in 10.2 s.Collecting 8 more samples in 9.0 s.Collecting 7 more samples in 7.9 s.Collecting 6 more samples in 6.8 s.Collecting 5 more samples in 5.7 s.Collecting 4 more samples in 4.5 s.Collecting 3 more samples in 3.4 s.Collecting 2 more samples in 2.3 s.Collecting 1 more samples in 1.1 s.mean: 953.6816 ms, lower bound: 936.6900 ms, upper bound: 970.1871 ms, confidence: 0.950 std dev: 85.61147 ms, lower bound: 75.81461 ms, upper bound: 101.4850 ms, confidence: 0.950 found 1 outliers among 100 samples (1.0%) variance introduced by outliers: 75.850% variance is severely inflated by outliers commits: 200000 retries: 536022 allocated bytes: 1647887928 Running a subject "6/33333/stm-containers" Collecting 99 more samples in 72.6 s.Collecting 98 more samples in 71.8 s.Collecting 97 more samples in 71.1 s.Collecting 96 more samples in 70.4 s.Collecting 95 more samples in 69.6 s.Collecting 94 more samples in 68.9 s.Collecting 93 more samples in 68.2 s.Collecting 92 more samples in 67.4 s.Collecting 91 more samples in 66.7 s.Collecting 90 more samples in 66.0 s.Collecting 89 more samples in 65.2 s.Collecting 88 more samples in 64.5 s.Collecting 87 more samples in 63.8 s.Collecting 86 more samples in 63.0 s.Collecting 85 more samples in 62.3 s.Collecting 84 more samples in 61.6 s.Collecting 83 more samples in 60.8 s.Collecting 82 more samples in 60.1 s.Collecting 81 more samples in 59.4 s.Collecting 80 more samples in 58.6 s.Collecting 79 more samples in 57.9 s.Collecting 78 more samples in 57.2 s.Collecting 77 more samples in 56.4 s.Collecting 76 more samples in 55.7 s.Collecting 75 more samples in 55.0 s.Collecting 74 more samples in 54.3 s.Collecting 73 more samples in 53.5 s.Collecting 72 more samples in 52.8 s.Collecting 71 more samples in 52.1 s.Collecting 70 more samples in 51.3 s.Collecting 69 more samples in 50.6 s.Collecting 68 more samples in 49.9 s.Collecting 67 more samples in 49.1 s.Collecting 66 more samples in 48.4 s.Collecting 65 more samples in 47.7 s.Collecting 64 more samples in 46.9 s.Collecting 63 more samples in 46.2 s.Collecting 62 more samples in 45.5 s.Collecting 61 more samples in 44.7 s.Collecting 60 more samples in 44.0 s.Collecting 59 more samples in 43.3 s.Collecting 58 more samples in 42.5 s.Collecting 57 more samples in 41.8 s.Collecting 56 more samples in 41.1 s.Collecting 55 more samples in 40.3 s.Collecting 54 more samples in 39.6 s.Collecting 53 more samples in 38.9 s.Collecting 52 more samples in 38.1 s.Collecting 51 more samples in 37.4 s.Collecting 50 more samples in 36.7 s.Collecting 49 more samples in 35.9 s.Collecting 48 more samples in 35.2 s.Collecting 47 more samples in 34.5 s.Collecting 46 more samples in 33.7 s.Collecting 45 more samples in 33.0 s.Collecting 44 more samples in 32.3 s.Collecting 43 more samples in 31.5 s.Collecting 42 more samples in 30.8 s.Collecting 41 more samples in 30.1 s.Collecting 40 more samples in 29.3 s.Collecting 39 more samples in 28.6 s.Collecting 38 more samples in 27.9 s.Collecting 37 more samples in 27.1 s.Collecting 36 more samples in 26.4 s.Collecting 35 more samples in 25.7 s.Collecting 34 more samples in 24.9 s.Collecting 33 more samples in 24.2 s.Collecting 32 more samples in 23.5 s.Collecting 31 more samples in 22.7 s.Collecting 30 more samples in 22.0 s.Collecting 29 more samples in 21.3 s.Collecting 28 more samples in 20.5 s.Collecting 27 more samples in 19.8 s.Collecting 26 more samples in 19.1 s.Collecting 25 more samples in 18.3 s.Collecting 24 more samples in 17.6 s.Collecting 23 more samples in 16.9 s.Collecting 22 more samples in 16.1 s.Collecting 21 more samples in 15.4 s.Collecting 20 more samples in 14.7 s.Collecting 19 more samples in 13.9 s.Collecting 18 more samples in 13.2 s.Collecting 17 more samples in 12.5 s.Collecting 16 more samples in 11.7 s.Collecting 15 more samples in 11.0 s.Collecting 14 more samples in 10.3 s.Collecting 13 more samples in 9.5 s.Collecting 12 more samples in 8.8 s.Collecting 11 more samples in 8.1 s.Collecting 10 more samples in 7.3 s.Collecting 9 more samples in 6.6 s.Collecting 8 more samples in 5.9 s.Collecting 7 more samples in 5.1 s.Collecting 6 more samples in 4.4 s.Collecting 5 more samples in 3.7 s.Collecting 4 more samples in 2.9 s.Collecting 3 more samples in 2.2 s.Collecting 2 more samples in 1.5 s.Collecting 1 more samples in 0.7 s.mean: 737.4398 ms, lower bound: 724.8553 ms, upper bound: 751.3184 ms, confidence: 0.950 std dev: 67.73587 ms, lower bound: 59.23208 ms, upper bound: 78.56614 ms, confidence: 0.950 found 2 outliers among 100 samples (2.0%) 2 (2.0%) high mild variance introduced by outliers: 75.902% variance is severely inflated by outliers commits: 200000 retries: 990 allocated bytes: 824782776 Running a subject "6/33333/ttrie" Collecting 99 more samples in 25.1 s.Collecting 98 more samples in 24.9 s.Collecting 97 more samples in 24.6 s.Collecting 96 more samples in 24.3 s.Collecting 95 more samples in 24.1 s.Collecting 94 more samples in 23.8 s.Collecting 93 more samples in 23.6 s.Collecting 92 more samples in 23.3 s.Collecting 91 more samples in 23.1 s.Collecting 90 more samples in 22.8 s.Collecting 89 more samples in 22.6 s.Collecting 88 more samples in 22.3 s.Collecting 87 more samples in 22.1 s.Collecting 86 more samples in 21.8 s.Collecting 85 more samples in 21.6 s.Collecting 84 more samples in 21.3 s.Collecting 83 more samples in 21.1 s.Collecting 82 more samples in 20.8 s.Collecting 81 more samples in 20.5 s.Collecting 80 more samples in 20.3 s.Collecting 79 more samples in 20.0 s.Collecting 78 more samples in 19.8 s.Collecting 77 more samples in 19.5 s.Collecting 76 more samples in 19.3 s.Collecting 75 more samples in 19.0 s.Collecting 74 more samples in 18.8 s.Collecting 73 more samples in 18.5 s.Collecting 72 more samples in 18.3 s.Collecting 71 more samples in 18.0 s.Collecting 70 more samples in 17.8 s.Collecting 69 more samples in 17.5 s.Collecting 68 more samples in 17.2 s.Collecting 67 more samples in 17.0 s.Collecting 66 more samples in 16.7 s.Collecting 65 more samples in 16.5 s.Collecting 64 more samples in 16.2 s.Collecting 63 more samples in 16.0 s.Collecting 62 more samples in 15.7 s.Collecting 61 more samples in 15.5 s.Collecting 60 more samples in 15.2 s.Collecting 59 more samples in 15.0 s.Collecting 58 more samples in 14.7 s.Collecting 57 more samples in 14.5 s.Collecting 56 more samples in 14.2 s.Collecting 55 more samples in 13.9 s.Collecting 54 more samples in 13.7 s.Collecting 53 more samples in 13.4 s.Collecting 52 more samples in 13.2 s.Collecting 51 more samples in 12.9 s.Collecting 50 more samples in 12.7 s.Collecting 49 more samples in 12.4 s.Collecting 48 more samples in 12.2 s.Collecting 47 more samples in 11.9 s.Collecting 46 more samples in 11.7 s.Collecting 45 more samples in 11.4 s.Collecting 44 more samples in 11.2 s.Collecting 43 more samples in 10.9 s.Collecting 42 more samples in 10.7 s.Collecting 41 more samples in 10.4 s.Collecting 40 more samples in 10.1 s.Collecting 39 more samples in 9.9 s.Collecting 38 more samples in 9.6 s.Collecting 37 more samples in 9.4 s.Collecting 36 more samples in 9.1 s.Collecting 35 more samples in 8.9 s.Collecting 34 more samples in 8.6 s.Collecting 33 more samples in 8.4 s.Collecting 32 more samples in 8.1 s.Collecting 31 more samples in 7.9 s.Collecting 30 more samples in 7.6 s.Collecting 29 more samples in 7.4 s.Collecting 28 more samples in 7.1 s.Collecting 27 more samples in 6.8 s.Collecting 26 more samples in 6.6 s.Collecting 25 more samples in 6.3 s.Collecting 24 more samples in 6.1 s.Collecting 23 more samples in 5.8 s.Collecting 22 more samples in 5.6 s.Collecting 21 more samples in 5.3 s.Collecting 20 more samples in 5.1 s.Collecting 19 more samples in 4.8 s.Collecting 18 more samples in 4.6 s.Collecting 17 more samples in 4.3 s.Collecting 16 more samples in 4.1 s.Collecting 15 more samples in 3.8 s.Collecting 14 more samples in 3.6 s.Collecting 13 more samples in 3.3 s.Collecting 12 more samples in 3.0 s.Collecting 11 more samples in 2.8 s.Collecting 10 more samples in 2.5 s.Collecting 9 more samples in 2.3 s.Collecting 8 more samples in 2.0 s.Collecting 7 more samples in 1.8 s.Collecting 6 more samples in 1.5 s.Collecting 5 more samples in 1.3 s.Collecting 4 more samples in 1.0 s.Collecting 3 more samples in 0.8 s.Collecting 2 more samples in 0.5 s.Collecting 1 more samples in 0.3 s.mean: 255.0660 ms, lower bound: 251.7402 ms, upper bound: 261.1216 ms, confidence: 0.950 std dev: 22.27165 ms, lower bound: 14.90414 ms, upper bound: 40.51644 ms, confidence: 0.950 found 11 outliers among 100 samples (11.0%) 10 (10.0%) high mild 1 (1.0%) high severe variance introduced by outliers: 74.816% variance is severely inflated by outliers commits: 200000 retries: 0 allocated bytes: 252675824 Running a subject "8/25000/unordered-containers" Collecting 99 more samples in 102.3 s.Collecting 98 more samples in 101.3 s.Collecting 97 more samples in 100.2 s.Collecting 96 more samples in 99.2 s.Collecting 95 more samples in 98.2 s.Collecting 94 more samples in 97.1 s.Collecting 93 more samples in 96.1 s.Collecting 92 more samples in 95.1 s.Collecting 91 more samples in 94.0 s.Collecting 90 more samples in 93.0 s.Collecting 89 more samples in 92.0 s.Collecting 88 more samples in 90.9 s.Collecting 87 more samples in 89.9 s.Collecting 86 more samples in 88.9 s.Collecting 85 more samples in 87.8 s.Collecting 84 more samples in 86.8 s.Collecting 83 more samples in 85.8 s.Collecting 82 more samples in 84.7 s.Collecting 81 more samples in 83.7 s.Collecting 80 more samples in 82.7 s.Collecting 79 more samples in 81.6 s.Collecting 78 more samples in 80.6 s.Collecting 77 more samples in 79.6 s.Collecting 76 more samples in 78.5 s.Collecting 75 more samples in 77.5 s.Collecting 74 more samples in 76.5 s.Collecting 73 more samples in 75.4 s.Collecting 72 more samples in 74.4 s.Collecting 71 more samples in 73.4 s.Collecting 70 more samples in 72.3 s.Collecting 69 more samples in 71.3 s.Collecting 68 more samples in 70.3 s.Collecting 67 more samples in 69.2 s.Collecting 66 more samples in 68.2 s.Collecting 65 more samples in 67.2 s.Collecting 64 more samples in 66.1 s.Collecting 63 more samples in 65.1 s.Collecting 62 more samples in 64.1 s.Collecting 61 more samples in 63.0 s.Collecting 60 more samples in 62.0 s.Collecting 59 more samples in 61.0 s.Collecting 58 more samples in 59.9 s.Collecting 57 more samples in 58.9 s.Collecting 56 more samples in 57.9 s.Collecting 55 more samples in 56.8 s.Collecting 54 more samples in 55.8 s.Collecting 53 more samples in 54.8 s.Collecting 52 more samples in 53.7 s.Collecting 51 more samples in 52.7 s.Collecting 50 more samples in 51.7 s.Collecting 49 more samples in 50.6 s.Collecting 48 more samples in 49.6 s.Collecting 47 more samples in 48.6 s.Collecting 46 more samples in 47.5 s.Collecting 45 more samples in 46.5 s.Collecting 44 more samples in 45.5 s.Collecting 43 more samples in 44.4 s.Collecting 42 more samples in 43.4 s.Collecting 41 more samples in 42.4 s.Collecting 40 more samples in 41.3 s.Collecting 39 more samples in 40.3 s.Collecting 38 more samples in 39.3 s.Collecting 37 more samples in 38.2 s.Collecting 36 more samples in 37.2 s.Collecting 35 more samples in 36.2 s.Collecting 34 more samples in 35.1 s.Collecting 33 more samples in 34.1 s.Collecting 32 more samples in 33.1 s.Collecting 31 more samples in 32.0 s.Collecting 30 more samples in 31.0 s.Collecting 29 more samples in 30.0 s.Collecting 28 more samples in 28.9 s.Collecting 27 more samples in 27.9 s.Collecting 26 more samples in 26.9 s.Collecting 25 more samples in 25.8 s.Collecting 24 more samples in 24.8 s.Collecting 23 more samples in 23.8 s.Collecting 22 more samples in 22.7 s.Collecting 21 more samples in 21.7 s.Collecting 20 more samples in 20.7 s.Collecting 19 more samples in 19.6 s.Collecting 18 more samples in 18.6 s.Collecting 17 more samples in 17.6 s.Collecting 16 more samples in 16.5 s.Collecting 15 more samples in 15.5 s.Collecting 14 more samples in 14.5 s.Collecting 13 more samples in 13.4 s.Collecting 12 more samples in 12.4 s.Collecting 11 more samples in 11.4 s.Collecting 10 more samples in 10.3 s.Collecting 9 more samples in 9.3 s.Collecting 8 more samples in 8.3 s.Collecting 7 more samples in 7.2 s.Collecting 6 more samples in 6.2 s.Collecting 5 more samples in 5.2 s.Collecting 4 more samples in 4.1 s.Collecting 3 more samples in 3.1 s.Collecting 2 more samples in 2.1 s.Collecting 1 more samples in 1.0 s.mean: 964.7353 ms, lower bound: 952.4085 ms, upper bound: 977.0199 ms, confidence: 0.950 std dev: 63.55063 ms, lower bound: 54.30049 ms, upper bound: 78.23208 ms, confidence: 0.950 found 4 outliers among 100 samples (4.0%) 2 (2.0%) low mild 2 (2.0%) high mild variance introduced by outliers: 61.571% variance is severely inflated by outliers commits: 200000 retries: 772742 allocated bytes: 2473919984 Running a subject "8/25000/stm-containers" Collecting 99 more samples in 59.0 s.Collecting 98 more samples in 58.4 s.Collecting 97 more samples in 57.8 s.Collecting 96 more samples in 57.2 s.Collecting 95 more samples in 56.6 s.Collecting 94 more samples in 56.0 s.Collecting 93 more samples in 55.4 s.Collecting 92 more samples in 54.8 s.Collecting 91 more samples in 54.2 s.Collecting 90 more samples in 53.7 s.Collecting 89 more samples in 53.1 s.Collecting 88 more samples in 52.5 s.Collecting 87 more samples in 51.9 s.Collecting 86 more samples in 51.3 s.Collecting 85 more samples in 50.7 s.Collecting 84 more samples in 50.1 s.Collecting 83 more samples in 49.5 s.Collecting 82 more samples in 48.9 s.Collecting 81 more samples in 48.3 s.Collecting 80 more samples in 47.7 s.Collecting 79 more samples in 47.1 s.Collecting 78 more samples in 46.5 s.Collecting 77 more samples in 45.9 s.Collecting 76 more samples in 45.3 s.Collecting 75 more samples in 44.7 s.Collecting 74 more samples in 44.1 s.Collecting 73 more samples in 43.5 s.Collecting 72 more samples in 42.9 s.Collecting 71 more samples in 42.3 s.Collecting 70 more samples in 41.7 s.Collecting 69 more samples in 41.1 s.Collecting 68 more samples in 40.5 s.Collecting 67 more samples in 39.9 s.Collecting 66 more samples in 39.3 s.Collecting 65 more samples in 38.7 s.Collecting 64 more samples in 38.2 s.Collecting 63 more samples in 37.6 s.Collecting 62 more samples in 37.0 s.Collecting 61 more samples in 36.4 s.Collecting 60 more samples in 35.8 s.Collecting 59 more samples in 35.2 s.Collecting 58 more samples in 34.6 s.Collecting 57 more samples in 34.0 s.Collecting 56 more samples in 33.4 s.Collecting 55 more samples in 32.8 s.Collecting 54 more samples in 32.2 s.Collecting 53 more samples in 31.6 s.Collecting 52 more samples in 31.0 s.Collecting 51 more samples in 30.4 s.Collecting 50 more samples in 29.8 s.Collecting 49 more samples in 29.2 s.Collecting 48 more samples in 28.6 s.Collecting 47 more samples in 28.0 s.Collecting 46 more samples in 27.4 s.Collecting 45 more samples in 26.8 s.Collecting 44 more samples in 26.2 s.Collecting 43 more samples in 25.6 s.Collecting 42 more samples in 25.0 s.Collecting 41 more samples in 24.4 s.Collecting 40 more samples in 23.8 s.Collecting 39 more samples in 23.2 s.Collecting 38 more samples in 22.7 s.Collecting 37 more samples in 22.1 s.Collecting 36 more samples in 21.5 s.Collecting 35 more samples in 20.9 s.Collecting 34 more samples in 20.3 s.Collecting 33 more samples in 19.7 s.Collecting 32 more samples in 19.1 s.Collecting 31 more samples in 18.5 s.Collecting 30 more samples in 17.9 s.Collecting 29 more samples in 17.3 s.Collecting 28 more samples in 16.7 s.Collecting 27 more samples in 16.1 s.Collecting 26 more samples in 15.5 s.Collecting 25 more samples in 14.9 s.Collecting 24 more samples in 14.3 s.Collecting 23 more samples in 13.7 s.Collecting 22 more samples in 13.1 s.Collecting 21 more samples in 12.5 s.Collecting 20 more samples in 11.9 s.Collecting 19 more samples in 11.3 s.Collecting 18 more samples in 10.7 s.Collecting 17 more samples in 10.1 s.Collecting 16 more samples in 9.5 s.Collecting 15 more samples in 8.9 s.Collecting 14 more samples in 8.3 s.Collecting 13 more samples in 7.7 s.Collecting 12 more samples in 7.2 s.Collecting 11 more samples in 6.6 s.Collecting 10 more samples in 6.0 s.Collecting 9 more samples in 5.4 s.Collecting 8 more samples in 4.8 s.Collecting 7 more samples in 4.2 s.Collecting 6 more samples in 3.6 s.Collecting 5 more samples in 3.0 s.Collecting 4 more samples in 2.4 s.Collecting 3 more samples in 1.8 s.Collecting 2 more samples in 1.2 s.Collecting 1 more samples in 0.6 s.mean: 622.8655 ms, lower bound: 611.6496 ms, upper bound: 633.8463 ms, confidence: 0.950 std dev: 57.29253 ms, lower bound: 50.66313 ms, upper bound: 66.97992 ms, confidence: 0.950 found 1 outliers among 100 samples (1.0%) variance introduced by outliers: 75.905% variance is severely inflated by outliers commits: 200000 retries: 1240 allocated bytes: 824631408 Running a subject "8/25000/ttrie" Collecting 100 more samples in 18.6 s.Collecting 99 more samples in 18.5 s.Collecting 98 more samples in 18.3 s.Collecting 97 more samples in 18.1 s.Collecting 96 more samples in 17.9 s.Collecting 95 more samples in 17.7 s.Collecting 94 more samples in 17.5 s.Collecting 93 more samples in 17.3 s.Collecting 92 more samples in 17.2 s.Collecting 91 more samples in 17.0 s.Collecting 90 more samples in 16.8 s.Collecting 89 more samples in 16.6 s.Collecting 88 more samples in 16.4 s.Collecting 87 more samples in 16.2 s.Collecting 86 more samples in 16.0 s.Collecting 85 more samples in 15.8 s.Collecting 84 more samples in 15.7 s.Collecting 83 more samples in 15.5 s.Collecting 82 more samples in 15.3 s.Collecting 81 more samples in 15.1 s.Collecting 80 more samples in 14.9 s.Collecting 79 more samples in 14.7 s.Collecting 78 more samples in 14.5 s.Collecting 77 more samples in 14.4 s.Collecting 76 more samples in 14.2 s.Collecting 75 more samples in 14.0 s.Collecting 74 more samples in 13.8 s.Collecting 73 more samples in 13.6 s.Collecting 72 more samples in 13.4 s.Collecting 71 more samples in 13.2 s.Collecting 70 more samples in 13.1 s.Collecting 69 more samples in 12.9 s.Collecting 68 more samples in 12.7 s.Collecting 67 more samples in 12.5 s.Collecting 66 more samples in 12.3 s.Collecting 65 more samples in 12.1 s.Collecting 64 more samples in 11.9 s.Collecting 63 more samples in 11.7 s.Collecting 62 more samples in 11.6 s.Collecting 61 more samples in 11.4 s.Collecting 60 more samples in 11.2 s.Collecting 59 more samples in 11.0 s.Collecting 58 more samples in 10.8 s.Collecting 57 more samples in 10.6 s.Collecting 56 more samples in 10.4 s.Collecting 55 more samples in 10.3 s.Collecting 54 more samples in 10.1 s.Collecting 53 more samples in 9.9 s.Collecting 52 more samples in 9.7 s.Collecting 51 more samples in 9.5 s.Collecting 50 more samples in 9.3 s.Collecting 49 more samples in 9.1 s.Collecting 48 more samples in 9.0 s.Collecting 47 more samples in 8.8 s.Collecting 46 more samples in 8.6 s.Collecting 45 more samples in 8.4 s.Collecting 44 more samples in 8.2 s.Collecting 43 more samples in 8.0 s.Collecting 42 more samples in 7.8 s.Collecting 41 more samples in 7.6 s.Collecting 40 more samples in 7.5 s.Collecting 39 more samples in 7.3 s.Collecting 38 more samples in 7.1 s.Collecting 37 more samples in 6.9 s.Collecting 36 more samples in 6.7 s.Collecting 35 more samples in 6.5 s.Collecting 34 more samples in 6.3 s.Collecting 33 more samples in 6.2 s.Collecting 32 more samples in 6.0 s.Collecting 31 more samples in 5.8 s.Collecting 30 more samples in 5.6 s.Collecting 29 more samples in 5.4 s.Collecting 28 more samples in 5.2 s.Collecting 27 more samples in 5.0 s.Collecting 26 more samples in 4.8 s.Collecting 25 more samples in 4.7 s.Collecting 24 more samples in 4.5 s.Collecting 23 more samples in 4.3 s.Collecting 22 more samples in 4.1 s.Collecting 21 more samples in 3.9 s.Collecting 20 more samples in 3.7 s.Collecting 19 more samples in 3.5 s.Collecting 18 more samples in 3.4 s.Collecting 17 more samples in 3.2 s.Collecting 16 more samples in 3.0 s.Collecting 15 more samples in 2.8 s.Collecting 14 more samples in 2.6 s.Collecting 13 more samples in 2.4 s.Collecting 12 more samples in 2.2 s.Collecting 11 more samples in 2.1 s.Collecting 10 more samples in 1.9 s.Collecting 9 more samples in 1.7 s.Collecting 8 more samples in 1.5 s.Collecting 7 more samples in 1.3 s.Collecting 6 more samples in 1.1 s.Collecting 5 more samples in 0.9 s.Collecting 4 more samples in 0.7 s.Collecting 3 more samples in 0.6 s.Collecting 2 more samples in 0.4 s.Collecting 1 more samples in 0.2 s.mean: 197.4216 ms, lower bound: 194.2166 ms, upper bound: 203.0032 ms, confidence: 0.950 std dev: 21.14903 ms, lower bound: 14.49233 ms, upper bound: 37.17430 ms, confidence: 0.950 found 11 outliers among 100 samples (11.0%) 8 (8.0%) high mild 3 (3.0%) high severe variance introduced by outliers: 81.085% variance is severely inflated by outliers commits: 200000 retries: 0 allocated bytes: 252714224 Running a subject "10/20000/unordered-containers" Collecting 99 more samples in 97.3 s.Collecting 98 more samples in 96.3 s.Collecting 97 more samples in 95.3 s.Collecting 96 more samples in 94.3 s.Collecting 95 more samples in 93.4 s.Collecting 94 more samples in 92.4 s.Collecting 93 more samples in 91.4 s.Collecting 92 more samples in 90.4 s.Collecting 91 more samples in 89.4 s.Collecting 90 more samples in 88.5 s.Collecting 89 more samples in 87.5 s.Collecting 88 more samples in 86.5 s.Collecting 87 more samples in 85.5 s.Collecting 86 more samples in 84.5 s.Collecting 85 more samples in 83.5 s.Collecting 84 more samples in 82.6 s.Collecting 83 more samples in 81.6 s.Collecting 82 more samples in 80.6 s.Collecting 81 more samples in 79.6 s.Collecting 80 more samples in 78.6 s.Collecting 79 more samples in 77.6 s.Collecting 78 more samples in 76.7 s.Collecting 77 more samples in 75.7 s.Collecting 76 more samples in 74.7 s.Collecting 75 more samples in 73.7 s.Collecting 74 more samples in 72.7 s.Collecting 73 more samples in 71.7 s.Collecting 72 more samples in 70.8 s.Collecting 71 more samples in 69.8 s.Collecting 70 more samples in 68.8 s.Collecting 69 more samples in 67.8 s.Collecting 68 more samples in 66.8 s.Collecting 67 more samples in 65.8 s.Collecting 66 more samples in 64.9 s.Collecting 65 more samples in 63.9 s.Collecting 64 more samples in 62.9 s.Collecting 63 more samples in 61.9 s.Collecting 62 more samples in 60.9 s.Collecting 61 more samples in 60.0 s.Collecting 60 more samples in 59.0 s.Collecting 59 more samples in 58.0 s.Collecting 58 more samples in 57.0 s.Collecting 57 more samples in 56.0 s.Collecting 56 more samples in 55.0 s.Collecting 55 more samples in 54.1 s.Collecting 54 more samples in 53.1 s.Collecting 53 more samples in 52.1 s.Collecting 52 more samples in 51.1 s.Collecting 51 more samples in 50.1 s.Collecting 50 more samples in 49.1 s.Collecting 49 more samples in 48.2 s.Collecting 48 more samples in 47.2 s.Collecting 47 more samples in 46.2 s.Collecting 46 more samples in 45.2 s.Collecting 45 more samples in 44.2 s.Collecting 44 more samples in 43.2 s.Collecting 43 more samples in 42.3 s.Collecting 42 more samples in 41.3 s.Collecting 41 more samples in 40.3 s.Collecting 40 more samples in 39.3 s.Collecting 39 more samples in 38.3 s.Collecting 38 more samples in 37.3 s.Collecting 37 more samples in 36.4 s.Collecting 36 more samples in 35.4 s.Collecting 35 more samples in 34.4 s.Collecting 34 more samples in 33.4 s.Collecting 33 more samples in 32.4 s.Collecting 32 more samples in 31.4 s.Collecting 31 more samples in 30.5 s.Collecting 30 more samples in 29.5 s.Collecting 29 more samples in 28.5 s.Collecting 28 more samples in 27.5 s.Collecting 27 more samples in 26.5 s.Collecting 26 more samples in 25.6 s.Collecting 25 more samples in 24.6 s.Collecting 24 more samples in 23.6 s.Collecting 23 more samples in 22.6 s.Collecting 22 more samples in 21.6 s.Collecting 21 more samples in 20.6 s.Collecting 20 more samples in 19.7 s.Collecting 19 more samples in 18.7 s.Collecting 18 more samples in 17.7 s.Collecting 17 more samples in 16.7 s.Collecting 16 more samples in 15.7 s.Collecting 15 more samples in 14.7 s.Collecting 14 more samples in 13.8 s.Collecting 13 more samples in 12.8 s.Collecting 12 more samples in 11.8 s.Collecting 11 more samples in 10.8 s.Collecting 10 more samples in 9.8 s.Collecting 9 more samples in 8.8 s.Collecting 8 more samples in 7.9 s.Collecting 7 more samples in 6.9 s.Collecting 6 more samples in 5.9 s.Collecting 5 more samples in 4.9 s.Collecting 4 more samples in 3.9 s.Collecting 3 more samples in 2.9 s.Collecting 2 more samples in 2.0 s.Collecting 1 more samples in 1.0 s.mean: 985.2695 ms, lower bound: 975.6227 ms, upper bound: 995.4355 ms, confidence: 0.950 std dev: 50.82505 ms, lower bound: 44.03570 ms, upper bound: 60.08203 ms, confidence: 0.950 found 3 outliers among 100 samples (3.0%) 3 (3.0%) high mild variance introduced by outliers: 49.473% variance is moderately inflated by outliers commits: 200000 retries: 893694 allocated bytes: 2048429432 Running a subject "10/20000/stm-containers" Collecting 99 more samples in 91.8 s.Collecting 98 more samples in 90.9 s.Collecting 97 more samples in 89.9 s.Collecting 96 more samples in 89.0 s.Collecting 95 more samples in 88.1 s.Collecting 94 more samples in 87.2 s.Collecting 93 more samples in 86.2 s.Collecting 92 more samples in 85.3 s.Collecting 91 more samples in 84.4 s.Collecting 90 more samples in 83.5 s.Collecting 89 more samples in 82.5 s.Collecting 88 more samples in 81.6 s.Collecting 87 more samples in 80.7 s.Collecting 86 more samples in 79.7 s.Collecting 85 more samples in 78.8 s.Collecting 84 more samples in 77.9 s.Collecting 83 more samples in 77.0 s.Collecting 82 more samples in 76.0 s.Collecting 81 more samples in 75.1 s.Collecting 80 more samples in 74.2 s.Collecting 79 more samples in 73.3 s.Collecting 78 more samples in 72.3 s.Collecting 77 more samples in 71.4 s.Collecting 76 more samples in 70.5 s.Collecting 75 more samples in 69.5 s.Collecting 74 more samples in 68.6 s.Collecting 73 more samples in 67.7 s.Collecting 72 more samples in 66.8 s.Collecting 71 more samples in 65.8 s.Collecting 70 more samples in 64.9 s.Collecting 69 more samples in 64.0 s.Collecting 68 more samples in 63.1 s.Collecting 67 more samples in 62.1 s.Collecting 66 more samples in 61.2 s.Collecting 65 more samples in 60.3 s.Collecting 64 more samples in 59.3 s.Collecting 63 more samples in 58.4 s.Collecting 62 more samples in 57.5 s.Collecting 61 more samples in 56.6 s.Collecting 60 more samples in 55.6 s.Collecting 59 more samples in 54.7 s.Collecting 58 more samples in 53.8 s.Collecting 57 more samples in 52.9 s.Collecting 56 more samples in 51.9 s.Collecting 55 more samples in 51.0 s.Collecting 54 more samples in 50.1 s.Collecting 53 more samples in 49.1 s.Collecting 52 more samples in 48.2 s.Collecting 51 more samples in 47.3 s.Collecting 50 more samples in 46.4 s.Collecting 49 more samples in 45.4 s.Collecting 48 more samples in 44.5 s.Collecting 47 more samples in 43.6 s.Collecting 46 more samples in 42.7 s.Collecting 45 more samples in 41.7 s.Collecting 44 more samples in 40.8 s.Collecting 43 more samples in 39.9 s.Collecting 42 more samples in 38.9 s.Collecting 41 more samples in 38.0 s.Collecting 40 more samples in 37.1 s.Collecting 39 more samples in 36.2 s.Collecting 38 more samples in 35.2 s.Collecting 37 more samples in 34.3 s.Collecting 36 more samples in 33.4 s.Collecting 35 more samples in 32.5 s.Collecting 34 more samples in 31.5 s.Collecting 33 more samples in 30.6 s.Collecting 32 more samples in 29.7 s.Collecting 31 more samples in 28.7 s.Collecting 30 more samples in 27.8 s.Collecting 29 more samples in 26.9 s.Collecting 28 more samples in 26.0 s.Collecting 27 more samples in 25.0 s.Collecting 26 more samples in 24.1 s.Collecting 25 more samples in 23.2 s.Collecting 24 more samples in 22.3 s.Collecting 23 more samples in 21.3 s.Collecting 22 more samples in 20.4 s.Collecting 21 more samples in 19.5 s.Collecting 20 more samples in 18.5 s.Collecting 19 more samples in 17.6 s.Collecting 18 more samples in 16.7 s.Collecting 17 more samples in 15.8 s.Collecting 16 more samples in 14.8 s.Collecting 15 more samples in 13.9 s.Collecting 14 more samples in 13.0 s.Collecting 13 more samples in 12.1 s.Collecting 12 more samples in 11.1 s.Collecting 11 more samples in 10.2 s.Collecting 10 more samples in 9.3 s.Collecting 9 more samples in 8.3 s.Collecting 8 more samples in 7.4 s.Collecting 7 more samples in 6.5 s.Collecting 6 more samples in 5.6 s.Collecting 5 more samples in 4.6 s.Collecting 4 more samples in 3.7 s.Collecting 3 more samples in 2.8 s.Collecting 2 more samples in 1.9 s.Collecting 1 more samples in 0.9 s.mean: 558.6698 ms, lower bound: 544.7924 ms, upper bound: 575.5561 ms, confidence: 0.950 std dev: 78.41765 ms, lower bound: 64.44152 ms, upper bound: 106.9779 ms, confidence: 0.950 found 5 outliers among 100 samples (5.0%) 4 (4.0%) high mild 1 (1.0%) high severe variance introduced by outliers: 88.372% variance is severely inflated by outliers commits: 200000 retries: 1511 allocated bytes: 824938016 Running a subject "10/20000/ttrie" Collecting 100 more samples in 17.8 s.Collecting 99 more samples in 17.7 s.Collecting 98 more samples in 17.5 s.Collecting 97 more samples in 17.3 s.Collecting 96 more samples in 17.1 s.Collecting 95 more samples in 16.9 s.Collecting 94 more samples in 16.8 s.Collecting 93 more samples in 16.6 s.Collecting 92 more samples in 16.4 s.Collecting 91 more samples in 16.2 s.Collecting 90 more samples in 16.1 s.Collecting 89 more samples in 15.9 s.Collecting 88 more samples in 15.7 s.Collecting 87 more samples in 15.5 s.Collecting 86 more samples in 15.3 s.Collecting 85 more samples in 15.2 s.Collecting 84 more samples in 15.0 s.Collecting 83 more samples in 14.8 s.Collecting 82 more samples in 14.6 s.Collecting 81 more samples in 14.4 s.Collecting 80 more samples in 14.3 s.Collecting 79 more samples in 14.1 s.Collecting 78 more samples in 13.9 s.Collecting 77 more samples in 13.7 s.Collecting 76 more samples in 13.6 s.Collecting 75 more samples in 13.4 s.Collecting 74 more samples in 13.2 s.Collecting 73 more samples in 13.0 s.Collecting 72 more samples in 12.8 s.Collecting 71 more samples in 12.7 s.Collecting 70 more samples in 12.5 s.Collecting 69 more samples in 12.3 s.Collecting 68 more samples in 12.1 s.Collecting 67 more samples in 12.0 s.Collecting 66 more samples in 11.8 s.Collecting 65 more samples in 11.6 s.Collecting 64 more samples in 11.4 s.Collecting 63 more samples in 11.2 s.Collecting 62 more samples in 11.1 s.Collecting 61 more samples in 10.9 s.Collecting 60 more samples in 10.7 s.Collecting 59 more samples in 10.5 s.Collecting 58 more samples in 10.3 s.Collecting 57 more samples in 10.2 s.Collecting 56 more samples in 10.0 s.Collecting 55 more samples in 9.8 s.Collecting 54 more samples in 9.6 s.Collecting 53 more samples in 9.5 s.Collecting 52 more samples in 9.3 s.Collecting 51 more samples in 9.1 s.Collecting 50 more samples in 8.9 s.Collecting 49 more samples in 8.7 s.Collecting 48 more samples in 8.6 s.Collecting 47 more samples in 8.4 s.Collecting 46 more samples in 8.2 s.Collecting 45 more samples in 8.0 s.Collecting 44 more samples in 7.8 s.Collecting 43 more samples in 7.7 s.Collecting 42 more samples in 7.5 s.Collecting 41 more samples in 7.3 s.Collecting 40 more samples in 7.1 s.Collecting 39 more samples in 7.0 s.Collecting 38 more samples in 6.8 s.Collecting 37 more samples in 6.6 s.Collecting 36 more samples in 6.4 s.Collecting 35 more samples in 6.2 s.Collecting 34 more samples in 6.1 s.Collecting 33 more samples in 5.9 s.Collecting 32 more samples in 5.7 s.Collecting 31 more samples in 5.5 s.Collecting 30 more samples in 5.4 s.Collecting 29 more samples in 5.2 s.Collecting 28 more samples in 5.0 s.Collecting 27 more samples in 4.8 s.Collecting 26 more samples in 4.6 s.Collecting 25 more samples in 4.5 s.Collecting 24 more samples in 4.3 s.Collecting 23 more samples in 4.1 s.Collecting 22 more samples in 3.9 s.Collecting 21 more samples in 3.7 s.Collecting 20 more samples in 3.6 s.Collecting 19 more samples in 3.4 s.Collecting 18 more samples in 3.2 s.Collecting 17 more samples in 3.0 s.Collecting 16 more samples in 2.9 s.Collecting 15 more samples in 2.7 s.Collecting 14 more samples in 2.5 s.Collecting 13 more samples in 2.3 s.Collecting 12 more samples in 2.1 s.Collecting 11 more samples in 2.0 s.Collecting 10 more samples in 1.8 s.Collecting 9 more samples in 1.6 s.Collecting 8 more samples in 1.4 s.Collecting 7 more samples in 1.2 s.Collecting 6 more samples in 1.1 s.Collecting 5 more samples in 0.9 s.Collecting 4 more samples in 0.7 s.Collecting 3 more samples in 0.5 s.Collecting 2 more samples in 0.4 s.Collecting 1 more samples in 0.2 s.mean: 168.5936 ms, lower bound: 164.5767 ms, upper bound: 174.4663 ms, confidence: 0.950 std dev: 24.70017 ms, lower bound: 19.01713 ms, upper bound: 35.45751 ms, confidence: 0.950 found 8 outliers among 100 samples (8.0%) 5 (5.0%) high mild 3 (3.0%) high severe variance introduced by outliers: 89.410% variance is severely inflated by outliers commits: 200000 retries: 3 allocated bytes: 252707776 Running a subject "12/16666/unordered-containers" Collecting 99 more samples in 104.0 s.Collecting 98 more samples in 102.9 s.Collecting 97 more samples in 101.9 s.Collecting 96 more samples in 100.8 s.Collecting 95 more samples in 99.8 s.Collecting 94 more samples in 98.7 s.Collecting 93 more samples in 97.7 s.Collecting 92 more samples in 96.6 s.Collecting 91 more samples in 95.6 s.Collecting 90 more samples in 94.5 s.Collecting 89 more samples in 93.5 s.Collecting 88 more samples in 92.4 s.Collecting 87 more samples in 91.4 s.Collecting 86 more samples in 90.3 s.Collecting 85 more samples in 89.3 s.Collecting 84 more samples in 88.2 s.Collecting 83 more samples in 87.2 s.Collecting 82 more samples in 86.1 s.Collecting 81 more samples in 85.1 s.Collecting 80 more samples in 84.0 s.Collecting 79 more samples in 83.0 s.Collecting 78 more samples in 81.9 s.Collecting 77 more samples in 80.9 s.Collecting 76 more samples in 79.8 s.Collecting 75 more samples in 78.8 s.Collecting 74 more samples in 77.7 s.Collecting 73 more samples in 76.7 s.Collecting 72 more samples in 75.6 s.Collecting 71 more samples in 74.6 s.Collecting 70 more samples in 73.5 s.Collecting 69 more samples in 72.5 s.Collecting 68 more samples in 71.4 s.Collecting 67 more samples in 70.4 s.Collecting 66 more samples in 69.3 s.Collecting 65 more samples in 68.3 s.Collecting 64 more samples in 67.2 s.Collecting 63 more samples in 66.2 s.Collecting 62 more samples in 65.1 s.Collecting 61 more samples in 64.1 s.Collecting 60 more samples in 63.0 s.Collecting 59 more samples in 62.0 s.Collecting 58 more samples in 60.9 s.Collecting 57 more samples in 59.9 s.Collecting 56 more samples in 58.8 s.Collecting 55 more samples in 57.8 s.Collecting 54 more samples in 56.7 s.Collecting 53 more samples in 55.7 s.Collecting 52 more samples in 54.6 s.Collecting 51 more samples in 53.6 s.Collecting 50 more samples in 52.5 s.Collecting 49 more samples in 51.5 s.Collecting 48 more samples in 50.4 s.Collecting 47 more samples in 49.4 s.Collecting 46 more samples in 48.3 s.Collecting 45 more samples in 47.3 s.Collecting 44 more samples in 46.2 s.Collecting 43 more samples in 45.2 s.Collecting 42 more samples in 44.1 s.Collecting 41 more samples in 43.1 s.Collecting 40 more samples in 42.0 s.Collecting 39 more samples in 41.0 s.Collecting 38 more samples in 39.9 s.Collecting 37 more samples in 38.9 s.Collecting 36 more samples in 37.8 s.Collecting 35 more samples in 36.8 s.Collecting 34 more samples in 35.7 s.Collecting 33 more samples in 34.7 s.Collecting 32 more samples in 33.6 s.Collecting 31 more samples in 32.6 s.Collecting 30 more samples in 31.5 s.Collecting 29 more samples in 30.5 s.Collecting 28 more samples in 29.4 s.Collecting 27 more samples in 28.4 s.Collecting 26 more samples in 27.3 s.Collecting 25 more samples in 26.3 s.Collecting 24 more samples in 25.2 s.Collecting 23 more samples in 24.2 s.Collecting 22 more samples in 23.1 s.Collecting 21 more samples in 22.1 s.Collecting 20 more samples in 21.0 s.Collecting 19 more samples in 20.0 s.Collecting 18 more samples in 18.9 s.Collecting 17 more samples in 17.9 s.Collecting 16 more samples in 16.8 s.Collecting 15 more samples in 15.8 s.Collecting 14 more samples in 14.7 s.Collecting 13 more samples in 13.7 s.Collecting 12 more samples in 12.6 s.Collecting 11 more samples in 11.6 s.Collecting 10 more samples in 10.5 s.Collecting 9 more samples in 9.5 s.Collecting 8 more samples in 8.4 s.Collecting 7 more samples in 7.4 s.Collecting 6 more samples in 6.3 s.Collecting 5 more samples in 5.3 s.Collecting 4 more samples in 4.2 s.Collecting 3 more samples in 3.2 s.Collecting 2 more samples in 2.1 s.Collecting 1 more samples in 1.1 s.mean: 1.011748 s, lower bound: 1.001193 s, upper bound: 1.022925 s, confidence: 0.950 std dev: 55.91630 ms, lower bound: 48.72822 ms, upper bound: 66.85346 ms, confidence: 0.950 found 1 outliers among 100 samples (1.0%) variance introduced by outliers: 53.453% variance is severely inflated by outliers commits: 200000 retries: 979956 allocated bytes: 2199781728 Running a subject "12/16666/stm-containers" Collecting 99 more samples in 71.9 s.Collecting 98 more samples in 71.2 s.Collecting 97 more samples in 70.4 s.Collecting 96 more samples in 69.7 s.Collecting 95 more samples in 69.0 s.Collecting 94 more samples in 68.3 s.Collecting 93 more samples in 67.5 s.Collecting 92 more samples in 66.8 s.Collecting 91 more samples in 66.1 s.Collecting 90 more samples in 65.3 s.Collecting 89 more samples in 64.6 s.Collecting 88 more samples in 63.9 s.Collecting 87 more samples in 63.2 s.Collecting 86 more samples in 62.4 s.Collecting 85 more samples in 61.7 s.Collecting 84 more samples in 61.0 s.Collecting 83 more samples in 60.3 s.Collecting 82 more samples in 59.5 s.Collecting 81 more samples in 58.8 s.Collecting 80 more samples in 58.1 s.Collecting 79 more samples in 57.4 s.Collecting 78 more samples in 56.6 s.Collecting 77 more samples in 55.9 s.Collecting 76 more samples in 55.2 s.Collecting 75 more samples in 54.5 s.Collecting 74 more samples in 53.7 s.Collecting 73 more samples in 53.0 s.Collecting 72 more samples in 52.3 s.Collecting 71 more samples in 51.6 s.Collecting 70 more samples in 50.8 s.Collecting 69 more samples in 50.1 s.Collecting 68 more samples in 49.4 s.Collecting 67 more samples in 48.6 s.Collecting 66 more samples in 47.9 s.Collecting 65 more samples in 47.2 s.Collecting 64 more samples in 46.5 s.Collecting 63 more samples in 45.7 s.Collecting 62 more samples in 45.0 s.Collecting 61 more samples in 44.3 s.Collecting 60 more samples in 43.6 s.Collecting 59 more samples in 42.8 s.Collecting 58 more samples in 42.1 s.Collecting 57 more samples in 41.4 s.Collecting 56 more samples in 40.7 s.Collecting 55 more samples in 39.9 s.Collecting 54 more samples in 39.2 s.Collecting 53 more samples in 38.5 s.Collecting 52 more samples in 37.8 s.Collecting 51 more samples in 37.0 s.Collecting 50 more samples in 36.3 s.Collecting 49 more samples in 35.6 s.Collecting 48 more samples in 34.9 s.Collecting 47 more samples in 34.1 s.Collecting 46 more samples in 33.4 s.Collecting 45 more samples in 32.7 s.Collecting 44 more samples in 31.9 s.Collecting 43 more samples in 31.2 s.Collecting 42 more samples in 30.5 s.Collecting 41 more samples in 29.8 s.Collecting 40 more samples in 29.0 s.Collecting 39 more samples in 28.3 s.Collecting 38 more samples in 27.6 s.Collecting 37 more samples in 26.9 s.Collecting 36 more samples in 26.1 s.Collecting 35 more samples in 25.4 s.Collecting 34 more samples in 24.7 s.Collecting 33 more samples in 24.0 s.Collecting 32 more samples in 23.2 s.Collecting 31 more samples in 22.5 s.Collecting 30 more samples in 21.8 s.Collecting 29 more samples in 21.1 s.Collecting 28 more samples in 20.3 s.Collecting 27 more samples in 19.6 s.Collecting 26 more samples in 18.9 s.Collecting 25 more samples in 18.2 s.Collecting 24 more samples in 17.4 s.Collecting 23 more samples in 16.7 s.Collecting 22 more samples in 16.0 s.Collecting 21 more samples in 15.2 s.Collecting 20 more samples in 14.5 s.Collecting 19 more samples in 13.8 s.Collecting 18 more samples in 13.1 s.Collecting 17 more samples in 12.3 s.Collecting 16 more samples in 11.6 s.Collecting 15 more samples in 10.9 s.Collecting 14 more samples in 10.2 s.Collecting 13 more samples in 9.4 s.Collecting 12 more samples in 8.7 s.Collecting 11 more samples in 8.0 s.Collecting 10 more samples in 7.3 s.Collecting 9 more samples in 6.5 s.Collecting 8 more samples in 5.8 s.Collecting 7 more samples in 5.1 s.Collecting 6 more samples in 4.4 s.Collecting 5 more samples in 3.6 s.Collecting 4 more samples in 2.9 s.Collecting 3 more samples in 2.2 s.Collecting 2 more samples in 1.5 s.Collecting 1 more samples in 0.7 s.mean: 518.7658 ms, lower bound: 507.3506 ms, upper bound: 531.0023 ms, confidence: 0.950 std dev: 60.28075 ms, lower bound: 50.76001 ms, upper bound: 74.20873 ms, confidence: 0.950 found 20 outliers among 100 samples (20.0%) 14 (14.0%) low mild 3 (3.0%) high mild 3 (3.0%) high severe variance introduced by outliers: 84.164% variance is severely inflated by outliers commits: 200000 retries: 1703 allocated bytes: 826122656 Running a subject "12/16666/ttrie" Collecting 100 more samples in 14.5 s.Collecting 99 more samples in 14.3 s.Collecting 98 more samples in 14.2 s.Collecting 97 more samples in 14.0 s.Collecting 96 more samples in 13.9 s.Collecting 95 more samples in 13.7 s.Collecting 94 more samples in 13.6 s.Collecting 93 more samples in 13.5 s.Collecting 92 more samples in 13.3 s.Collecting 91 more samples in 13.2 s.Collecting 90 more samples in 13.0 s.Collecting 89 more samples in 12.9 s.Collecting 88 more samples in 12.7 s.Collecting 87 more samples in 12.6 s.Collecting 86 more samples in 12.4 s.Collecting 85 more samples in 12.3 s.Collecting 84 more samples in 12.2 s.Collecting 83 more samples in 12.0 s.Collecting 82 more samples in 11.9 s.Collecting 81 more samples in 11.7 s.Collecting 80 more samples in 11.6 s.Collecting 79 more samples in 11.4 s.Collecting 78 more samples in 11.3 s.Collecting 77 more samples in 11.1 s.Collecting 76 more samples in 11.0 s.Collecting 75 more samples in 10.9 s.Collecting 74 more samples in 10.7 s.Collecting 73 more samples in 10.6 s.Collecting 72 more samples in 10.4 s.Collecting 71 more samples in 10.3 s.Collecting 70 more samples in 10.1 s.Collecting 69 more samples in 10.0 s.Collecting 68 more samples in 9.8 s.Collecting 67 more samples in 9.7 s.Collecting 66 more samples in 9.5 s.Collecting 65 more samples in 9.4 s.Collecting 64 more samples in 9.3 s.Collecting 63 more samples in 9.1 s.Collecting 62 more samples in 9.0 s.Collecting 61 more samples in 8.8 s.Collecting 60 more samples in 8.7 s.Collecting 59 more samples in 8.5 s.Collecting 58 more samples in 8.4 s.Collecting 57 more samples in 8.2 s.Collecting 56 more samples in 8.1 s.Collecting 55 more samples in 8.0 s.Collecting 54 more samples in 7.8 s.Collecting 53 more samples in 7.7 s.Collecting 52 more samples in 7.5 s.Collecting 51 more samples in 7.4 s.Collecting 50 more samples in 7.2 s.Collecting 49 more samples in 7.1 s.Collecting 48 more samples in 6.9 s.Collecting 47 more samples in 6.8 s.Collecting 46 more samples in 6.7 s.Collecting 45 more samples in 6.5 s.Collecting 44 more samples in 6.4 s.Collecting 43 more samples in 6.2 s.Collecting 42 more samples in 6.1 s.Collecting 41 more samples in 5.9 s.Collecting 40 more samples in 5.8 s.Collecting 39 more samples in 5.6 s.Collecting 38 more samples in 5.5 s.Collecting 37 more samples in 5.4 s.Collecting 36 more samples in 5.2 s.Collecting 35 more samples in 5.1 s.Collecting 34 more samples in 4.9 s.Collecting 33 more samples in 4.8 s.Collecting 32 more samples in 4.6 s.Collecting 31 more samples in 4.5 s.Collecting 30 more samples in 4.3 s.Collecting 29 more samples in 4.2 s.Collecting 28 more samples in 4.1 s.Collecting 27 more samples in 3.9 s.Collecting 26 more samples in 3.8 s.Collecting 25 more samples in 3.6 s.Collecting 24 more samples in 3.5 s.Collecting 23 more samples in 3.3 s.Collecting 22 more samples in 3.2 s.Collecting 21 more samples in 3.0 s.Collecting 20 more samples in 2.9 s.Collecting 19 more samples in 2.7 s.Collecting 18 more samples in 2.6 s.Collecting 17 more samples in 2.5 s.Collecting 16 more samples in 2.3 s.Collecting 15 more samples in 2.2 s.Collecting 14 more samples in 2.0 s.Collecting 13 more samples in 1.9 s.Collecting 12 more samples in 1.7 s.Collecting 11 more samples in 1.6 s.Collecting 10 more samples in 1.4 s.Collecting 9 more samples in 1.3 s.Collecting 8 more samples in 1.2 s.Collecting 7 more samples in 1.0 s.Collecting 6 more samples in 0.9 s.Collecting 5 more samples in 0.7 s.Collecting 4 more samples in 0.6 s.Collecting 3 more samples in 0.4 s.Collecting 2 more samples in 0.3 s.Collecting 1 more samples in 0.1 s.mean: 150.5747 ms, lower bound: 146.3233 ms, upper bound: 157.8950 ms, confidence: 0.950 std dev: 27.80712 ms, lower bound: 19.48195 ms, upper bound: 49.16069 ms, confidence: 0.950 found 8 outliers among 100 samples (8.0%) 7 (7.0%) high mild 1 (1.0%) high severe variance introduced by outliers: 93.595% variance is severely inflated by outliers commits: 200000 retries: 5 allocated bytes: 252716688 Running a subject "14/14285/unordered-containers" Collecting 99 more samples in 111.4 s.Collecting 98 more samples in 110.3 s.Collecting 97 more samples in 109.2 s.Collecting 96 more samples in 108.1 s.Collecting 95 more samples in 106.9 s.Collecting 94 more samples in 105.8 s.Collecting 93 more samples in 104.7 s.Collecting 92 more samples in 103.6 s.Collecting 91 more samples in 102.4 s.Collecting 90 more samples in 101.3 s.Collecting 89 more samples in 100.2 s.Collecting 88 more samples in 99.1 s.Collecting 87 more samples in 97.9 s.Collecting 86 more samples in 96.8 s.Collecting 85 more samples in 95.7 s.Collecting 84 more samples in 94.6 s.Collecting 83 more samples in 93.4 s.Collecting 82 more samples in 92.3 s.Collecting 81 more samples in 91.2 s.Collecting 80 more samples in 90.0 s.Collecting 79 more samples in 88.9 s.Collecting 78 more samples in 87.8 s.Collecting 77 more samples in 86.7 s.Collecting 76 more samples in 85.5 s.Collecting 75 more samples in 84.4 s.Collecting 74 more samples in 83.3 s.Collecting 73 more samples in 82.2 s.Collecting 72 more samples in 81.0 s.Collecting 71 more samples in 79.9 s.Collecting 70 more samples in 78.8 s.Collecting 69 more samples in 77.7 s.Collecting 68 more samples in 76.5 s.Collecting 67 more samples in 75.4 s.Collecting 66 more samples in 74.3 s.Collecting 65 more samples in 73.2 s.Collecting 64 more samples in 72.0 s.Collecting 63 more samples in 70.9 s.Collecting 62 more samples in 69.8 s.Collecting 61 more samples in 68.7 s.Collecting 60 more samples in 67.5 s.Collecting 59 more samples in 66.4 s.Collecting 58 more samples in 65.3 s.Collecting 57 more samples in 64.2 s.Collecting 56 more samples in 63.0 s.Collecting 55 more samples in 61.9 s.Collecting 54 more samples in 60.8 s.Collecting 53 more samples in 59.7 s.Collecting 52 more samples in 58.5 s.Collecting 51 more samples in 57.4 s.Collecting 50 more samples in 56.3 s.Collecting 49 more samples in 55.2 s.Collecting 48 more samples in 54.0 s.Collecting 47 more samples in 52.9 s.Collecting 46 more samples in 51.8 s.Collecting 45 more samples in 50.7 s.Collecting 44 more samples in 49.5 s.Collecting 43 more samples in 48.4 s.Collecting 42 more samples in 47.3 s.Collecting 41 more samples in 46.1 s.Collecting 40 more samples in 45.0 s.Collecting 39 more samples in 43.9 s.Collecting 38 more samples in 42.8 s.Collecting 37 more samples in 41.6 s.Collecting 36 more samples in 40.5 s.Collecting 35 more samples in 39.4 s.Collecting 34 more samples in 38.3 s.Collecting 33 more samples in 37.1 s.Collecting 32 more samples in 36.0 s.Collecting 31 more samples in 34.9 s.Collecting 30 more samples in 33.8 s.Collecting 29 more samples in 32.6 s.Collecting 28 more samples in 31.5 s.Collecting 27 more samples in 30.4 s.Collecting 26 more samples in 29.3 s.Collecting 25 more samples in 28.1 s.Collecting 24 more samples in 27.0 s.Collecting 23 more samples in 25.9 s.Collecting 22 more samples in 24.8 s.Collecting 21 more samples in 23.6 s.Collecting 20 more samples in 22.5 s.Collecting 19 more samples in 21.4 s.Collecting 18 more samples in 20.3 s.Collecting 17 more samples in 19.1 s.Collecting 16 more samples in 18.0 s.Collecting 15 more samples in 16.9 s.Collecting 14 more samples in 15.8 s.Collecting 13 more samples in 14.6 s.Collecting 12 more samples in 13.5 s.Collecting 11 more samples in 12.4 s.Collecting 10 more samples in 11.3 s.Collecting 9 more samples in 10.1 s.Collecting 8 more samples in 9.0 s.Collecting 7 more samples in 7.9 s.Collecting 6 more samples in 6.8 s.Collecting 5 more samples in 5.6 s.Collecting 4 more samples in 4.5 s.Collecting 3 more samples in 3.4 s.Collecting 2 more samples in 2.3 s.Collecting 1 more samples in 1.1 s.mean: 1.087518 s, lower bound: 1.069379 s, upper bound: 1.109435 s, confidence: 0.950 std dev: 102.5973 ms, lower bound: 85.70514 ms, upper bound: 127.0143 ms, confidence: 0.950 found 7 outliers among 100 samples (7.0%) 6 (6.0%) high mild 1 (1.0%) high severe variance introduced by outliers: 76.932% variance is severely inflated by outliers commits: 200000 retries: 1134936 allocated bytes: 2753618256 Running a subject "14/14285/stm-containers" Collecting 99 more samples in 40.8 s.Collecting 98 more samples in 40.4 s.Collecting 97 more samples in 40.0 s.Collecting 96 more samples in 39.6 s.Collecting 95 more samples in 39.2 s.Collecting 94 more samples in 38.8 s.Collecting 93 more samples in 38.4 s.Collecting 92 more samples in 37.9 s.Collecting 91 more samples in 37.5 s.Collecting 90 more samples in 37.1 s.Collecting 89 more samples in 36.7 s.Collecting 88 more samples in 36.3 s.Collecting 87 more samples in 35.9 s.Collecting 86 more samples in 35.5 s.Collecting 85 more samples in 35.1 s.Collecting 84 more samples in 34.6 s.Collecting 83 more samples in 34.2 s.Collecting 82 more samples in 33.8 s.Collecting 81 more samples in 33.4 s.Collecting 80 more samples in 33.0 s.Collecting 79 more samples in 32.6 s.Collecting 78 more samples in 32.2 s.Collecting 77 more samples in 31.8 s.Collecting 76 more samples in 31.3 s.Collecting 75 more samples in 30.9 s.Collecting 74 more samples in 30.5 s.Collecting 73 more samples in 30.1 s.Collecting 72 more samples in 29.7 s.Collecting 71 more samples in 29.3 s.Collecting 70 more samples in 28.9 s.Collecting 69 more samples in 28.5 s.Collecting 68 more samples in 28.0 s.Collecting 67 more samples in 27.6 s.Collecting 66 more samples in 27.2 s.Collecting 65 more samples in 26.8 s.Collecting 64 more samples in 26.4 s.Collecting 63 more samples in 26.0 s.Collecting 62 more samples in 25.6 s.Collecting 61 more samples in 25.2 s.Collecting 60 more samples in 24.7 s.Collecting 59 more samples in 24.3 s.Collecting 58 more samples in 23.9 s.Collecting 57 more samples in 23.5 s.Collecting 56 more samples in 23.1 s.Collecting 55 more samples in 22.7 s.Collecting 54 more samples in 22.3 s.Collecting 53 more samples in 21.9 s.Collecting 52 more samples in 21.4 s.Collecting 51 more samples in 21.0 s.Collecting 50 more samples in 20.6 s.Collecting 49 more samples in 20.2 s.Collecting 48 more samples in 19.8 s.Collecting 47 more samples in 19.4 s.Collecting 46 more samples in 19.0 s.Collecting 45 more samples in 18.6 s.Collecting 44 more samples in 18.1 s.Collecting 43 more samples in 17.7 s.Collecting 42 more samples in 17.3 s.Collecting 41 more samples in 16.9 s.Collecting 40 more samples in 16.5 s.Collecting 39 more samples in 16.1 s.Collecting 38 more samples in 15.7 s.Collecting 37 more samples in 15.3 s.Collecting 36 more samples in 14.8 s.Collecting 35 more samples in 14.4 s.Collecting 34 more samples in 14.0 s.Collecting 33 more samples in 13.6 s.Collecting 32 more samples in 13.2 s.Collecting 31 more samples in 12.8 s.Collecting 30 more samples in 12.4 s.Collecting 29 more samples in 12.0 s.Collecting 28 more samples in 11.5 s.Collecting 27 more samples in 11.1 s.Collecting 26 more samples in 10.7 s.Collecting 25 more samples in 10.3 s.Collecting 24 more samples in 9.9 s.Collecting 23 more samples in 9.5 s.Collecting 22 more samples in 9.1 s.Collecting 21 more samples in 8.7 s.Collecting 20 more samples in 8.2 s.Collecting 19 more samples in 7.8 s.Collecting 18 more samples in 7.4 s.Collecting 17 more samples in 7.0 s.Collecting 16 more samples in 6.6 s.Collecting 15 more samples in 6.2 s.Collecting 14 more samples in 5.8 s.Collecting 13 more samples in 5.4 s.Collecting 12 more samples in 4.9 s.Collecting 11 more samples in 4.5 s.Collecting 10 more samples in 4.1 s.Collecting 9 more samples in 3.7 s.Collecting 8 more samples in 3.3 s.Collecting 7 more samples in 2.9 s.Collecting 6 more samples in 2.5 s.Collecting 5 more samples in 2.1 s.Collecting 4 more samples in 1.6 s.Collecting 3 more samples in 1.2 s.Collecting 2 more samples in 0.8 s.Collecting 1 more samples in 0.4 s.mean: 510.3364 ms, lower bound: 498.2622 ms, upper bound: 521.9413 ms, confidence: 0.950 std dev: 60.78341 ms, lower bound: 53.90261 ms, upper bound: 69.01126 ms, confidence: 0.950 variance introduced by outliers: 84.204% variance is severely inflated by outliers commits: 200000 retries: 1734 allocated bytes: 826029072 Running a subject "14/14285/ttrie" Collecting 100 more samples in 17.5 s.Collecting 99 more samples in 17.4 s.Collecting 98 more samples in 17.2 s.Collecting 97 more samples in 17.0 s.Collecting 96 more samples in 16.8 s.Collecting 95 more samples in 16.7 s.Collecting 94 more samples in 16.5 s.Collecting 93 more samples in 16.3 s.Collecting 92 more samples in 16.1 s.Collecting 91 more samples in 16.0 s.Collecting 90 more samples in 15.8 s.Collecting 89 more samples in 15.6 s.Collecting 88 more samples in 15.4 s.Collecting 87 more samples in 15.3 s.Collecting 86 more samples in 15.1 s.Collecting 85 more samples in 14.9 s.Collecting 84 more samples in 14.7 s.Collecting 83 more samples in 14.6 s.Collecting 82 more samples in 14.4 s.Collecting 81 more samples in 14.2 s.Collecting 80 more samples in 14.0 s.Collecting 79 more samples in 13.9 s.Collecting 78 more samples in 13.7 s.Collecting 77 more samples in 13.5 s.Collecting 76 more samples in 13.3 s.Collecting 75 more samples in 13.2 s.Collecting 74 more samples in 13.0 s.Collecting 73 more samples in 12.8 s.Collecting 72 more samples in 12.6 s.Collecting 71 more samples in 12.5 s.Collecting 70 more samples in 12.3 s.Collecting 69 more samples in 12.1 s.Collecting 68 more samples in 11.9 s.Collecting 67 more samples in 11.8 s.Collecting 66 more samples in 11.6 s.Collecting 65 more samples in 11.4 s.Collecting 64 more samples in 11.2 s.Collecting 63 more samples in 11.1 s.Collecting 62 more samples in 10.9 s.Collecting 61 more samples in 10.7 s.Collecting 60 more samples in 10.5 s.Collecting 59 more samples in 10.4 s.Collecting 58 more samples in 10.2 s.Collecting 57 more samples in 10.0 s.Collecting 56 more samples in 9.8 s.Collecting 55 more samples in 9.7 s.Collecting 54 more samples in 9.5 s.Collecting 53 more samples in 9.3 s.Collecting 52 more samples in 9.1 s.Collecting 51 more samples in 8.9 s.Collecting 50 more samples in 8.8 s.Collecting 49 more samples in 8.6 s.Collecting 48 more samples in 8.4 s.Collecting 47 more samples in 8.2 s.Collecting 46 more samples in 8.1 s.Collecting 45 more samples in 7.9 s.Collecting 44 more samples in 7.7 s.Collecting 43 more samples in 7.5 s.Collecting 42 more samples in 7.4 s.Collecting 41 more samples in 7.2 s.Collecting 40 more samples in 7.0 s.Collecting 39 more samples in 6.8 s.Collecting 38 more samples in 6.7 s.Collecting 37 more samples in 6.5 s.Collecting 36 more samples in 6.3 s.Collecting 35 more samples in 6.1 s.Collecting 34 more samples in 6.0 s.Collecting 33 more samples in 5.8 s.Collecting 32 more samples in 5.6 s.Collecting 31 more samples in 5.4 s.Collecting 30 more samples in 5.3 s.Collecting 29 more samples in 5.1 s.Collecting 28 more samples in 4.9 s.Collecting 27 more samples in 4.7 s.Collecting 26 more samples in 4.6 s.Collecting 25 more samples in 4.4 s.Collecting 24 more samples in 4.2 s.Collecting 23 more samples in 4.0 s.Collecting 22 more samples in 3.9 s.Collecting 21 more samples in 3.7 s.Collecting 20 more samples in 3.5 s.Collecting 19 more samples in 3.3 s.Collecting 18 more samples in 3.2 s.Collecting 17 more samples in 3.0 s.Collecting 16 more samples in 2.8 s.Collecting 15 more samples in 2.6 s.Collecting 14 more samples in 2.5 s.Collecting 13 more samples in 2.3 s.Collecting 12 more samples in 2.1 s.Collecting 11 more samples in 1.9 s.Collecting 10 more samples in 1.8 s.Collecting 9 more samples in 1.6 s.Collecting 8 more samples in 1.4 s.Collecting 7 more samples in 1.2 s.Collecting 6 more samples in 1.1 s.Collecting 5 more samples in 0.9 s.Collecting 4 more samples in 0.7 s.Collecting 3 more samples in 0.5 s.Collecting 2 more samples in 0.4 s.Collecting 1 more samples in 0.2 s.mean: 140.8152 ms, lower bound: 137.0817 ms, upper bound: 144.9758 ms, confidence: 0.950 std dev: 20.30150 ms, lower bound: 17.70803 ms, upper bound: 23.45817 ms, confidence: 0.950 found 3 outliers among 100 samples (3.0%) 3 (3.0%) high mild variance introduced by outliers: 89.391% variance is severely inflated by outliers commits: 200000 retries: 3 allocated bytes: 252742184 Running a subject "16/12500/unordered-containers" Collecting 99 more samples in 99.1 s.Collecting 98 more samples in 98.1 s.Collecting 97 more samples in 97.1 s.Collecting 96 more samples in 96.1 s.Collecting 95 more samples in 95.1 s.Collecting 94 more samples in 94.1 s.Collecting 93 more samples in 93.1 s.Collecting 92 more samples in 92.1 s.Collecting 91 more samples in 91.1 s.Collecting 90 more samples in 90.1 s.Collecting 89 more samples in 89.1 s.Collecting 88 more samples in 88.1 s.Collecting 87 more samples in 87.1 s.Collecting 86 more samples in 86.1 s.Collecting 85 more samples in 85.1 s.Collecting 84 more samples in 84.1 s.Collecting 83 more samples in 83.1 s.Collecting 82 more samples in 82.1 s.Collecting 81 more samples in 81.1 s.Collecting 80 more samples in 80.1 s.Collecting 79 more samples in 79.1 s.Collecting 78 more samples in 78.1 s.Collecting 77 more samples in 77.1 s.Collecting 76 more samples in 76.1 s.Collecting 75 more samples in 75.1 s.Collecting 74 more samples in 74.1 s.Collecting 73 more samples in 73.1 s.Collecting 72 more samples in 72.1 s.Collecting 71 more samples in 71.1 s.Collecting 70 more samples in 70.1 s.Collecting 69 more samples in 69.1 s.Collecting 68 more samples in 68.0 s.Collecting 67 more samples in 67.0 s.Collecting 66 more samples in 66.0 s.Collecting 65 more samples in 65.0 s.Collecting 64 more samples in 64.0 s.Collecting 63 more samples in 63.0 s.Collecting 62 more samples in 62.0 s.Collecting 61 more samples in 61.0 s.Collecting 60 more samples in 60.0 s.Collecting 59 more samples in 59.0 s.Collecting 58 more samples in 58.0 s.Collecting 57 more samples in 57.0 s.Collecting 56 more samples in 56.0 s.Collecting 55 more samples in 55.0 s.Collecting 54 more samples in 54.0 s.Collecting 53 more samples in 53.0 s.Collecting 52 more samples in 52.0 s.Collecting 51 more samples in 51.0 s.Collecting 50 more samples in 50.0 s.Collecting 49 more samples in 49.0 s.Collecting 48 more samples in 48.0 s.Collecting 47 more samples in 47.0 s.Collecting 46 more samples in 46.0 s.Collecting 45 more samples in 45.0 s.Collecting 44 more samples in 44.0 s.Collecting 43 more samples in 43.0 s.Collecting 42 more samples in 42.0 s.Collecting 41 more samples in 41.0 s.Collecting 40 more samples in 40.0 s.Collecting 39 more samples in 39.0 s.Collecting 38 more samples in 38.0 s.Collecting 37 more samples in 37.0 s.Collecting 36 more samples in 36.0 s.Collecting 35 more samples in 35.0 s.Collecting 34 more samples in 34.0 s.Collecting 33 more samples in 33.0 s.Collecting 32 more samples in 32.0 s.Collecting 31 more samples in 31.0 s.Collecting 30 more samples in 30.0 s.Collecting 29 more samples in 29.0 s.Collecting 28 more samples in 28.0 s.Collecting 27 more samples in 27.0 s.Collecting 26 more samples in 26.0 s.Collecting 25 more samples in 25.0 s.Collecting 24 more samples in 24.0 s.Collecting 23 more samples in 23.0 s.Collecting 22 more samples in 22.0 s.Collecting 21 more samples in 21.0 s.Collecting 20 more samples in 20.0 s.Collecting 19 more samples in 19.0 s.Collecting 18 more samples in 18.0 s.Collecting 17 more samples in 17.0 s.Collecting 16 more samples in 16.0 s.Collecting 15 more samples in 15.0 s.Collecting 14 more samples in 14.0 s.Collecting 13 more samples in 13.0 s.Collecting 12 more samples in 12.0 s.Collecting 11 more samples in 11.0 s.Collecting 10 more samples in 10.0 s.Collecting 9 more samples in 9.0 s.Collecting 8 more samples in 8.0 s.Collecting 7 more samples in 7.0 s.Collecting 6 more samples in 6.0 s.Collecting 5 more samples in 5.0 s.Collecting 4 more samples in 4.0 s.Collecting 3 more samples in 3.0 s.Collecting 2 more samples in 2.0 s.Collecting 1 more samples in 1.0 s.mean: 1.121188 s, lower bound: 1.101340 s, upper bound: 1.144652 s, confidence: 0.950 std dev: 110.4650 ms, lower bound: 92.16209 ms, upper bound: 138.1253 ms, confidence: 0.950 found 8 outliers among 100 samples (8.0%) 6 (6.0%) high mild 1 (1.0%) high severe variance introduced by outliers: 78.970% variance is severely inflated by outliers commits: 200000 retries: 1126038 allocated bytes: 2476045128 Running a subject "16/12500/stm-containers" Collecting 99 more samples in 60.1 s.Collecting 98 more samples in 59.5 s.Collecting 97 more samples in 58.9 s.Collecting 96 more samples in 58.3 s.Collecting 95 more samples in 57.7 s.Collecting 94 more samples in 57.1 s.Collecting 93 more samples in 56.5 s.Collecting 92 more samples in 55.9 s.Collecting 91 more samples in 55.3 s.Collecting 90 more samples in 54.7 s.Collecting 89 more samples in 54.1 s.Collecting 88 more samples in 53.5 s.Collecting 87 more samples in 52.9 s.Collecting 86 more samples in 52.2 s.Collecting 85 more samples in 51.6 s.Collecting 84 more samples in 51.0 s.Collecting 83 more samples in 50.4 s.Collecting 82 more samples in 49.8 s.Collecting 81 more samples in 49.2 s.Collecting 80 more samples in 48.6 s.Collecting 79 more samples in 48.0 s.Collecting 78 more samples in 47.4 s.Collecting 77 more samples in 46.8 s.Collecting 76 more samples in 46.2 s.Collecting 75 more samples in 45.6 s.Collecting 74 more samples in 45.0 s.Collecting 73 more samples in 44.3 s.Collecting 72 more samples in 43.7 s.Collecting 71 more samples in 43.1 s.Collecting 70 more samples in 42.5 s.Collecting 69 more samples in 41.9 s.Collecting 68 more samples in 41.3 s.Collecting 67 more samples in 40.7 s.Collecting 66 more samples in 40.1 s.Collecting 65 more samples in 39.5 s.Collecting 64 more samples in 38.9 s.Collecting 63 more samples in 38.3 s.Collecting 62 more samples in 37.7 s.Collecting 61 more samples in 37.1 s.Collecting 60 more samples in 36.4 s.Collecting 59 more samples in 35.8 s.Collecting 58 more samples in 35.2 s.Collecting 57 more samples in 34.6 s.Collecting 56 more samples in 34.0 s.Collecting 55 more samples in 33.4 s.Collecting 54 more samples in 32.8 s.Collecting 53 more samples in 32.2 s.Collecting 52 more samples in 31.6 s.Collecting 51 more samples in 31.0 s.Collecting 50 more samples in 30.4 s.Collecting 49 more samples in 29.8 s.Collecting 48 more samples in 29.2 s.Collecting 47 more samples in 28.6 s.Collecting 46 more samples in 27.9 s.Collecting 45 more samples in 27.3 s.Collecting 44 more samples in 26.7 s.Collecting 43 more samples in 26.1 s.Collecting 42 more samples in 25.5 s.Collecting 41 more samples in 24.9 s.Collecting 40 more samples in 24.3 s.Collecting 39 more samples in 23.7 s.Collecting 38 more samples in 23.1 s.Collecting 37 more samples in 22.5 s.Collecting 36 more samples in 21.9 s.Collecting 35 more samples in 21.3 s.Collecting 34 more samples in 20.7 s.Collecting 33 more samples in 20.0 s.Collecting 32 more samples in 19.4 s.Collecting 31 more samples in 18.8 s.Collecting 30 more samples in 18.2 s.Collecting 29 more samples in 17.6 s.Collecting 28 more samples in 17.0 s.Collecting 27 more samples in 16.4 s.Collecting 26 more samples in 15.8 s.Collecting 25 more samples in 15.2 s.Collecting 24 more samples in 14.6 s.Collecting 23 more samples in 14.0 s.Collecting 22 more samples in 13.4 s.Collecting 21 more samples in 12.8 s.Collecting 20 more samples in 12.1 s.Collecting 19 more samples in 11.5 s.Collecting 18 more samples in 10.9 s.Collecting 17 more samples in 10.3 s.Collecting 16 more samples in 9.7 s.Collecting 15 more samples in 9.1 s.Collecting 14 more samples in 8.5 s.Collecting 13 more samples in 7.9 s.Collecting 12 more samples in 7.3 s.Collecting 11 more samples in 6.7 s.Collecting 10 more samples in 6.1 s.Collecting 9 more samples in 5.5 s.Collecting 8 more samples in 4.9 s.Collecting 7 more samples in 4.3 s.Collecting 6 more samples in 3.6 s.Collecting 5 more samples in 3.0 s.Collecting 4 more samples in 2.4 s.Collecting 3 more samples in 1.8 s.Collecting 2 more samples in 1.2 s.Collecting 1 more samples in 0.6 s.mean: 502.4145 ms, lower bound: 490.5989 ms, upper bound: 514.3475 ms, confidence: 0.950 std dev: 61.27591 ms, lower bound: 52.99832 ms, upper bound: 72.54615 ms, confidence: 0.950 found 3 outliers among 100 samples (3.0%) 2 (2.0%) high mild variance introduced by outliers: 85.223% variance is severely inflated by outliers commits: 200000 retries: 2040 allocated bytes: 825759848 Running a subject "16/12500/ttrie" Collecting 100 more samples in 12.2 s.Collecting 99 more samples in 12.1 s.Collecting 98 more samples in 12.0 s.Collecting 97 more samples in 11.9 s.Collecting 96 more samples in 11.7 s.Collecting 95 more samples in 11.6 s.Collecting 94 more samples in 11.5 s.Collecting 93 more samples in 11.4 s.Collecting 92 more samples in 11.3 s.Collecting 91 more samples in 11.1 s.Collecting 90 more samples in 11.0 s.Collecting 89 more samples in 10.9 s.Collecting 88 more samples in 10.8 s.Collecting 87 more samples in 10.6 s.Collecting 86 more samples in 10.5 s.Collecting 85 more samples in 10.4 s.Collecting 84 more samples in 10.3 s.Collecting 83 more samples in 10.2 s.Collecting 82 more samples in 10.0 s.Collecting 81 more samples in 9.9 s.Collecting 80 more samples in 9.8 s.Collecting 79 more samples in 9.7 s.Collecting 78 more samples in 9.5 s.Collecting 77 more samples in 9.4 s.Collecting 76 more samples in 9.3 s.Collecting 75 more samples in 9.2 s.Collecting 74 more samples in 9.1 s.Collecting 73 more samples in 8.9 s.Collecting 72 more samples in 8.8 s.Collecting 71 more samples in 8.7 s.Collecting 70 more samples in 8.6 s.Collecting 69 more samples in 8.4 s.Collecting 68 more samples in 8.3 s.Collecting 67 more samples in 8.2 s.Collecting 66 more samples in 8.1 s.Collecting 65 more samples in 8.0 s.Collecting 64 more samples in 7.8 s.Collecting 63 more samples in 7.7 s.Collecting 62 more samples in 7.6 s.Collecting 61 more samples in 7.5 s.Collecting 60 more samples in 7.3 s.Collecting 59 more samples in 7.2 s.Collecting 58 more samples in 7.1 s.Collecting 57 more samples in 7.0 s.Collecting 56 more samples in 6.9 s.Collecting 55 more samples in 6.7 s.Collecting 54 more samples in 6.6 s.Collecting 53 more samples in 6.5 s.Collecting 52 more samples in 6.4 s.Collecting 51 more samples in 6.2 s.Collecting 50 more samples in 6.1 s.Collecting 49 more samples in 6.0 s.Collecting 48 more samples in 5.9 s.Collecting 47 more samples in 5.8 s.Collecting 46 more samples in 5.6 s.Collecting 45 more samples in 5.5 s.Collecting 44 more samples in 5.4 s.Collecting 43 more samples in 5.3 s.Collecting 42 more samples in 5.1 s.Collecting 41 more samples in 5.0 s.Collecting 40 more samples in 4.9 s.Collecting 39 more samples in 4.8 s.Collecting 38 more samples in 4.7 s.Collecting 37 more samples in 4.5 s.Collecting 36 more samples in 4.4 s.Collecting 35 more samples in 4.3 s.Collecting 34 more samples in 4.2 s.Collecting 33 more samples in 4.0 s.Collecting 32 more samples in 3.9 s.Collecting 31 more samples in 3.8 s.Collecting 30 more samples in 3.7 s.Collecting 29 more samples in 3.5 s.Collecting 28 more samples in 3.4 s.Collecting 27 more samples in 3.3 s.Collecting 26 more samples in 3.2 s.Collecting 25 more samples in 3.1 s.Collecting 24 more samples in 2.9 s.Collecting 23 more samples in 2.8 s.Collecting 22 more samples in 2.7 s.Collecting 21 more samples in 2.6 s.Collecting 20 more samples in 2.4 s.Collecting 19 more samples in 2.3 s.Collecting 18 more samples in 2.2 s.Collecting 17 more samples in 2.1 s.Collecting 16 more samples in 2.0 s.Collecting 15 more samples in 1.8 s.Collecting 14 more samples in 1.7 s.Collecting 13 more samples in 1.6 s.Collecting 12 more samples in 1.5 s.Collecting 11 more samples in 1.3 s.Collecting 10 more samples in 1.2 s.Collecting 9 more samples in 1.1 s.Collecting 8 more samples in 1.0 s.Collecting 7 more samples in 0.9 s.Collecting 6 more samples in 0.7 s.Collecting 5 more samples in 0.6 s.Collecting 4 more samples in 0.5 s.Collecting 3 more samples in 0.4 s.Collecting 2 more samples in 0.2 s.Collecting 1 more samples in 0.1 s.mean: 130.0471 ms, lower bound: 127.2088 ms, upper bound: 133.2759 ms, confidence: 0.950 std dev: 15.56645 ms, lower bound: 13.41787 ms, upper bound: 18.58316 ms, confidence: 0.950 found 3 outliers among 100 samples (3.0%) 3 (3.0%) high mild variance introduced by outliers: 85.193% variance is severely inflated by outliers commits: 200000 retries: 2 allocated bytes: 252744024 Benchmark bench: FINISH