Preprocessing library ttrie-0.1.2... In-place registering ttrie-0.1.2... Preprocessing benchmark 'bench' for ttrie-0.1.2... Running 1 benchmarks... Benchmark bench: RUNNING... threads = [1,2,4,6,8,10,12,14,16] numTransactions = 200000 sizes = [(1,1),(2,1),(3,1),(4,1),(5,1)] numPrefill = 0 ops = (70,10,10,10) Generating 0 random keys to prefill... Generating 200000 random transactions... warming up estimating clock resolution... mean is 1.689018 us (320001 iterations) found 31840 outliers among 319999 samples (10.0%) 23 (7.2e-3%) low severe 31817 (9.9%) high severe estimating cost of a clock call... mean is 198.6826 ns (11 iterations) found 2 outliers among 11 samples (18.2%) 2 (18.2%) high severe Running a subject "1/200000/unordered-containers" Collecting 99 more samples in 159.3 s.Collecting 98 more samples in 157.7 s.Collecting 97 more samples in 156.1 s.Collecting 96 more samples in 154.5 s.Collecting 95 more samples in 152.9 s.Collecting 94 more samples in 151.3 s.Collecting 93 more samples in 149.7 s.Collecting 92 more samples in 148.1 s.Collecting 91 more samples in 146.4 s.Collecting 90 more samples in 144.8 s.Collecting 89 more samples in 143.2 s.Collecting 88 more samples in 141.6 s.Collecting 87 more samples in 140.0 s.Collecting 86 more samples in 138.4 s.Collecting 85 more samples in 136.8 s.Collecting 84 more samples in 135.2 s.Collecting 83 more samples in 133.6 s.Collecting 82 more samples in 132.0 s.Collecting 81 more samples in 130.4 s.Collecting 80 more samples in 128.7 s.Collecting 79 more samples in 127.1 s.Collecting 78 more samples in 125.5 s.Collecting 77 more samples in 123.9 s.Collecting 76 more samples in 122.3 s.Collecting 75 more samples in 120.7 s.Collecting 74 more samples in 119.1 s.Collecting 73 more samples in 117.5 s.Collecting 72 more samples in 115.9 s.Collecting 71 more samples in 114.3 s.Collecting 70 more samples in 112.7 s.Collecting 69 more samples in 111.0 s.Collecting 68 more samples in 109.4 s.Collecting 67 more samples in 107.8 s.Collecting 66 more samples in 106.2 s.Collecting 65 more samples in 104.6 s.Collecting 64 more samples in 103.0 s.Collecting 63 more samples in 101.4 s.Collecting 62 more samples in 99.8 s.Collecting 61 more samples in 98.2 s.Collecting 60 more samples in 96.6 s.Collecting 59 more samples in 94.9 s.Collecting 58 more samples in 93.3 s.Collecting 57 more samples in 91.7 s.Collecting 56 more samples in 90.1 s.Collecting 55 more samples in 88.5 s.Collecting 54 more samples in 86.9 s.Collecting 53 more samples in 85.3 s.Collecting 52 more samples in 83.7 s.Collecting 51 more samples in 82.1 s.Collecting 50 more samples in 80.5 s.Collecting 49 more samples in 78.9 s.Collecting 48 more samples in 77.2 s.Collecting 47 more samples in 75.6 s.Collecting 46 more samples in 74.0 s.Collecting 45 more samples in 72.4 s.Collecting 44 more samples in 70.8 s.Collecting 43 more samples in 69.2 s.Collecting 42 more samples in 67.6 s.Collecting 41 more samples in 66.0 s.Collecting 40 more samples in 64.4 s.Collecting 39 more samples in 62.8 s.Collecting 38 more samples in 61.2 s.Collecting 37 more samples in 59.5 s.Collecting 36 more samples in 57.9 s.Collecting 35 more samples in 56.3 s.Collecting 34 more samples in 54.7 s.Collecting 33 more samples in 53.1 s.Collecting 32 more samples in 51.5 s.Collecting 31 more samples in 49.9 s.Collecting 30 more samples in 48.3 s.Collecting 29 more samples in 46.7 s.Collecting 28 more samples in 45.1 s.Collecting 27 more samples in 43.5 s.Collecting 26 more samples in 41.8 s.Collecting 25 more samples in 40.2 s.Collecting 24 more samples in 38.6 s.Collecting 23 more samples in 37.0 s.Collecting 22 more samples in 35.4 s.Collecting 21 more samples in 33.8 s.Collecting 20 more samples in 32.2 s.Collecting 19 more samples in 30.6 s.Collecting 18 more samples in 29.0 s.Collecting 17 more samples in 27.4 s.Collecting 16 more samples in 25.7 s.Collecting 15 more samples in 24.1 s.Collecting 14 more samples in 22.5 s.Collecting 13 more samples in 20.9 s.Collecting 12 more samples in 19.3 s.Collecting 11 more samples in 17.7 s.Collecting 10 more samples in 16.1 s.Collecting 9 more samples in 14.5 s.Collecting 8 more samples in 12.9 s.Collecting 7 more samples in 11.3 s.Collecting 6 more samples in 9.7 s.Collecting 5 more samples in 8.0 s.Collecting 4 more samples in 6.4 s.Collecting 3 more samples in 4.8 s.Collecting 2 more samples in 3.2 s.Collecting 1 more samples in 1.6 s.mean: 1.745437 s, lower bound: 1.702352 s, upper bound: 1.803233 s, confidence: 0.950 std dev: 255.2103 ms, lower bound: 198.5205 ms, upper bound: 356.0997 ms, confidence: 0.950 found 3 outliers among 100 samples (3.0%) 2 (2.0%) high severe variance introduced by outliers: 89.408% variance is severely inflated by outliers commits: 200000 retries: 0 allocated bytes: 407863392 Running a subject "1/200000/stm-containers" Collecting 99 more samples in 230.0 s.Collecting 98 more samples in 227.7 s.Collecting 97 more samples in 225.4 s.Collecting 96 more samples in 223.1 s.Collecting 95 more samples in 220.7 s.Collecting 94 more samples in 218.4 s.Collecting 93 more samples in 216.1 s.Collecting 92 more samples in 213.8 s.Collecting 91 more samples in 211.5 s.Collecting 90 more samples in 209.1 s.Collecting 89 more samples in 206.8 s.Collecting 88 more samples in 204.5 s.Collecting 87 more samples in 202.2 s.Collecting 86 more samples in 199.8 s.Collecting 85 more samples in 197.5 s.Collecting 84 more samples in 195.2 s.Collecting 83 more samples in 192.9 s.Collecting 82 more samples in 190.5 s.Collecting 81 more samples in 188.2 s.Collecting 80 more samples in 185.9 s.Collecting 79 more samples in 183.6 s.Collecting 78 more samples in 181.2 s.Collecting 77 more samples in 178.9 s.Collecting 76 more samples in 176.6 s.Collecting 75 more samples in 174.3 s.Collecting 74 more samples in 171.9 s.Collecting 73 more samples in 169.6 s.Collecting 72 more samples in 167.3 s.Collecting 71 more samples in 165.0 s.Collecting 70 more samples in 162.7 s.Collecting 69 more samples in 160.3 s.Collecting 68 more samples in 158.0 s.Collecting 67 more samples in 155.7 s.Collecting 66 more samples in 153.4 s.Collecting 65 more samples in 151.0 s.Collecting 64 more samples in 148.7 s.Collecting 63 more samples in 146.4 s.Collecting 62 more samples in 144.1 s.Collecting 61 more samples in 141.7 s.Collecting 60 more samples in 139.4 s.Collecting 59 more samples in 137.1 s.Collecting 58 more samples in 134.8 s.Collecting 57 more samples in 132.4 s.Collecting 56 more samples in 130.1 s.Collecting 55 more samples in 127.8 s.Collecting 54 more samples in 125.5 s.Collecting 53 more samples in 123.2 s.Collecting 52 more samples in 120.8 s.Collecting 51 more samples in 118.5 s.Collecting 50 more samples in 116.2 s.Collecting 49 more samples in 113.9 s.Collecting 48 more samples in 111.5 s.Collecting 47 more samples in 109.2 s.Collecting 46 more samples in 106.9 s.Collecting 45 more samples in 104.6 s.Collecting 44 more samples in 102.2 s.Collecting 43 more samples in 99.9 s.Collecting 42 more samples in 97.6 s.Collecting 41 more samples in 95.3 s.Collecting 40 more samples in 92.9 s.Collecting 39 more samples in 90.6 s.Collecting 38 more samples in 88.3 s.Collecting 37 more samples in 86.0 s.Collecting 36 more samples in 83.7 s.Collecting 35 more samples in 81.3 s.Collecting 34 more samples in 79.0 s.Collecting 33 more samples in 76.7 s.Collecting 32 more samples in 74.4 s.Collecting 31 more samples in 72.0 s.Collecting 30 more samples in 69.7 s.Collecting 29 more samples in 67.4 s.Collecting 28 more samples in 65.1 s.Collecting 27 more samples in 62.7 s.Collecting 26 more samples in 60.4 s.Collecting 25 more samples in 58.1 s.Collecting 24 more samples in 55.8 s.Collecting 23 more samples in 53.4 s.Collecting 22 more samples in 51.1 s.Collecting 21 more samples in 48.8 s.Collecting 20 more samples in 46.5 s.Collecting 19 more samples in 44.1 s.Collecting 18 more samples in 41.8 s.Collecting 17 more samples in 39.5 s.Collecting 16 more samples in 37.2 s.Collecting 15 more samples in 34.9 s.Collecting 14 more samples in 32.5 s.Collecting 13 more samples in 30.2 s.Collecting 12 more samples in 27.9 s.Collecting 11 more samples in 25.6 s.Collecting 10 more samples in 23.2 s.Collecting 9 more samples in 20.9 s.Collecting 8 more samples in 18.6 s.Collecting 7 more samples in 16.3 s.Collecting 6 more samples in 13.9 s.Collecting 5 more samples in 11.6 s.Collecting 4 more samples in 9.3 s.Collecting 3 more samples in 7.0 s.Collecting 2 more samples in 4.6 s.Collecting 1 more samples in 2.3 s.mean: 2.074113 s, lower bound: 2.050644 s, upper bound: 2.104643 s, confidence: 0.950 std dev: 136.6114 ms, lower bound: 107.9693 ms, upper bound: 188.0479 ms, confidence: 0.950 found 7 outliers among 100 samples (7.0%) 4 (4.0%) high mild 2 (2.0%) high severe variance introduced by outliers: 61.570% variance is severely inflated by outliers commits: 200000 retries: 0 allocated bytes: 684411616 Running a subject "1/200000/ttrie" Collecting 99 more samples in 188.3 s.Collecting 98 more samples in 186.4 s.Collecting 97 more samples in 184.5 s.Collecting 96 more samples in 182.5 s.Collecting 95 more samples in 180.6 s.Collecting 94 more samples in 178.7 s.Collecting 93 more samples in 176.8 s.Collecting 92 more samples in 174.9 s.Collecting 91 more samples in 173.0 s.Collecting 90 more samples in 171.1 s.Collecting 89 more samples in 169.2 s.Collecting 88 more samples in 167.3 s.Collecting 87 more samples in 165.4 s.Collecting 86 more samples in 163.5 s.Collecting 85 more samples in 161.6 s.Collecting 84 more samples in 159.7 s.Collecting 83 more samples in 157.8 s.Collecting 82 more samples in 155.9 s.Collecting 81 more samples in 154.0 s.Collecting 80 more samples in 152.1 s.Collecting 79 more samples in 150.2 s.Collecting 78 more samples in 148.3 s.Collecting 77 more samples in 146.4 s.Collecting 76 more samples in 144.5 s.Collecting 75 more samples in 142.6 s.Collecting 74 more samples in 140.7 s.Collecting 73 more samples in 138.8 s.Collecting 72 more samples in 136.9 s.Collecting 71 more samples in 135.0 s.Collecting 70 more samples in 133.1 s.Collecting 69 more samples in 131.2 s.Collecting 68 more samples in 129.3 s.Collecting 67 more samples in 127.4 s.Collecting 66 more samples in 125.5 s.Collecting 65 more samples in 123.6 s.Collecting 64 more samples in 121.7 s.Collecting 63 more samples in 119.8 s.Collecting 62 more samples in 117.9 s.Collecting 61 more samples in 116.0 s.Collecting 60 more samples in 114.1 s.Collecting 59 more samples in 112.2 s.Collecting 58 more samples in 110.3 s.Collecting 57 more samples in 108.4 s.Collecting 56 more samples in 106.5 s.Collecting 55 more samples in 104.6 s.Collecting 54 more samples in 102.7 s.Collecting 53 more samples in 100.8 s.Collecting 52 more samples in 98.9 s.Collecting 51 more samples in 97.0 s.Collecting 50 more samples in 95.1 s.Collecting 49 more samples in 93.2 s.Collecting 48 more samples in 91.3 s.Collecting 47 more samples in 89.4 s.Collecting 46 more samples in 87.5 s.Collecting 45 more samples in 85.6 s.Collecting 44 more samples in 83.7 s.Collecting 43 more samples in 81.8 s.Collecting 42 more samples in 79.9 s.Collecting 41 more samples in 78.0 s.Collecting 40 more samples in 76.1 s.Collecting 39 more samples in 74.2 s.Collecting 38 more samples in 72.3 s.Collecting 37 more samples in 70.4 s.Collecting 36 more samples in 68.5 s.Collecting 35 more samples in 66.6 s.Collecting 34 more samples in 64.7 s.Collecting 33 more samples in 62.8 s.Collecting 32 more samples in 60.8 s.Collecting 31 more samples in 58.9 s.Collecting 30 more samples in 57.0 s.Collecting 29 more samples in 55.1 s.Collecting 28 more samples in 53.2 s.Collecting 27 more samples in 51.3 s.Collecting 26 more samples in 49.4 s.Collecting 25 more samples in 47.5 s.Collecting 24 more samples in 45.6 s.Collecting 23 more samples in 43.7 s.Collecting 22 more samples in 41.8 s.Collecting 21 more samples in 39.9 s.Collecting 20 more samples in 38.0 s.Collecting 19 more samples in 36.1 s.Collecting 18 more samples in 34.2 s.Collecting 17 more samples in 32.3 s.Collecting 16 more samples in 30.4 s.Collecting 15 more samples in 28.5 s.Collecting 14 more samples in 26.6 s.Collecting 13 more samples in 24.7 s.Collecting 12 more samples in 22.8 s.Collecting 11 more samples in 20.9 s.Collecting 10 more samples in 19.0 s.Collecting 9 more samples in 17.1 s.Collecting 8 more samples in 15.2 s.Collecting 7 more samples in 13.3 s.Collecting 6 more samples in 11.4 s.Collecting 5 more samples in 9.5 s.Collecting 4 more samples in 7.6 s.Collecting 3 more samples in 5.7 s.Collecting 2 more samples in 3.8 s.Collecting 1 more samples in 1.9 s.mean: 1.956469 s, lower bound: 1.933693 s, upper bound: 1.981636 s, confidence: 0.950 std dev: 122.7679 ms, lower bound: 106.4549 ms, upper bound: 147.5610 ms, confidence: 0.950 found 1 outliers among 100 samples (1.0%) variance introduced by outliers: 59.523% variance is severely inflated by outliers commits: 200000 retries: 0 allocated bytes: 380542536 Running a subject "2/100000/unordered-containers" Collecting 99 more samples in 141.5 s.Collecting 98 more samples in 140.1 s.Collecting 97 more samples in 138.6 s.Collecting 96 more samples in 137.2 s.Collecting 95 more samples in 135.8 s.Collecting 94 more samples in 134.3 s.Collecting 93 more samples in 132.9 s.Collecting 92 more samples in 131.5 s.Collecting 91 more samples in 130.1 s.Collecting 90 more samples in 128.6 s.Collecting 89 more samples in 127.2 s.Collecting 88 more samples in 125.8 s.Collecting 87 more samples in 124.3 s.Collecting 86 more samples in 122.9 s.Collecting 85 more samples in 121.5 s.Collecting 84 more samples in 120.0 s.Collecting 83 more samples in 118.6 s.Collecting 82 more samples in 117.2 s.Collecting 81 more samples in 115.8 s.Collecting 80 more samples in 114.3 s.Collecting 79 more samples in 112.9 s.Collecting 78 more samples in 111.5 s.Collecting 77 more samples in 110.0 s.Collecting 76 more samples in 108.6 s.Collecting 75 more samples in 107.2 s.Collecting 74 more samples in 105.8 s.Collecting 73 more samples in 104.3 s.Collecting 72 more samples in 102.9 s.Collecting 71 more samples in 101.5 s.Collecting 70 more samples in 100.0 s.Collecting 69 more samples in 98.6 s.Collecting 68 more samples in 97.2 s.Collecting 67 more samples in 95.8 s.Collecting 66 more samples in 94.3 s.Collecting 65 more samples in 92.9 s.Collecting 64 more samples in 91.5 s.Collecting 63 more samples in 90.0 s.Collecting 62 more samples in 88.6 s.Collecting 61 more samples in 87.2 s.Collecting 60 more samples in 85.7 s.Collecting 59 more samples in 84.3 s.Collecting 58 more samples in 82.9 s.Collecting 57 more samples in 81.5 s.Collecting 56 more samples in 80.0 s.Collecting 55 more samples in 78.6 s.Collecting 54 more samples in 77.2 s.Collecting 53 more samples in 75.7 s.Collecting 52 more samples in 74.3 s.Collecting 51 more samples in 72.9 s.Collecting 50 more samples in 71.5 s.Collecting 49 more samples in 70.0 s.Collecting 48 more samples in 68.6 s.Collecting 47 more samples in 67.2 s.Collecting 46 more samples in 65.7 s.Collecting 45 more samples in 64.3 s.Collecting 44 more samples in 62.9 s.Collecting 43 more samples in 61.5 s.Collecting 42 more samples in 60.0 s.Collecting 41 more samples in 58.6 s.Collecting 40 more samples in 57.2 s.Collecting 39 more samples in 55.7 s.Collecting 38 more samples in 54.3 s.Collecting 37 more samples in 52.9 s.Collecting 36 more samples in 51.4 s.Collecting 35 more samples in 50.0 s.Collecting 34 more samples in 48.6 s.Collecting 33 more samples in 47.2 s.Collecting 32 more samples in 45.7 s.Collecting 31 more samples in 44.3 s.Collecting 30 more samples in 42.9 s.Collecting 29 more samples in 41.4 s.Collecting 28 more samples in 40.0 s.Collecting 27 more samples in 38.6 s.Collecting 26 more samples in 37.2 s.Collecting 25 more samples in 35.7 s.Collecting 24 more samples in 34.3 s.Collecting 23 more samples in 32.9 s.Collecting 22 more samples in 31.4 s.Collecting 21 more samples in 30.0 s.Collecting 20 more samples in 28.6 s.Collecting 19 more samples in 27.2 s.Collecting 18 more samples in 25.7 s.Collecting 17 more samples in 24.3 s.Collecting 16 more samples in 22.9 s.Collecting 15 more samples in 21.4 s.Collecting 14 more samples in 20.0 s.Collecting 13 more samples in 18.6 s.Collecting 12 more samples in 17.1 s.Collecting 11 more samples in 15.7 s.Collecting 10 more samples in 14.3 s.Collecting 9 more samples in 12.9 s.Collecting 8 more samples in 11.4 s.Collecting 7 more samples in 10.0 s.Collecting 6 more samples in 8.6 s.Collecting 5 more samples in 7.1 s.Collecting 4 more samples in 5.7 s.Collecting 3 more samples in 4.3 s.Collecting 2 more samples in 2.9 s.Collecting 1 more samples in 1.4 s.mean: 1.544666 s, lower bound: 1.514158 s, upper bound: 1.576707 s, confidence: 0.950 std dev: 160.6704 ms, lower bound: 144.8862 ms, upper bound: 189.9762 ms, confidence: 0.950 found 1 outliers among 100 samples (1.0%) variance introduced by outliers: 81.029% variance is severely inflated by outliers commits: 200000 retries: 157671 allocated bytes: 869739616 Running a subject "2/100000/stm-containers" Collecting 99 more samples in 105.2 s.Collecting 98 more samples in 104.1 s.Collecting 97 more samples in 103.0 s.Collecting 96 more samples in 102.0 s.Collecting 95 more samples in 100.9 s.Collecting 94 more samples in 99.9 s.Collecting 93 more samples in 98.8 s.Collecting 92 more samples in 97.7 s.Collecting 91 more samples in 96.7 s.Collecting 90 more samples in 95.6 s.Collecting 89 more samples in 94.5 s.Collecting 88 more samples in 93.5 s.Collecting 87 more samples in 92.4 s.Collecting 86 more samples in 91.4 s.Collecting 85 more samples in 90.3 s.Collecting 84 more samples in 89.2 s.Collecting 83 more samples in 88.2 s.Collecting 82 more samples in 87.1 s.Collecting 81 more samples in 86.0 s.Collecting 80 more samples in 85.0 s.Collecting 79 more samples in 83.9 s.Collecting 78 more samples in 82.9 s.Collecting 77 more samples in 81.8 s.Collecting 76 more samples in 80.7 s.Collecting 75 more samples in 79.7 s.Collecting 74 more samples in 78.6 s.Collecting 73 more samples in 77.5 s.Collecting 72 more samples in 76.5 s.Collecting 71 more samples in 75.4 s.Collecting 70 more samples in 74.4 s.Collecting 69 more samples in 73.3 s.Collecting 68 more samples in 72.2 s.Collecting 67 more samples in 71.2 s.Collecting 66 more samples in 70.1 s.Collecting 65 more samples in 69.1 s.Collecting 64 more samples in 68.0 s.Collecting 63 more samples in 66.9 s.Collecting 62 more samples in 65.9 s.Collecting 61 more samples in 64.8 s.Collecting 60 more samples in 63.7 s.Collecting 59 more samples in 62.7 s.Collecting 58 more samples in 61.6 s.Collecting 57 more samples in 60.6 s.Collecting 56 more samples in 59.5 s.Collecting 55 more samples in 58.4 s.Collecting 54 more samples in 57.4 s.Collecting 53 more samples in 56.3 s.Collecting 52 more samples in 55.2 s.Collecting 51 more samples in 54.2 s.Collecting 50 more samples in 53.1 s.Collecting 49 more samples in 52.1 s.Collecting 48 more samples in 51.0 s.Collecting 47 more samples in 49.9 s.Collecting 46 more samples in 48.9 s.Collecting 45 more samples in 47.8 s.Collecting 44 more samples in 46.7 s.Collecting 43 more samples in 45.7 s.Collecting 42 more samples in 44.6 s.Collecting 41 more samples in 43.6 s.Collecting 40 more samples in 42.5 s.Collecting 39 more samples in 41.4 s.Collecting 38 more samples in 40.4 s.Collecting 37 more samples in 39.3 s.Collecting 36 more samples in 38.2 s.Collecting 35 more samples in 37.2 s.Collecting 34 more samples in 36.1 s.Collecting 33 more samples in 35.1 s.Collecting 32 more samples in 34.0 s.Collecting 31 more samples in 32.9 s.Collecting 30 more samples in 31.9 s.Collecting 29 more samples in 30.8 s.Collecting 28 more samples in 29.7 s.Collecting 27 more samples in 28.7 s.Collecting 26 more samples in 27.6 s.Collecting 25 more samples in 26.6 s.Collecting 24 more samples in 25.5 s.Collecting 23 more samples in 24.4 s.Collecting 22 more samples in 23.4 s.Collecting 21 more samples in 22.3 s.Collecting 20 more samples in 21.2 s.Collecting 19 more samples in 20.2 s.Collecting 18 more samples in 19.1 s.Collecting 17 more samples in 18.1 s.Collecting 16 more samples in 17.0 s.Collecting 15 more samples in 15.9 s.Collecting 14 more samples in 14.9 s.Collecting 13 more samples in 13.8 s.Collecting 12 more samples in 12.7 s.Collecting 11 more samples in 11.7 s.Collecting 10 more samples in 10.6 s.Collecting 9 more samples in 9.6 s.Collecting 8 more samples in 8.5 s.Collecting 7 more samples in 7.4 s.Collecting 6 more samples in 6.4 s.Collecting 5 more samples in 5.3 s.Collecting 4 more samples in 4.2 s.Collecting 3 more samples in 3.2 s.Collecting 2 more samples in 2.1 s.Collecting 1 more samples in 1.1 s.mean: 1.190783 s, lower bound: 1.173684 s, upper bound: 1.208503 s, confidence: 0.950 std dev: 89.14041 ms, lower bound: 78.99303 ms, upper bound: 108.8218 ms, confidence: 0.950 found 1 outliers among 100 samples (1.0%) variance introduced by outliers: 67.673% variance is severely inflated by outliers commits: 200000 retries: 291 allocated bytes: 679270592 Running a subject "2/100000/ttrie" Collecting 99 more samples in 117.4 s.Collecting 98 more samples in 116.2 s.Collecting 97 more samples in 115.0 s.Collecting 96 more samples in 113.8 s.Collecting 95 more samples in 112.7 s.Collecting 94 more samples in 111.5 s.Collecting 93 more samples in 110.3 s.Collecting 92 more samples in 109.1 s.Collecting 91 more samples in 107.9 s.Collecting 90 more samples in 106.7 s.Collecting 89 more samples in 105.5 s.Collecting 88 more samples in 104.4 s.Collecting 87 more samples in 103.2 s.Collecting 86 more samples in 102.0 s.Collecting 85 more samples in 100.8 s.Collecting 84 more samples in 99.6 s.Collecting 83 more samples in 98.4 s.Collecting 82 more samples in 97.2 s.Collecting 81 more samples in 96.1 s.Collecting 80 more samples in 94.9 s.Collecting 79 more samples in 93.7 s.Collecting 78 more samples in 92.5 s.Collecting 77 more samples in 91.3 s.Collecting 76 more samples in 90.1 s.Collecting 75 more samples in 88.9 s.Collecting 74 more samples in 87.8 s.Collecting 73 more samples in 86.6 s.Collecting 72 more samples in 85.4 s.Collecting 71 more samples in 84.2 s.Collecting 70 more samples in 83.0 s.Collecting 69 more samples in 81.8 s.Collecting 68 more samples in 80.6 s.Collecting 67 more samples in 79.4 s.Collecting 66 more samples in 78.3 s.Collecting 65 more samples in 77.1 s.Collecting 64 more samples in 75.9 s.Collecting 63 more samples in 74.7 s.Collecting 62 more samples in 73.5 s.Collecting 61 more samples in 72.3 s.Collecting 60 more samples in 71.1 s.Collecting 59 more samples in 70.0 s.Collecting 58 more samples in 68.8 s.Collecting 57 more samples in 67.6 s.Collecting 56 more samples in 66.4 s.Collecting 55 more samples in 65.2 s.Collecting 54 more samples in 64.0 s.Collecting 53 more samples in 62.8 s.Collecting 52 more samples in 61.7 s.Collecting 51 more samples in 60.5 s.Collecting 50 more samples in 59.3 s.Collecting 49 more samples in 58.1 s.Collecting 48 more samples in 56.9 s.Collecting 47 more samples in 55.7 s.Collecting 46 more samples in 54.5 s.Collecting 45 more samples in 53.4 s.Collecting 44 more samples in 52.2 s.Collecting 43 more samples in 51.0 s.Collecting 42 more samples in 49.8 s.Collecting 41 more samples in 48.6 s.Collecting 40 more samples in 47.4 s.Collecting 39 more samples in 46.2 s.Collecting 38 more samples in 45.1 s.Collecting 37 more samples in 43.9 s.Collecting 36 more samples in 42.7 s.Collecting 35 more samples in 41.5 s.Collecting 34 more samples in 40.3 s.Collecting 33 more samples in 39.1 s.Collecting 32 more samples in 37.9 s.Collecting 31 more samples in 36.8 s.Collecting 30 more samples in 35.6 s.Collecting 29 more samples in 34.4 s.Collecting 28 more samples in 33.2 s.Collecting 27 more samples in 32.0 s.Collecting 26 more samples in 30.8 s.Collecting 25 more samples in 29.6 s.Collecting 24 more samples in 28.5 s.Collecting 23 more samples in 27.3 s.Collecting 22 more samples in 26.1 s.Collecting 21 more samples in 24.9 s.Collecting 20 more samples in 23.7 s.Collecting 19 more samples in 22.5 s.Collecting 18 more samples in 21.3 s.Collecting 17 more samples in 20.2 s.Collecting 16 more samples in 19.0 s.Collecting 15 more samples in 17.8 s.Collecting 14 more samples in 16.6 s.Collecting 13 more samples in 15.4 s.Collecting 12 more samples in 14.2 s.Collecting 11 more samples in 13.0 s.Collecting 10 more samples in 11.9 s.Collecting 9 more samples in 10.7 s.Collecting 8 more samples in 9.5 s.Collecting 7 more samples in 8.3 s.Collecting 6 more samples in 7.1 s.Collecting 5 more samples in 5.9 s.Collecting 4 more samples in 4.7 s.Collecting 3 more samples in 3.6 s.Collecting 2 more samples in 2.4 s.Collecting 1 more samples in 1.2 s.mean: 1.223076 s, lower bound: 1.208626 s, upper bound: 1.238640 s, confidence: 0.950 std dev: 76.91532 ms, lower bound: 66.65947 ms, upper bound: 94.10039 ms, confidence: 0.950 found 1 outliers among 100 samples (1.0%) variance introduced by outliers: 59.530% variance is severely inflated by outliers commits: 200000 retries: 0 allocated bytes: 382221168 Running a subject "4/50000/unordered-containers" Collecting 99 more samples in 119.0 s.Collecting 98 more samples in 117.8 s.Collecting 97 more samples in 116.6 s.Collecting 96 more samples in 115.4 s.Collecting 95 more samples in 114.2 s.Collecting 94 more samples in 113.0 s.Collecting 93 more samples in 111.8 s.Collecting 92 more samples in 110.6 s.Collecting 91 more samples in 109.4 s.Collecting 90 more samples in 108.2 s.Collecting 89 more samples in 107.0 s.Collecting 88 more samples in 105.8 s.Collecting 87 more samples in 104.6 s.Collecting 86 more samples in 103.4 s.Collecting 85 more samples in 102.2 s.Collecting 84 more samples in 101.0 s.Collecting 83 more samples in 99.8 s.Collecting 82 more samples in 98.6 s.Collecting 81 more samples in 97.4 s.Collecting 80 more samples in 96.2 s.Collecting 79 more samples in 95.0 s.Collecting 78 more samples in 93.7 s.Collecting 77 more samples in 92.5 s.Collecting 76 more samples in 91.3 s.Collecting 75 more samples in 90.1 s.Collecting 74 more samples in 88.9 s.Collecting 73 more samples in 87.7 s.Collecting 72 more samples in 86.5 s.Collecting 71 more samples in 85.3 s.Collecting 70 more samples in 84.1 s.Collecting 69 more samples in 82.9 s.Collecting 68 more samples in 81.7 s.Collecting 67 more samples in 80.5 s.Collecting 66 more samples in 79.3 s.Collecting 65 more samples in 78.1 s.Collecting 64 more samples in 76.9 s.Collecting 63 more samples in 75.7 s.Collecting 62 more samples in 74.5 s.Collecting 61 more samples in 73.3 s.Collecting 60 more samples in 72.1 s.Collecting 59 more samples in 70.9 s.Collecting 58 more samples in 69.7 s.Collecting 57 more samples in 68.5 s.Collecting 56 more samples in 67.3 s.Collecting 55 more samples in 66.1 s.Collecting 54 more samples in 64.9 s.Collecting 53 more samples in 63.7 s.Collecting 52 more samples in 62.5 s.Collecting 51 more samples in 61.3 s.Collecting 50 more samples in 60.1 s.Collecting 49 more samples in 58.9 s.Collecting 48 more samples in 57.7 s.Collecting 47 more samples in 56.5 s.Collecting 46 more samples in 55.3 s.Collecting 45 more samples in 54.1 s.Collecting 44 more samples in 52.9 s.Collecting 43 more samples in 51.7 s.Collecting 42 more samples in 50.5 s.Collecting 41 more samples in 49.3 s.Collecting 40 more samples in 48.1 s.Collecting 39 more samples in 46.9 s.Collecting 38 more samples in 45.7 s.Collecting 37 more samples in 44.5 s.Collecting 36 more samples in 43.3 s.Collecting 35 more samples in 42.1 s.Collecting 34 more samples in 40.9 s.Collecting 33 more samples in 39.7 s.Collecting 32 more samples in 38.5 s.Collecting 31 more samples in 37.3 s.Collecting 30 more samples in 36.1 s.Collecting 29 more samples in 34.9 s.Collecting 28 more samples in 33.7 s.Collecting 27 more samples in 32.5 s.Collecting 26 more samples in 31.2 s.Collecting 25 more samples in 30.0 s.Collecting 24 more samples in 28.8 s.Collecting 23 more samples in 27.6 s.Collecting 22 more samples in 26.4 s.Collecting 21 more samples in 25.2 s.Collecting 20 more samples in 24.0 s.Collecting 19 more samples in 22.8 s.Collecting 18 more samples in 21.6 s.Collecting 17 more samples in 20.4 s.Collecting 16 more samples in 19.2 s.Collecting 15 more samples in 18.0 s.Collecting 14 more samples in 16.8 s.Collecting 13 more samples in 15.6 s.Collecting 12 more samples in 14.4 s.Collecting 11 more samples in 13.2 s.Collecting 10 more samples in 12.0 s.Collecting 9 more samples in 10.8 s.Collecting 8 more samples in 9.6 s.Collecting 7 more samples in 8.4 s.Collecting 6 more samples in 7.2 s.Collecting 5 more samples in 6.0 s.Collecting 4 more samples in 4.8 s.Collecting 3 more samples in 3.6 s.Collecting 2 more samples in 2.4 s.Collecting 1 more samples in 1.2 s.mean: 1.355729 s, lower bound: 1.331703 s, upper bound: 1.378773 s, confidence: 0.950 std dev: 121.5515 ms, lower bound: 110.4827 ms, upper bound: 137.0331 ms, confidence: 0.950 variance introduced by outliers: 75.848% variance is severely inflated by outliers commits: 200000 retries: 389477 allocated bytes: 1560019408 Running a subject "4/50000/stm-containers" Collecting 99 more samples in 63.8 s.Collecting 98 more samples in 63.2 s.Collecting 97 more samples in 62.5 s.Collecting 96 more samples in 61.9 s.Collecting 95 more samples in 61.2 s.Collecting 94 more samples in 60.6 s.Collecting 93 more samples in 60.0 s.Collecting 92 more samples in 59.3 s.Collecting 91 more samples in 58.7 s.Collecting 90 more samples in 58.0 s.Collecting 89 more samples in 57.4 s.Collecting 88 more samples in 56.7 s.Collecting 87 more samples in 56.1 s.Collecting 86 more samples in 55.4 s.Collecting 85 more samples in 54.8 s.Collecting 84 more samples in 54.1 s.Collecting 83 more samples in 53.5 s.Collecting 82 more samples in 52.9 s.Collecting 81 more samples in 52.2 s.Collecting 80 more samples in 51.6 s.Collecting 79 more samples in 50.9 s.Collecting 78 more samples in 50.3 s.Collecting 77 more samples in 49.6 s.Collecting 76 more samples in 49.0 s.Collecting 75 more samples in 48.3 s.Collecting 74 more samples in 47.7 s.Collecting 73 more samples in 47.1 s.Collecting 72 more samples in 46.4 s.Collecting 71 more samples in 45.8 s.Collecting 70 more samples in 45.1 s.Collecting 69 more samples in 44.5 s.Collecting 68 more samples in 43.8 s.Collecting 67 more samples in 43.2 s.Collecting 66 more samples in 42.5 s.Collecting 65 more samples in 41.9 s.Collecting 64 more samples in 41.3 s.Collecting 63 more samples in 40.6 s.Collecting 62 more samples in 40.0 s.Collecting 61 more samples in 39.3 s.Collecting 60 more samples in 38.7 s.Collecting 59 more samples in 38.0 s.Collecting 58 more samples in 37.4 s.Collecting 57 more samples in 36.7 s.Collecting 56 more samples in 36.1 s.Collecting 55 more samples in 35.5 s.Collecting 54 more samples in 34.8 s.Collecting 53 more samples in 34.2 s.Collecting 52 more samples in 33.5 s.Collecting 51 more samples in 32.9 s.Collecting 50 more samples in 32.2 s.Collecting 49 more samples in 31.6 s.Collecting 48 more samples in 30.9 s.Collecting 47 more samples in 30.3 s.Collecting 46 more samples in 29.7 s.Collecting 45 more samples in 29.0 s.Collecting 44 more samples in 28.4 s.Collecting 43 more samples in 27.7 s.Collecting 42 more samples in 27.1 s.Collecting 41 more samples in 26.4 s.Collecting 40 more samples in 25.8 s.Collecting 39 more samples in 25.1 s.Collecting 38 more samples in 24.5 s.Collecting 37 more samples in 23.9 s.Collecting 36 more samples in 23.2 s.Collecting 35 more samples in 22.6 s.Collecting 34 more samples in 21.9 s.Collecting 33 more samples in 21.3 s.Collecting 32 more samples in 20.6 s.Collecting 31 more samples in 20.0 s.Collecting 30 more samples in 19.3 s.Collecting 29 more samples in 18.7 s.Collecting 28 more samples in 18.0 s.Collecting 27 more samples in 17.4 s.Collecting 26 more samples in 16.8 s.Collecting 25 more samples in 16.1 s.Collecting 24 more samples in 15.5 s.Collecting 23 more samples in 14.8 s.Collecting 22 more samples in 14.2 s.Collecting 21 more samples in 13.5 s.Collecting 20 more samples in 12.9 s.Collecting 19 more samples in 12.2 s.Collecting 18 more samples in 11.6 s.Collecting 17 more samples in 11.0 s.Collecting 16 more samples in 10.3 s.Collecting 15 more samples in 9.7 s.Collecting 14 more samples in 9.0 s.Collecting 13 more samples in 8.4 s.Collecting 12 more samples in 7.7 s.Collecting 11 more samples in 7.1 s.Collecting 10 more samples in 6.4 s.Collecting 9 more samples in 5.8 s.Collecting 8 more samples in 5.2 s.Collecting 7 more samples in 4.5 s.Collecting 6 more samples in 3.9 s.Collecting 5 more samples in 3.2 s.Collecting 4 more samples in 2.6 s.Collecting 3 more samples in 1.9 s.Collecting 2 more samples in 1.3 s.Collecting 1 more samples in 0.6 s.mean: 678.1017 ms, lower bound: 670.4089 ms, upper bound: 686.8581 ms, confidence: 0.950 std dev: 42.12481 ms, lower bound: 35.95292 ms, upper bound: 51.22463 ms, confidence: 0.950 found 3 outliers among 100 samples (3.0%) 3 (3.0%) high mild variance introduced by outliers: 59.493% variance is severely inflated by outliers commits: 200000 retries: 1136 allocated bytes: 677347368 Running a subject "4/50000/ttrie" Collecting 99 more samples in 65.7 s.Collecting 98 more samples in 65.0 s.Collecting 97 more samples in 64.3 s.Collecting 96 more samples in 63.7 s.Collecting 95 more samples in 63.0 s.Collecting 94 more samples in 62.3 s.Collecting 93 more samples in 61.7 s.Collecting 92 more samples in 61.0 s.Collecting 91 more samples in 60.3 s.Collecting 90 more samples in 59.7 s.Collecting 89 more samples in 59.0 s.Collecting 88 more samples in 58.4 s.Collecting 87 more samples in 57.7 s.Collecting 86 more samples in 57.0 s.Collecting 85 more samples in 56.4 s.Collecting 84 more samples in 55.7 s.Collecting 83 more samples in 55.0 s.Collecting 82 more samples in 54.4 s.Collecting 81 more samples in 53.7 s.Collecting 80 more samples in 53.1 s.Collecting 79 more samples in 52.4 s.Collecting 78 more samples in 51.7 s.Collecting 77 more samples in 51.1 s.Collecting 76 more samples in 50.4 s.Collecting 75 more samples in 49.7 s.Collecting 74 more samples in 49.1 s.Collecting 73 more samples in 48.4 s.Collecting 72 more samples in 47.7 s.Collecting 71 more samples in 47.1 s.Collecting 70 more samples in 46.4 s.Collecting 69 more samples in 45.8 s.Collecting 68 more samples in 45.1 s.Collecting 67 more samples in 44.4 s.Collecting 66 more samples in 43.8 s.Collecting 65 more samples in 43.1 s.Collecting 64 more samples in 42.4 s.Collecting 63 more samples in 41.8 s.Collecting 62 more samples in 41.1 s.Collecting 61 more samples in 40.5 s.Collecting 60 more samples in 39.8 s.Collecting 59 more samples in 39.1 s.Collecting 58 more samples in 38.5 s.Collecting 57 more samples in 37.8 s.Collecting 56 more samples in 37.1 s.Collecting 55 more samples in 36.5 s.Collecting 54 more samples in 35.8 s.Collecting 53 more samples in 35.1 s.Collecting 52 more samples in 34.5 s.Collecting 51 more samples in 33.8 s.Collecting 50 more samples in 33.2 s.Collecting 49 more samples in 32.5 s.Collecting 48 more samples in 31.8 s.Collecting 47 more samples in 31.2 s.Collecting 46 more samples in 30.5 s.Collecting 45 more samples in 29.8 s.Collecting 44 more samples in 29.2 s.Collecting 43 more samples in 28.5 s.Collecting 42 more samples in 27.9 s.Collecting 41 more samples in 27.2 s.Collecting 40 more samples in 26.5 s.Collecting 39 more samples in 25.9 s.Collecting 38 more samples in 25.2 s.Collecting 37 more samples in 24.5 s.Collecting 36 more samples in 23.9 s.Collecting 35 more samples in 23.2 s.Collecting 34 more samples in 22.5 s.Collecting 33 more samples in 21.9 s.Collecting 32 more samples in 21.2 s.Collecting 31 more samples in 20.6 s.Collecting 30 more samples in 19.9 s.Collecting 29 more samples in 19.2 s.Collecting 28 more samples in 18.6 s.Collecting 27 more samples in 17.9 s.Collecting 26 more samples in 17.2 s.Collecting 25 more samples in 16.6 s.Collecting 24 more samples in 15.9 s.Collecting 23 more samples in 15.3 s.Collecting 22 more samples in 14.6 s.Collecting 21 more samples in 13.9 s.Collecting 20 more samples in 13.3 s.Collecting 19 more samples in 12.6 s.Collecting 18 more samples in 11.9 s.Collecting 17 more samples in 11.3 s.Collecting 16 more samples in 10.6 s.Collecting 15 more samples in 9.9 s.Collecting 14 more samples in 9.3 s.Collecting 13 more samples in 8.6 s.Collecting 12 more samples in 8.0 s.Collecting 11 more samples in 7.3 s.Collecting 10 more samples in 6.6 s.Collecting 9 more samples in 6.0 s.Collecting 8 more samples in 5.3 s.Collecting 7 more samples in 4.6 s.Collecting 6 more samples in 4.0 s.Collecting 5 more samples in 3.3 s.Collecting 4 more samples in 2.7 s.Collecting 3 more samples in 2.0 s.Collecting 2 more samples in 1.3 s.Collecting 1 more samples in 0.7 s.mean: 682.9694 ms, lower bound: 673.7685 ms, upper bound: 693.5750 ms, confidence: 0.950 std dev: 50.31315 ms, lower bound: 43.49968 ms, upper bound: 61.88885 ms, confidence: 0.950 found 4 outliers among 100 samples (4.0%) 4 (4.0%) high mild variance introduced by outliers: 67.629% variance is severely inflated by outliers commits: 200000 retries: 2 allocated bytes: 383209328 Running a subject "6/33333/unordered-containers" Collecting 99 more samples in 130.4 s.Collecting 98 more samples in 129.1 s.Collecting 97 more samples in 127.8 s.Collecting 96 more samples in 126.5 s.Collecting 95 more samples in 125.2 s.Collecting 94 more samples in 123.9 s.Collecting 93 more samples in 122.5 s.Collecting 92 more samples in 121.2 s.Collecting 91 more samples in 119.9 s.Collecting 90 more samples in 118.6 s.Collecting 89 more samples in 117.3 s.Collecting 88 more samples in 116.0 s.Collecting 87 more samples in 114.6 s.Collecting 86 more samples in 113.3 s.Collecting 85 more samples in 112.0 s.Collecting 84 more samples in 110.7 s.Collecting 83 more samples in 109.4 s.Collecting 82 more samples in 108.0 s.Collecting 81 more samples in 106.7 s.Collecting 80 more samples in 105.4 s.Collecting 79 more samples in 104.1 s.Collecting 78 more samples in 102.8 s.Collecting 77 more samples in 101.5 s.Collecting 76 more samples in 100.1 s.Collecting 75 more samples in 98.8 s.Collecting 74 more samples in 97.5 s.Collecting 73 more samples in 96.2 s.Collecting 72 more samples in 94.9 s.Collecting 71 more samples in 93.6 s.Collecting 70 more samples in 92.2 s.Collecting 69 more samples in 90.9 s.Collecting 68 more samples in 89.6 s.Collecting 67 more samples in 88.3 s.Collecting 66 more samples in 87.0 s.Collecting 65 more samples in 85.6 s.Collecting 64 more samples in 84.3 s.Collecting 63 more samples in 83.0 s.Collecting 62 more samples in 81.7 s.Collecting 61 more samples in 80.4 s.Collecting 60 more samples in 79.1 s.Collecting 59 more samples in 77.7 s.Collecting 58 more samples in 76.4 s.Collecting 57 more samples in 75.1 s.Collecting 56 more samples in 73.8 s.Collecting 55 more samples in 72.5 s.Collecting 54 more samples in 71.2 s.Collecting 53 more samples in 69.8 s.Collecting 52 more samples in 68.5 s.Collecting 51 more samples in 67.2 s.Collecting 50 more samples in 65.9 s.Collecting 49 more samples in 64.6 s.Collecting 48 more samples in 63.2 s.Collecting 47 more samples in 61.9 s.Collecting 46 more samples in 60.6 s.Collecting 45 more samples in 59.3 s.Collecting 44 more samples in 58.0 s.Collecting 43 more samples in 56.7 s.Collecting 42 more samples in 55.3 s.Collecting 41 more samples in 54.0 s.Collecting 40 more samples in 52.7 s.Collecting 39 more samples in 51.4 s.Collecting 38 more samples in 50.1 s.Collecting 37 more samples in 48.8 s.Collecting 36 more samples in 47.4 s.Collecting 35 more samples in 46.1 s.Collecting 34 more samples in 44.8 s.Collecting 33 more samples in 43.5 s.Collecting 32 more samples in 42.2 s.Collecting 31 more samples in 40.8 s.Collecting 30 more samples in 39.5 s.Collecting 29 more samples in 38.2 s.Collecting 28 more samples in 36.9 s.Collecting 27 more samples in 35.6 s.Collecting 26 more samples in 34.3 s.Collecting 25 more samples in 32.9 s.Collecting 24 more samples in 31.6 s.Collecting 23 more samples in 30.3 s.Collecting 22 more samples in 29.0 s.Collecting 21 more samples in 27.7 s.Collecting 20 more samples in 26.4 s.Collecting 19 more samples in 25.0 s.Collecting 18 more samples in 23.7 s.Collecting 17 more samples in 22.4 s.Collecting 16 more samples in 21.1 s.Collecting 15 more samples in 19.8 s.Collecting 14 more samples in 18.4 s.Collecting 13 more samples in 17.1 s.Collecting 12 more samples in 15.8 s.Collecting 11 more samples in 14.5 s.Collecting 10 more samples in 13.2 s.Collecting 9 more samples in 11.9 s.Collecting 8 more samples in 10.5 s.Collecting 7 more samples in 9.2 s.Collecting 6 more samples in 7.9 s.Collecting 5 more samples in 6.6 s.Collecting 4 more samples in 5.3 s.Collecting 3 more samples in 4.0 s.Collecting 2 more samples in 2.6 s.Collecting 1 more samples in 1.3 s.mean: 1.361031 s, lower bound: 1.349683 s, upper bound: 1.376784 s, confidence: 0.950 std dev: 67.89765 ms, lower bound: 51.29376 ms, upper bound: 95.89920 ms, confidence: 0.950 found 4 outliers among 100 samples (4.0%) 2 (2.0%) high mild 2 (2.0%) high severe variance introduced by outliers: 48.430% variance is moderately inflated by outliers commits: 200000 retries: 682931 allocated bytes: 2583479712 Running a subject "6/33333/stm-containers" Collecting 99 more samples in 62.7 s.Collecting 98 more samples in 62.1 s.Collecting 97 more samples in 61.5 s.Collecting 96 more samples in 60.8 s.Collecting 95 more samples in 60.2 s.Collecting 94 more samples in 59.6 s.Collecting 93 more samples in 58.9 s.Collecting 92 more samples in 58.3 s.Collecting 91 more samples in 57.7 s.Collecting 90 more samples in 57.0 s.Collecting 89 more samples in 56.4 s.Collecting 88 more samples in 55.8 s.Collecting 87 more samples in 55.1 s.Collecting 86 more samples in 54.5 s.Collecting 85 more samples in 53.9 s.Collecting 84 more samples in 53.2 s.Collecting 83 more samples in 52.6 s.Collecting 82 more samples in 52.0 s.Collecting 81 more samples in 51.3 s.Collecting 80 more samples in 50.7 s.Collecting 79 more samples in 50.1 s.Collecting 78 more samples in 49.4 s.Collecting 77 more samples in 48.8 s.Collecting 76 more samples in 48.1 s.Collecting 75 more samples in 47.5 s.Collecting 74 more samples in 46.9 s.Collecting 73 more samples in 46.2 s.Collecting 72 more samples in 45.6 s.Collecting 71 more samples in 45.0 s.Collecting 70 more samples in 44.3 s.Collecting 69 more samples in 43.7 s.Collecting 68 more samples in 43.1 s.Collecting 67 more samples in 42.4 s.Collecting 66 more samples in 41.8 s.Collecting 65 more samples in 41.2 s.Collecting 64 more samples in 40.5 s.Collecting 63 more samples in 39.9 s.Collecting 62 more samples in 39.3 s.Collecting 61 more samples in 38.6 s.Collecting 60 more samples in 38.0 s.Collecting 59 more samples in 37.4 s.Collecting 58 more samples in 36.7 s.Collecting 57 more samples in 36.1 s.Collecting 56 more samples in 35.5 s.Collecting 55 more samples in 34.8 s.Collecting 54 more samples in 34.2 s.Collecting 53 more samples in 33.6 s.Collecting 52 more samples in 32.9 s.Collecting 51 more samples in 32.3 s.Collecting 50 more samples in 31.7 s.Collecting 49 more samples in 31.0 s.Collecting 48 more samples in 30.4 s.Collecting 47 more samples in 29.8 s.Collecting 46 more samples in 29.1 s.Collecting 45 more samples in 28.5 s.Collecting 44 more samples in 27.9 s.Collecting 43 more samples in 27.2 s.Collecting 42 more samples in 26.6 s.Collecting 41 more samples in 26.0 s.Collecting 40 more samples in 25.3 s.Collecting 39 more samples in 24.7 s.Collecting 38 more samples in 24.1 s.Collecting 37 more samples in 23.4 s.Collecting 36 more samples in 22.8 s.Collecting 35 more samples in 22.2 s.Collecting 34 more samples in 21.5 s.Collecting 33 more samples in 20.9 s.Collecting 32 more samples in 20.3 s.Collecting 31 more samples in 19.6 s.Collecting 30 more samples in 19.0 s.Collecting 29 more samples in 18.4 s.Collecting 28 more samples in 17.7 s.Collecting 27 more samples in 17.1 s.Collecting 26 more samples in 16.5 s.Collecting 25 more samples in 15.8 s.Collecting 24 more samples in 15.2 s.Collecting 23 more samples in 14.6 s.Collecting 22 more samples in 13.9 s.Collecting 21 more samples in 13.3 s.Collecting 20 more samples in 12.7 s.Collecting 19 more samples in 12.0 s.Collecting 18 more samples in 11.4 s.Collecting 17 more samples in 10.8 s.Collecting 16 more samples in 10.1 s.Collecting 15 more samples in 9.5 s.Collecting 14 more samples in 8.9 s.Collecting 13 more samples in 8.2 s.Collecting 12 more samples in 7.6 s.Collecting 11 more samples in 7.0 s.Collecting 10 more samples in 6.3 s.Collecting 9 more samples in 5.7 s.Collecting 8 more samples in 5.1 s.Collecting 7 more samples in 4.4 s.Collecting 6 more samples in 3.8 s.Collecting 5 more samples in 3.2 s.Collecting 4 more samples in 2.5 s.Collecting 3 more samples in 1.9 s.Collecting 2 more samples in 1.3 s.Collecting 1 more samples in 0.6 s.mean: 470.0635 ms, lower bound: 462.4542 ms, upper bound: 479.5470 ms, confidence: 0.950 std dev: 43.23169 ms, lower bound: 34.18366 ms, upper bound: 57.99899 ms, confidence: 0.950 found 3 outliers among 100 samples (3.0%) 2 (2.0%) high severe variance introduced by outliers: 75.905% variance is severely inflated by outliers commits: 200000 retries: 1855 allocated bytes: 677953376 Running a subject "6/33333/ttrie" Collecting 99 more samples in 46.3 s.Collecting 98 more samples in 45.8 s.Collecting 97 more samples in 45.3 s.Collecting 96 more samples in 44.9 s.Collecting 95 more samples in 44.4 s.Collecting 94 more samples in 43.9 s.Collecting 93 more samples in 43.5 s.Collecting 92 more samples in 43.0 s.Collecting 91 more samples in 42.5 s.Collecting 90 more samples in 42.1 s.Collecting 89 more samples in 41.6 s.Collecting 88 more samples in 41.1 s.Collecting 87 more samples in 40.7 s.Collecting 86 more samples in 40.2 s.Collecting 85 more samples in 39.7 s.Collecting 84 more samples in 39.3 s.Collecting 83 more samples in 38.8 s.Collecting 82 more samples in 38.3 s.Collecting 81 more samples in 37.9 s.Collecting 80 more samples in 37.4 s.Collecting 79 more samples in 36.9 s.Collecting 78 more samples in 36.4 s.Collecting 77 more samples in 36.0 s.Collecting 76 more samples in 35.5 s.Collecting 75 more samples in 35.0 s.Collecting 74 more samples in 34.6 s.Collecting 73 more samples in 34.1 s.Collecting 72 more samples in 33.6 s.Collecting 71 more samples in 33.2 s.Collecting 70 more samples in 32.7 s.Collecting 69 more samples in 32.2 s.Collecting 68 more samples in 31.8 s.Collecting 67 more samples in 31.3 s.Collecting 66 more samples in 30.8 s.Collecting 65 more samples in 30.4 s.Collecting 64 more samples in 29.9 s.Collecting 63 more samples in 29.4 s.Collecting 62 more samples in 29.0 s.Collecting 61 more samples in 28.5 s.Collecting 60 more samples in 28.0 s.Collecting 59 more samples in 27.6 s.Collecting 58 more samples in 27.1 s.Collecting 57 more samples in 26.6 s.Collecting 56 more samples in 26.2 s.Collecting 55 more samples in 25.7 s.Collecting 54 more samples in 25.2 s.Collecting 53 more samples in 24.8 s.Collecting 52 more samples in 24.3 s.Collecting 51 more samples in 23.8 s.Collecting 50 more samples in 23.4 s.Collecting 49 more samples in 22.9 s.Collecting 48 more samples in 22.4 s.Collecting 47 more samples in 22.0 s.Collecting 46 more samples in 21.5 s.Collecting 45 more samples in 21.0 s.Collecting 44 more samples in 20.6 s.Collecting 43 more samples in 20.1 s.Collecting 42 more samples in 19.6 s.Collecting 41 more samples in 19.2 s.Collecting 40 more samples in 18.7 s.Collecting 39 more samples in 18.2 s.Collecting 38 more samples in 17.8 s.Collecting 37 more samples in 17.3 s.Collecting 36 more samples in 16.8 s.Collecting 35 more samples in 16.4 s.Collecting 34 more samples in 15.9 s.Collecting 33 more samples in 15.4 s.Collecting 32 more samples in 15.0 s.Collecting 31 more samples in 14.5 s.Collecting 30 more samples in 14.0 s.Collecting 29 more samples in 13.6 s.Collecting 28 more samples in 13.1 s.Collecting 27 more samples in 12.6 s.Collecting 26 more samples in 12.1 s.Collecting 25 more samples in 11.7 s.Collecting 24 more samples in 11.2 s.Collecting 23 more samples in 10.7 s.Collecting 22 more samples in 10.3 s.Collecting 21 more samples in 9.8 s.Collecting 20 more samples in 9.3 s.Collecting 19 more samples in 8.9 s.Collecting 18 more samples in 8.4 s.Collecting 17 more samples in 7.9 s.Collecting 16 more samples in 7.5 s.Collecting 15 more samples in 7.0 s.Collecting 14 more samples in 6.5 s.Collecting 13 more samples in 6.1 s.Collecting 12 more samples in 5.6 s.Collecting 11 more samples in 5.1 s.Collecting 10 more samples in 4.7 s.Collecting 9 more samples in 4.2 s.Collecting 8 more samples in 3.7 s.Collecting 7 more samples in 3.3 s.Collecting 6 more samples in 2.8 s.Collecting 5 more samples in 2.3 s.Collecting 4 more samples in 1.9 s.Collecting 3 more samples in 1.4 s.Collecting 2 more samples in 0.9 s.Collecting 1 more samples in 0.5 s.mean: 481.2128 ms, lower bound: 474.8898 ms, upper bound: 488.4371 ms, confidence: 0.950 std dev: 34.86315 ms, lower bound: 29.91326 ms, upper bound: 41.22376 ms, confidence: 0.950 found 6 outliers among 100 samples (6.0%) 6 (6.0%) high mild variance introduced by outliers: 66.623% variance is severely inflated by outliers commits: 200000 retries: 1 allocated bytes: 383564608 Running a subject "8/25000/unordered-containers" Collecting 99 more samples in 126.5 s.Collecting 98 more samples in 125.2 s.Collecting 97 more samples in 123.9 s.Collecting 96 more samples in 122.6 s.Collecting 95 more samples in 121.3 s.Collecting 94 more samples in 120.1 s.Collecting 93 more samples in 118.8 s.Collecting 92 more samples in 117.5 s.Collecting 91 more samples in 116.2 s.Collecting 90 more samples in 115.0 s.Collecting 89 more samples in 113.7 s.Collecting 88 more samples in 112.4 s.Collecting 87 more samples in 111.1 s.Collecting 86 more samples in 109.9 s.Collecting 85 more samples in 108.6 s.Collecting 84 more samples in 107.3 s.Collecting 83 more samples in 106.0 s.Collecting 82 more samples in 104.7 s.Collecting 81 more samples in 103.5 s.Collecting 80 more samples in 102.2 s.Collecting 79 more samples in 100.9 s.Collecting 78 more samples in 99.6 s.Collecting 77 more samples in 98.4 s.Collecting 76 more samples in 97.1 s.Collecting 75 more samples in 95.8 s.Collecting 74 more samples in 94.5 s.Collecting 73 more samples in 93.2 s.Collecting 72 more samples in 92.0 s.Collecting 71 more samples in 90.7 s.Collecting 70 more samples in 89.4 s.Collecting 69 more samples in 88.1 s.Collecting 68 more samples in 86.9 s.Collecting 67 more samples in 85.6 s.Collecting 66 more samples in 84.3 s.Collecting 65 more samples in 83.0 s.Collecting 64 more samples in 81.8 s.Collecting 63 more samples in 80.5 s.Collecting 62 more samples in 79.2 s.Collecting 61 more samples in 77.9 s.Collecting 60 more samples in 76.6 s.Collecting 59 more samples in 75.4 s.Collecting 58 more samples in 74.1 s.Collecting 57 more samples in 72.8 s.Collecting 56 more samples in 71.5 s.Collecting 55 more samples in 70.3 s.Collecting 54 more samples in 69.0 s.Collecting 53 more samples in 67.7 s.Collecting 52 more samples in 66.4 s.Collecting 51 more samples in 65.1 s.Collecting 50 more samples in 63.9 s.Collecting 49 more samples in 62.6 s.Collecting 48 more samples in 61.3 s.Collecting 47 more samples in 60.0 s.Collecting 46 more samples in 58.8 s.Collecting 45 more samples in 57.5 s.Collecting 44 more samples in 56.2 s.Collecting 43 more samples in 54.9 s.Collecting 42 more samples in 53.6 s.Collecting 41 more samples in 52.4 s.Collecting 40 more samples in 51.1 s.Collecting 39 more samples in 49.8 s.Collecting 38 more samples in 48.5 s.Collecting 37 more samples in 47.3 s.Collecting 36 more samples in 46.0 s.Collecting 35 more samples in 44.7 s.Collecting 34 more samples in 43.4 s.Collecting 33 more samples in 42.2 s.Collecting 32 more samples in 40.9 s.Collecting 31 more samples in 39.6 s.Collecting 30 more samples in 38.3 s.Collecting 29 more samples in 37.0 s.Collecting 28 more samples in 35.8 s.Collecting 27 more samples in 34.5 s.Collecting 26 more samples in 33.2 s.Collecting 25 more samples in 31.9 s.Collecting 24 more samples in 30.7 s.Collecting 23 more samples in 29.4 s.Collecting 22 more samples in 28.1 s.Collecting 21 more samples in 26.8 s.Collecting 20 more samples in 25.5 s.Collecting 19 more samples in 24.3 s.Collecting 18 more samples in 23.0 s.Collecting 17 more samples in 21.7 s.Collecting 16 more samples in 20.4 s.Collecting 15 more samples in 19.2 s.Collecting 14 more samples in 17.9 s.Collecting 13 more samples in 16.6 s.Collecting 12 more samples in 15.3 s.Collecting 11 more samples in 14.1 s.Collecting 10 more samples in 12.8 s.Collecting 9 more samples in 11.5 s.Collecting 8 more samples in 10.2 s.Collecting 7 more samples in 8.9 s.Collecting 6 more samples in 7.7 s.Collecting 5 more samples in 6.4 s.Collecting 4 more samples in 5.1 s.Collecting 3 more samples in 3.8 s.Collecting 2 more samples in 2.6 s.Collecting 1 more samples in 1.3 s.mean: 1.311839 s, lower bound: 1.299825 s, upper bound: 1.326765 s, confidence: 0.950 std dev: 69.00883 ms, lower bound: 56.43027 ms, upper bound: 87.89861 ms, confidence: 0.950 found 4 outliers among 100 samples (4.0%) 4 (4.0%) high mild variance introduced by outliers: 50.473% variance is severely inflated by outliers commits: 200000 retries: 973019 allocated bytes: 3115006224 Running a subject "8/25000/stm-containers" Collecting 99 more samples in 37.0 s.Collecting 98 more samples in 36.6 s.Collecting 97 more samples in 36.2 s.Collecting 96 more samples in 35.8 s.Collecting 95 more samples in 35.5 s.Collecting 94 more samples in 35.1 s.Collecting 93 more samples in 34.7 s.Collecting 92 more samples in 34.3 s.Collecting 91 more samples in 34.0 s.Collecting 90 more samples in 33.6 s.Collecting 89 more samples in 33.2 s.Collecting 88 more samples in 32.8 s.Collecting 87 more samples in 32.5 s.Collecting 86 more samples in 32.1 s.Collecting 85 more samples in 31.7 s.Collecting 84 more samples in 31.4 s.Collecting 83 more samples in 31.0 s.Collecting 82 more samples in 30.6 s.Collecting 81 more samples in 30.2 s.Collecting 80 more samples in 29.9 s.Collecting 79 more samples in 29.5 s.Collecting 78 more samples in 29.1 s.Collecting 77 more samples in 28.7 s.Collecting 76 more samples in 28.4 s.Collecting 75 more samples in 28.0 s.Collecting 74 more samples in 27.6 s.Collecting 73 more samples in 27.2 s.Collecting 72 more samples in 26.9 s.Collecting 71 more samples in 26.5 s.Collecting 70 more samples in 26.1 s.Collecting 69 more samples in 25.8 s.Collecting 68 more samples in 25.4 s.Collecting 67 more samples in 25.0 s.Collecting 66 more samples in 24.6 s.Collecting 65 more samples in 24.3 s.Collecting 64 more samples in 23.9 s.Collecting 63 more samples in 23.5 s.Collecting 62 more samples in 23.1 s.Collecting 61 more samples in 22.8 s.Collecting 60 more samples in 22.4 s.Collecting 59 more samples in 22.0 s.Collecting 58 more samples in 21.6 s.Collecting 57 more samples in 21.3 s.Collecting 56 more samples in 20.9 s.Collecting 55 more samples in 20.5 s.Collecting 54 more samples in 20.2 s.Collecting 53 more samples in 19.8 s.Collecting 52 more samples in 19.4 s.Collecting 51 more samples in 19.0 s.Collecting 50 more samples in 18.7 s.Collecting 49 more samples in 18.3 s.Collecting 48 more samples in 17.9 s.Collecting 47 more samples in 17.5 s.Collecting 46 more samples in 17.2 s.Collecting 45 more samples in 16.8 s.Collecting 44 more samples in 16.4 s.Collecting 43 more samples in 16.0 s.Collecting 42 more samples in 15.7 s.Collecting 41 more samples in 15.3 s.Collecting 40 more samples in 14.9 s.Collecting 39 more samples in 14.6 s.Collecting 38 more samples in 14.2 s.Collecting 37 more samples in 13.8 s.Collecting 36 more samples in 13.4 s.Collecting 35 more samples in 13.1 s.Collecting 34 more samples in 12.7 s.Collecting 33 more samples in 12.3 s.Collecting 32 more samples in 11.9 s.Collecting 31 more samples in 11.6 s.Collecting 30 more samples in 11.2 s.Collecting 29 more samples in 10.8 s.Collecting 28 more samples in 10.5 s.Collecting 27 more samples in 10.1 s.Collecting 26 more samples in 9.7 s.Collecting 25 more samples in 9.3 s.Collecting 24 more samples in 9.0 s.Collecting 23 more samples in 8.6 s.Collecting 22 more samples in 8.2 s.Collecting 21 more samples in 7.8 s.Collecting 20 more samples in 7.5 s.Collecting 19 more samples in 7.1 s.Collecting 18 more samples in 6.7 s.Collecting 17 more samples in 6.3 s.Collecting 16 more samples in 6.0 s.Collecting 15 more samples in 5.6 s.Collecting 14 more samples in 5.2 s.Collecting 13 more samples in 4.9 s.Collecting 12 more samples in 4.5 s.Collecting 11 more samples in 4.1 s.Collecting 10 more samples in 3.7 s.Collecting 9 more samples in 3.4 s.Collecting 8 more samples in 3.0 s.Collecting 7 more samples in 2.6 s.Collecting 6 more samples in 2.2 s.Collecting 5 more samples in 1.9 s.Collecting 4 more samples in 1.5 s.Collecting 3 more samples in 1.1 s.Collecting 2 more samples in 0.7 s.Collecting 1 more samples in 0.4 s.mean: 392.3266 ms, lower bound: 384.7375 ms, upper bound: 402.4516 ms, confidence: 0.950 std dev: 44.71522 ms, lower bound: 34.93995 ms, upper bound: 57.75638 ms, confidence: 0.950 found 9 outliers among 100 samples (9.0%) 5 (5.0%) high mild 4 (4.0%) high severe variance introduced by outliers: 83.151% variance is severely inflated by outliers commits: 200000 retries: 2362 allocated bytes: 677596320 Running a subject "8/25000/ttrie" Collecting 99 more samples in 38.2 s.Collecting 98 more samples in 37.8 s.Collecting 97 more samples in 37.4 s.Collecting 96 more samples in 37.0 s.Collecting 95 more samples in 36.6 s.Collecting 94 more samples in 36.2 s.Collecting 93 more samples in 35.9 s.Collecting 92 more samples in 35.5 s.Collecting 91 more samples in 35.1 s.Collecting 90 more samples in 34.7 s.Collecting 89 more samples in 34.3 s.Collecting 88 more samples in 33.9 s.Collecting 87 more samples in 33.6 s.Collecting 86 more samples in 33.2 s.Collecting 85 more samples in 32.8 s.Collecting 84 more samples in 32.4 s.Collecting 83 more samples in 32.0 s.Collecting 82 more samples in 31.6 s.Collecting 81 more samples in 31.2 s.Collecting 80 more samples in 30.9 s.Collecting 79 more samples in 30.5 s.Collecting 78 more samples in 30.1 s.Collecting 77 more samples in 29.7 s.Collecting 76 more samples in 29.3 s.Collecting 75 more samples in 28.9 s.Collecting 74 more samples in 28.5 s.Collecting 73 more samples in 28.2 s.Collecting 72 more samples in 27.8 s.Collecting 71 more samples in 27.4 s.Collecting 70 more samples in 27.0 s.Collecting 69 more samples in 26.6 s.Collecting 68 more samples in 26.2 s.Collecting 67 more samples in 25.8 s.Collecting 66 more samples in 25.5 s.Collecting 65 more samples in 25.1 s.Collecting 64 more samples in 24.7 s.Collecting 63 more samples in 24.3 s.Collecting 62 more samples in 23.9 s.Collecting 61 more samples in 23.5 s.Collecting 60 more samples in 23.1 s.Collecting 59 more samples in 22.8 s.Collecting 58 more samples in 22.4 s.Collecting 57 more samples in 22.0 s.Collecting 56 more samples in 21.6 s.Collecting 55 more samples in 21.2 s.Collecting 54 more samples in 20.8 s.Collecting 53 more samples in 20.4 s.Collecting 52 more samples in 20.1 s.Collecting 51 more samples in 19.7 s.Collecting 50 more samples in 19.3 s.Collecting 49 more samples in 18.9 s.Collecting 48 more samples in 18.5 s.Collecting 47 more samples in 18.1 s.Collecting 46 more samples in 17.7 s.Collecting 45 more samples in 17.4 s.Collecting 44 more samples in 17.0 s.Collecting 43 more samples in 16.6 s.Collecting 42 more samples in 16.2 s.Collecting 41 more samples in 15.8 s.Collecting 40 more samples in 15.4 s.Collecting 39 more samples in 15.0 s.Collecting 38 more samples in 14.7 s.Collecting 37 more samples in 14.3 s.Collecting 36 more samples in 13.9 s.Collecting 35 more samples in 13.5 s.Collecting 34 more samples in 13.1 s.Collecting 33 more samples in 12.7 s.Collecting 32 more samples in 12.3 s.Collecting 31 more samples in 12.0 s.Collecting 30 more samples in 11.6 s.Collecting 29 more samples in 11.2 s.Collecting 28 more samples in 10.8 s.Collecting 27 more samples in 10.4 s.Collecting 26 more samples in 10.0 s.Collecting 25 more samples in 9.6 s.Collecting 24 more samples in 9.3 s.Collecting 23 more samples in 8.9 s.Collecting 22 more samples in 8.5 s.Collecting 21 more samples in 8.1 s.Collecting 20 more samples in 7.7 s.Collecting 19 more samples in 7.3 s.Collecting 18 more samples in 6.9 s.Collecting 17 more samples in 6.6 s.Collecting 16 more samples in 6.2 s.Collecting 15 more samples in 5.8 s.Collecting 14 more samples in 5.4 s.Collecting 13 more samples in 5.0 s.Collecting 12 more samples in 4.6 s.Collecting 11 more samples in 4.2 s.Collecting 10 more samples in 3.9 s.Collecting 9 more samples in 3.5 s.Collecting 8 more samples in 3.1 s.Collecting 7 more samples in 2.7 s.Collecting 6 more samples in 2.3 s.Collecting 5 more samples in 1.9 s.Collecting 4 more samples in 1.5 s.Collecting 3 more samples in 1.2 s.Collecting 2 more samples in 0.8 s.Collecting 1 more samples in 0.4 s.mean: 396.6723 ms, lower bound: 391.1353 ms, upper bound: 403.1371 ms, confidence: 0.950 std dev: 30.52479 ms, lower bound: 25.98486 ms, upper bound: 38.11130 ms, confidence: 0.950 found 2 outliers among 100 samples (2.0%) 2 (2.0%) high mild variance introduced by outliers: 68.707% variance is severely inflated by outliers commits: 200000 retries: 6 allocated bytes: 383805080 Running a subject "10/20000/unordered-containers" Collecting 99 more samples in 138.0 s.Collecting 98 more samples in 136.6 s.Collecting 97 more samples in 135.2 s.Collecting 96 more samples in 133.8 s.Collecting 95 more samples in 132.4 s.Collecting 94 more samples in 131.0 s.Collecting 93 more samples in 129.6 s.Collecting 92 more samples in 128.2 s.Collecting 91 more samples in 126.8 s.Collecting 90 more samples in 125.4 s.Collecting 89 more samples in 124.0 s.Collecting 88 more samples in 122.7 s.Collecting 87 more samples in 121.3 s.Collecting 86 more samples in 119.9 s.Collecting 85 more samples in 118.5 s.Collecting 84 more samples in 117.1 s.Collecting 83 more samples in 115.7 s.Collecting 82 more samples in 114.3 s.Collecting 81 more samples in 112.9 s.Collecting 80 more samples in 111.5 s.Collecting 79 more samples in 110.1 s.Collecting 78 more samples in 108.7 s.Collecting 77 more samples in 107.3 s.Collecting 76 more samples in 105.9 s.Collecting 75 more samples in 104.5 s.Collecting 74 more samples in 103.1 s.Collecting 73 more samples in 101.7 s.Collecting 72 more samples in 100.4 s.Collecting 71 more samples in 99.0 s.Collecting 70 more samples in 97.6 s.Collecting 69 more samples in 96.2 s.Collecting 68 more samples in 94.8 s.Collecting 67 more samples in 93.4 s.Collecting 66 more samples in 92.0 s.Collecting 65 more samples in 90.6 s.Collecting 64 more samples in 89.2 s.Collecting 63 more samples in 87.8 s.Collecting 62 more samples in 86.4 s.Collecting 61 more samples in 85.0 s.Collecting 60 more samples in 83.6 s.Collecting 59 more samples in 82.2 s.Collecting 58 more samples in 80.8 s.Collecting 57 more samples in 79.4 s.Collecting 56 more samples in 78.1 s.Collecting 55 more samples in 76.7 s.Collecting 54 more samples in 75.3 s.Collecting 53 more samples in 73.9 s.Collecting 52 more samples in 72.5 s.Collecting 51 more samples in 71.1 s.Collecting 50 more samples in 69.7 s.Collecting 49 more samples in 68.3 s.Collecting 48 more samples in 66.9 s.Collecting 47 more samples in 65.5 s.Collecting 46 more samples in 64.1 s.Collecting 45 more samples in 62.7 s.Collecting 44 more samples in 61.3 s.Collecting 43 more samples in 59.9 s.Collecting 42 more samples in 58.5 s.Collecting 41 more samples in 57.1 s.Collecting 40 more samples in 55.8 s.Collecting 39 more samples in 54.4 s.Collecting 38 more samples in 53.0 s.Collecting 37 more samples in 51.6 s.Collecting 36 more samples in 50.2 s.Collecting 35 more samples in 48.8 s.Collecting 34 more samples in 47.4 s.Collecting 33 more samples in 46.0 s.Collecting 32 more samples in 44.6 s.Collecting 31 more samples in 43.2 s.Collecting 30 more samples in 41.8 s.Collecting 29 more samples in 40.4 s.Collecting 28 more samples in 39.0 s.Collecting 27 more samples in 37.6 s.Collecting 26 more samples in 36.2 s.Collecting 25 more samples in 34.8 s.Collecting 24 more samples in 33.5 s.Collecting 23 more samples in 32.1 s.Collecting 22 more samples in 30.7 s.Collecting 21 more samples in 29.3 s.Collecting 20 more samples in 27.9 s.Collecting 19 more samples in 26.5 s.Collecting 18 more samples in 25.1 s.Collecting 17 more samples in 23.7 s.Collecting 16 more samples in 22.3 s.Collecting 15 more samples in 20.9 s.Collecting 14 more samples in 19.5 s.Collecting 13 more samples in 18.1 s.Collecting 12 more samples in 16.7 s.Collecting 11 more samples in 15.3 s.Collecting 10 more samples in 13.9 s.Collecting 9 more samples in 12.5 s.Collecting 8 more samples in 11.2 s.Collecting 7 more samples in 9.8 s.Collecting 6 more samples in 8.4 s.Collecting 5 more samples in 7.0 s.Collecting 4 more samples in 5.6 s.Collecting 3 more samples in 4.2 s.Collecting 2 more samples in 2.8 s.Collecting 1 more samples in 1.4 s.mean: 1.299182 s, lower bound: 1.288334 s, upper bound: 1.311534 s, confidence: 0.950 std dev: 59.18892 ms, lower bound: 50.30150 ms, upper bound: 80.59303 ms, confidence: 0.950 found 2 outliers among 100 samples (2.0%) 1 (1.0%) high severe variance introduced by outliers: 43.476% variance is moderately inflated by outliers commits: 200000 retries: 1098776 allocated bytes: 3381093904 Running a subject "10/20000/stm-containers" Collecting 99 more samples in 30.2 s.Collecting 98 more samples in 29.9 s.Collecting 97 more samples in 29.5 s.Collecting 96 more samples in 29.2 s.Collecting 95 more samples in 28.9 s.Collecting 94 more samples in 28.6 s.Collecting 93 more samples in 28.3 s.Collecting 92 more samples in 28.0 s.Collecting 91 more samples in 27.7 s.Collecting 90 more samples in 27.4 s.Collecting 89 more samples in 27.1 s.Collecting 88 more samples in 26.8 s.Collecting 87 more samples in 26.5 s.Collecting 86 more samples in 26.2 s.Collecting 85 more samples in 25.9 s.Collecting 84 more samples in 25.6 s.Collecting 83 more samples in 25.3 s.Collecting 82 more samples in 25.0 s.Collecting 81 more samples in 24.7 s.Collecting 80 more samples in 24.4 s.Collecting 79 more samples in 24.1 s.Collecting 78 more samples in 23.8 s.Collecting 77 more samples in 23.5 s.Collecting 76 more samples in 23.2 s.Collecting 75 more samples in 22.8 s.Collecting 74 more samples in 22.5 s.Collecting 73 more samples in 22.2 s.Collecting 72 more samples in 21.9 s.Collecting 71 more samples in 21.6 s.Collecting 70 more samples in 21.3 s.Collecting 69 more samples in 21.0 s.Collecting 68 more samples in 20.7 s.Collecting 67 more samples in 20.4 s.Collecting 66 more samples in 20.1 s.Collecting 65 more samples in 19.8 s.Collecting 64 more samples in 19.5 s.Collecting 63 more samples in 19.2 s.Collecting 62 more samples in 18.9 s.Collecting 61 more samples in 18.6 s.Collecting 60 more samples in 18.3 s.Collecting 59 more samples in 18.0 s.Collecting 58 more samples in 17.7 s.Collecting 57 more samples in 17.4 s.Collecting 56 more samples in 17.1 s.Collecting 55 more samples in 16.8 s.Collecting 54 more samples in 16.4 s.Collecting 53 more samples in 16.1 s.Collecting 52 more samples in 15.8 s.Collecting 51 more samples in 15.5 s.Collecting 50 more samples in 15.2 s.Collecting 49 more samples in 14.9 s.Collecting 48 more samples in 14.6 s.Collecting 47 more samples in 14.3 s.Collecting 46 more samples in 14.0 s.Collecting 45 more samples in 13.7 s.Collecting 44 more samples in 13.4 s.Collecting 43 more samples in 13.1 s.Collecting 42 more samples in 12.8 s.Collecting 41 more samples in 12.5 s.Collecting 40 more samples in 12.2 s.Collecting 39 more samples in 11.9 s.Collecting 38 more samples in 11.6 s.Collecting 37 more samples in 11.3 s.Collecting 36 more samples in 11.0 s.Collecting 35 more samples in 10.7 s.Collecting 34 more samples in 10.4 s.Collecting 33 more samples in 10.1 s.Collecting 32 more samples in 9.7 s.Collecting 31 more samples in 9.4 s.Collecting 30 more samples in 9.1 s.Collecting 29 more samples in 8.8 s.Collecting 28 more samples in 8.5 s.Collecting 27 more samples in 8.2 s.Collecting 26 more samples in 7.9 s.Collecting 25 more samples in 7.6 s.Collecting 24 more samples in 7.3 s.Collecting 23 more samples in 7.0 s.Collecting 22 more samples in 6.7 s.Collecting 21 more samples in 6.4 s.Collecting 20 more samples in 6.1 s.Collecting 19 more samples in 5.8 s.Collecting 18 more samples in 5.5 s.Collecting 17 more samples in 5.2 s.Collecting 16 more samples in 4.9 s.Collecting 15 more samples in 4.6 s.Collecting 14 more samples in 4.3 s.Collecting 13 more samples in 4.0 s.Collecting 12 more samples in 3.7 s.Collecting 11 more samples in 3.4 s.Collecting 10 more samples in 3.0 s.Collecting 9 more samples in 2.7 s.Collecting 8 more samples in 2.4 s.Collecting 7 more samples in 2.1 s.Collecting 6 more samples in 1.8 s.Collecting 5 more samples in 1.5 s.Collecting 4 more samples in 1.2 s.Collecting 3 more samples in 0.9 s.Collecting 2 more samples in 0.6 s.Collecting 1 more samples in 0.3 s.mean: 333.8745 ms, lower bound: 326.5886 ms, upper bound: 346.6818 ms, confidence: 0.950 std dev: 47.90080 ms, lower bound: 32.50048 ms, upper bound: 83.35971 ms, confidence: 0.950 found 9 outliers among 100 samples (9.0%) 5 (5.0%) high mild 4 (4.0%) high severe variance introduced by outliers: 89.385% variance is severely inflated by outliers commits: 200000 retries: 2971 allocated bytes: 678294200 Running a subject "10/20000/ttrie" Collecting 99 more samples in 32.3 s.Collecting 98 more samples in 32.0 s.Collecting 97 more samples in 31.6 s.Collecting 96 more samples in 31.3 s.Collecting 95 more samples in 31.0 s.Collecting 94 more samples in 30.7 s.Collecting 93 more samples in 30.3 s.Collecting 92 more samples in 30.0 s.Collecting 91 more samples in 29.7 s.Collecting 90 more samples in 29.3 s.Collecting 89 more samples in 29.0 s.Collecting 88 more samples in 28.7 s.Collecting 87 more samples in 28.4 s.Collecting 86 more samples in 28.0 s.Collecting 85 more samples in 27.7 s.Collecting 84 more samples in 27.4 s.Collecting 83 more samples in 27.1 s.Collecting 82 more samples in 26.7 s.Collecting 81 more samples in 26.4 s.Collecting 80 more samples in 26.1 s.Collecting 79 more samples in 25.8 s.Collecting 78 more samples in 25.4 s.Collecting 77 more samples in 25.1 s.Collecting 76 more samples in 24.8 s.Collecting 75 more samples in 24.5 s.Collecting 74 more samples in 24.1 s.Collecting 73 more samples in 23.8 s.Collecting 72 more samples in 23.5 s.Collecting 71 more samples in 23.2 s.Collecting 70 more samples in 22.8 s.Collecting 69 more samples in 22.5 s.Collecting 68 more samples in 22.2 s.Collecting 67 more samples in 21.8 s.Collecting 66 more samples in 21.5 s.Collecting 65 more samples in 21.2 s.Collecting 64 more samples in 20.9 s.Collecting 63 more samples in 20.5 s.Collecting 62 more samples in 20.2 s.Collecting 61 more samples in 19.9 s.Collecting 60 more samples in 19.6 s.Collecting 59 more samples in 19.2 s.Collecting 58 more samples in 18.9 s.Collecting 57 more samples in 18.6 s.Collecting 56 more samples in 18.3 s.Collecting 55 more samples in 17.9 s.Collecting 54 more samples in 17.6 s.Collecting 53 more samples in 17.3 s.Collecting 52 more samples in 17.0 s.Collecting 51 more samples in 16.6 s.Collecting 50 more samples in 16.3 s.Collecting 49 more samples in 16.0 s.Collecting 48 more samples in 15.7 s.Collecting 47 more samples in 15.3 s.Collecting 46 more samples in 15.0 s.Collecting 45 more samples in 14.7 s.Collecting 44 more samples in 14.3 s.Collecting 43 more samples in 14.0 s.Collecting 42 more samples in 13.7 s.Collecting 41 more samples in 13.4 s.Collecting 40 more samples in 13.0 s.Collecting 39 more samples in 12.7 s.Collecting 38 more samples in 12.4 s.Collecting 37 more samples in 12.1 s.Collecting 36 more samples in 11.7 s.Collecting 35 more samples in 11.4 s.Collecting 34 more samples in 11.1 s.Collecting 33 more samples in 10.8 s.Collecting 32 more samples in 10.4 s.Collecting 31 more samples in 10.1 s.Collecting 30 more samples in 9.8 s.Collecting 29 more samples in 9.5 s.Collecting 28 more samples in 9.1 s.Collecting 27 more samples in 8.8 s.Collecting 26 more samples in 8.5 s.Collecting 25 more samples in 8.2 s.Collecting 24 more samples in 7.8 s.Collecting 23 more samples in 7.5 s.Collecting 22 more samples in 7.2 s.Collecting 21 more samples in 6.8 s.Collecting 20 more samples in 6.5 s.Collecting 19 more samples in 6.2 s.Collecting 18 more samples in 5.9 s.Collecting 17 more samples in 5.5 s.Collecting 16 more samples in 5.2 s.Collecting 15 more samples in 4.9 s.Collecting 14 more samples in 4.6 s.Collecting 13 more samples in 4.2 s.Collecting 12 more samples in 3.9 s.Collecting 11 more samples in 3.6 s.Collecting 10 more samples in 3.3 s.Collecting 9 more samples in 2.9 s.Collecting 8 more samples in 2.6 s.Collecting 7 more samples in 2.3 s.Collecting 6 more samples in 2.0 s.Collecting 5 more samples in 1.6 s.Collecting 4 more samples in 1.3 s.Collecting 3 more samples in 1.0 s.Collecting 2 more samples in 0.7 s.Collecting 1 more samples in 0.3 s.mean: 350.7384 ms, lower bound: 343.7988 ms, upper bound: 359.5996 ms, confidence: 0.950 std dev: 40.11212 ms, lower bound: 33.06407 ms, upper bound: 54.26117 ms, confidence: 0.950 found 8 outliers among 100 samples (8.0%) 7 (7.0%) high mild 1 (1.0%) high severe variance introduced by outliers: 83.157% variance is severely inflated by outliers commits: 200000 retries: 7 allocated bytes: 383827896 Running a subject "12/16666/unordered-containers" Collecting 99 more samples in 132.9 s.Collecting 98 more samples in 131.6 s.Collecting 97 more samples in 130.2 s.Collecting 96 more samples in 128.9 s.Collecting 95 more samples in 127.6 s.Collecting 94 more samples in 126.2 s.Collecting 93 more samples in 124.9 s.Collecting 92 more samples in 123.5 s.Collecting 91 more samples in 122.2 s.Collecting 90 more samples in 120.8 s.Collecting 89 more samples in 119.5 s.Collecting 88 more samples in 118.2 s.Collecting 87 more samples in 116.8 s.Collecting 86 more samples in 115.5 s.Collecting 85 more samples in 114.1 s.Collecting 84 more samples in 112.8 s.Collecting 83 more samples in 111.4 s.Collecting 82 more samples in 110.1 s.Collecting 81 more samples in 108.8 s.Collecting 80 more samples in 107.4 s.Collecting 79 more samples in 106.1 s.Collecting 78 more samples in 104.7 s.Collecting 77 more samples in 103.4 s.Collecting 76 more samples in 102.0 s.Collecting 75 more samples in 100.7 s.Collecting 74 more samples in 99.4 s.Collecting 73 more samples in 98.0 s.Collecting 72 more samples in 96.7 s.Collecting 71 more samples in 95.3 s.Collecting 70 more samples in 94.0 s.Collecting 69 more samples in 92.7 s.Collecting 68 more samples in 91.3 s.Collecting 67 more samples in 90.0 s.Collecting 66 more samples in 88.6 s.Collecting 65 more samples in 87.3 s.Collecting 64 more samples in 85.9 s.Collecting 63 more samples in 84.6 s.Collecting 62 more samples in 83.3 s.Collecting 61 more samples in 81.9 s.Collecting 60 more samples in 80.6 s.Collecting 59 more samples in 79.2 s.Collecting 58 more samples in 77.9 s.Collecting 57 more samples in 76.5 s.Collecting 56 more samples in 75.2 s.Collecting 55 more samples in 73.9 s.Collecting 54 more samples in 72.5 s.Collecting 53 more samples in 71.2 s.Collecting 52 more samples in 69.8 s.Collecting 51 more samples in 68.5 s.Collecting 50 more samples in 67.1 s.Collecting 49 more samples in 65.8 s.Collecting 48 more samples in 64.5 s.Collecting 47 more samples in 63.1 s.Collecting 46 more samples in 61.8 s.Collecting 45 more samples in 60.4 s.Collecting 44 more samples in 59.1 s.Collecting 43 more samples in 57.7 s.Collecting 42 more samples in 56.4 s.Collecting 41 more samples in 55.1 s.Collecting 40 more samples in 53.7 s.Collecting 39 more samples in 52.4 s.Collecting 38 more samples in 51.0 s.Collecting 37 more samples in 49.7 s.Collecting 36 more samples in 48.3 s.Collecting 35 more samples in 47.0 s.Collecting 34 more samples in 45.7 s.Collecting 33 more samples in 44.3 s.Collecting 32 more samples in 43.0 s.Collecting 31 more samples in 41.6 s.Collecting 30 more samples in 40.3 s.Collecting 29 more samples in 38.9 s.Collecting 28 more samples in 37.6 s.Collecting 27 more samples in 36.3 s.Collecting 26 more samples in 34.9 s.Collecting 25 more samples in 33.6 s.Collecting 24 more samples in 32.2 s.Collecting 23 more samples in 30.9 s.Collecting 22 more samples in 29.5 s.Collecting 21 more samples in 28.2 s.Collecting 20 more samples in 26.9 s.Collecting 19 more samples in 25.5 s.Collecting 18 more samples in 24.2 s.Collecting 17 more samples in 22.8 s.Collecting 16 more samples in 21.5 s.Collecting 15 more samples in 20.1 s.Collecting 14 more samples in 18.8 s.Collecting 13 more samples in 17.5 s.Collecting 12 more samples in 16.1 s.Collecting 11 more samples in 14.8 s.Collecting 10 more samples in 13.4 s.Collecting 9 more samples in 12.1 s.Collecting 8 more samples in 10.7 s.Collecting 7 more samples in 9.4 s.Collecting 6 more samples in 8.1 s.Collecting 5 more samples in 6.7 s.Collecting 4 more samples in 5.4 s.Collecting 3 more samples in 4.0 s.Collecting 2 more samples in 2.7 s.Collecting 1 more samples in 1.3 s.mean: 1.336134 s, lower bound: 1.324987 s, upper bound: 1.347019 s, confidence: 0.950 std dev: 56.31915 ms, lower bound: 49.62791 ms, upper bound: 66.42262 ms, confidence: 0.950 found 1 outliers among 100 samples (1.0%) variance introduced by outliers: 39.522% variance is moderately inflated by outliers commits: 200000 retries: 1121628 allocated bytes: 3243199448 Running a subject "12/16666/stm-containers" Collecting 99 more samples in 31.4 s.Collecting 98 more samples in 31.1 s.Collecting 97 more samples in 30.8 s.Collecting 96 more samples in 30.5 s.Collecting 95 more samples in 30.1 s.Collecting 94 more samples in 29.8 s.Collecting 93 more samples in 29.5 s.Collecting 92 more samples in 29.2 s.Collecting 91 more samples in 28.9 s.Collecting 90 more samples in 28.5 s.Collecting 89 more samples in 28.2 s.Collecting 88 more samples in 27.9 s.Collecting 87 more samples in 27.6 s.Collecting 86 more samples in 27.3 s.Collecting 85 more samples in 27.0 s.Collecting 84 more samples in 26.6 s.Collecting 83 more samples in 26.3 s.Collecting 82 more samples in 26.0 s.Collecting 81 more samples in 25.7 s.Collecting 80 more samples in 25.4 s.Collecting 79 more samples in 25.1 s.Collecting 78 more samples in 24.7 s.Collecting 77 more samples in 24.4 s.Collecting 76 more samples in 24.1 s.Collecting 75 more samples in 23.8 s.Collecting 74 more samples in 23.5 s.Collecting 73 more samples in 23.2 s.Collecting 72 more samples in 22.8 s.Collecting 71 more samples in 22.5 s.Collecting 70 more samples in 22.2 s.Collecting 69 more samples in 21.9 s.Collecting 68 more samples in 21.6 s.Collecting 67 more samples in 21.3 s.Collecting 66 more samples in 20.9 s.Collecting 65 more samples in 20.6 s.Collecting 64 more samples in 20.3 s.Collecting 63 more samples in 20.0 s.Collecting 62 more samples in 19.7 s.Collecting 61 more samples in 19.3 s.Collecting 60 more samples in 19.0 s.Collecting 59 more samples in 18.7 s.Collecting 58 more samples in 18.4 s.Collecting 57 more samples in 18.1 s.Collecting 56 more samples in 17.8 s.Collecting 55 more samples in 17.4 s.Collecting 54 more samples in 17.1 s.Collecting 53 more samples in 16.8 s.Collecting 52 more samples in 16.5 s.Collecting 51 more samples in 16.2 s.Collecting 50 more samples in 15.9 s.Collecting 49 more samples in 15.5 s.Collecting 48 more samples in 15.2 s.Collecting 47 more samples in 14.9 s.Collecting 46 more samples in 14.6 s.Collecting 45 more samples in 14.3 s.Collecting 44 more samples in 14.0 s.Collecting 43 more samples in 13.6 s.Collecting 42 more samples in 13.3 s.Collecting 41 more samples in 13.0 s.Collecting 40 more samples in 12.7 s.Collecting 39 more samples in 12.4 s.Collecting 38 more samples in 12.1 s.Collecting 37 more samples in 11.7 s.Collecting 36 more samples in 11.4 s.Collecting 35 more samples in 11.1 s.Collecting 34 more samples in 10.8 s.Collecting 33 more samples in 10.5 s.Collecting 32 more samples in 10.2 s.Collecting 31 more samples in 9.8 s.Collecting 30 more samples in 9.5 s.Collecting 29 more samples in 9.2 s.Collecting 28 more samples in 8.9 s.Collecting 27 more samples in 8.6 s.Collecting 26 more samples in 8.2 s.Collecting 25 more samples in 7.9 s.Collecting 24 more samples in 7.6 s.Collecting 23 more samples in 7.3 s.Collecting 22 more samples in 7.0 s.Collecting 21 more samples in 6.7 s.Collecting 20 more samples in 6.3 s.Collecting 19 more samples in 6.0 s.Collecting 18 more samples in 5.7 s.Collecting 17 more samples in 5.4 s.Collecting 16 more samples in 5.1 s.Collecting 15 more samples in 4.8 s.Collecting 14 more samples in 4.4 s.Collecting 13 more samples in 4.1 s.Collecting 12 more samples in 3.8 s.Collecting 11 more samples in 3.5 s.Collecting 10 more samples in 3.2 s.Collecting 9 more samples in 2.9 s.Collecting 8 more samples in 2.5 s.Collecting 7 more samples in 2.2 s.Collecting 6 more samples in 1.9 s.Collecting 5 more samples in 1.6 s.Collecting 4 more samples in 1.3 s.Collecting 3 more samples in 1.0 s.Collecting 2 more samples in 0.6 s.Collecting 1 more samples in 0.3 s.mean: 305.4242 ms, lower bound: 299.4385 ms, upper bound: 312.0611 ms, confidence: 0.950 std dev: 32.39169 ms, lower bound: 28.45202 ms, upper bound: 37.58673 ms, confidence: 0.950 found 1 outliers among 100 samples (1.0%) variance introduced by outliers: 81.066% variance is severely inflated by outliers commits: 200000 retries: 3420 allocated bytes: 678618904 Running a subject "12/16666/ttrie" Collecting 99 more samples in 29.4 s.Collecting 98 more samples in 29.1 s.Collecting 97 more samples in 28.8 s.Collecting 96 more samples in 28.5 s.Collecting 95 more samples in 28.2 s.Collecting 94 more samples in 27.9 s.Collecting 93 more samples in 27.6 s.Collecting 92 more samples in 27.3 s.Collecting 91 more samples in 27.0 s.Collecting 90 more samples in 26.7 s.Collecting 89 more samples in 26.4 s.Collecting 88 more samples in 26.1 s.Collecting 87 more samples in 25.8 s.Collecting 86 more samples in 25.5 s.Collecting 85 more samples in 25.3 s.Collecting 84 more samples in 25.0 s.Collecting 83 more samples in 24.7 s.Collecting 82 more samples in 24.4 s.Collecting 81 more samples in 24.1 s.Collecting 80 more samples in 23.8 s.Collecting 79 more samples in 23.5 s.Collecting 78 more samples in 23.2 s.Collecting 77 more samples in 22.9 s.Collecting 76 more samples in 22.6 s.Collecting 75 more samples in 22.3 s.Collecting 74 more samples in 22.0 s.Collecting 73 more samples in 21.7 s.Collecting 72 more samples in 21.4 s.Collecting 71 more samples in 21.1 s.Collecting 70 more samples in 20.8 s.Collecting 69 more samples in 20.5 s.Collecting 68 more samples in 20.2 s.Collecting 67 more samples in 19.9 s.Collecting 66 more samples in 19.6 s.Collecting 65 more samples in 19.3 s.Collecting 64 more samples in 19.0 s.Collecting 63 more samples in 18.7 s.Collecting 62 more samples in 18.4 s.Collecting 61 more samples in 18.1 s.Collecting 60 more samples in 17.8 s.Collecting 59 more samples in 17.5 s.Collecting 58 more samples in 17.2 s.Collecting 57 more samples in 16.9 s.Collecting 56 more samples in 16.6 s.Collecting 55 more samples in 16.3 s.Collecting 54 more samples in 16.0 s.Collecting 53 more samples in 15.7 s.Collecting 52 more samples in 15.4 s.Collecting 51 more samples in 15.2 s.Collecting 50 more samples in 14.9 s.Collecting 49 more samples in 14.6 s.Collecting 48 more samples in 14.3 s.Collecting 47 more samples in 14.0 s.Collecting 46 more samples in 13.7 s.Collecting 45 more samples in 13.4 s.Collecting 44 more samples in 13.1 s.Collecting 43 more samples in 12.8 s.Collecting 42 more samples in 12.5 s.Collecting 41 more samples in 12.2 s.Collecting 40 more samples in 11.9 s.Collecting 39 more samples in 11.6 s.Collecting 38 more samples in 11.3 s.Collecting 37 more samples in 11.0 s.Collecting 36 more samples in 10.7 s.Collecting 35 more samples in 10.4 s.Collecting 34 more samples in 10.1 s.Collecting 33 more samples in 9.8 s.Collecting 32 more samples in 9.5 s.Collecting 31 more samples in 9.2 s.Collecting 30 more samples in 8.9 s.Collecting 29 more samples in 8.6 s.Collecting 28 more samples in 8.3 s.Collecting 27 more samples in 8.0 s.Collecting 26 more samples in 7.7 s.Collecting 25 more samples in 7.4 s.Collecting 24 more samples in 7.1 s.Collecting 23 more samples in 6.8 s.Collecting 22 more samples in 6.5 s.Collecting 21 more samples in 6.2 s.Collecting 20 more samples in 5.9 s.Collecting 19 more samples in 5.6 s.Collecting 18 more samples in 5.3 s.Collecting 17 more samples in 5.1 s.Collecting 16 more samples in 4.8 s.Collecting 15 more samples in 4.5 s.Collecting 14 more samples in 4.2 s.Collecting 13 more samples in 3.9 s.Collecting 12 more samples in 3.6 s.Collecting 11 more samples in 3.3 s.Collecting 10 more samples in 3.0 s.Collecting 9 more samples in 2.7 s.Collecting 8 more samples in 2.4 s.Collecting 7 more samples in 2.1 s.Collecting 6 more samples in 1.8 s.Collecting 5 more samples in 1.5 s.Collecting 4 more samples in 1.2 s.Collecting 3 more samples in 0.9 s.Collecting 2 more samples in 0.6 s.Collecting 1 more samples in 0.3 s.mean: 326.0444 ms, lower bound: 320.2735 ms, upper bound: 332.6036 ms, confidence: 0.950 std dev: 31.55486 ms, lower bound: 27.04294 ms, upper bound: 37.46586 ms, confidence: 0.950 found 4 outliers among 100 samples (4.0%) 4 (4.0%) high mild variance introduced by outliers: 77.959% variance is severely inflated by outliers commits: 200000 retries: 7 allocated bytes: 384152704 Running a subject "14/14285/unordered-containers" Collecting 99 more samples in 121.7 s.Collecting 98 more samples in 120.4 s.Collecting 97 more samples in 119.2 s.Collecting 96 more samples in 118.0 s.Collecting 95 more samples in 116.8 s.Collecting 94 more samples in 115.5 s.Collecting 93 more samples in 114.3 s.Collecting 92 more samples in 113.1 s.Collecting 91 more samples in 111.8 s.Collecting 90 more samples in 110.6 s.Collecting 89 more samples in 109.4 s.Collecting 88 more samples in 108.2 s.Collecting 87 more samples in 106.9 s.Collecting 86 more samples in 105.7 s.Collecting 85 more samples in 104.5 s.Collecting 84 more samples in 103.2 s.Collecting 83 more samples in 102.0 s.Collecting 82 more samples in 100.8 s.Collecting 81 more samples in 99.6 s.Collecting 80 more samples in 98.3 s.Collecting 79 more samples in 97.1 s.Collecting 78 more samples in 95.9 s.Collecting 77 more samples in 94.6 s.Collecting 76 more samples in 93.4 s.Collecting 75 more samples in 92.2 s.Collecting 74 more samples in 91.0 s.Collecting 73 more samples in 89.7 s.Collecting 72 more samples in 88.5 s.Collecting 71 more samples in 87.3 s.Collecting 70 more samples in 86.0 s.Collecting 69 more samples in 84.8 s.Collecting 68 more samples in 83.6 s.Collecting 67 more samples in 82.3 s.Collecting 66 more samples in 81.1 s.Collecting 65 more samples in 79.9 s.Collecting 64 more samples in 78.7 s.Collecting 63 more samples in 77.4 s.Collecting 62 more samples in 76.2 s.Collecting 61 more samples in 75.0 s.Collecting 60 more samples in 73.7 s.Collecting 59 more samples in 72.5 s.Collecting 58 more samples in 71.3 s.Collecting 57 more samples in 70.1 s.Collecting 56 more samples in 68.8 s.Collecting 55 more samples in 67.6 s.Collecting 54 more samples in 66.4 s.Collecting 53 more samples in 65.1 s.Collecting 52 more samples in 63.9 s.Collecting 51 more samples in 62.7 s.Collecting 50 more samples in 61.5 s.Collecting 49 more samples in 60.2 s.Collecting 48 more samples in 59.0 s.Collecting 47 more samples in 57.8 s.Collecting 46 more samples in 56.5 s.Collecting 45 more samples in 55.3 s.Collecting 44 more samples in 54.1 s.Collecting 43 more samples in 52.8 s.Collecting 42 more samples in 51.6 s.Collecting 41 more samples in 50.4 s.Collecting 40 more samples in 49.2 s.Collecting 39 more samples in 47.9 s.Collecting 38 more samples in 46.7 s.Collecting 37 more samples in 45.5 s.Collecting 36 more samples in 44.2 s.Collecting 35 more samples in 43.0 s.Collecting 34 more samples in 41.8 s.Collecting 33 more samples in 40.6 s.Collecting 32 more samples in 39.3 s.Collecting 31 more samples in 38.1 s.Collecting 30 more samples in 36.9 s.Collecting 29 more samples in 35.6 s.Collecting 28 more samples in 34.4 s.Collecting 27 more samples in 33.2 s.Collecting 26 more samples in 32.0 s.Collecting 25 more samples in 30.7 s.Collecting 24 more samples in 29.5 s.Collecting 23 more samples in 28.3 s.Collecting 22 more samples in 27.0 s.Collecting 21 more samples in 25.8 s.Collecting 20 more samples in 24.6 s.Collecting 19 more samples in 23.4 s.Collecting 18 more samples in 22.1 s.Collecting 17 more samples in 20.9 s.Collecting 16 more samples in 19.7 s.Collecting 15 more samples in 18.4 s.Collecting 14 more samples in 17.2 s.Collecting 13 more samples in 16.0 s.Collecting 12 more samples in 14.7 s.Collecting 11 more samples in 13.5 s.Collecting 10 more samples in 12.3 s.Collecting 9 more samples in 11.1 s.Collecting 8 more samples in 9.8 s.Collecting 7 more samples in 8.6 s.Collecting 6 more samples in 7.4 s.Collecting 5 more samples in 6.1 s.Collecting 4 more samples in 4.9 s.Collecting 3 more samples in 3.7 s.Collecting 2 more samples in 2.5 s.Collecting 1 more samples in 1.2 s.mean: 1.363506 s, lower bound: 1.344168 s, upper bound: 1.387616 s, confidence: 0.950 std dev: 110.3185 ms, lower bound: 84.47099 ms, upper bound: 171.4157 ms, confidence: 0.950 found 13 outliers among 100 samples (13.0%) 1 (1.0%) low severe 8 (8.0%) low mild 3 (3.0%) high mild 1 (1.0%) high severe variance introduced by outliers: 71.728% variance is severely inflated by outliers commits: 200000 retries: 1211625 allocated bytes: 3798105080 Running a subject "14/14285/stm-containers" Collecting 99 more samples in 30.8 s.Collecting 98 more samples in 30.5 s.Collecting 97 more samples in 30.1 s.Collecting 96 more samples in 29.8 s.Collecting 95 more samples in 29.5 s.Collecting 94 more samples in 29.2 s.Collecting 93 more samples in 28.9 s.Collecting 92 more samples in 28.6 s.Collecting 91 more samples in 28.3 s.Collecting 90 more samples in 28.0 s.Collecting 89 more samples in 27.7 s.Collecting 88 more samples in 27.4 s.Collecting 87 more samples in 27.0 s.Collecting 86 more samples in 26.7 s.Collecting 85 more samples in 26.4 s.Collecting 84 more samples in 26.1 s.Collecting 83 more samples in 25.8 s.Collecting 82 more samples in 25.5 s.Collecting 81 more samples in 25.2 s.Collecting 80 more samples in 24.9 s.Collecting 79 more samples in 24.6 s.Collecting 78 more samples in 24.2 s.Collecting 77 more samples in 23.9 s.Collecting 76 more samples in 23.6 s.Collecting 75 more samples in 23.3 s.Collecting 74 more samples in 23.0 s.Collecting 73 more samples in 22.7 s.Collecting 72 more samples in 22.4 s.Collecting 71 more samples in 22.1 s.Collecting 70 more samples in 21.8 s.Collecting 69 more samples in 21.4 s.Collecting 68 more samples in 21.1 s.Collecting 67 more samples in 20.8 s.Collecting 66 more samples in 20.5 s.Collecting 65 more samples in 20.2 s.Collecting 64 more samples in 19.9 s.Collecting 63 more samples in 19.6 s.Collecting 62 more samples in 19.3 s.Collecting 61 more samples in 19.0 s.Collecting 60 more samples in 18.6 s.Collecting 59 more samples in 18.3 s.Collecting 58 more samples in 18.0 s.Collecting 57 more samples in 17.7 s.Collecting 56 more samples in 17.4 s.Collecting 55 more samples in 17.1 s.Collecting 54 more samples in 16.8 s.Collecting 53 more samples in 16.5 s.Collecting 52 more samples in 16.2 s.Collecting 51 more samples in 15.9 s.Collecting 50 more samples in 15.5 s.Collecting 49 more samples in 15.2 s.Collecting 48 more samples in 14.9 s.Collecting 47 more samples in 14.6 s.Collecting 46 more samples in 14.3 s.Collecting 45 more samples in 14.0 s.Collecting 44 more samples in 13.7 s.Collecting 43 more samples in 13.4 s.Collecting 42 more samples in 13.1 s.Collecting 41 more samples in 12.7 s.Collecting 40 more samples in 12.4 s.Collecting 39 more samples in 12.1 s.Collecting 38 more samples in 11.8 s.Collecting 37 more samples in 11.5 s.Collecting 36 more samples in 11.2 s.Collecting 35 more samples in 10.9 s.Collecting 34 more samples in 10.6 s.Collecting 33 more samples in 10.3 s.Collecting 32 more samples in 9.9 s.Collecting 31 more samples in 9.6 s.Collecting 30 more samples in 9.3 s.Collecting 29 more samples in 9.0 s.Collecting 28 more samples in 8.7 s.Collecting 27 more samples in 8.4 s.Collecting 26 more samples in 8.1 s.Collecting 25 more samples in 7.8 s.Collecting 24 more samples in 7.5 s.Collecting 23 more samples in 7.1 s.Collecting 22 more samples in 6.8 s.Collecting 21 more samples in 6.5 s.Collecting 20 more samples in 6.2 s.Collecting 19 more samples in 5.9 s.Collecting 18 more samples in 5.6 s.Collecting 17 more samples in 5.3 s.Collecting 16 more samples in 5.0 s.Collecting 15 more samples in 4.7 s.Collecting 14 more samples in 4.4 s.Collecting 13 more samples in 4.0 s.Collecting 12 more samples in 3.7 s.Collecting 11 more samples in 3.4 s.Collecting 10 more samples in 3.1 s.Collecting 9 more samples in 2.8 s.Collecting 8 more samples in 2.5 s.Collecting 7 more samples in 2.2 s.Collecting 6 more samples in 1.9 s.Collecting 5 more samples in 1.6 s.Collecting 4 more samples in 1.2 s.Collecting 3 more samples in 0.9 s.Collecting 2 more samples in 0.6 s.Collecting 1 more samples in 0.3 s.mean: 280.3616 ms, lower bound: 275.6138 ms, upper bound: 285.8619 ms, confidence: 0.950 std dev: 26.13746 ms, lower bound: 22.17867 ms, upper bound: 32.61286 ms, confidence: 0.950 found 3 outliers among 100 samples (3.0%) 3 (3.0%) high mild variance introduced by outliers: 76.906% variance is severely inflated by outliers commits: 200000 retries: 3886 allocated bytes: 679223544 Running a subject "14/14285/ttrie" Collecting 99 more samples in 33.0 s.Collecting 98 more samples in 32.7 s.Collecting 97 more samples in 32.4 s.Collecting 96 more samples in 32.0 s.Collecting 95 more samples in 31.7 s.Collecting 94 more samples in 31.4 s.Collecting 93 more samples in 31.0 s.Collecting 92 more samples in 30.7 s.Collecting 91 more samples in 30.4 s.Collecting 90 more samples in 30.0 s.Collecting 89 more samples in 29.7 s.Collecting 88 more samples in 29.4 s.Collecting 87 more samples in 29.0 s.Collecting 86 more samples in 28.7 s.Collecting 85 more samples in 28.4 s.Collecting 84 more samples in 28.0 s.Collecting 83 more samples in 27.7 s.Collecting 82 more samples in 27.4 s.Collecting 81 more samples in 27.0 s.Collecting 80 more samples in 26.7 s.Collecting 79 more samples in 26.4 s.Collecting 78 more samples in 26.0 s.Collecting 77 more samples in 25.7 s.Collecting 76 more samples in 25.4 s.Collecting 75 more samples in 25.0 s.Collecting 74 more samples in 24.7 s.Collecting 73 more samples in 24.4 s.Collecting 72 more samples in 24.0 s.Collecting 71 more samples in 23.7 s.Collecting 70 more samples in 23.4 s.Collecting 69 more samples in 23.0 s.Collecting 68 more samples in 22.7 s.Collecting 67 more samples in 22.4 s.Collecting 66 more samples in 22.0 s.Collecting 65 more samples in 21.7 s.Collecting 64 more samples in 21.4 s.Collecting 63 more samples in 21.0 s.Collecting 62 more samples in 20.7 s.Collecting 61 more samples in 20.4 s.Collecting 60 more samples in 20.0 s.Collecting 59 more samples in 19.7 s.Collecting 58 more samples in 19.4 s.Collecting 57 more samples in 19.0 s.Collecting 56 more samples in 18.7 s.Collecting 55 more samples in 18.4 s.Collecting 54 more samples in 18.0 s.Collecting 53 more samples in 17.7 s.Collecting 52 more samples in 17.4 s.Collecting 51 more samples in 17.0 s.Collecting 50 more samples in 16.7 s.Collecting 49 more samples in 16.4 s.Collecting 48 more samples in 16.0 s.Collecting 47 more samples in 15.7 s.Collecting 46 more samples in 15.4 s.Collecting 45 more samples in 15.0 s.Collecting 44 more samples in 14.7 s.Collecting 43 more samples in 14.3 s.Collecting 42 more samples in 14.0 s.Collecting 41 more samples in 13.7 s.Collecting 40 more samples in 13.3 s.Collecting 39 more samples in 13.0 s.Collecting 38 more samples in 12.7 s.Collecting 37 more samples in 12.3 s.Collecting 36 more samples in 12.0 s.Collecting 35 more samples in 11.7 s.Collecting 34 more samples in 11.3 s.Collecting 33 more samples in 11.0 s.Collecting 32 more samples in 10.7 s.Collecting 31 more samples in 10.3 s.Collecting 30 more samples in 10.0 s.Collecting 29 more samples in 9.7 s.Collecting 28 more samples in 9.3 s.Collecting 27 more samples in 9.0 s.Collecting 26 more samples in 8.7 s.Collecting 25 more samples in 8.3 s.Collecting 24 more samples in 8.0 s.Collecting 23 more samples in 7.7 s.Collecting 22 more samples in 7.3 s.Collecting 21 more samples in 7.0 s.Collecting 20 more samples in 6.7 s.Collecting 19 more samples in 6.3 s.Collecting 18 more samples in 6.0 s.Collecting 17 more samples in 5.7 s.Collecting 16 more samples in 5.3 s.Collecting 15 more samples in 5.0 s.Collecting 14 more samples in 4.7 s.Collecting 13 more samples in 4.3 s.Collecting 12 more samples in 4.0 s.Collecting 11 more samples in 3.7 s.Collecting 10 more samples in 3.3 s.Collecting 9 more samples in 3.0 s.Collecting 8 more samples in 2.7 s.Collecting 7 more samples in 2.3 s.Collecting 6 more samples in 2.0 s.Collecting 5 more samples in 1.7 s.Collecting 4 more samples in 1.3 s.Collecting 3 more samples in 1.0 s.Collecting 2 more samples in 0.7 s.Collecting 1 more samples in 0.3 s.mean: 316.4498 ms, lower bound: 309.3309 ms, upper bound: 324.2445 ms, confidence: 0.950 std dev: 38.15261 ms, lower bound: 31.74083 ms, upper bound: 46.51308 ms, confidence: 0.950 found 8 outliers among 100 samples (8.0%) 3 (3.0%) low mild 5 (5.0%) high mild variance introduced by outliers: 85.205% variance is severely inflated by outliers commits: 200000 retries: 12 allocated bytes: 384030128 Running a subject "16/12500/unordered-containers" Collecting 99 more samples in 140.3 s.Collecting 98 more samples in 138.9 s.Collecting 97 more samples in 137.5 s.Collecting 96 more samples in 136.1 s.Collecting 95 more samples in 134.6 s.Collecting 94 more samples in 133.2 s.Collecting 93 more samples in 131.8 s.Collecting 92 more samples in 130.4 s.Collecting 91 more samples in 129.0 s.Collecting 90 more samples in 127.6 s.Collecting 89 more samples in 126.1 s.Collecting 88 more samples in 124.7 s.Collecting 87 more samples in 123.3 s.Collecting 86 more samples in 121.9 s.Collecting 85 more samples in 120.5 s.Collecting 84 more samples in 119.1 s.Collecting 83 more samples in 117.6 s.Collecting 82 more samples in 116.2 s.Collecting 81 more samples in 114.8 s.Collecting 80 more samples in 113.4 s.Collecting 79 more samples in 112.0 s.Collecting 78 more samples in 110.5 s.Collecting 77 more samples in 109.1 s.Collecting 76 more samples in 107.7 s.Collecting 75 more samples in 106.3 s.Collecting 74 more samples in 104.9 s.Collecting 73 more samples in 103.5 s.Collecting 72 more samples in 102.0 s.Collecting 71 more samples in 100.6 s.Collecting 70 more samples in 99.2 s.Collecting 69 more samples in 97.8 s.Collecting 68 more samples in 96.4 s.Collecting 67 more samples in 95.0 s.Collecting 66 more samples in 93.5 s.Collecting 65 more samples in 92.1 s.Collecting 64 more samples in 90.7 s.Collecting 63 more samples in 89.3 s.Collecting 62 more samples in 87.9 s.Collecting 61 more samples in 86.5 s.Collecting 60 more samples in 85.0 s.Collecting 59 more samples in 83.6 s.Collecting 58 more samples in 82.2 s.Collecting 57 more samples in 80.8 s.Collecting 56 more samples in 79.4 s.Collecting 55 more samples in 78.0 s.Collecting 54 more samples in 76.5 s.Collecting 53 more samples in 75.1 s.Collecting 52 more samples in 73.7 s.Collecting 51 more samples in 72.3 s.Collecting 50 more samples in 70.9 s.Collecting 49 more samples in 69.4 s.Collecting 48 more samples in 68.0 s.Collecting 47 more samples in 66.6 s.Collecting 46 more samples in 65.2 s.Collecting 45 more samples in 63.8 s.Collecting 44 more samples in 62.4 s.Collecting 43 more samples in 60.9 s.Collecting 42 more samples in 59.5 s.Collecting 41 more samples in 58.1 s.Collecting 40 more samples in 56.7 s.Collecting 39 more samples in 55.3 s.Collecting 38 more samples in 53.9 s.Collecting 37 more samples in 52.4 s.Collecting 36 more samples in 51.0 s.Collecting 35 more samples in 49.6 s.Collecting 34 more samples in 48.2 s.Collecting 33 more samples in 46.8 s.Collecting 32 more samples in 45.4 s.Collecting 31 more samples in 43.9 s.Collecting 30 more samples in 42.5 s.Collecting 29 more samples in 41.1 s.Collecting 28 more samples in 39.7 s.Collecting 27 more samples in 38.3 s.Collecting 26 more samples in 36.8 s.Collecting 25 more samples in 35.4 s.Collecting 24 more samples in 34.0 s.Collecting 23 more samples in 32.6 s.Collecting 22 more samples in 31.2 s.Collecting 21 more samples in 29.8 s.Collecting 20 more samples in 28.3 s.Collecting 19 more samples in 26.9 s.Collecting 18 more samples in 25.5 s.Collecting 17 more samples in 24.1 s.Collecting 16 more samples in 22.7 s.Collecting 15 more samples in 21.3 s.Collecting 14 more samples in 19.8 s.Collecting 13 more samples in 18.4 s.Collecting 12 more samples in 17.0 s.Collecting 11 more samples in 15.6 s.Collecting 10 more samples in 14.2 s.Collecting 9 more samples in 12.8 s.Collecting 8 more samples in 11.3 s.Collecting 7 more samples in 9.9 s.Collecting 6 more samples in 8.5 s.Collecting 5 more samples in 7.1 s.Collecting 4 more samples in 5.7 s.Collecting 3 more samples in 4.3 s.Collecting 2 more samples in 2.8 s.Collecting 1 more samples in 1.4 s.mean: 1.391954 s, lower bound: 1.364231 s, upper bound: 1.424689 s, confidence: 0.950 std dev: 154.4820 ms, lower bound: 129.8548 ms, upper bound: 194.1225 ms, confidence: 0.950 found 3 outliers among 100 samples (3.0%) 3 (3.0%) high mild variance introduced by outliers: 82.126% variance is severely inflated by outliers commits: 200000 retries: 1342929 allocated bytes: 4213293760 Running a subject "16/12500/stm-containers" Collecting 99 more samples in 28.8 s.Collecting 98 more samples in 28.5 s.Collecting 97 more samples in 28.2 s.Collecting 96 more samples in 27.9 s.Collecting 95 more samples in 27.6 s.Collecting 94 more samples in 27.3 s.Collecting 93 more samples in 27.0 s.Collecting 92 more samples in 26.7 s.Collecting 91 more samples in 26.4 s.Collecting 90 more samples in 26.2 s.Collecting 89 more samples in 25.9 s.Collecting 88 more samples in 25.6 s.Collecting 87 more samples in 25.3 s.Collecting 86 more samples in 25.0 s.Collecting 85 more samples in 24.7 s.Collecting 84 more samples in 24.4 s.Collecting 83 more samples in 24.1 s.Collecting 82 more samples in 23.8 s.Collecting 81 more samples in 23.5 s.Collecting 80 more samples in 23.3 s.Collecting 79 more samples in 23.0 s.Collecting 78 more samples in 22.7 s.Collecting 77 more samples in 22.4 s.Collecting 76 more samples in 22.1 s.Collecting 75 more samples in 21.8 s.Collecting 74 more samples in 21.5 s.Collecting 73 more samples in 21.2 s.Collecting 72 more samples in 20.9 s.Collecting 71 more samples in 20.6 s.Collecting 70 more samples in 20.3 s.Collecting 69 more samples in 20.1 s.Collecting 68 more samples in 19.8 s.Collecting 67 more samples in 19.5 s.Collecting 66 more samples in 19.2 s.Collecting 65 more samples in 18.9 s.Collecting 64 more samples in 18.6 s.Collecting 63 more samples in 18.3 s.Collecting 62 more samples in 18.0 s.Collecting 61 more samples in 17.7 s.Collecting 60 more samples in 17.4 s.Collecting 59 more samples in 17.1 s.Collecting 58 more samples in 16.9 s.Collecting 57 more samples in 16.6 s.Collecting 56 more samples in 16.3 s.Collecting 55 more samples in 16.0 s.Collecting 54 more samples in 15.7 s.Collecting 53 more samples in 15.4 s.Collecting 52 more samples in 15.1 s.Collecting 51 more samples in 14.8 s.Collecting 50 more samples in 14.5 s.Collecting 49 more samples in 14.2 s.Collecting 48 more samples in 14.0 s.Collecting 47 more samples in 13.7 s.Collecting 46 more samples in 13.4 s.Collecting 45 more samples in 13.1 s.Collecting 44 more samples in 12.8 s.Collecting 43 more samples in 12.5 s.Collecting 42 more samples in 12.2 s.Collecting 41 more samples in 11.9 s.Collecting 40 more samples in 11.6 s.Collecting 39 more samples in 11.3 s.Collecting 38 more samples in 11.0 s.Collecting 37 more samples in 10.8 s.Collecting 36 more samples in 10.5 s.Collecting 35 more samples in 10.2 s.Collecting 34 more samples in 9.9 s.Collecting 33 more samples in 9.6 s.Collecting 32 more samples in 9.3 s.Collecting 31 more samples in 9.0 s.Collecting 30 more samples in 8.7 s.Collecting 29 more samples in 8.4 s.Collecting 28 more samples in 8.1 s.Collecting 27 more samples in 7.8 s.Collecting 26 more samples in 7.6 s.Collecting 25 more samples in 7.3 s.Collecting 24 more samples in 7.0 s.Collecting 23 more samples in 6.7 s.Collecting 22 more samples in 6.4 s.Collecting 21 more samples in 6.1 s.Collecting 20 more samples in 5.8 s.Collecting 19 more samples in 5.5 s.Collecting 18 more samples in 5.2 s.Collecting 17 more samples in 4.9 s.Collecting 16 more samples in 4.7 s.Collecting 15 more samples in 4.4 s.Collecting 14 more samples in 4.1 s.Collecting 13 more samples in 3.8 s.Collecting 12 more samples in 3.5 s.Collecting 11 more samples in 3.2 s.Collecting 10 more samples in 2.9 s.Collecting 9 more samples in 2.6 s.Collecting 8 more samples in 2.3 s.Collecting 7 more samples in 2.0 s.Collecting 6 more samples in 1.7 s.Collecting 5 more samples in 1.5 s.Collecting 4 more samples in 1.2 s.Collecting 3 more samples in 0.9 s.Collecting 2 more samples in 0.6 s.Collecting 1 more samples in 0.3 s.mean: 278.9163 ms, lower bound: 273.9220 ms, upper bound: 286.2301 ms, confidence: 0.950 std dev: 30.82138 ms, lower bound: 23.03427 ms, upper bound: 48.74225 ms, confidence: 0.950 found 4 outliers among 100 samples (4.0%) 3 (3.0%) high mild 1 (1.0%) high severe variance introduced by outliers: 82.119% variance is severely inflated by outliers commits: 200000 retries: 4111 allocated bytes: 679959984 Running a subject "16/12500/ttrie" Collecting 99 more samples in 29.7 s.Collecting 98 more samples in 29.4 s.Collecting 97 more samples in 29.1 s.Collecting 96 more samples in 28.8 s.Collecting 95 more samples in 28.5 s.Collecting 94 more samples in 28.2 s.Collecting 93 more samples in 27.9 s.Collecting 92 more samples in 27.6 s.Collecting 91 more samples in 27.3 s.Collecting 90 more samples in 27.0 s.Collecting 89 more samples in 26.7 s.Collecting 88 more samples in 26.4 s.Collecting 87 more samples in 26.1 s.Collecting 86 more samples in 25.8 s.Collecting 85 more samples in 25.5 s.Collecting 84 more samples in 25.2 s.Collecting 83 more samples in 24.9 s.Collecting 82 more samples in 24.6 s.Collecting 81 more samples in 24.3 s.Collecting 80 more samples in 24.0 s.Collecting 79 more samples in 23.7 s.Collecting 78 more samples in 23.4 s.Collecting 77 more samples in 23.1 s.Collecting 76 more samples in 22.8 s.Collecting 75 more samples in 22.5 s.Collecting 74 more samples in 22.2 s.Collecting 73 more samples in 21.9 s.Collecting 72 more samples in 21.6 s.Collecting 71 more samples in 21.3 s.Collecting 70 more samples in 21.0 s.Collecting 69 more samples in 20.7 s.Collecting 68 more samples in 20.4 s.Collecting 67 more samples in 20.1 s.Collecting 66 more samples in 19.8 s.Collecting 65 more samples in 19.5 s.Collecting 64 more samples in 19.2 s.Collecting 63 more samples in 18.9 s.Collecting 62 more samples in 18.6 s.Collecting 61 more samples in 18.3 s.Collecting 60 more samples in 18.0 s.Collecting 59 more samples in 17.7 s.Collecting 58 more samples in 17.4 s.Collecting 57 more samples in 17.1 s.Collecting 56 more samples in 16.8 s.Collecting 55 more samples in 16.5 s.Collecting 54 more samples in 16.2 s.Collecting 53 more samples in 15.9 s.Collecting 52 more samples in 15.6 s.Collecting 51 more samples in 15.3 s.Collecting 50 more samples in 15.0 s.Collecting 49 more samples in 14.7 s.Collecting 48 more samples in 14.4 s.Collecting 47 more samples in 14.1 s.Collecting 46 more samples in 13.8 s.Collecting 45 more samples in 13.5 s.Collecting 44 more samples in 13.2 s.Collecting 43 more samples in 12.9 s.Collecting 42 more samples in 12.6 s.Collecting 41 more samples in 12.3 s.Collecting 40 more samples in 12.0 s.Collecting 39 more samples in 11.7 s.Collecting 38 more samples in 11.4 s.Collecting 37 more samples in 11.1 s.Collecting 36 more samples in 10.8 s.Collecting 35 more samples in 10.5 s.Collecting 34 more samples in 10.2 s.Collecting 33 more samples in 9.9 s.Collecting 32 more samples in 9.6 s.Collecting 31 more samples in 9.3 s.Collecting 30 more samples in 9.0 s.Collecting 29 more samples in 8.7 s.Collecting 28 more samples in 8.4 s.Collecting 27 more samples in 8.1 s.Collecting 26 more samples in 7.8 s.Collecting 25 more samples in 7.5 s.Collecting 24 more samples in 7.2 s.Collecting 23 more samples in 6.9 s.Collecting 22 more samples in 6.6 s.Collecting 21 more samples in 6.3 s.Collecting 20 more samples in 6.0 s.Collecting 19 more samples in 5.7 s.Collecting 18 more samples in 5.4 s.Collecting 17 more samples in 5.1 s.Collecting 16 more samples in 4.8 s.Collecting 15 more samples in 4.5 s.Collecting 14 more samples in 4.2 s.Collecting 13 more samples in 3.9 s.Collecting 12 more samples in 3.6 s.Collecting 11 more samples in 3.3 s.Collecting 10 more samples in 3.0 s.Collecting 9 more samples in 2.7 s.Collecting 8 more samples in 2.4 s.Collecting 7 more samples in 2.1 s.Collecting 6 more samples in 1.8 s.Collecting 5 more samples in 1.5 s.Collecting 4 more samples in 1.2 s.Collecting 3 more samples in 0.9 s.Collecting 2 more samples in 0.6 s.Collecting 1 more samples in 0.3 s.mean: 306.2821 ms, lower bound: 296.2647 ms, upper bound: 315.0784 ms, confidence: 0.950 std dev: 47.86874 ms, lower bound: 41.38387 ms, upper bound: 54.84384 ms, confidence: 0.950 found 20 outliers among 100 samples (20.0%) 1 (1.0%) low severe 16 (16.0%) low mild 3 (3.0%) high mild variance introduced by outliers: 90.470% variance is severely inflated by outliers commits: 200000 retries: 6 allocated bytes: 384274888 Benchmark bench: FINISH