Preprocessing library ttrie-0.1.2... In-place registering ttrie-0.1.2... Preprocessing benchmark 'bench' for ttrie-0.1.2... Running 1 benchmarks... Benchmark bench: RUNNING... threads = [1,2,4,6,8,10,12,14,16] numTransactions = 200000 sizes = [(1,1)] numPrefill = 200000 ops = (0,0,1,0) Generating 200000 random keys to prefill... Generating 200000 random transactions... warming up estimating clock resolution... mean is 3.144035 us (320001 iterations) found 9326 outliers among 319999 samples (2.9%) 7332 (2.3%) high severe estimating cost of a clock call... mean is 826.5144 ns (20 iterations) Running a subject "1/200000/unordered-containers" Collecting 100 more samples in 5.5 s.Collecting 99 more samples in 5.5 s.Collecting 98 more samples in 5.4 s.Collecting 97 more samples in 5.4 s.Collecting 96 more samples in 5.3 s.Collecting 95 more samples in 5.3 s.Collecting 94 more samples in 5.2 s.Collecting 93 more samples in 5.1 s.Collecting 92 more samples in 5.1 s.Collecting 91 more samples in 5.0 s.Collecting 90 more samples in 5.0 s.Collecting 89 more samples in 4.9 s.Collecting 88 more samples in 4.9 s.Collecting 87 more samples in 4.8 s.Collecting 86 more samples in 4.8 s.Collecting 85 more samples in 4.7 s.Collecting 84 more samples in 4.7 s.Collecting 83 more samples in 4.6 s.Collecting 82 more samples in 4.5 s.Collecting 81 more samples in 4.5 s.Collecting 80 more samples in 4.4 s.Collecting 79 more samples in 4.4 s.Collecting 78 more samples in 4.3 s.Collecting 77 more samples in 4.3 s.Collecting 76 more samples in 4.2 s.Collecting 75 more samples in 4.2 s.Collecting 74 more samples in 4.1 s.Collecting 73 more samples in 4.0 s.Collecting 72 more samples in 4.0 s.Collecting 71 more samples in 3.9 s.Collecting 70 more samples in 3.9 s.Collecting 69 more samples in 3.8 s.Collecting 68 more samples in 3.8 s.Collecting 67 more samples in 3.7 s.Collecting 66 more samples in 3.7 s.Collecting 65 more samples in 3.6 s.Collecting 64 more samples in 3.5 s.Collecting 63 more samples in 3.5 s.Collecting 62 more samples in 3.4 s.Collecting 61 more samples in 3.4 s.Collecting 60 more samples in 3.3 s.Collecting 59 more samples in 3.3 s.Collecting 58 more samples in 3.2 s.Collecting 57 more samples in 3.2 s.Collecting 56 more samples in 3.1 s.Collecting 55 more samples in 3.0 s.Collecting 54 more samples in 3.0 s.Collecting 53 more samples in 2.9 s.Collecting 52 more samples in 2.9 s.Collecting 51 more samples in 2.8 s.Collecting 50 more samples in 2.8 s.Collecting 49 more samples in 2.7 s.Collecting 48 more samples in 2.7 s.Collecting 47 more samples in 2.6 s.Collecting 46 more samples in 2.5 s.Collecting 45 more samples in 2.5 s.Collecting 44 more samples in 2.4 s.Collecting 43 more samples in 2.4 s.Collecting 42 more samples in 2.3 s.Collecting 41 more samples in 2.3 s.Collecting 40 more samples in 2.2 s.Collecting 39 more samples in 2.2 s.Collecting 38 more samples in 2.1 s.Collecting 37 more samples in 2.0 s.Collecting 36 more samples in 2.0 s.Collecting 35 more samples in 1.9 s.Collecting 34 more samples in 1.9 s.Collecting 33 more samples in 1.8 s.Collecting 32 more samples in 1.8 s.Collecting 31 more samples in 1.7 s.Collecting 30 more samples in 1.7 s.Collecting 29 more samples in 1.6 s.Collecting 28 more samples in 1.6 s.Collecting 27 more samples in 1.5 s.Collecting 26 more samples in 1.4 s.Collecting 25 more samples in 1.4 s.Collecting 24 more samples in 1.3 s.Collecting 23 more samples in 1.3 s.Collecting 22 more samples in 1.2 s.Collecting 21 more samples in 1.2 s.Collecting 20 more samples in 1.1 s.Collecting 19 more samples in 1.1 s.Collecting 18 more samples in 1.0 s.Collecting 17 more samples in 0.9 s.Collecting 16 more samples in 0.9 s.Collecting 15 more samples in 0.8 s.Collecting 14 more samples in 0.8 s.Collecting 13 more samples in 0.7 s.Collecting 12 more samples in 0.7 s.Collecting 11 more samples in 0.6 s.Collecting 10 more samples in 0.6 s.Collecting 9 more samples in 0.5 s.Collecting 8 more samples in 0.4 s.Collecting 7 more samples in 0.4 s.Collecting 6 more samples in 0.3 s.Collecting 5 more samples in 0.3 s.Collecting 4 more samples in 0.2 s.Collecting 3 more samples in 0.2 s.Collecting 2 more samples in 0.1 s.Collecting 1 more samples in 0.1 s.mean: 26.64096 ms, lower bound: 25.78612 ms, upper bound: 28.26316 ms, confidence: 0.950 std dev: 5.845271 ms, lower bound: 3.472862 ms, upper bound: 9.425507 ms, confidence: 0.950 found 10 outliers among 100 samples (10.0%) 3 (3.0%) high mild 7 (7.0%) high severe variance introduced by outliers: 95.701% variance is severely inflated by outliers commits: 200000 retries: 0 allocated bytes: 4808840 Running a subject "1/200000/stm-containers" Collecting 99 more samples in 66.9 s.Collecting 98 more samples in 66.2 s.Collecting 97 more samples in 65.5 s.Collecting 96 more samples in 64.8 s.Collecting 95 more samples in 64.2 s.Collecting 94 more samples in 63.5 s.Collecting 93 more samples in 62.8 s.Collecting 92 more samples in 62.1 s.Collecting 91 more samples in 61.5 s.Collecting 90 more samples in 60.8 s.Collecting 89 more samples in 60.1 s.Collecting 88 more samples in 59.4 s.Collecting 87 more samples in 58.8 s.Collecting 86 more samples in 58.1 s.Collecting 85 more samples in 57.4 s.Collecting 84 more samples in 56.7 s.Collecting 83 more samples in 56.1 s.Collecting 82 more samples in 55.4 s.Collecting 81 more samples in 54.7 s.Collecting 80 more samples in 54.0 s.Collecting 79 more samples in 53.4 s.Collecting 78 more samples in 52.7 s.Collecting 77 more samples in 52.0 s.Collecting 76 more samples in 51.3 s.Collecting 75 more samples in 50.6 s.Collecting 74 more samples in 50.0 s.Collecting 73 more samples in 49.3 s.Collecting 72 more samples in 48.6 s.Collecting 71 more samples in 47.9 s.Collecting 70 more samples in 47.3 s.Collecting 69 more samples in 46.6 s.Collecting 68 more samples in 45.9 s.Collecting 67 more samples in 45.2 s.Collecting 66 more samples in 44.6 s.Collecting 65 more samples in 43.9 s.Collecting 64 more samples in 43.2 s.Collecting 63 more samples in 42.5 s.Collecting 62 more samples in 41.9 s.Collecting 61 more samples in 41.2 s.Collecting 60 more samples in 40.5 s.Collecting 59 more samples in 39.8 s.Collecting 58 more samples in 39.2 s.Collecting 57 more samples in 38.5 s.Collecting 56 more samples in 37.8 s.Collecting 55 more samples in 37.1 s.Collecting 54 more samples in 36.5 s.Collecting 53 more samples in 35.8 s.Collecting 52 more samples in 35.1 s.Collecting 51 more samples in 34.4 s.Collecting 50 more samples in 33.8 s.Collecting 49 more samples in 33.1 s.Collecting 48 more samples in 32.4 s.Collecting 47 more samples in 31.7 s.Collecting 46 more samples in 31.1 s.Collecting 45 more samples in 30.4 s.Collecting 44 more samples in 29.7 s.Collecting 43 more samples in 29.0 s.Collecting 42 more samples in 28.4 s.Collecting 41 more samples in 27.7 s.Collecting 40 more samples in 27.0 s.Collecting 39 more samples in 26.3 s.Collecting 38 more samples in 25.7 s.Collecting 37 more samples in 25.0 s.Collecting 36 more samples in 24.3 s.Collecting 35 more samples in 23.6 s.Collecting 34 more samples in 23.0 s.Collecting 33 more samples in 22.3 s.Collecting 32 more samples in 21.6 s.Collecting 31 more samples in 20.9 s.Collecting 30 more samples in 20.3 s.Collecting 29 more samples in 19.6 s.Collecting 28 more samples in 18.9 s.Collecting 27 more samples in 18.2 s.Collecting 26 more samples in 17.6 s.Collecting 25 more samples in 16.9 s.Collecting 24 more samples in 16.2 s.Collecting 23 more samples in 15.5 s.Collecting 22 more samples in 14.9 s.Collecting 21 more samples in 14.2 s.Collecting 20 more samples in 13.5 s.Collecting 19 more samples in 12.8 s.Collecting 18 more samples in 12.2 s.Collecting 17 more samples in 11.5 s.Collecting 16 more samples in 10.8 s.Collecting 15 more samples in 10.1 s.Collecting 14 more samples in 9.5 s.Collecting 13 more samples in 8.8 s.Collecting 12 more samples in 8.1 s.Collecting 11 more samples in 7.4 s.Collecting 10 more samples in 6.8 s.Collecting 9 more samples in 6.1 s.Collecting 8 more samples in 5.4 s.Collecting 7 more samples in 4.7 s.Collecting 6 more samples in 4.1 s.Collecting 5 more samples in 3.4 s.Collecting 4 more samples in 2.7 s.Collecting 3 more samples in 2.0 s.Collecting 2 more samples in 1.4 s.Collecting 1 more samples in 0.7 s.mean: 417.5763 ms, lower bound: 411.6124 ms, upper bound: 429.1569 ms, confidence: 0.950 std dev: 41.41036 ms, lower bound: 22.47984 ms, upper bound: 67.80753 ms, confidence: 0.950 found 5 outliers among 100 samples (5.0%) 4 (4.0%) high severe variance introduced by outliers: 78.983% variance is severely inflated by outliers commits: 200000 retries: 0 allocated bytes: 116122664 Running a subject "1/200000/ttrie" Collecting 99 more samples in 26.2 s.Collecting 98 more samples in 26.0 s.Collecting 97 more samples in 25.7 s.Collecting 96 more samples in 25.4 s.Collecting 95 more samples in 25.2 s.Collecting 94 more samples in 24.9 s.Collecting 93 more samples in 24.7 s.Collecting 92 more samples in 24.4 s.Collecting 91 more samples in 24.1 s.Collecting 90 more samples in 23.9 s.Collecting 89 more samples in 23.6 s.Collecting 88 more samples in 23.3 s.Collecting 87 more samples in 23.1 s.Collecting 86 more samples in 22.8 s.Collecting 85 more samples in 22.5 s.Collecting 84 more samples in 22.3 s.Collecting 83 more samples in 22.0 s.Collecting 82 more samples in 21.7 s.Collecting 81 more samples in 21.5 s.Collecting 80 more samples in 21.2 s.Collecting 79 more samples in 20.9 s.Collecting 78 more samples in 20.7 s.Collecting 77 more samples in 20.4 s.Collecting 76 more samples in 20.1 s.Collecting 75 more samples in 19.9 s.Collecting 74 more samples in 19.6 s.Collecting 73 more samples in 19.4 s.Collecting 72 more samples in 19.1 s.Collecting 71 more samples in 18.8 s.Collecting 70 more samples in 18.6 s.Collecting 69 more samples in 18.3 s.Collecting 68 more samples in 18.0 s.Collecting 67 more samples in 17.8 s.Collecting 66 more samples in 17.5 s.Collecting 65 more samples in 17.2 s.Collecting 64 more samples in 17.0 s.Collecting 63 more samples in 16.7 s.Collecting 62 more samples in 16.4 s.Collecting 61 more samples in 16.2 s.Collecting 60 more samples in 15.9 s.Collecting 59 more samples in 15.6 s.Collecting 58 more samples in 15.4 s.Collecting 57 more samples in 15.1 s.Collecting 56 more samples in 14.8 s.Collecting 55 more samples in 14.6 s.Collecting 54 more samples in 14.3 s.Collecting 53 more samples in 14.1 s.Collecting 52 more samples in 13.8 s.Collecting 51 more samples in 13.5 s.Collecting 50 more samples in 13.3 s.Collecting 49 more samples in 13.0 s.Collecting 48 more samples in 12.7 s.Collecting 47 more samples in 12.5 s.Collecting 46 more samples in 12.2 s.Collecting 45 more samples in 11.9 s.Collecting 44 more samples in 11.7 s.Collecting 43 more samples in 11.4 s.Collecting 42 more samples in 11.1 s.Collecting 41 more samples in 10.9 s.Collecting 40 more samples in 10.6 s.Collecting 39 more samples in 10.3 s.Collecting 38 more samples in 10.1 s.Collecting 37 more samples in 9.8 s.Collecting 36 more samples in 9.5 s.Collecting 35 more samples in 9.3 s.Collecting 34 more samples in 9.0 s.Collecting 33 more samples in 8.7 s.Collecting 32 more samples in 8.5 s.Collecting 31 more samples in 8.2 s.Collecting 30 more samples in 8.0 s.Collecting 29 more samples in 7.7 s.Collecting 28 more samples in 7.4 s.Collecting 27 more samples in 7.2 s.Collecting 26 more samples in 6.9 s.Collecting 25 more samples in 6.6 s.Collecting 24 more samples in 6.4 s.Collecting 23 more samples in 6.1 s.Collecting 22 more samples in 5.8 s.Collecting 21 more samples in 5.6 s.Collecting 20 more samples in 5.3 s.Collecting 19 more samples in 5.0 s.Collecting 18 more samples in 4.8 s.Collecting 17 more samples in 4.5 s.Collecting 16 more samples in 4.2 s.Collecting 15 more samples in 4.0 s.Collecting 14 more samples in 3.7 s.Collecting 13 more samples in 3.4 s.Collecting 12 more samples in 3.2 s.Collecting 11 more samples in 2.9 s.Collecting 10 more samples in 2.7 s.Collecting 9 more samples in 2.4 s.Collecting 8 more samples in 2.1 s.Collecting 7 more samples in 1.9 s.Collecting 6 more samples in 1.6 s.Collecting 5 more samples in 1.3 s.Collecting 4 more samples in 1.1 s.Collecting 3 more samples in 0.8 s.Collecting 2 more samples in 0.5 s.Collecting 1 more samples in 0.3 s.mean: 283.9375 ms, lower bound: 278.4133 ms, upper bound: 293.2034 ms, confidence: 0.950 std dev: 35.55917 ms, lower bound: 23.50587 ms, upper bound: 54.80647 ms, confidence: 0.950 found 13 outliers among 100 samples (13.0%) 4 (4.0%) high mild 9 (9.0%) high severe variance introduced by outliers: 86.246% variance is severely inflated by outliers commits: 200000 retries: 0 allocated bytes: 68175032 Running a subject "2/100000/unordered-containers" Collecting 100 more samples in 9.1 s.Collecting 99 more samples in 9.1 s.Collecting 98 more samples in 9.0 s.Collecting 97 more samples in 8.9 s.Collecting 96 more samples in 8.8 s.Collecting 95 more samples in 8.7 s.Collecting 94 more samples in 8.6 s.Collecting 93 more samples in 8.5 s.Collecting 92 more samples in 8.4 s.Collecting 91 more samples in 8.3 s.Collecting 90 more samples in 8.2 s.Collecting 89 more samples in 8.1 s.Collecting 88 more samples in 8.0 s.Collecting 87 more samples in 8.0 s.Collecting 86 more samples in 7.9 s.Collecting 85 more samples in 7.8 s.Collecting 84 more samples in 7.7 s.Collecting 83 more samples in 7.6 s.Collecting 82 more samples in 7.5 s.Collecting 81 more samples in 7.4 s.Collecting 80 more samples in 7.3 s.Collecting 79 more samples in 7.2 s.Collecting 78 more samples in 7.1 s.Collecting 77 more samples in 7.0 s.Collecting 76 more samples in 6.9 s.Collecting 75 more samples in 6.9 s.Collecting 74 more samples in 6.8 s.Collecting 73 more samples in 6.7 s.Collecting 72 more samples in 6.6 s.Collecting 71 more samples in 6.5 s.Collecting 70 more samples in 6.4 s.Collecting 69 more samples in 6.3 s.Collecting 68 more samples in 6.2 s.Collecting 67 more samples in 6.1 s.Collecting 66 more samples in 6.0 s.Collecting 65 more samples in 5.9 s.Collecting 64 more samples in 5.9 s.Collecting 63 more samples in 5.8 s.Collecting 62 more samples in 5.7 s.Collecting 61 more samples in 5.6 s.Collecting 60 more samples in 5.5 s.Collecting 59 more samples in 5.4 s.Collecting 58 more samples in 5.3 s.Collecting 57 more samples in 5.2 s.Collecting 56 more samples in 5.1 s.Collecting 55 more samples in 5.0 s.Collecting 54 more samples in 4.9 s.Collecting 53 more samples in 4.8 s.Collecting 52 more samples in 4.8 s.Collecting 51 more samples in 4.7 s.Collecting 50 more samples in 4.6 s.Collecting 49 more samples in 4.5 s.Collecting 48 more samples in 4.4 s.Collecting 47 more samples in 4.3 s.Collecting 46 more samples in 4.2 s.Collecting 45 more samples in 4.1 s.Collecting 44 more samples in 4.0 s.Collecting 43 more samples in 3.9 s.Collecting 42 more samples in 3.8 s.Collecting 41 more samples in 3.7 s.Collecting 40 more samples in 3.7 s.Collecting 39 more samples in 3.6 s.Collecting 38 more samples in 3.5 s.Collecting 37 more samples in 3.4 s.Collecting 36 more samples in 3.3 s.Collecting 35 more samples in 3.2 s.Collecting 34 more samples in 3.1 s.Collecting 33 more samples in 3.0 s.Collecting 32 more samples in 2.9 s.Collecting 31 more samples in 2.8 s.Collecting 30 more samples in 2.7 s.Collecting 29 more samples in 2.7 s.Collecting 28 more samples in 2.6 s.Collecting 27 more samples in 2.5 s.Collecting 26 more samples in 2.4 s.Collecting 25 more samples in 2.3 s.Collecting 24 more samples in 2.2 s.Collecting 23 more samples in 2.1 s.Collecting 22 more samples in 2.0 s.Collecting 21 more samples in 1.9 s.Collecting 20 more samples in 1.8 s.Collecting 19 more samples in 1.7 s.Collecting 18 more samples in 1.6 s.Collecting 17 more samples in 1.6 s.Collecting 16 more samples in 1.5 s.Collecting 15 more samples in 1.4 s.Collecting 14 more samples in 1.3 s.Collecting 13 more samples in 1.2 s.Collecting 12 more samples in 1.1 s.Collecting 11 more samples in 1.0 s.Collecting 10 more samples in 0.9 s.Collecting 9 more samples in 0.8 s.Collecting 8 more samples in 0.7 s.Collecting 7 more samples in 0.6 s.Collecting 6 more samples in 0.5 s.Collecting 5 more samples in 0.5 s.Collecting 4 more samples in 0.4 s.Collecting 3 more samples in 0.3 s.Collecting 2 more samples in 0.2 s.Collecting 1 more samples in 0.1 s.mean: 15.80314 ms, lower bound: 14.39750 ms, upper bound: 19.19842 ms, confidence: 0.950 std dev: 10.48376 ms, lower bound: 5.210103 ms, upper bound: 20.33774 ms, confidence: 0.950 found 16 outliers among 100 samples (16.0%) 15 (15.0%) high severe variance introduced by outliers: 98.965% variance is severely inflated by outliers commits: 200000 retries: 0 allocated bytes: 4811616 Running a subject "2/100000/stm-containers" Collecting 99 more samples in 20.2 s.Collecting 98 more samples in 20.0 s.Collecting 97 more samples in 19.8 s.Collecting 96 more samples in 19.6 s.Collecting 95 more samples in 19.4 s.Collecting 94 more samples in 19.2 s.Collecting 93 more samples in 19.0 s.Collecting 92 more samples in 18.8 s.Collecting 91 more samples in 18.6 s.Collecting 90 more samples in 18.4 s.Collecting 89 more samples in 18.2 s.Collecting 88 more samples in 18.0 s.Collecting 87 more samples in 17.8 s.Collecting 86 more samples in 17.6 s.Collecting 85 more samples in 17.4 s.Collecting 84 more samples in 17.2 s.Collecting 83 more samples in 17.0 s.Collecting 82 more samples in 16.8 s.Collecting 81 more samples in 16.6 s.Collecting 80 more samples in 16.4 s.Collecting 79 more samples in 16.2 s.Collecting 78 more samples in 15.9 s.Collecting 77 more samples in 15.7 s.Collecting 76 more samples in 15.5 s.Collecting 75 more samples in 15.3 s.Collecting 74 more samples in 15.1 s.Collecting 73 more samples in 14.9 s.Collecting 72 more samples in 14.7 s.Collecting 71 more samples in 14.5 s.Collecting 70 more samples in 14.3 s.Collecting 69 more samples in 14.1 s.Collecting 68 more samples in 13.9 s.Collecting 67 more samples in 13.7 s.Collecting 66 more samples in 13.5 s.Collecting 65 more samples in 13.3 s.Collecting 64 more samples in 13.1 s.Collecting 63 more samples in 12.9 s.Collecting 62 more samples in 12.7 s.Collecting 61 more samples in 12.5 s.Collecting 60 more samples in 12.3 s.Collecting 59 more samples in 12.1 s.Collecting 58 more samples in 11.9 s.Collecting 57 more samples in 11.7 s.Collecting 56 more samples in 11.5 s.Collecting 55 more samples in 11.2 s.Collecting 54 more samples in 11.0 s.Collecting 53 more samples in 10.8 s.Collecting 52 more samples in 10.6 s.Collecting 51 more samples in 10.4 s.Collecting 50 more samples in 10.2 s.Collecting 49 more samples in 10.0 s.Collecting 48 more samples in 9.8 s.Collecting 47 more samples in 9.6 s.Collecting 46 more samples in 9.4 s.Collecting 45 more samples in 9.2 s.Collecting 44 more samples in 9.0 s.Collecting 43 more samples in 8.8 s.Collecting 42 more samples in 8.6 s.Collecting 41 more samples in 8.4 s.Collecting 40 more samples in 8.2 s.Collecting 39 more samples in 8.0 s.Collecting 38 more samples in 7.8 s.Collecting 37 more samples in 7.6 s.Collecting 36 more samples in 7.4 s.Collecting 35 more samples in 7.2 s.Collecting 34 more samples in 7.0 s.Collecting 33 more samples in 6.7 s.Collecting 32 more samples in 6.5 s.Collecting 31 more samples in 6.3 s.Collecting 30 more samples in 6.1 s.Collecting 29 more samples in 5.9 s.Collecting 28 more samples in 5.7 s.Collecting 27 more samples in 5.5 s.Collecting 26 more samples in 5.3 s.Collecting 25 more samples in 5.1 s.Collecting 24 more samples in 4.9 s.Collecting 23 more samples in 4.7 s.Collecting 22 more samples in 4.5 s.Collecting 21 more samples in 4.3 s.Collecting 20 more samples in 4.1 s.Collecting 19 more samples in 3.9 s.Collecting 18 more samples in 3.7 s.Collecting 17 more samples in 3.5 s.Collecting 16 more samples in 3.3 s.Collecting 15 more samples in 3.1 s.Collecting 14 more samples in 2.9 s.Collecting 13 more samples in 2.7 s.Collecting 12 more samples in 2.5 s.Collecting 11 more samples in 2.2 s.Collecting 10 more samples in 2.0 s.Collecting 9 more samples in 1.8 s.Collecting 8 more samples in 1.6 s.Collecting 7 more samples in 1.4 s.Collecting 6 more samples in 1.2 s.Collecting 5 more samples in 1.0 s.Collecting 4 more samples in 0.8 s.Collecting 3 more samples in 0.6 s.Collecting 2 more samples in 0.4 s.Collecting 1 more samples in 0.2 s.mean: 201.3362 ms, lower bound: 198.3393 ms, upper bound: 206.9010 ms, confidence: 0.950 std dev: 20.29139 ms, lower bound: 13.12694 ms, upper bound: 37.51682 ms, confidence: 0.950 found 5 outliers among 100 samples (5.0%) 4 (4.0%) high mild 1 (1.0%) high severe variance introduced by outliers: 79.991% variance is severely inflated by outliers commits: 200000 retries: 2 allocated bytes: 116176760 Running a subject "2/100000/ttrie" Collecting 100 more samples in 14.4 s.Collecting 99 more samples in 14.2 s.Collecting 98 more samples in 14.1 s.Collecting 97 more samples in 14.0 s.Collecting 96 more samples in 13.8 s.Collecting 95 more samples in 13.7 s.Collecting 94 more samples in 13.5 s.Collecting 93 more samples in 13.4 s.Collecting 92 more samples in 13.2 s.Collecting 91 more samples in 13.1 s.Collecting 90 more samples in 12.9 s.Collecting 89 more samples in 12.8 s.Collecting 88 more samples in 12.7 s.Collecting 87 more samples in 12.5 s.Collecting 86 more samples in 12.4 s.Collecting 85 more samples in 12.2 s.Collecting 84 more samples in 12.1 s.Collecting 83 more samples in 11.9 s.Collecting 82 more samples in 11.8 s.Collecting 81 more samples in 11.7 s.Collecting 80 more samples in 11.5 s.Collecting 79 more samples in 11.4 s.Collecting 78 more samples in 11.2 s.Collecting 77 more samples in 11.1 s.Collecting 76 more samples in 10.9 s.Collecting 75 more samples in 10.8 s.Collecting 74 more samples in 10.6 s.Collecting 73 more samples in 10.5 s.Collecting 72 more samples in 10.4 s.Collecting 71 more samples in 10.2 s.Collecting 70 more samples in 10.1 s.Collecting 69 more samples in 9.9 s.Collecting 68 more samples in 9.8 s.Collecting 67 more samples in 9.6 s.Collecting 66 more samples in 9.5 s.Collecting 65 more samples in 9.3 s.Collecting 64 more samples in 9.2 s.Collecting 63 more samples in 9.1 s.Collecting 62 more samples in 8.9 s.Collecting 61 more samples in 8.8 s.Collecting 60 more samples in 8.6 s.Collecting 59 more samples in 8.5 s.Collecting 58 more samples in 8.3 s.Collecting 57 more samples in 8.2 s.Collecting 56 more samples in 8.1 s.Collecting 55 more samples in 7.9 s.Collecting 54 more samples in 7.8 s.Collecting 53 more samples in 7.6 s.Collecting 52 more samples in 7.5 s.Collecting 51 more samples in 7.3 s.Collecting 50 more samples in 7.2 s.Collecting 49 more samples in 7.0 s.Collecting 48 more samples in 6.9 s.Collecting 47 more samples in 6.8 s.Collecting 46 more samples in 6.6 s.Collecting 45 more samples in 6.5 s.Collecting 44 more samples in 6.3 s.Collecting 43 more samples in 6.2 s.Collecting 42 more samples in 6.0 s.Collecting 41 more samples in 5.9 s.Collecting 40 more samples in 5.8 s.Collecting 39 more samples in 5.6 s.Collecting 38 more samples in 5.5 s.Collecting 37 more samples in 5.3 s.Collecting 36 more samples in 5.2 s.Collecting 35 more samples in 5.0 s.Collecting 34 more samples in 4.9 s.Collecting 33 more samples in 4.7 s.Collecting 32 more samples in 4.6 s.Collecting 31 more samples in 4.5 s.Collecting 30 more samples in 4.3 s.Collecting 29 more samples in 4.2 s.Collecting 28 more samples in 4.0 s.Collecting 27 more samples in 3.9 s.Collecting 26 more samples in 3.7 s.Collecting 25 more samples in 3.6 s.Collecting 24 more samples in 3.5 s.Collecting 23 more samples in 3.3 s.Collecting 22 more samples in 3.2 s.Collecting 21 more samples in 3.0 s.Collecting 20 more samples in 2.9 s.Collecting 19 more samples in 2.7 s.Collecting 18 more samples in 2.6 s.Collecting 17 more samples in 2.4 s.Collecting 16 more samples in 2.3 s.Collecting 15 more samples in 2.2 s.Collecting 14 more samples in 2.0 s.Collecting 13 more samples in 1.9 s.Collecting 12 more samples in 1.7 s.Collecting 11 more samples in 1.6 s.Collecting 10 more samples in 1.4 s.Collecting 9 more samples in 1.3 s.Collecting 8 more samples in 1.2 s.Collecting 7 more samples in 1.0 s.Collecting 6 more samples in 0.9 s.Collecting 5 more samples in 0.7 s.Collecting 4 more samples in 0.6 s.Collecting 3 more samples in 0.4 s.Collecting 2 more samples in 0.3 s.Collecting 1 more samples in 0.1 s.mean: 150.9846 ms, lower bound: 148.8665 ms, upper bound: 154.5728 ms, confidence: 0.950 std dev: 13.68852 ms, lower bound: 9.293241 ms, upper bound: 23.59169 ms, confidence: 0.950 found 6 outliers among 100 samples (6.0%) 3 (3.0%) high mild 3 (3.0%) high severe variance introduced by outliers: 75.873% variance is severely inflated by outliers commits: 200000 retries: 0 allocated bytes: 68180112 Running a subject "4/50000/unordered-containers" Collecting 100 more samples in 9.6 s.Collecting 99 more samples in 9.5 s.Collecting 98 more samples in 9.5 s.Collecting 97 more samples in 9.4 s.Collecting 96 more samples in 9.3 s.Collecting 95 more samples in 9.2 s.Collecting 94 more samples in 9.1 s.Collecting 93 more samples in 9.0 s.Collecting 92 more samples in 8.9 s.Collecting 91 more samples in 8.8 s.Collecting 90 more samples in 8.7 s.Collecting 89 more samples in 8.6 s.Collecting 88 more samples in 8.5 s.Collecting 87 more samples in 8.4 s.Collecting 86 more samples in 8.3 s.Collecting 85 more samples in 8.2 s.Collecting 84 more samples in 8.1 s.Collecting 83 more samples in 8.0 s.Collecting 82 more samples in 7.9 s.Collecting 81 more samples in 7.8 s.Collecting 80 more samples in 7.7 s.Collecting 79 more samples in 7.6 s.Collecting 78 more samples in 7.5 s.Collecting 77 more samples in 7.4 s.Collecting 76 more samples in 7.3 s.Collecting 75 more samples in 7.2 s.Collecting 74 more samples in 7.1 s.Collecting 73 more samples in 7.0 s.Collecting 72 more samples in 6.9 s.Collecting 71 more samples in 6.8 s.Collecting 70 more samples in 6.8 s.Collecting 69 more samples in 6.7 s.Collecting 68 more samples in 6.6 s.Collecting 67 more samples in 6.5 s.Collecting 66 more samples in 6.4 s.Collecting 65 more samples in 6.3 s.Collecting 64 more samples in 6.2 s.Collecting 63 more samples in 6.1 s.Collecting 62 more samples in 6.0 s.Collecting 61 more samples in 5.9 s.Collecting 60 more samples in 5.8 s.Collecting 59 more samples in 5.7 s.Collecting 58 more samples in 5.6 s.Collecting 57 more samples in 5.5 s.Collecting 56 more samples in 5.4 s.Collecting 55 more samples in 5.3 s.Collecting 54 more samples in 5.2 s.Collecting 53 more samples in 5.1 s.Collecting 52 more samples in 5.0 s.Collecting 51 more samples in 4.9 s.Collecting 50 more samples in 4.8 s.Collecting 49 more samples in 4.7 s.Collecting 48 more samples in 4.6 s.Collecting 47 more samples in 4.5 s.Collecting 46 more samples in 4.4 s.Collecting 45 more samples in 4.3 s.Collecting 44 more samples in 4.2 s.Collecting 43 more samples in 4.1 s.Collecting 42 more samples in 4.1 s.Collecting 41 more samples in 4.0 s.Collecting 40 more samples in 3.9 s.Collecting 39 more samples in 3.8 s.Collecting 38 more samples in 3.7 s.Collecting 37 more samples in 3.6 s.Collecting 36 more samples in 3.5 s.Collecting 35 more samples in 3.4 s.Collecting 34 more samples in 3.3 s.Collecting 33 more samples in 3.2 s.Collecting 32 more samples in 3.1 s.Collecting 31 more samples in 3.0 s.Collecting 30 more samples in 2.9 s.Collecting 29 more samples in 2.8 s.Collecting 28 more samples in 2.7 s.Collecting 27 more samples in 2.6 s.Collecting 26 more samples in 2.5 s.Collecting 25 more samples in 2.4 s.Collecting 24 more samples in 2.3 s.Collecting 23 more samples in 2.2 s.Collecting 22 more samples in 2.1 s.Collecting 21 more samples in 2.0 s.Collecting 20 more samples in 1.9 s.Collecting 19 more samples in 1.8 s.Collecting 18 more samples in 1.7 s.Collecting 17 more samples in 1.6 s.Collecting 16 more samples in 1.5 s.Collecting 15 more samples in 1.4 s.Collecting 14 more samples in 1.4 s.Collecting 13 more samples in 1.3 s.Collecting 12 more samples in 1.2 s.Collecting 11 more samples in 1.1 s.Collecting 10 more samples in 1.0 s.Collecting 9 more samples in 0.9 s.Collecting 8 more samples in 0.8 s.Collecting 7 more samples in 0.7 s.Collecting 6 more samples in 0.6 s.Collecting 5 more samples in 0.5 s.Collecting 4 more samples in 0.4 s.Collecting 3 more samples in 0.3 s.Collecting 2 more samples in 0.2 s.Collecting 1 more samples in 0.1 s.mean: 12.55274 ms, lower bound: 11.83519 ms, upper bound: 13.84551 ms, confidence: 0.950 std dev: 4.788209 ms, lower bound: 3.102665 ms, upper bound: 7.216023 ms, confidence: 0.950 found 10 outliers among 100 samples (10.0%) 6 (6.0%) high mild 4 (4.0%) high severe variance introduced by outliers: 98.895% variance is severely inflated by outliers commits: 200000 retries: 0 allocated bytes: 4818464 Running a subject "4/50000/stm-containers" Collecting 100 more samples in 10.9 s.Collecting 99 more samples in 10.8 s.Collecting 98 more samples in 10.7 s.Collecting 97 more samples in 10.6 s.Collecting 96 more samples in 10.5 s.Collecting 95 more samples in 10.3 s.Collecting 94 more samples in 10.2 s.Collecting 93 more samples in 10.1 s.Collecting 92 more samples in 10.0 s.Collecting 91 more samples in 9.9 s.Collecting 90 more samples in 9.8 s.Collecting 89 more samples in 9.7 s.Collecting 88 more samples in 9.6 s.Collecting 87 more samples in 9.5 s.Collecting 86 more samples in 9.4 s.Collecting 85 more samples in 9.3 s.Collecting 84 more samples in 9.1 s.Collecting 83 more samples in 9.0 s.Collecting 82 more samples in 8.9 s.Collecting 81 more samples in 8.8 s.Collecting 80 more samples in 8.7 s.Collecting 79 more samples in 8.6 s.Collecting 78 more samples in 8.5 s.Collecting 77 more samples in 8.4 s.Collecting 76 more samples in 8.3 s.Collecting 75 more samples in 8.2 s.Collecting 74 more samples in 8.1 s.Collecting 73 more samples in 7.9 s.Collecting 72 more samples in 7.8 s.Collecting 71 more samples in 7.7 s.Collecting 70 more samples in 7.6 s.Collecting 69 more samples in 7.5 s.Collecting 68 more samples in 7.4 s.Collecting 67 more samples in 7.3 s.Collecting 66 more samples in 7.2 s.Collecting 65 more samples in 7.1 s.Collecting 64 more samples in 7.0 s.Collecting 63 more samples in 6.9 s.Collecting 62 more samples in 6.8 s.Collecting 61 more samples in 6.6 s.Collecting 60 more samples in 6.5 s.Collecting 59 more samples in 6.4 s.Collecting 58 more samples in 6.3 s.Collecting 57 more samples in 6.2 s.Collecting 56 more samples in 6.1 s.Collecting 55 more samples in 6.0 s.Collecting 54 more samples in 5.9 s.Collecting 53 more samples in 5.8 s.Collecting 52 more samples in 5.7 s.Collecting 51 more samples in 5.6 s.Collecting 50 more samples in 5.4 s.Collecting 49 more samples in 5.3 s.Collecting 48 more samples in 5.2 s.Collecting 47 more samples in 5.1 s.Collecting 46 more samples in 5.0 s.Collecting 45 more samples in 4.9 s.Collecting 44 more samples in 4.8 s.Collecting 43 more samples in 4.7 s.Collecting 42 more samples in 4.6 s.Collecting 41 more samples in 4.5 s.Collecting 40 more samples in 4.4 s.Collecting 39 more samples in 4.2 s.Collecting 38 more samples in 4.1 s.Collecting 37 more samples in 4.0 s.Collecting 36 more samples in 3.9 s.Collecting 35 more samples in 3.8 s.Collecting 34 more samples in 3.7 s.Collecting 33 more samples in 3.6 s.Collecting 32 more samples in 3.5 s.Collecting 31 more samples in 3.4 s.Collecting 30 more samples in 3.3 s.Collecting 29 more samples in 3.2 s.Collecting 28 more samples in 3.0 s.Collecting 27 more samples in 2.9 s.Collecting 26 more samples in 2.8 s.Collecting 25 more samples in 2.7 s.Collecting 24 more samples in 2.6 s.Collecting 23 more samples in 2.5 s.Collecting 22 more samples in 2.4 s.Collecting 21 more samples in 2.3 s.Collecting 20 more samples in 2.2 s.Collecting 19 more samples in 2.1 s.Collecting 18 more samples in 2.0 s.Collecting 17 more samples in 1.9 s.Collecting 16 more samples in 1.7 s.Collecting 15 more samples in 1.6 s.Collecting 14 more samples in 1.5 s.Collecting 13 more samples in 1.4 s.Collecting 12 more samples in 1.3 s.Collecting 11 more samples in 1.2 s.Collecting 10 more samples in 1.1 s.Collecting 9 more samples in 1.0 s.Collecting 8 more samples in 0.9 s.Collecting 7 more samples in 0.8 s.Collecting 6 more samples in 0.7 s.Collecting 5 more samples in 0.5 s.Collecting 4 more samples in 0.4 s.Collecting 3 more samples in 0.3 s.Collecting 2 more samples in 0.2 s.Collecting 1 more samples in 0.1 s.mean: 109.1720 ms, lower bound: 108.3936 ms, upper bound: 110.2666 ms, confidence: 0.950 std dev: 4.700736 ms, lower bound: 3.559950 ms, upper bound: 6.742719 ms, confidence: 0.950 found 7 outliers among 100 samples (7.0%) 3 (3.0%) high mild 3 (3.0%) high severe variance introduced by outliers: 40.513% variance is moderately inflated by outliers commits: 200000 retries: 47 allocated bytes: 116274464 Running a subject "4/50000/ttrie" Collecting 100 more samples in 7.7 s.Collecting 99 more samples in 7.7 s.Collecting 98 more samples in 7.6 s.Collecting 97 more samples in 7.5 s.Collecting 96 more samples in 7.4 s.Collecting 95 more samples in 7.3 s.Collecting 94 more samples in 7.3 s.Collecting 93 more samples in 7.2 s.Collecting 92 more samples in 7.1 s.Collecting 91 more samples in 7.0 s.Collecting 90 more samples in 7.0 s.Collecting 89 more samples in 6.9 s.Collecting 88 more samples in 6.8 s.Collecting 87 more samples in 6.7 s.Collecting 86 more samples in 6.6 s.Collecting 85 more samples in 6.6 s.Collecting 84 more samples in 6.5 s.Collecting 83 more samples in 6.4 s.Collecting 82 more samples in 6.3 s.Collecting 81 more samples in 6.3 s.Collecting 80 more samples in 6.2 s.Collecting 79 more samples in 6.1 s.Collecting 78 more samples in 6.0 s.Collecting 77 more samples in 6.0 s.Collecting 76 more samples in 5.9 s.Collecting 75 more samples in 5.8 s.Collecting 74 more samples in 5.7 s.Collecting 73 more samples in 5.6 s.Collecting 72 more samples in 5.6 s.Collecting 71 more samples in 5.5 s.Collecting 70 more samples in 5.4 s.Collecting 69 more samples in 5.3 s.Collecting 68 more samples in 5.3 s.Collecting 67 more samples in 5.2 s.Collecting 66 more samples in 5.1 s.Collecting 65 more samples in 5.0 s.Collecting 64 more samples in 4.9 s.Collecting 63 more samples in 4.9 s.Collecting 62 more samples in 4.8 s.Collecting 61 more samples in 4.7 s.Collecting 60 more samples in 4.6 s.Collecting 59 more samples in 4.6 s.Collecting 58 more samples in 4.5 s.Collecting 57 more samples in 4.4 s.Collecting 56 more samples in 4.3 s.Collecting 55 more samples in 4.3 s.Collecting 54 more samples in 4.2 s.Collecting 53 more samples in 4.1 s.Collecting 52 more samples in 4.0 s.Collecting 51 more samples in 3.9 s.Collecting 50 more samples in 3.9 s.Collecting 49 more samples in 3.8 s.Collecting 48 more samples in 3.7 s.Collecting 47 more samples in 3.6 s.Collecting 46 more samples in 3.6 s.Collecting 45 more samples in 3.5 s.Collecting 44 more samples in 3.4 s.Collecting 43 more samples in 3.3 s.Collecting 42 more samples in 3.2 s.Collecting 41 more samples in 3.2 s.Collecting 40 more samples in 3.1 s.Collecting 39 more samples in 3.0 s.Collecting 38 more samples in 2.9 s.Collecting 37 more samples in 2.9 s.Collecting 36 more samples in 2.8 s.Collecting 35 more samples in 2.7 s.Collecting 34 more samples in 2.6 s.Collecting 33 more samples in 2.6 s.Collecting 32 more samples in 2.5 s.Collecting 31 more samples in 2.4 s.Collecting 30 more samples in 2.3 s.Collecting 29 more samples in 2.2 s.Collecting 28 more samples in 2.2 s.Collecting 27 more samples in 2.1 s.Collecting 26 more samples in 2.0 s.Collecting 25 more samples in 1.9 s.Collecting 24 more samples in 1.9 s.Collecting 23 more samples in 1.8 s.Collecting 22 more samples in 1.7 s.Collecting 21 more samples in 1.6 s.Collecting 20 more samples in 1.5 s.Collecting 19 more samples in 1.5 s.Collecting 18 more samples in 1.4 s.Collecting 17 more samples in 1.3 s.Collecting 16 more samples in 1.2 s.Collecting 15 more samples in 1.2 s.Collecting 14 more samples in 1.1 s.Collecting 13 more samples in 1.0 s.Collecting 12 more samples in 0.9 s.Collecting 11 more samples in 0.9 s.Collecting 10 more samples in 0.8 s.Collecting 9 more samples in 0.7 s.Collecting 8 more samples in 0.6 s.Collecting 7 more samples in 0.5 s.Collecting 6 more samples in 0.5 s.Collecting 5 more samples in 0.4 s.Collecting 4 more samples in 0.3 s.Collecting 3 more samples in 0.2 s.Collecting 2 more samples in 0.2 s.Collecting 1 more samples in 0.1 s.mean: 78.30056 ms, lower bound: 75.84567 ms, upper bound: 82.86492 ms, confidence: 0.950 std dev: 16.70484 ms, lower bound: 9.923826 ms, upper bound: 27.02253 ms, confidence: 0.950 found 10 outliers among 100 samples (10.0%) 3 (3.0%) low mild 6 (6.0%) high severe variance introduced by outliers: 94.690% variance is severely inflated by outliers commits: 200000 retries: 0 allocated bytes: 68193296 Running a subject "6/33333/unordered-containers" Collecting 100 more samples in 10.5 s.Collecting 99 more samples in 10.4 s.Collecting 98 more samples in 10.3 s.Collecting 97 more samples in 10.2 s.Collecting 96 more samples in 10.1 s.Collecting 95 more samples in 10.0 s.Collecting 94 more samples in 9.9 s.Collecting 93 more samples in 9.8 s.Collecting 92 more samples in 9.7 s.Collecting 91 more samples in 9.6 s.Collecting 90 more samples in 9.5 s.Collecting 89 more samples in 9.4 s.Collecting 88 more samples in 9.3 s.Collecting 87 more samples in 9.2 s.Collecting 86 more samples in 9.0 s.Collecting 85 more samples in 8.9 s.Collecting 84 more samples in 8.8 s.Collecting 83 more samples in 8.7 s.Collecting 82 more samples in 8.6 s.Collecting 81 more samples in 8.5 s.Collecting 80 more samples in 8.4 s.Collecting 79 more samples in 8.3 s.Collecting 78 more samples in 8.2 s.Collecting 77 more samples in 8.1 s.Collecting 76 more samples in 8.0 s.Collecting 75 more samples in 7.9 s.Collecting 74 more samples in 7.8 s.Collecting 73 more samples in 7.7 s.Collecting 72 more samples in 7.6 s.Collecting 71 more samples in 7.5 s.Collecting 70 more samples in 7.4 s.Collecting 69 more samples in 7.3 s.Collecting 68 more samples in 7.2 s.Collecting 67 more samples in 7.0 s.Collecting 66 more samples in 6.9 s.Collecting 65 more samples in 6.8 s.Collecting 64 more samples in 6.7 s.Collecting 63 more samples in 6.6 s.Collecting 62 more samples in 6.5 s.Collecting 61 more samples in 6.4 s.Collecting 60 more samples in 6.3 s.Collecting 59 more samples in 6.2 s.Collecting 58 more samples in 6.1 s.Collecting 57 more samples in 6.0 s.Collecting 56 more samples in 5.9 s.Collecting 55 more samples in 5.8 s.Collecting 54 more samples in 5.7 s.Collecting 53 more samples in 5.6 s.Collecting 52 more samples in 5.5 s.Collecting 51 more samples in 5.4 s.Collecting 50 more samples in 5.3 s.Collecting 49 more samples in 5.2 s.Collecting 48 more samples in 5.0 s.Collecting 47 more samples in 4.9 s.Collecting 46 more samples in 4.8 s.Collecting 45 more samples in 4.7 s.Collecting 44 more samples in 4.6 s.Collecting 43 more samples in 4.5 s.Collecting 42 more samples in 4.4 s.Collecting 41 more samples in 4.3 s.Collecting 40 more samples in 4.2 s.Collecting 39 more samples in 4.1 s.Collecting 38 more samples in 4.0 s.Collecting 37 more samples in 3.9 s.Collecting 36 more samples in 3.8 s.Collecting 35 more samples in 3.7 s.Collecting 34 more samples in 3.6 s.Collecting 33 more samples in 3.5 s.Collecting 32 more samples in 3.4 s.Collecting 31 more samples in 3.3 s.Collecting 30 more samples in 3.2 s.Collecting 29 more samples in 3.1 s.Collecting 28 more samples in 2.9 s.Collecting 27 more samples in 2.8 s.Collecting 26 more samples in 2.7 s.Collecting 25 more samples in 2.6 s.Collecting 24 more samples in 2.5 s.Collecting 23 more samples in 2.4 s.Collecting 22 more samples in 2.3 s.Collecting 21 more samples in 2.2 s.Collecting 20 more samples in 2.1 s.Collecting 19 more samples in 2.0 s.Collecting 18 more samples in 1.9 s.Collecting 17 more samples in 1.8 s.Collecting 16 more samples in 1.7 s.Collecting 15 more samples in 1.6 s.Collecting 14 more samples in 1.5 s.Collecting 13 more samples in 1.4 s.Collecting 12 more samples in 1.3 s.Collecting 11 more samples in 1.2 s.Collecting 10 more samples in 1.1 s.Collecting 9 more samples in 0.9 s.Collecting 8 more samples in 0.8 s.Collecting 7 more samples in 0.7 s.Collecting 6 more samples in 0.6 s.Collecting 5 more samples in 0.5 s.Collecting 4 more samples in 0.4 s.Collecting 3 more samples in 0.3 s.Collecting 2 more samples in 0.2 s.Collecting 1 more samples in 0.1 s.mean: 9.533604 ms, lower bound: 9.150618 ms, upper bound: 10.13826 ms, confidence: 0.950 std dev: 2.415830 ms, lower bound: 1.684251 ms, upper bound: 3.594984 ms, confidence: 0.950 found 9 outliers among 100 samples (9.0%) 5 (5.0%) high mild 4 (4.0%) high severe variance introduced by outliers: 96.771% variance is severely inflated by outliers commits: 200000 retries: 0 allocated bytes: 4830392 Running a subject "6/33333/stm-containers" Collecting 100 more samples in 7.2 s.Collecting 99 more samples in 7.2 s.Collecting 98 more samples in 7.1 s.Collecting 97 more samples in 7.0 s.Collecting 96 more samples in 6.9 s.Collecting 95 more samples in 6.9 s.Collecting 94 more samples in 6.8 s.Collecting 93 more samples in 6.7 s.Collecting 92 more samples in 6.7 s.Collecting 91 more samples in 6.6 s.Collecting 90 more samples in 6.5 s.Collecting 89 more samples in 6.4 s.Collecting 88 more samples in 6.4 s.Collecting 87 more samples in 6.3 s.Collecting 86 more samples in 6.2 s.Collecting 85 more samples in 6.2 s.Collecting 84 more samples in 6.1 s.Collecting 83 more samples in 6.0 s.Collecting 82 more samples in 5.9 s.Collecting 81 more samples in 5.9 s.Collecting 80 more samples in 5.8 s.Collecting 79 more samples in 5.7 s.Collecting 78 more samples in 5.6 s.Collecting 77 more samples in 5.6 s.Collecting 76 more samples in 5.5 s.Collecting 75 more samples in 5.4 s.Collecting 74 more samples in 5.4 s.Collecting 73 more samples in 5.3 s.Collecting 72 more samples in 5.2 s.Collecting 71 more samples in 5.1 s.Collecting 70 more samples in 5.1 s.Collecting 69 more samples in 5.0 s.Collecting 68 more samples in 4.9 s.Collecting 67 more samples in 4.8 s.Collecting 66 more samples in 4.8 s.Collecting 65 more samples in 4.7 s.Collecting 64 more samples in 4.6 s.Collecting 63 more samples in 4.6 s.Collecting 62 more samples in 4.5 s.Collecting 61 more samples in 4.4 s.Collecting 60 more samples in 4.3 s.Collecting 59 more samples in 4.3 s.Collecting 58 more samples in 4.2 s.Collecting 57 more samples in 4.1 s.Collecting 56 more samples in 4.1 s.Collecting 55 more samples in 4.0 s.Collecting 54 more samples in 3.9 s.Collecting 53 more samples in 3.8 s.Collecting 52 more samples in 3.8 s.Collecting 51 more samples in 3.7 s.Collecting 50 more samples in 3.6 s.Collecting 49 more samples in 3.5 s.Collecting 48 more samples in 3.5 s.Collecting 47 more samples in 3.4 s.Collecting 46 more samples in 3.3 s.Collecting 45 more samples in 3.3 s.Collecting 44 more samples in 3.2 s.Collecting 43 more samples in 3.1 s.Collecting 42 more samples in 3.0 s.Collecting 41 more samples in 3.0 s.Collecting 40 more samples in 2.9 s.Collecting 39 more samples in 2.8 s.Collecting 38 more samples in 2.7 s.Collecting 37 more samples in 2.7 s.Collecting 36 more samples in 2.6 s.Collecting 35 more samples in 2.5 s.Collecting 34 more samples in 2.5 s.Collecting 33 more samples in 2.4 s.Collecting 32 more samples in 2.3 s.Collecting 31 more samples in 2.2 s.Collecting 30 more samples in 2.2 s.Collecting 29 more samples in 2.1 s.Collecting 28 more samples in 2.0 s.Collecting 27 more samples in 2.0 s.Collecting 26 more samples in 1.9 s.Collecting 25 more samples in 1.8 s.Collecting 24 more samples in 1.7 s.Collecting 23 more samples in 1.7 s.Collecting 22 more samples in 1.6 s.Collecting 21 more samples in 1.5 s.Collecting 20 more samples in 1.4 s.Collecting 19 more samples in 1.4 s.Collecting 18 more samples in 1.3 s.Collecting 17 more samples in 1.2 s.Collecting 16 more samples in 1.2 s.Collecting 15 more samples in 1.1 s.Collecting 14 more samples in 1.0 s.Collecting 13 more samples in 0.9 s.Collecting 12 more samples in 0.9 s.Collecting 11 more samples in 0.8 s.Collecting 10 more samples in 0.7 s.Collecting 9 more samples in 0.7 s.Collecting 8 more samples in 0.6 s.Collecting 7 more samples in 0.5 s.Collecting 6 more samples in 0.4 s.Collecting 5 more samples in 0.4 s.Collecting 4 more samples in 0.3 s.Collecting 3 more samples in 0.2 s.Collecting 2 more samples in 0.1 s.Collecting 1 more samples in 0.1 s.mean: 77.72212 ms, lower bound: 76.46019 ms, upper bound: 80.21076 ms, confidence: 0.950 std dev: 8.748337 ms, lower bound: 5.119533 ms, upper bound: 14.19060 ms, confidence: 0.950 found 10 outliers among 100 samples (10.0%) 5 (5.0%) high mild 5 (5.0%) high severe variance introduced by outliers: 83.130% variance is severely inflated by outliers commits: 200000 retries: 110 allocated bytes: 116345672 Running a subject "6/33333/ttrie" Collecting 100 more samples in 5.2 s.Collecting 99 more samples in 5.1 s.Collecting 98 more samples in 5.1 s.Collecting 97 more samples in 5.0 s.Collecting 96 more samples in 5.0 s.Collecting 95 more samples in 4.9 s.Collecting 94 more samples in 4.9 s.Collecting 93 more samples in 4.8 s.Collecting 92 more samples in 4.8 s.Collecting 91 more samples in 4.7 s.Collecting 90 more samples in 4.7 s.Collecting 89 more samples in 4.6 s.Collecting 88 more samples in 4.6 s.Collecting 87 more samples in 4.5 s.Collecting 86 more samples in 4.4 s.Collecting 85 more samples in 4.4 s.Collecting 84 more samples in 4.3 s.Collecting 83 more samples in 4.3 s.Collecting 82 more samples in 4.2 s.Collecting 81 more samples in 4.2 s.Collecting 80 more samples in 4.1 s.Collecting 79 more samples in 4.1 s.Collecting 78 more samples in 4.0 s.Collecting 77 more samples in 4.0 s.Collecting 76 more samples in 3.9 s.Collecting 75 more samples in 3.9 s.Collecting 74 more samples in 3.8 s.Collecting 73 more samples in 3.8 s.Collecting 72 more samples in 3.7 s.Collecting 71 more samples in 3.7 s.Collecting 70 more samples in 3.6 s.Collecting 69 more samples in 3.6 s.Collecting 68 more samples in 3.5 s.Collecting 67 more samples in 3.5 s.Collecting 66 more samples in 3.4 s.Collecting 65 more samples in 3.4 s.Collecting 64 more samples in 3.3 s.Collecting 63 more samples in 3.3 s.Collecting 62 more samples in 3.2 s.Collecting 61 more samples in 3.2 s.Collecting 60 more samples in 3.1 s.Collecting 59 more samples in 3.1 s.Collecting 58 more samples in 3.0 s.Collecting 57 more samples in 2.9 s.Collecting 56 more samples in 2.9 s.Collecting 55 more samples in 2.8 s.Collecting 54 more samples in 2.8 s.Collecting 53 more samples in 2.7 s.Collecting 52 more samples in 2.7 s.Collecting 51 more samples in 2.6 s.Collecting 50 more samples in 2.6 s.Collecting 49 more samples in 2.5 s.Collecting 48 more samples in 2.5 s.Collecting 47 more samples in 2.4 s.Collecting 46 more samples in 2.4 s.Collecting 45 more samples in 2.3 s.Collecting 44 more samples in 2.3 s.Collecting 43 more samples in 2.2 s.Collecting 42 more samples in 2.2 s.Collecting 41 more samples in 2.1 s.Collecting 40 more samples in 2.1 s.Collecting 39 more samples in 2.0 s.Collecting 38 more samples in 2.0 s.Collecting 37 more samples in 1.9 s.Collecting 36 more samples in 1.9 s.Collecting 35 more samples in 1.8 s.Collecting 34 more samples in 1.8 s.Collecting 33 more samples in 1.7 s.Collecting 32 more samples in 1.7 s.Collecting 31 more samples in 1.6 s.Collecting 30 more samples in 1.6 s.Collecting 29 more samples in 1.5 s.Collecting 28 more samples in 1.4 s.Collecting 27 more samples in 1.4 s.Collecting 26 more samples in 1.3 s.Collecting 25 more samples in 1.3 s.Collecting 24 more samples in 1.2 s.Collecting 23 more samples in 1.2 s.Collecting 22 more samples in 1.1 s.Collecting 21 more samples in 1.1 s.Collecting 20 more samples in 1.0 s.Collecting 19 more samples in 1.0 s.Collecting 18 more samples in 0.9 s.Collecting 17 more samples in 0.9 s.Collecting 16 more samples in 0.8 s.Collecting 15 more samples in 0.8 s.Collecting 14 more samples in 0.7 s.Collecting 13 more samples in 0.7 s.Collecting 12 more samples in 0.6 s.Collecting 11 more samples in 0.6 s.Collecting 10 more samples in 0.5 s.Collecting 9 more samples in 0.5 s.Collecting 8 more samples in 0.4 s.Collecting 7 more samples in 0.4 s.Collecting 6 more samples in 0.3 s.Collecting 5 more samples in 0.3 s.Collecting 4 more samples in 0.2 s.Collecting 3 more samples in 0.2 s.Collecting 2 more samples in 0.1 s.Collecting 1 more samples in 0.1 s.mean: 56.25256 ms, lower bound: 54.81861 ms, upper bound: 58.58787 ms, confidence: 0.950 std dev: 9.175438 ms, lower bound: 6.222510 ms, upper bound: 13.03401 ms, confidence: 0.950 found 9 outliers among 100 samples (9.0%) 8 (8.0%) high severe variance introduced by outliers: 91.503% variance is severely inflated by outliers commits: 200000 retries: 0 allocated bytes: 68202944 Running a subject "8/25000/unordered-containers" Collecting 100 more samples in 8.5 s.Collecting 99 more samples in 8.4 s.Collecting 98 more samples in 8.4 s.Collecting 97 more samples in 8.3 s.Collecting 96 more samples in 8.2 s.Collecting 95 more samples in 8.1 s.Collecting 94 more samples in 8.0 s.Collecting 93 more samples in 7.9 s.Collecting 92 more samples in 7.8 s.Collecting 91 more samples in 7.8 s.Collecting 90 more samples in 7.7 s.Collecting 89 more samples in 7.6 s.Collecting 88 more samples in 7.5 s.Collecting 87 more samples in 7.4 s.Collecting 86 more samples in 7.3 s.Collecting 85 more samples in 7.2 s.Collecting 84 more samples in 7.2 s.Collecting 83 more samples in 7.1 s.Collecting 82 more samples in 7.0 s.Collecting 81 more samples in 6.9 s.Collecting 80 more samples in 6.8 s.Collecting 79 more samples in 6.7 s.Collecting 78 more samples in 6.7 s.Collecting 77 more samples in 6.6 s.Collecting 76 more samples in 6.5 s.Collecting 75 more samples in 6.4 s.Collecting 74 more samples in 6.3 s.Collecting 73 more samples in 6.2 s.Collecting 72 more samples in 6.1 s.Collecting 71 more samples in 6.1 s.Collecting 70 more samples in 6.0 s.Collecting 69 more samples in 5.9 s.Collecting 68 more samples in 5.8 s.Collecting 67 more samples in 5.7 s.Collecting 66 more samples in 5.6 s.Collecting 65 more samples in 5.5 s.Collecting 64 more samples in 5.5 s.Collecting 63 more samples in 5.4 s.Collecting 62 more samples in 5.3 s.Collecting 61 more samples in 5.2 s.Collecting 60 more samples in 5.1 s.Collecting 59 more samples in 5.0 s.Collecting 58 more samples in 4.9 s.Collecting 57 more samples in 4.9 s.Collecting 56 more samples in 4.8 s.Collecting 55 more samples in 4.7 s.Collecting 54 more samples in 4.6 s.Collecting 53 more samples in 4.5 s.Collecting 52 more samples in 4.4 s.Collecting 51 more samples in 4.3 s.Collecting 50 more samples in 4.3 s.Collecting 49 more samples in 4.2 s.Collecting 48 more samples in 4.1 s.Collecting 47 more samples in 4.0 s.Collecting 46 more samples in 3.9 s.Collecting 45 more samples in 3.8 s.Collecting 44 more samples in 3.8 s.Collecting 43 more samples in 3.7 s.Collecting 42 more samples in 3.6 s.Collecting 41 more samples in 3.5 s.Collecting 40 more samples in 3.4 s.Collecting 39 more samples in 3.3 s.Collecting 38 more samples in 3.2 s.Collecting 37 more samples in 3.2 s.Collecting 36 more samples in 3.1 s.Collecting 35 more samples in 3.0 s.Collecting 34 more samples in 2.9 s.Collecting 33 more samples in 2.8 s.Collecting 32 more samples in 2.7 s.Collecting 31 more samples in 2.6 s.Collecting 30 more samples in 2.6 s.Collecting 29 more samples in 2.5 s.Collecting 28 more samples in 2.4 s.Collecting 27 more samples in 2.3 s.Collecting 26 more samples in 2.2 s.Collecting 25 more samples in 2.1 s.Collecting 24 more samples in 2.0 s.Collecting 23 more samples in 2.0 s.Collecting 22 more samples in 1.9 s.Collecting 21 more samples in 1.8 s.Collecting 20 more samples in 1.7 s.Collecting 19 more samples in 1.6 s.Collecting 18 more samples in 1.5 s.Collecting 17 more samples in 1.4 s.Collecting 16 more samples in 1.4 s.Collecting 15 more samples in 1.3 s.Collecting 14 more samples in 1.2 s.Collecting 13 more samples in 1.1 s.Collecting 12 more samples in 1.0 s.Collecting 11 more samples in 0.9 s.Collecting 10 more samples in 0.9 s.Collecting 9 more samples in 0.8 s.Collecting 8 more samples in 0.7 s.Collecting 7 more samples in 0.6 s.Collecting 6 more samples in 0.5 s.Collecting 5 more samples in 0.4 s.Collecting 4 more samples in 0.3 s.Collecting 3 more samples in 0.3 s.Collecting 2 more samples in 0.2 s.Collecting 1 more samples in 0.1 s.mean: 8.520292 ms, lower bound: 8.306635 ms, upper bound: 8.797026 ms, confidence: 0.950 std dev: 1.245857 ms, lower bound: 997.3542 us, upper bound: 1.581291 ms, confidence: 0.950 found 5 outliers among 100 samples (5.0%) 3 (3.0%) high mild 2 (2.0%) high severe variance introduced by outliers: 89.408% variance is severely inflated by outliers commits: 200000 retries: 0 allocated bytes: 4838368 Running a subject "8/25000/stm-containers" Collecting 100 more samples in 5.8 s.Collecting 99 more samples in 5.8 s.Collecting 98 more samples in 5.7 s.Collecting 97 more samples in 5.6 s.Collecting 96 more samples in 5.6 s.Collecting 95 more samples in 5.5 s.Collecting 94 more samples in 5.5 s.Collecting 93 more samples in 5.4 s.Collecting 92 more samples in 5.4 s.Collecting 91 more samples in 5.3 s.Collecting 90 more samples in 5.2 s.Collecting 89 more samples in 5.2 s.Collecting 88 more samples in 5.1 s.Collecting 87 more samples in 5.1 s.Collecting 86 more samples in 5.0 s.Collecting 85 more samples in 4.9 s.Collecting 84 more samples in 4.9 s.Collecting 83 more samples in 4.8 s.Collecting 82 more samples in 4.8 s.Collecting 81 more samples in 4.7 s.Collecting 80 more samples in 4.7 s.Collecting 79 more samples in 4.6 s.Collecting 78 more samples in 4.5 s.Collecting 77 more samples in 4.5 s.Collecting 76 more samples in 4.4 s.Collecting 75 more samples in 4.4 s.Collecting 74 more samples in 4.3 s.Collecting 73 more samples in 4.2 s.Collecting 72 more samples in 4.2 s.Collecting 71 more samples in 4.1 s.Collecting 70 more samples in 4.1 s.Collecting 69 more samples in 4.0 s.Collecting 68 more samples in 4.0 s.Collecting 67 more samples in 3.9 s.Collecting 66 more samples in 3.8 s.Collecting 65 more samples in 3.8 s.Collecting 64 more samples in 3.7 s.Collecting 63 more samples in 3.7 s.Collecting 62 more samples in 3.6 s.Collecting 61 more samples in 3.5 s.Collecting 60 more samples in 3.5 s.Collecting 59 more samples in 3.4 s.Collecting 58 more samples in 3.4 s.Collecting 57 more samples in 3.3 s.Collecting 56 more samples in 3.3 s.Collecting 55 more samples in 3.2 s.Collecting 54 more samples in 3.1 s.Collecting 53 more samples in 3.1 s.Collecting 52 more samples in 3.0 s.Collecting 51 more samples in 3.0 s.Collecting 50 more samples in 2.9 s.Collecting 49 more samples in 2.9 s.Collecting 48 more samples in 2.8 s.Collecting 47 more samples in 2.7 s.Collecting 46 more samples in 2.7 s.Collecting 45 more samples in 2.6 s.Collecting 44 more samples in 2.6 s.Collecting 43 more samples in 2.5 s.Collecting 42 more samples in 2.4 s.Collecting 41 more samples in 2.4 s.Collecting 40 more samples in 2.3 s.Collecting 39 more samples in 2.3 s.Collecting 38 more samples in 2.2 s.Collecting 37 more samples in 2.2 s.Collecting 36 more samples in 2.1 s.Collecting 35 more samples in 2.0 s.Collecting 34 more samples in 2.0 s.Collecting 33 more samples in 1.9 s.Collecting 32 more samples in 1.9 s.Collecting 31 more samples in 1.8 s.Collecting 30 more samples in 1.7 s.Collecting 29 more samples in 1.7 s.Collecting 28 more samples in 1.6 s.Collecting 27 more samples in 1.6 s.Collecting 26 more samples in 1.5 s.Collecting 25 more samples in 1.5 s.Collecting 24 more samples in 1.4 s.Collecting 23 more samples in 1.3 s.Collecting 22 more samples in 1.3 s.Collecting 21 more samples in 1.2 s.Collecting 20 more samples in 1.2 s.Collecting 19 more samples in 1.1 s.Collecting 18 more samples in 1.0 s.Collecting 17 more samples in 1.0 s.Collecting 16 more samples in 0.9 s.Collecting 15 more samples in 0.9 s.Collecting 14 more samples in 0.8 s.Collecting 13 more samples in 0.8 s.Collecting 12 more samples in 0.7 s.Collecting 11 more samples in 0.6 s.Collecting 10 more samples in 0.6 s.Collecting 9 more samples in 0.5 s.Collecting 8 more samples in 0.5 s.Collecting 7 more samples in 0.4 s.Collecting 6 more samples in 0.3 s.Collecting 5 more samples in 0.3 s.Collecting 4 more samples in 0.2 s.Collecting 3 more samples in 0.2 s.Collecting 2 more samples in 0.1 s.Collecting 1 more samples in 0.1 s.mean: 60.01323 ms, lower bound: 59.30854 ms, upper bound: 61.20021 ms, confidence: 0.950 std dev: 4.588773 ms, lower bound: 3.055028 ms, upper bound: 7.011472 ms, confidence: 0.950 found 4 outliers among 100 samples (4.0%) 3 (3.0%) high severe variance introduced by outliers: 68.690% variance is severely inflated by outliers commits: 200000 retries: 174 allocated bytes: 116425552 Running a subject "8/25000/ttrie" Collecting 100 more samples in 4.6 s.Collecting 99 more samples in 4.5 s.Collecting 98 more samples in 4.5 s.Collecting 97 more samples in 4.4 s.Collecting 96 more samples in 4.4 s.Collecting 95 more samples in 4.4 s.Collecting 94 more samples in 4.3 s.Collecting 93 more samples in 4.3 s.Collecting 92 more samples in 4.2 s.Collecting 91 more samples in 4.2 s.Collecting 90 more samples in 4.1 s.Collecting 89 more samples in 4.1 s.Collecting 88 more samples in 4.0 s.Collecting 87 more samples in 4.0 s.Collecting 86 more samples in 3.9 s.Collecting 85 more samples in 3.9 s.Collecting 84 more samples in 3.9 s.Collecting 83 more samples in 3.8 s.Collecting 82 more samples in 3.8 s.Collecting 81 more samples in 3.7 s.Collecting 80 more samples in 3.7 s.Collecting 79 more samples in 3.6 s.Collecting 78 more samples in 3.6 s.Collecting 77 more samples in 3.5 s.Collecting 76 more samples in 3.5 s.Collecting 75 more samples in 3.4 s.Collecting 74 more samples in 3.4 s.Collecting 73 more samples in 3.3 s.Collecting 72 more samples in 3.3 s.Collecting 71 more samples in 3.3 s.Collecting 70 more samples in 3.2 s.Collecting 69 more samples in 3.2 s.Collecting 68 more samples in 3.1 s.Collecting 67 more samples in 3.1 s.Collecting 66 more samples in 3.0 s.Collecting 65 more samples in 3.0 s.Collecting 64 more samples in 2.9 s.Collecting 63 more samples in 2.9 s.Collecting 62 more samples in 2.8 s.Collecting 61 more samples in 2.8 s.Collecting 60 more samples in 2.8 s.Collecting 59 more samples in 2.7 s.Collecting 58 more samples in 2.7 s.Collecting 57 more samples in 2.6 s.Collecting 56 more samples in 2.6 s.Collecting 55 more samples in 2.5 s.Collecting 54 more samples in 2.5 s.Collecting 53 more samples in 2.4 s.Collecting 52 more samples in 2.4 s.Collecting 51 more samples in 2.3 s.Collecting 50 more samples in 2.3 s.Collecting 49 more samples in 2.2 s.Collecting 48 more samples in 2.2 s.Collecting 47 more samples in 2.2 s.Collecting 46 more samples in 2.1 s.Collecting 45 more samples in 2.1 s.Collecting 44 more samples in 2.0 s.Collecting 43 more samples in 2.0 s.Collecting 42 more samples in 1.9 s.Collecting 41 more samples in 1.9 s.Collecting 40 more samples in 1.8 s.Collecting 39 more samples in 1.8 s.Collecting 38 more samples in 1.7 s.Collecting 37 more samples in 1.7 s.Collecting 36 more samples in 1.7 s.Collecting 35 more samples in 1.6 s.Collecting 34 more samples in 1.6 s.Collecting 33 more samples in 1.5 s.Collecting 32 more samples in 1.5 s.Collecting 31 more samples in 1.4 s.Collecting 30 more samples in 1.4 s.Collecting 29 more samples in 1.3 s.Collecting 28 more samples in 1.3 s.Collecting 27 more samples in 1.2 s.Collecting 26 more samples in 1.2 s.Collecting 25 more samples in 1.1 s.Collecting 24 more samples in 1.1 s.Collecting 23 more samples in 1.1 s.Collecting 22 more samples in 1.0 s.Collecting 21 more samples in 1.0 s.Collecting 20 more samples in 0.9 s.Collecting 19 more samples in 0.9 s.Collecting 18 more samples in 0.8 s.Collecting 17 more samples in 0.8 s.Collecting 16 more samples in 0.7 s.Collecting 15 more samples in 0.7 s.Collecting 14 more samples in 0.6 s.Collecting 13 more samples in 0.6 s.Collecting 12 more samples in 0.6 s.Collecting 11 more samples in 0.5 s.Collecting 10 more samples in 0.5 s.Collecting 9 more samples in 0.4 s.Collecting 8 more samples in 0.4 s.Collecting 7 more samples in 0.3 s.Collecting 6 more samples in 0.3 s.Collecting 5 more samples in 0.2 s.Collecting 4 more samples in 0.2 s.Collecting 3 more samples in 0.1 s.Collecting 2 more samples in 0.1 s.Collecting 1 more samples in 0.0 s.mean: 45.66243 ms, lower bound: 44.62096 ms, upper bound: 47.26096 ms, confidence: 0.950 std dev: 6.509509 ms, lower bound: 4.687157 ms, upper bound: 9.817578 ms, confidence: 0.950 found 6 outliers among 100 samples (6.0%) 2 (2.0%) high mild 4 (4.0%) high severe variance introduced by outliers: 88.391% variance is severely inflated by outliers commits: 200000 retries: 0 allocated bytes: 68204616 Running a subject "10/20000/unordered-containers" Collecting 100 more samples in 8.5 s.Collecting 99 more samples in 8.4 s.Collecting 98 more samples in 8.3 s.Collecting 97 more samples in 8.2 s.Collecting 96 more samples in 8.2 s.Collecting 95 more samples in 8.1 s.Collecting 94 more samples in 8.0 s.Collecting 93 more samples in 7.9 s.Collecting 92 more samples in 7.8 s.Collecting 91 more samples in 7.7 s.Collecting 90 more samples in 7.6 s.Collecting 89 more samples in 7.6 s.Collecting 88 more samples in 7.5 s.Collecting 87 more samples in 7.4 s.Collecting 86 more samples in 7.3 s.Collecting 85 more samples in 7.2 s.Collecting 84 more samples in 7.1 s.Collecting 83 more samples in 7.0 s.Collecting 82 more samples in 7.0 s.Collecting 81 more samples in 6.9 s.Collecting 80 more samples in 6.8 s.Collecting 79 more samples in 6.7 s.Collecting 78 more samples in 6.6 s.Collecting 77 more samples in 6.5 s.Collecting 76 more samples in 6.5 s.Collecting 75 more samples in 6.4 s.Collecting 74 more samples in 6.3 s.Collecting 73 more samples in 6.2 s.Collecting 72 more samples in 6.1 s.Collecting 71 more samples in 6.0 s.Collecting 70 more samples in 5.9 s.Collecting 69 more samples in 5.9 s.Collecting 68 more samples in 5.8 s.Collecting 67 more samples in 5.7 s.Collecting 66 more samples in 5.6 s.Collecting 65 more samples in 5.5 s.Collecting 64 more samples in 5.4 s.Collecting 63 more samples in 5.4 s.Collecting 62 more samples in 5.3 s.Collecting 61 more samples in 5.2 s.Collecting 60 more samples in 5.1 s.Collecting 59 more samples in 5.0 s.Collecting 58 more samples in 4.9 s.Collecting 57 more samples in 4.8 s.Collecting 56 more samples in 4.8 s.Collecting 55 more samples in 4.7 s.Collecting 54 more samples in 4.6 s.Collecting 53 more samples in 4.5 s.Collecting 52 more samples in 4.4 s.Collecting 51 more samples in 4.3 s.Collecting 50 more samples in 4.2 s.Collecting 49 more samples in 4.2 s.Collecting 48 more samples in 4.1 s.Collecting 47 more samples in 4.0 s.Collecting 46 more samples in 3.9 s.Collecting 45 more samples in 3.8 s.Collecting 44 more samples in 3.7 s.Collecting 43 more samples in 3.7 s.Collecting 42 more samples in 3.6 s.Collecting 41 more samples in 3.5 s.Collecting 40 more samples in 3.4 s.Collecting 39 more samples in 3.3 s.Collecting 38 more samples in 3.2 s.Collecting 37 more samples in 3.1 s.Collecting 36 more samples in 3.1 s.Collecting 35 more samples in 3.0 s.Collecting 34 more samples in 2.9 s.Collecting 33 more samples in 2.8 s.Collecting 32 more samples in 2.7 s.Collecting 31 more samples in 2.6 s.Collecting 30 more samples in 2.5 s.Collecting 29 more samples in 2.5 s.Collecting 28 more samples in 2.4 s.Collecting 27 more samples in 2.3 s.Collecting 26 more samples in 2.2 s.Collecting 25 more samples in 2.1 s.Collecting 24 more samples in 2.0 s.Collecting 23 more samples in 2.0 s.Collecting 22 more samples in 1.9 s.Collecting 21 more samples in 1.8 s.Collecting 20 more samples in 1.7 s.Collecting 19 more samples in 1.6 s.Collecting 18 more samples in 1.5 s.Collecting 17 more samples in 1.4 s.Collecting 16 more samples in 1.4 s.Collecting 15 more samples in 1.3 s.Collecting 14 more samples in 1.2 s.Collecting 13 more samples in 1.1 s.Collecting 12 more samples in 1.0 s.Collecting 11 more samples in 0.9 s.Collecting 10 more samples in 0.8 s.Collecting 9 more samples in 0.8 s.Collecting 8 more samples in 0.7 s.Collecting 7 more samples in 0.6 s.Collecting 6 more samples in 0.5 s.Collecting 5 more samples in 0.4 s.Collecting 4 more samples in 0.3 s.Collecting 3 more samples in 0.3 s.Collecting 2 more samples in 0.2 s.Collecting 1 more samples in 0.1 s.mean: 7.870899 ms, lower bound: 7.758714 ms, upper bound: 8.052080 ms, confidence: 0.950 std dev: 711.9472 us, lower bound: 496.3722 us, upper bound: 1.274426 ms, confidence: 0.950 found 1 outliers among 100 samples (1.0%) 1 (1.0%) high severe variance introduced by outliers: 75.868% variance is severely inflated by outliers commits: 200000 retries: 0 allocated bytes: 4838288 Running a subject "10/20000/stm-containers" Collecting 100 more samples in 5.4 s.Collecting 99 more samples in 5.4 s.Collecting 98 more samples in 5.3 s.Collecting 97 more samples in 5.3 s.Collecting 96 more samples in 5.2 s.Collecting 95 more samples in 5.2 s.Collecting 94 more samples in 5.1 s.Collecting 93 more samples in 5.0 s.Collecting 92 more samples in 5.0 s.Collecting 91 more samples in 4.9 s.Collecting 90 more samples in 4.9 s.Collecting 89 more samples in 4.8 s.Collecting 88 more samples in 4.8 s.Collecting 87 more samples in 4.7 s.Collecting 86 more samples in 4.7 s.Collecting 85 more samples in 4.6 s.Collecting 84 more samples in 4.6 s.Collecting 83 more samples in 4.5 s.Collecting 82 more samples in 4.4 s.Collecting 81 more samples in 4.4 s.Collecting 80 more samples in 4.3 s.Collecting 79 more samples in 4.3 s.Collecting 78 more samples in 4.2 s.Collecting 77 more samples in 4.2 s.Collecting 76 more samples in 4.1 s.Collecting 75 more samples in 4.1 s.Collecting 74 more samples in 4.0 s.Collecting 73 more samples in 4.0 s.Collecting 72 more samples in 3.9 s.Collecting 71 more samples in 3.9 s.Collecting 70 more samples in 3.8 s.Collecting 69 more samples in 3.7 s.Collecting 68 more samples in 3.7 s.Collecting 67 more samples in 3.6 s.Collecting 66 more samples in 3.6 s.Collecting 65 more samples in 3.5 s.Collecting 64 more samples in 3.5 s.Collecting 63 more samples in 3.4 s.Collecting 62 more samples in 3.4 s.Collecting 61 more samples in 3.3 s.Collecting 60 more samples in 3.3 s.Collecting 59 more samples in 3.2 s.Collecting 58 more samples in 3.1 s.Collecting 57 more samples in 3.1 s.Collecting 56 more samples in 3.0 s.Collecting 55 more samples in 3.0 s.Collecting 54 more samples in 2.9 s.Collecting 53 more samples in 2.9 s.Collecting 52 more samples in 2.8 s.Collecting 51 more samples in 2.8 s.Collecting 50 more samples in 2.7 s.Collecting 49 more samples in 2.7 s.Collecting 48 more samples in 2.6 s.Collecting 47 more samples in 2.5 s.Collecting 46 more samples in 2.5 s.Collecting 45 more samples in 2.4 s.Collecting 44 more samples in 2.4 s.Collecting 43 more samples in 2.3 s.Collecting 42 more samples in 2.3 s.Collecting 41 more samples in 2.2 s.Collecting 40 more samples in 2.2 s.Collecting 39 more samples in 2.1 s.Collecting 38 more samples in 2.1 s.Collecting 37 more samples in 2.0 s.Collecting 36 more samples in 2.0 s.Collecting 35 more samples in 1.9 s.Collecting 34 more samples in 1.8 s.Collecting 33 more samples in 1.8 s.Collecting 32 more samples in 1.7 s.Collecting 31 more samples in 1.7 s.Collecting 30 more samples in 1.6 s.Collecting 29 more samples in 1.6 s.Collecting 28 more samples in 1.5 s.Collecting 27 more samples in 1.5 s.Collecting 26 more samples in 1.4 s.Collecting 25 more samples in 1.4 s.Collecting 24 more samples in 1.3 s.Collecting 23 more samples in 1.2 s.Collecting 22 more samples in 1.2 s.Collecting 21 more samples in 1.1 s.Collecting 20 more samples in 1.1 s.Collecting 19 more samples in 1.0 s.Collecting 18 more samples in 1.0 s.Collecting 17 more samples in 0.9 s.Collecting 16 more samples in 0.9 s.Collecting 15 more samples in 0.8 s.Collecting 14 more samples in 0.8 s.Collecting 13 more samples in 0.7 s.Collecting 12 more samples in 0.7 s.Collecting 11 more samples in 0.6 s.Collecting 10 more samples in 0.5 s.Collecting 9 more samples in 0.5 s.Collecting 8 more samples in 0.4 s.Collecting 7 more samples in 0.4 s.Collecting 6 more samples in 0.3 s.Collecting 5 more samples in 0.3 s.Collecting 4 more samples in 0.2 s.Collecting 3 more samples in 0.2 s.Collecting 2 more samples in 0.1 s.Collecting 1 more samples in 0.1 s.mean: 49.60067 ms, lower bound: 49.03756 ms, upper bound: 50.74772 ms, confidence: 0.950 std dev: 3.940275 ms, lower bound: 2.274633 ms, upper bound: 6.932974 ms, confidence: 0.950 found 8 outliers among 100 samples (8.0%) 4 (4.0%) high mild 4 (4.0%) high severe variance introduced by outliers: 70.716% variance is severely inflated by outliers commits: 200000 retries: 187 allocated bytes: 116509808 Running a subject "10/20000/ttrie" Collecting 100 more samples in 4.0 s.Collecting 99 more samples in 4.0 s.Collecting 98 more samples in 3.9 s.Collecting 97 more samples in 3.9 s.Collecting 96 more samples in 3.9 s.Collecting 95 more samples in 3.8 s.Collecting 94 more samples in 3.8 s.Collecting 93 more samples in 3.7 s.Collecting 92 more samples in 3.7 s.Collecting 91 more samples in 3.7 s.Collecting 90 more samples in 3.6 s.Collecting 89 more samples in 3.6 s.Collecting 88 more samples in 3.5 s.Collecting 87 more samples in 3.5 s.Collecting 86 more samples in 3.5 s.Collecting 85 more samples in 3.4 s.Collecting 84 more samples in 3.4 s.Collecting 83 more samples in 3.3 s.Collecting 82 more samples in 3.3 s.Collecting 81 more samples in 3.3 s.Collecting 80 more samples in 3.2 s.Collecting 79 more samples in 3.2 s.Collecting 78 more samples in 3.1 s.Collecting 77 more samples in 3.1 s.Collecting 76 more samples in 3.1 s.Collecting 75 more samples in 3.0 s.Collecting 74 more samples in 3.0 s.Collecting 73 more samples in 2.9 s.Collecting 72 more samples in 2.9 s.Collecting 71 more samples in 2.9 s.Collecting 70 more samples in 2.8 s.Collecting 69 more samples in 2.8 s.Collecting 68 more samples in 2.7 s.Collecting 67 more samples in 2.7 s.Collecting 66 more samples in 2.7 s.Collecting 65 more samples in 2.6 s.Collecting 64 more samples in 2.6 s.Collecting 63 more samples in 2.5 s.Collecting 62 more samples in 2.5 s.Collecting 61 more samples in 2.5 s.Collecting 60 more samples in 2.4 s.Collecting 59 more samples in 2.4 s.Collecting 58 more samples in 2.3 s.Collecting 57 more samples in 2.3 s.Collecting 56 more samples in 2.3 s.Collecting 55 more samples in 2.2 s.Collecting 54 more samples in 2.2 s.Collecting 53 more samples in 2.1 s.Collecting 52 more samples in 2.1 s.Collecting 51 more samples in 2.0 s.Collecting 50 more samples in 2.0 s.Collecting 49 more samples in 2.0 s.Collecting 48 more samples in 1.9 s.Collecting 47 more samples in 1.9 s.Collecting 46 more samples in 1.8 s.Collecting 45 more samples in 1.8 s.Collecting 44 more samples in 1.8 s.Collecting 43 more samples in 1.7 s.Collecting 42 more samples in 1.7 s.Collecting 41 more samples in 1.6 s.Collecting 40 more samples in 1.6 s.Collecting 39 more samples in 1.6 s.Collecting 38 more samples in 1.5 s.Collecting 37 more samples in 1.5 s.Collecting 36 more samples in 1.4 s.Collecting 35 more samples in 1.4 s.Collecting 34 more samples in 1.4 s.Collecting 33 more samples in 1.3 s.Collecting 32 more samples in 1.3 s.Collecting 31 more samples in 1.2 s.Collecting 30 more samples in 1.2 s.Collecting 29 more samples in 1.2 s.Collecting 28 more samples in 1.1 s.Collecting 27 more samples in 1.1 s.Collecting 26 more samples in 1.0 s.Collecting 25 more samples in 1.0 s.Collecting 24 more samples in 1.0 s.Collecting 23 more samples in 0.9 s.Collecting 22 more samples in 0.9 s.Collecting 21 more samples in 0.8 s.Collecting 20 more samples in 0.8 s.Collecting 19 more samples in 0.8 s.Collecting 18 more samples in 0.7 s.Collecting 17 more samples in 0.7 s.Collecting 16 more samples in 0.6 s.Collecting 15 more samples in 0.6 s.Collecting 14 more samples in 0.6 s.Collecting 13 more samples in 0.5 s.Collecting 12 more samples in 0.5 s.Collecting 11 more samples in 0.4 s.Collecting 10 more samples in 0.4 s.Collecting 9 more samples in 0.4 s.Collecting 8 more samples in 0.3 s.Collecting 7 more samples in 0.3 s.Collecting 6 more samples in 0.2 s.Collecting 5 more samples in 0.2 s.Collecting 4 more samples in 0.2 s.Collecting 3 more samples in 0.1 s.Collecting 2 more samples in 0.1 s.Collecting 1 more samples in 0.0 s.mean: 39.24587 ms, lower bound: 37.81345 ms, upper bound: 42.09685 ms, confidence: 0.950 std dev: 9.902738 ms, lower bound: 5.683115 ms, upper bound: 17.26788 ms, confidence: 0.950 found 11 outliers among 100 samples (11.0%) 2 (2.0%) high mild 9 (9.0%) high severe variance introduced by outliers: 96.769% variance is severely inflated by outliers commits: 200000 retries: 0 allocated bytes: 68219888 Running a subject "12/16666/unordered-containers" Collecting 100 more samples in 13.5 s.Collecting 99 more samples in 13.4 s.Collecting 98 more samples in 13.2 s.Collecting 97 more samples in 13.1 s.Collecting 96 more samples in 13.0 s.Collecting 95 more samples in 12.8 s.Collecting 94 more samples in 12.7 s.Collecting 93 more samples in 12.6 s.Collecting 92 more samples in 12.4 s.Collecting 91 more samples in 12.3 s.Collecting 90 more samples in 12.2 s.Collecting 89 more samples in 12.0 s.Collecting 88 more samples in 11.9 s.Collecting 87 more samples in 11.8 s.Collecting 86 more samples in 11.6 s.Collecting 85 more samples in 11.5 s.Collecting 84 more samples in 11.4 s.Collecting 83 more samples in 11.2 s.Collecting 82 more samples in 11.1 s.Collecting 81 more samples in 10.9 s.Collecting 80 more samples in 10.8 s.Collecting 79 more samples in 10.7 s.Collecting 78 more samples in 10.5 s.Collecting 77 more samples in 10.4 s.Collecting 76 more samples in 10.3 s.Collecting 75 more samples in 10.1 s.Collecting 74 more samples in 10.0 s.Collecting 73 more samples in 9.9 s.Collecting 72 more samples in 9.7 s.Collecting 71 more samples in 9.6 s.Collecting 70 more samples in 9.5 s.Collecting 69 more samples in 9.3 s.Collecting 68 more samples in 9.2 s.Collecting 67 more samples in 9.1 s.Collecting 66 more samples in 8.9 s.Collecting 65 more samples in 8.8 s.Collecting 64 more samples in 8.6 s.Collecting 63 more samples in 8.5 s.Collecting 62 more samples in 8.4 s.Collecting 61 more samples in 8.2 s.Collecting 60 more samples in 8.1 s.Collecting 59 more samples in 8.0 s.Collecting 58 more samples in 7.8 s.Collecting 57 more samples in 7.7 s.Collecting 56 more samples in 7.6 s.Collecting 55 more samples in 7.4 s.Collecting 54 more samples in 7.3 s.Collecting 53 more samples in 7.2 s.Collecting 52 more samples in 7.0 s.Collecting 51 more samples in 6.9 s.Collecting 50 more samples in 6.8 s.Collecting 49 more samples in 6.6 s.Collecting 48 more samples in 6.5 s.Collecting 47 more samples in 6.4 s.Collecting 46 more samples in 6.2 s.Collecting 45 more samples in 6.1 s.Collecting 44 more samples in 5.9 s.Collecting 43 more samples in 5.8 s.Collecting 42 more samples in 5.7 s.Collecting 41 more samples in 5.5 s.Collecting 40 more samples in 5.4 s.Collecting 39 more samples in 5.3 s.Collecting 38 more samples in 5.1 s.Collecting 37 more samples in 5.0 s.Collecting 36 more samples in 4.9 s.Collecting 35 more samples in 4.7 s.Collecting 34 more samples in 4.6 s.Collecting 33 more samples in 4.5 s.Collecting 32 more samples in 4.3 s.Collecting 31 more samples in 4.2 s.Collecting 30 more samples in 4.1 s.Collecting 29 more samples in 3.9 s.Collecting 28 more samples in 3.8 s.Collecting 27 more samples in 3.6 s.Collecting 26 more samples in 3.5 s.Collecting 25 more samples in 3.4 s.Collecting 24 more samples in 3.2 s.Collecting 23 more samples in 3.1 s.Collecting 22 more samples in 3.0 s.Collecting 21 more samples in 2.8 s.Collecting 20 more samples in 2.7 s.Collecting 19 more samples in 2.6 s.Collecting 18 more samples in 2.4 s.Collecting 17 more samples in 2.3 s.Collecting 16 more samples in 2.2 s.Collecting 15 more samples in 2.0 s.Collecting 14 more samples in 1.9 s.Collecting 13 more samples in 1.8 s.Collecting 12 more samples in 1.6 s.Collecting 11 more samples in 1.5 s.Collecting 10 more samples in 1.4 s.Collecting 9 more samples in 1.2 s.Collecting 8 more samples in 1.1 s.Collecting 7 more samples in 0.9 s.Collecting 6 more samples in 0.8 s.Collecting 5 more samples in 0.7 s.Collecting 4 more samples in 0.5 s.Collecting 3 more samples in 0.4 s.Collecting 2 more samples in 0.3 s.Collecting 1 more samples in 0.1 s.mean: 8.080636 ms, lower bound: 7.964991 ms, upper bound: 8.221913 ms, confidence: 0.950 std dev: 656.6373 us, lower bound: 530.4394 us, upper bound: 880.6976 us, confidence: 0.950 found 2 outliers among 100 samples (2.0%) 2 (2.0%) high mild variance introduced by outliers: 71.739% variance is severely inflated by outliers commits: 200000 retries: 0 allocated bytes: 4844456 Running a subject "12/16666/stm-containers" Collecting 100 more samples in 4.1 s.Collecting 99 more samples in 4.0 s.Collecting 98 more samples in 4.0 s.Collecting 97 more samples in 3.9 s.Collecting 96 more samples in 3.9 s.Collecting 95 more samples in 3.8 s.Collecting 94 more samples in 3.8 s.Collecting 93 more samples in 3.8 s.Collecting 92 more samples in 3.7 s.Collecting 91 more samples in 3.7 s.Collecting 90 more samples in 3.6 s.Collecting 89 more samples in 3.6 s.Collecting 88 more samples in 3.6 s.Collecting 87 more samples in 3.5 s.Collecting 86 more samples in 3.5 s.Collecting 85 more samples in 3.4 s.Collecting 84 more samples in 3.4 s.Collecting 83 more samples in 3.4 s.Collecting 82 more samples in 3.3 s.Collecting 81 more samples in 3.3 s.Collecting 80 more samples in 3.2 s.Collecting 79 more samples in 3.2 s.Collecting 78 more samples in 3.2 s.Collecting 77 more samples in 3.1 s.Collecting 76 more samples in 3.1 s.Collecting 75 more samples in 3.0 s.Collecting 74 more samples in 3.0 s.Collecting 73 more samples in 3.0 s.Collecting 72 more samples in 2.9 s.Collecting 71 more samples in 2.9 s.Collecting 70 more samples in 2.8 s.Collecting 69 more samples in 2.8 s.Collecting 68 more samples in 2.8 s.Collecting 67 more samples in 2.7 s.Collecting 66 more samples in 2.7 s.Collecting 65 more samples in 2.6 s.Collecting 64 more samples in 2.6 s.Collecting 63 more samples in 2.6 s.Collecting 62 more samples in 2.5 s.Collecting 61 more samples in 2.5 s.Collecting 60 more samples in 2.4 s.Collecting 59 more samples in 2.4 s.Collecting 58 more samples in 2.4 s.Collecting 57 more samples in 2.3 s.Collecting 56 more samples in 2.3 s.Collecting 55 more samples in 2.2 s.Collecting 54 more samples in 2.2 s.Collecting 53 more samples in 2.1 s.Collecting 52 more samples in 2.1 s.Collecting 51 more samples in 2.1 s.Collecting 50 more samples in 2.0 s.Collecting 49 more samples in 2.0 s.Collecting 48 more samples in 1.9 s.Collecting 47 more samples in 1.9 s.Collecting 46 more samples in 1.9 s.Collecting 45 more samples in 1.8 s.Collecting 44 more samples in 1.8 s.Collecting 43 more samples in 1.7 s.Collecting 42 more samples in 1.7 s.Collecting 41 more samples in 1.7 s.Collecting 40 more samples in 1.6 s.Collecting 39 more samples in 1.6 s.Collecting 38 more samples in 1.5 s.Collecting 37 more samples in 1.5 s.Collecting 36 more samples in 1.5 s.Collecting 35 more samples in 1.4 s.Collecting 34 more samples in 1.4 s.Collecting 33 more samples in 1.3 s.Collecting 32 more samples in 1.3 s.Collecting 31 more samples in 1.3 s.Collecting 30 more samples in 1.2 s.Collecting 29 more samples in 1.2 s.Collecting 28 more samples in 1.1 s.Collecting 27 more samples in 1.1 s.Collecting 26 more samples in 1.1 s.Collecting 25 more samples in 1.0 s.Collecting 24 more samples in 1.0 s.Collecting 23 more samples in 0.9 s.Collecting 22 more samples in 0.9 s.Collecting 21 more samples in 0.9 s.Collecting 20 more samples in 0.8 s.Collecting 19 more samples in 0.8 s.Collecting 18 more samples in 0.7 s.Collecting 17 more samples in 0.7 s.Collecting 16 more samples in 0.6 s.Collecting 15 more samples in 0.6 s.Collecting 14 more samples in 0.6 s.Collecting 13 more samples in 0.5 s.Collecting 12 more samples in 0.5 s.Collecting 11 more samples in 0.4 s.Collecting 10 more samples in 0.4 s.Collecting 9 more samples in 0.4 s.Collecting 8 more samples in 0.3 s.Collecting 7 more samples in 0.3 s.Collecting 6 more samples in 0.2 s.Collecting 5 more samples in 0.2 s.Collecting 4 more samples in 0.2 s.Collecting 3 more samples in 0.1 s.Collecting 2 more samples in 0.1 s.Collecting 1 more samples in 0.0 s.mean: 45.67111 ms, lower bound: 44.76491 ms, upper bound: 47.11824 ms, confidence: 0.950 std dev: 5.795974 ms, lower bound: 4.070346 ms, upper bound: 10.03659 ms, confidence: 0.950 found 2 outliers among 100 samples (2.0%) 1 (1.0%) high severe variance introduced by outliers: 86.266% variance is severely inflated by outliers commits: 200000 retries: 244 allocated bytes: 116586520 Running a subject "12/16666/ttrie" Collecting 100 more samples in 4.7 s.Collecting 99 more samples in 4.6 s.Collecting 98 more samples in 4.6 s.Collecting 97 more samples in 4.5 s.Collecting 96 more samples in 4.5 s.Collecting 95 more samples in 4.4 s.Collecting 94 more samples in 4.4 s.Collecting 93 more samples in 4.3 s.Collecting 92 more samples in 4.3 s.Collecting 91 more samples in 4.3 s.Collecting 90 more samples in 4.2 s.Collecting 89 more samples in 4.2 s.Collecting 88 more samples in 4.1 s.Collecting 87 more samples in 4.1 s.Collecting 86 more samples in 4.0 s.Collecting 85 more samples in 4.0 s.Collecting 84 more samples in 3.9 s.Collecting 83 more samples in 3.9 s.Collecting 82 more samples in 3.8 s.Collecting 81 more samples in 3.8 s.Collecting 80 more samples in 3.7 s.Collecting 79 more samples in 3.7 s.Collecting 78 more samples in 3.6 s.Collecting 77 more samples in 3.6 s.Collecting 76 more samples in 3.6 s.Collecting 75 more samples in 3.5 s.Collecting 74 more samples in 3.5 s.Collecting 73 more samples in 3.4 s.Collecting 72 more samples in 3.4 s.Collecting 71 more samples in 3.3 s.Collecting 70 more samples in 3.3 s.Collecting 69 more samples in 3.2 s.Collecting 68 more samples in 3.2 s.Collecting 67 more samples in 3.1 s.Collecting 66 more samples in 3.1 s.Collecting 65 more samples in 3.0 s.Collecting 64 more samples in 3.0 s.Collecting 63 more samples in 2.9 s.Collecting 62 more samples in 2.9 s.Collecting 61 more samples in 2.8 s.Collecting 60 more samples in 2.8 s.Collecting 59 more samples in 2.8 s.Collecting 58 more samples in 2.7 s.Collecting 57 more samples in 2.7 s.Collecting 56 more samples in 2.6 s.Collecting 55 more samples in 2.6 s.Collecting 54 more samples in 2.5 s.Collecting 53 more samples in 2.5 s.Collecting 52 more samples in 2.4 s.Collecting 51 more samples in 2.4 s.Collecting 50 more samples in 2.3 s.Collecting 49 more samples in 2.3 s.Collecting 48 more samples in 2.2 s.Collecting 47 more samples in 2.2 s.Collecting 46 more samples in 2.1 s.Collecting 45 more samples in 2.1 s.Collecting 44 more samples in 2.1 s.Collecting 43 more samples in 2.0 s.Collecting 42 more samples in 2.0 s.Collecting 41 more samples in 1.9 s.Collecting 40 more samples in 1.9 s.Collecting 39 more samples in 1.8 s.Collecting 38 more samples in 1.8 s.Collecting 37 more samples in 1.7 s.Collecting 36 more samples in 1.7 s.Collecting 35 more samples in 1.6 s.Collecting 34 more samples in 1.6 s.Collecting 33 more samples in 1.5 s.Collecting 32 more samples in 1.5 s.Collecting 31 more samples in 1.4 s.Collecting 30 more samples in 1.4 s.Collecting 29 more samples in 1.4 s.Collecting 28 more samples in 1.3 s.Collecting 27 more samples in 1.3 s.Collecting 26 more samples in 1.2 s.Collecting 25 more samples in 1.2 s.Collecting 24 more samples in 1.1 s.Collecting 23 more samples in 1.1 s.Collecting 22 more samples in 1.0 s.Collecting 21 more samples in 1.0 s.Collecting 20 more samples in 0.9 s.Collecting 19 more samples in 0.9 s.Collecting 18 more samples in 0.8 s.Collecting 17 more samples in 0.8 s.Collecting 16 more samples in 0.7 s.Collecting 15 more samples in 0.7 s.Collecting 14 more samples in 0.7 s.Collecting 13 more samples in 0.6 s.Collecting 12 more samples in 0.6 s.Collecting 11 more samples in 0.5 s.Collecting 10 more samples in 0.5 s.Collecting 9 more samples in 0.4 s.Collecting 8 more samples in 0.4 s.Collecting 7 more samples in 0.3 s.Collecting 6 more samples in 0.3 s.Collecting 5 more samples in 0.2 s.Collecting 4 more samples in 0.2 s.Collecting 3 more samples in 0.1 s.Collecting 2 more samples in 0.1 s.Collecting 1 more samples in 0.0 s.mean: 34.35190 ms, lower bound: 33.49085 ms, upper bound: 35.64797 ms, confidence: 0.950 std dev: 5.324810 ms, lower bound: 3.933880 ms, upper bound: 8.512015 ms, confidence: 0.950 found 9 outliers among 100 samples (9.0%) 6 (6.0%) high mild 3 (3.0%) high severe variance introduced by outliers: 90.461% variance is severely inflated by outliers commits: 200000 retries: 0 allocated bytes: 68226240 Running a subject "14/14285/unordered-containers" Collecting 100 more samples in 12.2 s.Collecting 99 more samples in 12.1 s.Collecting 98 more samples in 12.0 s.Collecting 97 more samples in 11.8 s.Collecting 96 more samples in 11.7 s.Collecting 95 more samples in 11.6 s.Collecting 94 more samples in 11.5 s.Collecting 93 more samples in 11.3 s.Collecting 92 more samples in 11.2 s.Collecting 91 more samples in 11.1 s.Collecting 90 more samples in 11.0 s.Collecting 89 more samples in 10.9 s.Collecting 88 more samples in 10.7 s.Collecting 87 more samples in 10.6 s.Collecting 86 more samples in 10.5 s.Collecting 85 more samples in 10.4 s.Collecting 84 more samples in 10.2 s.Collecting 83 more samples in 10.1 s.Collecting 82 more samples in 10.0 s.Collecting 81 more samples in 9.9 s.Collecting 80 more samples in 9.8 s.Collecting 79 more samples in 9.6 s.Collecting 78 more samples in 9.5 s.Collecting 77 more samples in 9.4 s.Collecting 76 more samples in 9.3 s.Collecting 75 more samples in 9.2 s.Collecting 74 more samples in 9.0 s.Collecting 73 more samples in 8.9 s.Collecting 72 more samples in 8.8 s.Collecting 71 more samples in 8.7 s.Collecting 70 more samples in 8.5 s.Collecting 69 more samples in 8.4 s.Collecting 68 more samples in 8.3 s.Collecting 67 more samples in 8.2 s.Collecting 66 more samples in 8.1 s.Collecting 65 more samples in 7.9 s.Collecting 64 more samples in 7.8 s.Collecting 63 more samples in 7.7 s.Collecting 62 more samples in 7.6 s.Collecting 61 more samples in 7.4 s.Collecting 60 more samples in 7.3 s.Collecting 59 more samples in 7.2 s.Collecting 58 more samples in 7.1 s.Collecting 57 more samples in 7.0 s.Collecting 56 more samples in 6.8 s.Collecting 55 more samples in 6.7 s.Collecting 54 more samples in 6.6 s.Collecting 53 more samples in 6.5 s.Collecting 52 more samples in 6.3 s.Collecting 51 more samples in 6.2 s.Collecting 50 more samples in 6.1 s.Collecting 49 more samples in 6.0 s.Collecting 48 more samples in 5.9 s.Collecting 47 more samples in 5.7 s.Collecting 46 more samples in 5.6 s.Collecting 45 more samples in 5.5 s.Collecting 44 more samples in 5.4 s.Collecting 43 more samples in 5.2 s.Collecting 42 more samples in 5.1 s.Collecting 41 more samples in 5.0 s.Collecting 40 more samples in 4.9 s.Collecting 39 more samples in 4.8 s.Collecting 38 more samples in 4.6 s.Collecting 37 more samples in 4.5 s.Collecting 36 more samples in 4.4 s.Collecting 35 more samples in 4.3 s.Collecting 34 more samples in 4.1 s.Collecting 33 more samples in 4.0 s.Collecting 32 more samples in 3.9 s.Collecting 31 more samples in 3.8 s.Collecting 30 more samples in 3.7 s.Collecting 29 more samples in 3.5 s.Collecting 28 more samples in 3.4 s.Collecting 27 more samples in 3.3 s.Collecting 26 more samples in 3.2 s.Collecting 25 more samples in 3.1 s.Collecting 24 more samples in 2.9 s.Collecting 23 more samples in 2.8 s.Collecting 22 more samples in 2.7 s.Collecting 21 more samples in 2.6 s.Collecting 20 more samples in 2.4 s.Collecting 19 more samples in 2.3 s.Collecting 18 more samples in 2.2 s.Collecting 17 more samples in 2.1 s.Collecting 16 more samples in 2.0 s.Collecting 15 more samples in 1.8 s.Collecting 14 more samples in 1.7 s.Collecting 13 more samples in 1.6 s.Collecting 12 more samples in 1.5 s.Collecting 11 more samples in 1.3 s.Collecting 10 more samples in 1.2 s.Collecting 9 more samples in 1.1 s.Collecting 8 more samples in 1.0 s.Collecting 7 more samples in 0.9 s.Collecting 6 more samples in 0.7 s.Collecting 5 more samples in 0.6 s.Collecting 4 more samples in 0.5 s.Collecting 3 more samples in 0.4 s.Collecting 2 more samples in 0.2 s.Collecting 1 more samples in 0.1 s.mean: 9.084469 ms, lower bound: 8.506280 ms, upper bound: 10.34021 ms, confidence: 0.950 std dev: 4.183494 ms, lower bound: 2.233488 ms, upper bound: 6.724371 ms, confidence: 0.950 found 9 outliers among 100 samples (9.0%) 2 (2.0%) high mild 6 (6.0%) high severe variance introduced by outliers: 98.928% variance is severely inflated by outliers commits: 200000 retries: 0 allocated bytes: 4852408 Running a subject "14/14285/stm-containers" Collecting 100 more samples in 5.1 s.Collecting 99 more samples in 5.1 s.Collecting 98 more samples in 5.0 s.Collecting 97 more samples in 5.0 s.Collecting 96 more samples in 4.9 s.Collecting 95 more samples in 4.9 s.Collecting 94 more samples in 4.8 s.Collecting 93 more samples in 4.8 s.Collecting 92 more samples in 4.7 s.Collecting 91 more samples in 4.7 s.Collecting 90 more samples in 4.6 s.Collecting 89 more samples in 4.6 s.Collecting 88 more samples in 4.5 s.Collecting 87 more samples in 4.5 s.Collecting 86 more samples in 4.4 s.Collecting 85 more samples in 4.3 s.Collecting 84 more samples in 4.3 s.Collecting 83 more samples in 4.2 s.Collecting 82 more samples in 4.2 s.Collecting 81 more samples in 4.1 s.Collecting 80 more samples in 4.1 s.Collecting 79 more samples in 4.0 s.Collecting 78 more samples in 4.0 s.Collecting 77 more samples in 3.9 s.Collecting 76 more samples in 3.9 s.Collecting 75 more samples in 3.8 s.Collecting 74 more samples in 3.8 s.Collecting 73 more samples in 3.7 s.Collecting 72 more samples in 3.7 s.Collecting 71 more samples in 3.6 s.Collecting 70 more samples in 3.6 s.Collecting 69 more samples in 3.5 s.Collecting 68 more samples in 3.5 s.Collecting 67 more samples in 3.4 s.Collecting 66 more samples in 3.4 s.Collecting 65 more samples in 3.3 s.Collecting 64 more samples in 3.3 s.Collecting 63 more samples in 3.2 s.Collecting 62 more samples in 3.2 s.Collecting 61 more samples in 3.1 s.Collecting 60 more samples in 3.1 s.Collecting 59 more samples in 3.0 s.Collecting 58 more samples in 3.0 s.Collecting 57 more samples in 2.9 s.Collecting 56 more samples in 2.9 s.Collecting 55 more samples in 2.8 s.Collecting 54 more samples in 2.8 s.Collecting 53 more samples in 2.7 s.Collecting 52 more samples in 2.7 s.Collecting 51 more samples in 2.6 s.Collecting 50 more samples in 2.6 s.Collecting 49 more samples in 2.5 s.Collecting 48 more samples in 2.5 s.Collecting 47 more samples in 2.4 s.Collecting 46 more samples in 2.4 s.Collecting 45 more samples in 2.3 s.Collecting 44 more samples in 2.3 s.Collecting 43 more samples in 2.2 s.Collecting 42 more samples in 2.1 s.Collecting 41 more samples in 2.1 s.Collecting 40 more samples in 2.0 s.Collecting 39 more samples in 2.0 s.Collecting 38 more samples in 1.9 s.Collecting 37 more samples in 1.9 s.Collecting 36 more samples in 1.8 s.Collecting 35 more samples in 1.8 s.Collecting 34 more samples in 1.7 s.Collecting 33 more samples in 1.7 s.Collecting 32 more samples in 1.6 s.Collecting 31 more samples in 1.6 s.Collecting 30 more samples in 1.5 s.Collecting 29 more samples in 1.5 s.Collecting 28 more samples in 1.4 s.Collecting 27 more samples in 1.4 s.Collecting 26 more samples in 1.3 s.Collecting 25 more samples in 1.3 s.Collecting 24 more samples in 1.2 s.Collecting 23 more samples in 1.2 s.Collecting 22 more samples in 1.1 s.Collecting 21 more samples in 1.1 s.Collecting 20 more samples in 1.0 s.Collecting 19 more samples in 1.0 s.Collecting 18 more samples in 0.9 s.Collecting 17 more samples in 0.9 s.Collecting 16 more samples in 0.8 s.Collecting 15 more samples in 0.8 s.Collecting 14 more samples in 0.7 s.Collecting 13 more samples in 0.7 s.Collecting 12 more samples in 0.6 s.Collecting 11 more samples in 0.6 s.Collecting 10 more samples in 0.5 s.Collecting 9 more samples in 0.5 s.Collecting 8 more samples in 0.4 s.Collecting 7 more samples in 0.4 s.Collecting 6 more samples in 0.3 s.Collecting 5 more samples in 0.3 s.Collecting 4 more samples in 0.2 s.Collecting 3 more samples in 0.2 s.Collecting 2 more samples in 0.1 s.Collecting 1 more samples in 0.1 s.mean: 41.18618 ms, lower bound: 40.34964 ms, upper bound: 42.48178 ms, confidence: 0.950 std dev: 5.276389 ms, lower bound: 3.681768 ms, upper bound: 7.927243 ms, confidence: 0.950 found 4 outliers among 100 samples (4.0%) 3 (3.0%) high severe variance introduced by outliers: 86.279% variance is severely inflated by outliers commits: 200000 retries: 234 allocated bytes: 116677688 Running a subject "14/14285/ttrie" Collecting 100 more samples in 3.2 s.Collecting 99 more samples in 3.2 s.Collecting 98 more samples in 3.1 s.Collecting 97 more samples in 3.1 s.Collecting 96 more samples in 3.1 s.Collecting 95 more samples in 3.0 s.Collecting 94 more samples in 3.0 s.Collecting 93 more samples in 3.0 s.Collecting 92 more samples in 2.9 s.Collecting 91 more samples in 2.9 s.Collecting 90 more samples in 2.9 s.Collecting 89 more samples in 2.8 s.Collecting 88 more samples in 2.8 s.Collecting 87 more samples in 2.8 s.Collecting 86 more samples in 2.8 s.Collecting 85 more samples in 2.7 s.Collecting 84 more samples in 2.7 s.Collecting 83 more samples in 2.7 s.Collecting 82 more samples in 2.6 s.Collecting 81 more samples in 2.6 s.Collecting 80 more samples in 2.6 s.Collecting 79 more samples in 2.5 s.Collecting 78 more samples in 2.5 s.Collecting 77 more samples in 2.5 s.Collecting 76 more samples in 2.4 s.Collecting 75 more samples in 2.4 s.Collecting 74 more samples in 2.4 s.Collecting 73 more samples in 2.3 s.Collecting 72 more samples in 2.3 s.Collecting 71 more samples in 2.3 s.Collecting 70 more samples in 2.2 s.Collecting 69 more samples in 2.2 s.Collecting 68 more samples in 2.2 s.Collecting 67 more samples in 2.1 s.Collecting 66 more samples in 2.1 s.Collecting 65 more samples in 2.1 s.Collecting 64 more samples in 2.0 s.Collecting 63 more samples in 2.0 s.Collecting 62 more samples in 2.0 s.Collecting 61 more samples in 2.0 s.Collecting 60 more samples in 1.9 s.Collecting 59 more samples in 1.9 s.Collecting 58 more samples in 1.9 s.Collecting 57 more samples in 1.8 s.Collecting 56 more samples in 1.8 s.Collecting 55 more samples in 1.8 s.Collecting 54 more samples in 1.7 s.Collecting 53 more samples in 1.7 s.Collecting 52 more samples in 1.7 s.Collecting 51 more samples in 1.6 s.Collecting 50 more samples in 1.6 s.Collecting 49 more samples in 1.6 s.Collecting 48 more samples in 1.5 s.Collecting 47 more samples in 1.5 s.Collecting 46 more samples in 1.5 s.Collecting 45 more samples in 1.4 s.Collecting 44 more samples in 1.4 s.Collecting 43 more samples in 1.4 s.Collecting 42 more samples in 1.3 s.Collecting 41 more samples in 1.3 s.Collecting 40 more samples in 1.3 s.Collecting 39 more samples in 1.2 s.Collecting 38 more samples in 1.2 s.Collecting 37 more samples in 1.2 s.Collecting 36 more samples in 1.2 s.Collecting 35 more samples in 1.1 s.Collecting 34 more samples in 1.1 s.Collecting 33 more samples in 1.1 s.Collecting 32 more samples in 1.0 s.Collecting 31 more samples in 1.0 s.Collecting 30 more samples in 1.0 s.Collecting 29 more samples in 0.9 s.Collecting 28 more samples in 0.9 s.Collecting 27 more samples in 0.9 s.Collecting 26 more samples in 0.8 s.Collecting 25 more samples in 0.8 s.Collecting 24 more samples in 0.8 s.Collecting 23 more samples in 0.7 s.Collecting 22 more samples in 0.7 s.Collecting 21 more samples in 0.7 s.Collecting 20 more samples in 0.6 s.Collecting 19 more samples in 0.6 s.Collecting 18 more samples in 0.6 s.Collecting 17 more samples in 0.5 s.Collecting 16 more samples in 0.5 s.Collecting 15 more samples in 0.5 s.Collecting 14 more samples in 0.4 s.Collecting 13 more samples in 0.4 s.Collecting 12 more samples in 0.4 s.Collecting 11 more samples in 0.4 s.Collecting 10 more samples in 0.3 s.Collecting 9 more samples in 0.3 s.Collecting 8 more samples in 0.3 s.Collecting 7 more samples in 0.2 s.Collecting 6 more samples in 0.2 s.Collecting 5 more samples in 0.2 s.Collecting 4 more samples in 0.1 s.Collecting 3 more samples in 0.1 s.Collecting 2 more samples in 0.1 s.Collecting 1 more samples in 0.0 s.mean: 29.41493 ms, lower bound: 28.96463 ms, upper bound: 29.98874 ms, confidence: 0.950 std dev: 2.597506 ms, lower bound: 2.120989 ms, upper bound: 3.708535 ms, confidence: 0.950 found 3 outliers among 100 samples (3.0%) 2 (2.0%) high mild 1 (1.0%) high severe variance introduced by outliers: 74.843% variance is severely inflated by outliers commits: 200000 retries: 0 allocated bytes: 68233192 Running a subject "16/12500/unordered-containers" Collecting 100 more samples in 9.6 s.Collecting 99 more samples in 9.5 s.Collecting 98 more samples in 9.4 s.Collecting 97 more samples in 9.3 s.Collecting 96 more samples in 9.2 s.Collecting 95 more samples in 9.1 s.Collecting 94 more samples in 9.0 s.Collecting 93 more samples in 8.9 s.Collecting 92 more samples in 8.8 s.Collecting 91 more samples in 8.7 s.Collecting 90 more samples in 8.6 s.Collecting 89 more samples in 8.5 s.Collecting 88 more samples in 8.4 s.Collecting 87 more samples in 8.3 s.Collecting 86 more samples in 8.2 s.Collecting 85 more samples in 8.1 s.Collecting 84 more samples in 8.0 s.Collecting 83 more samples in 7.9 s.Collecting 82 more samples in 7.8 s.Collecting 81 more samples in 7.7 s.Collecting 80 more samples in 7.7 s.Collecting 79 more samples in 7.6 s.Collecting 78 more samples in 7.5 s.Collecting 77 more samples in 7.4 s.Collecting 76 more samples in 7.3 s.Collecting 75 more samples in 7.2 s.Collecting 74 more samples in 7.1 s.Collecting 73 more samples in 7.0 s.Collecting 72 more samples in 6.9 s.Collecting 71 more samples in 6.8 s.Collecting 70 more samples in 6.7 s.Collecting 69 more samples in 6.6 s.Collecting 68 more samples in 6.5 s.Collecting 67 more samples in 6.4 s.Collecting 66 more samples in 6.3 s.Collecting 65 more samples in 6.2 s.Collecting 64 more samples in 6.1 s.Collecting 63 more samples in 6.0 s.Collecting 62 more samples in 5.9 s.Collecting 61 more samples in 5.8 s.Collecting 60 more samples in 5.7 s.Collecting 59 more samples in 5.6 s.Collecting 58 more samples in 5.5 s.Collecting 57 more samples in 5.5 s.Collecting 56 more samples in 5.4 s.Collecting 55 more samples in 5.3 s.Collecting 54 more samples in 5.2 s.Collecting 53 more samples in 5.1 s.Collecting 52 more samples in 5.0 s.Collecting 51 more samples in 4.9 s.Collecting 50 more samples in 4.8 s.Collecting 49 more samples in 4.7 s.Collecting 48 more samples in 4.6 s.Collecting 47 more samples in 4.5 s.Collecting 46 more samples in 4.4 s.Collecting 45 more samples in 4.3 s.Collecting 44 more samples in 4.2 s.Collecting 43 more samples in 4.1 s.Collecting 42 more samples in 4.0 s.Collecting 41 more samples in 3.9 s.Collecting 40 more samples in 3.8 s.Collecting 39 more samples in 3.7 s.Collecting 38 more samples in 3.6 s.Collecting 37 more samples in 3.5 s.Collecting 36 more samples in 3.4 s.Collecting 35 more samples in 3.3 s.Collecting 34 more samples in 3.3 s.Collecting 33 more samples in 3.2 s.Collecting 32 more samples in 3.1 s.Collecting 31 more samples in 3.0 s.Collecting 30 more samples in 2.9 s.Collecting 29 more samples in 2.8 s.Collecting 28 more samples in 2.7 s.Collecting 27 more samples in 2.6 s.Collecting 26 more samples in 2.5 s.Collecting 25 more samples in 2.4 s.Collecting 24 more samples in 2.3 s.Collecting 23 more samples in 2.2 s.Collecting 22 more samples in 2.1 s.Collecting 21 more samples in 2.0 s.Collecting 20 more samples in 1.9 s.Collecting 19 more samples in 1.8 s.Collecting 18 more samples in 1.7 s.Collecting 17 more samples in 1.6 s.Collecting 16 more samples in 1.5 s.Collecting 15 more samples in 1.4 s.Collecting 14 more samples in 1.3 s.Collecting 13 more samples in 1.2 s.Collecting 12 more samples in 1.1 s.Collecting 11 more samples in 1.1 s.Collecting 10 more samples in 1.0 s.Collecting 9 more samples in 0.9 s.Collecting 8 more samples in 0.8 s.Collecting 7 more samples in 0.7 s.Collecting 6 more samples in 0.6 s.Collecting 5 more samples in 0.5 s.Collecting 4 more samples in 0.4 s.Collecting 3 more samples in 0.3 s.Collecting 2 more samples in 0.2 s.Collecting 1 more samples in 0.1 s.mean: 8.978883 ms, lower bound: 8.656767 ms, upper bound: 9.772766 ms, confidence: 0.950 std dev: 2.413466 ms, lower bound: 1.172451 ms, upper bound: 4.879336 ms, confidence: 0.950 found 7 outliers among 100 samples (7.0%) 6 (6.0%) high severe variance introduced by outliers: 96.797% variance is severely inflated by outliers commits: 200000 retries: 0 allocated bytes: 4856960 Running a subject "16/12500/stm-containers" Collecting 100 more samples in 4.9 s.Collecting 99 more samples in 4.8 s.Collecting 98 more samples in 4.8 s.Collecting 97 more samples in 4.7 s.Collecting 96 more samples in 4.7 s.Collecting 95 more samples in 4.6 s.Collecting 94 more samples in 4.6 s.Collecting 93 more samples in 4.5 s.Collecting 92 more samples in 4.5 s.Collecting 91 more samples in 4.4 s.Collecting 90 more samples in 4.4 s.Collecting 89 more samples in 4.3 s.Collecting 88 more samples in 4.3 s.Collecting 87 more samples in 4.2 s.Collecting 86 more samples in 4.2 s.Collecting 85 more samples in 4.1 s.Collecting 84 more samples in 4.1 s.Collecting 83 more samples in 4.0 s.Collecting 82 more samples in 4.0 s.Collecting 81 more samples in 3.9 s.Collecting 80 more samples in 3.9 s.Collecting 79 more samples in 3.8 s.Collecting 78 more samples in 3.8 s.Collecting 77 more samples in 3.7 s.Collecting 76 more samples in 3.7 s.Collecting 75 more samples in 3.6 s.Collecting 74 more samples in 3.6 s.Collecting 73 more samples in 3.5 s.Collecting 72 more samples in 3.5 s.Collecting 71 more samples in 3.4 s.Collecting 70 more samples in 3.4 s.Collecting 69 more samples in 3.3 s.Collecting 68 more samples in 3.3 s.Collecting 67 more samples in 3.3 s.Collecting 66 more samples in 3.2 s.Collecting 65 more samples in 3.2 s.Collecting 64 more samples in 3.1 s.Collecting 63 more samples in 3.1 s.Collecting 62 more samples in 3.0 s.Collecting 61 more samples in 3.0 s.Collecting 60 more samples in 2.9 s.Collecting 59 more samples in 2.9 s.Collecting 58 more samples in 2.8 s.Collecting 57 more samples in 2.8 s.Collecting 56 more samples in 2.7 s.Collecting 55 more samples in 2.7 s.Collecting 54 more samples in 2.6 s.Collecting 53 more samples in 2.6 s.Collecting 52 more samples in 2.5 s.Collecting 51 more samples in 2.5 s.Collecting 50 more samples in 2.4 s.Collecting 49 more samples in 2.4 s.Collecting 48 more samples in 2.3 s.Collecting 47 more samples in 2.3 s.Collecting 46 more samples in 2.2 s.Collecting 45 more samples in 2.2 s.Collecting 44 more samples in 2.1 s.Collecting 43 more samples in 2.1 s.Collecting 42 more samples in 2.0 s.Collecting 41 more samples in 2.0 s.Collecting 40 more samples in 1.9 s.Collecting 39 more samples in 1.9 s.Collecting 38 more samples in 1.8 s.Collecting 37 more samples in 1.8 s.Collecting 36 more samples in 1.7 s.Collecting 35 more samples in 1.7 s.Collecting 34 more samples in 1.6 s.Collecting 33 more samples in 1.6 s.Collecting 32 more samples in 1.6 s.Collecting 31 more samples in 1.5 s.Collecting 30 more samples in 1.5 s.Collecting 29 more samples in 1.4 s.Collecting 28 more samples in 1.4 s.Collecting 27 more samples in 1.3 s.Collecting 26 more samples in 1.3 s.Collecting 25 more samples in 1.2 s.Collecting 24 more samples in 1.2 s.Collecting 23 more samples in 1.1 s.Collecting 22 more samples in 1.1 s.Collecting 21 more samples in 1.0 s.Collecting 20 more samples in 1.0 s.Collecting 19 more samples in 0.9 s.Collecting 18 more samples in 0.9 s.Collecting 17 more samples in 0.8 s.Collecting 16 more samples in 0.8 s.Collecting 15 more samples in 0.7 s.Collecting 14 more samples in 0.7 s.Collecting 13 more samples in 0.6 s.Collecting 12 more samples in 0.6 s.Collecting 11 more samples in 0.5 s.Collecting 10 more samples in 0.5 s.Collecting 9 more samples in 0.4 s.Collecting 8 more samples in 0.4 s.Collecting 7 more samples in 0.3 s.Collecting 6 more samples in 0.3 s.Collecting 5 more samples in 0.2 s.Collecting 4 more samples in 0.2 s.Collecting 3 more samples in 0.1 s.Collecting 2 more samples in 0.1 s.Collecting 1 more samples in 0.0 s.mean: 36.95741 ms, lower bound: 36.40382 ms, upper bound: 37.75343 ms, confidence: 0.950 std dev: 3.363151 ms, lower bound: 2.567917 ms, upper bound: 4.920893 ms, confidence: 0.950 found 9 outliers among 100 samples (9.0%) 5 (5.0%) high mild 4 (4.0%) high severe variance introduced by outliers: 75.881% variance is severely inflated by outliers commits: 200000 retries: 333 allocated bytes: 116752904 Running a subject "16/12500/ttrie" Collecting 100 more samples in 2.6 s.Collecting 99 more samples in 2.6 s.Collecting 98 more samples in 2.6 s.Collecting 97 more samples in 2.5 s.Collecting 96 more samples in 2.5 s.Collecting 95 more samples in 2.5 s.Collecting 94 more samples in 2.5 s.Collecting 93 more samples in 2.4 s.Collecting 92 more samples in 2.4 s.Collecting 91 more samples in 2.4 s.Collecting 90 more samples in 2.4 s.Collecting 89 more samples in 2.3 s.Collecting 88 more samples in 2.3 s.Collecting 87 more samples in 2.3 s.Collecting 86 more samples in 2.3 s.Collecting 85 more samples in 2.2 s.Collecting 84 more samples in 2.2 s.Collecting 83 more samples in 2.2 s.Collecting 82 more samples in 2.1 s.Collecting 81 more samples in 2.1 s.Collecting 80 more samples in 2.1 s.Collecting 79 more samples in 2.1 s.Collecting 78 more samples in 2.0 s.Collecting 77 more samples in 2.0 s.Collecting 76 more samples in 2.0 s.Collecting 75 more samples in 2.0 s.Collecting 74 more samples in 1.9 s.Collecting 73 more samples in 1.9 s.Collecting 72 more samples in 1.9 s.Collecting 71 more samples in 1.9 s.Collecting 70 more samples in 1.8 s.Collecting 69 more samples in 1.8 s.Collecting 68 more samples in 1.8 s.Collecting 67 more samples in 1.8 s.Collecting 66 more samples in 1.7 s.Collecting 65 more samples in 1.7 s.Collecting 64 more samples in 1.7 s.Collecting 63 more samples in 1.7 s.Collecting 62 more samples in 1.6 s.Collecting 61 more samples in 1.6 s.Collecting 60 more samples in 1.6 s.Collecting 59 more samples in 1.5 s.Collecting 58 more samples in 1.5 s.Collecting 57 more samples in 1.5 s.Collecting 56 more samples in 1.5 s.Collecting 55 more samples in 1.4 s.Collecting 54 more samples in 1.4 s.Collecting 53 more samples in 1.4 s.Collecting 52 more samples in 1.4 s.Collecting 51 more samples in 1.3 s.Collecting 50 more samples in 1.3 s.Collecting 49 more samples in 1.3 s.Collecting 48 more samples in 1.3 s.Collecting 47 more samples in 1.2 s.Collecting 46 more samples in 1.2 s.Collecting 45 more samples in 1.2 s.Collecting 44 more samples in 1.2 s.Collecting 43 more samples in 1.1 s.Collecting 42 more samples in 1.1 s.Collecting 41 more samples in 1.1 s.Collecting 40 more samples in 1.0 s.Collecting 39 more samples in 1.0 s.Collecting 38 more samples in 1.0 s.Collecting 37 more samples in 1.0 s.Collecting 36 more samples in 0.9 s.Collecting 35 more samples in 0.9 s.Collecting 34 more samples in 0.9 s.Collecting 33 more samples in 0.9 s.Collecting 32 more samples in 0.8 s.Collecting 31 more samples in 0.8 s.Collecting 30 more samples in 0.8 s.Collecting 29 more samples in 0.8 s.Collecting 28 more samples in 0.7 s.Collecting 27 more samples in 0.7 s.Collecting 26 more samples in 0.7 s.Collecting 25 more samples in 0.7 s.Collecting 24 more samples in 0.6 s.Collecting 23 more samples in 0.6 s.Collecting 22 more samples in 0.6 s.Collecting 21 more samples in 0.6 s.Collecting 20 more samples in 0.5 s.Collecting 19 more samples in 0.5 s.Collecting 18 more samples in 0.5 s.Collecting 17 more samples in 0.4 s.Collecting 16 more samples in 0.4 s.Collecting 15 more samples in 0.4 s.Collecting 14 more samples in 0.4 s.Collecting 13 more samples in 0.3 s.Collecting 12 more samples in 0.3 s.Collecting 11 more samples in 0.3 s.Collecting 10 more samples in 0.3 s.Collecting 9 more samples in 0.2 s.Collecting 8 more samples in 0.2 s.Collecting 7 more samples in 0.2 s.Collecting 6 more samples in 0.2 s.Collecting 5 more samples in 0.1 s.Collecting 4 more samples in 0.1 s.Collecting 3 more samples in 0.1 s.Collecting 2 more samples in 0.1 s.Collecting 1 more samples in 0.0 s.mean: 29.21818 ms, lower bound: 28.00979 ms, upper bound: 31.08818 ms, confidence: 0.950 std dev: 7.607087 ms, lower bound: 5.416559 ms, upper bound: 10.14398 ms, confidence: 0.950 found 9 outliers among 100 samples (9.0%) 2 (2.0%) high mild 7 (7.0%) high severe variance introduced by outliers: 96.783% variance is severely inflated by outliers commits: 200000 retries: 0 allocated bytes: 68242000 Benchmark bench: FINISH