Preprocessing library ttrie-0.1.2... In-place registering ttrie-0.1.2... Preprocessing benchmark 'bench' for ttrie-0.1.2... Running 1 benchmarks... Benchmark bench: RUNNING... threads = [1,2,4,6,8,10,12,14,16] numTransactions = 200000 sizes = [(1,1)] numPrefill = 200000 ops = (0,0,0,1) Generating 200000 random keys to prefill... Generating 200000 random transactions... warming up estimating clock resolution... mean is 3.138039 us (160001 iterations) found 3637 outliers among 159999 samples (2.3%) 3008 (1.9%) high severe estimating cost of a clock call... mean is 814.9362 ns (20 iterations) Running a subject "1/200000/unordered-containers" Collecting 99 more samples in 66.7 s.Collecting 98 more samples in 66.0 s.Collecting 97 more samples in 65.3 s.Collecting 96 more samples in 64.7 s.Collecting 95 more samples in 64.0 s.Collecting 94 more samples in 63.3 s.Collecting 93 more samples in 62.7 s.Collecting 92 more samples in 62.0 s.Collecting 91 more samples in 61.3 s.Collecting 90 more samples in 60.6 s.Collecting 89 more samples in 60.0 s.Collecting 88 more samples in 59.3 s.Collecting 87 more samples in 58.6 s.Collecting 86 more samples in 57.9 s.Collecting 85 more samples in 57.3 s.Collecting 84 more samples in 56.6 s.Collecting 83 more samples in 55.9 s.Collecting 82 more samples in 55.2 s.Collecting 81 more samples in 54.6 s.Collecting 80 more samples in 53.9 s.Collecting 79 more samples in 53.2 s.Collecting 78 more samples in 52.5 s.Collecting 77 more samples in 51.9 s.Collecting 76 more samples in 51.2 s.Collecting 75 more samples in 50.5 s.Collecting 74 more samples in 49.9 s.Collecting 73 more samples in 49.2 s.Collecting 72 more samples in 48.5 s.Collecting 71 more samples in 47.8 s.Collecting 70 more samples in 47.2 s.Collecting 69 more samples in 46.5 s.Collecting 68 more samples in 45.8 s.Collecting 67 more samples in 45.1 s.Collecting 66 more samples in 44.5 s.Collecting 65 more samples in 43.8 s.Collecting 64 more samples in 43.1 s.Collecting 63 more samples in 42.4 s.Collecting 62 more samples in 41.8 s.Collecting 61 more samples in 41.1 s.Collecting 60 more samples in 40.4 s.Collecting 59 more samples in 39.7 s.Collecting 58 more samples in 39.1 s.Collecting 57 more samples in 38.4 s.Collecting 56 more samples in 37.7 s.Collecting 55 more samples in 37.1 s.Collecting 54 more samples in 36.4 s.Collecting 53 more samples in 35.7 s.Collecting 52 more samples in 35.0 s.Collecting 51 more samples in 34.4 s.Collecting 50 more samples in 33.7 s.Collecting 49 more samples in 33.0 s.Collecting 48 more samples in 32.3 s.Collecting 47 more samples in 31.7 s.Collecting 46 more samples in 31.0 s.Collecting 45 more samples in 30.3 s.Collecting 44 more samples in 29.6 s.Collecting 43 more samples in 29.0 s.Collecting 42 more samples in 28.3 s.Collecting 41 more samples in 27.6 s.Collecting 40 more samples in 26.9 s.Collecting 39 more samples in 26.3 s.Collecting 38 more samples in 25.6 s.Collecting 37 more samples in 24.9 s.Collecting 36 more samples in 24.3 s.Collecting 35 more samples in 23.6 s.Collecting 34 more samples in 22.9 s.Collecting 33 more samples in 22.2 s.Collecting 32 more samples in 21.6 s.Collecting 31 more samples in 20.9 s.Collecting 30 more samples in 20.2 s.Collecting 29 more samples in 19.5 s.Collecting 28 more samples in 18.9 s.Collecting 27 more samples in 18.2 s.Collecting 26 more samples in 17.5 s.Collecting 25 more samples in 16.8 s.Collecting 24 more samples in 16.2 s.Collecting 23 more samples in 15.5 s.Collecting 22 more samples in 14.8 s.Collecting 21 more samples in 14.1 s.Collecting 20 more samples in 13.5 s.Collecting 19 more samples in 12.8 s.Collecting 18 more samples in 12.1 s.Collecting 17 more samples in 11.5 s.Collecting 16 more samples in 10.8 s.Collecting 15 more samples in 10.1 s.Collecting 14 more samples in 9.4 s.Collecting 13 more samples in 8.8 s.Collecting 12 more samples in 8.1 s.Collecting 11 more samples in 7.4 s.Collecting 10 more samples in 6.7 s.Collecting 9 more samples in 6.1 s.Collecting 8 more samples in 5.4 s.Collecting 7 more samples in 4.7 s.Collecting 6 more samples in 4.0 s.Collecting 5 more samples in 3.4 s.Collecting 4 more samples in 2.7 s.Collecting 3 more samples in 2.0 s.Collecting 2 more samples in 1.3 s.Collecting 1 more samples in 0.7 s.mean: 667.4638 ms, lower bound: 655.8751 ms, upper bound: 683.8521 ms, confidence: 0.950 std dev: 70.22969 ms, lower bound: 51.67188 ms, upper bound: 100.5760 ms, confidence: 0.950 found 6 outliers among 100 samples (6.0%) 2 (2.0%) high mild 3 (3.0%) high severe variance introduced by outliers: 81.051% variance is severely inflated by outliers commits: 200000 retries: 0 allocated bytes: 144787584 Running a subject "1/200000/stm-containers" Collecting 99 more samples in 71.9 s.Collecting 98 more samples in 71.2 s.Collecting 97 more samples in 70.4 s.Collecting 96 more samples in 69.7 s.Collecting 95 more samples in 69.0 s.Collecting 94 more samples in 68.3 s.Collecting 93 more samples in 67.5 s.Collecting 92 more samples in 66.8 s.Collecting 91 more samples in 66.1 s.Collecting 90 more samples in 65.4 s.Collecting 89 more samples in 64.6 s.Collecting 88 more samples in 63.9 s.Collecting 87 more samples in 63.2 s.Collecting 86 more samples in 62.5 s.Collecting 85 more samples in 61.7 s.Collecting 84 more samples in 61.0 s.Collecting 83 more samples in 60.3 s.Collecting 82 more samples in 59.5 s.Collecting 81 more samples in 58.8 s.Collecting 80 more samples in 58.1 s.Collecting 79 more samples in 57.4 s.Collecting 78 more samples in 56.6 s.Collecting 77 more samples in 55.9 s.Collecting 76 more samples in 55.2 s.Collecting 75 more samples in 54.5 s.Collecting 74 more samples in 53.7 s.Collecting 73 more samples in 53.0 s.Collecting 72 more samples in 52.3 s.Collecting 71 more samples in 51.6 s.Collecting 70 more samples in 50.8 s.Collecting 69 more samples in 50.1 s.Collecting 68 more samples in 49.4 s.Collecting 67 more samples in 48.7 s.Collecting 66 more samples in 47.9 s.Collecting 65 more samples in 47.2 s.Collecting 64 more samples in 46.5 s.Collecting 63 more samples in 45.7 s.Collecting 62 more samples in 45.0 s.Collecting 61 more samples in 44.3 s.Collecting 60 more samples in 43.6 s.Collecting 59 more samples in 42.8 s.Collecting 58 more samples in 42.1 s.Collecting 57 more samples in 41.4 s.Collecting 56 more samples in 40.7 s.Collecting 55 more samples in 39.9 s.Collecting 54 more samples in 39.2 s.Collecting 53 more samples in 38.5 s.Collecting 52 more samples in 37.8 s.Collecting 51 more samples in 37.0 s.Collecting 50 more samples in 36.3 s.Collecting 49 more samples in 35.6 s.Collecting 48 more samples in 34.9 s.Collecting 47 more samples in 34.1 s.Collecting 46 more samples in 33.4 s.Collecting 45 more samples in 32.7 s.Collecting 44 more samples in 32.0 s.Collecting 43 more samples in 31.2 s.Collecting 42 more samples in 30.5 s.Collecting 41 more samples in 29.8 s.Collecting 40 more samples in 29.0 s.Collecting 39 more samples in 28.3 s.Collecting 38 more samples in 27.6 s.Collecting 37 more samples in 26.9 s.Collecting 36 more samples in 26.1 s.Collecting 35 more samples in 25.4 s.Collecting 34 more samples in 24.7 s.Collecting 33 more samples in 24.0 s.Collecting 32 more samples in 23.2 s.Collecting 31 more samples in 22.5 s.Collecting 30 more samples in 21.8 s.Collecting 29 more samples in 21.1 s.Collecting 28 more samples in 20.3 s.Collecting 27 more samples in 19.6 s.Collecting 26 more samples in 18.9 s.Collecting 25 more samples in 18.2 s.Collecting 24 more samples in 17.4 s.Collecting 23 more samples in 16.7 s.Collecting 22 more samples in 16.0 s.Collecting 21 more samples in 15.2 s.Collecting 20 more samples in 14.5 s.Collecting 19 more samples in 13.8 s.Collecting 18 more samples in 13.1 s.Collecting 17 more samples in 12.3 s.Collecting 16 more samples in 11.6 s.Collecting 15 more samples in 10.9 s.Collecting 14 more samples in 10.2 s.Collecting 13 more samples in 9.4 s.Collecting 12 more samples in 8.7 s.Collecting 11 more samples in 8.0 s.Collecting 10 more samples in 7.3 s.Collecting 9 more samples in 6.5 s.Collecting 8 more samples in 5.8 s.Collecting 7 more samples in 5.1 s.Collecting 6 more samples in 4.4 s.Collecting 5 more samples in 3.6 s.Collecting 4 more samples in 2.9 s.Collecting 3 more samples in 2.2 s.Collecting 2 more samples in 1.5 s.Collecting 1 more samples in 0.7 s.mean: 737.5347 ms, lower bound: 731.1904 ms, upper bound: 745.1666 ms, confidence: 0.950 std dev: 35.62505 ms, lower bound: 28.74938 ms, upper bound: 49.96560 ms, confidence: 0.950 found 3 outliers among 100 samples (3.0%) 1 (1.0%) high severe variance introduced by outliers: 46.457% variance is moderately inflated by outliers commits: 200000 retries: 0 allocated bytes: 259591032 Running a subject "1/200000/ttrie" Collecting 99 more samples in 32.9 s.Collecting 98 more samples in 32.6 s.Collecting 97 more samples in 32.2 s.Collecting 96 more samples in 31.9 s.Collecting 95 more samples in 31.6 s.Collecting 94 more samples in 31.3 s.Collecting 93 more samples in 30.9 s.Collecting 92 more samples in 30.6 s.Collecting 91 more samples in 30.3 s.Collecting 90 more samples in 29.9 s.Collecting 89 more samples in 29.6 s.Collecting 88 more samples in 29.3 s.Collecting 87 more samples in 28.9 s.Collecting 86 more samples in 28.6 s.Collecting 85 more samples in 28.3 s.Collecting 84 more samples in 27.9 s.Collecting 83 more samples in 27.6 s.Collecting 82 more samples in 27.3 s.Collecting 81 more samples in 26.9 s.Collecting 80 more samples in 26.6 s.Collecting 79 more samples in 26.3 s.Collecting 78 more samples in 25.9 s.Collecting 77 more samples in 25.6 s.Collecting 76 more samples in 25.3 s.Collecting 75 more samples in 24.9 s.Collecting 74 more samples in 24.6 s.Collecting 73 more samples in 24.3 s.Collecting 72 more samples in 23.9 s.Collecting 71 more samples in 23.6 s.Collecting 70 more samples in 23.3 s.Collecting 69 more samples in 22.9 s.Collecting 68 more samples in 22.6 s.Collecting 67 more samples in 22.3 s.Collecting 66 more samples in 21.9 s.Collecting 65 more samples in 21.6 s.Collecting 64 more samples in 21.3 s.Collecting 63 more samples in 20.9 s.Collecting 62 more samples in 20.6 s.Collecting 61 more samples in 20.3 s.Collecting 60 more samples in 19.9 s.Collecting 59 more samples in 19.6 s.Collecting 58 more samples in 19.3 s.Collecting 57 more samples in 19.0 s.Collecting 56 more samples in 18.6 s.Collecting 55 more samples in 18.3 s.Collecting 54 more samples in 18.0 s.Collecting 53 more samples in 17.6 s.Collecting 52 more samples in 17.3 s.Collecting 51 more samples in 17.0 s.Collecting 50 more samples in 16.6 s.Collecting 49 more samples in 16.3 s.Collecting 48 more samples in 16.0 s.Collecting 47 more samples in 15.6 s.Collecting 46 more samples in 15.3 s.Collecting 45 more samples in 15.0 s.Collecting 44 more samples in 14.6 s.Collecting 43 more samples in 14.3 s.Collecting 42 more samples in 14.0 s.Collecting 41 more samples in 13.6 s.Collecting 40 more samples in 13.3 s.Collecting 39 more samples in 13.0 s.Collecting 38 more samples in 12.6 s.Collecting 37 more samples in 12.3 s.Collecting 36 more samples in 12.0 s.Collecting 35 more samples in 11.6 s.Collecting 34 more samples in 11.3 s.Collecting 33 more samples in 11.0 s.Collecting 32 more samples in 10.6 s.Collecting 31 more samples in 10.3 s.Collecting 30 more samples in 10.0 s.Collecting 29 more samples in 9.6 s.Collecting 28 more samples in 9.3 s.Collecting 27 more samples in 9.0 s.Collecting 26 more samples in 8.6 s.Collecting 25 more samples in 8.3 s.Collecting 24 more samples in 8.0 s.Collecting 23 more samples in 7.6 s.Collecting 22 more samples in 7.3 s.Collecting 21 more samples in 7.0 s.Collecting 20 more samples in 6.6 s.Collecting 19 more samples in 6.3 s.Collecting 18 more samples in 6.0 s.Collecting 17 more samples in 5.7 s.Collecting 16 more samples in 5.3 s.Collecting 15 more samples in 5.0 s.Collecting 14 more samples in 4.7 s.Collecting 13 more samples in 4.3 s.Collecting 12 more samples in 4.0 s.Collecting 11 more samples in 3.7 s.Collecting 10 more samples in 3.3 s.Collecting 9 more samples in 3.0 s.Collecting 8 more samples in 2.7 s.Collecting 7 more samples in 2.3 s.Collecting 6 more samples in 2.0 s.Collecting 5 more samples in 1.7 s.Collecting 4 more samples in 1.3 s.Collecting 3 more samples in 1.0 s.Collecting 2 more samples in 0.7 s.Collecting 1 more samples in 0.3 s.mean: 324.7156 ms, lower bound: 319.0471 ms, upper bound: 342.8565 ms, confidence: 0.950 std dev: 46.99806 ms, lower bound: 16.85918 ms, upper bound: 104.3692 ms, confidence: 0.950 found 7 outliers among 100 samples (7.0%) 3 (3.0%) high mild 4 (4.0%) high severe variance introduced by outliers: 89.396% variance is severely inflated by outliers commits: 200000 retries: 0 allocated bytes: 69999008 Running a subject "2/100000/unordered-containers" Collecting 99 more samples in 51.8 s.Collecting 98 more samples in 51.3 s.Collecting 97 more samples in 50.8 s.Collecting 96 more samples in 50.3 s.Collecting 95 more samples in 49.7 s.Collecting 94 more samples in 49.2 s.Collecting 93 more samples in 48.7 s.Collecting 92 more samples in 48.2 s.Collecting 91 more samples in 47.6 s.Collecting 90 more samples in 47.1 s.Collecting 89 more samples in 46.6 s.Collecting 88 more samples in 46.1 s.Collecting 87 more samples in 45.5 s.Collecting 86 more samples in 45.0 s.Collecting 85 more samples in 44.5 s.Collecting 84 more samples in 44.0 s.Collecting 83 more samples in 43.5 s.Collecting 82 more samples in 42.9 s.Collecting 81 more samples in 42.4 s.Collecting 80 more samples in 41.9 s.Collecting 79 more samples in 41.4 s.Collecting 78 more samples in 40.8 s.Collecting 77 more samples in 40.3 s.Collecting 76 more samples in 39.8 s.Collecting 75 more samples in 39.3 s.Collecting 74 more samples in 38.7 s.Collecting 73 more samples in 38.2 s.Collecting 72 more samples in 37.7 s.Collecting 71 more samples in 37.2 s.Collecting 70 more samples in 36.6 s.Collecting 69 more samples in 36.1 s.Collecting 68 more samples in 35.6 s.Collecting 67 more samples in 35.1 s.Collecting 66 more samples in 34.6 s.Collecting 65 more samples in 34.0 s.Collecting 64 more samples in 33.5 s.Collecting 63 more samples in 33.0 s.Collecting 62 more samples in 32.5 s.Collecting 61 more samples in 31.9 s.Collecting 60 more samples in 31.4 s.Collecting 59 more samples in 30.9 s.Collecting 58 more samples in 30.4 s.Collecting 57 more samples in 29.8 s.Collecting 56 more samples in 29.3 s.Collecting 55 more samples in 28.8 s.Collecting 54 more samples in 28.3 s.Collecting 53 more samples in 27.7 s.Collecting 52 more samples in 27.2 s.Collecting 51 more samples in 26.7 s.Collecting 50 more samples in 26.2 s.Collecting 49 more samples in 25.7 s.Collecting 48 more samples in 25.1 s.Collecting 47 more samples in 24.6 s.Collecting 46 more samples in 24.1 s.Collecting 45 more samples in 23.6 s.Collecting 44 more samples in 23.0 s.Collecting 43 more samples in 22.5 s.Collecting 42 more samples in 22.0 s.Collecting 41 more samples in 21.5 s.Collecting 40 more samples in 20.9 s.Collecting 39 more samples in 20.4 s.Collecting 38 more samples in 19.9 s.Collecting 37 more samples in 19.4 s.Collecting 36 more samples in 18.8 s.Collecting 35 more samples in 18.3 s.Collecting 34 more samples in 17.8 s.Collecting 33 more samples in 17.3 s.Collecting 32 more samples in 16.8 s.Collecting 31 more samples in 16.2 s.Collecting 30 more samples in 15.7 s.Collecting 29 more samples in 15.2 s.Collecting 28 more samples in 14.7 s.Collecting 27 more samples in 14.1 s.Collecting 26 more samples in 13.6 s.Collecting 25 more samples in 13.1 s.Collecting 24 more samples in 12.6 s.Collecting 23 more samples in 12.0 s.Collecting 22 more samples in 11.5 s.Collecting 21 more samples in 11.0 s.Collecting 20 more samples in 10.5 s.Collecting 19 more samples in 9.9 s.Collecting 18 more samples in 9.4 s.Collecting 17 more samples in 8.9 s.Collecting 16 more samples in 8.4 s.Collecting 15 more samples in 7.9 s.Collecting 14 more samples in 7.3 s.Collecting 13 more samples in 6.8 s.Collecting 12 more samples in 6.3 s.Collecting 11 more samples in 5.8 s.Collecting 10 more samples in 5.2 s.Collecting 9 more samples in 4.7 s.Collecting 8 more samples in 4.2 s.Collecting 7 more samples in 3.7 s.Collecting 6 more samples in 3.1 s.Collecting 5 more samples in 2.6 s.Collecting 4 more samples in 2.1 s.Collecting 3 more samples in 1.6 s.Collecting 2 more samples in 1.0 s.Collecting 1 more samples in 0.5 s.mean: 574.9885 ms, lower bound: 561.0055 ms, upper bound: 589.4336 ms, confidence: 0.950 std dev: 73.25502 ms, lower bound: 66.96866 ms, upper bound: 87.17393 ms, confidence: 0.950 variance introduced by outliers: 86.271% variance is severely inflated by outliers commits: 200000 retries: 188047 allocated bytes: 276250504 Running a subject "2/100000/stm-containers" Collecting 99 more samples in 40.6 s.Collecting 98 more samples in 40.2 s.Collecting 97 more samples in 39.8 s.Collecting 96 more samples in 39.3 s.Collecting 95 more samples in 38.9 s.Collecting 94 more samples in 38.5 s.Collecting 93 more samples in 38.1 s.Collecting 92 more samples in 37.7 s.Collecting 91 more samples in 37.3 s.Collecting 90 more samples in 36.9 s.Collecting 89 more samples in 36.5 s.Collecting 88 more samples in 36.1 s.Collecting 87 more samples in 35.7 s.Collecting 86 more samples in 35.2 s.Collecting 85 more samples in 34.8 s.Collecting 84 more samples in 34.4 s.Collecting 83 more samples in 34.0 s.Collecting 82 more samples in 33.6 s.Collecting 81 more samples in 33.2 s.Collecting 80 more samples in 32.8 s.Collecting 79 more samples in 32.4 s.Collecting 78 more samples in 32.0 s.Collecting 77 more samples in 31.6 s.Collecting 76 more samples in 31.1 s.Collecting 75 more samples in 30.7 s.Collecting 74 more samples in 30.3 s.Collecting 73 more samples in 29.9 s.Collecting 72 more samples in 29.5 s.Collecting 71 more samples in 29.1 s.Collecting 70 more samples in 28.7 s.Collecting 69 more samples in 28.3 s.Collecting 68 more samples in 27.9 s.Collecting 67 more samples in 27.5 s.Collecting 66 more samples in 27.0 s.Collecting 65 more samples in 26.6 s.Collecting 64 more samples in 26.2 s.Collecting 63 more samples in 25.8 s.Collecting 62 more samples in 25.4 s.Collecting 61 more samples in 25.0 s.Collecting 60 more samples in 24.6 s.Collecting 59 more samples in 24.2 s.Collecting 58 more samples in 23.8 s.Collecting 57 more samples in 23.4 s.Collecting 56 more samples in 23.0 s.Collecting 55 more samples in 22.5 s.Collecting 54 more samples in 22.1 s.Collecting 53 more samples in 21.7 s.Collecting 52 more samples in 21.3 s.Collecting 51 more samples in 20.9 s.Collecting 50 more samples in 20.5 s.Collecting 49 more samples in 20.1 s.Collecting 48 more samples in 19.7 s.Collecting 47 more samples in 19.3 s.Collecting 46 more samples in 18.9 s.Collecting 45 more samples in 18.4 s.Collecting 44 more samples in 18.0 s.Collecting 43 more samples in 17.6 s.Collecting 42 more samples in 17.2 s.Collecting 41 more samples in 16.8 s.Collecting 40 more samples in 16.4 s.Collecting 39 more samples in 16.0 s.Collecting 38 more samples in 15.6 s.Collecting 37 more samples in 15.2 s.Collecting 36 more samples in 14.8 s.Collecting 35 more samples in 14.3 s.Collecting 34 more samples in 13.9 s.Collecting 33 more samples in 13.5 s.Collecting 32 more samples in 13.1 s.Collecting 31 more samples in 12.7 s.Collecting 30 more samples in 12.3 s.Collecting 29 more samples in 11.9 s.Collecting 28 more samples in 11.5 s.Collecting 27 more samples in 11.1 s.Collecting 26 more samples in 10.7 s.Collecting 25 more samples in 10.2 s.Collecting 24 more samples in 9.8 s.Collecting 23 more samples in 9.4 s.Collecting 22 more samples in 9.0 s.Collecting 21 more samples in 8.6 s.Collecting 20 more samples in 8.2 s.Collecting 19 more samples in 7.8 s.Collecting 18 more samples in 7.4 s.Collecting 17 more samples in 7.0 s.Collecting 16 more samples in 6.6 s.Collecting 15 more samples in 6.1 s.Collecting 14 more samples in 5.7 s.Collecting 13 more samples in 5.3 s.Collecting 12 more samples in 4.9 s.Collecting 11 more samples in 4.5 s.Collecting 10 more samples in 4.1 s.Collecting 9 more samples in 3.7 s.Collecting 8 more samples in 3.3 s.Collecting 7 more samples in 2.9 s.Collecting 6 more samples in 2.5 s.Collecting 5 more samples in 2.0 s.Collecting 4 more samples in 1.6 s.Collecting 3 more samples in 1.2 s.Collecting 2 more samples in 0.8 s.Collecting 1 more samples in 0.4 s.mean: 379.0461 ms, lower bound: 374.1990 ms, upper bound: 385.2456 ms, confidence: 0.950 std dev: 27.96492 ms, lower bound: 22.65339 ms, upper bound: 37.16294 ms, confidence: 0.950 found 3 outliers among 100 samples (3.0%) 3 (3.0%) high mild variance introduced by outliers: 67.633% variance is severely inflated by outliers commits: 200000 retries: 36 allocated bytes: 259702392 Running a subject "2/100000/ttrie" Collecting 100 more samples in 15.7 s.Collecting 99 more samples in 15.6 s.Collecting 98 more samples in 15.4 s.Collecting 97 more samples in 15.3 s.Collecting 96 more samples in 15.1 s.Collecting 95 more samples in 14.9 s.Collecting 94 more samples in 14.8 s.Collecting 93 more samples in 14.6 s.Collecting 92 more samples in 14.5 s.Collecting 91 more samples in 14.3 s.Collecting 90 more samples in 14.2 s.Collecting 89 more samples in 14.0 s.Collecting 88 more samples in 13.8 s.Collecting 87 more samples in 13.7 s.Collecting 86 more samples in 13.5 s.Collecting 85 more samples in 13.4 s.Collecting 84 more samples in 13.2 s.Collecting 83 more samples in 13.1 s.Collecting 82 more samples in 12.9 s.Collecting 81 more samples in 12.7 s.Collecting 80 more samples in 12.6 s.Collecting 79 more samples in 12.4 s.Collecting 78 more samples in 12.3 s.Collecting 77 more samples in 12.1 s.Collecting 76 more samples in 12.0 s.Collecting 75 more samples in 11.8 s.Collecting 74 more samples in 11.6 s.Collecting 73 more samples in 11.5 s.Collecting 72 more samples in 11.3 s.Collecting 71 more samples in 11.2 s.Collecting 70 more samples in 11.0 s.Collecting 69 more samples in 10.9 s.Collecting 68 more samples in 10.7 s.Collecting 67 more samples in 10.5 s.Collecting 66 more samples in 10.4 s.Collecting 65 more samples in 10.2 s.Collecting 64 more samples in 10.1 s.Collecting 63 more samples in 9.9 s.Collecting 62 more samples in 9.8 s.Collecting 61 more samples in 9.6 s.Collecting 60 more samples in 9.4 s.Collecting 59 more samples in 9.3 s.Collecting 58 more samples in 9.1 s.Collecting 57 more samples in 9.0 s.Collecting 56 more samples in 8.8 s.Collecting 55 more samples in 8.7 s.Collecting 54 more samples in 8.5 s.Collecting 53 more samples in 8.3 s.Collecting 52 more samples in 8.2 s.Collecting 51 more samples in 8.0 s.Collecting 50 more samples in 7.9 s.Collecting 49 more samples in 7.7 s.Collecting 48 more samples in 7.6 s.Collecting 47 more samples in 7.4 s.Collecting 46 more samples in 7.2 s.Collecting 45 more samples in 7.1 s.Collecting 44 more samples in 6.9 s.Collecting 43 more samples in 6.8 s.Collecting 42 more samples in 6.6 s.Collecting 41 more samples in 6.5 s.Collecting 40 more samples in 6.3 s.Collecting 39 more samples in 6.1 s.Collecting 38 more samples in 6.0 s.Collecting 37 more samples in 5.8 s.Collecting 36 more samples in 5.7 s.Collecting 35 more samples in 5.5 s.Collecting 34 more samples in 5.3 s.Collecting 33 more samples in 5.2 s.Collecting 32 more samples in 5.0 s.Collecting 31 more samples in 4.9 s.Collecting 30 more samples in 4.7 s.Collecting 29 more samples in 4.6 s.Collecting 28 more samples in 4.4 s.Collecting 27 more samples in 4.2 s.Collecting 26 more samples in 4.1 s.Collecting 25 more samples in 3.9 s.Collecting 24 more samples in 3.8 s.Collecting 23 more samples in 3.6 s.Collecting 22 more samples in 3.5 s.Collecting 21 more samples in 3.3 s.Collecting 20 more samples in 3.1 s.Collecting 19 more samples in 3.0 s.Collecting 18 more samples in 2.8 s.Collecting 17 more samples in 2.7 s.Collecting 16 more samples in 2.5 s.Collecting 15 more samples in 2.4 s.Collecting 14 more samples in 2.2 s.Collecting 13 more samples in 2.0 s.Collecting 12 more samples in 1.9 s.Collecting 11 more samples in 1.7 s.Collecting 10 more samples in 1.6 s.Collecting 9 more samples in 1.4 s.Collecting 8 more samples in 1.3 s.Collecting 7 more samples in 1.1 s.Collecting 6 more samples in 0.9 s.Collecting 5 more samples in 0.8 s.Collecting 4 more samples in 0.6 s.Collecting 3 more samples in 0.5 s.Collecting 2 more samples in 0.3 s.Collecting 1 more samples in 0.2 s.mean: 172.4585 ms, lower bound: 166.4673 ms, upper bound: 183.4078 ms, confidence: 0.950 std dev: 40.37223 ms, lower bound: 26.80455 ms, upper bound: 72.22055 ms, confidence: 0.950 found 15 outliers among 100 samples (15.0%) 9 (9.0%) high mild 6 (6.0%) high severe variance introduced by outliers: 95.737% variance is severely inflated by outliers commits: 200000 retries: 0 allocated bytes: 70011048 Running a subject "4/50000/unordered-containers" Collecting 99 more samples in 57.5 s.Collecting 98 more samples in 56.9 s.Collecting 97 more samples in 56.3 s.Collecting 96 more samples in 55.8 s.Collecting 95 more samples in 55.2 s.Collecting 94 more samples in 54.6 s.Collecting 93 more samples in 54.0 s.Collecting 92 more samples in 53.4 s.Collecting 91 more samples in 52.9 s.Collecting 90 more samples in 52.3 s.Collecting 89 more samples in 51.7 s.Collecting 88 more samples in 51.1 s.Collecting 87 more samples in 50.5 s.Collecting 86 more samples in 50.0 s.Collecting 85 more samples in 49.4 s.Collecting 84 more samples in 48.8 s.Collecting 83 more samples in 48.2 s.Collecting 82 more samples in 47.6 s.Collecting 81 more samples in 47.1 s.Collecting 80 more samples in 46.5 s.Collecting 79 more samples in 45.9 s.Collecting 78 more samples in 45.3 s.Collecting 77 more samples in 44.7 s.Collecting 76 more samples in 44.2 s.Collecting 75 more samples in 43.6 s.Collecting 74 more samples in 43.0 s.Collecting 73 more samples in 42.4 s.Collecting 72 more samples in 41.8 s.Collecting 71 more samples in 41.2 s.Collecting 70 more samples in 40.7 s.Collecting 69 more samples in 40.1 s.Collecting 68 more samples in 39.5 s.Collecting 67 more samples in 38.9 s.Collecting 66 more samples in 38.3 s.Collecting 65 more samples in 37.8 s.Collecting 64 more samples in 37.2 s.Collecting 63 more samples in 36.6 s.Collecting 62 more samples in 36.0 s.Collecting 61 more samples in 35.4 s.Collecting 60 more samples in 34.9 s.Collecting 59 more samples in 34.3 s.Collecting 58 more samples in 33.7 s.Collecting 57 more samples in 33.1 s.Collecting 56 more samples in 32.5 s.Collecting 55 more samples in 32.0 s.Collecting 54 more samples in 31.4 s.Collecting 53 more samples in 30.8 s.Collecting 52 more samples in 30.2 s.Collecting 51 more samples in 29.6 s.Collecting 50 more samples in 29.0 s.Collecting 49 more samples in 28.5 s.Collecting 48 more samples in 27.9 s.Collecting 47 more samples in 27.3 s.Collecting 46 more samples in 26.7 s.Collecting 45 more samples in 26.1 s.Collecting 44 more samples in 25.6 s.Collecting 43 more samples in 25.0 s.Collecting 42 more samples in 24.4 s.Collecting 41 more samples in 23.8 s.Collecting 40 more samples in 23.2 s.Collecting 39 more samples in 22.7 s.Collecting 38 more samples in 22.1 s.Collecting 37 more samples in 21.5 s.Collecting 36 more samples in 20.9 s.Collecting 35 more samples in 20.3 s.Collecting 34 more samples in 19.8 s.Collecting 33 more samples in 19.2 s.Collecting 32 more samples in 18.6 s.Collecting 31 more samples in 18.0 s.Collecting 30 more samples in 17.4 s.Collecting 29 more samples in 16.8 s.Collecting 28 more samples in 16.3 s.Collecting 27 more samples in 15.7 s.Collecting 26 more samples in 15.1 s.Collecting 25 more samples in 14.5 s.Collecting 24 more samples in 13.9 s.Collecting 23 more samples in 13.4 s.Collecting 22 more samples in 12.8 s.Collecting 21 more samples in 12.2 s.Collecting 20 more samples in 11.6 s.Collecting 19 more samples in 11.0 s.Collecting 18 more samples in 10.5 s.Collecting 17 more samples in 9.9 s.Collecting 16 more samples in 9.3 s.Collecting 15 more samples in 8.7 s.Collecting 14 more samples in 8.1 s.Collecting 13 more samples in 7.6 s.Collecting 12 more samples in 7.0 s.Collecting 11 more samples in 6.4 s.Collecting 10 more samples in 5.8 s.Collecting 9 more samples in 5.2 s.Collecting 8 more samples in 4.6 s.Collecting 7 more samples in 4.1 s.Collecting 6 more samples in 3.5 s.Collecting 5 more samples in 2.9 s.Collecting 4 more samples in 2.3 s.Collecting 3 more samples in 1.7 s.Collecting 2 more samples in 1.2 s.Collecting 1 more samples in 0.6 s.mean: 575.3610 ms, lower bound: 565.2269 ms, upper bound: 588.3222 ms, confidence: 0.950 std dev: 58.43706 ms, lower bound: 46.15397 ms, upper bound: 76.69384 ms, confidence: 0.950 found 20 outliers among 100 samples (20.0%) 2 (2.0%) low severe 7 (7.0%) low mild 3 (3.0%) high mild 8 (8.0%) high severe variance introduced by outliers: 80.006% variance is severely inflated by outliers commits: 200000 retries: 450435 allocated bytes: 527013048 Running a subject "4/50000/stm-containers" Collecting 100 more samples in 18.1 s.Collecting 99 more samples in 17.9 s.Collecting 98 more samples in 17.7 s.Collecting 97 more samples in 17.5 s.Collecting 96 more samples in 17.4 s.Collecting 95 more samples in 17.2 s.Collecting 94 more samples in 17.0 s.Collecting 93 more samples in 16.8 s.Collecting 92 more samples in 16.6 s.Collecting 91 more samples in 16.4 s.Collecting 90 more samples in 16.3 s.Collecting 89 more samples in 16.1 s.Collecting 88 more samples in 15.9 s.Collecting 87 more samples in 15.7 s.Collecting 86 more samples in 15.5 s.Collecting 85 more samples in 15.4 s.Collecting 84 more samples in 15.2 s.Collecting 83 more samples in 15.0 s.Collecting 82 more samples in 14.8 s.Collecting 81 more samples in 14.6 s.Collecting 80 more samples in 14.5 s.Collecting 79 more samples in 14.3 s.Collecting 78 more samples in 14.1 s.Collecting 77 more samples in 13.9 s.Collecting 76 more samples in 13.7 s.Collecting 75 more samples in 13.6 s.Collecting 74 more samples in 13.4 s.Collecting 73 more samples in 13.2 s.Collecting 72 more samples in 13.0 s.Collecting 71 more samples in 12.8 s.Collecting 70 more samples in 12.7 s.Collecting 69 more samples in 12.5 s.Collecting 68 more samples in 12.3 s.Collecting 67 more samples in 12.1 s.Collecting 66 more samples in 11.9 s.Collecting 65 more samples in 11.7 s.Collecting 64 more samples in 11.6 s.Collecting 63 more samples in 11.4 s.Collecting 62 more samples in 11.2 s.Collecting 61 more samples in 11.0 s.Collecting 60 more samples in 10.8 s.Collecting 59 more samples in 10.7 s.Collecting 58 more samples in 10.5 s.Collecting 57 more samples in 10.3 s.Collecting 56 more samples in 10.1 s.Collecting 55 more samples in 9.9 s.Collecting 54 more samples in 9.8 s.Collecting 53 more samples in 9.6 s.Collecting 52 more samples in 9.4 s.Collecting 51 more samples in 9.2 s.Collecting 50 more samples in 9.0 s.Collecting 49 more samples in 8.9 s.Collecting 48 more samples in 8.7 s.Collecting 47 more samples in 8.5 s.Collecting 46 more samples in 8.3 s.Collecting 45 more samples in 8.1 s.Collecting 44 more samples in 8.0 s.Collecting 43 more samples in 7.8 s.Collecting 42 more samples in 7.6 s.Collecting 41 more samples in 7.4 s.Collecting 40 more samples in 7.2 s.Collecting 39 more samples in 7.0 s.Collecting 38 more samples in 6.9 s.Collecting 37 more samples in 6.7 s.Collecting 36 more samples in 6.5 s.Collecting 35 more samples in 6.3 s.Collecting 34 more samples in 6.1 s.Collecting 33 more samples in 6.0 s.Collecting 32 more samples in 5.8 s.Collecting 31 more samples in 5.6 s.Collecting 30 more samples in 5.4 s.Collecting 29 more samples in 5.2 s.Collecting 28 more samples in 5.1 s.Collecting 27 more samples in 4.9 s.Collecting 26 more samples in 4.7 s.Collecting 25 more samples in 4.5 s.Collecting 24 more samples in 4.3 s.Collecting 23 more samples in 4.2 s.Collecting 22 more samples in 4.0 s.Collecting 21 more samples in 3.8 s.Collecting 20 more samples in 3.6 s.Collecting 19 more samples in 3.4 s.Collecting 18 more samples in 3.3 s.Collecting 17 more samples in 3.1 s.Collecting 16 more samples in 2.9 s.Collecting 15 more samples in 2.7 s.Collecting 14 more samples in 2.5 s.Collecting 13 more samples in 2.3 s.Collecting 12 more samples in 2.2 s.Collecting 11 more samples in 2.0 s.Collecting 10 more samples in 1.8 s.Collecting 9 more samples in 1.6 s.Collecting 8 more samples in 1.4 s.Collecting 7 more samples in 1.3 s.Collecting 6 more samples in 1.1 s.Collecting 5 more samples in 0.9 s.Collecting 4 more samples in 0.7 s.Collecting 3 more samples in 0.5 s.Collecting 2 more samples in 0.4 s.Collecting 1 more samples in 0.2 s.mean: 219.8840 ms, lower bound: 212.9854 ms, upper bound: 239.5085 ms, confidence: 0.950 std dev: 54.61835 ms, lower bound: 21.61310 ms, upper bound: 115.5361 ms, confidence: 0.950 found 10 outliers among 100 samples (10.0%) 3 (3.0%) low mild 3 (3.0%) high mild 4 (4.0%) high severe variance introduced by outliers: 96.762% variance is severely inflated by outliers commits: 200000 retries: 170 allocated bytes: 260013304 Running a subject "4/50000/ttrie" Collecting 100 more samples in 8.9 s.Collecting 99 more samples in 8.8 s.Collecting 98 more samples in 8.7 s.Collecting 97 more samples in 8.7 s.Collecting 96 more samples in 8.6 s.Collecting 95 more samples in 8.5 s.Collecting 94 more samples in 8.4 s.Collecting 93 more samples in 8.3 s.Collecting 92 more samples in 8.2 s.Collecting 91 more samples in 8.1 s.Collecting 90 more samples in 8.0 s.Collecting 89 more samples in 7.9 s.Collecting 88 more samples in 7.8 s.Collecting 87 more samples in 7.8 s.Collecting 86 more samples in 7.7 s.Collecting 85 more samples in 7.6 s.Collecting 84 more samples in 7.5 s.Collecting 83 more samples in 7.4 s.Collecting 82 more samples in 7.3 s.Collecting 81 more samples in 7.2 s.Collecting 80 more samples in 7.1 s.Collecting 79 more samples in 7.0 s.Collecting 78 more samples in 7.0 s.Collecting 77 more samples in 6.9 s.Collecting 76 more samples in 6.8 s.Collecting 75 more samples in 6.7 s.Collecting 74 more samples in 6.6 s.Collecting 73 more samples in 6.5 s.Collecting 72 more samples in 6.4 s.Collecting 71 more samples in 6.3 s.Collecting 70 more samples in 6.2 s.Collecting 69 more samples in 6.2 s.Collecting 68 more samples in 6.1 s.Collecting 67 more samples in 6.0 s.Collecting 66 more samples in 5.9 s.Collecting 65 more samples in 5.8 s.Collecting 64 more samples in 5.7 s.Collecting 63 more samples in 5.6 s.Collecting 62 more samples in 5.5 s.Collecting 61 more samples in 5.4 s.Collecting 60 more samples in 5.4 s.Collecting 59 more samples in 5.3 s.Collecting 58 more samples in 5.2 s.Collecting 57 more samples in 5.1 s.Collecting 56 more samples in 5.0 s.Collecting 55 more samples in 4.9 s.Collecting 54 more samples in 4.8 s.Collecting 53 more samples in 4.7 s.Collecting 52 more samples in 4.6 s.Collecting 51 more samples in 4.5 s.Collecting 50 more samples in 4.5 s.Collecting 49 more samples in 4.4 s.Collecting 48 more samples in 4.3 s.Collecting 47 more samples in 4.2 s.Collecting 46 more samples in 4.1 s.Collecting 45 more samples in 4.0 s.Collecting 44 more samples in 3.9 s.Collecting 43 more samples in 3.8 s.Collecting 42 more samples in 3.7 s.Collecting 41 more samples in 3.7 s.Collecting 40 more samples in 3.6 s.Collecting 39 more samples in 3.5 s.Collecting 38 more samples in 3.4 s.Collecting 37 more samples in 3.3 s.Collecting 36 more samples in 3.2 s.Collecting 35 more samples in 3.1 s.Collecting 34 more samples in 3.0 s.Collecting 33 more samples in 2.9 s.Collecting 32 more samples in 2.9 s.Collecting 31 more samples in 2.8 s.Collecting 30 more samples in 2.7 s.Collecting 29 more samples in 2.6 s.Collecting 28 more samples in 2.5 s.Collecting 27 more samples in 2.4 s.Collecting 26 more samples in 2.3 s.Collecting 25 more samples in 2.2 s.Collecting 24 more samples in 2.1 s.Collecting 23 more samples in 2.1 s.Collecting 22 more samples in 2.0 s.Collecting 21 more samples in 1.9 s.Collecting 20 more samples in 1.8 s.Collecting 19 more samples in 1.7 s.Collecting 18 more samples in 1.6 s.Collecting 17 more samples in 1.5 s.Collecting 16 more samples in 1.4 s.Collecting 15 more samples in 1.3 s.Collecting 14 more samples in 1.2 s.Collecting 13 more samples in 1.2 s.Collecting 12 more samples in 1.1 s.Collecting 11 more samples in 1.0 s.Collecting 10 more samples in 0.9 s.Collecting 9 more samples in 0.8 s.Collecting 8 more samples in 0.7 s.Collecting 7 more samples in 0.6 s.Collecting 6 more samples in 0.5 s.Collecting 5 more samples in 0.4 s.Collecting 4 more samples in 0.4 s.Collecting 3 more samples in 0.3 s.Collecting 2 more samples in 0.2 s.Collecting 1 more samples in 0.1 s.mean: 97.89919 ms, lower bound: 94.05056 ms, upper bound: 104.7798 ms, confidence: 0.950 std dev: 25.52378 ms, lower bound: 16.23970 ms, upper bound: 38.19649 ms, confidence: 0.950 found 9 outliers among 100 samples (9.0%) 8 (8.0%) high severe variance introduced by outliers: 96.784% variance is severely inflated by outliers commits: 200000 retries: 0 allocated bytes: 70015544 Running a subject "6/33333/unordered-containers" Collecting 99 more samples in 59.8 s.Collecting 98 more samples in 59.2 s.Collecting 97 more samples in 58.6 s.Collecting 96 more samples in 58.0 s.Collecting 95 more samples in 57.4 s.Collecting 94 more samples in 56.8 s.Collecting 93 more samples in 56.2 s.Collecting 92 more samples in 55.6 s.Collecting 91 more samples in 54.9 s.Collecting 90 more samples in 54.3 s.Collecting 89 more samples in 53.7 s.Collecting 88 more samples in 53.1 s.Collecting 87 more samples in 52.5 s.Collecting 86 more samples in 51.9 s.Collecting 85 more samples in 51.3 s.Collecting 84 more samples in 50.7 s.Collecting 83 more samples in 50.1 s.Collecting 82 more samples in 49.5 s.Collecting 81 more samples in 48.9 s.Collecting 80 more samples in 48.3 s.Collecting 79 more samples in 47.7 s.Collecting 78 more samples in 47.1 s.Collecting 77 more samples in 46.5 s.Collecting 76 more samples in 45.9 s.Collecting 75 more samples in 45.3 s.Collecting 74 more samples in 44.7 s.Collecting 73 more samples in 44.1 s.Collecting 72 more samples in 43.5 s.Collecting 71 more samples in 42.9 s.Collecting 70 more samples in 42.3 s.Collecting 69 more samples in 41.7 s.Collecting 68 more samples in 41.1 s.Collecting 67 more samples in 40.5 s.Collecting 66 more samples in 39.9 s.Collecting 65 more samples in 39.2 s.Collecting 64 more samples in 38.6 s.Collecting 63 more samples in 38.0 s.Collecting 62 more samples in 37.4 s.Collecting 61 more samples in 36.8 s.Collecting 60 more samples in 36.2 s.Collecting 59 more samples in 35.6 s.Collecting 58 more samples in 35.0 s.Collecting 57 more samples in 34.4 s.Collecting 56 more samples in 33.8 s.Collecting 55 more samples in 33.2 s.Collecting 54 more samples in 32.6 s.Collecting 53 more samples in 32.0 s.Collecting 52 more samples in 31.4 s.Collecting 51 more samples in 30.8 s.Collecting 50 more samples in 30.2 s.Collecting 49 more samples in 29.6 s.Collecting 48 more samples in 29.0 s.Collecting 47 more samples in 28.4 s.Collecting 46 more samples in 27.8 s.Collecting 45 more samples in 27.2 s.Collecting 44 more samples in 26.6 s.Collecting 43 more samples in 26.0 s.Collecting 42 more samples in 25.4 s.Collecting 41 more samples in 24.8 s.Collecting 40 more samples in 24.2 s.Collecting 39 more samples in 23.5 s.Collecting 38 more samples in 22.9 s.Collecting 37 more samples in 22.3 s.Collecting 36 more samples in 21.7 s.Collecting 35 more samples in 21.1 s.Collecting 34 more samples in 20.5 s.Collecting 33 more samples in 19.9 s.Collecting 32 more samples in 19.3 s.Collecting 31 more samples in 18.7 s.Collecting 30 more samples in 18.1 s.Collecting 29 more samples in 17.5 s.Collecting 28 more samples in 16.9 s.Collecting 27 more samples in 16.3 s.Collecting 26 more samples in 15.7 s.Collecting 25 more samples in 15.1 s.Collecting 24 more samples in 14.5 s.Collecting 23 more samples in 13.9 s.Collecting 22 more samples in 13.3 s.Collecting 21 more samples in 12.7 s.Collecting 20 more samples in 12.1 s.Collecting 19 more samples in 11.5 s.Collecting 18 more samples in 10.9 s.Collecting 17 more samples in 10.3 s.Collecting 16 more samples in 9.7 s.Collecting 15 more samples in 9.1 s.Collecting 14 more samples in 8.5 s.Collecting 13 more samples in 7.8 s.Collecting 12 more samples in 7.2 s.Collecting 11 more samples in 6.6 s.Collecting 10 more samples in 6.0 s.Collecting 9 more samples in 5.4 s.Collecting 8 more samples in 4.8 s.Collecting 7 more samples in 4.2 s.Collecting 6 more samples in 3.6 s.Collecting 5 more samples in 3.0 s.Collecting 4 more samples in 2.4 s.Collecting 3 more samples in 1.8 s.Collecting 2 more samples in 1.2 s.Collecting 1 more samples in 0.6 s.mean: 604.3267 ms, lower bound: 596.8837 ms, upper bound: 610.7727 ms, confidence: 0.950 std dev: 35.38187 ms, lower bound: 29.19114 ms, upper bound: 44.40664 ms, confidence: 0.950 found 5 outliers among 100 samples (5.0%) 4 (4.0%) low mild variance introduced by outliers: 56.467% variance is severely inflated by outliers commits: 200000 retries: 706124 allocated bytes: 711534800 Running a subject "6/33333/stm-containers" Collecting 100 more samples in 14.1 s.Collecting 99 more samples in 14.0 s.Collecting 98 more samples in 13.8 s.Collecting 97 more samples in 13.7 s.Collecting 96 more samples in 13.6 s.Collecting 95 more samples in 13.4 s.Collecting 94 more samples in 13.3 s.Collecting 93 more samples in 13.1 s.Collecting 92 more samples in 13.0 s.Collecting 91 more samples in 12.8 s.Collecting 90 more samples in 12.7 s.Collecting 89 more samples in 12.6 s.Collecting 88 more samples in 12.4 s.Collecting 87 more samples in 12.3 s.Collecting 86 more samples in 12.1 s.Collecting 85 more samples in 12.0 s.Collecting 84 more samples in 11.9 s.Collecting 83 more samples in 11.7 s.Collecting 82 more samples in 11.6 s.Collecting 81 more samples in 11.4 s.Collecting 80 more samples in 11.3 s.Collecting 79 more samples in 11.2 s.Collecting 78 more samples in 11.0 s.Collecting 77 more samples in 10.9 s.Collecting 76 more samples in 10.7 s.Collecting 75 more samples in 10.6 s.Collecting 74 more samples in 10.4 s.Collecting 73 more samples in 10.3 s.Collecting 72 more samples in 10.2 s.Collecting 71 more samples in 10.0 s.Collecting 70 more samples in 9.9 s.Collecting 69 more samples in 9.7 s.Collecting 68 more samples in 9.6 s.Collecting 67 more samples in 9.5 s.Collecting 66 more samples in 9.3 s.Collecting 65 more samples in 9.2 s.Collecting 64 more samples in 9.0 s.Collecting 63 more samples in 8.9 s.Collecting 62 more samples in 8.8 s.Collecting 61 more samples in 8.6 s.Collecting 60 more samples in 8.5 s.Collecting 59 more samples in 8.3 s.Collecting 58 more samples in 8.2 s.Collecting 57 more samples in 8.0 s.Collecting 56 more samples in 7.9 s.Collecting 55 more samples in 7.8 s.Collecting 54 more samples in 7.6 s.Collecting 53 more samples in 7.5 s.Collecting 52 more samples in 7.3 s.Collecting 51 more samples in 7.2 s.Collecting 50 more samples in 7.1 s.Collecting 49 more samples in 6.9 s.Collecting 48 more samples in 6.8 s.Collecting 47 more samples in 6.6 s.Collecting 46 more samples in 6.5 s.Collecting 45 more samples in 6.4 s.Collecting 44 more samples in 6.2 s.Collecting 43 more samples in 6.1 s.Collecting 42 more samples in 5.9 s.Collecting 41 more samples in 5.8 s.Collecting 40 more samples in 5.6 s.Collecting 39 more samples in 5.5 s.Collecting 38 more samples in 5.4 s.Collecting 37 more samples in 5.2 s.Collecting 36 more samples in 5.1 s.Collecting 35 more samples in 4.9 s.Collecting 34 more samples in 4.8 s.Collecting 33 more samples in 4.7 s.Collecting 32 more samples in 4.5 s.Collecting 31 more samples in 4.4 s.Collecting 30 more samples in 4.2 s.Collecting 29 more samples in 4.1 s.Collecting 28 more samples in 4.0 s.Collecting 27 more samples in 3.8 s.Collecting 26 more samples in 3.7 s.Collecting 25 more samples in 3.5 s.Collecting 24 more samples in 3.4 s.Collecting 23 more samples in 3.2 s.Collecting 22 more samples in 3.1 s.Collecting 21 more samples in 3.0 s.Collecting 20 more samples in 2.8 s.Collecting 19 more samples in 2.7 s.Collecting 18 more samples in 2.5 s.Collecting 17 more samples in 2.4 s.Collecting 16 more samples in 2.3 s.Collecting 15 more samples in 2.1 s.Collecting 14 more samples in 2.0 s.Collecting 13 more samples in 1.8 s.Collecting 12 more samples in 1.7 s.Collecting 11 more samples in 1.6 s.Collecting 10 more samples in 1.4 s.Collecting 9 more samples in 1.3 s.Collecting 8 more samples in 1.1 s.Collecting 7 more samples in 1.0 s.Collecting 6 more samples in 0.8 s.Collecting 5 more samples in 0.7 s.Collecting 4 more samples in 0.6 s.Collecting 3 more samples in 0.4 s.Collecting 2 more samples in 0.3 s.Collecting 1 more samples in 0.1 s.mean: 145.1190 ms, lower bound: 142.6466 ms, upper bound: 148.6581 ms, confidence: 0.950 std dev: 15.00797 ms, lower bound: 11.32635 ms, upper bound: 22.22216 ms, confidence: 0.950 found 6 outliers among 100 samples (6.0%) 2 (2.0%) high mild 4 (4.0%) high severe variance introduced by outliers: 80.041% variance is severely inflated by outliers commits: 200000 retries: 326 allocated bytes: 260068368 Running a subject "6/33333/ttrie" Collecting 100 more samples in 6.2 s.Collecting 99 more samples in 6.1 s.Collecting 98 more samples in 6.0 s.Collecting 97 more samples in 6.0 s.Collecting 96 more samples in 5.9 s.Collecting 95 more samples in 5.8 s.Collecting 94 more samples in 5.8 s.Collecting 93 more samples in 5.7 s.Collecting 92 more samples in 5.7 s.Collecting 91 more samples in 5.6 s.Collecting 90 more samples in 5.5 s.Collecting 89 more samples in 5.5 s.Collecting 88 more samples in 5.4 s.Collecting 87 more samples in 5.4 s.Collecting 86 more samples in 5.3 s.Collecting 85 more samples in 5.2 s.Collecting 84 more samples in 5.2 s.Collecting 83 more samples in 5.1 s.Collecting 82 more samples in 5.0 s.Collecting 81 more samples in 5.0 s.Collecting 80 more samples in 4.9 s.Collecting 79 more samples in 4.9 s.Collecting 78 more samples in 4.8 s.Collecting 77 more samples in 4.7 s.Collecting 76 more samples in 4.7 s.Collecting 75 more samples in 4.6 s.Collecting 74 more samples in 4.6 s.Collecting 73 more samples in 4.5 s.Collecting 72 more samples in 4.4 s.Collecting 71 more samples in 4.4 s.Collecting 70 more samples in 4.3 s.Collecting 69 more samples in 4.2 s.Collecting 68 more samples in 4.2 s.Collecting 67 more samples in 4.1 s.Collecting 66 more samples in 4.1 s.Collecting 65 more samples in 4.0 s.Collecting 64 more samples in 3.9 s.Collecting 63 more samples in 3.9 s.Collecting 62 more samples in 3.8 s.Collecting 61 more samples in 3.8 s.Collecting 60 more samples in 3.7 s.Collecting 59 more samples in 3.6 s.Collecting 58 more samples in 3.6 s.Collecting 57 more samples in 3.5 s.Collecting 56 more samples in 3.4 s.Collecting 55 more samples in 3.4 s.Collecting 54 more samples in 3.3 s.Collecting 53 more samples in 3.3 s.Collecting 52 more samples in 3.2 s.Collecting 51 more samples in 3.1 s.Collecting 50 more samples in 3.1 s.Collecting 49 more samples in 3.0 s.Collecting 48 more samples in 3.0 s.Collecting 47 more samples in 2.9 s.Collecting 46 more samples in 2.8 s.Collecting 45 more samples in 2.8 s.Collecting 44 more samples in 2.7 s.Collecting 43 more samples in 2.6 s.Collecting 42 more samples in 2.6 s.Collecting 41 more samples in 2.5 s.Collecting 40 more samples in 2.5 s.Collecting 39 more samples in 2.4 s.Collecting 38 more samples in 2.3 s.Collecting 37 more samples in 2.3 s.Collecting 36 more samples in 2.2 s.Collecting 35 more samples in 2.2 s.Collecting 34 more samples in 2.1 s.Collecting 33 more samples in 2.0 s.Collecting 32 more samples in 2.0 s.Collecting 31 more samples in 1.9 s.Collecting 30 more samples in 1.8 s.Collecting 29 more samples in 1.8 s.Collecting 28 more samples in 1.7 s.Collecting 27 more samples in 1.7 s.Collecting 26 more samples in 1.6 s.Collecting 25 more samples in 1.5 s.Collecting 24 more samples in 1.5 s.Collecting 23 more samples in 1.4 s.Collecting 22 more samples in 1.4 s.Collecting 21 more samples in 1.3 s.Collecting 20 more samples in 1.2 s.Collecting 19 more samples in 1.2 s.Collecting 18 more samples in 1.1 s.Collecting 17 more samples in 1.0 s.Collecting 16 more samples in 1.0 s.Collecting 15 more samples in 0.9 s.Collecting 14 more samples in 0.9 s.Collecting 13 more samples in 0.8 s.Collecting 12 more samples in 0.7 s.Collecting 11 more samples in 0.7 s.Collecting 10 more samples in 0.6 s.Collecting 9 more samples in 0.6 s.Collecting 8 more samples in 0.5 s.Collecting 7 more samples in 0.4 s.Collecting 6 more samples in 0.4 s.Collecting 5 more samples in 0.3 s.Collecting 4 more samples in 0.2 s.Collecting 3 more samples in 0.2 s.Collecting 2 more samples in 0.1 s.Collecting 1 more samples in 0.1 s.mean: 65.93338 ms, lower bound: 64.27917 ms, upper bound: 70.14551 ms, confidence: 0.950 std dev: 12.50251 ms, lower bound: 6.175889 ms, upper bound: 25.90878 ms, confidence: 0.950 found 11 outliers among 100 samples (11.0%) 3 (3.0%) high mild 8 (8.0%) high severe variance introduced by outliers: 93.616% variance is severely inflated by outliers commits: 200000 retries: 0 allocated bytes: 70029800 Running a subject "8/25000/unordered-containers" Collecting 99 more samples in 67.3 s.Collecting 98 more samples in 66.7 s.Collecting 97 more samples in 66.0 s.Collecting 96 more samples in 65.3 s.Collecting 95 more samples in 64.6 s.Collecting 94 more samples in 63.9 s.Collecting 93 more samples in 63.3 s.Collecting 92 more samples in 62.6 s.Collecting 91 more samples in 61.9 s.Collecting 90 more samples in 61.2 s.Collecting 89 more samples in 60.5 s.Collecting 88 more samples in 59.9 s.Collecting 87 more samples in 59.2 s.Collecting 86 more samples in 58.5 s.Collecting 85 more samples in 57.8 s.Collecting 84 more samples in 57.1 s.Collecting 83 more samples in 56.5 s.Collecting 82 more samples in 55.8 s.Collecting 81 more samples in 55.1 s.Collecting 80 more samples in 54.4 s.Collecting 79 more samples in 53.7 s.Collecting 78 more samples in 53.1 s.Collecting 77 more samples in 52.4 s.Collecting 76 more samples in 51.7 s.Collecting 75 more samples in 51.0 s.Collecting 74 more samples in 50.3 s.Collecting 73 more samples in 49.7 s.Collecting 72 more samples in 49.0 s.Collecting 71 more samples in 48.3 s.Collecting 70 more samples in 47.6 s.Collecting 69 more samples in 46.9 s.Collecting 68 more samples in 46.3 s.Collecting 67 more samples in 45.6 s.Collecting 66 more samples in 44.9 s.Collecting 65 more samples in 44.2 s.Collecting 64 more samples in 43.5 s.Collecting 63 more samples in 42.9 s.Collecting 62 more samples in 42.2 s.Collecting 61 more samples in 41.5 s.Collecting 60 more samples in 40.8 s.Collecting 59 more samples in 40.1 s.Collecting 58 more samples in 39.5 s.Collecting 57 more samples in 38.8 s.Collecting 56 more samples in 38.1 s.Collecting 55 more samples in 37.4 s.Collecting 54 more samples in 36.7 s.Collecting 53 more samples in 36.1 s.Collecting 52 more samples in 35.4 s.Collecting 51 more samples in 34.7 s.Collecting 50 more samples in 34.0 s.Collecting 49 more samples in 33.3 s.Collecting 48 more samples in 32.7 s.Collecting 47 more samples in 32.0 s.Collecting 46 more samples in 31.3 s.Collecting 45 more samples in 30.6 s.Collecting 44 more samples in 29.9 s.Collecting 43 more samples in 29.3 s.Collecting 42 more samples in 28.6 s.Collecting 41 more samples in 27.9 s.Collecting 40 more samples in 27.2 s.Collecting 39 more samples in 26.5 s.Collecting 38 more samples in 25.9 s.Collecting 37 more samples in 25.2 s.Collecting 36 more samples in 24.5 s.Collecting 35 more samples in 23.8 s.Collecting 34 more samples in 23.1 s.Collecting 33 more samples in 22.4 s.Collecting 32 more samples in 21.8 s.Collecting 31 more samples in 21.1 s.Collecting 30 more samples in 20.4 s.Collecting 29 more samples in 19.7 s.Collecting 28 more samples in 19.0 s.Collecting 27 more samples in 18.4 s.Collecting 26 more samples in 17.7 s.Collecting 25 more samples in 17.0 s.Collecting 24 more samples in 16.3 s.Collecting 23 more samples in 15.6 s.Collecting 22 more samples in 15.0 s.Collecting 21 more samples in 14.3 s.Collecting 20 more samples in 13.6 s.Collecting 19 more samples in 12.9 s.Collecting 18 more samples in 12.2 s.Collecting 17 more samples in 11.6 s.Collecting 16 more samples in 10.9 s.Collecting 15 more samples in 10.2 s.Collecting 14 more samples in 9.5 s.Collecting 13 more samples in 8.8 s.Collecting 12 more samples in 8.2 s.Collecting 11 more samples in 7.5 s.Collecting 10 more samples in 6.8 s.Collecting 9 more samples in 6.1 s.Collecting 8 more samples in 5.4 s.Collecting 7 more samples in 4.8 s.Collecting 6 more samples in 4.1 s.Collecting 5 more samples in 3.4 s.Collecting 4 more samples in 2.7 s.Collecting 3 more samples in 2.0 s.Collecting 2 more samples in 1.4 s.Collecting 1 more samples in 0.7 s.mean: 650.8321 ms, lower bound: 643.6666 ms, upper bound: 658.0508 ms, confidence: 0.950 std dev: 36.85077 ms, lower bound: 33.23028 ms, upper bound: 41.33089 ms, confidence: 0.950 variance introduced by outliers: 54.472% variance is severely inflated by outliers commits: 200000 retries: 818397 allocated bytes: 689656152 Running a subject "8/25000/stm-containers" Collecting 100 more samples in 12.1 s.Collecting 99 more samples in 12.0 s.Collecting 98 more samples in 11.8 s.Collecting 97 more samples in 11.7 s.Collecting 96 more samples in 11.6 s.Collecting 95 more samples in 11.5 s.Collecting 94 more samples in 11.4 s.Collecting 93 more samples in 11.2 s.Collecting 92 more samples in 11.1 s.Collecting 91 more samples in 11.0 s.Collecting 90 more samples in 10.9 s.Collecting 89 more samples in 10.7 s.Collecting 88 more samples in 10.6 s.Collecting 87 more samples in 10.5 s.Collecting 86 more samples in 10.4 s.Collecting 85 more samples in 10.3 s.Collecting 84 more samples in 10.1 s.Collecting 83 more samples in 10.0 s.Collecting 82 more samples in 9.9 s.Collecting 81 more samples in 9.8 s.Collecting 80 more samples in 9.7 s.Collecting 79 more samples in 9.5 s.Collecting 78 more samples in 9.4 s.Collecting 77 more samples in 9.3 s.Collecting 76 more samples in 9.2 s.Collecting 75 more samples in 9.1 s.Collecting 74 more samples in 8.9 s.Collecting 73 more samples in 8.8 s.Collecting 72 more samples in 8.7 s.Collecting 71 more samples in 8.6 s.Collecting 70 more samples in 8.5 s.Collecting 69 more samples in 8.3 s.Collecting 68 more samples in 8.2 s.Collecting 67 more samples in 8.1 s.Collecting 66 more samples in 8.0 s.Collecting 65 more samples in 7.8 s.Collecting 64 more samples in 7.7 s.Collecting 63 more samples in 7.6 s.Collecting 62 more samples in 7.5 s.Collecting 61 more samples in 7.4 s.Collecting 60 more samples in 7.2 s.Collecting 59 more samples in 7.1 s.Collecting 58 more samples in 7.0 s.Collecting 57 more samples in 6.9 s.Collecting 56 more samples in 6.8 s.Collecting 55 more samples in 6.6 s.Collecting 54 more samples in 6.5 s.Collecting 53 more samples in 6.4 s.Collecting 52 more samples in 6.3 s.Collecting 51 more samples in 6.2 s.Collecting 50 more samples in 6.0 s.Collecting 49 more samples in 5.9 s.Collecting 48 more samples in 5.8 s.Collecting 47 more samples in 5.7 s.Collecting 46 more samples in 5.6 s.Collecting 45 more samples in 5.4 s.Collecting 44 more samples in 5.3 s.Collecting 43 more samples in 5.2 s.Collecting 42 more samples in 5.1 s.Collecting 41 more samples in 5.0 s.Collecting 40 more samples in 4.8 s.Collecting 39 more samples in 4.7 s.Collecting 38 more samples in 4.6 s.Collecting 37 more samples in 4.5 s.Collecting 36 more samples in 4.3 s.Collecting 35 more samples in 4.2 s.Collecting 34 more samples in 4.1 s.Collecting 33 more samples in 4.0 s.Collecting 32 more samples in 3.9 s.Collecting 31 more samples in 3.7 s.Collecting 30 more samples in 3.6 s.Collecting 29 more samples in 3.5 s.Collecting 28 more samples in 3.4 s.Collecting 27 more samples in 3.3 s.Collecting 26 more samples in 3.1 s.Collecting 25 more samples in 3.0 s.Collecting 24 more samples in 2.9 s.Collecting 23 more samples in 2.8 s.Collecting 22 more samples in 2.7 s.Collecting 21 more samples in 2.5 s.Collecting 20 more samples in 2.4 s.Collecting 19 more samples in 2.3 s.Collecting 18 more samples in 2.2 s.Collecting 17 more samples in 2.1 s.Collecting 16 more samples in 1.9 s.Collecting 15 more samples in 1.8 s.Collecting 14 more samples in 1.7 s.Collecting 13 more samples in 1.6 s.Collecting 12 more samples in 1.4 s.Collecting 11 more samples in 1.3 s.Collecting 10 more samples in 1.2 s.Collecting 9 more samples in 1.1 s.Collecting 8 more samples in 1.0 s.Collecting 7 more samples in 0.8 s.Collecting 6 more samples in 0.7 s.Collecting 5 more samples in 0.6 s.Collecting 4 more samples in 0.5 s.Collecting 3 more samples in 0.4 s.Collecting 2 more samples in 0.2 s.Collecting 1 more samples in 0.1 s.mean: 120.3560 ms, lower bound: 119.2893 ms, upper bound: 122.2825 ms, confidence: 0.950 std dev: 7.134595 ms, lower bound: 4.595765 ms, upper bound: 13.40137 ms, confidence: 0.950 found 3 outliers among 100 samples (3.0%) 2 (2.0%) high mild 1 (1.0%) high severe variance introduced by outliers: 56.504% variance is severely inflated by outliers commits: 200000 retries: 404 allocated bytes: 260274544 Running a subject "8/25000/ttrie" Collecting 100 more samples in 5.1 s.Collecting 99 more samples in 5.0 s.Collecting 98 more samples in 5.0 s.Collecting 97 more samples in 4.9 s.Collecting 96 more samples in 4.9 s.Collecting 95 more samples in 4.8 s.Collecting 94 more samples in 4.8 s.Collecting 93 more samples in 4.7 s.Collecting 92 more samples in 4.7 s.Collecting 91 more samples in 4.6 s.Collecting 90 more samples in 4.6 s.Collecting 89 more samples in 4.5 s.Collecting 88 more samples in 4.5 s.Collecting 87 more samples in 4.4 s.Collecting 86 more samples in 4.4 s.Collecting 85 more samples in 4.3 s.Collecting 84 more samples in 4.3 s.Collecting 83 more samples in 4.2 s.Collecting 82 more samples in 4.2 s.Collecting 81 more samples in 4.1 s.Collecting 80 more samples in 4.1 s.Collecting 79 more samples in 4.0 s.Collecting 78 more samples in 4.0 s.Collecting 77 more samples in 3.9 s.Collecting 76 more samples in 3.9 s.Collecting 75 more samples in 3.8 s.Collecting 74 more samples in 3.8 s.Collecting 73 more samples in 3.7 s.Collecting 72 more samples in 3.7 s.Collecting 71 more samples in 3.6 s.Collecting 70 more samples in 3.6 s.Collecting 69 more samples in 3.5 s.Collecting 68 more samples in 3.4 s.Collecting 67 more samples in 3.4 s.Collecting 66 more samples in 3.3 s.Collecting 65 more samples in 3.3 s.Collecting 64 more samples in 3.2 s.Collecting 63 more samples in 3.2 s.Collecting 62 more samples in 3.1 s.Collecting 61 more samples in 3.1 s.Collecting 60 more samples in 3.0 s.Collecting 59 more samples in 3.0 s.Collecting 58 more samples in 2.9 s.Collecting 57 more samples in 2.9 s.Collecting 56 more samples in 2.8 s.Collecting 55 more samples in 2.8 s.Collecting 54 more samples in 2.7 s.Collecting 53 more samples in 2.7 s.Collecting 52 more samples in 2.6 s.Collecting 51 more samples in 2.6 s.Collecting 50 more samples in 2.5 s.Collecting 49 more samples in 2.5 s.Collecting 48 more samples in 2.4 s.Collecting 47 more samples in 2.4 s.Collecting 46 more samples in 2.3 s.Collecting 45 more samples in 2.3 s.Collecting 44 more samples in 2.2 s.Collecting 43 more samples in 2.2 s.Collecting 42 more samples in 2.1 s.Collecting 41 more samples in 2.1 s.Collecting 40 more samples in 2.0 s.Collecting 39 more samples in 2.0 s.Collecting 38 more samples in 1.9 s.Collecting 37 more samples in 1.9 s.Collecting 36 more samples in 1.8 s.Collecting 35 more samples in 1.8 s.Collecting 34 more samples in 1.7 s.Collecting 33 more samples in 1.7 s.Collecting 32 more samples in 1.6 s.Collecting 31 more samples in 1.6 s.Collecting 30 more samples in 1.5 s.Collecting 29 more samples in 1.5 s.Collecting 28 more samples in 1.4 s.Collecting 27 more samples in 1.4 s.Collecting 26 more samples in 1.3 s.Collecting 25 more samples in 1.3 s.Collecting 24 more samples in 1.2 s.Collecting 23 more samples in 1.2 s.Collecting 22 more samples in 1.1 s.Collecting 21 more samples in 1.1 s.Collecting 20 more samples in 1.0 s.Collecting 19 more samples in 1.0 s.Collecting 18 more samples in 0.9 s.Collecting 17 more samples in 0.9 s.Collecting 16 more samples in 0.8 s.Collecting 15 more samples in 0.8 s.Collecting 14 more samples in 0.7 s.Collecting 13 more samples in 0.7 s.Collecting 12 more samples in 0.6 s.Collecting 11 more samples in 0.6 s.Collecting 10 more samples in 0.5 s.Collecting 9 more samples in 0.5 s.Collecting 8 more samples in 0.4 s.Collecting 7 more samples in 0.4 s.Collecting 6 more samples in 0.3 s.Collecting 5 more samples in 0.3 s.Collecting 4 more samples in 0.2 s.Collecting 3 more samples in 0.2 s.Collecting 2 more samples in 0.1 s.Collecting 1 more samples in 0.1 s.mean: 51.53505 ms, lower bound: 49.86711 ms, upper bound: 57.67485 ms, confidence: 0.950 std dev: 14.34351 ms, lower bound: 2.646091 ms, upper bound: 32.77588 ms, confidence: 0.950 found 5 outliers among 100 samples (5.0%) 2 (2.0%) high mild 3 (3.0%) high severe variance introduced by outliers: 96.810% variance is severely inflated by outliers commits: 200000 retries: 0 allocated bytes: 70030320 Running a subject "10/20000/unordered-containers" Collecting 99 more samples in 74.5 s.Collecting 98 more samples in 73.8 s.Collecting 97 more samples in 73.0 s.Collecting 96 more samples in 72.3 s.Collecting 95 more samples in 71.5 s.Collecting 94 more samples in 70.7 s.Collecting 93 more samples in 70.0 s.Collecting 92 more samples in 69.2 s.Collecting 91 more samples in 68.5 s.Collecting 90 more samples in 67.7 s.Collecting 89 more samples in 67.0 s.Collecting 88 more samples in 66.2 s.Collecting 87 more samples in 65.5 s.Collecting 86 more samples in 64.7 s.Collecting 85 more samples in 64.0 s.Collecting 84 more samples in 63.2 s.Collecting 83 more samples in 62.5 s.Collecting 82 more samples in 61.7 s.Collecting 81 more samples in 61.0 s.Collecting 80 more samples in 60.2 s.Collecting 79 more samples in 59.5 s.Collecting 78 more samples in 58.7 s.Collecting 77 more samples in 58.0 s.Collecting 76 more samples in 57.2 s.Collecting 75 more samples in 56.4 s.Collecting 74 more samples in 55.7 s.Collecting 73 more samples in 54.9 s.Collecting 72 more samples in 54.2 s.Collecting 71 more samples in 53.4 s.Collecting 70 more samples in 52.7 s.Collecting 69 more samples in 51.9 s.Collecting 68 more samples in 51.2 s.Collecting 67 more samples in 50.4 s.Collecting 66 more samples in 49.7 s.Collecting 65 more samples in 48.9 s.Collecting 64 more samples in 48.2 s.Collecting 63 more samples in 47.4 s.Collecting 62 more samples in 46.7 s.Collecting 61 more samples in 45.9 s.Collecting 60 more samples in 45.2 s.Collecting 59 more samples in 44.4 s.Collecting 58 more samples in 43.7 s.Collecting 57 more samples in 42.9 s.Collecting 56 more samples in 42.1 s.Collecting 55 more samples in 41.4 s.Collecting 54 more samples in 40.6 s.Collecting 53 more samples in 39.9 s.Collecting 52 more samples in 39.1 s.Collecting 51 more samples in 38.4 s.Collecting 50 more samples in 37.6 s.Collecting 49 more samples in 36.9 s.Collecting 48 more samples in 36.1 s.Collecting 47 more samples in 35.4 s.Collecting 46 more samples in 34.6 s.Collecting 45 more samples in 33.9 s.Collecting 44 more samples in 33.1 s.Collecting 43 more samples in 32.4 s.Collecting 42 more samples in 31.6 s.Collecting 41 more samples in 30.9 s.Collecting 40 more samples in 30.1 s.Collecting 39 more samples in 29.4 s.Collecting 38 more samples in 28.6 s.Collecting 37 more samples in 27.8 s.Collecting 36 more samples in 27.1 s.Collecting 35 more samples in 26.3 s.Collecting 34 more samples in 25.6 s.Collecting 33 more samples in 24.8 s.Collecting 32 more samples in 24.1 s.Collecting 31 more samples in 23.3 s.Collecting 30 more samples in 22.6 s.Collecting 29 more samples in 21.8 s.Collecting 28 more samples in 21.1 s.Collecting 27 more samples in 20.3 s.Collecting 26 more samples in 19.6 s.Collecting 25 more samples in 18.8 s.Collecting 24 more samples in 18.1 s.Collecting 23 more samples in 17.3 s.Collecting 22 more samples in 16.6 s.Collecting 21 more samples in 15.8 s.Collecting 20 more samples in 15.1 s.Collecting 19 more samples in 14.3 s.Collecting 18 more samples in 13.5 s.Collecting 17 more samples in 12.8 s.Collecting 16 more samples in 12.0 s.Collecting 15 more samples in 11.3 s.Collecting 14 more samples in 10.5 s.Collecting 13 more samples in 9.8 s.Collecting 12 more samples in 9.0 s.Collecting 11 more samples in 8.3 s.Collecting 10 more samples in 7.5 s.Collecting 9 more samples in 6.8 s.Collecting 8 more samples in 6.0 s.Collecting 7 more samples in 5.3 s.Collecting 6 more samples in 4.5 s.Collecting 5 more samples in 3.8 s.Collecting 4 more samples in 3.0 s.Collecting 3 more samples in 2.3 s.Collecting 2 more samples in 1.5 s.Collecting 1 more samples in 0.8 s.mean: 721.5409 ms, lower bound: 713.3370 ms, upper bound: 730.4858 ms, confidence: 0.950 std dev: 44.14433 ms, lower bound: 37.03089 ms, upper bound: 59.08458 ms, confidence: 0.950 found 5 outliers among 100 samples (5.0%) 3 (3.0%) low mild 1 (1.0%) high severe variance introduced by outliers: 58.497% variance is severely inflated by outliers commits: 200000 retries: 842515 allocated bytes: 759260560 Running a subject "10/20000/stm-containers" Collecting 100 more samples in 10.0 s.Collecting 99 more samples in 9.9 s.Collecting 98 more samples in 9.8 s.Collecting 97 more samples in 9.7 s.Collecting 96 more samples in 9.6 s.Collecting 95 more samples in 9.5 s.Collecting 94 more samples in 9.4 s.Collecting 93 more samples in 9.3 s.Collecting 92 more samples in 9.2 s.Collecting 91 more samples in 9.1 s.Collecting 90 more samples in 9.0 s.Collecting 89 more samples in 8.9 s.Collecting 88 more samples in 8.8 s.Collecting 87 more samples in 8.7 s.Collecting 86 more samples in 8.6 s.Collecting 85 more samples in 8.5 s.Collecting 84 more samples in 8.4 s.Collecting 83 more samples in 8.3 s.Collecting 82 more samples in 8.2 s.Collecting 81 more samples in 8.1 s.Collecting 80 more samples in 8.0 s.Collecting 79 more samples in 7.9 s.Collecting 78 more samples in 7.8 s.Collecting 77 more samples in 7.7 s.Collecting 76 more samples in 7.6 s.Collecting 75 more samples in 7.5 s.Collecting 74 more samples in 7.4 s.Collecting 73 more samples in 7.3 s.Collecting 72 more samples in 7.2 s.Collecting 71 more samples in 7.1 s.Collecting 70 more samples in 7.0 s.Collecting 69 more samples in 6.9 s.Collecting 68 more samples in 6.8 s.Collecting 67 more samples in 6.7 s.Collecting 66 more samples in 6.6 s.Collecting 65 more samples in 6.5 s.Collecting 64 more samples in 6.4 s.Collecting 63 more samples in 6.3 s.Collecting 62 more samples in 6.2 s.Collecting 61 more samples in 6.1 s.Collecting 60 more samples in 6.0 s.Collecting 59 more samples in 5.9 s.Collecting 58 more samples in 5.8 s.Collecting 57 more samples in 5.7 s.Collecting 56 more samples in 5.6 s.Collecting 55 more samples in 5.5 s.Collecting 54 more samples in 5.4 s.Collecting 53 more samples in 5.3 s.Collecting 52 more samples in 5.2 s.Collecting 51 more samples in 5.1 s.Collecting 50 more samples in 5.0 s.Collecting 49 more samples in 4.9 s.Collecting 48 more samples in 4.8 s.Collecting 47 more samples in 4.7 s.Collecting 46 more samples in 4.6 s.Collecting 45 more samples in 4.5 s.Collecting 44 more samples in 4.4 s.Collecting 43 more samples in 4.3 s.Collecting 42 more samples in 4.2 s.Collecting 41 more samples in 4.1 s.Collecting 40 more samples in 4.0 s.Collecting 39 more samples in 3.9 s.Collecting 38 more samples in 3.8 s.Collecting 37 more samples in 3.7 s.Collecting 36 more samples in 3.6 s.Collecting 35 more samples in 3.5 s.Collecting 34 more samples in 3.4 s.Collecting 33 more samples in 3.3 s.Collecting 32 more samples in 3.2 s.Collecting 31 more samples in 3.1 s.Collecting 30 more samples in 3.0 s.Collecting 29 more samples in 2.9 s.Collecting 28 more samples in 2.8 s.Collecting 27 more samples in 2.7 s.Collecting 26 more samples in 2.6 s.Collecting 25 more samples in 2.5 s.Collecting 24 more samples in 2.4 s.Collecting 23 more samples in 2.3 s.Collecting 22 more samples in 2.2 s.Collecting 21 more samples in 2.1 s.Collecting 20 more samples in 2.0 s.Collecting 19 more samples in 1.9 s.Collecting 18 more samples in 1.8 s.Collecting 17 more samples in 1.7 s.Collecting 16 more samples in 1.6 s.Collecting 15 more samples in 1.5 s.Collecting 14 more samples in 1.4 s.Collecting 13 more samples in 1.3 s.Collecting 12 more samples in 1.2 s.Collecting 11 more samples in 1.1 s.Collecting 10 more samples in 1.0 s.Collecting 9 more samples in 0.9 s.Collecting 8 more samples in 0.8 s.Collecting 7 more samples in 0.7 s.Collecting 6 more samples in 0.6 s.Collecting 5 more samples in 0.5 s.Collecting 4 more samples in 0.4 s.Collecting 3 more samples in 0.3 s.Collecting 2 more samples in 0.2 s.Collecting 1 more samples in 0.1 s.mean: 94.46405 ms, lower bound: 93.12477 ms, upper bound: 96.46551 ms, confidence: 0.950 std dev: 8.227506 ms, lower bound: 6.040965 ms, upper bound: 12.45033 ms, confidence: 0.950 found 5 outliers among 100 samples (5.0%) 3 (3.0%) high mild 2 (2.0%) high severe variance introduced by outliers: 73.841% variance is severely inflated by outliers commits: 200000 retries: 521 allocated bytes: 260420424 Running a subject "10/20000/ttrie" Collecting 100 more samples in 4.0 s.Collecting 99 more samples in 4.0 s.Collecting 98 more samples in 4.0 s.Collecting 97 more samples in 3.9 s.Collecting 96 more samples in 3.9 s.Collecting 95 more samples in 3.8 s.Collecting 94 more samples in 3.8 s.Collecting 93 more samples in 3.7 s.Collecting 92 more samples in 3.7 s.Collecting 91 more samples in 3.7 s.Collecting 90 more samples in 3.6 s.Collecting 89 more samples in 3.6 s.Collecting 88 more samples in 3.5 s.Collecting 87 more samples in 3.5 s.Collecting 86 more samples in 3.5 s.Collecting 85 more samples in 3.4 s.Collecting 84 more samples in 3.4 s.Collecting 83 more samples in 3.3 s.Collecting 82 more samples in 3.3 s.Collecting 81 more samples in 3.3 s.Collecting 80 more samples in 3.2 s.Collecting 79 more samples in 3.2 s.Collecting 78 more samples in 3.1 s.Collecting 77 more samples in 3.1 s.Collecting 76 more samples in 3.1 s.Collecting 75 more samples in 3.0 s.Collecting 74 more samples in 3.0 s.Collecting 73 more samples in 2.9 s.Collecting 72 more samples in 2.9 s.Collecting 71 more samples in 2.9 s.Collecting 70 more samples in 2.8 s.Collecting 69 more samples in 2.8 s.Collecting 68 more samples in 2.7 s.Collecting 67 more samples in 2.7 s.Collecting 66 more samples in 2.7 s.Collecting 65 more samples in 2.6 s.Collecting 64 more samples in 2.6 s.Collecting 63 more samples in 2.5 s.Collecting 62 more samples in 2.5 s.Collecting 61 more samples in 2.5 s.Collecting 60 more samples in 2.4 s.Collecting 59 more samples in 2.4 s.Collecting 58 more samples in 2.3 s.Collecting 57 more samples in 2.3 s.Collecting 56 more samples in 2.3 s.Collecting 55 more samples in 2.2 s.Collecting 54 more samples in 2.2 s.Collecting 53 more samples in 2.1 s.Collecting 52 more samples in 2.1 s.Collecting 51 more samples in 2.1 s.Collecting 50 more samples in 2.0 s.Collecting 49 more samples in 2.0 s.Collecting 48 more samples in 1.9 s.Collecting 47 more samples in 1.9 s.Collecting 46 more samples in 1.9 s.Collecting 45 more samples in 1.8 s.Collecting 44 more samples in 1.8 s.Collecting 43 more samples in 1.7 s.Collecting 42 more samples in 1.7 s.Collecting 41 more samples in 1.7 s.Collecting 40 more samples in 1.6 s.Collecting 39 more samples in 1.6 s.Collecting 38 more samples in 1.5 s.Collecting 37 more samples in 1.5 s.Collecting 36 more samples in 1.5 s.Collecting 35 more samples in 1.4 s.Collecting 34 more samples in 1.4 s.Collecting 33 more samples in 1.3 s.Collecting 32 more samples in 1.3 s.Collecting 31 more samples in 1.2 s.Collecting 30 more samples in 1.2 s.Collecting 29 more samples in 1.2 s.Collecting 28 more samples in 1.1 s.Collecting 27 more samples in 1.1 s.Collecting 26 more samples in 1.0 s.Collecting 25 more samples in 1.0 s.Collecting 24 more samples in 1.0 s.Collecting 23 more samples in 0.9 s.Collecting 22 more samples in 0.9 s.Collecting 21 more samples in 0.8 s.Collecting 20 more samples in 0.8 s.Collecting 19 more samples in 0.8 s.Collecting 18 more samples in 0.7 s.Collecting 17 more samples in 0.7 s.Collecting 16 more samples in 0.6 s.Collecting 15 more samples in 0.6 s.Collecting 14 more samples in 0.6 s.Collecting 13 more samples in 0.5 s.Collecting 12 more samples in 0.5 s.Collecting 11 more samples in 0.4 s.Collecting 10 more samples in 0.4 s.Collecting 9 more samples in 0.4 s.Collecting 8 more samples in 0.3 s.Collecting 7 more samples in 0.3 s.Collecting 6 more samples in 0.2 s.Collecting 5 more samples in 0.2 s.Collecting 4 more samples in 0.2 s.Collecting 3 more samples in 0.1 s.Collecting 2 more samples in 0.1 s.Collecting 1 more samples in 0.0 s.mean: 41.59957 ms, lower bound: 40.91017 ms, upper bound: 42.86647 ms, confidence: 0.950 std dev: 4.664363 ms, lower bound: 2.816095 ms, upper bound: 7.466691 ms, confidence: 0.950 found 7 outliers among 100 samples (7.0%) 3 (3.0%) high mild 4 (4.0%) high severe variance introduced by outliers: 83.123% variance is severely inflated by outliers commits: 200000 retries: 0 allocated bytes: 70044200 Running a subject "12/16666/unordered-containers" Collecting 99 more samples in 65.9 s.Collecting 98 more samples in 65.2 s.Collecting 97 more samples in 64.6 s.Collecting 96 more samples in 63.9 s.Collecting 95 more samples in 63.3 s.Collecting 94 more samples in 62.6 s.Collecting 93 more samples in 61.9 s.Collecting 92 more samples in 61.3 s.Collecting 91 more samples in 60.6 s.Collecting 90 more samples in 59.9 s.Collecting 89 more samples in 59.3 s.Collecting 88 more samples in 58.6 s.Collecting 87 more samples in 57.9 s.Collecting 86 more samples in 57.3 s.Collecting 85 more samples in 56.6 s.Collecting 84 more samples in 55.9 s.Collecting 83 more samples in 55.3 s.Collecting 82 more samples in 54.6 s.Collecting 81 more samples in 53.9 s.Collecting 80 more samples in 53.3 s.Collecting 79 more samples in 52.6 s.Collecting 78 more samples in 51.9 s.Collecting 77 more samples in 51.3 s.Collecting 76 more samples in 50.6 s.Collecting 75 more samples in 49.9 s.Collecting 74 more samples in 49.3 s.Collecting 73 more samples in 48.6 s.Collecting 72 more samples in 47.9 s.Collecting 71 more samples in 47.3 s.Collecting 70 more samples in 46.6 s.Collecting 69 more samples in 45.9 s.Collecting 68 more samples in 45.3 s.Collecting 67 more samples in 44.6 s.Collecting 66 more samples in 43.9 s.Collecting 65 more samples in 43.3 s.Collecting 64 more samples in 42.6 s.Collecting 63 more samples in 41.9 s.Collecting 62 more samples in 41.3 s.Collecting 61 more samples in 40.6 s.Collecting 60 more samples in 39.9 s.Collecting 59 more samples in 39.3 s.Collecting 58 more samples in 38.6 s.Collecting 57 more samples in 38.0 s.Collecting 56 more samples in 37.3 s.Collecting 55 more samples in 36.6 s.Collecting 54 more samples in 36.0 s.Collecting 53 more samples in 35.3 s.Collecting 52 more samples in 34.6 s.Collecting 51 more samples in 34.0 s.Collecting 50 more samples in 33.3 s.Collecting 49 more samples in 32.6 s.Collecting 48 more samples in 32.0 s.Collecting 47 more samples in 31.3 s.Collecting 46 more samples in 30.6 s.Collecting 45 more samples in 30.0 s.Collecting 44 more samples in 29.3 s.Collecting 43 more samples in 28.6 s.Collecting 42 more samples in 28.0 s.Collecting 41 more samples in 27.3 s.Collecting 40 more samples in 26.6 s.Collecting 39 more samples in 26.0 s.Collecting 38 more samples in 25.3 s.Collecting 37 more samples in 24.6 s.Collecting 36 more samples in 24.0 s.Collecting 35 more samples in 23.3 s.Collecting 34 more samples in 22.6 s.Collecting 33 more samples in 22.0 s.Collecting 32 more samples in 21.3 s.Collecting 31 more samples in 20.6 s.Collecting 30 more samples in 20.0 s.Collecting 29 more samples in 19.3 s.Collecting 28 more samples in 18.6 s.Collecting 27 more samples in 18.0 s.Collecting 26 more samples in 17.3 s.Collecting 25 more samples in 16.6 s.Collecting 24 more samples in 16.0 s.Collecting 23 more samples in 15.3 s.Collecting 22 more samples in 14.6 s.Collecting 21 more samples in 14.0 s.Collecting 20 more samples in 13.3 s.Collecting 19 more samples in 12.7 s.Collecting 18 more samples in 12.0 s.Collecting 17 more samples in 11.3 s.Collecting 16 more samples in 10.7 s.Collecting 15 more samples in 10.0 s.Collecting 14 more samples in 9.3 s.Collecting 13 more samples in 8.7 s.Collecting 12 more samples in 8.0 s.Collecting 11 more samples in 7.3 s.Collecting 10 more samples in 6.7 s.Collecting 9 more samples in 6.0 s.Collecting 8 more samples in 5.3 s.Collecting 7 more samples in 4.7 s.Collecting 6 more samples in 4.0 s.Collecting 5 more samples in 3.3 s.Collecting 4 more samples in 2.7 s.Collecting 3 more samples in 2.0 s.Collecting 2 more samples in 1.3 s.Collecting 1 more samples in 0.7 s.mean: 748.9600 ms, lower bound: 734.1706 ms, upper bound: 763.9500 ms, confidence: 0.950 std dev: 76.51008 ms, lower bound: 68.06738 ms, upper bound: 90.19215 ms, confidence: 0.950 found 1 outliers among 100 samples (1.0%) variance introduced by outliers: 80.018% variance is severely inflated by outliers commits: 200000 retries: 947512 allocated bytes: 812602792 Running a subject "12/16666/stm-containers" Collecting 100 more samples in 7.5 s.Collecting 99 more samples in 7.4 s.Collecting 98 more samples in 7.3 s.Collecting 97 more samples in 7.2 s.Collecting 96 more samples in 7.2 s.Collecting 95 more samples in 7.1 s.Collecting 94 more samples in 7.0 s.Collecting 93 more samples in 6.9 s.Collecting 92 more samples in 6.9 s.Collecting 91 more samples in 6.8 s.Collecting 90 more samples in 6.7 s.Collecting 89 more samples in 6.6 s.Collecting 88 more samples in 6.6 s.Collecting 87 more samples in 6.5 s.Collecting 86 more samples in 6.4 s.Collecting 85 more samples in 6.3 s.Collecting 84 more samples in 6.3 s.Collecting 83 more samples in 6.2 s.Collecting 82 more samples in 6.1 s.Collecting 81 more samples in 6.0 s.Collecting 80 more samples in 6.0 s.Collecting 79 more samples in 5.9 s.Collecting 78 more samples in 5.8 s.Collecting 77 more samples in 5.7 s.Collecting 76 more samples in 5.7 s.Collecting 75 more samples in 5.6 s.Collecting 74 more samples in 5.5 s.Collecting 73 more samples in 5.4 s.Collecting 72 more samples in 5.4 s.Collecting 71 more samples in 5.3 s.Collecting 70 more samples in 5.2 s.Collecting 69 more samples in 5.1 s.Collecting 68 more samples in 5.1 s.Collecting 67 more samples in 5.0 s.Collecting 66 more samples in 4.9 s.Collecting 65 more samples in 4.8 s.Collecting 64 more samples in 4.8 s.Collecting 63 more samples in 4.7 s.Collecting 62 more samples in 4.6 s.Collecting 61 more samples in 4.5 s.Collecting 60 more samples in 4.5 s.Collecting 59 more samples in 4.4 s.Collecting 58 more samples in 4.3 s.Collecting 57 more samples in 4.2 s.Collecting 56 more samples in 4.2 s.Collecting 55 more samples in 4.1 s.Collecting 54 more samples in 4.0 s.Collecting 53 more samples in 3.9 s.Collecting 52 more samples in 3.9 s.Collecting 51 more samples in 3.8 s.Collecting 50 more samples in 3.7 s.Collecting 49 more samples in 3.7 s.Collecting 48 more samples in 3.6 s.Collecting 47 more samples in 3.5 s.Collecting 46 more samples in 3.4 s.Collecting 45 more samples in 3.4 s.Collecting 44 more samples in 3.3 s.Collecting 43 more samples in 3.2 s.Collecting 42 more samples in 3.1 s.Collecting 41 more samples in 3.1 s.Collecting 40 more samples in 3.0 s.Collecting 39 more samples in 2.9 s.Collecting 38 more samples in 2.8 s.Collecting 37 more samples in 2.8 s.Collecting 36 more samples in 2.7 s.Collecting 35 more samples in 2.6 s.Collecting 34 more samples in 2.5 s.Collecting 33 more samples in 2.5 s.Collecting 32 more samples in 2.4 s.Collecting 31 more samples in 2.3 s.Collecting 30 more samples in 2.2 s.Collecting 29 more samples in 2.2 s.Collecting 28 more samples in 2.1 s.Collecting 27 more samples in 2.0 s.Collecting 26 more samples in 1.9 s.Collecting 25 more samples in 1.9 s.Collecting 24 more samples in 1.8 s.Collecting 23 more samples in 1.7 s.Collecting 22 more samples in 1.6 s.Collecting 21 more samples in 1.6 s.Collecting 20 more samples in 1.5 s.Collecting 19 more samples in 1.4 s.Collecting 18 more samples in 1.3 s.Collecting 17 more samples in 1.3 s.Collecting 16 more samples in 1.2 s.Collecting 15 more samples in 1.1 s.Collecting 14 more samples in 1.0 s.Collecting 13 more samples in 1.0 s.Collecting 12 more samples in 0.9 s.Collecting 11 more samples in 0.8 s.Collecting 10 more samples in 0.7 s.Collecting 9 more samples in 0.7 s.Collecting 8 more samples in 0.6 s.Collecting 7 more samples in 0.5 s.Collecting 6 more samples in 0.4 s.Collecting 5 more samples in 0.4 s.Collecting 4 more samples in 0.3 s.Collecting 3 more samples in 0.2 s.Collecting 2 more samples in 0.1 s.Collecting 1 more samples in 0.1 s.mean: 84.63929 ms, lower bound: 81.86586 ms, upper bound: 92.25093 ms, confidence: 0.950 std dev: 21.71398 ms, lower bound: 9.650454 ms, upper bound: 46.09558 ms, confidence: 0.950 found 5 outliers among 100 samples (5.0%) 4 (4.0%) high severe variance introduced by outliers: 96.777% variance is severely inflated by outliers commits: 200000 retries: 720 allocated bytes: 260718440 Running a subject "12/16666/ttrie" Collecting 100 more samples in 3.3 s.Collecting 99 more samples in 3.2 s.Collecting 98 more samples in 3.2 s.Collecting 97 more samples in 3.2 s.Collecting 96 more samples in 3.1 s.Collecting 95 more samples in 3.1 s.Collecting 94 more samples in 3.1 s.Collecting 93 more samples in 3.0 s.Collecting 92 more samples in 3.0 s.Collecting 91 more samples in 3.0 s.Collecting 90 more samples in 2.9 s.Collecting 89 more samples in 2.9 s.Collecting 88 more samples in 2.9 s.Collecting 87 more samples in 2.8 s.Collecting 86 more samples in 2.8 s.Collecting 85 more samples in 2.8 s.Collecting 84 more samples in 2.7 s.Collecting 83 more samples in 2.7 s.Collecting 82 more samples in 2.7 s.Collecting 81 more samples in 2.7 s.Collecting 80 more samples in 2.6 s.Collecting 79 more samples in 2.6 s.Collecting 78 more samples in 2.6 s.Collecting 77 more samples in 2.5 s.Collecting 76 more samples in 2.5 s.Collecting 75 more samples in 2.5 s.Collecting 74 more samples in 2.4 s.Collecting 73 more samples in 2.4 s.Collecting 72 more samples in 2.4 s.Collecting 71 more samples in 2.3 s.Collecting 70 more samples in 2.3 s.Collecting 69 more samples in 2.3 s.Collecting 68 more samples in 2.2 s.Collecting 67 more samples in 2.2 s.Collecting 66 more samples in 2.2 s.Collecting 65 more samples in 2.1 s.Collecting 64 more samples in 2.1 s.Collecting 63 more samples in 2.1 s.Collecting 62 more samples in 2.0 s.Collecting 61 more samples in 2.0 s.Collecting 60 more samples in 2.0 s.Collecting 59 more samples in 1.9 s.Collecting 58 more samples in 1.9 s.Collecting 57 more samples in 1.9 s.Collecting 56 more samples in 1.8 s.Collecting 55 more samples in 1.8 s.Collecting 54 more samples in 1.8 s.Collecting 53 more samples in 1.7 s.Collecting 52 more samples in 1.7 s.Collecting 51 more samples in 1.7 s.Collecting 50 more samples in 1.6 s.Collecting 49 more samples in 1.6 s.Collecting 48 more samples in 1.6 s.Collecting 47 more samples in 1.5 s.Collecting 46 more samples in 1.5 s.Collecting 45 more samples in 1.5 s.Collecting 44 more samples in 1.4 s.Collecting 43 more samples in 1.4 s.Collecting 42 more samples in 1.4 s.Collecting 41 more samples in 1.3 s.Collecting 40 more samples in 1.3 s.Collecting 39 more samples in 1.3 s.Collecting 38 more samples in 1.2 s.Collecting 37 more samples in 1.2 s.Collecting 36 more samples in 1.2 s.Collecting 35 more samples in 1.1 s.Collecting 34 more samples in 1.1 s.Collecting 33 more samples in 1.1 s.Collecting 32 more samples in 1.0 s.Collecting 31 more samples in 1.0 s.Collecting 30 more samples in 1.0 s.Collecting 29 more samples in 0.9 s.Collecting 28 more samples in 0.9 s.Collecting 27 more samples in 0.9 s.Collecting 26 more samples in 0.9 s.Collecting 25 more samples in 0.8 s.Collecting 24 more samples in 0.8 s.Collecting 23 more samples in 0.8 s.Collecting 22 more samples in 0.7 s.Collecting 21 more samples in 0.7 s.Collecting 20 more samples in 0.7 s.Collecting 19 more samples in 0.6 s.Collecting 18 more samples in 0.6 s.Collecting 17 more samples in 0.6 s.Collecting 16 more samples in 0.5 s.Collecting 15 more samples in 0.5 s.Collecting 14 more samples in 0.5 s.Collecting 13 more samples in 0.4 s.Collecting 12 more samples in 0.4 s.Collecting 11 more samples in 0.4 s.Collecting 10 more samples in 0.3 s.Collecting 9 more samples in 0.3 s.Collecting 8 more samples in 0.3 s.Collecting 7 more samples in 0.2 s.Collecting 6 more samples in 0.2 s.Collecting 5 more samples in 0.2 s.Collecting 4 more samples in 0.1 s.Collecting 3 more samples in 0.1 s.Collecting 2 more samples in 0.1 s.Collecting 1 more samples in 0.0 s.mean: 35.75546 ms, lower bound: 34.92368 ms, upper bound: 37.36314 ms, confidence: 0.950 std dev: 5.707362 ms, lower bound: 3.610799 ms, upper bound: 9.920841 ms, confidence: 0.950 found 15 outliers among 100 samples (15.0%) 6 (6.0%) high mild 9 (9.0%) high severe variance introduced by outliers: 91.481% variance is severely inflated by outliers commits: 200000 retries: 0 allocated bytes: 70046912 Running a subject "14/14285/unordered-containers" Collecting 99 more samples in 77.7 s.Collecting 98 more samples in 76.9 s.Collecting 97 more samples in 76.1 s.Collecting 96 more samples in 75.3 s.Collecting 95 more samples in 74.5 s.Collecting 94 more samples in 73.7 s.Collecting 93 more samples in 73.0 s.Collecting 92 more samples in 72.2 s.Collecting 91 more samples in 71.4 s.Collecting 90 more samples in 70.6 s.Collecting 89 more samples in 69.8 s.Collecting 88 more samples in 69.0 s.Collecting 87 more samples in 68.3 s.Collecting 86 more samples in 67.5 s.Collecting 85 more samples in 66.7 s.Collecting 84 more samples in 65.9 s.Collecting 83 more samples in 65.1 s.Collecting 82 more samples in 64.3 s.Collecting 81 more samples in 63.5 s.Collecting 80 more samples in 62.8 s.Collecting 79 more samples in 62.0 s.Collecting 78 more samples in 61.2 s.Collecting 77 more samples in 60.4 s.Collecting 76 more samples in 59.6 s.Collecting 75 more samples in 58.8 s.Collecting 74 more samples in 58.1 s.Collecting 73 more samples in 57.3 s.Collecting 72 more samples in 56.5 s.Collecting 71 more samples in 55.7 s.Collecting 70 more samples in 54.9 s.Collecting 69 more samples in 54.1 s.Collecting 68 more samples in 53.3 s.Collecting 67 more samples in 52.6 s.Collecting 66 more samples in 51.8 s.Collecting 65 more samples in 51.0 s.Collecting 64 more samples in 50.2 s.Collecting 63 more samples in 49.4 s.Collecting 62 more samples in 48.6 s.Collecting 61 more samples in 47.9 s.Collecting 60 more samples in 47.1 s.Collecting 59 more samples in 46.3 s.Collecting 58 more samples in 45.5 s.Collecting 57 more samples in 44.7 s.Collecting 56 more samples in 43.9 s.Collecting 55 more samples in 43.1 s.Collecting 54 more samples in 42.4 s.Collecting 53 more samples in 41.6 s.Collecting 52 more samples in 40.8 s.Collecting 51 more samples in 40.0 s.Collecting 50 more samples in 39.2 s.Collecting 49 more samples in 38.4 s.Collecting 48 more samples in 37.7 s.Collecting 47 more samples in 36.9 s.Collecting 46 more samples in 36.1 s.Collecting 45 more samples in 35.3 s.Collecting 44 more samples in 34.5 s.Collecting 43 more samples in 33.7 s.Collecting 42 more samples in 32.9 s.Collecting 41 more samples in 32.2 s.Collecting 40 more samples in 31.4 s.Collecting 39 more samples in 30.6 s.Collecting 38 more samples in 29.8 s.Collecting 37 more samples in 29.0 s.Collecting 36 more samples in 28.2 s.Collecting 35 more samples in 27.5 s.Collecting 34 more samples in 26.7 s.Collecting 33 more samples in 25.9 s.Collecting 32 more samples in 25.1 s.Collecting 31 more samples in 24.3 s.Collecting 30 more samples in 23.5 s.Collecting 29 more samples in 22.8 s.Collecting 28 more samples in 22.0 s.Collecting 27 more samples in 21.2 s.Collecting 26 more samples in 20.4 s.Collecting 25 more samples in 19.6 s.Collecting 24 more samples in 18.8 s.Collecting 23 more samples in 18.0 s.Collecting 22 more samples in 17.3 s.Collecting 21 more samples in 16.5 s.Collecting 20 more samples in 15.7 s.Collecting 19 more samples in 14.9 s.Collecting 18 more samples in 14.1 s.Collecting 17 more samples in 13.3 s.Collecting 16 more samples in 12.6 s.Collecting 15 more samples in 11.8 s.Collecting 14 more samples in 11.0 s.Collecting 13 more samples in 10.2 s.Collecting 12 more samples in 9.4 s.Collecting 11 more samples in 8.6 s.Collecting 10 more samples in 7.8 s.Collecting 9 more samples in 7.1 s.Collecting 8 more samples in 6.3 s.Collecting 7 more samples in 5.5 s.Collecting 6 more samples in 4.7 s.Collecting 5 more samples in 3.9 s.Collecting 4 more samples in 3.1 s.Collecting 3 more samples in 2.4 s.Collecting 2 more samples in 1.6 s.Collecting 1 more samples in 0.8 s.mean: 813.8393 ms, lower bound: 799.1822 ms, upper bound: 828.1597 ms, confidence: 0.950 std dev: 73.91416 ms, lower bound: 64.68378 ms, upper bound: 88.06643 ms, confidence: 0.950 found 2 outliers among 100 samples (2.0%) variance introduced by outliers: 75.877% variance is severely inflated by outliers commits: 200000 retries: 1110176 allocated bytes: 915938552 Running a subject "14/14285/stm-containers" Collecting 100 more samples in 7.5 s.Collecting 99 more samples in 7.4 s.Collecting 98 more samples in 7.3 s.Collecting 97 more samples in 7.3 s.Collecting 96 more samples in 7.2 s.Collecting 95 more samples in 7.1 s.Collecting 94 more samples in 7.0 s.Collecting 93 more samples in 7.0 s.Collecting 92 more samples in 6.9 s.Collecting 91 more samples in 6.8 s.Collecting 90 more samples in 6.7 s.Collecting 89 more samples in 6.7 s.Collecting 88 more samples in 6.6 s.Collecting 87 more samples in 6.5 s.Collecting 86 more samples in 6.4 s.Collecting 85 more samples in 6.4 s.Collecting 84 more samples in 6.3 s.Collecting 83 more samples in 6.2 s.Collecting 82 more samples in 6.1 s.Collecting 81 more samples in 6.1 s.Collecting 80 more samples in 6.0 s.Collecting 79 more samples in 5.9 s.Collecting 78 more samples in 5.8 s.Collecting 77 more samples in 5.8 s.Collecting 76 more samples in 5.7 s.Collecting 75 more samples in 5.6 s.Collecting 74 more samples in 5.5 s.Collecting 73 more samples in 5.5 s.Collecting 72 more samples in 5.4 s.Collecting 71 more samples in 5.3 s.Collecting 70 more samples in 5.2 s.Collecting 69 more samples in 5.2 s.Collecting 68 more samples in 5.1 s.Collecting 67 more samples in 5.0 s.Collecting 66 more samples in 4.9 s.Collecting 65 more samples in 4.9 s.Collecting 64 more samples in 4.8 s.Collecting 63 more samples in 4.7 s.Collecting 62 more samples in 4.6 s.Collecting 61 more samples in 4.6 s.Collecting 60 more samples in 4.5 s.Collecting 59 more samples in 4.4 s.Collecting 58 more samples in 4.3 s.Collecting 57 more samples in 4.3 s.Collecting 56 more samples in 4.2 s.Collecting 55 more samples in 4.1 s.Collecting 54 more samples in 4.0 s.Collecting 53 more samples in 4.0 s.Collecting 52 more samples in 3.9 s.Collecting 51 more samples in 3.8 s.Collecting 50 more samples in 3.7 s.Collecting 49 more samples in 3.7 s.Collecting 48 more samples in 3.6 s.Collecting 47 more samples in 3.5 s.Collecting 46 more samples in 3.4 s.Collecting 45 more samples in 3.4 s.Collecting 44 more samples in 3.3 s.Collecting 43 more samples in 3.2 s.Collecting 42 more samples in 3.1 s.Collecting 41 more samples in 3.1 s.Collecting 40 more samples in 3.0 s.Collecting 39 more samples in 2.9 s.Collecting 38 more samples in 2.8 s.Collecting 37 more samples in 2.8 s.Collecting 36 more samples in 2.7 s.Collecting 35 more samples in 2.6 s.Collecting 34 more samples in 2.5 s.Collecting 33 more samples in 2.5 s.Collecting 32 more samples in 2.4 s.Collecting 31 more samples in 2.3 s.Collecting 30 more samples in 2.2 s.Collecting 29 more samples in 2.2 s.Collecting 28 more samples in 2.1 s.Collecting 27 more samples in 2.0 s.Collecting 26 more samples in 1.9 s.Collecting 25 more samples in 1.9 s.Collecting 24 more samples in 1.8 s.Collecting 23 more samples in 1.7 s.Collecting 22 more samples in 1.6 s.Collecting 21 more samples in 1.6 s.Collecting 20 more samples in 1.5 s.Collecting 19 more samples in 1.4 s.Collecting 18 more samples in 1.3 s.Collecting 17 more samples in 1.3 s.Collecting 16 more samples in 1.2 s.Collecting 15 more samples in 1.1 s.Collecting 14 more samples in 1.0 s.Collecting 13 more samples in 1.0 s.Collecting 12 more samples in 0.9 s.Collecting 11 more samples in 0.8 s.Collecting 10 more samples in 0.7 s.Collecting 9 more samples in 0.7 s.Collecting 8 more samples in 0.6 s.Collecting 7 more samples in 0.5 s.Collecting 6 more samples in 0.4 s.Collecting 5 more samples in 0.4 s.Collecting 4 more samples in 0.3 s.Collecting 3 more samples in 0.2 s.Collecting 2 more samples in 0.1 s.Collecting 1 more samples in 0.1 s.mean: 75.17666 ms, lower bound: 73.30458 ms, upper bound: 77.63156 ms, confidence: 0.950 std dev: 10.95322 ms, lower bound: 8.820691 ms, upper bound: 15.09427 ms, confidence: 0.950 found 5 outliers among 100 samples (5.0%) 4 (4.0%) high mild 1 (1.0%) high severe variance introduced by outliers: 89.404% variance is severely inflated by outliers commits: 200000 retries: 744 allocated bytes: 260957904 Running a subject "14/14285/ttrie" Collecting 100 more samples in 3.3 s.Collecting 99 more samples in 3.2 s.Collecting 98 more samples in 3.2 s.Collecting 97 more samples in 3.2 s.Collecting 96 more samples in 3.1 s.Collecting 95 more samples in 3.1 s.Collecting 94 more samples in 3.1 s.Collecting 93 more samples in 3.0 s.Collecting 92 more samples in 3.0 s.Collecting 91 more samples in 3.0 s.Collecting 90 more samples in 2.9 s.Collecting 89 more samples in 2.9 s.Collecting 88 more samples in 2.9 s.Collecting 87 more samples in 2.8 s.Collecting 86 more samples in 2.8 s.Collecting 85 more samples in 2.8 s.Collecting 84 more samples in 2.7 s.Collecting 83 more samples in 2.7 s.Collecting 82 more samples in 2.7 s.Collecting 81 more samples in 2.6 s.Collecting 80 more samples in 2.6 s.Collecting 79 more samples in 2.6 s.Collecting 78 more samples in 2.5 s.Collecting 77 more samples in 2.5 s.Collecting 76 more samples in 2.5 s.Collecting 75 more samples in 2.4 s.Collecting 74 more samples in 2.4 s.Collecting 73 more samples in 2.4 s.Collecting 72 more samples in 2.4 s.Collecting 71 more samples in 2.3 s.Collecting 70 more samples in 2.3 s.Collecting 69 more samples in 2.3 s.Collecting 68 more samples in 2.2 s.Collecting 67 more samples in 2.2 s.Collecting 66 more samples in 2.2 s.Collecting 65 more samples in 2.1 s.Collecting 64 more samples in 2.1 s.Collecting 63 more samples in 2.1 s.Collecting 62 more samples in 2.0 s.Collecting 61 more samples in 2.0 s.Collecting 60 more samples in 2.0 s.Collecting 59 more samples in 1.9 s.Collecting 58 more samples in 1.9 s.Collecting 57 more samples in 1.9 s.Collecting 56 more samples in 1.8 s.Collecting 55 more samples in 1.8 s.Collecting 54 more samples in 1.8 s.Collecting 53 more samples in 1.7 s.Collecting 52 more samples in 1.7 s.Collecting 51 more samples in 1.7 s.Collecting 50 more samples in 1.6 s.Collecting 49 more samples in 1.6 s.Collecting 48 more samples in 1.6 s.Collecting 47 more samples in 1.5 s.Collecting 46 more samples in 1.5 s.Collecting 45 more samples in 1.5 s.Collecting 44 more samples in 1.4 s.Collecting 43 more samples in 1.4 s.Collecting 42 more samples in 1.4 s.Collecting 41 more samples in 1.3 s.Collecting 40 more samples in 1.3 s.Collecting 39 more samples in 1.3 s.Collecting 38 more samples in 1.2 s.Collecting 37 more samples in 1.2 s.Collecting 36 more samples in 1.2 s.Collecting 35 more samples in 1.1 s.Collecting 34 more samples in 1.1 s.Collecting 33 more samples in 1.1 s.Collecting 32 more samples in 1.0 s.Collecting 31 more samples in 1.0 s.Collecting 30 more samples in 1.0 s.Collecting 29 more samples in 0.9 s.Collecting 28 more samples in 0.9 s.Collecting 27 more samples in 0.9 s.Collecting 26 more samples in 0.8 s.Collecting 25 more samples in 0.8 s.Collecting 24 more samples in 0.8 s.Collecting 23 more samples in 0.8 s.Collecting 22 more samples in 0.7 s.Collecting 21 more samples in 0.7 s.Collecting 20 more samples in 0.7 s.Collecting 19 more samples in 0.6 s.Collecting 18 more samples in 0.6 s.Collecting 17 more samples in 0.6 s.Collecting 16 more samples in 0.5 s.Collecting 15 more samples in 0.5 s.Collecting 14 more samples in 0.5 s.Collecting 13 more samples in 0.4 s.Collecting 12 more samples in 0.4 s.Collecting 11 more samples in 0.4 s.Collecting 10 more samples in 0.3 s.Collecting 9 more samples in 0.3 s.Collecting 8 more samples in 0.3 s.Collecting 7 more samples in 0.2 s.Collecting 6 more samples in 0.2 s.Collecting 5 more samples in 0.2 s.Collecting 4 more samples in 0.1 s.Collecting 3 more samples in 0.1 s.Collecting 2 more samples in 0.1 s.Collecting 1 more samples in 0.0 s.mean: 35.92031 ms, lower bound: 35.08590 ms, upper bound: 37.04265 ms, confidence: 0.950 std dev: 4.923912 ms, lower bound: 3.872609 ms, upper bound: 6.170840 ms, confidence: 0.950 found 10 outliers among 100 samples (10.0%) 2 (2.0%) high mild 8 (8.0%) high severe variance introduced by outliers: 88.341% variance is severely inflated by outliers commits: 200000 retries: 0 allocated bytes: 70054696 Running a subject "16/12500/unordered-containers" Collecting 99 more samples in 93.5 s.Collecting 98 more samples in 92.6 s.Collecting 97 more samples in 91.7 s.Collecting 96 more samples in 90.7 s.Collecting 95 more samples in 89.8 s.Collecting 94 more samples in 88.8 s.Collecting 93 more samples in 87.9 s.Collecting 92 more samples in 86.9 s.Collecting 91 more samples in 86.0 s.Collecting 90 more samples in 85.0 s.Collecting 89 more samples in 84.1 s.Collecting 88 more samples in 83.2 s.Collecting 87 more samples in 82.2 s.Collecting 86 more samples in 81.3 s.Collecting 85 more samples in 80.3 s.Collecting 84 more samples in 79.4 s.Collecting 83 more samples in 78.4 s.Collecting 82 more samples in 77.5 s.Collecting 81 more samples in 76.5 s.Collecting 80 more samples in 75.6 s.Collecting 79 more samples in 74.6 s.Collecting 78 more samples in 73.7 s.Collecting 77 more samples in 72.8 s.Collecting 76 more samples in 71.8 s.Collecting 75 more samples in 70.9 s.Collecting 74 more samples in 69.9 s.Collecting 73 more samples in 69.0 s.Collecting 72 more samples in 68.0 s.Collecting 71 more samples in 67.1 s.Collecting 70 more samples in 66.1 s.Collecting 69 more samples in 65.2 s.Collecting 68 more samples in 64.3 s.Collecting 67 more samples in 63.3 s.Collecting 66 more samples in 62.4 s.Collecting 65 more samples in 61.4 s.Collecting 64 more samples in 60.5 s.Collecting 63 more samples in 59.5 s.Collecting 62 more samples in 58.6 s.Collecting 61 more samples in 57.6 s.Collecting 60 more samples in 56.7 s.Collecting 59 more samples in 55.7 s.Collecting 58 more samples in 54.8 s.Collecting 57 more samples in 53.9 s.Collecting 56 more samples in 52.9 s.Collecting 55 more samples in 52.0 s.Collecting 54 more samples in 51.0 s.Collecting 53 more samples in 50.1 s.Collecting 52 more samples in 49.1 s.Collecting 51 more samples in 48.2 s.Collecting 50 more samples in 47.2 s.Collecting 49 more samples in 46.3 s.Collecting 48 more samples in 45.4 s.Collecting 47 more samples in 44.4 s.Collecting 46 more samples in 43.5 s.Collecting 45 more samples in 42.5 s.Collecting 44 more samples in 41.6 s.Collecting 43 more samples in 40.6 s.Collecting 42 more samples in 39.7 s.Collecting 41 more samples in 38.7 s.Collecting 40 more samples in 37.8 s.Collecting 39 more samples in 36.9 s.Collecting 38 more samples in 35.9 s.Collecting 37 more samples in 35.0 s.Collecting 36 more samples in 34.0 s.Collecting 35 more samples in 33.1 s.Collecting 34 more samples in 32.1 s.Collecting 33 more samples in 31.2 s.Collecting 32 more samples in 30.2 s.Collecting 31 more samples in 29.3 s.Collecting 30 more samples in 28.3 s.Collecting 29 more samples in 27.4 s.Collecting 28 more samples in 26.5 s.Collecting 27 more samples in 25.5 s.Collecting 26 more samples in 24.6 s.Collecting 25 more samples in 23.6 s.Collecting 24 more samples in 22.7 s.Collecting 23 more samples in 21.7 s.Collecting 22 more samples in 20.8 s.Collecting 21 more samples in 19.8 s.Collecting 20 more samples in 18.9 s.Collecting 19 more samples in 18.0 s.Collecting 18 more samples in 17.0 s.Collecting 17 more samples in 16.1 s.Collecting 16 more samples in 15.1 s.Collecting 15 more samples in 14.2 s.Collecting 14 more samples in 13.2 s.Collecting 13 more samples in 12.3 s.Collecting 12 more samples in 11.3 s.Collecting 11 more samples in 10.4 s.Collecting 10 more samples in 9.4 s.Collecting 9 more samples in 8.5 s.Collecting 8 more samples in 7.6 s.Collecting 7 more samples in 6.6 s.Collecting 6 more samples in 5.7 s.Collecting 5 more samples in 4.7 s.Collecting 4 more samples in 3.8 s.Collecting 3 more samples in 2.8 s.Collecting 2 more samples in 1.9 s.Collecting 1 more samples in 0.9 s.mean: 904.3497 ms, lower bound: 890.6643 ms, upper bound: 918.8003 ms, confidence: 0.950 std dev: 72.09496 ms, lower bound: 60.91945 ms, upper bound: 87.94932 ms, confidence: 0.950 found 7 outliers among 100 samples (7.0%) 2 (2.0%) low mild 4 (4.0%) high mild 1 (1.0%) high severe variance introduced by outliers: 70.725% variance is severely inflated by outliers commits: 200000 retries: 1074543 allocated bytes: 880649888 Running a subject "16/12500/stm-containers" Collecting 100 more samples in 6.7 s.Collecting 99 more samples in 6.6 s.Collecting 98 more samples in 6.6 s.Collecting 97 more samples in 6.5 s.Collecting 96 more samples in 6.4 s.Collecting 95 more samples in 6.4 s.Collecting 94 more samples in 6.3 s.Collecting 93 more samples in 6.2 s.Collecting 92 more samples in 6.2 s.Collecting 91 more samples in 6.1 s.Collecting 90 more samples in 6.0 s.Collecting 89 more samples in 6.0 s.Collecting 88 more samples in 5.9 s.Collecting 87 more samples in 5.8 s.Collecting 86 more samples in 5.8 s.Collecting 85 more samples in 5.7 s.Collecting 84 more samples in 5.6 s.Collecting 83 more samples in 5.6 s.Collecting 82 more samples in 5.5 s.Collecting 81 more samples in 5.4 s.Collecting 80 more samples in 5.4 s.Collecting 79 more samples in 5.3 s.Collecting 78 more samples in 5.2 s.Collecting 77 more samples in 5.2 s.Collecting 76 more samples in 5.1 s.Collecting 75 more samples in 5.0 s.Collecting 74 more samples in 5.0 s.Collecting 73 more samples in 4.9 s.Collecting 72 more samples in 4.8 s.Collecting 71 more samples in 4.7 s.Collecting 70 more samples in 4.7 s.Collecting 69 more samples in 4.6 s.Collecting 68 more samples in 4.5 s.Collecting 67 more samples in 4.5 s.Collecting 66 more samples in 4.4 s.Collecting 65 more samples in 4.3 s.Collecting 64 more samples in 4.3 s.Collecting 63 more samples in 4.2 s.Collecting 62 more samples in 4.1 s.Collecting 61 more samples in 4.1 s.Collecting 60 more samples in 4.0 s.Collecting 59 more samples in 3.9 s.Collecting 58 more samples in 3.9 s.Collecting 57 more samples in 3.8 s.Collecting 56 more samples in 3.7 s.Collecting 55 more samples in 3.7 s.Collecting 54 more samples in 3.6 s.Collecting 53 more samples in 3.5 s.Collecting 52 more samples in 3.5 s.Collecting 51 more samples in 3.4 s.Collecting 50 more samples in 3.3 s.Collecting 49 more samples in 3.3 s.Collecting 48 more samples in 3.2 s.Collecting 47 more samples in 3.1 s.Collecting 46 more samples in 3.1 s.Collecting 45 more samples in 3.0 s.Collecting 44 more samples in 2.9 s.Collecting 43 more samples in 2.9 s.Collecting 42 more samples in 2.8 s.Collecting 41 more samples in 2.7 s.Collecting 40 more samples in 2.7 s.Collecting 39 more samples in 2.6 s.Collecting 38 more samples in 2.5 s.Collecting 37 more samples in 2.5 s.Collecting 36 more samples in 2.4 s.Collecting 35 more samples in 2.3 s.Collecting 34 more samples in 2.3 s.Collecting 33 more samples in 2.2 s.Collecting 32 more samples in 2.1 s.Collecting 31 more samples in 2.1 s.Collecting 30 more samples in 2.0 s.Collecting 29 more samples in 1.9 s.Collecting 28 more samples in 1.9 s.Collecting 27 more samples in 1.8 s.Collecting 26 more samples in 1.7 s.Collecting 25 more samples in 1.7 s.Collecting 24 more samples in 1.6 s.Collecting 23 more samples in 1.5 s.Collecting 22 more samples in 1.5 s.Collecting 21 more samples in 1.4 s.Collecting 20 more samples in 1.3 s.Collecting 19 more samples in 1.3 s.Collecting 18 more samples in 1.2 s.Collecting 17 more samples in 1.1 s.Collecting 16 more samples in 1.1 s.Collecting 15 more samples in 1.0 s.Collecting 14 more samples in 0.9 s.Collecting 13 more samples in 0.9 s.Collecting 12 more samples in 0.8 s.Collecting 11 more samples in 0.7 s.Collecting 10 more samples in 0.7 s.Collecting 9 more samples in 0.6 s.Collecting 8 more samples in 0.5 s.Collecting 7 more samples in 0.5 s.Collecting 6 more samples in 0.4 s.Collecting 5 more samples in 0.3 s.Collecting 4 more samples in 0.3 s.Collecting 3 more samples in 0.2 s.Collecting 2 more samples in 0.1 s.Collecting 1 more samples in 0.1 s.mean: 71.11025 ms, lower bound: 69.67745 ms, upper bound: 72.75143 ms, confidence: 0.950 std dev: 7.845869 ms, lower bound: 6.691429 ms, upper bound: 9.317364 ms, confidence: 0.950 found 9 outliers among 100 samples (9.0%) 9 (9.0%) high mild variance introduced by outliers: 82.116% variance is severely inflated by outliers commits: 200000 retries: 830 allocated bytes: 260993768 Running a subject "16/12500/ttrie" Collecting 100 more samples in 3.0 s.Collecting 99 more samples in 3.0 s.Collecting 98 more samples in 2.9 s.Collecting 97 more samples in 2.9 s.Collecting 96 more samples in 2.9 s.Collecting 95 more samples in 2.8 s.Collecting 94 more samples in 2.8 s.Collecting 93 more samples in 2.8 s.Collecting 92 more samples in 2.8 s.Collecting 91 more samples in 2.7 s.Collecting 90 more samples in 2.7 s.Collecting 89 more samples in 2.7 s.Collecting 88 more samples in 2.6 s.Collecting 87 more samples in 2.6 s.Collecting 86 more samples in 2.6 s.Collecting 85 more samples in 2.5 s.Collecting 84 more samples in 2.5 s.Collecting 83 more samples in 2.5 s.Collecting 82 more samples in 2.5 s.Collecting 81 more samples in 2.4 s.Collecting 80 more samples in 2.4 s.Collecting 79 more samples in 2.4 s.Collecting 78 more samples in 2.3 s.Collecting 77 more samples in 2.3 s.Collecting 76 more samples in 2.3 s.Collecting 75 more samples in 2.2 s.Collecting 74 more samples in 2.2 s.Collecting 73 more samples in 2.2 s.Collecting 72 more samples in 2.2 s.Collecting 71 more samples in 2.1 s.Collecting 70 more samples in 2.1 s.Collecting 69 more samples in 2.1 s.Collecting 68 more samples in 2.0 s.Collecting 67 more samples in 2.0 s.Collecting 66 more samples in 2.0 s.Collecting 65 more samples in 1.9 s.Collecting 64 more samples in 1.9 s.Collecting 63 more samples in 1.9 s.Collecting 62 more samples in 1.9 s.Collecting 61 more samples in 1.8 s.Collecting 60 more samples in 1.8 s.Collecting 59 more samples in 1.8 s.Collecting 58 more samples in 1.7 s.Collecting 57 more samples in 1.7 s.Collecting 56 more samples in 1.7 s.Collecting 55 more samples in 1.6 s.Collecting 54 more samples in 1.6 s.Collecting 53 more samples in 1.6 s.Collecting 52 more samples in 1.6 s.Collecting 51 more samples in 1.5 s.Collecting 50 more samples in 1.5 s.Collecting 49 more samples in 1.5 s.Collecting 48 more samples in 1.4 s.Collecting 47 more samples in 1.4 s.Collecting 46 more samples in 1.4 s.Collecting 45 more samples in 1.3 s.Collecting 44 more samples in 1.3 s.Collecting 43 more samples in 1.3 s.Collecting 42 more samples in 1.3 s.Collecting 41 more samples in 1.2 s.Collecting 40 more samples in 1.2 s.Collecting 39 more samples in 1.2 s.Collecting 38 more samples in 1.1 s.Collecting 37 more samples in 1.1 s.Collecting 36 more samples in 1.1 s.Collecting 35 more samples in 1.0 s.Collecting 34 more samples in 1.0 s.Collecting 33 more samples in 1.0 s.Collecting 32 more samples in 1.0 s.Collecting 31 more samples in 0.9 s.Collecting 30 more samples in 0.9 s.Collecting 29 more samples in 0.9 s.Collecting 28 more samples in 0.8 s.Collecting 27 more samples in 0.8 s.Collecting 26 more samples in 0.8 s.Collecting 25 more samples in 0.7 s.Collecting 24 more samples in 0.7 s.Collecting 23 more samples in 0.7 s.Collecting 22 more samples in 0.7 s.Collecting 21 more samples in 0.6 s.Collecting 20 more samples in 0.6 s.Collecting 19 more samples in 0.6 s.Collecting 18 more samples in 0.5 s.Collecting 17 more samples in 0.5 s.Collecting 16 more samples in 0.5 s.Collecting 15 more samples in 0.4 s.Collecting 14 more samples in 0.4 s.Collecting 13 more samples in 0.4 s.Collecting 12 more samples in 0.4 s.Collecting 11 more samples in 0.3 s.Collecting 10 more samples in 0.3 s.Collecting 9 more samples in 0.3 s.Collecting 8 more samples in 0.2 s.Collecting 7 more samples in 0.2 s.Collecting 6 more samples in 0.2 s.Collecting 5 more samples in 0.1 s.Collecting 4 more samples in 0.1 s.Collecting 3 more samples in 0.1 s.Collecting 2 more samples in 0.1 s.Collecting 1 more samples in 0.0 s.mean: 32.51177 ms, lower bound: 31.06482 ms, upper bound: 35.71906 ms, confidence: 0.950 std dev: 10.57311 ms, lower bound: 5.347605 ms, upper bound: 17.30491 ms, confidence: 0.950 found 13 outliers among 100 samples (13.0%) 8 (8.0%) high mild 5 (5.0%) high severe variance introduced by outliers: 97.858% variance is severely inflated by outliers commits: 200000 retries: 0 allocated bytes: 70064256 Benchmark bench: FINISH