Preprocessing library ttrie-0.1.2... In-place registering ttrie-0.1.2... Preprocessing benchmark 'bench' for ttrie-0.1.2... Running 1 benchmarks... Benchmark bench: RUNNING... threads = [1,2,4,6,8,10,12,14,16] numTransactions = 200000 sizes = [(1,1),(2,1),(3,1),(4,1),(5,1)] numPrefill = 1000000 ops = (10,10,70,10) Generating 1000000 random keys to prefill... Generating 200000 random transactions... warming up estimating clock resolution... mean is 1.588098 us (320001 iterations) found 554633 outliers among 319999 samples (173.3%) 258165 (80.7%) low severe 296468 (92.6%) high severe estimating cost of a clock call... mean is 188.3325 ns (11 iterations) found 2 outliers among 11 samples (18.2%) 2 (18.2%) high severe Running a subject "1/200000/unordered-containers" Collecting 99 more samples in 78.6 s.Collecting 98 more samples in 77.8 s.Collecting 97 more samples in 77.0 s.Collecting 96 more samples in 76.2 s.Collecting 95 more samples in 75.4 s.Collecting 94 more samples in 74.6 s.Collecting 93 more samples in 73.8 s.Collecting 92 more samples in 73.0 s.Collecting 91 more samples in 72.2 s.Collecting 90 more samples in 71.4 s.Collecting 89 more samples in 70.6 s.Collecting 88 more samples in 69.8 s.Collecting 87 more samples in 69.0 s.Collecting 86 more samples in 68.3 s.Collecting 85 more samples in 67.5 s.Collecting 84 more samples in 66.7 s.Collecting 83 more samples in 65.9 s.Collecting 82 more samples in 65.1 s.Collecting 81 more samples in 64.3 s.Collecting 80 more samples in 63.5 s.Collecting 79 more samples in 62.7 s.Collecting 78 more samples in 61.9 s.Collecting 77 more samples in 61.1 s.Collecting 76 more samples in 60.3 s.Collecting 75 more samples in 59.5 s.Collecting 74 more samples in 58.7 s.Collecting 73 more samples in 57.9 s.Collecting 72 more samples in 57.1 s.Collecting 71 more samples in 56.3 s.Collecting 70 more samples in 55.6 s.Collecting 69 more samples in 54.8 s.Collecting 68 more samples in 54.0 s.Collecting 67 more samples in 53.2 s.Collecting 66 more samples in 52.4 s.Collecting 65 more samples in 51.6 s.Collecting 64 more samples in 50.8 s.Collecting 63 more samples in 50.0 s.Collecting 62 more samples in 49.2 s.Collecting 61 more samples in 48.4 s.Collecting 60 more samples in 47.6 s.Collecting 59 more samples in 46.8 s.Collecting 58 more samples in 46.0 s.Collecting 57 more samples in 45.2 s.Collecting 56 more samples in 44.4 s.Collecting 55 more samples in 43.6 s.Collecting 54 more samples in 42.9 s.Collecting 53 more samples in 42.1 s.Collecting 52 more samples in 41.3 s.Collecting 51 more samples in 40.5 s.Collecting 50 more samples in 39.7 s.Collecting 49 more samples in 38.9 s.Collecting 48 more samples in 38.1 s.Collecting 47 more samples in 37.3 s.Collecting 46 more samples in 36.5 s.Collecting 45 more samples in 35.7 s.Collecting 44 more samples in 34.9 s.Collecting 43 more samples in 34.1 s.Collecting 42 more samples in 33.3 s.Collecting 41 more samples in 32.5 s.Collecting 40 more samples in 31.7 s.Collecting 39 more samples in 31.0 s.Collecting 38 more samples in 30.2 s.Collecting 37 more samples in 29.4 s.Collecting 36 more samples in 28.6 s.Collecting 35 more samples in 27.8 s.Collecting 34 more samples in 27.0 s.Collecting 33 more samples in 26.2 s.Collecting 32 more samples in 25.4 s.Collecting 31 more samples in 24.6 s.Collecting 30 more samples in 23.8 s.Collecting 29 more samples in 23.0 s.Collecting 28 more samples in 22.2 s.Collecting 27 more samples in 21.4 s.Collecting 26 more samples in 20.6 s.Collecting 25 more samples in 19.8 s.Collecting 24 more samples in 19.0 s.Collecting 23 more samples in 18.3 s.Collecting 22 more samples in 17.5 s.Collecting 21 more samples in 16.7 s.Collecting 20 more samples in 15.9 s.Collecting 19 more samples in 15.1 s.Collecting 18 more samples in 14.3 s.Collecting 17 more samples in 13.5 s.Collecting 16 more samples in 12.7 s.Collecting 15 more samples in 11.9 s.Collecting 14 more samples in 11.1 s.Collecting 13 more samples in 10.3 s.Collecting 12 more samples in 9.5 s.Collecting 11 more samples in 8.7 s.Collecting 10 more samples in 7.9 s.Collecting 9 more samples in 7.1 s.Collecting 8 more samples in 6.3 s.Collecting 7 more samples in 5.6 s.Collecting 6 more samples in 4.8 s.Collecting 5 more samples in 4.0 s.Collecting 4 more samples in 3.2 s.Collecting 3 more samples in 2.4 s.Collecting 2 more samples in 1.6 s.Collecting 1 more samples in 0.8 s.mean: 759.3132 ms, lower bound: 735.9797 ms, upper bound: 787.5383 ms, confidence: 0.950 std dev: 131.3561 ms, lower bound: 109.7426 ms, upper bound: 159.7004 ms, confidence: 0.950 found 8 outliers among 100 samples (8.0%) 7 (7.0%) high mild 1 (1.0%) high severe variance introduced by outliers: 92.548% variance is severely inflated by outliers commits: 200000 retries: 1 allocated bytes: 114981992 Running a subject "1/200000/stm-containers" Collecting 99 more samples in 338.5 s.Collecting 98 more samples in 335.1 s.Collecting 97 more samples in 331.6 s.Collecting 96 more samples in 328.2 s.Collecting 95 more samples in 324.8 s.Collecting 94 more samples in 321.4 s.Collecting 93 more samples in 318.0 s.Collecting 92 more samples in 314.5 s.Collecting 91 more samples in 311.1 s.Collecting 90 more samples in 307.7 s.Collecting 89 more samples in 304.3 s.Collecting 88 more samples in 300.9 s.Collecting 87 more samples in 297.5 s.Collecting 86 more samples in 294.0 s.Collecting 85 more samples in 290.6 s.Collecting 84 more samples in 287.2 s.Collecting 83 more samples in 283.8 s.Collecting 82 more samples in 280.4 s.Collecting 81 more samples in 276.9 s.Collecting 80 more samples in 273.5 s.Collecting 79 more samples in 270.1 s.Collecting 78 more samples in 266.7 s.Collecting 77 more samples in 263.3 s.Collecting 76 more samples in 259.8 s.Collecting 75 more samples in 256.4 s.Collecting 74 more samples in 253.0 s.Collecting 73 more samples in 249.6 s.Collecting 72 more samples in 246.2 s.Collecting 71 more samples in 242.7 s.Collecting 70 more samples in 239.3 s.Collecting 69 more samples in 235.9 s.Collecting 68 more samples in 232.5 s.Collecting 67 more samples in 229.1 s.Collecting 66 more samples in 225.7 s.Collecting 65 more samples in 222.2 s.Collecting 64 more samples in 218.8 s.Collecting 63 more samples in 215.4 s.Collecting 62 more samples in 212.0 s.Collecting 61 more samples in 208.6 s.Collecting 60 more samples in 205.1 s.Collecting 59 more samples in 201.7 s.Collecting 58 more samples in 198.3 s.Collecting 57 more samples in 194.9 s.Collecting 56 more samples in 191.5 s.Collecting 55 more samples in 188.0 s.Collecting 54 more samples in 184.6 s.Collecting 53 more samples in 181.2 s.Collecting 52 more samples in 177.8 s.Collecting 51 more samples in 174.4 s.Collecting 50 more samples in 170.9 s.Collecting 49 more samples in 167.5 s.Collecting 48 more samples in 164.1 s.Collecting 47 more samples in 160.7 s.Collecting 46 more samples in 157.3 s.Collecting 45 more samples in 153.9 s.Collecting 44 more samples in 150.4 s.Collecting 43 more samples in 147.0 s.Collecting 42 more samples in 143.6 s.Collecting 41 more samples in 140.2 s.Collecting 40 more samples in 136.8 s.Collecting 39 more samples in 133.3 s.Collecting 38 more samples in 129.9 s.Collecting 37 more samples in 126.5 s.Collecting 36 more samples in 123.1 s.Collecting 35 more samples in 119.7 s.Collecting 34 more samples in 116.2 s.Collecting 33 more samples in 112.8 s.Collecting 32 more samples in 109.4 s.Collecting 31 more samples in 106.0 s.Collecting 30 more samples in 102.6 s.Collecting 29 more samples in 99.2 s.Collecting 28 more samples in 95.7 s.Collecting 27 more samples in 92.3 s.Collecting 26 more samples in 88.9 s.Collecting 25 more samples in 85.5 s.Collecting 24 more samples in 82.1 s.Collecting 23 more samples in 78.6 s.Collecting 22 more samples in 75.2 s.Collecting 21 more samples in 71.8 s.Collecting 20 more samples in 68.4 s.Collecting 19 more samples in 65.0 s.Collecting 18 more samples in 61.5 s.Collecting 17 more samples in 58.1 s.Collecting 16 more samples in 54.7 s.Collecting 15 more samples in 51.3 s.Collecting 14 more samples in 47.9 s.Collecting 13 more samples in 44.4 s.Collecting 12 more samples in 41.0 s.Collecting 11 more samples in 37.6 s.Collecting 10 more samples in 34.2 s.Collecting 9 more samples in 30.8 s.Collecting 8 more samples in 27.4 s.Collecting 7 more samples in 23.9 s.Collecting 6 more samples in 20.5 s.Collecting 5 more samples in 17.1 s.Collecting 4 more samples in 13.7 s.Collecting 3 more samples in 10.3 s.Collecting 2 more samples in 6.8 s.Collecting 1 more samples in 3.4 s.mean: 1.997845 s, lower bound: 1.960069 s, upper bound: 2.058214 s, confidence: 0.950 std dev: 241.5122 ms, lower bound: 175.2625 ms, upper bound: 373.0490 ms, confidence: 0.950 found 14 outliers among 100 samples (14.0%) 12 (12.0%) high severe variance introduced by outliers: 85.209% variance is severely inflated by outliers commits: 200000 retries: 0 allocated bytes: 569091440 Running a subject "1/200000/ttrie" Collecting 99 more samples in 105.9 s.Collecting 98 more samples in 104.8 s.Collecting 97 more samples in 103.7 s.Collecting 96 more samples in 102.7 s.Collecting 95 more samples in 101.6 s.Collecting 94 more samples in 100.5 s.Collecting 93 more samples in 99.5 s.Collecting 92 more samples in 98.4 s.Collecting 91 more samples in 97.3 s.Collecting 90 more samples in 96.2 s.Collecting 89 more samples in 95.2 s.Collecting 88 more samples in 94.1 s.Collecting 87 more samples in 93.0 s.Collecting 86 more samples in 92.0 s.Collecting 85 more samples in 90.9 s.Collecting 84 more samples in 89.8 s.Collecting 83 more samples in 88.8 s.Collecting 82 more samples in 87.7 s.Collecting 81 more samples in 86.6 s.Collecting 80 more samples in 85.6 s.Collecting 79 more samples in 84.5 s.Collecting 78 more samples in 83.4 s.Collecting 77 more samples in 82.3 s.Collecting 76 more samples in 81.3 s.Collecting 75 more samples in 80.2 s.Collecting 74 more samples in 79.1 s.Collecting 73 more samples in 78.1 s.Collecting 72 more samples in 77.0 s.Collecting 71 more samples in 75.9 s.Collecting 70 more samples in 74.9 s.Collecting 69 more samples in 73.8 s.Collecting 68 more samples in 72.7 s.Collecting 67 more samples in 71.7 s.Collecting 66 more samples in 70.6 s.Collecting 65 more samples in 69.5 s.Collecting 64 more samples in 68.4 s.Collecting 63 more samples in 67.4 s.Collecting 62 more samples in 66.3 s.Collecting 61 more samples in 65.2 s.Collecting 60 more samples in 64.2 s.Collecting 59 more samples in 63.1 s.Collecting 58 more samples in 62.0 s.Collecting 57 more samples in 61.0 s.Collecting 56 more samples in 59.9 s.Collecting 55 more samples in 58.8 s.Collecting 54 more samples in 57.7 s.Collecting 53 more samples in 56.7 s.Collecting 52 more samples in 55.6 s.Collecting 51 more samples in 54.5 s.Collecting 50 more samples in 53.5 s.Collecting 49 more samples in 52.4 s.Collecting 48 more samples in 51.3 s.Collecting 47 more samples in 50.3 s.Collecting 46 more samples in 49.2 s.Collecting 45 more samples in 48.1 s.Collecting 44 more samples in 47.1 s.Collecting 43 more samples in 46.0 s.Collecting 42 more samples in 44.9 s.Collecting 41 more samples in 43.8 s.Collecting 40 more samples in 42.8 s.Collecting 39 more samples in 41.7 s.Collecting 38 more samples in 40.6 s.Collecting 37 more samples in 39.6 s.Collecting 36 more samples in 38.5 s.Collecting 35 more samples in 37.4 s.Collecting 34 more samples in 36.4 s.Collecting 33 more samples in 35.3 s.Collecting 32 more samples in 34.2 s.Collecting 31 more samples in 33.2 s.Collecting 30 more samples in 32.1 s.Collecting 29 more samples in 31.0 s.Collecting 28 more samples in 29.9 s.Collecting 27 more samples in 28.9 s.Collecting 26 more samples in 27.8 s.Collecting 25 more samples in 26.7 s.Collecting 24 more samples in 25.7 s.Collecting 23 more samples in 24.6 s.Collecting 22 more samples in 23.5 s.Collecting 21 more samples in 22.5 s.Collecting 20 more samples in 21.4 s.Collecting 19 more samples in 20.3 s.Collecting 18 more samples in 19.2 s.Collecting 17 more samples in 18.2 s.Collecting 16 more samples in 17.1 s.Collecting 15 more samples in 16.0 s.Collecting 14 more samples in 15.0 s.Collecting 13 more samples in 13.9 s.Collecting 12 more samples in 12.8 s.Collecting 11 more samples in 11.8 s.Collecting 10 more samples in 10.7 s.Collecting 9 more samples in 9.6 s.Collecting 8 more samples in 8.6 s.Collecting 7 more samples in 7.5 s.Collecting 6 more samples in 6.4 s.Collecting 5 more samples in 5.3 s.Collecting 4 more samples in 4.3 s.Collecting 3 more samples in 3.2 s.Collecting 2 more samples in 2.1 s.Collecting 1 more samples in 1.1 s.mean: 1.069404 s, lower bound: 1.057615 s, upper bound: 1.082519 s, confidence: 0.950 std dev: 64.13727 ms, lower bound: 57.14643 ms, upper bound: 74.07592 ms, confidence: 0.950 variance introduced by outliers: 57.488% variance is severely inflated by outliers commits: 200000 retries: 0 allocated bytes: 223276968 Running a subject "2/100000/unordered-containers" Collecting 99 more samples in 56.5 s.Collecting 98 more samples in 55.9 s.Collecting 97 more samples in 55.4 s.Collecting 96 more samples in 54.8 s.Collecting 95 more samples in 54.2 s.Collecting 94 more samples in 53.6 s.Collecting 93 more samples in 53.1 s.Collecting 92 more samples in 52.5 s.Collecting 91 more samples in 51.9 s.Collecting 90 more samples in 51.4 s.Collecting 89 more samples in 50.8 s.Collecting 88 more samples in 50.2 s.Collecting 87 more samples in 49.7 s.Collecting 86 more samples in 49.1 s.Collecting 85 more samples in 48.5 s.Collecting 84 more samples in 47.9 s.Collecting 83 more samples in 47.4 s.Collecting 82 more samples in 46.8 s.Collecting 81 more samples in 46.2 s.Collecting 80 more samples in 45.7 s.Collecting 79 more samples in 45.1 s.Collecting 78 more samples in 44.5 s.Collecting 77 more samples in 43.9 s.Collecting 76 more samples in 43.4 s.Collecting 75 more samples in 42.8 s.Collecting 74 more samples in 42.2 s.Collecting 73 more samples in 41.7 s.Collecting 72 more samples in 41.1 s.Collecting 71 more samples in 40.5 s.Collecting 70 more samples in 40.0 s.Collecting 69 more samples in 39.4 s.Collecting 68 more samples in 38.8 s.Collecting 67 more samples in 38.2 s.Collecting 66 more samples in 37.7 s.Collecting 65 more samples in 37.1 s.Collecting 64 more samples in 36.5 s.Collecting 63 more samples in 36.0 s.Collecting 62 more samples in 35.4 s.Collecting 61 more samples in 34.8 s.Collecting 60 more samples in 34.2 s.Collecting 59 more samples in 33.7 s.Collecting 58 more samples in 33.1 s.Collecting 57 more samples in 32.5 s.Collecting 56 more samples in 32.0 s.Collecting 55 more samples in 31.4 s.Collecting 54 more samples in 30.8 s.Collecting 53 more samples in 30.2 s.Collecting 52 more samples in 29.7 s.Collecting 51 more samples in 29.1 s.Collecting 50 more samples in 28.5 s.Collecting 49 more samples in 28.0 s.Collecting 48 more samples in 27.4 s.Collecting 47 more samples in 26.8 s.Collecting 46 more samples in 26.3 s.Collecting 45 more samples in 25.7 s.Collecting 44 more samples in 25.1 s.Collecting 43 more samples in 24.5 s.Collecting 42 more samples in 24.0 s.Collecting 41 more samples in 23.4 s.Collecting 40 more samples in 22.8 s.Collecting 39 more samples in 22.3 s.Collecting 38 more samples in 21.7 s.Collecting 37 more samples in 21.1 s.Collecting 36 more samples in 20.5 s.Collecting 35 more samples in 20.0 s.Collecting 34 more samples in 19.4 s.Collecting 33 more samples in 18.8 s.Collecting 32 more samples in 18.3 s.Collecting 31 more samples in 17.7 s.Collecting 30 more samples in 17.1 s.Collecting 29 more samples in 16.6 s.Collecting 28 more samples in 16.0 s.Collecting 27 more samples in 15.4 s.Collecting 26 more samples in 14.8 s.Collecting 25 more samples in 14.3 s.Collecting 24 more samples in 13.7 s.Collecting 23 more samples in 13.1 s.Collecting 22 more samples in 12.6 s.Collecting 21 more samples in 12.0 s.Collecting 20 more samples in 11.4 s.Collecting 19 more samples in 10.8 s.Collecting 18 more samples in 10.3 s.Collecting 17 more samples in 9.7 s.Collecting 16 more samples in 9.1 s.Collecting 15 more samples in 8.6 s.Collecting 14 more samples in 8.0 s.Collecting 13 more samples in 7.4 s.Collecting 12 more samples in 6.8 s.Collecting 11 more samples in 6.3 s.Collecting 10 more samples in 5.7 s.Collecting 9 more samples in 5.1 s.Collecting 8 more samples in 4.6 s.Collecting 7 more samples in 4.0 s.Collecting 6 more samples in 3.4 s.Collecting 5 more samples in 2.9 s.Collecting 4 more samples in 2.3 s.Collecting 3 more samples in 1.7 s.Collecting 2 more samples in 1.1 s.Collecting 1 more samples in 0.6 s.mean: 478.0006 ms, lower bound: 462.2313 ms, upper bound: 500.3803 ms, confidence: 0.950 std dev: 95.69221 ms, lower bound: 71.65423 ms, upper bound: 131.8704 ms, confidence: 0.950 found 4 outliers among 100 samples (4.0%) 3 (3.0%) high mild 1 (1.0%) high severe variance introduced by outliers: 94.648% variance is severely inflated by outliers commits: 200000 retries: 77303 allocated bytes: 197212216 Running a subject "2/100000/stm-containers" Collecting 99 more samples in 117.7 s.Collecting 98 more samples in 116.5 s.Collecting 97 more samples in 115.3 s.Collecting 96 more samples in 114.1 s.Collecting 95 more samples in 112.9 s.Collecting 94 more samples in 111.8 s.Collecting 93 more samples in 110.6 s.Collecting 92 more samples in 109.4 s.Collecting 91 more samples in 108.2 s.Collecting 90 more samples in 107.0 s.Collecting 89 more samples in 105.8 s.Collecting 88 more samples in 104.6 s.Collecting 87 more samples in 103.4 s.Collecting 86 more samples in 102.2 s.Collecting 85 more samples in 101.1 s.Collecting 84 more samples in 99.9 s.Collecting 83 more samples in 98.7 s.Collecting 82 more samples in 97.5 s.Collecting 81 more samples in 96.3 s.Collecting 80 more samples in 95.1 s.Collecting 79 more samples in 93.9 s.Collecting 78 more samples in 92.7 s.Collecting 77 more samples in 91.5 s.Collecting 76 more samples in 90.4 s.Collecting 75 more samples in 89.2 s.Collecting 74 more samples in 88.0 s.Collecting 73 more samples in 86.8 s.Collecting 72 more samples in 85.6 s.Collecting 71 more samples in 84.4 s.Collecting 70 more samples in 83.2 s.Collecting 69 more samples in 82.0 s.Collecting 68 more samples in 80.8 s.Collecting 67 more samples in 79.7 s.Collecting 66 more samples in 78.5 s.Collecting 65 more samples in 77.3 s.Collecting 64 more samples in 76.1 s.Collecting 63 more samples in 74.9 s.Collecting 62 more samples in 73.7 s.Collecting 61 more samples in 72.5 s.Collecting 60 more samples in 71.3 s.Collecting 59 more samples in 70.1 s.Collecting 58 more samples in 69.0 s.Collecting 57 more samples in 67.8 s.Collecting 56 more samples in 66.6 s.Collecting 55 more samples in 65.4 s.Collecting 54 more samples in 64.2 s.Collecting 53 more samples in 63.0 s.Collecting 52 more samples in 61.8 s.Collecting 51 more samples in 60.6 s.Collecting 50 more samples in 59.4 s.Collecting 49 more samples in 58.3 s.Collecting 48 more samples in 57.1 s.Collecting 47 more samples in 55.9 s.Collecting 46 more samples in 54.7 s.Collecting 45 more samples in 53.5 s.Collecting 44 more samples in 52.3 s.Collecting 43 more samples in 51.1 s.Collecting 42 more samples in 49.9 s.Collecting 41 more samples in 48.7 s.Collecting 40 more samples in 47.6 s.Collecting 39 more samples in 46.4 s.Collecting 38 more samples in 45.2 s.Collecting 37 more samples in 44.0 s.Collecting 36 more samples in 42.8 s.Collecting 35 more samples in 41.6 s.Collecting 34 more samples in 40.4 s.Collecting 33 more samples in 39.2 s.Collecting 32 more samples in 38.0 s.Collecting 31 more samples in 36.9 s.Collecting 30 more samples in 35.7 s.Collecting 29 more samples in 34.5 s.Collecting 28 more samples in 33.3 s.Collecting 27 more samples in 32.1 s.Collecting 26 more samples in 30.9 s.Collecting 25 more samples in 29.7 s.Collecting 24 more samples in 28.5 s.Collecting 23 more samples in 27.3 s.Collecting 22 more samples in 26.2 s.Collecting 21 more samples in 25.0 s.Collecting 20 more samples in 23.8 s.Collecting 19 more samples in 22.6 s.Collecting 18 more samples in 21.4 s.Collecting 17 more samples in 20.2 s.Collecting 16 more samples in 19.0 s.Collecting 15 more samples in 17.8 s.Collecting 14 more samples in 16.6 s.Collecting 13 more samples in 15.5 s.Collecting 12 more samples in 14.3 s.Collecting 11 more samples in 13.1 s.Collecting 10 more samples in 11.9 s.Collecting 9 more samples in 10.7 s.Collecting 8 more samples in 9.5 s.Collecting 7 more samples in 8.3 s.Collecting 6 more samples in 7.1 s.Collecting 5 more samples in 5.9 s.Collecting 4 more samples in 4.8 s.Collecting 3 more samples in 3.6 s.Collecting 2 more samples in 2.4 s.Collecting 1 more samples in 1.2 s.mean: 989.9004 ms, lower bound: 978.7773 ms, upper bound: 1.003615 s, confidence: 0.950 std dev: 63.30513 ms, lower bound: 51.57210 ms, upper bound: 81.79163 ms, confidence: 0.950 found 7 outliers among 100 samples (7.0%) 6 (6.0%) high mild 1 (1.0%) high severe variance introduced by outliers: 60.531% variance is severely inflated by outliers commits: 200000 retries: 22 allocated bytes: 567729032 Running a subject "2/100000/ttrie" Collecting 99 more samples in 58.6 s.Collecting 98 more samples in 58.0 s.Collecting 97 more samples in 57.4 s.Collecting 96 more samples in 56.9 s.Collecting 95 more samples in 56.3 s.Collecting 94 more samples in 55.7 s.Collecting 93 more samples in 55.1 s.Collecting 92 more samples in 54.5 s.Collecting 91 more samples in 53.9 s.Collecting 90 more samples in 53.3 s.Collecting 89 more samples in 52.7 s.Collecting 88 more samples in 52.1 s.Collecting 87 more samples in 51.5 s.Collecting 86 more samples in 50.9 s.Collecting 85 more samples in 50.3 s.Collecting 84 more samples in 49.7 s.Collecting 83 more samples in 49.2 s.Collecting 82 more samples in 48.6 s.Collecting 81 more samples in 48.0 s.Collecting 80 more samples in 47.4 s.Collecting 79 more samples in 46.8 s.Collecting 78 more samples in 46.2 s.Collecting 77 more samples in 45.6 s.Collecting 76 more samples in 45.0 s.Collecting 75 more samples in 44.4 s.Collecting 74 more samples in 43.8 s.Collecting 73 more samples in 43.2 s.Collecting 72 more samples in 42.6 s.Collecting 71 more samples in 42.0 s.Collecting 70 more samples in 41.5 s.Collecting 69 more samples in 40.9 s.Collecting 68 more samples in 40.3 s.Collecting 67 more samples in 39.7 s.Collecting 66 more samples in 39.1 s.Collecting 65 more samples in 38.5 s.Collecting 64 more samples in 37.9 s.Collecting 63 more samples in 37.3 s.Collecting 62 more samples in 36.7 s.Collecting 61 more samples in 36.1 s.Collecting 60 more samples in 35.5 s.Collecting 59 more samples in 34.9 s.Collecting 58 more samples in 34.3 s.Collecting 57 more samples in 33.8 s.Collecting 56 more samples in 33.2 s.Collecting 55 more samples in 32.6 s.Collecting 54 more samples in 32.0 s.Collecting 53 more samples in 31.4 s.Collecting 52 more samples in 30.8 s.Collecting 51 more samples in 30.2 s.Collecting 50 more samples in 29.6 s.Collecting 49 more samples in 29.0 s.Collecting 48 more samples in 28.4 s.Collecting 47 more samples in 27.8 s.Collecting 46 more samples in 27.2 s.Collecting 45 more samples in 26.6 s.Collecting 44 more samples in 26.1 s.Collecting 43 more samples in 25.5 s.Collecting 42 more samples in 24.9 s.Collecting 41 more samples in 24.3 s.Collecting 40 more samples in 23.7 s.Collecting 39 more samples in 23.1 s.Collecting 38 more samples in 22.5 s.Collecting 37 more samples in 21.9 s.Collecting 36 more samples in 21.3 s.Collecting 35 more samples in 20.7 s.Collecting 34 more samples in 20.1 s.Collecting 33 more samples in 19.5 s.Collecting 32 more samples in 19.0 s.Collecting 31 more samples in 18.4 s.Collecting 30 more samples in 17.8 s.Collecting 29 more samples in 17.2 s.Collecting 28 more samples in 16.6 s.Collecting 27 more samples in 16.0 s.Collecting 26 more samples in 15.4 s.Collecting 25 more samples in 14.8 s.Collecting 24 more samples in 14.2 s.Collecting 23 more samples in 13.6 s.Collecting 22 more samples in 13.0 s.Collecting 21 more samples in 12.4 s.Collecting 20 more samples in 11.8 s.Collecting 19 more samples in 11.3 s.Collecting 18 more samples in 10.7 s.Collecting 17 more samples in 10.1 s.Collecting 16 more samples in 9.5 s.Collecting 15 more samples in 8.9 s.Collecting 14 more samples in 8.3 s.Collecting 13 more samples in 7.7 s.Collecting 12 more samples in 7.1 s.Collecting 11 more samples in 6.5 s.Collecting 10 more samples in 5.9 s.Collecting 9 more samples in 5.3 s.Collecting 8 more samples in 4.7 s.Collecting 7 more samples in 4.1 s.Collecting 6 more samples in 3.6 s.Collecting 5 more samples in 3.0 s.Collecting 4 more samples in 2.4 s.Collecting 3 more samples in 1.8 s.Collecting 2 more samples in 1.2 s.Collecting 1 more samples in 0.6 s.mean: 583.1910 ms, lower bound: 575.9498 ms, upper bound: 590.3124 ms, confidence: 0.950 std dev: 36.91239 ms, lower bound: 32.60082 ms, upper bound: 43.52941 ms, confidence: 0.950 found 1 outliers among 100 samples (1.0%) variance introduced by outliers: 60.501% variance is severely inflated by outliers commits: 200000 retries: 0 allocated bytes: 223293720 Running a subject "4/50000/unordered-containers" Collecting 99 more samples in 43.3 s.Collecting 98 more samples in 42.9 s.Collecting 97 more samples in 42.4 s.Collecting 96 more samples in 42.0 s.Collecting 95 more samples in 41.6 s.Collecting 94 more samples in 41.1 s.Collecting 93 more samples in 40.7 s.Collecting 92 more samples in 40.2 s.Collecting 91 more samples in 39.8 s.Collecting 90 more samples in 39.4 s.Collecting 89 more samples in 38.9 s.Collecting 88 more samples in 38.5 s.Collecting 87 more samples in 38.1 s.Collecting 86 more samples in 37.6 s.Collecting 85 more samples in 37.2 s.Collecting 84 more samples in 36.7 s.Collecting 83 more samples in 36.3 s.Collecting 82 more samples in 35.9 s.Collecting 81 more samples in 35.4 s.Collecting 80 more samples in 35.0 s.Collecting 79 more samples in 34.6 s.Collecting 78 more samples in 34.1 s.Collecting 77 more samples in 33.7 s.Collecting 76 more samples in 33.2 s.Collecting 75 more samples in 32.8 s.Collecting 74 more samples in 32.4 s.Collecting 73 more samples in 31.9 s.Collecting 72 more samples in 31.5 s.Collecting 71 more samples in 31.1 s.Collecting 70 more samples in 30.6 s.Collecting 69 more samples in 30.2 s.Collecting 68 more samples in 29.7 s.Collecting 67 more samples in 29.3 s.Collecting 66 more samples in 28.9 s.Collecting 65 more samples in 28.4 s.Collecting 64 more samples in 28.0 s.Collecting 63 more samples in 27.6 s.Collecting 62 more samples in 27.1 s.Collecting 61 more samples in 26.7 s.Collecting 60 more samples in 26.2 s.Collecting 59 more samples in 25.8 s.Collecting 58 more samples in 25.4 s.Collecting 57 more samples in 24.9 s.Collecting 56 more samples in 24.5 s.Collecting 55 more samples in 24.1 s.Collecting 54 more samples in 23.6 s.Collecting 53 more samples in 23.2 s.Collecting 52 more samples in 22.7 s.Collecting 51 more samples in 22.3 s.Collecting 50 more samples in 21.9 s.Collecting 49 more samples in 21.4 s.Collecting 48 more samples in 21.0 s.Collecting 47 more samples in 20.6 s.Collecting 46 more samples in 20.1 s.Collecting 45 more samples in 19.7 s.Collecting 44 more samples in 19.2 s.Collecting 43 more samples in 18.8 s.Collecting 42 more samples in 18.4 s.Collecting 41 more samples in 17.9 s.Collecting 40 more samples in 17.5 s.Collecting 39 more samples in 17.1 s.Collecting 38 more samples in 16.6 s.Collecting 37 more samples in 16.2 s.Collecting 36 more samples in 15.7 s.Collecting 35 more samples in 15.3 s.Collecting 34 more samples in 14.9 s.Collecting 33 more samples in 14.4 s.Collecting 32 more samples in 14.0 s.Collecting 31 more samples in 13.6 s.Collecting 30 more samples in 13.1 s.Collecting 29 more samples in 12.7 s.Collecting 28 more samples in 12.2 s.Collecting 27 more samples in 11.8 s.Collecting 26 more samples in 11.4 s.Collecting 25 more samples in 10.9 s.Collecting 24 more samples in 10.5 s.Collecting 23 more samples in 10.1 s.Collecting 22 more samples in 9.6 s.Collecting 21 more samples in 9.2 s.Collecting 20 more samples in 8.7 s.Collecting 19 more samples in 8.3 s.Collecting 18 more samples in 7.9 s.Collecting 17 more samples in 7.4 s.Collecting 16 more samples in 7.0 s.Collecting 15 more samples in 6.6 s.Collecting 14 more samples in 6.1 s.Collecting 13 more samples in 5.7 s.Collecting 12 more samples in 5.2 s.Collecting 11 more samples in 4.8 s.Collecting 10 more samples in 4.4 s.Collecting 9 more samples in 3.9 s.Collecting 8 more samples in 3.5 s.Collecting 7 more samples in 3.1 s.Collecting 6 more samples in 2.6 s.Collecting 5 more samples in 2.2 s.Collecting 4 more samples in 1.7 s.Collecting 3 more samples in 1.3 s.Collecting 2 more samples in 0.9 s.Collecting 1 more samples in 0.4 s.mean: 402.0112 ms, lower bound: 392.1281 ms, upper bound: 412.9353 ms, confidence: 0.950 std dev: 52.80094 ms, lower bound: 44.47178 ms, upper bound: 72.08774 ms, confidence: 0.950 found 1 outliers among 100 samples (1.0%) variance introduced by outliers: 87.299% variance is severely inflated by outliers commits: 200000 retries: 190345 allocated bytes: 354219104 Running a subject "4/50000/stm-containers" Collecting 99 more samples in 48.8 s.Collecting 98 more samples in 48.3 s.Collecting 97 more samples in 47.8 s.Collecting 96 more samples in 47.3 s.Collecting 95 more samples in 46.8 s.Collecting 94 more samples in 46.3 s.Collecting 93 more samples in 45.8 s.Collecting 92 more samples in 45.3 s.Collecting 91 more samples in 44.9 s.Collecting 90 more samples in 44.4 s.Collecting 89 more samples in 43.9 s.Collecting 88 more samples in 43.4 s.Collecting 87 more samples in 42.9 s.Collecting 86 more samples in 42.4 s.Collecting 85 more samples in 41.9 s.Collecting 84 more samples in 41.4 s.Collecting 83 more samples in 40.9 s.Collecting 82 more samples in 40.4 s.Collecting 81 more samples in 39.9 s.Collecting 80 more samples in 39.4 s.Collecting 79 more samples in 38.9 s.Collecting 78 more samples in 38.4 s.Collecting 77 more samples in 38.0 s.Collecting 76 more samples in 37.5 s.Collecting 75 more samples in 37.0 s.Collecting 74 more samples in 36.5 s.Collecting 73 more samples in 36.0 s.Collecting 72 more samples in 35.5 s.Collecting 71 more samples in 35.0 s.Collecting 70 more samples in 34.5 s.Collecting 69 more samples in 34.0 s.Collecting 68 more samples in 33.5 s.Collecting 67 more samples in 33.0 s.Collecting 66 more samples in 32.5 s.Collecting 65 more samples in 32.0 s.Collecting 64 more samples in 31.5 s.Collecting 63 more samples in 31.1 s.Collecting 62 more samples in 30.6 s.Collecting 61 more samples in 30.1 s.Collecting 60 more samples in 29.6 s.Collecting 59 more samples in 29.1 s.Collecting 58 more samples in 28.6 s.Collecting 57 more samples in 28.1 s.Collecting 56 more samples in 27.6 s.Collecting 55 more samples in 27.1 s.Collecting 54 more samples in 26.6 s.Collecting 53 more samples in 26.1 s.Collecting 52 more samples in 25.6 s.Collecting 51 more samples in 25.1 s.Collecting 50 more samples in 24.6 s.Collecting 49 more samples in 24.2 s.Collecting 48 more samples in 23.7 s.Collecting 47 more samples in 23.2 s.Collecting 46 more samples in 22.7 s.Collecting 45 more samples in 22.2 s.Collecting 44 more samples in 21.7 s.Collecting 43 more samples in 21.2 s.Collecting 42 more samples in 20.7 s.Collecting 41 more samples in 20.2 s.Collecting 40 more samples in 19.7 s.Collecting 39 more samples in 19.2 s.Collecting 38 more samples in 18.7 s.Collecting 37 more samples in 18.2 s.Collecting 36 more samples in 17.7 s.Collecting 35 more samples in 17.3 s.Collecting 34 more samples in 16.8 s.Collecting 33 more samples in 16.3 s.Collecting 32 more samples in 15.8 s.Collecting 31 more samples in 15.3 s.Collecting 30 more samples in 14.8 s.Collecting 29 more samples in 14.3 s.Collecting 28 more samples in 13.8 s.Collecting 27 more samples in 13.3 s.Collecting 26 more samples in 12.8 s.Collecting 25 more samples in 12.3 s.Collecting 24 more samples in 11.8 s.Collecting 23 more samples in 11.3 s.Collecting 22 more samples in 10.8 s.Collecting 21 more samples in 10.4 s.Collecting 20 more samples in 9.9 s.Collecting 19 more samples in 9.4 s.Collecting 18 more samples in 8.9 s.Collecting 17 more samples in 8.4 s.Collecting 16 more samples in 7.9 s.Collecting 15 more samples in 7.4 s.Collecting 14 more samples in 6.9 s.Collecting 13 more samples in 6.4 s.Collecting 12 more samples in 5.9 s.Collecting 11 more samples in 5.4 s.Collecting 10 more samples in 4.9 s.Collecting 9 more samples in 4.4 s.Collecting 8 more samples in 3.9 s.Collecting 7 more samples in 3.5 s.Collecting 6 more samples in 3.0 s.Collecting 5 more samples in 2.5 s.Collecting 4 more samples in 2.0 s.Collecting 3 more samples in 1.5 s.Collecting 2 more samples in 1.0 s.Collecting 1 more samples in 0.5 s.mean: 506.9586 ms, lower bound: 501.6216 ms, upper bound: 516.2592 ms, confidence: 0.950 std dev: 35.04532 ms, lower bound: 23.36698 ms, upper bound: 63.02998 ms, confidence: 0.950 found 9 outliers among 100 samples (9.0%) 2 (2.0%) low mild 5 (5.0%) high mild 2 (2.0%) high severe variance introduced by outliers: 64.576% variance is severely inflated by outliers commits: 200000 retries: 399 allocated bytes: 567750720 Running a subject "4/50000/ttrie" Collecting 99 more samples in 31.5 s.Collecting 98 more samples in 31.2 s.Collecting 97 more samples in 30.9 s.Collecting 96 more samples in 30.5 s.Collecting 95 more samples in 30.2 s.Collecting 94 more samples in 29.9 s.Collecting 93 more samples in 29.6 s.Collecting 92 more samples in 29.3 s.Collecting 91 more samples in 28.9 s.Collecting 90 more samples in 28.6 s.Collecting 89 more samples in 28.3 s.Collecting 88 more samples in 28.0 s.Collecting 87 more samples in 27.7 s.Collecting 86 more samples in 27.4 s.Collecting 85 more samples in 27.0 s.Collecting 84 more samples in 26.7 s.Collecting 83 more samples in 26.4 s.Collecting 82 more samples in 26.1 s.Collecting 81 more samples in 25.8 s.Collecting 80 more samples in 25.4 s.Collecting 79 more samples in 25.1 s.Collecting 78 more samples in 24.8 s.Collecting 77 more samples in 24.5 s.Collecting 76 more samples in 24.2 s.Collecting 75 more samples in 23.9 s.Collecting 74 more samples in 23.5 s.Collecting 73 more samples in 23.2 s.Collecting 72 more samples in 22.9 s.Collecting 71 more samples in 22.6 s.Collecting 70 more samples in 22.3 s.Collecting 69 more samples in 22.0 s.Collecting 68 more samples in 21.6 s.Collecting 67 more samples in 21.3 s.Collecting 66 more samples in 21.0 s.Collecting 65 more samples in 20.7 s.Collecting 64 more samples in 20.4 s.Collecting 63 more samples in 20.0 s.Collecting 62 more samples in 19.7 s.Collecting 61 more samples in 19.4 s.Collecting 60 more samples in 19.1 s.Collecting 59 more samples in 18.8 s.Collecting 58 more samples in 18.5 s.Collecting 57 more samples in 18.1 s.Collecting 56 more samples in 17.8 s.Collecting 55 more samples in 17.5 s.Collecting 54 more samples in 17.2 s.Collecting 53 more samples in 16.9 s.Collecting 52 more samples in 16.5 s.Collecting 51 more samples in 16.2 s.Collecting 50 more samples in 15.9 s.Collecting 49 more samples in 15.6 s.Collecting 48 more samples in 15.3 s.Collecting 47 more samples in 15.0 s.Collecting 46 more samples in 14.6 s.Collecting 45 more samples in 14.3 s.Collecting 44 more samples in 14.0 s.Collecting 43 more samples in 13.7 s.Collecting 42 more samples in 13.4 s.Collecting 41 more samples in 13.0 s.Collecting 40 more samples in 12.7 s.Collecting 39 more samples in 12.4 s.Collecting 38 more samples in 12.1 s.Collecting 37 more samples in 11.8 s.Collecting 36 more samples in 11.5 s.Collecting 35 more samples in 11.1 s.Collecting 34 more samples in 10.8 s.Collecting 33 more samples in 10.5 s.Collecting 32 more samples in 10.2 s.Collecting 31 more samples in 9.9 s.Collecting 30 more samples in 9.5 s.Collecting 29 more samples in 9.2 s.Collecting 28 more samples in 8.9 s.Collecting 27 more samples in 8.6 s.Collecting 26 more samples in 8.3 s.Collecting 25 more samples in 8.0 s.Collecting 24 more samples in 7.6 s.Collecting 23 more samples in 7.3 s.Collecting 22 more samples in 7.0 s.Collecting 21 more samples in 6.7 s.Collecting 20 more samples in 6.4 s.Collecting 19 more samples in 6.0 s.Collecting 18 more samples in 5.7 s.Collecting 17 more samples in 5.4 s.Collecting 16 more samples in 5.1 s.Collecting 15 more samples in 4.8 s.Collecting 14 more samples in 4.5 s.Collecting 13 more samples in 4.1 s.Collecting 12 more samples in 3.8 s.Collecting 11 more samples in 3.5 s.Collecting 10 more samples in 3.2 s.Collecting 9 more samples in 2.9 s.Collecting 8 more samples in 2.5 s.Collecting 7 more samples in 2.2 s.Collecting 6 more samples in 1.9 s.Collecting 5 more samples in 1.6 s.Collecting 4 more samples in 1.3 s.Collecting 3 more samples in 1.0 s.Collecting 2 more samples in 0.6 s.Collecting 1 more samples in 0.3 s.mean: 310.4442 ms, lower bound: 307.5808 ms, upper bound: 313.4916 ms, confidence: 0.950 std dev: 15.15150 ms, lower bound: 13.59710 ms, upper bound: 17.72642 ms, confidence: 0.950 variance introduced by outliers: 46.489% variance is moderately inflated by outliers commits: 200000 retries: 0 allocated bytes: 223330880 Running a subject "6/33333/unordered-containers" Collecting 99 more samples in 39.0 s.Collecting 98 more samples in 38.6 s.Collecting 97 more samples in 38.2 s.Collecting 96 more samples in 37.8 s.Collecting 95 more samples in 37.4 s.Collecting 94 more samples in 37.0 s.Collecting 93 more samples in 36.6 s.Collecting 92 more samples in 36.2 s.Collecting 91 more samples in 35.8 s.Collecting 90 more samples in 35.4 s.Collecting 89 more samples in 35.0 s.Collecting 88 more samples in 34.6 s.Collecting 87 more samples in 34.2 s.Collecting 86 more samples in 33.9 s.Collecting 85 more samples in 33.5 s.Collecting 84 more samples in 33.1 s.Collecting 83 more samples in 32.7 s.Collecting 82 more samples in 32.3 s.Collecting 81 more samples in 31.9 s.Collecting 80 more samples in 31.5 s.Collecting 79 more samples in 31.1 s.Collecting 78 more samples in 30.7 s.Collecting 77 more samples in 30.3 s.Collecting 76 more samples in 29.9 s.Collecting 75 more samples in 29.5 s.Collecting 74 more samples in 29.1 s.Collecting 73 more samples in 28.7 s.Collecting 72 more samples in 28.3 s.Collecting 71 more samples in 27.9 s.Collecting 70 more samples in 27.6 s.Collecting 69 more samples in 27.2 s.Collecting 68 more samples in 26.8 s.Collecting 67 more samples in 26.4 s.Collecting 66 more samples in 26.0 s.Collecting 65 more samples in 25.6 s.Collecting 64 more samples in 25.2 s.Collecting 63 more samples in 24.8 s.Collecting 62 more samples in 24.4 s.Collecting 61 more samples in 24.0 s.Collecting 60 more samples in 23.6 s.Collecting 59 more samples in 23.2 s.Collecting 58 more samples in 22.8 s.Collecting 57 more samples in 22.4 s.Collecting 56 more samples in 22.0 s.Collecting 55 more samples in 21.6 s.Collecting 54 more samples in 21.3 s.Collecting 53 more samples in 20.9 s.Collecting 52 more samples in 20.5 s.Collecting 51 more samples in 20.1 s.Collecting 50 more samples in 19.7 s.Collecting 49 more samples in 19.3 s.Collecting 48 more samples in 18.9 s.Collecting 47 more samples in 18.5 s.Collecting 46 more samples in 18.1 s.Collecting 45 more samples in 17.7 s.Collecting 44 more samples in 17.3 s.Collecting 43 more samples in 16.9 s.Collecting 42 more samples in 16.5 s.Collecting 41 more samples in 16.1 s.Collecting 40 more samples in 15.7 s.Collecting 39 more samples in 15.4 s.Collecting 38 more samples in 15.0 s.Collecting 37 more samples in 14.6 s.Collecting 36 more samples in 14.2 s.Collecting 35 more samples in 13.8 s.Collecting 34 more samples in 13.4 s.Collecting 33 more samples in 13.0 s.Collecting 32 more samples in 12.6 s.Collecting 31 more samples in 12.2 s.Collecting 30 more samples in 11.8 s.Collecting 29 more samples in 11.4 s.Collecting 28 more samples in 11.0 s.Collecting 27 more samples in 10.6 s.Collecting 26 more samples in 10.2 s.Collecting 25 more samples in 9.8 s.Collecting 24 more samples in 9.4 s.Collecting 23 more samples in 9.1 s.Collecting 22 more samples in 8.7 s.Collecting 21 more samples in 8.3 s.Collecting 20 more samples in 7.9 s.Collecting 19 more samples in 7.5 s.Collecting 18 more samples in 7.1 s.Collecting 17 more samples in 6.7 s.Collecting 16 more samples in 6.3 s.Collecting 15 more samples in 5.9 s.Collecting 14 more samples in 5.5 s.Collecting 13 more samples in 5.1 s.Collecting 12 more samples in 4.7 s.Collecting 11 more samples in 4.3 s.Collecting 10 more samples in 3.9 s.Collecting 9 more samples in 3.5 s.Collecting 8 more samples in 3.1 s.Collecting 7 more samples in 2.8 s.Collecting 6 more samples in 2.4 s.Collecting 5 more samples in 2.0 s.Collecting 4 more samples in 1.6 s.Collecting 3 more samples in 1.2 s.Collecting 2 more samples in 0.8 s.Collecting 1 more samples in 0.4 s.mean: 403.8481 ms, lower bound: 397.6758 ms, upper bound: 409.4099 ms, confidence: 0.950 std dev: 30.04912 ms, lower bound: 25.97124 ms, upper bound: 35.62362 ms, confidence: 0.950 found 4 outliers among 100 samples (4.0%) 3 (3.0%) low mild variance introduced by outliers: 67.656% variance is severely inflated by outliers commits: 200000 retries: 317555 allocated bytes: 548599432 Running a subject "6/33333/stm-containers" Collecting 99 more samples in 31.8 s.Collecting 98 more samples in 31.4 s.Collecting 97 more samples in 31.1 s.Collecting 96 more samples in 30.8 s.Collecting 95 more samples in 30.5 s.Collecting 94 more samples in 30.2 s.Collecting 93 more samples in 29.8 s.Collecting 92 more samples in 29.5 s.Collecting 91 more samples in 29.2 s.Collecting 90 more samples in 28.9 s.Collecting 89 more samples in 28.6 s.Collecting 88 more samples in 28.2 s.Collecting 87 more samples in 27.9 s.Collecting 86 more samples in 27.6 s.Collecting 85 more samples in 27.3 s.Collecting 84 more samples in 26.9 s.Collecting 83 more samples in 26.6 s.Collecting 82 more samples in 26.3 s.Collecting 81 more samples in 26.0 s.Collecting 80 more samples in 25.7 s.Collecting 79 more samples in 25.3 s.Collecting 78 more samples in 25.0 s.Collecting 77 more samples in 24.7 s.Collecting 76 more samples in 24.4 s.Collecting 75 more samples in 24.1 s.Collecting 74 more samples in 23.7 s.Collecting 73 more samples in 23.4 s.Collecting 72 more samples in 23.1 s.Collecting 71 more samples in 22.8 s.Collecting 70 more samples in 22.5 s.Collecting 69 more samples in 22.1 s.Collecting 68 more samples in 21.8 s.Collecting 67 more samples in 21.5 s.Collecting 66 more samples in 21.2 s.Collecting 65 more samples in 20.9 s.Collecting 64 more samples in 20.5 s.Collecting 63 more samples in 20.2 s.Collecting 62 more samples in 19.9 s.Collecting 61 more samples in 19.6 s.Collecting 60 more samples in 19.2 s.Collecting 59 more samples in 18.9 s.Collecting 58 more samples in 18.6 s.Collecting 57 more samples in 18.3 s.Collecting 56 more samples in 18.0 s.Collecting 55 more samples in 17.6 s.Collecting 54 more samples in 17.3 s.Collecting 53 more samples in 17.0 s.Collecting 52 more samples in 16.7 s.Collecting 51 more samples in 16.4 s.Collecting 50 more samples in 16.0 s.Collecting 49 more samples in 15.7 s.Collecting 48 more samples in 15.4 s.Collecting 47 more samples in 15.1 s.Collecting 46 more samples in 14.8 s.Collecting 45 more samples in 14.4 s.Collecting 44 more samples in 14.1 s.Collecting 43 more samples in 13.8 s.Collecting 42 more samples in 13.5 s.Collecting 41 more samples in 13.2 s.Collecting 40 more samples in 12.8 s.Collecting 39 more samples in 12.5 s.Collecting 38 more samples in 12.2 s.Collecting 37 more samples in 11.9 s.Collecting 36 more samples in 11.5 s.Collecting 35 more samples in 11.2 s.Collecting 34 more samples in 10.9 s.Collecting 33 more samples in 10.6 s.Collecting 32 more samples in 10.3 s.Collecting 31 more samples in 9.9 s.Collecting 30 more samples in 9.6 s.Collecting 29 more samples in 9.3 s.Collecting 28 more samples in 9.0 s.Collecting 27 more samples in 8.7 s.Collecting 26 more samples in 8.3 s.Collecting 25 more samples in 8.0 s.Collecting 24 more samples in 7.7 s.Collecting 23 more samples in 7.4 s.Collecting 22 more samples in 7.1 s.Collecting 21 more samples in 6.7 s.Collecting 20 more samples in 6.4 s.Collecting 19 more samples in 6.1 s.Collecting 18 more samples in 5.8 s.Collecting 17 more samples in 5.5 s.Collecting 16 more samples in 5.1 s.Collecting 15 more samples in 4.8 s.Collecting 14 more samples in 4.5 s.Collecting 13 more samples in 4.2 s.Collecting 12 more samples in 3.8 s.Collecting 11 more samples in 3.5 s.Collecting 10 more samples in 3.2 s.Collecting 9 more samples in 2.9 s.Collecting 8 more samples in 2.6 s.Collecting 7 more samples in 2.2 s.Collecting 6 more samples in 1.9 s.Collecting 5 more samples in 1.6 s.Collecting 4 more samples in 1.3 s.Collecting 3 more samples in 1.0 s.Collecting 2 more samples in 0.6 s.Collecting 1 more samples in 0.3 s.mean: 348.6327 ms, lower bound: 345.3302 ms, upper bound: 354.0099 ms, confidence: 0.950 std dev: 21.14005 ms, lower bound: 14.77456 ms, upper bound: 33.16225 ms, confidence: 0.950 found 14 outliers among 100 samples (14.0%) 2 (2.0%) low mild 5 (5.0%) high mild 7 (7.0%) high severe variance introduced by outliers: 57.521% variance is severely inflated by outliers commits: 200000 retries: 660 allocated bytes: 567981976 Running a subject "6/33333/ttrie" Collecting 99 more samples in 21.3 s.Collecting 98 more samples in 21.1 s.Collecting 97 more samples in 20.9 s.Collecting 96 more samples in 20.7 s.Collecting 95 more samples in 20.5 s.Collecting 94 more samples in 20.3 s.Collecting 93 more samples in 20.1 s.Collecting 92 more samples in 19.8 s.Collecting 91 more samples in 19.6 s.Collecting 90 more samples in 19.4 s.Collecting 89 more samples in 19.2 s.Collecting 88 more samples in 19.0 s.Collecting 87 more samples in 18.8 s.Collecting 86 more samples in 18.5 s.Collecting 85 more samples in 18.3 s.Collecting 84 more samples in 18.1 s.Collecting 83 more samples in 17.9 s.Collecting 82 more samples in 17.7 s.Collecting 81 more samples in 17.5 s.Collecting 80 more samples in 17.3 s.Collecting 79 more samples in 17.0 s.Collecting 78 more samples in 16.8 s.Collecting 77 more samples in 16.6 s.Collecting 76 more samples in 16.4 s.Collecting 75 more samples in 16.2 s.Collecting 74 more samples in 16.0 s.Collecting 73 more samples in 15.7 s.Collecting 72 more samples in 15.5 s.Collecting 71 more samples in 15.3 s.Collecting 70 more samples in 15.1 s.Collecting 69 more samples in 14.9 s.Collecting 68 more samples in 14.7 s.Collecting 67 more samples in 14.4 s.Collecting 66 more samples in 14.2 s.Collecting 65 more samples in 14.0 s.Collecting 64 more samples in 13.8 s.Collecting 63 more samples in 13.6 s.Collecting 62 more samples in 13.4 s.Collecting 61 more samples in 13.2 s.Collecting 60 more samples in 12.9 s.Collecting 59 more samples in 12.7 s.Collecting 58 more samples in 12.5 s.Collecting 57 more samples in 12.3 s.Collecting 56 more samples in 12.1 s.Collecting 55 more samples in 11.9 s.Collecting 54 more samples in 11.6 s.Collecting 53 more samples in 11.4 s.Collecting 52 more samples in 11.2 s.Collecting 51 more samples in 11.0 s.Collecting 50 more samples in 10.8 s.Collecting 49 more samples in 10.6 s.Collecting 48 more samples in 10.4 s.Collecting 47 more samples in 10.1 s.Collecting 46 more samples in 9.9 s.Collecting 45 more samples in 9.7 s.Collecting 44 more samples in 9.5 s.Collecting 43 more samples in 9.3 s.Collecting 42 more samples in 9.1 s.Collecting 41 more samples in 8.8 s.Collecting 40 more samples in 8.6 s.Collecting 39 more samples in 8.4 s.Collecting 38 more samples in 8.2 s.Collecting 37 more samples in 8.0 s.Collecting 36 more samples in 7.8 s.Collecting 35 more samples in 7.5 s.Collecting 34 more samples in 7.3 s.Collecting 33 more samples in 7.1 s.Collecting 32 more samples in 6.9 s.Collecting 31 more samples in 6.7 s.Collecting 30 more samples in 6.5 s.Collecting 29 more samples in 6.3 s.Collecting 28 more samples in 6.0 s.Collecting 27 more samples in 5.8 s.Collecting 26 more samples in 5.6 s.Collecting 25 more samples in 5.4 s.Collecting 24 more samples in 5.2 s.Collecting 23 more samples in 5.0 s.Collecting 22 more samples in 4.7 s.Collecting 21 more samples in 4.5 s.Collecting 20 more samples in 4.3 s.Collecting 19 more samples in 4.1 s.Collecting 18 more samples in 3.9 s.Collecting 17 more samples in 3.7 s.Collecting 16 more samples in 3.5 s.Collecting 15 more samples in 3.2 s.Collecting 14 more samples in 3.0 s.Collecting 13 more samples in 2.8 s.Collecting 12 more samples in 2.6 s.Collecting 11 more samples in 2.4 s.Collecting 10 more samples in 2.2 s.Collecting 9 more samples in 1.9 s.Collecting 8 more samples in 1.7 s.Collecting 7 more samples in 1.5 s.Collecting 6 more samples in 1.3 s.Collecting 5 more samples in 1.1 s.Collecting 4 more samples in 0.9 s.Collecting 3 more samples in 0.6 s.Collecting 2 more samples in 0.4 s.Collecting 1 more samples in 0.2 s.mean: 218.4473 ms, lower bound: 216.8480 ms, upper bound: 220.4332 ms, confidence: 0.950 std dev: 9.116054 ms, lower bound: 7.051997 ms, upper bound: 11.92845 ms, confidence: 0.950 found 9 outliers among 100 samples (9.0%) 4 (4.0%) low mild 4 (4.0%) high severe variance introduced by outliers: 39.492% variance is moderately inflated by outliers commits: 200000 retries: 0 allocated bytes: 223330336 Running a subject "8/25000/unordered-containers" Collecting 99 more samples in 42.7 s.Collecting 98 more samples in 42.3 s.Collecting 97 more samples in 41.9 s.Collecting 96 more samples in 41.5 s.Collecting 95 more samples in 41.0 s.Collecting 94 more samples in 40.6 s.Collecting 93 more samples in 40.2 s.Collecting 92 more samples in 39.7 s.Collecting 91 more samples in 39.3 s.Collecting 90 more samples in 38.9 s.Collecting 89 more samples in 38.4 s.Collecting 88 more samples in 38.0 s.Collecting 87 more samples in 37.6 s.Collecting 86 more samples in 37.1 s.Collecting 85 more samples in 36.7 s.Collecting 84 more samples in 36.3 s.Collecting 83 more samples in 35.8 s.Collecting 82 more samples in 35.4 s.Collecting 81 more samples in 35.0 s.Collecting 80 more samples in 34.5 s.Collecting 79 more samples in 34.1 s.Collecting 78 more samples in 33.7 s.Collecting 77 more samples in 33.2 s.Collecting 76 more samples in 32.8 s.Collecting 75 more samples in 32.4 s.Collecting 74 more samples in 32.0 s.Collecting 73 more samples in 31.5 s.Collecting 72 more samples in 31.1 s.Collecting 71 more samples in 30.7 s.Collecting 70 more samples in 30.2 s.Collecting 69 more samples in 29.8 s.Collecting 68 more samples in 29.4 s.Collecting 67 more samples in 28.9 s.Collecting 66 more samples in 28.5 s.Collecting 65 more samples in 28.1 s.Collecting 64 more samples in 27.6 s.Collecting 63 more samples in 27.2 s.Collecting 62 more samples in 26.8 s.Collecting 61 more samples in 26.3 s.Collecting 60 more samples in 25.9 s.Collecting 59 more samples in 25.5 s.Collecting 58 more samples in 25.0 s.Collecting 57 more samples in 24.6 s.Collecting 56 more samples in 24.2 s.Collecting 55 more samples in 23.7 s.Collecting 54 more samples in 23.3 s.Collecting 53 more samples in 22.9 s.Collecting 52 more samples in 22.5 s.Collecting 51 more samples in 22.0 s.Collecting 50 more samples in 21.6 s.Collecting 49 more samples in 21.2 s.Collecting 48 more samples in 20.7 s.Collecting 47 more samples in 20.3 s.Collecting 46 more samples in 19.9 s.Collecting 45 more samples in 19.4 s.Collecting 44 more samples in 19.0 s.Collecting 43 more samples in 18.6 s.Collecting 42 more samples in 18.1 s.Collecting 41 more samples in 17.7 s.Collecting 40 more samples in 17.3 s.Collecting 39 more samples in 16.8 s.Collecting 38 more samples in 16.4 s.Collecting 37 more samples in 16.0 s.Collecting 36 more samples in 15.5 s.Collecting 35 more samples in 15.1 s.Collecting 34 more samples in 14.7 s.Collecting 33 more samples in 14.2 s.Collecting 32 more samples in 13.8 s.Collecting 31 more samples in 13.4 s.Collecting 30 more samples in 13.0 s.Collecting 29 more samples in 12.5 s.Collecting 28 more samples in 12.1 s.Collecting 27 more samples in 11.7 s.Collecting 26 more samples in 11.2 s.Collecting 25 more samples in 10.8 s.Collecting 24 more samples in 10.4 s.Collecting 23 more samples in 9.9 s.Collecting 22 more samples in 9.5 s.Collecting 21 more samples in 9.1 s.Collecting 20 more samples in 8.6 s.Collecting 19 more samples in 8.2 s.Collecting 18 more samples in 7.8 s.Collecting 17 more samples in 7.3 s.Collecting 16 more samples in 6.9 s.Collecting 15 more samples in 6.5 s.Collecting 14 more samples in 6.0 s.Collecting 13 more samples in 5.6 s.Collecting 12 more samples in 5.2 s.Collecting 11 more samples in 4.7 s.Collecting 10 more samples in 4.3 s.Collecting 9 more samples in 3.9 s.Collecting 8 more samples in 3.5 s.Collecting 7 more samples in 3.0 s.Collecting 6 more samples in 2.6 s.Collecting 5 more samples in 2.2 s.Collecting 4 more samples in 1.7 s.Collecting 3 more samples in 1.3 s.Collecting 2 more samples in 0.9 s.Collecting 1 more samples in 0.4 s.mean: 402.5011 ms, lower bound: 397.5560 ms, upper bound: 407.4514 ms, confidence: 0.950 std dev: 25.23834 ms, lower bound: 22.33269 ms, upper bound: 29.14121 ms, confidence: 0.950 found 1 outliers among 100 samples (1.0%) variance introduced by outliers: 59.521% variance is severely inflated by outliers commits: 200000 retries: 470568 allocated bytes: 934870392 Running a subject "8/25000/stm-containers" Collecting 99 more samples in 26.4 s.Collecting 98 more samples in 26.2 s.Collecting 97 more samples in 25.9 s.Collecting 96 more samples in 25.6 s.Collecting 95 more samples in 25.4 s.Collecting 94 more samples in 25.1 s.Collecting 93 more samples in 24.8 s.Collecting 92 more samples in 24.6 s.Collecting 91 more samples in 24.3 s.Collecting 90 more samples in 24.0 s.Collecting 89 more samples in 23.8 s.Collecting 88 more samples in 23.5 s.Collecting 87 more samples in 23.2 s.Collecting 86 more samples in 23.0 s.Collecting 85 more samples in 22.7 s.Collecting 84 more samples in 22.4 s.Collecting 83 more samples in 22.2 s.Collecting 82 more samples in 21.9 s.Collecting 81 more samples in 21.6 s.Collecting 80 more samples in 21.4 s.Collecting 79 more samples in 21.1 s.Collecting 78 more samples in 20.8 s.Collecting 77 more samples in 20.6 s.Collecting 76 more samples in 20.3 s.Collecting 75 more samples in 20.0 s.Collecting 74 more samples in 19.8 s.Collecting 73 more samples in 19.5 s.Collecting 72 more samples in 19.2 s.Collecting 71 more samples in 19.0 s.Collecting 70 more samples in 18.7 s.Collecting 69 more samples in 18.4 s.Collecting 68 more samples in 18.2 s.Collecting 67 more samples in 17.9 s.Collecting 66 more samples in 17.6 s.Collecting 65 more samples in 17.4 s.Collecting 64 more samples in 17.1 s.Collecting 63 more samples in 16.8 s.Collecting 62 more samples in 16.6 s.Collecting 61 more samples in 16.3 s.Collecting 60 more samples in 16.0 s.Collecting 59 more samples in 15.8 s.Collecting 58 more samples in 15.5 s.Collecting 57 more samples in 15.2 s.Collecting 56 more samples in 15.0 s.Collecting 55 more samples in 14.7 s.Collecting 54 more samples in 14.4 s.Collecting 53 more samples in 14.2 s.Collecting 52 more samples in 13.9 s.Collecting 51 more samples in 13.6 s.Collecting 50 more samples in 13.4 s.Collecting 49 more samples in 13.1 s.Collecting 48 more samples in 12.8 s.Collecting 47 more samples in 12.5 s.Collecting 46 more samples in 12.3 s.Collecting 45 more samples in 12.0 s.Collecting 44 more samples in 11.7 s.Collecting 43 more samples in 11.5 s.Collecting 42 more samples in 11.2 s.Collecting 41 more samples in 10.9 s.Collecting 40 more samples in 10.7 s.Collecting 39 more samples in 10.4 s.Collecting 38 more samples in 10.1 s.Collecting 37 more samples in 9.9 s.Collecting 36 more samples in 9.6 s.Collecting 35 more samples in 9.3 s.Collecting 34 more samples in 9.1 s.Collecting 33 more samples in 8.8 s.Collecting 32 more samples in 8.5 s.Collecting 31 more samples in 8.3 s.Collecting 30 more samples in 8.0 s.Collecting 29 more samples in 7.7 s.Collecting 28 more samples in 7.5 s.Collecting 27 more samples in 7.2 s.Collecting 26 more samples in 6.9 s.Collecting 25 more samples in 6.7 s.Collecting 24 more samples in 6.4 s.Collecting 23 more samples in 6.1 s.Collecting 22 more samples in 5.9 s.Collecting 21 more samples in 5.6 s.Collecting 20 more samples in 5.3 s.Collecting 19 more samples in 5.1 s.Collecting 18 more samples in 4.8 s.Collecting 17 more samples in 4.5 s.Collecting 16 more samples in 4.3 s.Collecting 15 more samples in 4.0 s.Collecting 14 more samples in 3.7 s.Collecting 13 more samples in 3.5 s.Collecting 12 more samples in 3.2 s.Collecting 11 more samples in 2.9 s.Collecting 10 more samples in 2.7 s.Collecting 9 more samples in 2.4 s.Collecting 8 more samples in 2.1 s.Collecting 7 more samples in 1.9 s.Collecting 6 more samples in 1.6 s.Collecting 5 more samples in 1.3 s.Collecting 4 more samples in 1.1 s.Collecting 3 more samples in 0.8 s.Collecting 2 more samples in 0.5 s.Collecting 1 more samples in 0.3 s.mean: 264.2360 ms, lower bound: 261.3322 ms, upper bound: 268.5121 ms, confidence: 0.950 std dev: 17.83026 ms, lower bound: 13.31439 ms, upper bound: 27.86853 ms, confidence: 0.950 found 6 outliers among 100 samples (6.0%) 4 (4.0%) high mild 2 (2.0%) high severe variance introduced by outliers: 63.550% variance is severely inflated by outliers commits: 200000 retries: 893 allocated bytes: 567886472 Running a subject "8/25000/ttrie" Collecting 100 more samples in 15.8 s.Collecting 99 more samples in 15.6 s.Collecting 98 more samples in 15.4 s.Collecting 97 more samples in 15.3 s.Collecting 96 more samples in 15.1 s.Collecting 95 more samples in 15.0 s.Collecting 94 more samples in 14.8 s.Collecting 93 more samples in 14.6 s.Collecting 92 more samples in 14.5 s.Collecting 91 more samples in 14.3 s.Collecting 90 more samples in 14.2 s.Collecting 89 more samples in 14.0 s.Collecting 88 more samples in 13.9 s.Collecting 87 more samples in 13.7 s.Collecting 86 more samples in 13.5 s.Collecting 85 more samples in 13.4 s.Collecting 84 more samples in 13.2 s.Collecting 83 more samples in 13.1 s.Collecting 82 more samples in 12.9 s.Collecting 81 more samples in 12.8 s.Collecting 80 more samples in 12.6 s.Collecting 79 more samples in 12.4 s.Collecting 78 more samples in 12.3 s.Collecting 77 more samples in 12.1 s.Collecting 76 more samples in 12.0 s.Collecting 75 more samples in 11.8 s.Collecting 74 more samples in 11.7 s.Collecting 73 more samples in 11.5 s.Collecting 72 more samples in 11.3 s.Collecting 71 more samples in 11.2 s.Collecting 70 more samples in 11.0 s.Collecting 69 more samples in 10.9 s.Collecting 68 more samples in 10.7 s.Collecting 67 more samples in 10.6 s.Collecting 66 more samples in 10.4 s.Collecting 65 more samples in 10.2 s.Collecting 64 more samples in 10.1 s.Collecting 63 more samples in 9.9 s.Collecting 62 more samples in 9.8 s.Collecting 61 more samples in 9.6 s.Collecting 60 more samples in 9.5 s.Collecting 59 more samples in 9.3 s.Collecting 58 more samples in 9.1 s.Collecting 57 more samples in 9.0 s.Collecting 56 more samples in 8.8 s.Collecting 55 more samples in 8.7 s.Collecting 54 more samples in 8.5 s.Collecting 53 more samples in 8.3 s.Collecting 52 more samples in 8.2 s.Collecting 51 more samples in 8.0 s.Collecting 50 more samples in 7.9 s.Collecting 49 more samples in 7.7 s.Collecting 48 more samples in 7.6 s.Collecting 47 more samples in 7.4 s.Collecting 46 more samples in 7.2 s.Collecting 45 more samples in 7.1 s.Collecting 44 more samples in 6.9 s.Collecting 43 more samples in 6.8 s.Collecting 42 more samples in 6.6 s.Collecting 41 more samples in 6.5 s.Collecting 40 more samples in 6.3 s.Collecting 39 more samples in 6.1 s.Collecting 38 more samples in 6.0 s.Collecting 37 more samples in 5.8 s.Collecting 36 more samples in 5.7 s.Collecting 35 more samples in 5.5 s.Collecting 34 more samples in 5.4 s.Collecting 33 more samples in 5.2 s.Collecting 32 more samples in 5.0 s.Collecting 31 more samples in 4.9 s.Collecting 30 more samples in 4.7 s.Collecting 29 more samples in 4.6 s.Collecting 28 more samples in 4.4 s.Collecting 27 more samples in 4.3 s.Collecting 26 more samples in 4.1 s.Collecting 25 more samples in 3.9 s.Collecting 24 more samples in 3.8 s.Collecting 23 more samples in 3.6 s.Collecting 22 more samples in 3.5 s.Collecting 21 more samples in 3.3 s.Collecting 20 more samples in 3.2 s.Collecting 19 more samples in 3.0 s.Collecting 18 more samples in 2.8 s.Collecting 17 more samples in 2.7 s.Collecting 16 more samples in 2.5 s.Collecting 15 more samples in 2.4 s.Collecting 14 more samples in 2.2 s.Collecting 13 more samples in 2.0 s.Collecting 12 more samples in 1.9 s.Collecting 11 more samples in 1.7 s.Collecting 10 more samples in 1.6 s.Collecting 9 more samples in 1.4 s.Collecting 8 more samples in 1.3 s.Collecting 7 more samples in 1.1 s.Collecting 6 more samples in 0.9 s.Collecting 5 more samples in 0.8 s.Collecting 4 more samples in 0.6 s.Collecting 3 more samples in 0.5 s.Collecting 2 more samples in 0.3 s.Collecting 1 more samples in 0.2 s.mean: 164.0905 ms, lower bound: 161.4916 ms, upper bound: 168.4021 ms, confidence: 0.950 std dev: 16.85225 ms, lower bound: 11.53169 ms, upper bound: 24.98766 ms, confidence: 0.950 found 6 outliers among 100 samples (6.0%) 5 (5.0%) high severe variance introduced by outliers: 80.028% variance is severely inflated by outliers commits: 200000 retries: 3 allocated bytes: 223345480 Running a subject "10/20000/unordered-containers" Collecting 99 more samples in 45.3 s.Collecting 98 more samples in 44.8 s.Collecting 97 more samples in 44.4 s.Collecting 96 more samples in 43.9 s.Collecting 95 more samples in 43.5 s.Collecting 94 more samples in 43.0 s.Collecting 93 more samples in 42.6 s.Collecting 92 more samples in 42.1 s.Collecting 91 more samples in 41.6 s.Collecting 90 more samples in 41.2 s.Collecting 89 more samples in 40.7 s.Collecting 88 more samples in 40.3 s.Collecting 87 more samples in 39.8 s.Collecting 86 more samples in 39.4 s.Collecting 85 more samples in 38.9 s.Collecting 84 more samples in 38.4 s.Collecting 83 more samples in 38.0 s.Collecting 82 more samples in 37.5 s.Collecting 81 more samples in 37.1 s.Collecting 80 more samples in 36.6 s.Collecting 79 more samples in 36.2 s.Collecting 78 more samples in 35.7 s.Collecting 77 more samples in 35.2 s.Collecting 76 more samples in 34.8 s.Collecting 75 more samples in 34.3 s.Collecting 74 more samples in 33.9 s.Collecting 73 more samples in 33.4 s.Collecting 72 more samples in 32.9 s.Collecting 71 more samples in 32.5 s.Collecting 70 more samples in 32.0 s.Collecting 69 more samples in 31.6 s.Collecting 68 more samples in 31.1 s.Collecting 67 more samples in 30.7 s.Collecting 66 more samples in 30.2 s.Collecting 65 more samples in 29.7 s.Collecting 64 more samples in 29.3 s.Collecting 63 more samples in 28.8 s.Collecting 62 more samples in 28.4 s.Collecting 61 more samples in 27.9 s.Collecting 60 more samples in 27.5 s.Collecting 59 more samples in 27.0 s.Collecting 58 more samples in 26.5 s.Collecting 57 more samples in 26.1 s.Collecting 56 more samples in 25.6 s.Collecting 55 more samples in 25.2 s.Collecting 54 more samples in 24.7 s.Collecting 53 more samples in 24.3 s.Collecting 52 more samples in 23.8 s.Collecting 51 more samples in 23.3 s.Collecting 50 more samples in 22.9 s.Collecting 49 more samples in 22.4 s.Collecting 48 more samples in 22.0 s.Collecting 47 more samples in 21.5 s.Collecting 46 more samples in 21.1 s.Collecting 45 more samples in 20.6 s.Collecting 44 more samples in 20.1 s.Collecting 43 more samples in 19.7 s.Collecting 42 more samples in 19.2 s.Collecting 41 more samples in 18.8 s.Collecting 40 more samples in 18.3 s.Collecting 39 more samples in 17.8 s.Collecting 38 more samples in 17.4 s.Collecting 37 more samples in 16.9 s.Collecting 36 more samples in 16.5 s.Collecting 35 more samples in 16.0 s.Collecting 34 more samples in 15.6 s.Collecting 33 more samples in 15.1 s.Collecting 32 more samples in 14.6 s.Collecting 31 more samples in 14.2 s.Collecting 30 more samples in 13.7 s.Collecting 29 more samples in 13.3 s.Collecting 28 more samples in 12.8 s.Collecting 27 more samples in 12.4 s.Collecting 26 more samples in 11.9 s.Collecting 25 more samples in 11.4 s.Collecting 24 more samples in 11.0 s.Collecting 23 more samples in 10.5 s.Collecting 22 more samples in 10.1 s.Collecting 21 more samples in 9.6 s.Collecting 20 more samples in 9.2 s.Collecting 19 more samples in 8.7 s.Collecting 18 more samples in 8.2 s.Collecting 17 more samples in 7.8 s.Collecting 16 more samples in 7.3 s.Collecting 15 more samples in 6.9 s.Collecting 14 more samples in 6.4 s.Collecting 13 more samples in 5.9 s.Collecting 12 more samples in 5.5 s.Collecting 11 more samples in 5.0 s.Collecting 10 more samples in 4.6 s.Collecting 9 more samples in 4.1 s.Collecting 8 more samples in 3.7 s.Collecting 7 more samples in 3.2 s.Collecting 6 more samples in 2.7 s.Collecting 5 more samples in 2.3 s.Collecting 4 more samples in 1.8 s.Collecting 3 more samples in 1.4 s.Collecting 2 more samples in 0.9 s.Collecting 1 more samples in 0.5 s.mean: 426.2634 ms, lower bound: 421.2039 ms, upper bound: 432.2044 ms, confidence: 0.950 std dev: 27.99459 ms, lower bound: 23.13474 ms, upper bound: 39.55714 ms, confidence: 0.950 found 1 outliers among 100 samples (1.0%) 1 (1.0%) high severe variance introduced by outliers: 61.562% variance is severely inflated by outliers commits: 200000 retries: 569399 allocated bytes: 745062272 Running a subject "10/20000/stm-containers" Collecting 99 more samples in 26.3 s.Collecting 98 more samples in 26.0 s.Collecting 97 more samples in 25.8 s.Collecting 96 more samples in 25.5 s.Collecting 95 more samples in 25.2 s.Collecting 94 more samples in 25.0 s.Collecting 93 more samples in 24.7 s.Collecting 92 more samples in 24.4 s.Collecting 91 more samples in 24.2 s.Collecting 90 more samples in 23.9 s.Collecting 89 more samples in 23.6 s.Collecting 88 more samples in 23.4 s.Collecting 87 more samples in 23.1 s.Collecting 86 more samples in 22.8 s.Collecting 85 more samples in 22.6 s.Collecting 84 more samples in 22.3 s.Collecting 83 more samples in 22.0 s.Collecting 82 more samples in 21.8 s.Collecting 81 more samples in 21.5 s.Collecting 80 more samples in 21.2 s.Collecting 79 more samples in 21.0 s.Collecting 78 more samples in 20.7 s.Collecting 77 more samples in 20.4 s.Collecting 76 more samples in 20.2 s.Collecting 75 more samples in 19.9 s.Collecting 74 more samples in 19.6 s.Collecting 73 more samples in 19.4 s.Collecting 72 more samples in 19.1 s.Collecting 71 more samples in 18.9 s.Collecting 70 more samples in 18.6 s.Collecting 69 more samples in 18.3 s.Collecting 68 more samples in 18.1 s.Collecting 67 more samples in 17.8 s.Collecting 66 more samples in 17.5 s.Collecting 65 more samples in 17.3 s.Collecting 64 more samples in 17.0 s.Collecting 63 more samples in 16.7 s.Collecting 62 more samples in 16.5 s.Collecting 61 more samples in 16.2 s.Collecting 60 more samples in 15.9 s.Collecting 59 more samples in 15.7 s.Collecting 58 more samples in 15.4 s.Collecting 57 more samples in 15.1 s.Collecting 56 more samples in 14.9 s.Collecting 55 more samples in 14.6 s.Collecting 54 more samples in 14.3 s.Collecting 53 more samples in 14.1 s.Collecting 52 more samples in 13.8 s.Collecting 51 more samples in 13.5 s.Collecting 50 more samples in 13.3 s.Collecting 49 more samples in 13.0 s.Collecting 48 more samples in 12.7 s.Collecting 47 more samples in 12.5 s.Collecting 46 more samples in 12.2 s.Collecting 45 more samples in 11.9 s.Collecting 44 more samples in 11.7 s.Collecting 43 more samples in 11.4 s.Collecting 42 more samples in 11.2 s.Collecting 41 more samples in 10.9 s.Collecting 40 more samples in 10.6 s.Collecting 39 more samples in 10.4 s.Collecting 38 more samples in 10.1 s.Collecting 37 more samples in 9.8 s.Collecting 36 more samples in 9.6 s.Collecting 35 more samples in 9.3 s.Collecting 34 more samples in 9.0 s.Collecting 33 more samples in 8.8 s.Collecting 32 more samples in 8.5 s.Collecting 31 more samples in 8.2 s.Collecting 30 more samples in 8.0 s.Collecting 29 more samples in 7.7 s.Collecting 28 more samples in 7.4 s.Collecting 27 more samples in 7.2 s.Collecting 26 more samples in 6.9 s.Collecting 25 more samples in 6.6 s.Collecting 24 more samples in 6.4 s.Collecting 23 more samples in 6.1 s.Collecting 22 more samples in 5.8 s.Collecting 21 more samples in 5.6 s.Collecting 20 more samples in 5.3 s.Collecting 19 more samples in 5.0 s.Collecting 18 more samples in 4.8 s.Collecting 17 more samples in 4.5 s.Collecting 16 more samples in 4.2 s.Collecting 15 more samples in 4.0 s.Collecting 14 more samples in 3.7 s.Collecting 13 more samples in 3.5 s.Collecting 12 more samples in 3.2 s.Collecting 11 more samples in 2.9 s.Collecting 10 more samples in 2.7 s.Collecting 9 more samples in 2.4 s.Collecting 8 more samples in 2.1 s.Collecting 7 more samples in 1.9 s.Collecting 6 more samples in 1.6 s.Collecting 5 more samples in 1.3 s.Collecting 4 more samples in 1.1 s.Collecting 3 more samples in 0.8 s.Collecting 2 more samples in 0.5 s.Collecting 1 more samples in 0.3 s.mean: 222.7457 ms, lower bound: 218.3078 ms, upper bound: 229.6199 ms, confidence: 0.950 std dev: 27.89807 ms, lower bound: 19.76586 ms, upper bound: 38.19684 ms, confidence: 0.950 found 12 outliers among 100 samples (12.0%) 4 (4.0%) high mild 8 (8.0%) high severe variance introduced by outliers: 86.246% variance is severely inflated by outliers commits: 200000 retries: 1071 allocated bytes: 568095336 Running a subject "10/20000/ttrie" Collecting 100 more samples in 15.2 s.Collecting 99 more samples in 15.1 s.Collecting 98 more samples in 14.9 s.Collecting 97 more samples in 14.8 s.Collecting 96 more samples in 14.6 s.Collecting 95 more samples in 14.5 s.Collecting 94 more samples in 14.3 s.Collecting 93 more samples in 14.2 s.Collecting 92 more samples in 14.0 s.Collecting 91 more samples in 13.9 s.Collecting 90 more samples in 13.7 s.Collecting 89 more samples in 13.6 s.Collecting 88 more samples in 13.4 s.Collecting 87 more samples in 13.2 s.Collecting 86 more samples in 13.1 s.Collecting 85 more samples in 12.9 s.Collecting 84 more samples in 12.8 s.Collecting 83 more samples in 12.6 s.Collecting 82 more samples in 12.5 s.Collecting 81 more samples in 12.3 s.Collecting 80 more samples in 12.2 s.Collecting 79 more samples in 12.0 s.Collecting 78 more samples in 11.9 s.Collecting 77 more samples in 11.7 s.Collecting 76 more samples in 11.6 s.Collecting 75 more samples in 11.4 s.Collecting 74 more samples in 11.3 s.Collecting 73 more samples in 11.1 s.Collecting 72 more samples in 11.0 s.Collecting 71 more samples in 10.8 s.Collecting 70 more samples in 10.7 s.Collecting 69 more samples in 10.5 s.Collecting 68 more samples in 10.4 s.Collecting 67 more samples in 10.2 s.Collecting 66 more samples in 10.1 s.Collecting 65 more samples in 9.9 s.Collecting 64 more samples in 9.7 s.Collecting 63 more samples in 9.6 s.Collecting 62 more samples in 9.4 s.Collecting 61 more samples in 9.3 s.Collecting 60 more samples in 9.1 s.Collecting 59 more samples in 9.0 s.Collecting 58 more samples in 8.8 s.Collecting 57 more samples in 8.7 s.Collecting 56 more samples in 8.5 s.Collecting 55 more samples in 8.4 s.Collecting 54 more samples in 8.2 s.Collecting 53 more samples in 8.1 s.Collecting 52 more samples in 7.9 s.Collecting 51 more samples in 7.8 s.Collecting 50 more samples in 7.6 s.Collecting 49 more samples in 7.5 s.Collecting 48 more samples in 7.3 s.Collecting 47 more samples in 7.2 s.Collecting 46 more samples in 7.0 s.Collecting 45 more samples in 6.9 s.Collecting 44 more samples in 6.7 s.Collecting 43 more samples in 6.5 s.Collecting 42 more samples in 6.4 s.Collecting 41 more samples in 6.2 s.Collecting 40 more samples in 6.1 s.Collecting 39 more samples in 5.9 s.Collecting 38 more samples in 5.8 s.Collecting 37 more samples in 5.6 s.Collecting 36 more samples in 5.5 s.Collecting 35 more samples in 5.3 s.Collecting 34 more samples in 5.2 s.Collecting 33 more samples in 5.0 s.Collecting 32 more samples in 4.9 s.Collecting 31 more samples in 4.7 s.Collecting 30 more samples in 4.6 s.Collecting 29 more samples in 4.4 s.Collecting 28 more samples in 4.3 s.Collecting 27 more samples in 4.1 s.Collecting 26 more samples in 4.0 s.Collecting 25 more samples in 3.8 s.Collecting 24 more samples in 3.7 s.Collecting 23 more samples in 3.5 s.Collecting 22 more samples in 3.4 s.Collecting 21 more samples in 3.2 s.Collecting 20 more samples in 3.0 s.Collecting 19 more samples in 2.9 s.Collecting 18 more samples in 2.7 s.Collecting 17 more samples in 2.6 s.Collecting 16 more samples in 2.4 s.Collecting 15 more samples in 2.3 s.Collecting 14 more samples in 2.1 s.Collecting 13 more samples in 2.0 s.Collecting 12 more samples in 1.8 s.Collecting 11 more samples in 1.7 s.Collecting 10 more samples in 1.5 s.Collecting 9 more samples in 1.4 s.Collecting 8 more samples in 1.2 s.Collecting 7 more samples in 1.1 s.Collecting 6 more samples in 0.9 s.Collecting 5 more samples in 0.8 s.Collecting 4 more samples in 0.6 s.Collecting 3 more samples in 0.5 s.Collecting 2 more samples in 0.3 s.Collecting 1 more samples in 0.2 s.mean: 135.2670 ms, lower bound: 132.1934 ms, upper bound: 139.5612 ms, confidence: 0.950 std dev: 18.52026 ms, lower bound: 14.27430 ms, upper bound: 24.09869 ms, confidence: 0.950 found 7 outliers among 100 samples (7.0%) 3 (3.0%) high mild 4 (4.0%) high severe variance introduced by outliers: 88.340% variance is severely inflated by outliers commits: 200000 retries: 1 allocated bytes: 223326960 Running a subject "12/16666/unordered-containers" Collecting 99 more samples in 45.6 s.Collecting 98 more samples in 45.1 s.Collecting 97 more samples in 44.7 s.Collecting 96 more samples in 44.2 s.Collecting 95 more samples in 43.8 s.Collecting 94 more samples in 43.3 s.Collecting 93 more samples in 42.8 s.Collecting 92 more samples in 42.4 s.Collecting 91 more samples in 41.9 s.Collecting 90 more samples in 41.5 s.Collecting 89 more samples in 41.0 s.Collecting 88 more samples in 40.5 s.Collecting 87 more samples in 40.1 s.Collecting 86 more samples in 39.6 s.Collecting 85 more samples in 39.2 s.Collecting 84 more samples in 38.7 s.Collecting 83 more samples in 38.2 s.Collecting 82 more samples in 37.8 s.Collecting 81 more samples in 37.3 s.Collecting 80 more samples in 36.9 s.Collecting 79 more samples in 36.4 s.Collecting 78 more samples in 35.9 s.Collecting 77 more samples in 35.5 s.Collecting 76 more samples in 35.0 s.Collecting 75 more samples in 34.6 s.Collecting 74 more samples in 34.1 s.Collecting 73 more samples in 33.6 s.Collecting 72 more samples in 33.2 s.Collecting 71 more samples in 32.7 s.Collecting 70 more samples in 32.2 s.Collecting 69 more samples in 31.8 s.Collecting 68 more samples in 31.3 s.Collecting 67 more samples in 30.9 s.Collecting 66 more samples in 30.4 s.Collecting 65 more samples in 29.9 s.Collecting 64 more samples in 29.5 s.Collecting 63 more samples in 29.0 s.Collecting 62 more samples in 28.6 s.Collecting 61 more samples in 28.1 s.Collecting 60 more samples in 27.6 s.Collecting 59 more samples in 27.2 s.Collecting 58 more samples in 26.7 s.Collecting 57 more samples in 26.3 s.Collecting 56 more samples in 25.8 s.Collecting 55 more samples in 25.3 s.Collecting 54 more samples in 24.9 s.Collecting 53 more samples in 24.4 s.Collecting 52 more samples in 24.0 s.Collecting 51 more samples in 23.5 s.Collecting 50 more samples in 23.0 s.Collecting 49 more samples in 22.6 s.Collecting 48 more samples in 22.1 s.Collecting 47 more samples in 21.7 s.Collecting 46 more samples in 21.2 s.Collecting 45 more samples in 20.7 s.Collecting 44 more samples in 20.3 s.Collecting 43 more samples in 19.8 s.Collecting 42 more samples in 19.3 s.Collecting 41 more samples in 18.9 s.Collecting 40 more samples in 18.4 s.Collecting 39 more samples in 18.0 s.Collecting 38 more samples in 17.5 s.Collecting 37 more samples in 17.0 s.Collecting 36 more samples in 16.6 s.Collecting 35 more samples in 16.1 s.Collecting 34 more samples in 15.7 s.Collecting 33 more samples in 15.2 s.Collecting 32 more samples in 14.7 s.Collecting 31 more samples in 14.3 s.Collecting 30 more samples in 13.8 s.Collecting 29 more samples in 13.4 s.Collecting 28 more samples in 12.9 s.Collecting 27 more samples in 12.4 s.Collecting 26 more samples in 12.0 s.Collecting 25 more samples in 11.5 s.Collecting 24 more samples in 11.1 s.Collecting 23 more samples in 10.6 s.Collecting 22 more samples in 10.1 s.Collecting 21 more samples in 9.7 s.Collecting 20 more samples in 9.2 s.Collecting 19 more samples in 8.8 s.Collecting 18 more samples in 8.3 s.Collecting 17 more samples in 7.8 s.Collecting 16 more samples in 7.4 s.Collecting 15 more samples in 6.9 s.Collecting 14 more samples in 6.4 s.Collecting 13 more samples in 6.0 s.Collecting 12 more samples in 5.5 s.Collecting 11 more samples in 5.1 s.Collecting 10 more samples in 4.6 s.Collecting 9 more samples in 4.1 s.Collecting 8 more samples in 3.7 s.Collecting 7 more samples in 3.2 s.Collecting 6 more samples in 2.8 s.Collecting 5 more samples in 2.3 s.Collecting 4 more samples in 1.8 s.Collecting 3 more samples in 1.4 s.Collecting 2 more samples in 0.9 s.Collecting 1 more samples in 0.5 s.mean: 453.4523 ms, lower bound: 447.2484 ms, upper bound: 463.5425 ms, confidence: 0.950 std dev: 39.88134 ms, lower bound: 27.27608 ms, upper bound: 67.83721 ms, confidence: 0.950 found 10 outliers among 100 samples (10.0%) 2 (2.0%) low mild 6 (6.0%) high mild 2 (2.0%) high severe variance introduced by outliers: 74.833% variance is severely inflated by outliers commits: 200000 retries: 642710 allocated bytes: 703835608 Running a subject "12/16666/stm-containers" Collecting 100 more samples in 17.3 s.Collecting 99 more samples in 17.1 s.Collecting 98 more samples in 17.0 s.Collecting 97 more samples in 16.8 s.Collecting 96 more samples in 16.6 s.Collecting 95 more samples in 16.4 s.Collecting 94 more samples in 16.3 s.Collecting 93 more samples in 16.1 s.Collecting 92 more samples in 15.9 s.Collecting 91 more samples in 15.8 s.Collecting 90 more samples in 15.6 s.Collecting 89 more samples in 15.4 s.Collecting 88 more samples in 15.2 s.Collecting 87 more samples in 15.1 s.Collecting 86 more samples in 14.9 s.Collecting 85 more samples in 14.7 s.Collecting 84 more samples in 14.5 s.Collecting 83 more samples in 14.4 s.Collecting 82 more samples in 14.2 s.Collecting 81 more samples in 14.0 s.Collecting 80 more samples in 13.9 s.Collecting 79 more samples in 13.7 s.Collecting 78 more samples in 13.5 s.Collecting 77 more samples in 13.3 s.Collecting 76 more samples in 13.2 s.Collecting 75 more samples in 13.0 s.Collecting 74 more samples in 12.8 s.Collecting 73 more samples in 12.6 s.Collecting 72 more samples in 12.5 s.Collecting 71 more samples in 12.3 s.Collecting 70 more samples in 12.1 s.Collecting 69 more samples in 11.9 s.Collecting 68 more samples in 11.8 s.Collecting 67 more samples in 11.6 s.Collecting 66 more samples in 11.4 s.Collecting 65 more samples in 11.3 s.Collecting 64 more samples in 11.1 s.Collecting 63 more samples in 10.9 s.Collecting 62 more samples in 10.7 s.Collecting 61 more samples in 10.6 s.Collecting 60 more samples in 10.4 s.Collecting 59 more samples in 10.2 s.Collecting 58 more samples in 10.0 s.Collecting 57 more samples in 9.9 s.Collecting 56 more samples in 9.7 s.Collecting 55 more samples in 9.5 s.Collecting 54 more samples in 9.3 s.Collecting 53 more samples in 9.2 s.Collecting 52 more samples in 9.0 s.Collecting 51 more samples in 8.8 s.Collecting 50 more samples in 8.7 s.Collecting 49 more samples in 8.5 s.Collecting 48 more samples in 8.3 s.Collecting 47 more samples in 8.1 s.Collecting 46 more samples in 8.0 s.Collecting 45 more samples in 7.8 s.Collecting 44 more samples in 7.6 s.Collecting 43 more samples in 7.4 s.Collecting 42 more samples in 7.3 s.Collecting 41 more samples in 7.1 s.Collecting 40 more samples in 6.9 s.Collecting 39 more samples in 6.8 s.Collecting 38 more samples in 6.6 s.Collecting 37 more samples in 6.4 s.Collecting 36 more samples in 6.2 s.Collecting 35 more samples in 6.1 s.Collecting 34 more samples in 5.9 s.Collecting 33 more samples in 5.7 s.Collecting 32 more samples in 5.5 s.Collecting 31 more samples in 5.4 s.Collecting 30 more samples in 5.2 s.Collecting 29 more samples in 5.0 s.Collecting 28 more samples in 4.8 s.Collecting 27 more samples in 4.7 s.Collecting 26 more samples in 4.5 s.Collecting 25 more samples in 4.3 s.Collecting 24 more samples in 4.2 s.Collecting 23 more samples in 4.0 s.Collecting 22 more samples in 3.8 s.Collecting 21 more samples in 3.6 s.Collecting 20 more samples in 3.5 s.Collecting 19 more samples in 3.3 s.Collecting 18 more samples in 3.1 s.Collecting 17 more samples in 2.9 s.Collecting 16 more samples in 2.8 s.Collecting 15 more samples in 2.6 s.Collecting 14 more samples in 2.4 s.Collecting 13 more samples in 2.3 s.Collecting 12 more samples in 2.1 s.Collecting 11 more samples in 1.9 s.Collecting 10 more samples in 1.7 s.Collecting 9 more samples in 1.6 s.Collecting 8 more samples in 1.4 s.Collecting 7 more samples in 1.2 s.Collecting 6 more samples in 1.0 s.Collecting 5 more samples in 0.9 s.Collecting 4 more samples in 0.7 s.Collecting 3 more samples in 0.5 s.Collecting 2 more samples in 0.3 s.Collecting 1 more samples in 0.2 s.mean: 197.1855 ms, lower bound: 190.4390 ms, upper bound: 210.2607 ms, confidence: 0.950 std dev: 46.69378 ms, lower bound: 27.69593 ms, upper bound: 81.44648 ms, confidence: 0.950 found 7 outliers among 100 samples (7.0%) 4 (4.0%) high mild 3 (3.0%) high severe variance introduced by outliers: 95.743% variance is severely inflated by outliers commits: 200000 retries: 1328 allocated bytes: 568597072 Running a subject "12/16666/ttrie" Collecting 100 more samples in 12.9 s.Collecting 99 more samples in 12.8 s.Collecting 98 more samples in 12.7 s.Collecting 97 more samples in 12.5 s.Collecting 96 more samples in 12.4 s.Collecting 95 more samples in 12.3 s.Collecting 94 more samples in 12.2 s.Collecting 93 more samples in 12.0 s.Collecting 92 more samples in 11.9 s.Collecting 91 more samples in 11.8 s.Collecting 90 more samples in 11.6 s.Collecting 89 more samples in 11.5 s.Collecting 88 more samples in 11.4 s.Collecting 87 more samples in 11.3 s.Collecting 86 more samples in 11.1 s.Collecting 85 more samples in 11.0 s.Collecting 84 more samples in 10.9 s.Collecting 83 more samples in 10.7 s.Collecting 82 more samples in 10.6 s.Collecting 81 more samples in 10.5 s.Collecting 80 more samples in 10.3 s.Collecting 79 more samples in 10.2 s.Collecting 78 more samples in 10.1 s.Collecting 77 more samples in 10.0 s.Collecting 76 more samples in 9.8 s.Collecting 75 more samples in 9.7 s.Collecting 74 more samples in 9.6 s.Collecting 73 more samples in 9.4 s.Collecting 72 more samples in 9.3 s.Collecting 71 more samples in 9.2 s.Collecting 70 more samples in 9.1 s.Collecting 69 more samples in 8.9 s.Collecting 68 more samples in 8.8 s.Collecting 67 more samples in 8.7 s.Collecting 66 more samples in 8.5 s.Collecting 65 more samples in 8.4 s.Collecting 64 more samples in 8.3 s.Collecting 63 more samples in 8.1 s.Collecting 62 more samples in 8.0 s.Collecting 61 more samples in 7.9 s.Collecting 60 more samples in 7.8 s.Collecting 59 more samples in 7.6 s.Collecting 58 more samples in 7.5 s.Collecting 57 more samples in 7.4 s.Collecting 56 more samples in 7.2 s.Collecting 55 more samples in 7.1 s.Collecting 54 more samples in 7.0 s.Collecting 53 more samples in 6.9 s.Collecting 52 more samples in 6.7 s.Collecting 51 more samples in 6.6 s.Collecting 50 more samples in 6.5 s.Collecting 49 more samples in 6.3 s.Collecting 48 more samples in 6.2 s.Collecting 47 more samples in 6.1 s.Collecting 46 more samples in 5.9 s.Collecting 45 more samples in 5.8 s.Collecting 44 more samples in 5.7 s.Collecting 43 more samples in 5.6 s.Collecting 42 more samples in 5.4 s.Collecting 41 more samples in 5.3 s.Collecting 40 more samples in 5.2 s.Collecting 39 more samples in 5.0 s.Collecting 38 more samples in 4.9 s.Collecting 37 more samples in 4.8 s.Collecting 36 more samples in 4.7 s.Collecting 35 more samples in 4.5 s.Collecting 34 more samples in 4.4 s.Collecting 33 more samples in 4.3 s.Collecting 32 more samples in 4.1 s.Collecting 31 more samples in 4.0 s.Collecting 30 more samples in 3.9 s.Collecting 29 more samples in 3.8 s.Collecting 28 more samples in 3.6 s.Collecting 27 more samples in 3.5 s.Collecting 26 more samples in 3.4 s.Collecting 25 more samples in 3.2 s.Collecting 24 more samples in 3.1 s.Collecting 23 more samples in 3.0 s.Collecting 22 more samples in 2.8 s.Collecting 21 more samples in 2.7 s.Collecting 20 more samples in 2.6 s.Collecting 19 more samples in 2.5 s.Collecting 18 more samples in 2.3 s.Collecting 17 more samples in 2.2 s.Collecting 16 more samples in 2.1 s.Collecting 15 more samples in 1.9 s.Collecting 14 more samples in 1.8 s.Collecting 13 more samples in 1.7 s.Collecting 12 more samples in 1.6 s.Collecting 11 more samples in 1.4 s.Collecting 10 more samples in 1.3 s.Collecting 9 more samples in 1.2 s.Collecting 8 more samples in 1.0 s.Collecting 7 more samples in 0.9 s.Collecting 6 more samples in 0.8 s.Collecting 5 more samples in 0.6 s.Collecting 4 more samples in 0.5 s.Collecting 3 more samples in 0.4 s.Collecting 2 more samples in 0.3 s.Collecting 1 more samples in 0.1 s.mean: 125.1850 ms, lower bound: 122.0332 ms, upper bound: 129.0500 ms, confidence: 0.950 std dev: 17.87774 ms, lower bound: 15.00491 ms, upper bound: 22.07573 ms, confidence: 0.950 found 3 outliers among 100 samples (3.0%) 3 (3.0%) high mild variance introduced by outliers: 89.379% variance is severely inflated by outliers commits: 200000 retries: 2 allocated bytes: 223362328 Running a subject "14/14285/unordered-containers" Collecting 99 more samples in 51.2 s.Collecting 98 more samples in 50.7 s.Collecting 97 more samples in 50.2 s.Collecting 96 more samples in 49.6 s.Collecting 95 more samples in 49.1 s.Collecting 94 more samples in 48.6 s.Collecting 93 more samples in 48.1 s.Collecting 92 more samples in 47.6 s.Collecting 91 more samples in 47.1 s.Collecting 90 more samples in 46.5 s.Collecting 89 more samples in 46.0 s.Collecting 88 more samples in 45.5 s.Collecting 87 more samples in 45.0 s.Collecting 86 more samples in 44.5 s.Collecting 85 more samples in 44.0 s.Collecting 84 more samples in 43.4 s.Collecting 83 more samples in 42.9 s.Collecting 82 more samples in 42.4 s.Collecting 81 more samples in 41.9 s.Collecting 80 more samples in 41.4 s.Collecting 79 more samples in 40.9 s.Collecting 78 more samples in 40.3 s.Collecting 77 more samples in 39.8 s.Collecting 76 more samples in 39.3 s.Collecting 75 more samples in 38.8 s.Collecting 74 more samples in 38.3 s.Collecting 73 more samples in 37.7 s.Collecting 72 more samples in 37.2 s.Collecting 71 more samples in 36.7 s.Collecting 70 more samples in 36.2 s.Collecting 69 more samples in 35.7 s.Collecting 68 more samples in 35.2 s.Collecting 67 more samples in 34.6 s.Collecting 66 more samples in 34.1 s.Collecting 65 more samples in 33.6 s.Collecting 64 more samples in 33.1 s.Collecting 63 more samples in 32.6 s.Collecting 62 more samples in 32.1 s.Collecting 61 more samples in 31.5 s.Collecting 60 more samples in 31.0 s.Collecting 59 more samples in 30.5 s.Collecting 58 more samples in 30.0 s.Collecting 57 more samples in 29.5 s.Collecting 56 more samples in 29.0 s.Collecting 55 more samples in 28.4 s.Collecting 54 more samples in 27.9 s.Collecting 53 more samples in 27.4 s.Collecting 52 more samples in 26.9 s.Collecting 51 more samples in 26.4 s.Collecting 50 more samples in 25.9 s.Collecting 49 more samples in 25.3 s.Collecting 48 more samples in 24.8 s.Collecting 47 more samples in 24.3 s.Collecting 46 more samples in 23.8 s.Collecting 45 more samples in 23.3 s.Collecting 44 more samples in 22.8 s.Collecting 43 more samples in 22.2 s.Collecting 42 more samples in 21.7 s.Collecting 41 more samples in 21.2 s.Collecting 40 more samples in 20.7 s.Collecting 39 more samples in 20.2 s.Collecting 38 more samples in 19.6 s.Collecting 37 more samples in 19.1 s.Collecting 36 more samples in 18.6 s.Collecting 35 more samples in 18.1 s.Collecting 34 more samples in 17.6 s.Collecting 33 more samples in 17.1 s.Collecting 32 more samples in 16.5 s.Collecting 31 more samples in 16.0 s.Collecting 30 more samples in 15.5 s.Collecting 29 more samples in 15.0 s.Collecting 28 more samples in 14.5 s.Collecting 27 more samples in 14.0 s.Collecting 26 more samples in 13.4 s.Collecting 25 more samples in 12.9 s.Collecting 24 more samples in 12.4 s.Collecting 23 more samples in 11.9 s.Collecting 22 more samples in 11.4 s.Collecting 21 more samples in 10.9 s.Collecting 20 more samples in 10.3 s.Collecting 19 more samples in 9.8 s.Collecting 18 more samples in 9.3 s.Collecting 17 more samples in 8.8 s.Collecting 16 more samples in 8.3 s.Collecting 15 more samples in 7.8 s.Collecting 14 more samples in 7.2 s.Collecting 13 more samples in 6.7 s.Collecting 12 more samples in 6.2 s.Collecting 11 more samples in 5.7 s.Collecting 10 more samples in 5.2 s.Collecting 9 more samples in 4.7 s.Collecting 8 more samples in 4.1 s.Collecting 7 more samples in 3.6 s.Collecting 6 more samples in 3.1 s.Collecting 5 more samples in 2.6 s.Collecting 4 more samples in 2.1 s.Collecting 3 more samples in 1.6 s.Collecting 2 more samples in 1.0 s.Collecting 1 more samples in 0.5 s.mean: 494.1789 ms, lower bound: 477.3659 ms, upper bound: 519.6365 ms, confidence: 0.950 std dev: 104.3285 ms, lower bound: 75.77348 ms, upper bound: 147.8905 ms, confidence: 0.950 found 6 outliers among 100 samples (6.0%) 3 (3.0%) high mild 3 (3.0%) high severe variance introduced by outliers: 94.684% variance is severely inflated by outliers commits: 200000 retries: 774809 allocated bytes: 1063430152 Running a subject "14/14285/stm-containers" Collecting 100 more samples in 17.5 s.Collecting 99 more samples in 17.3 s.Collecting 98 more samples in 17.1 s.Collecting 97 more samples in 17.0 s.Collecting 96 more samples in 16.8 s.Collecting 95 more samples in 16.6 s.Collecting 94 more samples in 16.4 s.Collecting 93 more samples in 16.3 s.Collecting 92 more samples in 16.1 s.Collecting 91 more samples in 15.9 s.Collecting 90 more samples in 15.7 s.Collecting 89 more samples in 15.6 s.Collecting 88 more samples in 15.4 s.Collecting 87 more samples in 15.2 s.Collecting 86 more samples in 15.0 s.Collecting 85 more samples in 14.9 s.Collecting 84 more samples in 14.7 s.Collecting 83 more samples in 14.5 s.Collecting 82 more samples in 14.3 s.Collecting 81 more samples in 14.2 s.Collecting 80 more samples in 14.0 s.Collecting 79 more samples in 13.8 s.Collecting 78 more samples in 13.6 s.Collecting 77 more samples in 13.5 s.Collecting 76 more samples in 13.3 s.Collecting 75 more samples in 13.1 s.Collecting 74 more samples in 12.9 s.Collecting 73 more samples in 12.8 s.Collecting 72 more samples in 12.6 s.Collecting 71 more samples in 12.4 s.Collecting 70 more samples in 12.2 s.Collecting 69 more samples in 12.1 s.Collecting 68 more samples in 11.9 s.Collecting 67 more samples in 11.7 s.Collecting 66 more samples in 11.5 s.Collecting 65 more samples in 11.4 s.Collecting 64 more samples in 11.2 s.Collecting 63 more samples in 11.0 s.Collecting 62 more samples in 10.8 s.Collecting 61 more samples in 10.7 s.Collecting 60 more samples in 10.5 s.Collecting 59 more samples in 10.3 s.Collecting 58 more samples in 10.1 s.Collecting 57 more samples in 10.0 s.Collecting 56 more samples in 9.8 s.Collecting 55 more samples in 9.6 s.Collecting 54 more samples in 9.4 s.Collecting 53 more samples in 9.3 s.Collecting 52 more samples in 9.1 s.Collecting 51 more samples in 8.9 s.Collecting 50 more samples in 8.7 s.Collecting 49 more samples in 8.6 s.Collecting 48 more samples in 8.4 s.Collecting 47 more samples in 8.2 s.Collecting 46 more samples in 8.0 s.Collecting 45 more samples in 7.9 s.Collecting 44 more samples in 7.7 s.Collecting 43 more samples in 7.5 s.Collecting 42 more samples in 7.3 s.Collecting 41 more samples in 7.2 s.Collecting 40 more samples in 7.0 s.Collecting 39 more samples in 6.8 s.Collecting 38 more samples in 6.6 s.Collecting 37 more samples in 6.5 s.Collecting 36 more samples in 6.3 s.Collecting 35 more samples in 6.1 s.Collecting 34 more samples in 5.9 s.Collecting 33 more samples in 5.8 s.Collecting 32 more samples in 5.6 s.Collecting 31 more samples in 5.4 s.Collecting 30 more samples in 5.2 s.Collecting 29 more samples in 5.1 s.Collecting 28 more samples in 4.9 s.Collecting 27 more samples in 4.7 s.Collecting 26 more samples in 4.5 s.Collecting 25 more samples in 4.4 s.Collecting 24 more samples in 4.2 s.Collecting 23 more samples in 4.0 s.Collecting 22 more samples in 3.8 s.Collecting 21 more samples in 3.7 s.Collecting 20 more samples in 3.5 s.Collecting 19 more samples in 3.3 s.Collecting 18 more samples in 3.1 s.Collecting 17 more samples in 3.0 s.Collecting 16 more samples in 2.8 s.Collecting 15 more samples in 2.6 s.Collecting 14 more samples in 2.4 s.Collecting 13 more samples in 2.3 s.Collecting 12 more samples in 2.1 s.Collecting 11 more samples in 1.9 s.Collecting 10 more samples in 1.7 s.Collecting 9 more samples in 1.6 s.Collecting 8 more samples in 1.4 s.Collecting 7 more samples in 1.2 s.Collecting 6 more samples in 1.0 s.Collecting 5 more samples in 0.9 s.Collecting 4 more samples in 0.7 s.Collecting 3 more samples in 0.5 s.Collecting 2 more samples in 0.3 s.Collecting 1 more samples in 0.2 s.mean: 181.0595 ms, lower bound: 175.7539 ms, upper bound: 189.2817 ms, confidence: 0.950 std dev: 33.12687 ms, lower bound: 23.70664 ms, upper bound: 52.59158 ms, confidence: 0.950 found 6 outliers among 100 samples (6.0%) 4 (4.0%) high mild 2 (2.0%) high severe variance introduced by outliers: 93.588% variance is severely inflated by outliers commits: 200000 retries: 1318 allocated bytes: 568472936 Running a subject "14/14285/ttrie" Collecting 100 more samples in 11.9 s.Collecting 99 more samples in 11.8 s.Collecting 98 more samples in 11.7 s.Collecting 97 more samples in 11.6 s.Collecting 96 more samples in 11.5 s.Collecting 95 more samples in 11.3 s.Collecting 94 more samples in 11.2 s.Collecting 93 more samples in 11.1 s.Collecting 92 more samples in 11.0 s.Collecting 91 more samples in 10.9 s.Collecting 90 more samples in 10.7 s.Collecting 89 more samples in 10.6 s.Collecting 88 more samples in 10.5 s.Collecting 87 more samples in 10.4 s.Collecting 86 more samples in 10.3 s.Collecting 85 more samples in 10.1 s.Collecting 84 more samples in 10.0 s.Collecting 83 more samples in 9.9 s.Collecting 82 more samples in 9.8 s.Collecting 81 more samples in 9.7 s.Collecting 80 more samples in 9.5 s.Collecting 79 more samples in 9.4 s.Collecting 78 more samples in 9.3 s.Collecting 77 more samples in 9.2 s.Collecting 76 more samples in 9.1 s.Collecting 75 more samples in 9.0 s.Collecting 74 more samples in 8.8 s.Collecting 73 more samples in 8.7 s.Collecting 72 more samples in 8.6 s.Collecting 71 more samples in 8.5 s.Collecting 70 more samples in 8.4 s.Collecting 69 more samples in 8.2 s.Collecting 68 more samples in 8.1 s.Collecting 67 more samples in 8.0 s.Collecting 66 more samples in 7.9 s.Collecting 65 more samples in 7.8 s.Collecting 64 more samples in 7.6 s.Collecting 63 more samples in 7.5 s.Collecting 62 more samples in 7.4 s.Collecting 61 more samples in 7.3 s.Collecting 60 more samples in 7.2 s.Collecting 59 more samples in 7.0 s.Collecting 58 more samples in 6.9 s.Collecting 57 more samples in 6.8 s.Collecting 56 more samples in 6.7 s.Collecting 55 more samples in 6.6 s.Collecting 54 more samples in 6.4 s.Collecting 53 more samples in 6.3 s.Collecting 52 more samples in 6.2 s.Collecting 51 more samples in 6.1 s.Collecting 50 more samples in 6.0 s.Collecting 49 more samples in 5.8 s.Collecting 48 more samples in 5.7 s.Collecting 47 more samples in 5.6 s.Collecting 46 more samples in 5.5 s.Collecting 45 more samples in 5.4 s.Collecting 44 more samples in 5.3 s.Collecting 43 more samples in 5.1 s.Collecting 42 more samples in 5.0 s.Collecting 41 more samples in 4.9 s.Collecting 40 more samples in 4.8 s.Collecting 39 more samples in 4.7 s.Collecting 38 more samples in 4.5 s.Collecting 37 more samples in 4.4 s.Collecting 36 more samples in 4.3 s.Collecting 35 more samples in 4.2 s.Collecting 34 more samples in 4.1 s.Collecting 33 more samples in 3.9 s.Collecting 32 more samples in 3.8 s.Collecting 31 more samples in 3.7 s.Collecting 30 more samples in 3.6 s.Collecting 29 more samples in 3.5 s.Collecting 28 more samples in 3.3 s.Collecting 27 more samples in 3.2 s.Collecting 26 more samples in 3.1 s.Collecting 25 more samples in 3.0 s.Collecting 24 more samples in 2.9 s.Collecting 23 more samples in 2.7 s.Collecting 22 more samples in 2.6 s.Collecting 21 more samples in 2.5 s.Collecting 20 more samples in 2.4 s.Collecting 19 more samples in 2.3 s.Collecting 18 more samples in 2.1 s.Collecting 17 more samples in 2.0 s.Collecting 16 more samples in 1.9 s.Collecting 15 more samples in 1.8 s.Collecting 14 more samples in 1.7 s.Collecting 13 more samples in 1.6 s.Collecting 12 more samples in 1.4 s.Collecting 11 more samples in 1.3 s.Collecting 10 more samples in 1.2 s.Collecting 9 more samples in 1.1 s.Collecting 8 more samples in 1.0 s.Collecting 7 more samples in 0.8 s.Collecting 6 more samples in 0.7 s.Collecting 5 more samples in 0.6 s.Collecting 4 more samples in 0.5 s.Collecting 3 more samples in 0.4 s.Collecting 2 more samples in 0.2 s.Collecting 1 more samples in 0.1 s.mean: 121.3558 ms, lower bound: 117.6670 ms, upper bound: 125.3690 ms, confidence: 0.950 std dev: 19.72251 ms, lower bound: 17.67290 ms, upper bound: 22.00430 ms, confidence: 0.950 variance introduced by outliers: 91.499% variance is severely inflated by outliers commits: 200000 retries: 0 allocated bytes: 223362720 Running a subject "16/12500/unordered-containers" Collecting 99 more samples in 47.8 s.Collecting 98 more samples in 47.3 s.Collecting 97 more samples in 46.8 s.Collecting 96 more samples in 46.3 s.Collecting 95 more samples in 45.8 s.Collecting 94 more samples in 45.4 s.Collecting 93 more samples in 44.9 s.Collecting 92 more samples in 44.4 s.Collecting 91 more samples in 43.9 s.Collecting 90 more samples in 43.4 s.Collecting 89 more samples in 43.0 s.Collecting 88 more samples in 42.5 s.Collecting 87 more samples in 42.0 s.Collecting 86 more samples in 41.5 s.Collecting 85 more samples in 41.0 s.Collecting 84 more samples in 40.5 s.Collecting 83 more samples in 40.1 s.Collecting 82 more samples in 39.6 s.Collecting 81 more samples in 39.1 s.Collecting 80 more samples in 38.6 s.Collecting 79 more samples in 38.1 s.Collecting 78 more samples in 37.6 s.Collecting 77 more samples in 37.2 s.Collecting 76 more samples in 36.7 s.Collecting 75 more samples in 36.2 s.Collecting 74 more samples in 35.7 s.Collecting 73 more samples in 35.2 s.Collecting 72 more samples in 34.7 s.Collecting 71 more samples in 34.3 s.Collecting 70 more samples in 33.8 s.Collecting 69 more samples in 33.3 s.Collecting 68 more samples in 32.8 s.Collecting 67 more samples in 32.3 s.Collecting 66 more samples in 31.9 s.Collecting 65 more samples in 31.4 s.Collecting 64 more samples in 30.9 s.Collecting 63 more samples in 30.4 s.Collecting 62 more samples in 29.9 s.Collecting 61 more samples in 29.4 s.Collecting 60 more samples in 29.0 s.Collecting 59 more samples in 28.5 s.Collecting 58 more samples in 28.0 s.Collecting 57 more samples in 27.5 s.Collecting 56 more samples in 27.0 s.Collecting 55 more samples in 26.5 s.Collecting 54 more samples in 26.1 s.Collecting 53 more samples in 25.6 s.Collecting 52 more samples in 25.1 s.Collecting 51 more samples in 24.6 s.Collecting 50 more samples in 24.1 s.Collecting 49 more samples in 23.6 s.Collecting 48 more samples in 23.2 s.Collecting 47 more samples in 22.7 s.Collecting 46 more samples in 22.2 s.Collecting 45 more samples in 21.7 s.Collecting 44 more samples in 21.2 s.Collecting 43 more samples in 20.8 s.Collecting 42 more samples in 20.3 s.Collecting 41 more samples in 19.8 s.Collecting 40 more samples in 19.3 s.Collecting 39 more samples in 18.8 s.Collecting 38 more samples in 18.3 s.Collecting 37 more samples in 17.9 s.Collecting 36 more samples in 17.4 s.Collecting 35 more samples in 16.9 s.Collecting 34 more samples in 16.4 s.Collecting 33 more samples in 15.9 s.Collecting 32 more samples in 15.4 s.Collecting 31 more samples in 15.0 s.Collecting 30 more samples in 14.5 s.Collecting 29 more samples in 14.0 s.Collecting 28 more samples in 13.5 s.Collecting 27 more samples in 13.0 s.Collecting 26 more samples in 12.5 s.Collecting 25 more samples in 12.1 s.Collecting 24 more samples in 11.6 s.Collecting 23 more samples in 11.1 s.Collecting 22 more samples in 10.6 s.Collecting 21 more samples in 10.1 s.Collecting 20 more samples in 9.7 s.Collecting 19 more samples in 9.2 s.Collecting 18 more samples in 8.7 s.Collecting 17 more samples in 8.2 s.Collecting 16 more samples in 7.7 s.Collecting 15 more samples in 7.2 s.Collecting 14 more samples in 6.8 s.Collecting 13 more samples in 6.3 s.Collecting 12 more samples in 5.8 s.Collecting 11 more samples in 5.3 s.Collecting 10 more samples in 4.8 s.Collecting 9 more samples in 4.3 s.Collecting 8 more samples in 3.9 s.Collecting 7 more samples in 3.4 s.Collecting 6 more samples in 2.9 s.Collecting 5 more samples in 2.4 s.Collecting 4 more samples in 1.9 s.Collecting 3 more samples in 1.4 s.Collecting 2 more samples in 1.0 s.Collecting 1 more samples in 0.5 s.mean: 518.4260 ms, lower bound: 505.9979 ms, upper bound: 535.9330 ms, confidence: 0.950 std dev: 74.94974 ms, lower bound: 56.69799 ms, upper bound: 105.1869 ms, confidence: 0.950 found 4 outliers among 100 samples (4.0%) 2 (2.0%) high mild 2 (2.0%) high severe variance introduced by outliers: 89.394% variance is severely inflated by outliers commits: 200000 retries: 966659 allocated bytes: 933735432 Running a subject "16/12500/stm-containers" Collecting 100 more samples in 19.3 s.Collecting 99 more samples in 19.1 s.Collecting 98 more samples in 18.9 s.Collecting 97 more samples in 18.7 s.Collecting 96 more samples in 18.5 s.Collecting 95 more samples in 18.3 s.Collecting 94 more samples in 18.1 s.Collecting 93 more samples in 17.9 s.Collecting 92 more samples in 17.7 s.Collecting 91 more samples in 17.6 s.Collecting 90 more samples in 17.4 s.Collecting 89 more samples in 17.2 s.Collecting 88 more samples in 17.0 s.Collecting 87 more samples in 16.8 s.Collecting 86 more samples in 16.6 s.Collecting 85 more samples in 16.4 s.Collecting 84 more samples in 16.2 s.Collecting 83 more samples in 16.0 s.Collecting 82 more samples in 15.8 s.Collecting 81 more samples in 15.6 s.Collecting 80 more samples in 15.4 s.Collecting 79 more samples in 15.2 s.Collecting 78 more samples in 15.0 s.Collecting 77 more samples in 14.9 s.Collecting 76 more samples in 14.7 s.Collecting 75 more samples in 14.5 s.Collecting 74 more samples in 14.3 s.Collecting 73 more samples in 14.1 s.Collecting 72 more samples in 13.9 s.Collecting 71 more samples in 13.7 s.Collecting 70 more samples in 13.5 s.Collecting 69 more samples in 13.3 s.Collecting 68 more samples in 13.1 s.Collecting 67 more samples in 12.9 s.Collecting 66 more samples in 12.7 s.Collecting 65 more samples in 12.5 s.Collecting 64 more samples in 12.3 s.Collecting 63 more samples in 12.2 s.Collecting 62 more samples in 12.0 s.Collecting 61 more samples in 11.8 s.Collecting 60 more samples in 11.6 s.Collecting 59 more samples in 11.4 s.Collecting 58 more samples in 11.2 s.Collecting 57 more samples in 11.0 s.Collecting 56 more samples in 10.8 s.Collecting 55 more samples in 10.6 s.Collecting 54 more samples in 10.4 s.Collecting 53 more samples in 10.2 s.Collecting 52 more samples in 10.0 s.Collecting 51 more samples in 9.8 s.Collecting 50 more samples in 9.6 s.Collecting 49 more samples in 9.5 s.Collecting 48 more samples in 9.3 s.Collecting 47 more samples in 9.1 s.Collecting 46 more samples in 8.9 s.Collecting 45 more samples in 8.7 s.Collecting 44 more samples in 8.5 s.Collecting 43 more samples in 8.3 s.Collecting 42 more samples in 8.1 s.Collecting 41 more samples in 7.9 s.Collecting 40 more samples in 7.7 s.Collecting 39 more samples in 7.5 s.Collecting 38 more samples in 7.3 s.Collecting 37 more samples in 7.1 s.Collecting 36 more samples in 6.9 s.Collecting 35 more samples in 6.8 s.Collecting 34 more samples in 6.6 s.Collecting 33 more samples in 6.4 s.Collecting 32 more samples in 6.2 s.Collecting 31 more samples in 6.0 s.Collecting 30 more samples in 5.8 s.Collecting 29 more samples in 5.6 s.Collecting 28 more samples in 5.4 s.Collecting 27 more samples in 5.2 s.Collecting 26 more samples in 5.0 s.Collecting 25 more samples in 4.8 s.Collecting 24 more samples in 4.6 s.Collecting 23 more samples in 4.4 s.Collecting 22 more samples in 4.2 s.Collecting 21 more samples in 4.1 s.Collecting 20 more samples in 3.9 s.Collecting 19 more samples in 3.7 s.Collecting 18 more samples in 3.5 s.Collecting 17 more samples in 3.3 s.Collecting 16 more samples in 3.1 s.Collecting 15 more samples in 2.9 s.Collecting 14 more samples in 2.7 s.Collecting 13 more samples in 2.5 s.Collecting 12 more samples in 2.3 s.Collecting 11 more samples in 2.1 s.Collecting 10 more samples in 1.9 s.Collecting 9 more samples in 1.7 s.Collecting 8 more samples in 1.5 s.Collecting 7 more samples in 1.4 s.Collecting 6 more samples in 1.2 s.Collecting 5 more samples in 1.0 s.Collecting 4 more samples in 0.8 s.Collecting 3 more samples in 0.6 s.Collecting 2 more samples in 0.4 s.Collecting 1 more samples in 0.2 s.mean: 175.8776 ms, lower bound: 171.0630 ms, upper bound: 181.6156 ms, confidence: 0.950 std dev: 26.90541 ms, lower bound: 23.03302 ms, upper bound: 32.67364 ms, confidence: 0.950 found 2 outliers among 100 samples (2.0%) 2 (2.0%) high mild variance introduced by outliers: 90.447% variance is severely inflated by outliers commits: 200000 retries: 1407 allocated bytes: 568632648 Running a subject "16/12500/ttrie" Collecting 100 more samples in 11.7 s.Collecting 99 more samples in 11.6 s.Collecting 98 more samples in 11.5 s.Collecting 97 more samples in 11.4 s.Collecting 96 more samples in 11.2 s.Collecting 95 more samples in 11.1 s.Collecting 94 more samples in 11.0 s.Collecting 93 more samples in 10.9 s.Collecting 92 more samples in 10.8 s.Collecting 91 more samples in 10.6 s.Collecting 90 more samples in 10.5 s.Collecting 89 more samples in 10.4 s.Collecting 88 more samples in 10.3 s.Collecting 87 more samples in 10.2 s.Collecting 86 more samples in 10.1 s.Collecting 85 more samples in 9.9 s.Collecting 84 more samples in 9.8 s.Collecting 83 more samples in 9.7 s.Collecting 82 more samples in 9.6 s.Collecting 81 more samples in 9.5 s.Collecting 80 more samples in 9.4 s.Collecting 79 more samples in 9.2 s.Collecting 78 more samples in 9.1 s.Collecting 77 more samples in 9.0 s.Collecting 76 more samples in 8.9 s.Collecting 75 more samples in 8.8 s.Collecting 74 more samples in 8.7 s.Collecting 73 more samples in 8.5 s.Collecting 72 more samples in 8.4 s.Collecting 71 more samples in 8.3 s.Collecting 70 more samples in 8.2 s.Collecting 69 more samples in 8.1 s.Collecting 68 more samples in 8.0 s.Collecting 67 more samples in 7.8 s.Collecting 66 more samples in 7.7 s.Collecting 65 more samples in 7.6 s.Collecting 64 more samples in 7.5 s.Collecting 63 more samples in 7.4 s.Collecting 62 more samples in 7.3 s.Collecting 61 more samples in 7.1 s.Collecting 60 more samples in 7.0 s.Collecting 59 more samples in 6.9 s.Collecting 58 more samples in 6.8 s.Collecting 57 more samples in 6.7 s.Collecting 56 more samples in 6.6 s.Collecting 55 more samples in 6.4 s.Collecting 54 more samples in 6.3 s.Collecting 53 more samples in 6.2 s.Collecting 52 more samples in 6.1 s.Collecting 51 more samples in 6.0 s.Collecting 50 more samples in 5.9 s.Collecting 49 more samples in 5.7 s.Collecting 48 more samples in 5.6 s.Collecting 47 more samples in 5.5 s.Collecting 46 more samples in 5.4 s.Collecting 45 more samples in 5.3 s.Collecting 44 more samples in 5.1 s.Collecting 43 more samples in 5.0 s.Collecting 42 more samples in 4.9 s.Collecting 41 more samples in 4.8 s.Collecting 40 more samples in 4.7 s.Collecting 39 more samples in 4.6 s.Collecting 38 more samples in 4.4 s.Collecting 37 more samples in 4.3 s.Collecting 36 more samples in 4.2 s.Collecting 35 more samples in 4.1 s.Collecting 34 more samples in 4.0 s.Collecting 33 more samples in 3.9 s.Collecting 32 more samples in 3.7 s.Collecting 31 more samples in 3.6 s.Collecting 30 more samples in 3.5 s.Collecting 29 more samples in 3.4 s.Collecting 28 more samples in 3.3 s.Collecting 27 more samples in 3.2 s.Collecting 26 more samples in 3.0 s.Collecting 25 more samples in 2.9 s.Collecting 24 more samples in 2.8 s.Collecting 23 more samples in 2.7 s.Collecting 22 more samples in 2.6 s.Collecting 21 more samples in 2.5 s.Collecting 20 more samples in 2.3 s.Collecting 19 more samples in 2.2 s.Collecting 18 more samples in 2.1 s.Collecting 17 more samples in 2.0 s.Collecting 16 more samples in 1.9 s.Collecting 15 more samples in 1.8 s.Collecting 14 more samples in 1.6 s.Collecting 13 more samples in 1.5 s.Collecting 12 more samples in 1.4 s.Collecting 11 more samples in 1.3 s.Collecting 10 more samples in 1.2 s.Collecting 9 more samples in 1.1 s.Collecting 8 more samples in 0.9 s.Collecting 7 more samples in 0.8 s.Collecting 6 more samples in 0.7 s.Collecting 5 more samples in 0.6 s.Collecting 4 more samples in 0.5 s.Collecting 3 more samples in 0.4 s.Collecting 2 more samples in 0.2 s.Collecting 1 more samples in 0.1 s.mean: 109.0157 ms, lower bound: 106.0956 ms, upper bound: 112.1690 ms, confidence: 0.950 std dev: 15.49308 ms, lower bound: 13.72949 ms, upper bound: 18.54153 ms, confidence: 0.950 found 1 outliers among 100 samples (1.0%) variance introduced by outliers: 88.387% variance is severely inflated by outliers commits: 200000 retries: 3 allocated bytes: 223368840 Benchmark bench: FINISH