Package has never been configured. Configuring with default flags. If this fails, please run configure manually. Resolving dependencies... Configuring ttrie-0.1.2... Preprocessing library ttrie-0.1.2... [1 of 2] Compiling Data.SparseArray ( src/Data/SparseArray.hs, dist/build/Data/SparseArray.o ) [2 of 2] Compiling Control.Concurrent.STM.Map ( src/Control/Concurrent/STM/Map.hs, dist/build/Control/Concurrent/STM/Map.o ) In-place registering ttrie-0.1.2... Preprocessing benchmark 'bench' for ttrie-0.1.2... [1 of 2] Compiling BenchGen ( benchmarks/BenchGen.hs, dist/build/bench/bench-tmp/BenchGen.o ) [2 of 2] Compiling Main ( benchmarks/Bench.hs, dist/build/bench/bench-tmp/Main.o ) Linking dist/build/bench/bench ... Running 1 benchmarks... Benchmark bench: RUNNING... threads = [1,2,4,6,8,10,12,14,16] numTransactions = 200000 sizes = [(1,1)] numPrefill = 0 ops = (1,0,0,0) Generating 0 random keys to prefill... Generating 200000 random transactions... warming up estimating clock resolution... mean is 3.217720 us (160001 iterations) found 4700 outliers among 159999 samples (2.9%) 3594 (2.2%) high severe estimating cost of a clock call... mean is 814.5105 ns (21 iterations) Running a subject "1/200000/unordered-containers" Collecting 99 more samples in 113.7 s.Collecting 98 more samples in 112.5 s.Collecting 97 more samples in 111.4 s.Collecting 96 more samples in 110.2 s.Collecting 95 more samples in 109.1 s.Collecting 94 more samples in 107.9 s.Collecting 93 more samples in 106.8 s.Collecting 92 more samples in 105.6 s.Collecting 91 more samples in 104.5 s.Collecting 90 more samples in 103.3 s.Collecting 89 more samples in 102.2 s.Collecting 88 more samples in 101.0 s.Collecting 87 more samples in 99.9 s.Collecting 86 more samples in 98.7 s.Collecting 85 more samples in 97.6 s.Collecting 84 more samples in 96.5 s.Collecting 83 more samples in 95.3 s.Collecting 82 more samples in 94.2 s.Collecting 81 more samples in 93.0 s.Collecting 80 more samples in 91.9 s.Collecting 79 more samples in 90.7 s.Collecting 78 more samples in 89.6 s.Collecting 77 more samples in 88.4 s.Collecting 76 more samples in 87.3 s.Collecting 75 more samples in 86.1 s.Collecting 74 more samples in 85.0 s.Collecting 73 more samples in 83.8 s.Collecting 72 more samples in 82.7 s.Collecting 71 more samples in 81.5 s.Collecting 70 more samples in 80.4 s.Collecting 69 more samples in 79.2 s.Collecting 68 more samples in 78.1 s.Collecting 67 more samples in 76.9 s.Collecting 66 more samples in 75.8 s.Collecting 65 more samples in 74.6 s.Collecting 64 more samples in 73.5 s.Collecting 63 more samples in 72.3 s.Collecting 62 more samples in 71.2 s.Collecting 61 more samples in 70.0 s.Collecting 60 more samples in 68.9 s.Collecting 59 more samples in 67.7 s.Collecting 58 more samples in 66.6 s.Collecting 57 more samples in 65.4 s.Collecting 56 more samples in 64.3 s.Collecting 55 more samples in 63.2 s.Collecting 54 more samples in 62.0 s.Collecting 53 more samples in 60.9 s.Collecting 52 more samples in 59.7 s.Collecting 51 more samples in 58.6 s.Collecting 50 more samples in 57.4 s.Collecting 49 more samples in 56.3 s.Collecting 48 more samples in 55.1 s.Collecting 47 more samples in 54.0 s.Collecting 46 more samples in 52.8 s.Collecting 45 more samples in 51.7 s.Collecting 44 more samples in 50.5 s.Collecting 43 more samples in 49.4 s.Collecting 42 more samples in 48.2 s.Collecting 41 more samples in 47.1 s.Collecting 40 more samples in 45.9 s.Collecting 39 more samples in 44.8 s.Collecting 38 more samples in 43.6 s.Collecting 37 more samples in 42.5 s.Collecting 36 more samples in 41.3 s.Collecting 35 more samples in 40.2 s.Collecting 34 more samples in 39.0 s.Collecting 33 more samples in 37.9 s.Collecting 32 more samples in 36.7 s.Collecting 31 more samples in 35.6 s.Collecting 30 more samples in 34.4 s.Collecting 29 more samples in 33.3 s.Collecting 28 more samples in 32.2 s.Collecting 27 more samples in 31.0 s.Collecting 26 more samples in 29.9 s.Collecting 25 more samples in 28.7 s.Collecting 24 more samples in 27.6 s.Collecting 23 more samples in 26.4 s.Collecting 22 more samples in 25.3 s.Collecting 21 more samples in 24.1 s.Collecting 20 more samples in 23.0 s.Collecting 19 more samples in 21.8 s.Collecting 18 more samples in 20.7 s.Collecting 17 more samples in 19.5 s.Collecting 16 more samples in 18.4 s.Collecting 15 more samples in 17.2 s.Collecting 14 more samples in 16.1 s.Collecting 13 more samples in 14.9 s.Collecting 12 more samples in 13.8 s.Collecting 11 more samples in 12.6 s.Collecting 10 more samples in 11.5 s.Collecting 9 more samples in 10.3 s.Collecting 8 more samples in 9.2 s.Collecting 7 more samples in 8.0 s.Collecting 6 more samples in 6.9 s.Collecting 5 more samples in 5.7 s.Collecting 4 more samples in 4.6 s.Collecting 3 more samples in 3.4 s.Collecting 2 more samples in 2.3 s.Collecting 1 more samples in 1.1 s.mean: 703.7403 ms, lower bound: 679.3598 ms, upper bound: 742.3997 ms, confidence: 0.950 std dev: 155.7528 ms, lower bound: 111.5980 ms, upper bound: 229.6995 ms, confidence: 0.950 found 8 outliers among 100 samples (8.0%) 4 (4.0%) high mild 4 (4.0%) high severe variance introduced by outliers: 95.706% variance is severely inflated by outliers commits: 200000 retries: 0 allocated bytes: 168519336 Running a subject "1/200000/stm-containers" Collecting 99 more samples in 82.2 s.Collecting 98 more samples in 81.3 s.Collecting 97 more samples in 80.5 s.Collecting 96 more samples in 79.7 s.Collecting 95 more samples in 78.8 s.Collecting 94 more samples in 78.0 s.Collecting 93 more samples in 77.2 s.Collecting 92 more samples in 76.4 s.Collecting 91 more samples in 75.5 s.Collecting 90 more samples in 74.7 s.Collecting 89 more samples in 73.9 s.Collecting 88 more samples in 73.0 s.Collecting 87 more samples in 72.2 s.Collecting 86 more samples in 71.4 s.Collecting 85 more samples in 70.5 s.Collecting 84 more samples in 69.7 s.Collecting 83 more samples in 68.9 s.Collecting 82 more samples in 68.1 s.Collecting 81 more samples in 67.2 s.Collecting 80 more samples in 66.4 s.Collecting 79 more samples in 65.6 s.Collecting 78 more samples in 64.7 s.Collecting 77 more samples in 63.9 s.Collecting 76 more samples in 63.1 s.Collecting 75 more samples in 62.2 s.Collecting 74 more samples in 61.4 s.Collecting 73 more samples in 60.6 s.Collecting 72 more samples in 59.8 s.Collecting 71 more samples in 58.9 s.Collecting 70 more samples in 58.1 s.Collecting 69 more samples in 57.3 s.Collecting 68 more samples in 56.4 s.Collecting 67 more samples in 55.6 s.Collecting 66 more samples in 54.8 s.Collecting 65 more samples in 53.9 s.Collecting 64 more samples in 53.1 s.Collecting 63 more samples in 52.3 s.Collecting 62 more samples in 51.5 s.Collecting 61 more samples in 50.6 s.Collecting 60 more samples in 49.8 s.Collecting 59 more samples in 49.0 s.Collecting 58 more samples in 48.1 s.Collecting 57 more samples in 47.3 s.Collecting 56 more samples in 46.5 s.Collecting 55 more samples in 45.6 s.Collecting 54 more samples in 44.8 s.Collecting 53 more samples in 44.0 s.Collecting 52 more samples in 43.2 s.Collecting 51 more samples in 42.3 s.Collecting 50 more samples in 41.5 s.Collecting 49 more samples in 40.7 s.Collecting 48 more samples in 39.8 s.Collecting 47 more samples in 39.0 s.Collecting 46 more samples in 38.2 s.Collecting 45 more samples in 37.3 s.Collecting 44 more samples in 36.5 s.Collecting 43 more samples in 35.7 s.Collecting 42 more samples in 34.9 s.Collecting 41 more samples in 34.0 s.Collecting 40 more samples in 33.2 s.Collecting 39 more samples in 32.4 s.Collecting 38 more samples in 31.5 s.Collecting 37 more samples in 30.7 s.Collecting 36 more samples in 29.9 s.Collecting 35 more samples in 29.0 s.Collecting 34 more samples in 28.2 s.Collecting 33 more samples in 27.4 s.Collecting 32 more samples in 26.6 s.Collecting 31 more samples in 25.7 s.Collecting 30 more samples in 24.9 s.Collecting 29 more samples in 24.1 s.Collecting 28 more samples in 23.2 s.Collecting 27 more samples in 22.4 s.Collecting 26 more samples in 21.6 s.Collecting 25 more samples in 20.7 s.Collecting 24 more samples in 19.9 s.Collecting 23 more samples in 19.1 s.Collecting 22 more samples in 18.3 s.Collecting 21 more samples in 17.4 s.Collecting 20 more samples in 16.6 s.Collecting 19 more samples in 15.8 s.Collecting 18 more samples in 14.9 s.Collecting 17 more samples in 14.1 s.Collecting 16 more samples in 13.3 s.Collecting 15 more samples in 12.4 s.Collecting 14 more samples in 11.6 s.Collecting 13 more samples in 10.8 s.Collecting 12 more samples in 10.0 s.Collecting 11 more samples in 9.1 s.Collecting 10 more samples in 8.3 s.Collecting 9 more samples in 7.5 s.Collecting 8 more samples in 6.6 s.Collecting 7 more samples in 5.8 s.Collecting 6 more samples in 5.0 s.Collecting 5 more samples in 4.1 s.Collecting 4 more samples in 3.3 s.Collecting 3 more samples in 2.5 s.Collecting 2 more samples in 1.7 s.Collecting 1 more samples in 0.8 s.mean: 764.5761 ms, lower bound: 751.7144 ms, upper bound: 783.6862 ms, confidence: 0.950 std dev: 79.01725 ms, lower bound: 54.65158 ms, upper bound: 120.7677 ms, confidence: 0.950 found 2 outliers among 100 samples (2.0%) 2 (2.0%) high severe variance introduced by outliers: 80.040% variance is severely inflated by outliers commits: 200000 retries: 0 allocated bytes: 264357824 Running a subject "1/200000/ttrie" Collecting 99 more samples in 84.3 s.Collecting 98 more samples in 83.4 s.Collecting 97 more samples in 82.6 s.Collecting 96 more samples in 81.7 s.Collecting 95 more samples in 80.9 s.Collecting 94 more samples in 80.0 s.Collecting 93 more samples in 79.2 s.Collecting 92 more samples in 78.3 s.Collecting 91 more samples in 77.5 s.Collecting 90 more samples in 76.6 s.Collecting 89 more samples in 75.8 s.Collecting 88 more samples in 74.9 s.Collecting 87 more samples in 74.1 s.Collecting 86 more samples in 73.2 s.Collecting 85 more samples in 72.4 s.Collecting 84 more samples in 71.5 s.Collecting 83 more samples in 70.7 s.Collecting 82 more samples in 69.8 s.Collecting 81 more samples in 69.0 s.Collecting 80 more samples in 68.1 s.Collecting 79 more samples in 67.3 s.Collecting 78 more samples in 66.4 s.Collecting 77 more samples in 65.6 s.Collecting 76 more samples in 64.7 s.Collecting 75 more samples in 63.9 s.Collecting 74 more samples in 63.0 s.Collecting 73 more samples in 62.2 s.Collecting 72 more samples in 61.3 s.Collecting 71 more samples in 60.5 s.Collecting 70 more samples in 59.6 s.Collecting 69 more samples in 58.8 s.Collecting 68 more samples in 57.9 s.Collecting 67 more samples in 57.1 s.Collecting 66 more samples in 56.2 s.Collecting 65 more samples in 55.3 s.Collecting 64 more samples in 54.5 s.Collecting 63 more samples in 53.6 s.Collecting 62 more samples in 52.8 s.Collecting 61 more samples in 51.9 s.Collecting 60 more samples in 51.1 s.Collecting 59 more samples in 50.2 s.Collecting 58 more samples in 49.4 s.Collecting 57 more samples in 48.5 s.Collecting 56 more samples in 47.7 s.Collecting 55 more samples in 46.8 s.Collecting 54 more samples in 46.0 s.Collecting 53 more samples in 45.1 s.Collecting 52 more samples in 44.3 s.Collecting 51 more samples in 43.4 s.Collecting 50 more samples in 42.6 s.Collecting 49 more samples in 41.7 s.Collecting 48 more samples in 40.9 s.Collecting 47 more samples in 40.0 s.Collecting 46 more samples in 39.2 s.Collecting 45 more samples in 38.3 s.Collecting 44 more samples in 37.5 s.Collecting 43 more samples in 36.6 s.Collecting 42 more samples in 35.8 s.Collecting 41 more samples in 34.9 s.Collecting 40 more samples in 34.1 s.Collecting 39 more samples in 33.2 s.Collecting 38 more samples in 32.4 s.Collecting 37 more samples in 31.5 s.Collecting 36 more samples in 30.7 s.Collecting 35 more samples in 29.8 s.Collecting 34 more samples in 29.0 s.Collecting 33 more samples in 28.1 s.Collecting 32 more samples in 27.2 s.Collecting 31 more samples in 26.4 s.Collecting 30 more samples in 25.5 s.Collecting 29 more samples in 24.7 s.Collecting 28 more samples in 23.8 s.Collecting 27 more samples in 23.0 s.Collecting 26 more samples in 22.1 s.Collecting 25 more samples in 21.3 s.Collecting 24 more samples in 20.4 s.Collecting 23 more samples in 19.6 s.Collecting 22 more samples in 18.7 s.Collecting 21 more samples in 17.9 s.Collecting 20 more samples in 17.0 s.Collecting 19 more samples in 16.2 s.Collecting 18 more samples in 15.3 s.Collecting 17 more samples in 14.5 s.Collecting 16 more samples in 13.6 s.Collecting 15 more samples in 12.8 s.Collecting 14 more samples in 11.9 s.Collecting 13 more samples in 11.1 s.Collecting 12 more samples in 10.2 s.Collecting 11 more samples in 9.4 s.Collecting 10 more samples in 8.5 s.Collecting 9 more samples in 7.7 s.Collecting 8 more samples in 6.8 s.Collecting 7 more samples in 6.0 s.Collecting 6 more samples in 5.1 s.Collecting 5 more samples in 4.3 s.Collecting 4 more samples in 3.4 s.Collecting 3 more samples in 2.6 s.Collecting 2 more samples in 1.7 s.Collecting 1 more samples in 0.9 s.mean: 662.7944 ms, lower bound: 654.8641 ms, upper bound: 672.3716 ms, confidence: 0.950 std dev: 44.48495 ms, lower bound: 36.66502 ms, upper bound: 58.94619 ms, confidence: 0.950 found 2 outliers among 100 samples (2.0%) 2 (2.0%) high mild variance introduced by outliers: 62.579% variance is severely inflated by outliers commits: 200000 retries: 0 allocated bytes: 140911568 Running a subject "2/100000/unordered-containers" Collecting 99 more samples in 56.2 s.Collecting 98 more samples in 55.7 s.Collecting 97 more samples in 55.1 s.Collecting 96 more samples in 54.5 s.Collecting 95 more samples in 54.0 s.Collecting 94 more samples in 53.4 s.Collecting 93 more samples in 52.8 s.Collecting 92 more samples in 52.3 s.Collecting 91 more samples in 51.7 s.Collecting 90 more samples in 51.1 s.Collecting 89 more samples in 50.6 s.Collecting 88 more samples in 50.0 s.Collecting 87 more samples in 49.4 s.Collecting 86 more samples in 48.8 s.Collecting 85 more samples in 48.3 s.Collecting 84 more samples in 47.7 s.Collecting 83 more samples in 47.1 s.Collecting 82 more samples in 46.6 s.Collecting 81 more samples in 46.0 s.Collecting 80 more samples in 45.4 s.Collecting 79 more samples in 44.9 s.Collecting 78 more samples in 44.3 s.Collecting 77 more samples in 43.7 s.Collecting 76 more samples in 43.2 s.Collecting 75 more samples in 42.6 s.Collecting 74 more samples in 42.0 s.Collecting 73 more samples in 41.5 s.Collecting 72 more samples in 40.9 s.Collecting 71 more samples in 40.3 s.Collecting 70 more samples in 39.8 s.Collecting 69 more samples in 39.2 s.Collecting 68 more samples in 38.6 s.Collecting 67 more samples in 38.1 s.Collecting 66 more samples in 37.5 s.Collecting 65 more samples in 36.9 s.Collecting 64 more samples in 36.4 s.Collecting 63 more samples in 35.8 s.Collecting 62 more samples in 35.2 s.Collecting 61 more samples in 34.6 s.Collecting 60 more samples in 34.1 s.Collecting 59 more samples in 33.5 s.Collecting 58 more samples in 32.9 s.Collecting 57 more samples in 32.4 s.Collecting 56 more samples in 31.8 s.Collecting 55 more samples in 31.2 s.Collecting 54 more samples in 30.7 s.Collecting 53 more samples in 30.1 s.Collecting 52 more samples in 29.5 s.Collecting 51 more samples in 29.0 s.Collecting 50 more samples in 28.4 s.Collecting 49 more samples in 27.8 s.Collecting 48 more samples in 27.3 s.Collecting 47 more samples in 26.7 s.Collecting 46 more samples in 26.1 s.Collecting 45 more samples in 25.6 s.Collecting 44 more samples in 25.0 s.Collecting 43 more samples in 24.4 s.Collecting 42 more samples in 23.9 s.Collecting 41 more samples in 23.3 s.Collecting 40 more samples in 22.7 s.Collecting 39 more samples in 22.2 s.Collecting 38 more samples in 21.6 s.Collecting 37 more samples in 21.0 s.Collecting 36 more samples in 20.4 s.Collecting 35 more samples in 19.9 s.Collecting 34 more samples in 19.3 s.Collecting 33 more samples in 18.7 s.Collecting 32 more samples in 18.2 s.Collecting 31 more samples in 17.6 s.Collecting 30 more samples in 17.0 s.Collecting 29 more samples in 16.5 s.Collecting 28 more samples in 15.9 s.Collecting 27 more samples in 15.3 s.Collecting 26 more samples in 14.8 s.Collecting 25 more samples in 14.2 s.Collecting 24 more samples in 13.6 s.Collecting 23 more samples in 13.1 s.Collecting 22 more samples in 12.5 s.Collecting 21 more samples in 11.9 s.Collecting 20 more samples in 11.4 s.Collecting 19 more samples in 10.8 s.Collecting 18 more samples in 10.2 s.Collecting 17 more samples in 9.7 s.Collecting 16 more samples in 9.1 s.Collecting 15 more samples in 8.5 s.Collecting 14 more samples in 8.0 s.Collecting 13 more samples in 7.4 s.Collecting 12 more samples in 6.8 s.Collecting 11 more samples in 6.2 s.Collecting 10 more samples in 5.7 s.Collecting 9 more samples in 5.1 s.Collecting 8 more samples in 4.5 s.Collecting 7 more samples in 4.0 s.Collecting 6 more samples in 3.4 s.Collecting 5 more samples in 2.8 s.Collecting 4 more samples in 2.3 s.Collecting 3 more samples in 1.7 s.Collecting 2 more samples in 1.1 s.Collecting 1 more samples in 0.6 s.mean: 628.2481 ms, lower bound: 612.6262 ms, upper bound: 644.2220 ms, confidence: 0.950 std dev: 81.01388 ms, lower bound: 77.29030 ms, upper bound: 88.44914 ms, confidence: 0.950 variance introduced by outliers: 86.289% variance is severely inflated by outliers commits: 200000 retries: 164361 allocated bytes: 328419176 Running a subject "2/100000/stm-containers" Collecting 99 more samples in 36.6 s.Collecting 98 more samples in 36.2 s.Collecting 97 more samples in 35.8 s.Collecting 96 more samples in 35.5 s.Collecting 95 more samples in 35.1 s.Collecting 94 more samples in 34.7 s.Collecting 93 more samples in 34.4 s.Collecting 92 more samples in 34.0 s.Collecting 91 more samples in 33.6 s.Collecting 90 more samples in 33.3 s.Collecting 89 more samples in 32.9 s.Collecting 88 more samples in 32.5 s.Collecting 87 more samples in 32.1 s.Collecting 86 more samples in 31.8 s.Collecting 85 more samples in 31.4 s.Collecting 84 more samples in 31.0 s.Collecting 83 more samples in 30.7 s.Collecting 82 more samples in 30.3 s.Collecting 81 more samples in 29.9 s.Collecting 80 more samples in 29.6 s.Collecting 79 more samples in 29.2 s.Collecting 78 more samples in 28.8 s.Collecting 77 more samples in 28.5 s.Collecting 76 more samples in 28.1 s.Collecting 75 more samples in 27.7 s.Collecting 74 more samples in 27.3 s.Collecting 73 more samples in 27.0 s.Collecting 72 more samples in 26.6 s.Collecting 71 more samples in 26.2 s.Collecting 70 more samples in 25.9 s.Collecting 69 more samples in 25.5 s.Collecting 68 more samples in 25.1 s.Collecting 67 more samples in 24.8 s.Collecting 66 more samples in 24.4 s.Collecting 65 more samples in 24.0 s.Collecting 64 more samples in 23.7 s.Collecting 63 more samples in 23.3 s.Collecting 62 more samples in 22.9 s.Collecting 61 more samples in 22.5 s.Collecting 60 more samples in 22.2 s.Collecting 59 more samples in 21.8 s.Collecting 58 more samples in 21.4 s.Collecting 57 more samples in 21.1 s.Collecting 56 more samples in 20.7 s.Collecting 55 more samples in 20.3 s.Collecting 54 more samples in 20.0 s.Collecting 53 more samples in 19.6 s.Collecting 52 more samples in 19.2 s.Collecting 51 more samples in 18.8 s.Collecting 50 more samples in 18.5 s.Collecting 49 more samples in 18.1 s.Collecting 48 more samples in 17.7 s.Collecting 47 more samples in 17.4 s.Collecting 46 more samples in 17.0 s.Collecting 45 more samples in 16.6 s.Collecting 44 more samples in 16.3 s.Collecting 43 more samples in 15.9 s.Collecting 42 more samples in 15.5 s.Collecting 41 more samples in 15.2 s.Collecting 40 more samples in 14.8 s.Collecting 39 more samples in 14.4 s.Collecting 38 more samples in 14.0 s.Collecting 37 more samples in 13.7 s.Collecting 36 more samples in 13.3 s.Collecting 35 more samples in 12.9 s.Collecting 34 more samples in 12.6 s.Collecting 33 more samples in 12.2 s.Collecting 32 more samples in 11.8 s.Collecting 31 more samples in 11.5 s.Collecting 30 more samples in 11.1 s.Collecting 29 more samples in 10.7 s.Collecting 28 more samples in 10.3 s.Collecting 27 more samples in 10.0 s.Collecting 26 more samples in 9.6 s.Collecting 25 more samples in 9.2 s.Collecting 24 more samples in 8.9 s.Collecting 23 more samples in 8.5 s.Collecting 22 more samples in 8.1 s.Collecting 21 more samples in 7.8 s.Collecting 20 more samples in 7.4 s.Collecting 19 more samples in 7.0 s.Collecting 18 more samples in 6.7 s.Collecting 17 more samples in 6.3 s.Collecting 16 more samples in 5.9 s.Collecting 15 more samples in 5.5 s.Collecting 14 more samples in 5.2 s.Collecting 13 more samples in 4.8 s.Collecting 12 more samples in 4.4 s.Collecting 11 more samples in 4.1 s.Collecting 10 more samples in 3.7 s.Collecting 9 more samples in 3.3 s.Collecting 8 more samples in 3.0 s.Collecting 7 more samples in 2.6 s.Collecting 6 more samples in 2.2 s.Collecting 5 more samples in 1.8 s.Collecting 4 more samples in 1.5 s.Collecting 3 more samples in 1.1 s.Collecting 2 more samples in 0.7 s.Collecting 1 more samples in 0.4 s.mean: 424.9760 ms, lower bound: 416.6434 ms, upper bound: 436.1252 ms, confidence: 0.950 std dev: 48.71955 ms, lower bound: 38.78859 ms, upper bound: 76.31353 ms, confidence: 0.950 found 1 outliers among 100 samples (1.0%) 1 (1.0%) high severe variance introduced by outliers: 83.161% variance is severely inflated by outliers commits: 200000 retries: 75 allocated bytes: 264773872 Running a subject "2/100000/ttrie" Collecting 99 more samples in 37.4 s.Collecting 98 more samples in 37.0 s.Collecting 97 more samples in 36.7 s.Collecting 96 more samples in 36.3 s.Collecting 95 more samples in 35.9 s.Collecting 94 more samples in 35.5 s.Collecting 93 more samples in 35.1 s.Collecting 92 more samples in 34.8 s.Collecting 91 more samples in 34.4 s.Collecting 90 more samples in 34.0 s.Collecting 89 more samples in 33.6 s.Collecting 88 more samples in 33.3 s.Collecting 87 more samples in 32.9 s.Collecting 86 more samples in 32.5 s.Collecting 85 more samples in 32.1 s.Collecting 84 more samples in 31.7 s.Collecting 83 more samples in 31.4 s.Collecting 82 more samples in 31.0 s.Collecting 81 more samples in 30.6 s.Collecting 80 more samples in 30.2 s.Collecting 79 more samples in 29.9 s.Collecting 78 more samples in 29.5 s.Collecting 77 more samples in 29.1 s.Collecting 76 more samples in 28.7 s.Collecting 75 more samples in 28.3 s.Collecting 74 more samples in 28.0 s.Collecting 73 more samples in 27.6 s.Collecting 72 more samples in 27.2 s.Collecting 71 more samples in 26.8 s.Collecting 70 more samples in 26.5 s.Collecting 69 more samples in 26.1 s.Collecting 68 more samples in 25.7 s.Collecting 67 more samples in 25.3 s.Collecting 66 more samples in 24.9 s.Collecting 65 more samples in 24.6 s.Collecting 64 more samples in 24.2 s.Collecting 63 more samples in 23.8 s.Collecting 62 more samples in 23.4 s.Collecting 61 more samples in 23.1 s.Collecting 60 more samples in 22.7 s.Collecting 59 more samples in 22.3 s.Collecting 58 more samples in 21.9 s.Collecting 57 more samples in 21.5 s.Collecting 56 more samples in 21.2 s.Collecting 55 more samples in 20.8 s.Collecting 54 more samples in 20.4 s.Collecting 53 more samples in 20.0 s.Collecting 52 more samples in 19.7 s.Collecting 51 more samples in 19.3 s.Collecting 50 more samples in 18.9 s.Collecting 49 more samples in 18.5 s.Collecting 48 more samples in 18.1 s.Collecting 47 more samples in 17.8 s.Collecting 46 more samples in 17.4 s.Collecting 45 more samples in 17.0 s.Collecting 44 more samples in 16.6 s.Collecting 43 more samples in 16.2 s.Collecting 42 more samples in 15.9 s.Collecting 41 more samples in 15.5 s.Collecting 40 more samples in 15.1 s.Collecting 39 more samples in 14.7 s.Collecting 38 more samples in 14.4 s.Collecting 37 more samples in 14.0 s.Collecting 36 more samples in 13.6 s.Collecting 35 more samples in 13.2 s.Collecting 34 more samples in 12.8 s.Collecting 33 more samples in 12.5 s.Collecting 32 more samples in 12.1 s.Collecting 31 more samples in 11.7 s.Collecting 30 more samples in 11.3 s.Collecting 29 more samples in 11.0 s.Collecting 28 more samples in 10.6 s.Collecting 27 more samples in 10.2 s.Collecting 26 more samples in 9.8 s.Collecting 25 more samples in 9.4 s.Collecting 24 more samples in 9.1 s.Collecting 23 more samples in 8.7 s.Collecting 22 more samples in 8.3 s.Collecting 21 more samples in 7.9 s.Collecting 20 more samples in 7.6 s.Collecting 19 more samples in 7.2 s.Collecting 18 more samples in 6.8 s.Collecting 17 more samples in 6.4 s.Collecting 16 more samples in 6.0 s.Collecting 15 more samples in 5.7 s.Collecting 14 more samples in 5.3 s.Collecting 13 more samples in 4.9 s.Collecting 12 more samples in 4.5 s.Collecting 11 more samples in 4.2 s.Collecting 10 more samples in 3.8 s.Collecting 9 more samples in 3.4 s.Collecting 8 more samples in 3.0 s.Collecting 7 more samples in 2.6 s.Collecting 6 more samples in 2.3 s.Collecting 5 more samples in 1.9 s.Collecting 4 more samples in 1.5 s.Collecting 3 more samples in 1.1 s.Collecting 2 more samples in 0.8 s.Collecting 1 more samples in 0.4 s.mean: 371.5323 ms, lower bound: 362.7378 ms, upper bound: 381.5256 ms, confidence: 0.950 std dev: 48.29692 ms, lower bound: 42.53981 ms, upper bound: 56.28669 ms, confidence: 0.950 found 1 outliers among 100 samples (1.0%) variance introduced by outliers: 87.284% variance is severely inflated by outliers commits: 200000 retries: 0 allocated bytes: 140990192 Running a subject "4/50000/unordered-containers" Collecting 99 more samples in 73.9 s.Collecting 98 more samples in 73.2 s.Collecting 97 more samples in 72.4 s.Collecting 96 more samples in 71.7 s.Collecting 95 more samples in 70.9 s.Collecting 94 more samples in 70.2 s.Collecting 93 more samples in 69.4 s.Collecting 92 more samples in 68.7 s.Collecting 91 more samples in 67.9 s.Collecting 90 more samples in 67.2 s.Collecting 89 more samples in 66.5 s.Collecting 88 more samples in 65.7 s.Collecting 87 more samples in 65.0 s.Collecting 86 more samples in 64.2 s.Collecting 85 more samples in 63.5 s.Collecting 84 more samples in 62.7 s.Collecting 83 more samples in 62.0 s.Collecting 82 more samples in 61.2 s.Collecting 81 more samples in 60.5 s.Collecting 80 more samples in 59.7 s.Collecting 79 more samples in 59.0 s.Collecting 78 more samples in 58.2 s.Collecting 77 more samples in 57.5 s.Collecting 76 more samples in 56.7 s.Collecting 75 more samples in 56.0 s.Collecting 74 more samples in 55.3 s.Collecting 73 more samples in 54.5 s.Collecting 72 more samples in 53.8 s.Collecting 71 more samples in 53.0 s.Collecting 70 more samples in 52.3 s.Collecting 69 more samples in 51.5 s.Collecting 68 more samples in 50.8 s.Collecting 67 more samples in 50.0 s.Collecting 66 more samples in 49.3 s.Collecting 65 more samples in 48.5 s.Collecting 64 more samples in 47.8 s.Collecting 63 more samples in 47.0 s.Collecting 62 more samples in 46.3 s.Collecting 61 more samples in 45.5 s.Collecting 60 more samples in 44.8 s.Collecting 59 more samples in 44.1 s.Collecting 58 more samples in 43.3 s.Collecting 57 more samples in 42.6 s.Collecting 56 more samples in 41.8 s.Collecting 55 more samples in 41.1 s.Collecting 54 more samples in 40.3 s.Collecting 53 more samples in 39.6 s.Collecting 52 more samples in 38.8 s.Collecting 51 more samples in 38.1 s.Collecting 50 more samples in 37.3 s.Collecting 49 more samples in 36.6 s.Collecting 48 more samples in 35.8 s.Collecting 47 more samples in 35.1 s.Collecting 46 more samples in 34.3 s.Collecting 45 more samples in 33.6 s.Collecting 44 more samples in 32.9 s.Collecting 43 more samples in 32.1 s.Collecting 42 more samples in 31.4 s.Collecting 41 more samples in 30.6 s.Collecting 40 more samples in 29.9 s.Collecting 39 more samples in 29.1 s.Collecting 38 more samples in 28.4 s.Collecting 37 more samples in 27.6 s.Collecting 36 more samples in 26.9 s.Collecting 35 more samples in 26.1 s.Collecting 34 more samples in 25.4 s.Collecting 33 more samples in 24.6 s.Collecting 32 more samples in 23.9 s.Collecting 31 more samples in 23.1 s.Collecting 30 more samples in 22.4 s.Collecting 29 more samples in 21.7 s.Collecting 28 more samples in 20.9 s.Collecting 27 more samples in 20.2 s.Collecting 26 more samples in 19.4 s.Collecting 25 more samples in 18.7 s.Collecting 24 more samples in 17.9 s.Collecting 23 more samples in 17.2 s.Collecting 22 more samples in 16.4 s.Collecting 21 more samples in 15.7 s.Collecting 20 more samples in 14.9 s.Collecting 19 more samples in 14.2 s.Collecting 18 more samples in 13.4 s.Collecting 17 more samples in 12.7 s.Collecting 16 more samples in 11.9 s.Collecting 15 more samples in 11.2 s.Collecting 14 more samples in 10.5 s.Collecting 13 more samples in 9.7 s.Collecting 12 more samples in 9.0 s.Collecting 11 more samples in 8.2 s.Collecting 10 more samples in 7.5 s.Collecting 9 more samples in 6.7 s.Collecting 8 more samples in 6.0 s.Collecting 7 more samples in 5.2 s.Collecting 6 more samples in 4.5 s.Collecting 5 more samples in 3.7 s.Collecting 4 more samples in 3.0 s.Collecting 3 more samples in 2.2 s.Collecting 2 more samples in 1.5 s.Collecting 1 more samples in 0.7 s.mean: 669.7285 ms, lower bound: 663.4649 ms, upper bound: 679.1128 ms, confidence: 0.950 std dev: 38.77451 ms, lower bound: 28.40831 ms, upper bound: 57.75935 ms, confidence: 0.950 found 4 outliers among 100 samples (4.0%) 2 (2.0%) high mild 2 (2.0%) high severe variance introduced by outliers: 55.485% variance is severely inflated by outliers commits: 200000 retries: 467322 allocated bytes: 541317640 Running a subject "4/50000/stm-containers" Collecting 99 more samples in 41.2 s.Collecting 98 more samples in 40.7 s.Collecting 97 more samples in 40.3 s.Collecting 96 more samples in 39.9 s.Collecting 95 more samples in 39.5 s.Collecting 94 more samples in 39.1 s.Collecting 93 more samples in 38.7 s.Collecting 92 more samples in 38.2 s.Collecting 91 more samples in 37.8 s.Collecting 90 more samples in 37.4 s.Collecting 89 more samples in 37.0 s.Collecting 88 more samples in 36.6 s.Collecting 87 more samples in 36.2 s.Collecting 86 more samples in 35.8 s.Collecting 85 more samples in 35.3 s.Collecting 84 more samples in 34.9 s.Collecting 83 more samples in 34.5 s.Collecting 82 more samples in 34.1 s.Collecting 81 more samples in 33.7 s.Collecting 80 more samples in 33.3 s.Collecting 79 more samples in 32.8 s.Collecting 78 more samples in 32.4 s.Collecting 77 more samples in 32.0 s.Collecting 76 more samples in 31.6 s.Collecting 75 more samples in 31.2 s.Collecting 74 more samples in 30.8 s.Collecting 73 more samples in 30.4 s.Collecting 72 more samples in 29.9 s.Collecting 71 more samples in 29.5 s.Collecting 70 more samples in 29.1 s.Collecting 69 more samples in 28.7 s.Collecting 68 more samples in 28.3 s.Collecting 67 more samples in 27.9 s.Collecting 66 more samples in 27.4 s.Collecting 65 more samples in 27.0 s.Collecting 64 more samples in 26.6 s.Collecting 63 more samples in 26.2 s.Collecting 62 more samples in 25.8 s.Collecting 61 more samples in 25.4 s.Collecting 60 more samples in 24.9 s.Collecting 59 more samples in 24.5 s.Collecting 58 more samples in 24.1 s.Collecting 57 more samples in 23.7 s.Collecting 56 more samples in 23.3 s.Collecting 55 more samples in 22.9 s.Collecting 54 more samples in 22.5 s.Collecting 53 more samples in 22.0 s.Collecting 52 more samples in 21.6 s.Collecting 51 more samples in 21.2 s.Collecting 50 more samples in 20.8 s.Collecting 49 more samples in 20.4 s.Collecting 48 more samples in 20.0 s.Collecting 47 more samples in 19.5 s.Collecting 46 more samples in 19.1 s.Collecting 45 more samples in 18.7 s.Collecting 44 more samples in 18.3 s.Collecting 43 more samples in 17.9 s.Collecting 42 more samples in 17.5 s.Collecting 41 more samples in 17.0 s.Collecting 40 more samples in 16.6 s.Collecting 39 more samples in 16.2 s.Collecting 38 more samples in 15.8 s.Collecting 37 more samples in 15.4 s.Collecting 36 more samples in 15.0 s.Collecting 35 more samples in 14.6 s.Collecting 34 more samples in 14.1 s.Collecting 33 more samples in 13.7 s.Collecting 32 more samples in 13.3 s.Collecting 31 more samples in 12.9 s.Collecting 30 more samples in 12.5 s.Collecting 29 more samples in 12.1 s.Collecting 28 more samples in 11.6 s.Collecting 27 more samples in 11.2 s.Collecting 26 more samples in 10.8 s.Collecting 25 more samples in 10.4 s.Collecting 24 more samples in 10.0 s.Collecting 23 more samples in 9.6 s.Collecting 22 more samples in 9.1 s.Collecting 21 more samples in 8.7 s.Collecting 20 more samples in 8.3 s.Collecting 19 more samples in 7.9 s.Collecting 18 more samples in 7.5 s.Collecting 17 more samples in 7.1 s.Collecting 16 more samples in 6.7 s.Collecting 15 more samples in 6.2 s.Collecting 14 more samples in 5.8 s.Collecting 13 more samples in 5.4 s.Collecting 12 more samples in 5.0 s.Collecting 11 more samples in 4.6 s.Collecting 10 more samples in 4.2 s.Collecting 9 more samples in 3.7 s.Collecting 8 more samples in 3.3 s.Collecting 7 more samples in 2.9 s.Collecting 6 more samples in 2.5 s.Collecting 5 more samples in 2.1 s.Collecting 4 more samples in 1.7 s.Collecting 3 more samples in 1.2 s.Collecting 2 more samples in 0.8 s.Collecting 1 more samples in 0.4 s.mean: 287.3406 ms, lower bound: 279.8110 ms, upper bound: 296.3862 ms, confidence: 0.950 std dev: 42.32348 ms, lower bound: 36.03192 ms, upper bound: 52.82364 ms, confidence: 0.950 found 2 outliers among 100 samples (2.0%) 2 (2.0%) high mild variance introduced by outliers: 89.417% variance is severely inflated by outliers commits: 200000 retries: 345 allocated bytes: 265416824 Running a subject "4/50000/ttrie" Collecting 99 more samples in 24.7 s.Collecting 98 more samples in 24.5 s.Collecting 97 more samples in 24.2 s.Collecting 96 more samples in 24.0 s.Collecting 95 more samples in 23.7 s.Collecting 94 more samples in 23.5 s.Collecting 93 more samples in 23.2 s.Collecting 92 more samples in 23.0 s.Collecting 91 more samples in 22.7 s.Collecting 90 more samples in 22.5 s.Collecting 89 more samples in 22.2 s.Collecting 88 more samples in 22.0 s.Collecting 87 more samples in 21.7 s.Collecting 86 more samples in 21.5 s.Collecting 85 more samples in 21.2 s.Collecting 84 more samples in 21.0 s.Collecting 83 more samples in 20.7 s.Collecting 82 more samples in 20.5 s.Collecting 81 more samples in 20.2 s.Collecting 80 more samples in 20.0 s.Collecting 79 more samples in 19.7 s.Collecting 78 more samples in 19.5 s.Collecting 77 more samples in 19.2 s.Collecting 76 more samples in 19.0 s.Collecting 75 more samples in 18.7 s.Collecting 74 more samples in 18.5 s.Collecting 73 more samples in 18.2 s.Collecting 72 more samples in 18.0 s.Collecting 71 more samples in 17.7 s.Collecting 70 more samples in 17.5 s.Collecting 69 more samples in 17.2 s.Collecting 68 more samples in 17.0 s.Collecting 67 more samples in 16.7 s.Collecting 66 more samples in 16.5 s.Collecting 65 more samples in 16.2 s.Collecting 64 more samples in 16.0 s.Collecting 63 more samples in 15.7 s.Collecting 62 more samples in 15.5 s.Collecting 61 more samples in 15.2 s.Collecting 60 more samples in 15.0 s.Collecting 59 more samples in 14.7 s.Collecting 58 more samples in 14.5 s.Collecting 57 more samples in 14.2 s.Collecting 56 more samples in 14.0 s.Collecting 55 more samples in 13.7 s.Collecting 54 more samples in 13.5 s.Collecting 53 more samples in 13.2 s.Collecting 52 more samples in 13.0 s.Collecting 51 more samples in 12.7 s.Collecting 50 more samples in 12.5 s.Collecting 49 more samples in 12.2 s.Collecting 48 more samples in 12.0 s.Collecting 47 more samples in 11.7 s.Collecting 46 more samples in 11.5 s.Collecting 45 more samples in 11.2 s.Collecting 44 more samples in 11.0 s.Collecting 43 more samples in 10.7 s.Collecting 42 more samples in 10.5 s.Collecting 41 more samples in 10.2 s.Collecting 40 more samples in 10.0 s.Collecting 39 more samples in 9.7 s.Collecting 38 more samples in 9.5 s.Collecting 37 more samples in 9.2 s.Collecting 36 more samples in 9.0 s.Collecting 35 more samples in 8.7 s.Collecting 34 more samples in 8.5 s.Collecting 33 more samples in 8.2 s.Collecting 32 more samples in 8.0 s.Collecting 31 more samples in 7.7 s.Collecting 30 more samples in 7.5 s.Collecting 29 more samples in 7.2 s.Collecting 28 more samples in 7.0 s.Collecting 27 more samples in 6.7 s.Collecting 26 more samples in 6.5 s.Collecting 25 more samples in 6.2 s.Collecting 24 more samples in 6.0 s.Collecting 23 more samples in 5.7 s.Collecting 22 more samples in 5.5 s.Collecting 21 more samples in 5.2 s.Collecting 20 more samples in 5.0 s.Collecting 19 more samples in 4.7 s.Collecting 18 more samples in 4.5 s.Collecting 17 more samples in 4.2 s.Collecting 16 more samples in 4.0 s.Collecting 15 more samples in 3.7 s.Collecting 14 more samples in 3.5 s.Collecting 13 more samples in 3.2 s.Collecting 12 more samples in 3.0 s.Collecting 11 more samples in 2.7 s.Collecting 10 more samples in 2.5 s.Collecting 9 more samples in 2.2 s.Collecting 8 more samples in 2.0 s.Collecting 7 more samples in 1.7 s.Collecting 6 more samples in 1.5 s.Collecting 5 more samples in 1.2 s.Collecting 4 more samples in 1.0 s.Collecting 3 more samples in 0.7 s.Collecting 2 more samples in 0.5 s.Collecting 1 more samples in 0.2 s.mean: 237.6509 ms, lower bound: 227.1027 ms, upper bound: 248.9796 ms, confidence: 0.950 std dev: 56.27307 ms, lower bound: 51.13168 ms, upper bound: 62.12205 ms, confidence: 0.950 variance introduced by outliers: 95.743% variance is severely inflated by outliers commits: 200000 retries: 0 allocated bytes: 141041632 Running a subject "6/33333/unordered-containers" Collecting 99 more samples in 66.7 s.Collecting 98 more samples in 66.0 s.Collecting 97 more samples in 65.3 s.Collecting 96 more samples in 64.6 s.Collecting 95 more samples in 64.0 s.Collecting 94 more samples in 63.3 s.Collecting 93 more samples in 62.6 s.Collecting 92 more samples in 61.9 s.Collecting 91 more samples in 61.3 s.Collecting 90 more samples in 60.6 s.Collecting 89 more samples in 59.9 s.Collecting 88 more samples in 59.3 s.Collecting 87 more samples in 58.6 s.Collecting 86 more samples in 57.9 s.Collecting 85 more samples in 57.2 s.Collecting 84 more samples in 56.6 s.Collecting 83 more samples in 55.9 s.Collecting 82 more samples in 55.2 s.Collecting 81 more samples in 54.5 s.Collecting 80 more samples in 53.9 s.Collecting 79 more samples in 53.2 s.Collecting 78 more samples in 52.5 s.Collecting 77 more samples in 51.8 s.Collecting 76 more samples in 51.2 s.Collecting 75 more samples in 50.5 s.Collecting 74 more samples in 49.8 s.Collecting 73 more samples in 49.2 s.Collecting 72 more samples in 48.5 s.Collecting 71 more samples in 47.8 s.Collecting 70 more samples in 47.1 s.Collecting 69 more samples in 46.5 s.Collecting 68 more samples in 45.8 s.Collecting 67 more samples in 45.1 s.Collecting 66 more samples in 44.4 s.Collecting 65 more samples in 43.8 s.Collecting 64 more samples in 43.1 s.Collecting 63 more samples in 42.4 s.Collecting 62 more samples in 41.7 s.Collecting 61 more samples in 41.1 s.Collecting 60 more samples in 40.4 s.Collecting 59 more samples in 39.7 s.Collecting 58 more samples in 39.1 s.Collecting 57 more samples in 38.4 s.Collecting 56 more samples in 37.7 s.Collecting 55 more samples in 37.0 s.Collecting 54 more samples in 36.4 s.Collecting 53 more samples in 35.7 s.Collecting 52 more samples in 35.0 s.Collecting 51 more samples in 34.3 s.Collecting 50 more samples in 33.7 s.Collecting 49 more samples in 33.0 s.Collecting 48 more samples in 32.3 s.Collecting 47 more samples in 31.6 s.Collecting 46 more samples in 31.0 s.Collecting 45 more samples in 30.3 s.Collecting 44 more samples in 29.6 s.Collecting 43 more samples in 29.0 s.Collecting 42 more samples in 28.3 s.Collecting 41 more samples in 27.6 s.Collecting 40 more samples in 26.9 s.Collecting 39 more samples in 26.3 s.Collecting 38 more samples in 25.6 s.Collecting 37 more samples in 24.9 s.Collecting 36 more samples in 24.2 s.Collecting 35 more samples in 23.6 s.Collecting 34 more samples in 22.9 s.Collecting 33 more samples in 22.2 s.Collecting 32 more samples in 21.5 s.Collecting 31 more samples in 20.9 s.Collecting 30 more samples in 20.2 s.Collecting 29 more samples in 19.5 s.Collecting 28 more samples in 18.9 s.Collecting 27 more samples in 18.2 s.Collecting 26 more samples in 17.5 s.Collecting 25 more samples in 16.8 s.Collecting 24 more samples in 16.2 s.Collecting 23 more samples in 15.5 s.Collecting 22 more samples in 14.8 s.Collecting 21 more samples in 14.1 s.Collecting 20 more samples in 13.5 s.Collecting 19 more samples in 12.8 s.Collecting 18 more samples in 12.1 s.Collecting 17 more samples in 11.4 s.Collecting 16 more samples in 10.8 s.Collecting 15 more samples in 10.1 s.Collecting 14 more samples in 9.4 s.Collecting 13 more samples in 8.8 s.Collecting 12 more samples in 8.1 s.Collecting 11 more samples in 7.4 s.Collecting 10 more samples in 6.7 s.Collecting 9 more samples in 6.1 s.Collecting 8 more samples in 5.4 s.Collecting 7 more samples in 4.7 s.Collecting 6 more samples in 4.0 s.Collecting 5 more samples in 3.4 s.Collecting 4 more samples in 2.7 s.Collecting 3 more samples in 2.0 s.Collecting 2 more samples in 1.3 s.Collecting 1 more samples in 0.7 s.mean: 699.1770 ms, lower bound: 695.1035 ms, upper bound: 703.2188 ms, confidence: 0.950 std dev: 20.78790 ms, lower bound: 17.75913 ms, upper bound: 25.16207 ms, confidence: 0.950 found 5 outliers among 100 samples (5.0%) 3 (3.0%) low mild 2 (2.0%) high mild variance introduced by outliers: 24.805% variance is moderately inflated by outliers commits: 200000 retries: 607292 allocated bytes: 693030592 Running a subject "6/33333/stm-containers" Collecting 100 more samples in 18.0 s.Collecting 99 more samples in 17.8 s.Collecting 98 more samples in 17.6 s.Collecting 97 more samples in 17.5 s.Collecting 96 more samples in 17.3 s.Collecting 95 more samples in 17.1 s.Collecting 94 more samples in 16.9 s.Collecting 93 more samples in 16.7 s.Collecting 92 more samples in 16.6 s.Collecting 91 more samples in 16.4 s.Collecting 90 more samples in 16.2 s.Collecting 89 more samples in 16.0 s.Collecting 88 more samples in 15.8 s.Collecting 87 more samples in 15.7 s.Collecting 86 more samples in 15.5 s.Collecting 85 more samples in 15.3 s.Collecting 84 more samples in 15.1 s.Collecting 83 more samples in 14.9 s.Collecting 82 more samples in 14.8 s.Collecting 81 more samples in 14.6 s.Collecting 80 more samples in 14.4 s.Collecting 79 more samples in 14.2 s.Collecting 78 more samples in 14.0 s.Collecting 77 more samples in 13.9 s.Collecting 76 more samples in 13.7 s.Collecting 75 more samples in 13.5 s.Collecting 74 more samples in 13.3 s.Collecting 73 more samples in 13.1 s.Collecting 72 more samples in 13.0 s.Collecting 71 more samples in 12.8 s.Collecting 70 more samples in 12.6 s.Collecting 69 more samples in 12.4 s.Collecting 68 more samples in 12.2 s.Collecting 67 more samples in 12.1 s.Collecting 66 more samples in 11.9 s.Collecting 65 more samples in 11.7 s.Collecting 64 more samples in 11.5 s.Collecting 63 more samples in 11.3 s.Collecting 62 more samples in 11.2 s.Collecting 61 more samples in 11.0 s.Collecting 60 more samples in 10.8 s.Collecting 59 more samples in 10.6 s.Collecting 58 more samples in 10.4 s.Collecting 57 more samples in 10.3 s.Collecting 56 more samples in 10.1 s.Collecting 55 more samples in 9.9 s.Collecting 54 more samples in 9.7 s.Collecting 53 more samples in 9.5 s.Collecting 52 more samples in 9.4 s.Collecting 51 more samples in 9.2 s.Collecting 50 more samples in 9.0 s.Collecting 49 more samples in 8.8 s.Collecting 48 more samples in 8.6 s.Collecting 47 more samples in 8.5 s.Collecting 46 more samples in 8.3 s.Collecting 45 more samples in 8.1 s.Collecting 44 more samples in 7.9 s.Collecting 43 more samples in 7.7 s.Collecting 42 more samples in 7.6 s.Collecting 41 more samples in 7.4 s.Collecting 40 more samples in 7.2 s.Collecting 39 more samples in 7.0 s.Collecting 38 more samples in 6.8 s.Collecting 37 more samples in 6.7 s.Collecting 36 more samples in 6.5 s.Collecting 35 more samples in 6.3 s.Collecting 34 more samples in 6.1 s.Collecting 33 more samples in 5.9 s.Collecting 32 more samples in 5.8 s.Collecting 31 more samples in 5.6 s.Collecting 30 more samples in 5.4 s.Collecting 29 more samples in 5.2 s.Collecting 28 more samples in 5.0 s.Collecting 27 more samples in 4.9 s.Collecting 26 more samples in 4.7 s.Collecting 25 more samples in 4.5 s.Collecting 24 more samples in 4.3 s.Collecting 23 more samples in 4.1 s.Collecting 22 more samples in 4.0 s.Collecting 21 more samples in 3.8 s.Collecting 20 more samples in 3.6 s.Collecting 19 more samples in 3.4 s.Collecting 18 more samples in 3.2 s.Collecting 17 more samples in 3.1 s.Collecting 16 more samples in 2.9 s.Collecting 15 more samples in 2.7 s.Collecting 14 more samples in 2.5 s.Collecting 13 more samples in 2.3 s.Collecting 12 more samples in 2.2 s.Collecting 11 more samples in 2.0 s.Collecting 10 more samples in 1.8 s.Collecting 9 more samples in 1.6 s.Collecting 8 more samples in 1.4 s.Collecting 7 more samples in 1.3 s.Collecting 6 more samples in 1.1 s.Collecting 5 more samples in 0.9 s.Collecting 4 more samples in 0.7 s.Collecting 3 more samples in 0.5 s.Collecting 2 more samples in 0.4 s.Collecting 1 more samples in 0.2 s.mean: 227.2956 ms, lower bound: 219.4680 ms, upper bound: 235.5586 ms, confidence: 0.950 std dev: 41.14073 ms, lower bound: 37.48020 ms, upper bound: 45.94101 ms, confidence: 0.950 variance introduced by outliers: 92.587% variance is severely inflated by outliers commits: 200000 retries: 601 allocated bytes: 265809672 Running a subject "6/33333/ttrie" Collecting 100 more samples in 14.4 s.Collecting 99 more samples in 14.2 s.Collecting 98 more samples in 14.1 s.Collecting 97 more samples in 13.9 s.Collecting 96 more samples in 13.8 s.Collecting 95 more samples in 13.6 s.Collecting 94 more samples in 13.5 s.Collecting 93 more samples in 13.3 s.Collecting 92 more samples in 13.2 s.Collecting 91 more samples in 13.1 s.Collecting 90 more samples in 12.9 s.Collecting 89 more samples in 12.8 s.Collecting 88 more samples in 12.6 s.Collecting 87 more samples in 12.5 s.Collecting 86 more samples in 12.3 s.Collecting 85 more samples in 12.2 s.Collecting 84 more samples in 12.1 s.Collecting 83 more samples in 11.9 s.Collecting 82 more samples in 11.8 s.Collecting 81 more samples in 11.6 s.Collecting 80 more samples in 11.5 s.Collecting 79 more samples in 11.3 s.Collecting 78 more samples in 11.2 s.Collecting 77 more samples in 11.1 s.Collecting 76 more samples in 10.9 s.Collecting 75 more samples in 10.8 s.Collecting 74 more samples in 10.6 s.Collecting 73 more samples in 10.5 s.Collecting 72 more samples in 10.3 s.Collecting 71 more samples in 10.2 s.Collecting 70 more samples in 10.0 s.Collecting 69 more samples in 9.9 s.Collecting 68 more samples in 9.8 s.Collecting 67 more samples in 9.6 s.Collecting 66 more samples in 9.5 s.Collecting 65 more samples in 9.3 s.Collecting 64 more samples in 9.2 s.Collecting 63 more samples in 9.0 s.Collecting 62 more samples in 8.9 s.Collecting 61 more samples in 8.8 s.Collecting 60 more samples in 8.6 s.Collecting 59 more samples in 8.5 s.Collecting 58 more samples in 8.3 s.Collecting 57 more samples in 8.2 s.Collecting 56 more samples in 8.0 s.Collecting 55 more samples in 7.9 s.Collecting 54 more samples in 7.8 s.Collecting 53 more samples in 7.6 s.Collecting 52 more samples in 7.5 s.Collecting 51 more samples in 7.3 s.Collecting 50 more samples in 7.2 s.Collecting 49 more samples in 7.0 s.Collecting 48 more samples in 6.9 s.Collecting 47 more samples in 6.7 s.Collecting 46 more samples in 6.6 s.Collecting 45 more samples in 6.5 s.Collecting 44 more samples in 6.3 s.Collecting 43 more samples in 6.2 s.Collecting 42 more samples in 6.0 s.Collecting 41 more samples in 5.9 s.Collecting 40 more samples in 5.7 s.Collecting 39 more samples in 5.6 s.Collecting 38 more samples in 5.5 s.Collecting 37 more samples in 5.3 s.Collecting 36 more samples in 5.2 s.Collecting 35 more samples in 5.0 s.Collecting 34 more samples in 4.9 s.Collecting 33 more samples in 4.7 s.Collecting 32 more samples in 4.6 s.Collecting 31 more samples in 4.4 s.Collecting 30 more samples in 4.3 s.Collecting 29 more samples in 4.2 s.Collecting 28 more samples in 4.0 s.Collecting 27 more samples in 3.9 s.Collecting 26 more samples in 3.7 s.Collecting 25 more samples in 3.6 s.Collecting 24 more samples in 3.4 s.Collecting 23 more samples in 3.3 s.Collecting 22 more samples in 3.2 s.Collecting 21 more samples in 3.0 s.Collecting 20 more samples in 2.9 s.Collecting 19 more samples in 2.7 s.Collecting 18 more samples in 2.6 s.Collecting 17 more samples in 2.4 s.Collecting 16 more samples in 2.3 s.Collecting 15 more samples in 2.2 s.Collecting 14 more samples in 2.0 s.Collecting 13 more samples in 1.9 s.Collecting 12 more samples in 1.7 s.Collecting 11 more samples in 1.6 s.Collecting 10 more samples in 1.4 s.Collecting 9 more samples in 1.3 s.Collecting 8 more samples in 1.1 s.Collecting 7 more samples in 1.0 s.Collecting 6 more samples in 0.9 s.Collecting 5 more samples in 0.7 s.Collecting 4 more samples in 0.6 s.Collecting 3 more samples in 0.4 s.Collecting 2 more samples in 0.3 s.Collecting 1 more samples in 0.1 s.mean: 136.2563 ms, lower bound: 132.6064 ms, upper bound: 148.0640 ms, confidence: 0.950 std dev: 30.30609 ms, lower bound: 11.05403 ms, upper bound: 67.36574 ms, confidence: 0.950 found 5 outliers among 100 samples (5.0%) 2 (2.0%) high mild 3 (3.0%) high severe variance introduced by outliers: 95.709% variance is severely inflated by outliers commits: 200000 retries: 0 allocated bytes: 141109120 Running a subject "8/25000/unordered-containers" Collecting 99 more samples in 79.0 s.Collecting 98 more samples in 78.2 s.Collecting 97 more samples in 77.4 s.Collecting 96 more samples in 76.6 s.Collecting 95 more samples in 75.8 s.Collecting 94 more samples in 75.0 s.Collecting 93 more samples in 74.2 s.Collecting 92 more samples in 73.4 s.Collecting 91 more samples in 72.6 s.Collecting 90 more samples in 71.8 s.Collecting 89 more samples in 71.0 s.Collecting 88 more samples in 70.2 s.Collecting 87 more samples in 69.4 s.Collecting 86 more samples in 68.6 s.Collecting 85 more samples in 67.8 s.Collecting 84 more samples in 67.0 s.Collecting 83 more samples in 66.2 s.Collecting 82 more samples in 65.4 s.Collecting 81 more samples in 64.6 s.Collecting 80 more samples in 63.8 s.Collecting 79 more samples in 63.0 s.Collecting 78 more samples in 62.2 s.Collecting 77 more samples in 61.4 s.Collecting 76 more samples in 60.6 s.Collecting 75 more samples in 59.8 s.Collecting 74 more samples in 59.0 s.Collecting 73 more samples in 58.2 s.Collecting 72 more samples in 57.4 s.Collecting 71 more samples in 56.6 s.Collecting 70 more samples in 55.8 s.Collecting 69 more samples in 55.0 s.Collecting 68 more samples in 54.2 s.Collecting 67 more samples in 53.4 s.Collecting 66 more samples in 52.6 s.Collecting 65 more samples in 51.8 s.Collecting 64 more samples in 51.0 s.Collecting 63 more samples in 50.2 s.Collecting 62 more samples in 49.4 s.Collecting 61 more samples in 48.6 s.Collecting 60 more samples in 47.8 s.Collecting 59 more samples in 47.1 s.Collecting 58 more samples in 46.3 s.Collecting 57 more samples in 45.5 s.Collecting 56 more samples in 44.7 s.Collecting 55 more samples in 43.9 s.Collecting 54 more samples in 43.1 s.Collecting 53 more samples in 42.3 s.Collecting 52 more samples in 41.5 s.Collecting 51 more samples in 40.7 s.Collecting 50 more samples in 39.9 s.Collecting 49 more samples in 39.1 s.Collecting 48 more samples in 38.3 s.Collecting 47 more samples in 37.5 s.Collecting 46 more samples in 36.7 s.Collecting 45 more samples in 35.9 s.Collecting 44 more samples in 35.1 s.Collecting 43 more samples in 34.3 s.Collecting 42 more samples in 33.5 s.Collecting 41 more samples in 32.7 s.Collecting 40 more samples in 31.9 s.Collecting 39 more samples in 31.1 s.Collecting 38 more samples in 30.3 s.Collecting 37 more samples in 29.5 s.Collecting 36 more samples in 28.7 s.Collecting 35 more samples in 27.9 s.Collecting 34 more samples in 27.1 s.Collecting 33 more samples in 26.3 s.Collecting 32 more samples in 25.5 s.Collecting 31 more samples in 24.7 s.Collecting 30 more samples in 23.9 s.Collecting 29 more samples in 23.1 s.Collecting 28 more samples in 22.3 s.Collecting 27 more samples in 21.5 s.Collecting 26 more samples in 20.7 s.Collecting 25 more samples in 19.9 s.Collecting 24 more samples in 19.1 s.Collecting 23 more samples in 18.3 s.Collecting 22 more samples in 17.5 s.Collecting 21 more samples in 16.7 s.Collecting 20 more samples in 15.9 s.Collecting 19 more samples in 15.2 s.Collecting 18 more samples in 14.4 s.Collecting 17 more samples in 13.6 s.Collecting 16 more samples in 12.8 s.Collecting 15 more samples in 12.0 s.Collecting 14 more samples in 11.2 s.Collecting 13 more samples in 10.4 s.Collecting 12 more samples in 9.6 s.Collecting 11 more samples in 8.8 s.Collecting 10 more samples in 8.0 s.Collecting 9 more samples in 7.2 s.Collecting 8 more samples in 6.4 s.Collecting 7 more samples in 5.6 s.Collecting 6 more samples in 4.8 s.Collecting 5 more samples in 4.0 s.Collecting 4 more samples in 3.2 s.Collecting 3 more samples in 2.4 s.Collecting 2 more samples in 1.6 s.Collecting 1 more samples in 0.8 s.mean: 759.1310 ms, lower bound: 751.0547 ms, upper bound: 766.4919 ms, confidence: 0.950 std dev: 39.70314 ms, lower bound: 34.56505 ms, upper bound: 45.55518 ms, confidence: 0.950 found 7 outliers among 100 samples (7.0%) 7 (7.0%) low mild variance introduced by outliers: 50.455% variance is severely inflated by outliers commits: 200000 retries: 734635 allocated bytes: 771984072 Running a subject "8/25000/stm-containers" Collecting 99 more samples in 29.1 s.Collecting 98 more samples in 28.8 s.Collecting 97 more samples in 28.5 s.Collecting 96 more samples in 28.2 s.Collecting 95 more samples in 27.9 s.Collecting 94 more samples in 27.6 s.Collecting 93 more samples in 27.3 s.Collecting 92 more samples in 27.0 s.Collecting 91 more samples in 26.7 s.Collecting 90 more samples in 26.4 s.Collecting 89 more samples in 26.2 s.Collecting 88 more samples in 25.9 s.Collecting 87 more samples in 25.6 s.Collecting 86 more samples in 25.3 s.Collecting 85 more samples in 25.0 s.Collecting 84 more samples in 24.7 s.Collecting 83 more samples in 24.4 s.Collecting 82 more samples in 24.1 s.Collecting 81 more samples in 23.8 s.Collecting 80 more samples in 23.5 s.Collecting 79 more samples in 23.2 s.Collecting 78 more samples in 22.9 s.Collecting 77 more samples in 22.6 s.Collecting 76 more samples in 22.3 s.Collecting 75 more samples in 22.0 s.Collecting 74 more samples in 21.7 s.Collecting 73 more samples in 21.5 s.Collecting 72 more samples in 21.2 s.Collecting 71 more samples in 20.9 s.Collecting 70 more samples in 20.6 s.Collecting 69 more samples in 20.3 s.Collecting 68 more samples in 20.0 s.Collecting 67 more samples in 19.7 s.Collecting 66 more samples in 19.4 s.Collecting 65 more samples in 19.1 s.Collecting 64 more samples in 18.8 s.Collecting 63 more samples in 18.5 s.Collecting 62 more samples in 18.2 s.Collecting 61 more samples in 17.9 s.Collecting 60 more samples in 17.6 s.Collecting 59 more samples in 17.3 s.Collecting 58 more samples in 17.0 s.Collecting 57 more samples in 16.8 s.Collecting 56 more samples in 16.5 s.Collecting 55 more samples in 16.2 s.Collecting 54 more samples in 15.9 s.Collecting 53 more samples in 15.6 s.Collecting 52 more samples in 15.3 s.Collecting 51 more samples in 15.0 s.Collecting 50 more samples in 14.7 s.Collecting 49 more samples in 14.4 s.Collecting 48 more samples in 14.1 s.Collecting 47 more samples in 13.8 s.Collecting 46 more samples in 13.5 s.Collecting 45 more samples in 13.2 s.Collecting 44 more samples in 12.9 s.Collecting 43 more samples in 12.6 s.Collecting 42 more samples in 12.3 s.Collecting 41 more samples in 12.0 s.Collecting 40 more samples in 11.8 s.Collecting 39 more samples in 11.5 s.Collecting 38 more samples in 11.2 s.Collecting 37 more samples in 10.9 s.Collecting 36 more samples in 10.6 s.Collecting 35 more samples in 10.3 s.Collecting 34 more samples in 10.0 s.Collecting 33 more samples in 9.7 s.Collecting 32 more samples in 9.4 s.Collecting 31 more samples in 9.1 s.Collecting 30 more samples in 8.8 s.Collecting 29 more samples in 8.5 s.Collecting 28 more samples in 8.2 s.Collecting 27 more samples in 7.9 s.Collecting 26 more samples in 7.6 s.Collecting 25 more samples in 7.3 s.Collecting 24 more samples in 7.1 s.Collecting 23 more samples in 6.8 s.Collecting 22 more samples in 6.5 s.Collecting 21 more samples in 6.2 s.Collecting 20 more samples in 5.9 s.Collecting 19 more samples in 5.6 s.Collecting 18 more samples in 5.3 s.Collecting 17 more samples in 5.0 s.Collecting 16 more samples in 4.7 s.Collecting 15 more samples in 4.4 s.Collecting 14 more samples in 4.1 s.Collecting 13 more samples in 3.8 s.Collecting 12 more samples in 3.5 s.Collecting 11 more samples in 3.2 s.Collecting 10 more samples in 2.9 s.Collecting 9 more samples in 2.6 s.Collecting 8 more samples in 2.4 s.Collecting 7 more samples in 2.1 s.Collecting 6 more samples in 1.8 s.Collecting 5 more samples in 1.5 s.Collecting 4 more samples in 1.2 s.Collecting 3 more samples in 0.9 s.Collecting 2 more samples in 0.6 s.Collecting 1 more samples in 0.3 s.mean: 193.0445 ms, lower bound: 184.2504 ms, upper bound: 211.8890 ms, confidence: 0.950 std dev: 63.01450 ms, lower bound: 38.20118 ms, upper bound: 122.5075 ms, confidence: 0.950 found 17 outliers among 100 samples (17.0%) 13 (13.0%) high mild 4 (4.0%) high severe variance introduced by outliers: 97.859% variance is severely inflated by outliers commits: 200000 retries: 663 allocated bytes: 266015288 Running a subject "8/25000/ttrie" Collecting 100 more samples in 13.4 s.Collecting 99 more samples in 13.3 s.Collecting 98 more samples in 13.1 s.Collecting 97 more samples in 13.0 s.Collecting 96 more samples in 12.9 s.Collecting 95 more samples in 12.7 s.Collecting 94 more samples in 12.6 s.Collecting 93 more samples in 12.5 s.Collecting 92 more samples in 12.3 s.Collecting 91 more samples in 12.2 s.Collecting 90 more samples in 12.1 s.Collecting 89 more samples in 11.9 s.Collecting 88 more samples in 11.8 s.Collecting 87 more samples in 11.7 s.Collecting 86 more samples in 11.5 s.Collecting 85 more samples in 11.4 s.Collecting 84 more samples in 11.3 s.Collecting 83 more samples in 11.1 s.Collecting 82 more samples in 11.0 s.Collecting 81 more samples in 10.8 s.Collecting 80 more samples in 10.7 s.Collecting 79 more samples in 10.6 s.Collecting 78 more samples in 10.4 s.Collecting 77 more samples in 10.3 s.Collecting 76 more samples in 10.2 s.Collecting 75 more samples in 10.0 s.Collecting 74 more samples in 9.9 s.Collecting 73 more samples in 9.8 s.Collecting 72 more samples in 9.6 s.Collecting 71 more samples in 9.5 s.Collecting 70 more samples in 9.4 s.Collecting 69 more samples in 9.2 s.Collecting 68 more samples in 9.1 s.Collecting 67 more samples in 9.0 s.Collecting 66 more samples in 8.8 s.Collecting 65 more samples in 8.7 s.Collecting 64 more samples in 8.6 s.Collecting 63 more samples in 8.4 s.Collecting 62 more samples in 8.3 s.Collecting 61 more samples in 8.2 s.Collecting 60 more samples in 8.0 s.Collecting 59 more samples in 7.9 s.Collecting 58 more samples in 7.8 s.Collecting 57 more samples in 7.6 s.Collecting 56 more samples in 7.5 s.Collecting 55 more samples in 7.4 s.Collecting 54 more samples in 7.2 s.Collecting 53 more samples in 7.1 s.Collecting 52 more samples in 7.0 s.Collecting 51 more samples in 6.8 s.Collecting 50 more samples in 6.7 s.Collecting 49 more samples in 6.6 s.Collecting 48 more samples in 6.4 s.Collecting 47 more samples in 6.3 s.Collecting 46 more samples in 6.2 s.Collecting 45 more samples in 6.0 s.Collecting 44 more samples in 5.9 s.Collecting 43 more samples in 5.8 s.Collecting 42 more samples in 5.6 s.Collecting 41 more samples in 5.5 s.Collecting 40 more samples in 5.4 s.Collecting 39 more samples in 5.2 s.Collecting 38 more samples in 5.1 s.Collecting 37 more samples in 5.0 s.Collecting 36 more samples in 4.8 s.Collecting 35 more samples in 4.7 s.Collecting 34 more samples in 4.6 s.Collecting 33 more samples in 4.4 s.Collecting 32 more samples in 4.3 s.Collecting 31 more samples in 4.2 s.Collecting 30 more samples in 4.0 s.Collecting 29 more samples in 3.9 s.Collecting 28 more samples in 3.8 s.Collecting 27 more samples in 3.6 s.Collecting 26 more samples in 3.5 s.Collecting 25 more samples in 3.3 s.Collecting 24 more samples in 3.2 s.Collecting 23 more samples in 3.1 s.Collecting 22 more samples in 2.9 s.Collecting 21 more samples in 2.8 s.Collecting 20 more samples in 2.7 s.Collecting 19 more samples in 2.5 s.Collecting 18 more samples in 2.4 s.Collecting 17 more samples in 2.3 s.Collecting 16 more samples in 2.1 s.Collecting 15 more samples in 2.0 s.Collecting 14 more samples in 1.9 s.Collecting 13 more samples in 1.7 s.Collecting 12 more samples in 1.6 s.Collecting 11 more samples in 1.5 s.Collecting 10 more samples in 1.3 s.Collecting 9 more samples in 1.2 s.Collecting 8 more samples in 1.1 s.Collecting 7 more samples in 0.9 s.Collecting 6 more samples in 0.8 s.Collecting 5 more samples in 0.7 s.Collecting 4 more samples in 0.5 s.Collecting 3 more samples in 0.4 s.Collecting 2 more samples in 0.3 s.Collecting 1 more samples in 0.1 s.mean: 127.1454 ms, lower bound: 123.8172 ms, upper bound: 132.4686 ms, confidence: 0.950 std dev: 21.21899 ms, lower bound: 14.96341 ms, upper bound: 34.47629 ms, confidence: 0.950 found 3 outliers among 100 samples (3.0%) 2 (2.0%) high severe variance introduced by outliers: 91.525% variance is severely inflated by outliers commits: 200000 retries: 0 allocated bytes: 141177576 Running a subject "10/20000/unordered-containers" Collecting 99 more samples in 81.7 s.Collecting 98 more samples in 80.9 s.Collecting 97 more samples in 80.1 s.Collecting 96 more samples in 79.3 s.Collecting 95 more samples in 78.4 s.Collecting 94 more samples in 77.6 s.Collecting 93 more samples in 76.8 s.Collecting 92 more samples in 76.0 s.Collecting 91 more samples in 75.1 s.Collecting 90 more samples in 74.3 s.Collecting 89 more samples in 73.5 s.Collecting 88 more samples in 72.6 s.Collecting 87 more samples in 71.8 s.Collecting 86 more samples in 71.0 s.Collecting 85 more samples in 70.2 s.Collecting 84 more samples in 69.3 s.Collecting 83 more samples in 68.5 s.Collecting 82 more samples in 67.7 s.Collecting 81 more samples in 66.9 s.Collecting 80 more samples in 66.0 s.Collecting 79 more samples in 65.2 s.Collecting 78 more samples in 64.4 s.Collecting 77 more samples in 63.6 s.Collecting 76 more samples in 62.7 s.Collecting 75 more samples in 61.9 s.Collecting 74 more samples in 61.1 s.Collecting 73 more samples in 60.3 s.Collecting 72 more samples in 59.4 s.Collecting 71 more samples in 58.6 s.Collecting 70 more samples in 57.8 s.Collecting 69 more samples in 57.0 s.Collecting 68 more samples in 56.1 s.Collecting 67 more samples in 55.3 s.Collecting 66 more samples in 54.5 s.Collecting 65 more samples in 53.7 s.Collecting 64 more samples in 52.8 s.Collecting 63 more samples in 52.0 s.Collecting 62 more samples in 51.2 s.Collecting 61 more samples in 50.4 s.Collecting 60 more samples in 49.5 s.Collecting 59 more samples in 48.7 s.Collecting 58 more samples in 47.9 s.Collecting 57 more samples in 47.1 s.Collecting 56 more samples in 46.2 s.Collecting 55 more samples in 45.4 s.Collecting 54 more samples in 44.6 s.Collecting 53 more samples in 43.8 s.Collecting 52 more samples in 42.9 s.Collecting 51 more samples in 42.1 s.Collecting 50 more samples in 41.3 s.Collecting 49 more samples in 40.5 s.Collecting 48 more samples in 39.6 s.Collecting 47 more samples in 38.8 s.Collecting 46 more samples in 38.0 s.Collecting 45 more samples in 37.2 s.Collecting 44 more samples in 36.3 s.Collecting 43 more samples in 35.5 s.Collecting 42 more samples in 34.7 s.Collecting 41 more samples in 33.8 s.Collecting 40 more samples in 33.0 s.Collecting 39 more samples in 32.2 s.Collecting 38 more samples in 31.4 s.Collecting 37 more samples in 30.5 s.Collecting 36 more samples in 29.7 s.Collecting 35 more samples in 28.9 s.Collecting 34 more samples in 28.1 s.Collecting 33 more samples in 27.2 s.Collecting 32 more samples in 26.4 s.Collecting 31 more samples in 25.6 s.Collecting 30 more samples in 24.8 s.Collecting 29 more samples in 23.9 s.Collecting 28 more samples in 23.1 s.Collecting 27 more samples in 22.3 s.Collecting 26 more samples in 21.5 s.Collecting 25 more samples in 20.6 s.Collecting 24 more samples in 19.8 s.Collecting 23 more samples in 19.0 s.Collecting 22 more samples in 18.2 s.Collecting 21 more samples in 17.3 s.Collecting 20 more samples in 16.5 s.Collecting 19 more samples in 15.7 s.Collecting 18 more samples in 14.9 s.Collecting 17 more samples in 14.0 s.Collecting 16 more samples in 13.2 s.Collecting 15 more samples in 12.4 s.Collecting 14 more samples in 11.6 s.Collecting 13 more samples in 10.7 s.Collecting 12 more samples in 9.9 s.Collecting 11 more samples in 9.1 s.Collecting 10 more samples in 8.3 s.Collecting 9 more samples in 7.4 s.Collecting 8 more samples in 6.6 s.Collecting 7 more samples in 5.8 s.Collecting 6 more samples in 5.0 s.Collecting 5 more samples in 4.1 s.Collecting 4 more samples in 3.3 s.Collecting 3 more samples in 2.5 s.Collecting 2 more samples in 1.7 s.Collecting 1 more samples in 0.8 s.mean: 817.5325 ms, lower bound: 808.9280 ms, upper bound: 825.3871 ms, confidence: 0.950 std dev: 42.47664 ms, lower bound: 36.70582 ms, upper bound: 50.54906 ms, confidence: 0.950 found 2 outliers among 100 samples (2.0%) 2 (2.0%) low mild variance introduced by outliers: 50.435% variance is severely inflated by outliers commits: 200000 retries: 862058 allocated bytes: 882079096 Running a subject "10/20000/stm-containers" Collecting 100 more samples in 15.7 s.Collecting 99 more samples in 15.6 s.Collecting 98 more samples in 15.4 s.Collecting 97 more samples in 15.3 s.Collecting 96 more samples in 15.1 s.Collecting 95 more samples in 14.9 s.Collecting 94 more samples in 14.8 s.Collecting 93 more samples in 14.6 s.Collecting 92 more samples in 14.5 s.Collecting 91 more samples in 14.3 s.Collecting 90 more samples in 14.2 s.Collecting 89 more samples in 14.0 s.Collecting 88 more samples in 13.8 s.Collecting 87 more samples in 13.7 s.Collecting 86 more samples in 13.5 s.Collecting 85 more samples in 13.4 s.Collecting 84 more samples in 13.2 s.Collecting 83 more samples in 13.1 s.Collecting 82 more samples in 12.9 s.Collecting 81 more samples in 12.7 s.Collecting 80 more samples in 12.6 s.Collecting 79 more samples in 12.4 s.Collecting 78 more samples in 12.3 s.Collecting 77 more samples in 12.1 s.Collecting 76 more samples in 12.0 s.Collecting 75 more samples in 11.8 s.Collecting 74 more samples in 11.6 s.Collecting 73 more samples in 11.5 s.Collecting 72 more samples in 11.3 s.Collecting 71 more samples in 11.2 s.Collecting 70 more samples in 11.0 s.Collecting 69 more samples in 10.9 s.Collecting 68 more samples in 10.7 s.Collecting 67 more samples in 10.5 s.Collecting 66 more samples in 10.4 s.Collecting 65 more samples in 10.2 s.Collecting 64 more samples in 10.1 s.Collecting 63 more samples in 9.9 s.Collecting 62 more samples in 9.8 s.Collecting 61 more samples in 9.6 s.Collecting 60 more samples in 9.4 s.Collecting 59 more samples in 9.3 s.Collecting 58 more samples in 9.1 s.Collecting 57 more samples in 9.0 s.Collecting 56 more samples in 8.8 s.Collecting 55 more samples in 8.7 s.Collecting 54 more samples in 8.5 s.Collecting 53 more samples in 8.3 s.Collecting 52 more samples in 8.2 s.Collecting 51 more samples in 8.0 s.Collecting 50 more samples in 7.9 s.Collecting 49 more samples in 7.7 s.Collecting 48 more samples in 7.6 s.Collecting 47 more samples in 7.4 s.Collecting 46 more samples in 7.2 s.Collecting 45 more samples in 7.1 s.Collecting 44 more samples in 6.9 s.Collecting 43 more samples in 6.8 s.Collecting 42 more samples in 6.6 s.Collecting 41 more samples in 6.5 s.Collecting 40 more samples in 6.3 s.Collecting 39 more samples in 6.1 s.Collecting 38 more samples in 6.0 s.Collecting 37 more samples in 5.8 s.Collecting 36 more samples in 5.7 s.Collecting 35 more samples in 5.5 s.Collecting 34 more samples in 5.3 s.Collecting 33 more samples in 5.2 s.Collecting 32 more samples in 5.0 s.Collecting 31 more samples in 4.9 s.Collecting 30 more samples in 4.7 s.Collecting 29 more samples in 4.6 s.Collecting 28 more samples in 4.4 s.Collecting 27 more samples in 4.2 s.Collecting 26 more samples in 4.1 s.Collecting 25 more samples in 3.9 s.Collecting 24 more samples in 3.8 s.Collecting 23 more samples in 3.6 s.Collecting 22 more samples in 3.5 s.Collecting 21 more samples in 3.3 s.Collecting 20 more samples in 3.1 s.Collecting 19 more samples in 3.0 s.Collecting 18 more samples in 2.8 s.Collecting 17 more samples in 2.7 s.Collecting 16 more samples in 2.5 s.Collecting 15 more samples in 2.4 s.Collecting 14 more samples in 2.2 s.Collecting 13 more samples in 2.0 s.Collecting 12 more samples in 1.9 s.Collecting 11 more samples in 1.7 s.Collecting 10 more samples in 1.6 s.Collecting 9 more samples in 1.4 s.Collecting 8 more samples in 1.3 s.Collecting 7 more samples in 1.1 s.Collecting 6 more samples in 0.9 s.Collecting 5 more samples in 0.8 s.Collecting 4 more samples in 0.6 s.Collecting 3 more samples in 0.5 s.Collecting 2 more samples in 0.3 s.Collecting 1 more samples in 0.2 s.mean: 178.7495 ms, lower bound: 169.0255 ms, upper bound: 190.9114 ms, confidence: 0.950 std dev: 55.92603 ms, lower bound: 47.15269 ms, upper bound: 74.07408 ms, confidence: 0.950 found 3 outliers among 100 samples (3.0%) 2 (2.0%) high mild 1 (1.0%) high severe variance introduced by outliers: 97.847% variance is severely inflated by outliers commits: 200000 retries: 827 allocated bytes: 266178328 Running a subject "10/20000/ttrie" Collecting 100 more samples in 12.3 s.Collecting 99 more samples in 12.2 s.Collecting 98 more samples in 12.1 s.Collecting 97 more samples in 12.0 s.Collecting 96 more samples in 11.8 s.Collecting 95 more samples in 11.7 s.Collecting 94 more samples in 11.6 s.Collecting 93 more samples in 11.5 s.Collecting 92 more samples in 11.4 s.Collecting 91 more samples in 11.2 s.Collecting 90 more samples in 11.1 s.Collecting 89 more samples in 11.0 s.Collecting 88 more samples in 10.9 s.Collecting 87 more samples in 10.7 s.Collecting 86 more samples in 10.6 s.Collecting 85 more samples in 10.5 s.Collecting 84 more samples in 10.4 s.Collecting 83 more samples in 10.2 s.Collecting 82 more samples in 10.1 s.Collecting 81 more samples in 10.0 s.Collecting 80 more samples in 9.9 s.Collecting 79 more samples in 9.7 s.Collecting 78 more samples in 9.6 s.Collecting 77 more samples in 9.5 s.Collecting 76 more samples in 9.4 s.Collecting 75 more samples in 9.3 s.Collecting 74 more samples in 9.1 s.Collecting 73 more samples in 9.0 s.Collecting 72 more samples in 8.9 s.Collecting 71 more samples in 8.8 s.Collecting 70 more samples in 8.6 s.Collecting 69 more samples in 8.5 s.Collecting 68 more samples in 8.4 s.Collecting 67 more samples in 8.3 s.Collecting 66 more samples in 8.1 s.Collecting 65 more samples in 8.0 s.Collecting 64 more samples in 7.9 s.Collecting 63 more samples in 7.8 s.Collecting 62 more samples in 7.6 s.Collecting 61 more samples in 7.5 s.Collecting 60 more samples in 7.4 s.Collecting 59 more samples in 7.3 s.Collecting 58 more samples in 7.2 s.Collecting 57 more samples in 7.0 s.Collecting 56 more samples in 6.9 s.Collecting 55 more samples in 6.8 s.Collecting 54 more samples in 6.7 s.Collecting 53 more samples in 6.5 s.Collecting 52 more samples in 6.4 s.Collecting 51 more samples in 6.3 s.Collecting 50 more samples in 6.2 s.Collecting 49 more samples in 6.0 s.Collecting 48 more samples in 5.9 s.Collecting 47 more samples in 5.8 s.Collecting 46 more samples in 5.7 s.Collecting 45 more samples in 5.6 s.Collecting 44 more samples in 5.4 s.Collecting 43 more samples in 5.3 s.Collecting 42 more samples in 5.2 s.Collecting 41 more samples in 5.1 s.Collecting 40 more samples in 4.9 s.Collecting 39 more samples in 4.8 s.Collecting 38 more samples in 4.7 s.Collecting 37 more samples in 4.6 s.Collecting 36 more samples in 4.4 s.Collecting 35 more samples in 4.3 s.Collecting 34 more samples in 4.2 s.Collecting 33 more samples in 4.1 s.Collecting 32 more samples in 3.9 s.Collecting 31 more samples in 3.8 s.Collecting 30 more samples in 3.7 s.Collecting 29 more samples in 3.6 s.Collecting 28 more samples in 3.5 s.Collecting 27 more samples in 3.3 s.Collecting 26 more samples in 3.2 s.Collecting 25 more samples in 3.1 s.Collecting 24 more samples in 3.0 s.Collecting 23 more samples in 2.8 s.Collecting 22 more samples in 2.7 s.Collecting 21 more samples in 2.6 s.Collecting 20 more samples in 2.5 s.Collecting 19 more samples in 2.3 s.Collecting 18 more samples in 2.2 s.Collecting 17 more samples in 2.1 s.Collecting 16 more samples in 2.0 s.Collecting 15 more samples in 1.9 s.Collecting 14 more samples in 1.7 s.Collecting 13 more samples in 1.6 s.Collecting 12 more samples in 1.5 s.Collecting 11 more samples in 1.4 s.Collecting 10 more samples in 1.2 s.Collecting 9 more samples in 1.1 s.Collecting 8 more samples in 1.0 s.Collecting 7 more samples in 0.9 s.Collecting 6 more samples in 0.7 s.Collecting 5 more samples in 0.6 s.Collecting 4 more samples in 0.5 s.Collecting 3 more samples in 0.4 s.Collecting 2 more samples in 0.2 s.Collecting 1 more samples in 0.1 s.mean: 116.8941 ms, lower bound: 109.6243 ms, upper bound: 142.6855 ms, confidence: 0.950 std dev: 62.55055 ms, lower bound: 17.61596 ms, upper bound: 142.8123 ms, confidence: 0.950 found 10 outliers among 100 samples (10.0%) 4 (4.0%) high mild 6 (6.0%) high severe variance introduced by outliers: 98.947% variance is severely inflated by outliers commits: 200000 retries: 0 allocated bytes: 141255904 Running a subject "12/16666/unordered-containers" Collecting 99 more samples in 85.3 s.Collecting 98 more samples in 84.5 s.Collecting 97 more samples in 83.6 s.Collecting 96 more samples in 82.8 s.Collecting 95 more samples in 81.9 s.Collecting 94 more samples in 81.0 s.Collecting 93 more samples in 80.2 s.Collecting 92 more samples in 79.3 s.Collecting 91 more samples in 78.4 s.Collecting 90 more samples in 77.6 s.Collecting 89 more samples in 76.7 s.Collecting 88 more samples in 75.9 s.Collecting 87 more samples in 75.0 s.Collecting 86 more samples in 74.1 s.Collecting 85 more samples in 73.3 s.Collecting 84 more samples in 72.4 s.Collecting 83 more samples in 71.5 s.Collecting 82 more samples in 70.7 s.Collecting 81 more samples in 69.8 s.Collecting 80 more samples in 69.0 s.Collecting 79 more samples in 68.1 s.Collecting 78 more samples in 67.2 s.Collecting 77 more samples in 66.4 s.Collecting 76 more samples in 65.5 s.Collecting 75 more samples in 64.7 s.Collecting 74 more samples in 63.8 s.Collecting 73 more samples in 62.9 s.Collecting 72 more samples in 62.1 s.Collecting 71 more samples in 61.2 s.Collecting 70 more samples in 60.3 s.Collecting 69 more samples in 59.5 s.Collecting 68 more samples in 58.6 s.Collecting 67 more samples in 57.8 s.Collecting 66 more samples in 56.9 s.Collecting 65 more samples in 56.0 s.Collecting 64 more samples in 55.2 s.Collecting 63 more samples in 54.3 s.Collecting 62 more samples in 53.4 s.Collecting 61 more samples in 52.6 s.Collecting 60 more samples in 51.7 s.Collecting 59 more samples in 50.9 s.Collecting 58 more samples in 50.0 s.Collecting 57 more samples in 49.1 s.Collecting 56 more samples in 48.3 s.Collecting 55 more samples in 47.4 s.Collecting 54 more samples in 46.5 s.Collecting 53 more samples in 45.7 s.Collecting 52 more samples in 44.8 s.Collecting 51 more samples in 44.0 s.Collecting 50 more samples in 43.1 s.Collecting 49 more samples in 42.2 s.Collecting 48 more samples in 41.4 s.Collecting 47 more samples in 40.5 s.Collecting 46 more samples in 39.7 s.Collecting 45 more samples in 38.8 s.Collecting 44 more samples in 37.9 s.Collecting 43 more samples in 37.1 s.Collecting 42 more samples in 36.2 s.Collecting 41 more samples in 35.3 s.Collecting 40 more samples in 34.5 s.Collecting 39 more samples in 33.6 s.Collecting 38 more samples in 32.8 s.Collecting 37 more samples in 31.9 s.Collecting 36 more samples in 31.0 s.Collecting 35 more samples in 30.2 s.Collecting 34 more samples in 29.3 s.Collecting 33 more samples in 28.4 s.Collecting 32 more samples in 27.6 s.Collecting 31 more samples in 26.7 s.Collecting 30 more samples in 25.9 s.Collecting 29 more samples in 25.0 s.Collecting 28 more samples in 24.1 s.Collecting 27 more samples in 23.3 s.Collecting 26 more samples in 22.4 s.Collecting 25 more samples in 21.6 s.Collecting 24 more samples in 20.7 s.Collecting 23 more samples in 19.8 s.Collecting 22 more samples in 19.0 s.Collecting 21 more samples in 18.1 s.Collecting 20 more samples in 17.2 s.Collecting 19 more samples in 16.4 s.Collecting 18 more samples in 15.5 s.Collecting 17 more samples in 14.7 s.Collecting 16 more samples in 13.8 s.Collecting 15 more samples in 12.9 s.Collecting 14 more samples in 12.1 s.Collecting 13 more samples in 11.2 s.Collecting 12 more samples in 10.3 s.Collecting 11 more samples in 9.5 s.Collecting 10 more samples in 8.6 s.Collecting 9 more samples in 7.8 s.Collecting 8 more samples in 6.9 s.Collecting 7 more samples in 6.0 s.Collecting 6 more samples in 5.2 s.Collecting 5 more samples in 4.3 s.Collecting 4 more samples in 3.4 s.Collecting 3 more samples in 2.6 s.Collecting 2 more samples in 1.7 s.Collecting 1 more samples in 0.9 s.mean: 837.6066 ms, lower bound: 827.3254 ms, upper bound: 847.6889 ms, confidence: 0.950 std dev: 51.93281 ms, lower bound: 43.78388 ms, upper bound: 63.80796 ms, confidence: 0.950 found 5 outliers among 100 samples (5.0%) 2 (2.0%) low mild 3 (3.0%) high mild variance introduced by outliers: 59.488% variance is severely inflated by outliers commits: 200000 retries: 908718 allocated bytes: 928134480 Running a subject "12/16666/stm-containers" Collecting 100 more samples in 13.8 s.Collecting 99 more samples in 13.6 s.Collecting 98 more samples in 13.5 s.Collecting 97 more samples in 13.4 s.Collecting 96 more samples in 13.2 s.Collecting 95 more samples in 13.1 s.Collecting 94 more samples in 12.9 s.Collecting 93 more samples in 12.8 s.Collecting 92 more samples in 12.7 s.Collecting 91 more samples in 12.5 s.Collecting 90 more samples in 12.4 s.Collecting 89 more samples in 12.3 s.Collecting 88 more samples in 12.1 s.Collecting 87 more samples in 12.0 s.Collecting 86 more samples in 11.8 s.Collecting 85 more samples in 11.7 s.Collecting 84 more samples in 11.6 s.Collecting 83 more samples in 11.4 s.Collecting 82 more samples in 11.3 s.Collecting 81 more samples in 11.2 s.Collecting 80 more samples in 11.0 s.Collecting 79 more samples in 10.9 s.Collecting 78 more samples in 10.7 s.Collecting 77 more samples in 10.6 s.Collecting 76 more samples in 10.5 s.Collecting 75 more samples in 10.3 s.Collecting 74 more samples in 10.2 s.Collecting 73 more samples in 10.1 s.Collecting 72 more samples in 9.9 s.Collecting 71 more samples in 9.8 s.Collecting 70 more samples in 9.6 s.Collecting 69 more samples in 9.5 s.Collecting 68 more samples in 9.4 s.Collecting 67 more samples in 9.2 s.Collecting 66 more samples in 9.1 s.Collecting 65 more samples in 9.0 s.Collecting 64 more samples in 8.8 s.Collecting 63 more samples in 8.7 s.Collecting 62 more samples in 8.5 s.Collecting 61 more samples in 8.4 s.Collecting 60 more samples in 8.3 s.Collecting 59 more samples in 8.1 s.Collecting 58 more samples in 8.0 s.Collecting 57 more samples in 7.9 s.Collecting 56 more samples in 7.7 s.Collecting 55 more samples in 7.6 s.Collecting 54 more samples in 7.4 s.Collecting 53 more samples in 7.3 s.Collecting 52 more samples in 7.2 s.Collecting 51 more samples in 7.0 s.Collecting 50 more samples in 6.9 s.Collecting 49 more samples in 6.7 s.Collecting 48 more samples in 6.6 s.Collecting 47 more samples in 6.5 s.Collecting 46 more samples in 6.3 s.Collecting 45 more samples in 6.2 s.Collecting 44 more samples in 6.1 s.Collecting 43 more samples in 5.9 s.Collecting 42 more samples in 5.8 s.Collecting 41 more samples in 5.6 s.Collecting 40 more samples in 5.5 s.Collecting 39 more samples in 5.4 s.Collecting 38 more samples in 5.2 s.Collecting 37 more samples in 5.1 s.Collecting 36 more samples in 5.0 s.Collecting 35 more samples in 4.8 s.Collecting 34 more samples in 4.7 s.Collecting 33 more samples in 4.5 s.Collecting 32 more samples in 4.4 s.Collecting 31 more samples in 4.3 s.Collecting 30 more samples in 4.1 s.Collecting 29 more samples in 4.0 s.Collecting 28 more samples in 3.9 s.Collecting 27 more samples in 3.7 s.Collecting 26 more samples in 3.6 s.Collecting 25 more samples in 3.4 s.Collecting 24 more samples in 3.3 s.Collecting 23 more samples in 3.2 s.Collecting 22 more samples in 3.0 s.Collecting 21 more samples in 2.9 s.Collecting 20 more samples in 2.8 s.Collecting 19 more samples in 2.6 s.Collecting 18 more samples in 2.5 s.Collecting 17 more samples in 2.3 s.Collecting 16 more samples in 2.2 s.Collecting 15 more samples in 2.1 s.Collecting 14 more samples in 1.9 s.Collecting 13 more samples in 1.8 s.Collecting 12 more samples in 1.7 s.Collecting 11 more samples in 1.5 s.Collecting 10 more samples in 1.4 s.Collecting 9 more samples in 1.2 s.Collecting 8 more samples in 1.1 s.Collecting 7 more samples in 1.0 s.Collecting 6 more samples in 0.8 s.Collecting 5 more samples in 0.7 s.Collecting 4 more samples in 0.6 s.Collecting 3 more samples in 0.4 s.Collecting 2 more samples in 0.3 s.Collecting 1 more samples in 0.1 s.mean: 140.0752 ms, lower bound: 130.9647 ms, upper bound: 151.5078 ms, confidence: 0.950 std dev: 52.16096 ms, lower bound: 44.13282 ms, upper bound: 67.28976 ms, confidence: 0.950 found 9 outliers among 100 samples (9.0%) 8 (8.0%) high mild 1 (1.0%) high severe variance introduced by outliers: 98.890% variance is severely inflated by outliers commits: 200000 retries: 921 allocated bytes: 266644136 Running a subject "12/16666/ttrie" Collecting 100 more samples in 11.8 s.Collecting 99 more samples in 11.6 s.Collecting 98 more samples in 11.5 s.Collecting 97 more samples in 11.4 s.Collecting 96 more samples in 11.3 s.Collecting 95 more samples in 11.2 s.Collecting 94 more samples in 11.1 s.Collecting 93 more samples in 10.9 s.Collecting 92 more samples in 10.8 s.Collecting 91 more samples in 10.7 s.Collecting 90 more samples in 10.6 s.Collecting 89 more samples in 10.5 s.Collecting 88 more samples in 10.3 s.Collecting 87 more samples in 10.2 s.Collecting 86 more samples in 10.1 s.Collecting 85 more samples in 10.0 s.Collecting 84 more samples in 9.9 s.Collecting 83 more samples in 9.8 s.Collecting 82 more samples in 9.6 s.Collecting 81 more samples in 9.5 s.Collecting 80 more samples in 9.4 s.Collecting 79 more samples in 9.3 s.Collecting 78 more samples in 9.2 s.Collecting 77 more samples in 9.1 s.Collecting 76 more samples in 8.9 s.Collecting 75 more samples in 8.8 s.Collecting 74 more samples in 8.7 s.Collecting 73 more samples in 8.6 s.Collecting 72 more samples in 8.5 s.Collecting 71 more samples in 8.3 s.Collecting 70 more samples in 8.2 s.Collecting 69 more samples in 8.1 s.Collecting 68 more samples in 8.0 s.Collecting 67 more samples in 7.9 s.Collecting 66 more samples in 7.8 s.Collecting 65 more samples in 7.6 s.Collecting 64 more samples in 7.5 s.Collecting 63 more samples in 7.4 s.Collecting 62 more samples in 7.3 s.Collecting 61 more samples in 7.2 s.Collecting 60 more samples in 7.1 s.Collecting 59 more samples in 6.9 s.Collecting 58 more samples in 6.8 s.Collecting 57 more samples in 6.7 s.Collecting 56 more samples in 6.6 s.Collecting 55 more samples in 6.5 s.Collecting 54 more samples in 6.3 s.Collecting 53 more samples in 6.2 s.Collecting 52 more samples in 6.1 s.Collecting 51 more samples in 6.0 s.Collecting 50 more samples in 5.9 s.Collecting 49 more samples in 5.8 s.Collecting 48 more samples in 5.6 s.Collecting 47 more samples in 5.5 s.Collecting 46 more samples in 5.4 s.Collecting 45 more samples in 5.3 s.Collecting 44 more samples in 5.2 s.Collecting 43 more samples in 5.1 s.Collecting 42 more samples in 4.9 s.Collecting 41 more samples in 4.8 s.Collecting 40 more samples in 4.7 s.Collecting 39 more samples in 4.6 s.Collecting 38 more samples in 4.5 s.Collecting 37 more samples in 4.4 s.Collecting 36 more samples in 4.2 s.Collecting 35 more samples in 4.1 s.Collecting 34 more samples in 4.0 s.Collecting 33 more samples in 3.9 s.Collecting 32 more samples in 3.8 s.Collecting 31 more samples in 3.6 s.Collecting 30 more samples in 3.5 s.Collecting 29 more samples in 3.4 s.Collecting 28 more samples in 3.3 s.Collecting 27 more samples in 3.2 s.Collecting 26 more samples in 3.1 s.Collecting 25 more samples in 2.9 s.Collecting 24 more samples in 2.8 s.Collecting 23 more samples in 2.7 s.Collecting 22 more samples in 2.6 s.Collecting 21 more samples in 2.5 s.Collecting 20 more samples in 2.4 s.Collecting 19 more samples in 2.2 s.Collecting 18 more samples in 2.1 s.Collecting 17 more samples in 2.0 s.Collecting 16 more samples in 1.9 s.Collecting 15 more samples in 1.8 s.Collecting 14 more samples in 1.6 s.Collecting 13 more samples in 1.5 s.Collecting 12 more samples in 1.4 s.Collecting 11 more samples in 1.3 s.Collecting 10 more samples in 1.2 s.Collecting 9 more samples in 1.1 s.Collecting 8 more samples in 0.9 s.Collecting 7 more samples in 0.8 s.Collecting 6 more samples in 0.7 s.Collecting 5 more samples in 0.6 s.Collecting 4 more samples in 0.5 s.Collecting 3 more samples in 0.4 s.Collecting 2 more samples in 0.2 s.Collecting 1 more samples in 0.1 s.mean: 116.3420 ms, lower bound: 113.0482 ms, upper bound: 120.7977 ms, confidence: 0.950 std dev: 19.48429 ms, lower bound: 15.34935 ms, upper bound: 24.92324 ms, confidence: 0.950 found 12 outliers among 100 samples (12.0%) 7 (7.0%) high mild 5 (5.0%) high severe variance introduced by outliers: 91.528% variance is severely inflated by outliers commits: 200000 retries: 0 allocated bytes: 141276840 Running a subject "14/14285/unordered-containers" Collecting 99 more samples in 89.4 s.Collecting 98 more samples in 88.5 s.Collecting 97 more samples in 87.6 s.Collecting 96 more samples in 86.7 s.Collecting 95 more samples in 85.8 s.Collecting 94 more samples in 84.9 s.Collecting 93 more samples in 84.0 s.Collecting 92 more samples in 83.1 s.Collecting 91 more samples in 82.2 s.Collecting 90 more samples in 81.3 s.Collecting 89 more samples in 80.4 s.Collecting 88 more samples in 79.5 s.Collecting 87 more samples in 78.6 s.Collecting 86 more samples in 77.7 s.Collecting 85 more samples in 76.8 s.Collecting 84 more samples in 75.9 s.Collecting 83 more samples in 75.0 s.Collecting 82 more samples in 74.1 s.Collecting 81 more samples in 73.2 s.Collecting 80 more samples in 72.3 s.Collecting 79 more samples in 71.4 s.Collecting 78 more samples in 70.5 s.Collecting 77 more samples in 69.6 s.Collecting 76 more samples in 68.7 s.Collecting 75 more samples in 67.7 s.Collecting 74 more samples in 66.8 s.Collecting 73 more samples in 65.9 s.Collecting 72 more samples in 65.0 s.Collecting 71 more samples in 64.1 s.Collecting 70 more samples in 63.2 s.Collecting 69 more samples in 62.3 s.Collecting 68 more samples in 61.4 s.Collecting 67 more samples in 60.5 s.Collecting 66 more samples in 59.6 s.Collecting 65 more samples in 58.7 s.Collecting 64 more samples in 57.8 s.Collecting 63 more samples in 56.9 s.Collecting 62 more samples in 56.0 s.Collecting 61 more samples in 55.1 s.Collecting 60 more samples in 54.2 s.Collecting 59 more samples in 53.3 s.Collecting 58 more samples in 52.4 s.Collecting 57 more samples in 51.5 s.Collecting 56 more samples in 50.6 s.Collecting 55 more samples in 49.7 s.Collecting 54 more samples in 48.8 s.Collecting 53 more samples in 47.9 s.Collecting 52 more samples in 47.0 s.Collecting 51 more samples in 46.1 s.Collecting 50 more samples in 45.2 s.Collecting 49 more samples in 44.3 s.Collecting 48 more samples in 43.4 s.Collecting 47 more samples in 42.5 s.Collecting 46 more samples in 41.6 s.Collecting 45 more samples in 40.6 s.Collecting 44 more samples in 39.7 s.Collecting 43 more samples in 38.8 s.Collecting 42 more samples in 37.9 s.Collecting 41 more samples in 37.0 s.Collecting 40 more samples in 36.1 s.Collecting 39 more samples in 35.2 s.Collecting 38 more samples in 34.3 s.Collecting 37 more samples in 33.4 s.Collecting 36 more samples in 32.5 s.Collecting 35 more samples in 31.6 s.Collecting 34 more samples in 30.7 s.Collecting 33 more samples in 29.8 s.Collecting 32 more samples in 28.9 s.Collecting 31 more samples in 28.0 s.Collecting 30 more samples in 27.1 s.Collecting 29 more samples in 26.2 s.Collecting 28 more samples in 25.3 s.Collecting 27 more samples in 24.4 s.Collecting 26 more samples in 23.5 s.Collecting 25 more samples in 22.6 s.Collecting 24 more samples in 21.7 s.Collecting 23 more samples in 20.8 s.Collecting 22 more samples in 19.9 s.Collecting 21 more samples in 19.0 s.Collecting 20 more samples in 18.1 s.Collecting 19 more samples in 17.2 s.Collecting 18 more samples in 16.3 s.Collecting 17 more samples in 15.4 s.Collecting 16 more samples in 14.5 s.Collecting 15 more samples in 13.5 s.Collecting 14 more samples in 12.6 s.Collecting 13 more samples in 11.7 s.Collecting 12 more samples in 10.8 s.Collecting 11 more samples in 9.9 s.Collecting 10 more samples in 9.0 s.Collecting 9 more samples in 8.1 s.Collecting 8 more samples in 7.2 s.Collecting 7 more samples in 6.3 s.Collecting 6 more samples in 5.4 s.Collecting 5 more samples in 4.5 s.Collecting 4 more samples in 3.6 s.Collecting 3 more samples in 2.7 s.Collecting 2 more samples in 1.8 s.Collecting 1 more samples in 0.9 s.mean: 930.3171 ms, lower bound: 917.2429 ms, upper bound: 942.8926 ms, confidence: 0.950 std dev: 65.92527 ms, lower bound: 58.19302 ms, upper bound: 76.14647 ms, confidence: 0.950 variance introduced by outliers: 65.603% variance is severely inflated by outliers commits: 200000 retries: 987155 allocated bytes: 992825936 Running a subject "14/14285/stm-containers" Collecting 100 more samples in 10.6 s.Collecting 99 more samples in 10.5 s.Collecting 98 more samples in 10.4 s.Collecting 97 more samples in 10.3 s.Collecting 96 more samples in 10.2 s.Collecting 95 more samples in 10.1 s.Collecting 94 more samples in 10.0 s.Collecting 93 more samples in 9.9 s.Collecting 92 more samples in 9.8 s.Collecting 91 more samples in 9.7 s.Collecting 90 more samples in 9.6 s.Collecting 89 more samples in 9.5 s.Collecting 88 more samples in 9.3 s.Collecting 87 more samples in 9.2 s.Collecting 86 more samples in 9.1 s.Collecting 85 more samples in 9.0 s.Collecting 84 more samples in 8.9 s.Collecting 83 more samples in 8.8 s.Collecting 82 more samples in 8.7 s.Collecting 81 more samples in 8.6 s.Collecting 80 more samples in 8.5 s.Collecting 79 more samples in 8.4 s.Collecting 78 more samples in 8.3 s.Collecting 77 more samples in 8.2 s.Collecting 76 more samples in 8.1 s.Collecting 75 more samples in 8.0 s.Collecting 74 more samples in 7.9 s.Collecting 73 more samples in 7.8 s.Collecting 72 more samples in 7.6 s.Collecting 71 more samples in 7.5 s.Collecting 70 more samples in 7.4 s.Collecting 69 more samples in 7.3 s.Collecting 68 more samples in 7.2 s.Collecting 67 more samples in 7.1 s.Collecting 66 more samples in 7.0 s.Collecting 65 more samples in 6.9 s.Collecting 64 more samples in 6.8 s.Collecting 63 more samples in 6.7 s.Collecting 62 more samples in 6.6 s.Collecting 61 more samples in 6.5 s.Collecting 60 more samples in 6.4 s.Collecting 59 more samples in 6.3 s.Collecting 58 more samples in 6.2 s.Collecting 57 more samples in 6.1 s.Collecting 56 more samples in 5.9 s.Collecting 55 more samples in 5.8 s.Collecting 54 more samples in 5.7 s.Collecting 53 more samples in 5.6 s.Collecting 52 more samples in 5.5 s.Collecting 51 more samples in 5.4 s.Collecting 50 more samples in 5.3 s.Collecting 49 more samples in 5.2 s.Collecting 48 more samples in 5.1 s.Collecting 47 more samples in 5.0 s.Collecting 46 more samples in 4.9 s.Collecting 45 more samples in 4.8 s.Collecting 44 more samples in 4.7 s.Collecting 43 more samples in 4.6 s.Collecting 42 more samples in 4.5 s.Collecting 41 more samples in 4.4 s.Collecting 40 more samples in 4.2 s.Collecting 39 more samples in 4.1 s.Collecting 38 more samples in 4.0 s.Collecting 37 more samples in 3.9 s.Collecting 36 more samples in 3.8 s.Collecting 35 more samples in 3.7 s.Collecting 34 more samples in 3.6 s.Collecting 33 more samples in 3.5 s.Collecting 32 more samples in 3.4 s.Collecting 31 more samples in 3.3 s.Collecting 30 more samples in 3.2 s.Collecting 29 more samples in 3.1 s.Collecting 28 more samples in 3.0 s.Collecting 27 more samples in 2.9 s.Collecting 26 more samples in 2.8 s.Collecting 25 more samples in 2.7 s.Collecting 24 more samples in 2.5 s.Collecting 23 more samples in 2.4 s.Collecting 22 more samples in 2.3 s.Collecting 21 more samples in 2.2 s.Collecting 20 more samples in 2.1 s.Collecting 19 more samples in 2.0 s.Collecting 18 more samples in 1.9 s.Collecting 17 more samples in 1.8 s.Collecting 16 more samples in 1.7 s.Collecting 15 more samples in 1.6 s.Collecting 14 more samples in 1.5 s.Collecting 13 more samples in 1.4 s.Collecting 12 more samples in 1.3 s.Collecting 11 more samples in 1.2 s.Collecting 10 more samples in 1.1 s.Collecting 9 more samples in 1.0 s.Collecting 8 more samples in 0.8 s.Collecting 7 more samples in 0.7 s.Collecting 6 more samples in 0.6 s.Collecting 5 more samples in 0.5 s.Collecting 4 more samples in 0.4 s.Collecting 3 more samples in 0.3 s.Collecting 2 more samples in 0.2 s.Collecting 1 more samples in 0.1 s.mean: 113.5980 ms, lower bound: 109.5714 ms, upper bound: 120.6717 ms, confidence: 0.950 std dev: 26.64138 ms, lower bound: 17.86164 ms, upper bound: 43.87852 ms, confidence: 0.950 found 7 outliers among 100 samples (7.0%) 4 (4.0%) high mild 3 (3.0%) high severe variance introduced by outliers: 95.738% variance is severely inflated by outliers commits: 200000 retries: 910 allocated bytes: 267030096 Running a subject "14/14285/ttrie" Collecting 100 more samples in 11.3 s.Collecting 99 more samples in 11.2 s.Collecting 98 more samples in 11.0 s.Collecting 97 more samples in 10.9 s.Collecting 96 more samples in 10.8 s.Collecting 95 more samples in 10.7 s.Collecting 94 more samples in 10.6 s.Collecting 93 more samples in 10.5 s.Collecting 92 more samples in 10.4 s.Collecting 91 more samples in 10.3 s.Collecting 90 more samples in 10.1 s.Collecting 89 more samples in 10.0 s.Collecting 88 more samples in 9.9 s.Collecting 87 more samples in 9.8 s.Collecting 86 more samples in 9.7 s.Collecting 85 more samples in 9.6 s.Collecting 84 more samples in 9.5 s.Collecting 83 more samples in 9.4 s.Collecting 82 more samples in 9.2 s.Collecting 81 more samples in 9.1 s.Collecting 80 more samples in 9.0 s.Collecting 79 more samples in 8.9 s.Collecting 78 more samples in 8.8 s.Collecting 77 more samples in 8.7 s.Collecting 76 more samples in 8.6 s.Collecting 75 more samples in 8.5 s.Collecting 74 more samples in 8.3 s.Collecting 73 more samples in 8.2 s.Collecting 72 more samples in 8.1 s.Collecting 71 more samples in 8.0 s.Collecting 70 more samples in 7.9 s.Collecting 69 more samples in 7.8 s.Collecting 68 more samples in 7.7 s.Collecting 67 more samples in 7.6 s.Collecting 66 more samples in 7.4 s.Collecting 65 more samples in 7.3 s.Collecting 64 more samples in 7.2 s.Collecting 63 more samples in 7.1 s.Collecting 62 more samples in 7.0 s.Collecting 61 more samples in 6.9 s.Collecting 60 more samples in 6.8 s.Collecting 59 more samples in 6.6 s.Collecting 58 more samples in 6.5 s.Collecting 57 more samples in 6.4 s.Collecting 56 more samples in 6.3 s.Collecting 55 more samples in 6.2 s.Collecting 54 more samples in 6.1 s.Collecting 53 more samples in 6.0 s.Collecting 52 more samples in 5.9 s.Collecting 51 more samples in 5.7 s.Collecting 50 more samples in 5.6 s.Collecting 49 more samples in 5.5 s.Collecting 48 more samples in 5.4 s.Collecting 47 more samples in 5.3 s.Collecting 46 more samples in 5.2 s.Collecting 45 more samples in 5.1 s.Collecting 44 more samples in 5.0 s.Collecting 43 more samples in 4.8 s.Collecting 42 more samples in 4.7 s.Collecting 41 more samples in 4.6 s.Collecting 40 more samples in 4.5 s.Collecting 39 more samples in 4.4 s.Collecting 38 more samples in 4.3 s.Collecting 37 more samples in 4.2 s.Collecting 36 more samples in 4.1 s.Collecting 35 more samples in 3.9 s.Collecting 34 more samples in 3.8 s.Collecting 33 more samples in 3.7 s.Collecting 32 more samples in 3.6 s.Collecting 31 more samples in 3.5 s.Collecting 30 more samples in 3.4 s.Collecting 29 more samples in 3.3 s.Collecting 28 more samples in 3.2 s.Collecting 27 more samples in 3.0 s.Collecting 26 more samples in 2.9 s.Collecting 25 more samples in 2.8 s.Collecting 24 more samples in 2.7 s.Collecting 23 more samples in 2.6 s.Collecting 22 more samples in 2.5 s.Collecting 21 more samples in 2.4 s.Collecting 20 more samples in 2.3 s.Collecting 19 more samples in 2.1 s.Collecting 18 more samples in 2.0 s.Collecting 17 more samples in 1.9 s.Collecting 16 more samples in 1.8 s.Collecting 15 more samples in 1.7 s.Collecting 14 more samples in 1.6 s.Collecting 13 more samples in 1.5 s.Collecting 12 more samples in 1.4 s.Collecting 11 more samples in 1.2 s.Collecting 10 more samples in 1.1 s.Collecting 9 more samples in 1.0 s.Collecting 8 more samples in 0.9 s.Collecting 7 more samples in 0.8 s.Collecting 6 more samples in 0.7 s.Collecting 5 more samples in 0.6 s.Collecting 4 more samples in 0.5 s.Collecting 3 more samples in 0.3 s.Collecting 2 more samples in 0.2 s.Collecting 1 more samples in 0.1 s.mean: 131.7497 ms, lower bound: 128.0587 ms, upper bound: 135.4758 ms, confidence: 0.950 std dev: 19.03287 ms, lower bound: 16.98366 ms, upper bound: 21.61477 ms, confidence: 0.950 variance introduced by outliers: 89.394% variance is severely inflated by outliers commits: 200000 retries: 0 allocated bytes: 141303960 Running a subject "16/12500/unordered-containers" Collecting 99 more samples in 102.7 s.Collecting 98 more samples in 101.7 s.Collecting 97 more samples in 100.6 s.Collecting 96 more samples in 99.6 s.Collecting 95 more samples in 98.6 s.Collecting 94 more samples in 97.5 s.Collecting 93 more samples in 96.5 s.Collecting 92 more samples in 95.4 s.Collecting 91 more samples in 94.4 s.Collecting 90 more samples in 93.4 s.Collecting 89 more samples in 92.3 s.Collecting 88 more samples in 91.3 s.Collecting 87 more samples in 90.3 s.Collecting 86 more samples in 89.2 s.Collecting 85 more samples in 88.2 s.Collecting 84 more samples in 87.1 s.Collecting 83 more samples in 86.1 s.Collecting 82 more samples in 85.1 s.Collecting 81 more samples in 84.0 s.Collecting 80 more samples in 83.0 s.Collecting 79 more samples in 82.0 s.Collecting 78 more samples in 80.9 s.Collecting 77 more samples in 79.9 s.Collecting 76 more samples in 78.8 s.Collecting 75 more samples in 77.8 s.Collecting 74 more samples in 76.8 s.Collecting 73 more samples in 75.7 s.Collecting 72 more samples in 74.7 s.Collecting 71 more samples in 73.7 s.Collecting 70 more samples in 72.6 s.Collecting 69 more samples in 71.6 s.Collecting 68 more samples in 70.5 s.Collecting 67 more samples in 69.5 s.Collecting 66 more samples in 68.5 s.Collecting 65 more samples in 67.4 s.Collecting 64 more samples in 66.4 s.Collecting 63 more samples in 65.4 s.Collecting 62 more samples in 64.3 s.Collecting 61 more samples in 63.3 s.Collecting 60 more samples in 62.2 s.Collecting 59 more samples in 61.2 s.Collecting 58 more samples in 60.2 s.Collecting 57 more samples in 59.1 s.Collecting 56 more samples in 58.1 s.Collecting 55 more samples in 57.1 s.Collecting 54 more samples in 56.0 s.Collecting 53 more samples in 55.0 s.Collecting 52 more samples in 53.9 s.Collecting 51 more samples in 52.9 s.Collecting 50 more samples in 51.9 s.Collecting 49 more samples in 50.8 s.Collecting 48 more samples in 49.8 s.Collecting 47 more samples in 48.8 s.Collecting 46 more samples in 47.7 s.Collecting 45 more samples in 46.7 s.Collecting 44 more samples in 45.6 s.Collecting 43 more samples in 44.6 s.Collecting 42 more samples in 43.6 s.Collecting 41 more samples in 42.5 s.Collecting 40 more samples in 41.5 s.Collecting 39 more samples in 40.5 s.Collecting 38 more samples in 39.4 s.Collecting 37 more samples in 38.4 s.Collecting 36 more samples in 37.3 s.Collecting 35 more samples in 36.3 s.Collecting 34 more samples in 35.3 s.Collecting 33 more samples in 34.2 s.Collecting 32 more samples in 33.2 s.Collecting 31 more samples in 32.2 s.Collecting 30 more samples in 31.1 s.Collecting 29 more samples in 30.1 s.Collecting 28 more samples in 29.0 s.Collecting 27 more samples in 28.0 s.Collecting 26 more samples in 27.0 s.Collecting 25 more samples in 25.9 s.Collecting 24 more samples in 24.9 s.Collecting 23 more samples in 23.9 s.Collecting 22 more samples in 22.8 s.Collecting 21 more samples in 21.8 s.Collecting 20 more samples in 20.7 s.Collecting 19 more samples in 19.7 s.Collecting 18 more samples in 18.7 s.Collecting 17 more samples in 17.6 s.Collecting 16 more samples in 16.6 s.Collecting 15 more samples in 15.6 s.Collecting 14 more samples in 14.5 s.Collecting 13 more samples in 13.5 s.Collecting 12 more samples in 12.4 s.Collecting 11 more samples in 11.4 s.Collecting 10 more samples in 10.4 s.Collecting 9 more samples in 9.3 s.Collecting 8 more samples in 8.3 s.Collecting 7 more samples in 7.3 s.Collecting 6 more samples in 6.2 s.Collecting 5 more samples in 5.2 s.Collecting 4 more samples in 4.1 s.Collecting 3 more samples in 3.1 s.Collecting 2 more samples in 2.1 s.Collecting 1 more samples in 1.0 s.mean: 923.8349 ms, lower bound: 906.9756 ms, upper bound: 946.8163 ms, confidence: 0.950 std dev: 99.87369 ms, lower bound: 76.37754 ms, upper bound: 159.9810 ms, confidence: 0.950 found 2 outliers among 100 samples (2.0%) 1 (1.0%) high severe variance introduced by outliers: 82.079% variance is severely inflated by outliers commits: 200000 retries: 1085782 allocated bytes: 1059603928 Running a subject "16/12500/stm-containers" Collecting 100 more samples in 10.9 s.Collecting 99 more samples in 10.7 s.Collecting 98 more samples in 10.6 s.Collecting 97 more samples in 10.5 s.Collecting 96 more samples in 10.4 s.Collecting 95 more samples in 10.3 s.Collecting 94 more samples in 10.2 s.Collecting 93 more samples in 10.1 s.Collecting 92 more samples in 10.0 s.Collecting 91 more samples in 9.9 s.Collecting 90 more samples in 9.8 s.Collecting 89 more samples in 9.7 s.Collecting 88 more samples in 9.5 s.Collecting 87 more samples in 9.4 s.Collecting 86 more samples in 9.3 s.Collecting 85 more samples in 9.2 s.Collecting 84 more samples in 9.1 s.Collecting 83 more samples in 9.0 s.Collecting 82 more samples in 8.9 s.Collecting 81 more samples in 8.8 s.Collecting 80 more samples in 8.7 s.Collecting 79 more samples in 8.6 s.Collecting 78 more samples in 8.5 s.Collecting 77 more samples in 8.4 s.Collecting 76 more samples in 8.2 s.Collecting 75 more samples in 8.1 s.Collecting 74 more samples in 8.0 s.Collecting 73 more samples in 7.9 s.Collecting 72 more samples in 7.8 s.Collecting 71 more samples in 7.7 s.Collecting 70 more samples in 7.6 s.Collecting 69 more samples in 7.5 s.Collecting 68 more samples in 7.4 s.Collecting 67 more samples in 7.3 s.Collecting 66 more samples in 7.2 s.Collecting 65 more samples in 7.1 s.Collecting 64 more samples in 6.9 s.Collecting 63 more samples in 6.8 s.Collecting 62 more samples in 6.7 s.Collecting 61 more samples in 6.6 s.Collecting 60 more samples in 6.5 s.Collecting 59 more samples in 6.4 s.Collecting 58 more samples in 6.3 s.Collecting 57 more samples in 6.2 s.Collecting 56 more samples in 6.1 s.Collecting 55 more samples in 6.0 s.Collecting 54 more samples in 5.9 s.Collecting 53 more samples in 5.8 s.Collecting 52 more samples in 5.6 s.Collecting 51 more samples in 5.5 s.Collecting 50 more samples in 5.4 s.Collecting 49 more samples in 5.3 s.Collecting 48 more samples in 5.2 s.Collecting 47 more samples in 5.1 s.Collecting 46 more samples in 5.0 s.Collecting 45 more samples in 4.9 s.Collecting 44 more samples in 4.8 s.Collecting 43 more samples in 4.7 s.Collecting 42 more samples in 4.6 s.Collecting 41 more samples in 4.4 s.Collecting 40 more samples in 4.3 s.Collecting 39 more samples in 4.2 s.Collecting 38 more samples in 4.1 s.Collecting 37 more samples in 4.0 s.Collecting 36 more samples in 3.9 s.Collecting 35 more samples in 3.8 s.Collecting 34 more samples in 3.7 s.Collecting 33 more samples in 3.6 s.Collecting 32 more samples in 3.5 s.Collecting 31 more samples in 3.4 s.Collecting 30 more samples in 3.3 s.Collecting 29 more samples in 3.1 s.Collecting 28 more samples in 3.0 s.Collecting 27 more samples in 2.9 s.Collecting 26 more samples in 2.8 s.Collecting 25 more samples in 2.7 s.Collecting 24 more samples in 2.6 s.Collecting 23 more samples in 2.5 s.Collecting 22 more samples in 2.4 s.Collecting 21 more samples in 2.3 s.Collecting 20 more samples in 2.2 s.Collecting 19 more samples in 2.1 s.Collecting 18 more samples in 2.0 s.Collecting 17 more samples in 1.8 s.Collecting 16 more samples in 1.7 s.Collecting 15 more samples in 1.6 s.Collecting 14 more samples in 1.5 s.Collecting 13 more samples in 1.4 s.Collecting 12 more samples in 1.3 s.Collecting 11 more samples in 1.2 s.Collecting 10 more samples in 1.1 s.Collecting 9 more samples in 1.0 s.Collecting 8 more samples in 0.9 s.Collecting 7 more samples in 0.8 s.Collecting 6 more samples in 0.7 s.Collecting 5 more samples in 0.5 s.Collecting 4 more samples in 0.4 s.Collecting 3 more samples in 0.3 s.Collecting 2 more samples in 0.2 s.Collecting 1 more samples in 0.1 s.mean: 108.9850 ms, lower bound: 106.2641 ms, upper bound: 112.0779 ms, confidence: 0.950 std dev: 14.90217 ms, lower bound: 12.75265 ms, upper bound: 18.03956 ms, confidence: 0.950 found 2 outliers among 100 samples (2.0%) 2 (2.0%) high mild variance introduced by outliers: 88.338% variance is severely inflated by outliers commits: 200000 retries: 1140 allocated bytes: 267284688 Running a subject "16/12500/ttrie" Collecting 100 more samples in 14.5 s.Collecting 99 more samples in 14.3 s.Collecting 98 more samples in 14.2 s.Collecting 97 more samples in 14.0 s.Collecting 96 more samples in 13.9 s.Collecting 95 more samples in 13.8 s.Collecting 94 more samples in 13.6 s.Collecting 93 more samples in 13.5 s.Collecting 92 more samples in 13.3 s.Collecting 91 more samples in 13.2 s.Collecting 90 more samples in 13.0 s.Collecting 89 more samples in 12.9 s.Collecting 88 more samples in 12.7 s.Collecting 87 more samples in 12.6 s.Collecting 86 more samples in 12.4 s.Collecting 85 more samples in 12.3 s.Collecting 84 more samples in 12.2 s.Collecting 83 more samples in 12.0 s.Collecting 82 more samples in 11.9 s.Collecting 81 more samples in 11.7 s.Collecting 80 more samples in 11.6 s.Collecting 79 more samples in 11.4 s.Collecting 78 more samples in 11.3 s.Collecting 77 more samples in 11.1 s.Collecting 76 more samples in 11.0 s.Collecting 75 more samples in 10.9 s.Collecting 74 more samples in 10.7 s.Collecting 73 more samples in 10.6 s.Collecting 72 more samples in 10.4 s.Collecting 71 more samples in 10.3 s.Collecting 70 more samples in 10.1 s.Collecting 69 more samples in 10.0 s.Collecting 68 more samples in 9.8 s.Collecting 67 more samples in 9.7 s.Collecting 66 more samples in 9.6 s.Collecting 65 more samples in 9.4 s.Collecting 64 more samples in 9.3 s.Collecting 63 more samples in 9.1 s.Collecting 62 more samples in 9.0 s.Collecting 61 more samples in 8.8 s.Collecting 60 more samples in 8.7 s.Collecting 59 more samples in 8.5 s.Collecting 58 more samples in 8.4 s.Collecting 57 more samples in 8.3 s.Collecting 56 more samples in 8.1 s.Collecting 55 more samples in 8.0 s.Collecting 54 more samples in 7.8 s.Collecting 53 more samples in 7.7 s.Collecting 52 more samples in 7.5 s.Collecting 51 more samples in 7.4 s.Collecting 50 more samples in 7.2 s.Collecting 49 more samples in 7.1 s.Collecting 48 more samples in 6.9 s.Collecting 47 more samples in 6.8 s.Collecting 46 more samples in 6.7 s.Collecting 45 more samples in 6.5 s.Collecting 44 more samples in 6.4 s.Collecting 43 more samples in 6.2 s.Collecting 42 more samples in 6.1 s.Collecting 41 more samples in 5.9 s.Collecting 40 more samples in 5.8 s.Collecting 39 more samples in 5.6 s.Collecting 38 more samples in 5.5 s.Collecting 37 more samples in 5.4 s.Collecting 36 more samples in 5.2 s.Collecting 35 more samples in 5.1 s.Collecting 34 more samples in 4.9 s.Collecting 33 more samples in 4.8 s.Collecting 32 more samples in 4.6 s.Collecting 31 more samples in 4.5 s.Collecting 30 more samples in 4.3 s.Collecting 29 more samples in 4.2 s.Collecting 28 more samples in 4.1 s.Collecting 27 more samples in 3.9 s.Collecting 26 more samples in 3.8 s.Collecting 25 more samples in 3.6 s.Collecting 24 more samples in 3.5 s.Collecting 23 more samples in 3.3 s.Collecting 22 more samples in 3.2 s.Collecting 21 more samples in 3.0 s.Collecting 20 more samples in 2.9 s.Collecting 19 more samples in 2.8 s.Collecting 18 more samples in 2.6 s.Collecting 17 more samples in 2.5 s.Collecting 16 more samples in 2.3 s.Collecting 15 more samples in 2.2 s.Collecting 14 more samples in 2.0 s.Collecting 13 more samples in 1.9 s.Collecting 12 more samples in 1.7 s.Collecting 11 more samples in 1.6 s.Collecting 10 more samples in 1.4 s.Collecting 9 more samples in 1.3 s.Collecting 8 more samples in 1.2 s.Collecting 7 more samples in 1.0 s.Collecting 6 more samples in 0.9 s.Collecting 5 more samples in 0.7 s.Collecting 4 more samples in 0.6 s.Collecting 3 more samples in 0.4 s.Collecting 2 more samples in 0.3 s.Collecting 1 more samples in 0.1 s.mean: 117.2701 ms, lower bound: 114.1851 ms, upper bound: 121.6615 ms, confidence: 0.950 std dev: 18.61485 ms, lower bound: 14.01420 ms, upper bound: 29.04448 ms, confidence: 0.950 found 6 outliers among 100 samples (6.0%) 4 (4.0%) high mild 2 (2.0%) high severe variance introduced by outliers: 90.486% variance is severely inflated by outliers commits: 200000 retries: 0 allocated bytes: 141272488 Benchmark bench: FINISH