warming up
estimating clock resolution
estimating cost of a clock call


new parameter round
  N = 1000

benchmarking std::set
collecting 20 samples, 1 iterations each, in estimated 2.00216 ms

benchmarking std::unordered_set
collecting 20 samples, 2 iterations each, in estimated 590.36 μs

benchmarking boost::flat_set
collecting 20 samples, 1 iterations each, in estimated 1353.7 μs

benchmarking hamt::hash_trie
collecting 20 samples, 2 iterations each, in estimated 958.6 μs

benchmarking immer::set/5B
collecting 20 samples, 2 iterations each, in estimated 799.6 μs

benchmarking immer::set/4B
collecting 20 samples, 2 iterations each, in estimated 966.88 μs

benchmarking bad/std::set
collecting 20 samples, 1 iterations each, in estimated 2.62672 ms

benchmarking bad/std::unordered_set
collecting 20 samples, 3 iterations each, in estimated 690.48 μs

benchmarking bad/boost::flat_set
collecting 20 samples, 1 iterations each, in estimated 1566.66 μs

benchmarking bad/hamt::hash_trie
collecting 20 samples, 3 iterations each, in estimated 792.66 μs

benchmarking bad/immer::set/5B
collecting 20 samples, 3 iterations each, in estimated 772.44 μs

benchmarking bad/immer::set/4B
collecting 20 samples, 3 iterations each, in estimated 837.78 μs

generating HTML report


result summary (μs)

  N = 1000
  std::set	 145.509	 2.219
  std::unordered_set	 19.29	 2.588
  boost::flat_set	 125.125	 5.841
  hamt::hash_trie	 33.457	 1.532
  immer::set/5B	 27.056	 2.037
  immer::set/4B	 29.014	 1.265
  bad/std::set	 168.582	 4.202
  bad/std::unordered_set	 13.014	 1.981
  bad/boost::flat_set	 134.406	 7.099
  bad/hamt::hash_trie	 16.187	 1.215
  bad/immer::set/5B	 14.916	 1.32
  bad/immer::set/4B	 16.496	 1.284

done