warming up
estimating clock resolution
estimating cost of a clock call


new parameter round
  N = 1000

benchmarking std::set
collecting 20 samples, 1 iterations each, in estimated 1315.9 μs

benchmarking std::unordered_set
collecting 20 samples, 2 iterations each, in estimated 683.96 μs

benchmarking boost::flat_set
collecting 20 samples, 1 iterations each, in estimated 1402.68 μs

benchmarking hamt::hash_trie
collecting 20 samples, 1 iterations each, in estimated 590.34 μs

benchmarking immer::set/5B
collecting 20 samples, 2 iterations each, in estimated 1029 μs

benchmarking immer::set/4B
collecting 20 samples, 1 iterations each, in estimated 607.72 μs

benchmarking bad/std::set
collecting 20 samples, 1 iterations each, in estimated 1666.42 μs

benchmarking bad/std::unordered_set
collecting 20 samples, 2 iterations each, in estimated 604.52 μs

benchmarking bad/boost::flat_set
collecting 20 samples, 1 iterations each, in estimated 1552.44 μs

benchmarking bad/hamt::hash_trie
collecting 20 samples, 2 iterations each, in estimated 720.4 μs

benchmarking bad/immer::set/5B
collecting 20 samples, 2 iterations each, in estimated 661.08 μs

benchmarking bad/immer::set/4B
collecting 20 samples, 2 iterations each, in estimated 822.88 μs

generating HTML report


result summary (μs)

  N = 1000
  std::set	 130.888	 8.457
  std::unordered_set	 21.574	 2.985
  boost::flat_set	 128.595	 4.042
  hamt::hash_trie	 42.417	 1.09
  immer::set/5B	 31.312	 2.59
  immer::set/4B	 39.286	 1.602
  bad/std::set	 149.737	 4.308
  bad/std::unordered_set	 20.693	 1.592
  bad/boost::flat_set	 148.154	 3.735
  bad/hamt::hash_trie	 26.25	 1.242
  bad/immer::set/5B	 23.136	 1.149
  bad/immer::set/4B	 26.103	 0.89

done