Why tcmalloc using aggresive decommit == false is a litte better than jemalloc

9 points by yiguolei 3y ago ↗ HN

Hi guys, I am tuning the malloc's performance. I want to replace Apache Doris's memory allocator from tcmalloc to jemalloc. Tcmalloc's conf is : tcmalloc.max_total_thread_cache_bytes:1G, tcmalloc.aggressive_memory_decommit:0 Jemalloc's conf is: percpu_arena:percpu,background_thread:true,metadata_thp:auto,muzzy_decay_ms:30000,dirty_decay_ms:30000,oversize_threshold:0,lg_tcache_max:16

When using tcmalloc, doris's performance is about 5% higher than jemalloc in ssb-flat benchmark. Anything I forget do optimize for Jemalloc?

2 comments

[ 5.0 ms ] story [ 125 ms ] thread

mry123 3y ago ↗

I see the apache doris https://github.com/apache/doris . it is another olap database， what‘s the difference with clickhouse？

zX41ZdbW 3y ago ↗

You are talking about the old tcmalloc from 2006 that should never be used anymore. There is also a new tcmaloc: https://github.com/google/tcmalloc/

If you are in doubt, you should simply use what ClickHouse is using.