{"componentChunkName":"component---src-pages-markdown-remark-fields-slug-js","path":"/engineering/memcach-memory-management/","result":{"data":{"markdownRemark":{"id":"177215ed-17df-5704-99e4-6260d06c47fb","excerpt":"The  memcached is one of the most popular open source on-memory key-value caching systems. I will briefly talk about the design of memory management of…","html":"

The  memcached is one of the most popular open source on-memory key-value caching systems. I will briefly talk about the design of memory management of memcached.

\n

Chunk and Slab

\n

\n \n \n

\n

You can get this information by adding -vvv and you can use the command

\n
stats slabs under telnet connection ip port
\n

Every time when a new memory needs to be allocated. It will scan the slab class to find the most suitable class to store the chunk.

\n

Rebalance and reassign slab memory:

\n

From memcached’s wiki:

\n

Overview: Memcached 1.4.11. Fixes race conditions and crashes introduced in 1.4.10. Adds the ability to rebalance and reassign slab memory.

\n

Slab Reassignment

\n

Long running instances of memcached memory may run into an issue where all available memory has been assigned to a specific slab class (say items of roughly size 100 bytes). Later the application starts storing more of its data into a different slab class (items around 200 bytes). Memcached could not use the 100 byte chunks to satisfy the 200 byte requests, and thus you would be able to store very few 200 byte items.

\n

1.4.11 introduces the ability to reassign slab pages. This is a beta feature and the commands may change for the next few releases, so please keep this in mind. When the commands are finalized they will be noted in the release notes

\n

Slab Automove

\n

While slab reassign is a manual feature, there is also the start of an automatic memory reassignment algorithm.

\n

From the source code in slabs.c we can see, memcached uses two threads to monitor the slabs class, one is to do maintenance and another one is to do the re-balance the class.

\n

Memcached defines a global variable struct slab\\rebalance slab_rebal,_ which is used to store the start, end information of slab. s_clsid is the source slab id and d_clsid is the destination slab id. The detailed blog in Chinese memcached源码分析—–slab automove和slab rebalance could be helpful.

\n
struct slab_rebalance {\n    void *slab_start;\n    void *slab_end;\n    void *slab_pos;\n    int s_clsid;\n    int d_clsid;\n    int busy_items;\n    uint8_t done;\n};
\n

Memory Pool

\n

Memcached implements its own memory pool, which is used to avoid system memory allocation and memory fragmentation. That will make your memory efficient and easy to manage. Here is a demo implementation of memory pool. Basically it is a large pre-allocated chunk of memory.

\n
 mem_avail) {\n        return NULL;\n    }\n    /* mem_current pointer _must_ be aligned!!! */\n    if (size % CHUNK_ALIGN_BYTES) {\n        size += CHUNK_ALIGN_BYTES - (size % CHUNK_ALIGN_BYTES);\n    }\n    mem_current = ((char*)mem_current) + size;\n    if (size
\n","headings":[{"value":"Chunk and Slab","depth":3},{"value":"Rebalance and reassign slab memory:","depth":3},{"value":"Slab Reassignment","depth":4},{"value":"Slab Automove","depth":4},{"value":"Memory Pool","depth":3}],"fields":{"slug":"/engineering/memcach-memory-management/"},"frontmatter":{"metatitle":null,"metadescription":null,"description":null,"title":"Memcached Memory Management","canonical":null,"date":"July 07, 2015","updated_date":null,"tags":["Memory Management"],"coverImage":{"childImageSharp":{"fluid":{"aspectRatio":1,"src":"/static/de7966e19463e0047c10eea9388c12c4/c40f8/memcached-memory-management.png","srcSet":"/static/de7966e19463e0047c10eea9388c12c4/f5f11/memcached-memory-management.png 200w,\n/static/de7966e19463e0047c10eea9388c12c4/6d133/memcached-memory-management.png 400w,\n/static/de7966e19463e0047c10eea9388c12c4/c40f8/memcached-memory-management.png 610w","sizes":"(max-width: 610px) 100vw, 610px"}}},"author":{"id":"Mark Duan","github":null,"bio":null,"avatar":null}}}},"pageContext":{"id":"177215ed-17df-5704-99e4-6260d06c47fb","fields__slug":"/engineering/memcach-memory-management/","__params":{"fields__slug":"engineering"}}},"staticQueryHashes":["1171199041","1384082988","1711371485","1753898100","2100481360","229320306","23180105","528864852"]}