Linux 6.19 Slated To Land "mm/cid" Rewrite That Has Very Positive Performance Potential
([Linux Kernel] 76 Minutes Ago
Improving Memory Management)
- Reference: 0001593296
- News link: https://www.phoronix.com/news/MM-CID-For-Linux-6.19
- Source link:
A set of Linux kernel patches posted back in October for [1]rewriting the kernel's memory-mapped concurrency ID code for some nice performance wins looks like it will land for Linux 6.19. This is the code that prominent Intel engineer Thomas Gleixner found to yield up to an 18% improvement for the PostgreSQL database. My testing of this "mm/cid" code has also shown some nice performance wins too.
Intel Fellow Thomas Gleixner overhauled the CID management code after finding the existing complex code introduced significant overhead into the kernel scheduler's hot code paths. This new code is simpler and lower-overhead.
Queued today into tip/tip.git's [2]core/rseq Git branch is this rewrite of the memory management's concurrency ID (CID) code. With the patches from Gleixner now being in a TIP branch, they will likely be submitted for the upcoming Linux 6.19 merge window barring no last minute problems or objections raised by prominent developers like Linus Torvalds himself.
This includes [3]reverting the complex CID management :
"The CID management is a complex beast, which affects both scheduling and task migration. The compaction mechanism forces random tasks of a process into task work on exit to user space causing latency spikes.
Revert back to the initial simple bitmap allocating mechanics, which are known to have scalability issues as that allows to gradually build up a replacement functionality in a reviewable way."
And then from there proceeding to overhaul the mm/cid code with the new implementation.
A few weeks back I ran some benchmarks of the tentative code within [4]Intel's Rewrite Of Linux MM CID Code Showing Some Nice Gains For AMD .
Linux 6.19 continues looking more exciting by the day. The Linux 6.19 merge window will happen in early December while the stable kernel should be out in February.
[1] https://www.phoronix.com/news/Linux-MM-CID-Faster-DBs
[2] https://git.kernel.org/pub/scm/linux/kernel/git/tip/tip.git/log/?h=core/rseq
[3] https://git.kernel.org/pub/scm/linux/kernel/git/tip/tip.git/commit/?h=core/rseq&id=77d7dc8bef482e987036bc204136bbda552d95cd
[4] https://www.phoronix.com/review/rseq-cid-benchmarks
Intel Fellow Thomas Gleixner overhauled the CID management code after finding the existing complex code introduced significant overhead into the kernel scheduler's hot code paths. This new code is simpler and lower-overhead.
Queued today into tip/tip.git's [2]core/rseq Git branch is this rewrite of the memory management's concurrency ID (CID) code. With the patches from Gleixner now being in a TIP branch, they will likely be submitted for the upcoming Linux 6.19 merge window barring no last minute problems or objections raised by prominent developers like Linus Torvalds himself.
This includes [3]reverting the complex CID management :
"The CID management is a complex beast, which affects both scheduling and task migration. The compaction mechanism forces random tasks of a process into task work on exit to user space causing latency spikes.
Revert back to the initial simple bitmap allocating mechanics, which are known to have scalability issues as that allows to gradually build up a replacement functionality in a reviewable way."
And then from there proceeding to overhaul the mm/cid code with the new implementation.
A few weeks back I ran some benchmarks of the tentative code within [4]Intel's Rewrite Of Linux MM CID Code Showing Some Nice Gains For AMD .
Linux 6.19 continues looking more exciting by the day. The Linux 6.19 merge window will happen in early December while the stable kernel should be out in February.
[1] https://www.phoronix.com/news/Linux-MM-CID-Faster-DBs
[2] https://git.kernel.org/pub/scm/linux/kernel/git/tip/tip.git/log/?h=core/rseq
[3] https://git.kernel.org/pub/scm/linux/kernel/git/tip/tip.git/commit/?h=core/rseq&id=77d7dc8bef482e987036bc204136bbda552d95cd
[4] https://www.phoronix.com/review/rseq-cid-benchmarks