Biggest Linux kernel release ever welcomes bcachefs file system, jettisons Itanium
(2024/01/10)
- Reference: 1704893411
- News link: https://www.theregister.co.uk/2024/01/10/linux_kernel_67/
- Source link:
The latest stable Linux kernel, 6.7, is out and finally includes the new next-gen copy-on-write (COW) bcachefs file system.
Linus Torvalds [1]announced the release on Sunday, noting that it is "one of the largest kernel releases we've ever had." Among the bigger and more visible changes are a whole new file system, along with fresh functionality for several existing ones; improved graphics support for several vendors' hardware; and the removal of an entire CPU architecture.
This is a short-term kernel release so probably will not feature in several distros whose release cycles aren't synchronized with that of the kernel, such as interim releases of Ubuntu. The kernel's release schedule is not set in stone – indeed, 6.7 itself was about a week later than usual, to avoid a release over the new year – but it will probably go end of life in March, when 6.8 appears. As we noted [2]when 6.6.6 came and went last month, since early December, kernel 6.6, [3]released in late October , is the latest long-term support release.
[4]
We rather suspect that the few remaining sites running Itanium systems are not running rolling-release Linux distros on them, and so will neither know nor care that [5]6.7 drops all support for the ill-fated IA64 architecture. That name is why The Reg FOSS desk still favors "x86-64" over "x64" – and on that much more common CPU architecture, kernel 6.7 now offers the ability to enable or disable x86-32 support at boot time, as we [6]described last year .
[7]
[8]
Even though [9]Intel's 14th generation chips only started shipping in October, more people are probably running those than are still aboard Itanic, and 6.7 adds full support for their integral GPUs.
More still use Nvidia cards, some of which must be initialized by special [10]GSP firmware . Although Nvidia's binary drivers do this on their own, as of kernel 6.7, the FOSS nouveau driver can now load this special firmware. The new release also has better handling for DisplayPort monitors connected over USB-C, and improves the handling of some keyboards and other input devices, including from Dell, Lenovo, and Asus.
[11]
It's not all about x86, though. The in-kernel hypervisor KVM now supports the Chinese LoongArch RISC chips, and on RISC-V, it now supports the new [12]smstateen [PDF] extensions for enhanced security, along with improvements for Arm hardware, especially the Ampere server chips.
Support for Rust language modules in the kernel now includes revision 1.73 of the language. Other Rusty refinements include support for [13]Intel IBTs , the ability to manage [14]workqueues , and better Android support.
The single biggest feature of 6.7 is the new [15]bcachefs file system, which [16]we examined in March 2022 . As this is the first release of Linux to include the new file system, it definitely would be premature to trust any important data to it yet, but this is a welcome change. The executive summary is that bcachefs is a next-generation file system that, like Btrfs and ZFS, provides COW functionality. COW enables the almost instant creation of "snapshots" of all or part of a drive or volume, which enables the OS to make disk operations transactional: In other words, to provide an "undo" function for complex sets of disk write operations.
[17]In surprise move, Gentoo Linux starts offering binaries
[18]Asahi's Fedora remix dazzles and baffles on Apple Silicon
[19]Penguins get their Wayland with Firefox 121
[20]Debian preps ground to drop 32-bit x86 as separate edition
Having a COW file system on Linux isn't new. The existing next-gen file system in the kernel, Btrfs, also supports COW snapshots. The version in 6.7 sees [21]several refinements . It inherits a [22]feature implemented for Steam OS : Two Btrfs file systems with the same ID can be mounted simultaneously, for failover scenarios. It also has improved quota support and a new [23]raid_stripe_tree that improves handling of arrays of dissimilar drives.
Btrfs remains somewhat [24]controversial . [25]Red Hat banished it from RHEL years ago ( [26]although Oracle Linux still offers it ) but SUSE's distros depend heavily upon it. It will be interesting to see how quickly SUSE's [27]Snapper tool gains support for bcachefs: This new COW contender may reveal unquestioned assumptions built into the code. Since Snapper is also used in several non-SUSE distros, including [28]Spiral Linux , [29]Garuda , and [30]siduction , they're tied to Btrfs as well.
[31]
The other widely used FOSS next-gen file system, OpenZFS, also supports COW, but licensing conflicts prevent ZFS being fully integrated into the Linux kernel. So although multiple distros (such as NixOS, Proxmox, TrueNAS Scale, Ubuntu, and Void Linux) support ZFS, it must remain separate and distinct. This results in limitations, such as the ZFS [32]Advanced Read Cache being separate from [33]Linux's page cache .
Bcachefs is all-GPL and doesn't suffer from such limitations. It aims to supply the important features of ZFS, such as integrated volume management, while being as fast as ext4 or XFS, and also surpass Btrfs in both performance and, crucially, reliability.
More competition is good. Having a second COW-capable file system available that's not encumbered with licensing restrictions will open up the competitive landscape – not just on Btrfs, but also on [34]Red Hat's Stratis , for example. It will also affect [35]tools that replicate similar functionality , such as Flatpak and OStree – and distros such as [36]Endless OS and Fedora's [37]various immutable variants , which are built around them.
There's a big annotated list of the changes in this release on [38]KernelNewbies , although it does note that the list isn't complete yet. In terms of the number of changes, this is the biggest kernel release ever, and some of the changes will have ramifications for years to come. There may be lurking dragons, or at least bugs. Exercise caution, and expect some of the new stuff to take some time – and point releases – to settle in. ®
Get our [39]Tech Resources
[1] https://lore.kernel.org/lkml/CAHk-=widprp4XoHUcsDe7e16YZjLYJWra-dK0hE1MnfPMf6C3Q@mail.gmail.com/
[2] https://www.theregister.com/2023/12/14/linux_kernel_of_the_beast/
[3] https://www.theregister.com/2023/10/30/linux_6_6_debuts/
[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/oses&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2ZZ7NOVv6RYB9IAK2Hkb3ygAAAMQ&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[5] https://www.theregister.com/2023/11/21/saving_linux_on_itanium/
[6] https://www.theregister.com/2023/10/30/linux_kernel_6_7_rundown/
[7] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/oses&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZZ7NOVv6RYB9IAK2Hkb3ygAAAMQ&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[8] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/oses&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZZ7NOVv6RYB9IAK2Hkb3ygAAAMQ&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[9] https://www.theregister.com/2023/10/16/intels_14thgen_raptor_lake_refresh/
[10] https://download.nvidia.com/XFree86/Linux-x86_64/510.39.01/README/gsp.html
[11] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/oses&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZZ7NOVv6RYB9IAK2Hkb3ygAAAMQ&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[12] https://github.com/riscv/riscv-state-enable/releases/download/v1.0.0/Smstateen.pdf
[13] https://lwn.net/Articles/889475/
[14] https://docs.kernel.org/core-api/workqueue.html
[15] https://bcachefs.org/
[16] https://www.theregister.com/2022/03/18/bcachefs/
[17] https://www.theregister.com/2024/01/03/gentoo_starts_offering_binaries/
[18] https://www.theregister.com/2023/12/21/fed39_asahi_remix/
[19] https://www.theregister.com/2023/12/20/firefox_121_released/
[20] https://www.theregister.com/2023/12/19/debian_to_drop_x86_32/
[21] https://lore.kernel.org/lkml/cover.1698679287.git.dsterba@suse.com/
[22] https://www.theregister.com/2023/09/27/osseu_steam_os_3/
[23] https://lwn.net/Articles/944631/
[24] https://arstechnica.com/gadgets/2021/09/examining-btrfs-linuxs-perpetually-half-finished-filesystem/
[25] https://www.theregister.com/2017/08/16/red_hat_banishes_btrfs_from_rhel/
[26] https://www.theregister.com/2022/07/12/oracle_linux_9/
[27] http://snapper.io/
[28] https://www.theregister.com/2022/06/20/spirallinux_new_debian_remix_from/
[29] https://www.theregister.com/2022/07/28/garuda_linux_arch_better/
[30] https://www.theregister.com/2023/01/05/siduction_2022_1/
[31] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/oses&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZZ7NOVv6RYB9IAK2Hkb3ygAAAMQ&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[32] https://www.45drives.com/community/articles/zfs-caching/
[33] https://www.thomas-krenn.com/en/wiki/Linux_Page_Cache_Basics
[34] https://www.theregister.com/2022/10/24/daos_22_stratis_33/
[35] https://www.theregister.com/2021/11/26/linux_software_installation/
[36] https://www.theregister.com/2023/01/12/endless_os_5/
[37] https://www.theregister.com/2021/02/18/kinoite_immutable_fedora/
[38] https://kernelnewbies.org/Linux_6.7
[39] https://whitepapers.theregister.com/
Linus Torvalds [1]announced the release on Sunday, noting that it is "one of the largest kernel releases we've ever had." Among the bigger and more visible changes are a whole new file system, along with fresh functionality for several existing ones; improved graphics support for several vendors' hardware; and the removal of an entire CPU architecture.
This is a short-term kernel release so probably will not feature in several distros whose release cycles aren't synchronized with that of the kernel, such as interim releases of Ubuntu. The kernel's release schedule is not set in stone – indeed, 6.7 itself was about a week later than usual, to avoid a release over the new year – but it will probably go end of life in March, when 6.8 appears. As we noted [2]when 6.6.6 came and went last month, since early December, kernel 6.6, [3]released in late October , is the latest long-term support release.
[4]
We rather suspect that the few remaining sites running Itanium systems are not running rolling-release Linux distros on them, and so will neither know nor care that [5]6.7 drops all support for the ill-fated IA64 architecture. That name is why The Reg FOSS desk still favors "x86-64" over "x64" – and on that much more common CPU architecture, kernel 6.7 now offers the ability to enable or disable x86-32 support at boot time, as we [6]described last year .
[7]
[8]
Even though [9]Intel's 14th generation chips only started shipping in October, more people are probably running those than are still aboard Itanic, and 6.7 adds full support for their integral GPUs.
More still use Nvidia cards, some of which must be initialized by special [10]GSP firmware . Although Nvidia's binary drivers do this on their own, as of kernel 6.7, the FOSS nouveau driver can now load this special firmware. The new release also has better handling for DisplayPort monitors connected over USB-C, and improves the handling of some keyboards and other input devices, including from Dell, Lenovo, and Asus.
[11]
It's not all about x86, though. The in-kernel hypervisor KVM now supports the Chinese LoongArch RISC chips, and on RISC-V, it now supports the new [12]smstateen [PDF] extensions for enhanced security, along with improvements for Arm hardware, especially the Ampere server chips.
Support for Rust language modules in the kernel now includes revision 1.73 of the language. Other Rusty refinements include support for [13]Intel IBTs , the ability to manage [14]workqueues , and better Android support.
The single biggest feature of 6.7 is the new [15]bcachefs file system, which [16]we examined in March 2022 . As this is the first release of Linux to include the new file system, it definitely would be premature to trust any important data to it yet, but this is a welcome change. The executive summary is that bcachefs is a next-generation file system that, like Btrfs and ZFS, provides COW functionality. COW enables the almost instant creation of "snapshots" of all or part of a drive or volume, which enables the OS to make disk operations transactional: In other words, to provide an "undo" function for complex sets of disk write operations.
[17]In surprise move, Gentoo Linux starts offering binaries
[18]Asahi's Fedora remix dazzles and baffles on Apple Silicon
[19]Penguins get their Wayland with Firefox 121
[20]Debian preps ground to drop 32-bit x86 as separate edition
Having a COW file system on Linux isn't new. The existing next-gen file system in the kernel, Btrfs, also supports COW snapshots. The version in 6.7 sees [21]several refinements . It inherits a [22]feature implemented for Steam OS : Two Btrfs file systems with the same ID can be mounted simultaneously, for failover scenarios. It also has improved quota support and a new [23]raid_stripe_tree that improves handling of arrays of dissimilar drives.
Btrfs remains somewhat [24]controversial . [25]Red Hat banished it from RHEL years ago ( [26]although Oracle Linux still offers it ) but SUSE's distros depend heavily upon it. It will be interesting to see how quickly SUSE's [27]Snapper tool gains support for bcachefs: This new COW contender may reveal unquestioned assumptions built into the code. Since Snapper is also used in several non-SUSE distros, including [28]Spiral Linux , [29]Garuda , and [30]siduction , they're tied to Btrfs as well.
[31]
The other widely used FOSS next-gen file system, OpenZFS, also supports COW, but licensing conflicts prevent ZFS being fully integrated into the Linux kernel. So although multiple distros (such as NixOS, Proxmox, TrueNAS Scale, Ubuntu, and Void Linux) support ZFS, it must remain separate and distinct. This results in limitations, such as the ZFS [32]Advanced Read Cache being separate from [33]Linux's page cache .
Bcachefs is all-GPL and doesn't suffer from such limitations. It aims to supply the important features of ZFS, such as integrated volume management, while being as fast as ext4 or XFS, and also surpass Btrfs in both performance and, crucially, reliability.
More competition is good. Having a second COW-capable file system available that's not encumbered with licensing restrictions will open up the competitive landscape – not just on Btrfs, but also on [34]Red Hat's Stratis , for example. It will also affect [35]tools that replicate similar functionality , such as Flatpak and OStree – and distros such as [36]Endless OS and Fedora's [37]various immutable variants , which are built around them.
There's a big annotated list of the changes in this release on [38]KernelNewbies , although it does note that the list isn't complete yet. In terms of the number of changes, this is the biggest kernel release ever, and some of the changes will have ramifications for years to come. There may be lurking dragons, or at least bugs. Exercise caution, and expect some of the new stuff to take some time – and point releases – to settle in. ®
Get our [39]Tech Resources
[1] https://lore.kernel.org/lkml/CAHk-=widprp4XoHUcsDe7e16YZjLYJWra-dK0hE1MnfPMf6C3Q@mail.gmail.com/
[2] https://www.theregister.com/2023/12/14/linux_kernel_of_the_beast/
[3] https://www.theregister.com/2023/10/30/linux_6_6_debuts/
[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/oses&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2ZZ7NOVv6RYB9IAK2Hkb3ygAAAMQ&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[5] https://www.theregister.com/2023/11/21/saving_linux_on_itanium/
[6] https://www.theregister.com/2023/10/30/linux_kernel_6_7_rundown/
[7] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/oses&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZZ7NOVv6RYB9IAK2Hkb3ygAAAMQ&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[8] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/oses&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZZ7NOVv6RYB9IAK2Hkb3ygAAAMQ&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[9] https://www.theregister.com/2023/10/16/intels_14thgen_raptor_lake_refresh/
[10] https://download.nvidia.com/XFree86/Linux-x86_64/510.39.01/README/gsp.html
[11] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/oses&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZZ7NOVv6RYB9IAK2Hkb3ygAAAMQ&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[12] https://github.com/riscv/riscv-state-enable/releases/download/v1.0.0/Smstateen.pdf
[13] https://lwn.net/Articles/889475/
[14] https://docs.kernel.org/core-api/workqueue.html
[15] https://bcachefs.org/
[16] https://www.theregister.com/2022/03/18/bcachefs/
[17] https://www.theregister.com/2024/01/03/gentoo_starts_offering_binaries/
[18] https://www.theregister.com/2023/12/21/fed39_asahi_remix/
[19] https://www.theregister.com/2023/12/20/firefox_121_released/
[20] https://www.theregister.com/2023/12/19/debian_to_drop_x86_32/
[21] https://lore.kernel.org/lkml/cover.1698679287.git.dsterba@suse.com/
[22] https://www.theregister.com/2023/09/27/osseu_steam_os_3/
[23] https://lwn.net/Articles/944631/
[24] https://arstechnica.com/gadgets/2021/09/examining-btrfs-linuxs-perpetually-half-finished-filesystem/
[25] https://www.theregister.com/2017/08/16/red_hat_banishes_btrfs_from_rhel/
[26] https://www.theregister.com/2022/07/12/oracle_linux_9/
[27] http://snapper.io/
[28] https://www.theregister.com/2022/06/20/spirallinux_new_debian_remix_from/
[29] https://www.theregister.com/2022/07/28/garuda_linux_arch_better/
[30] https://www.theregister.com/2023/01/05/siduction_2022_1/
[31] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/oses&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZZ7NOVv6RYB9IAK2Hkb3ygAAAMQ&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[32] https://www.45drives.com/community/articles/zfs-caching/
[33] https://www.thomas-krenn.com/en/wiki/Linux_Page_Cache_Basics
[34] https://www.theregister.com/2022/10/24/daos_22_stratis_33/
[35] https://www.theregister.com/2021/11/26/linux_software_installation/
[36] https://www.theregister.com/2023/01/12/endless_os_5/
[37] https://www.theregister.com/2021/02/18/kinoite_immutable_fedora/
[38] https://kernelnewbies.org/Linux_6.7
[39] https://whitepapers.theregister.com/
45RPM
Sounds like bull to me - time to moove on. Don’t milk it.
Lee D
Sounds like you have beef with the idea.
Liam Proven
Oh, gods, what have I done?
Graham Dawson
You've loosed the herd.
UCAP
Deciding which COW filesystem to use is beginning to be like the horns of a dilemma.
Simon Palmer
Always great to see a new FS.
F2FS performance for certain workloads is interesting too. (The Phoronix benchmark article)
Ian Johnston
Always great to see a new FS.
https://xkcd.com/927/
Anonymous Coward
Great, now lactose intolerant people will have to take a pill before using Linux.
alain williams
What a cheesy comment !
:-)
Depends how you look at it
Arthur the cat
Having a second COW-capable file system available that's not encumbered with licensing restrictions
As OpenZFS has been used happily in the BSDs and other Unix-alikes for yonks, it's arguable that it's LInux that is encumbered with licensing restrictions.
Re: Depends how you look at it
Liam Proven
[Author here]
> it's arguable that it's LInux that is encumbered with licensing restrictions.
That's fair enough.
OTOH, I suspect that the number of Linux deployments, especially if you count Android and ephemeral VMs, is ITRO 3-4+ orders of magnitude greater than all other xNix systems combined. So it's all relative, isn't it?
Sadly, it isn't the first time that something FOSS has been totally re-implemented because of licensing restrictions and it won't be the last.
> The executive summary is that bcachefs is a next-generation file system that, like Btrfs and ZFS, provides COW functionality.
So I guess you'll need to decide if you want to run bcachefs or the udder one...