LWN.net

There are a number of different language-enhancement ideas that crop upwith some regularity in the Python community; many of them have been debated and shot down multipletimes over the years. When one inevitably arises anew, it can sometimes bedifficult to tamp it down, even if it is unlikely that the idea will goany further than the last N times it cropped up. A recent discussion about"real" anonymous functions follows a somewhat predictable path, but thereare still reasons to participate in vetting these "new" ideas, despite thetiresome, repetitive nature of the exercise-examples of recurring feature ideas that were eventually adopted definitely exist.

Version124.0 of the Firefox browser is out. Changes include support for"caret browsing mode" in the PDF viewer and the ability to control thesorting of tabs in the Firefox View screen.

Security updates have been issued by Debian (cacti, postgresql-11, and zfs-linux), Fedora (freeimage, mingw-expat, and mingw-freeimage), Mageia (apache-mod_security-crs, expat, and multipath-tools), Oracle (.NET 7.0 and kernel), Red Hat (kernel, kernel-rt, and kpatch-patch), and Ubuntu (bash, kernel, linux, linux-aws, linux-hwe, linux-kvm, linux-oracle, linux, linux-aws, linux-kvm, linux-lts-xenial, and vim).

Man Yue Mo explainshow to compromise a Pixel8 phone even when the Arm memory-tagging extension is in use, by takingadvantage of the Mali GPU.

Kernel developers have long been told that any attempt to allocate memorymight fail, so their code must be prepared for memory to be unavailable.Informally, though, the kernel's memory-management subsystem implements apolicy whereby requests below a certain size will not fail (in processcontext, at least), regardless ofhow tight memory may be. A recent discussion on the linux-mm list haslooked at the idea of making the "too small tofail" rule a policy that developers can rely on.

Security updates have been issued by Debian (curl, spip, and unadf), Fedora (chromium, iwd, opensc, openvswitch, python3.6, shim, shim-unsigned-aarch64, and shim-unsigned-x64), Mageia (batik, imagemagick, irssi, jackson-databind, jupyter-notebook, ncurses, and yajl), Oracle (.NET 7.0, .NET 8.0, and dnsmasq), Red Hat (postgresql:10), SUSE (chromium, kernel, openvswitch, python-rpyc, and tiff), and Ubuntu (openjdk-8).

Cranelift is an Apache-2.0-licensedcode-generation backend being developed as partof the Wasmtime runtime forWebAssembly.In October 2023, the Rust project made Cranelift available as an optionalcomponent in its nightly toolchain.Users can now use Cranelift as the code-generation backend for debug builds ofprojects written in Rust,making it an opportune time to look at what makes Cranelift different.Cranelift is designed to compete with existing compilers by generatingcode more quickly than they can, thanks to a stripped-down design that prioritizesonly the most important optimizations.

Zach Mitchell has announced the 1.0 release of Flox, a tool that lets its users install packages from nixpkgs inside portable virtual environments, and share those virtual environments with others as an alternative to Docker-style containers. Flox is based on Nix but allows users to skip learning how to work with the Nix language:

Sasha Levin has announced the release of the 6.8.1,6.7.10, 6.6.22,6.1.82, 5.15.152,5.10.213, 5.4.272,and 4.19.310 stable kernels. As always, they contain important fixes throughout the tree. Users of those kernels should upgrade.

Security updates have been issued by Debian (composer and node-xml2js), Fedora (baresip), Mageia (fonttools, libgit2, mplayer, open-vm-tools, and packages), Red Hat (dnsmasq, gimp:2.8, and kernel-rt), and SUSE (389-ds, gdb, kernel, python-Django, python3, python36-pip, spectre-meltdown-checker, sudo, and thunderbird).

As of this writing, just over 4,900 non-merge changesets have been pulledinto the mainline for the 6.9 release. This work includes the usual arrayof changes all over the kernel tree; read on for a summary of the mostsignificant work merged during the first part of the 6.9 merge window.

Security updates have been issued by Debian (chromium and openvswitch), Fedora (chromium, python-multipart, thunderbird, and xen), Mageia (java-17-openjdk and screen), Red Hat (.NET 7.0, .NET 8.0, kernel-rt, kpatch-patch, postgresql:13, and postgresql:15), Slackware (expat), SUSE (glibc, python-Django, python-Django1, sudo, and vim), and Ubuntu (expat, linux-ibm, linux-ibm-5.4, linux-oracle, linux-oracle-5.4, linux-lowlatency, linux-raspi, python-cryptography, texlive-bin, and xorg-server).

The LWN.net Weekly Edition for March 14, 2024 is available.

Kaitlyn Abdo of Fedora's AI/MLSIG opened an issue with theFedora Engineering Steering Committee (FESCo) recently that carried a few trickyquestions about packaging machine-learning (ML) models for Fedora. Specifically, the SIG is looking for guidance on whether pre-trained weights forPyTorch constitute code or content. And, if the models are released under alicense approved by theOpen Source Initiative (OSI),does it matter what data the models were trained on? The issue was quicklytossed over to Fedora's legalmailing list and sparked an interesting discussion about how tohandle these items, and a temporary path forward.

Security updates have been issued by Fedora (edk2, freeipa, kernel, and liblas), Oracle (kernel), Red Hat (docker, edk2, kernel, kernel-rt, and kpatch-patch), SUSE (axis, fontforge, gnutls, java-1_8_0-openjdk, kernel, python3, sudo, and zabbix), and Ubuntu (dotnet7, dotnet8, libgoogle-gson-java, openssl, and ovn).

The pidfd abstraction is a Linux-specificway of referring to processes that avoids the race conditions inherent inUnix process ID numbers. Since a pidfd is a file descriptor, it needs afilesystem to implement the usual operations performed on files. As theuse of pidfds has grown, they have stressed the limits of the simplefilesystem that was created for them. Christian Brauner has createda new filesystem for pidfds that seems likely to debut in the 6.9kernel, but it ran into a little bump along the way, demonstrating thatthings you cannot see can still hurt you.

The mainline kernel has just received a set of commits addressing the"register file data sampling" hardware vulnerability.

Herb Sutter, chair of the ISO C++ standards committee,writes about the current problems with writing secure C++,and his personal opinion on next steps to address this while maintainingbackward compatibility.

Serialization is the process of transforming Python objects into a sequence ofbytes which can be used to recreate a copy of the object later - or on anothermachine.pickle is Python's native serialization module. It can store complex Pythonobjects,making it an appealing prospect for moving data without having to writecustom serialization code. For example, pickle is an integral component ofseveral fileformats used for machine learning. However, using pickle to deserializeuntrusted files is a major security risk, because doing so can invoke arbitraryPython functions. Consequently, the machine-learning community is working to address thesecurity issues caused by widespread use of pickle.

Security updates have been issued by Debian (qemu), Mageia (libtiff and thunderbird), Red Hat (kernel, kpatch-patch, postgresql, and rhc-worker-script), SUSE (compat-openssl098, openssl, openssl1, python-Django, python-Django1, and wpa_supplicant), and Ubuntu (accountsservice, libxml2, linux-bluefield, linux-raspi-5.4, linux-xilinx-zynqmp, linux-oem-6.1, openvswitch, postgresql-9.5, and ruby-rack).

Geoff Huston digs into thedetails of the KeyTrap DNS vulnerability, which was disclosed in February.

The 6.8 kernel was released on March 10after a typical, nine-week development cycle. Over this time, 1,938developers contributed 14,405 non-merge changesets, making 6.8 into aslower cycle than 6.7 (but busier than 6.6), with the lowest number ofdevelopers participating since the 6.5 release. Still, there wasa lot going on during this cycle; read on for some of the details.

Security updates have been issued by Debian (libuv1, nss, squid, tar, tiff, and wordpress), Fedora (chromium, exercism, grub2, qpdf, and wpa_supplicant), Oracle (edk2 and opencryptoki), and SUSE (cpio, openssl-1_0_0, openssl-1_1, openssl-3, sudo, tomcat, and xen).

Linus has released the 6.8 kernel.

Andrew 'bunnie' Huang provides an update onhis IRIS infrared chip-scanning project as the starting point for adetailed summary on how chip customers can detect forgeries andmodifications in general.

Name collisions aren't just a problem for softwaredevelopment-organizations, projects, and software that have thesame or similar names can cause serious confusion. That was certainlythe case on February28 when the Open CollectiveFoundation (OCF) began to notify its hosted projects that it wouldbe shutting down by the end of2024. The announcement surprisedprojects hosted with OCF, as one might expect. It also worried andconfused users of the Open Collective software platform from Open Collective, Inc. (OCI), aswell as organizations hosted by the Open SourceCollective (OSC) and Open CollectiveEurope (OC Europe). There is enough confusion about the names,relationships between the organizations, and impact on projects likeFlatpak, Homebrew, and htop hosted by OCF, that adeeper look is warranted.

Before loading a BPF program, the kernel must verify that the program issafe to run; among other things, that verification includes ensuring thatthe program will terminate within a bounded time. That requirement haslong made writing loops in BPF a challenging task. The situation hasimproved over the years for some types of loops, but others - includinglinked-list traversal - are still awkward in BPF programs. A new set ofBPF primitives aims to make life easier for this use case through theinstallation of what can be seen as a sort of circuit breaker.

Security updates have been issued by Debian (fontforge), Fedora (chromium, iwd, libell, and thunderbird), Oracle (buildah, kernel, skopeo, and tomcat), Red Hat (opencryptoki), Slackware (ghostscript), SUSE (go1.21, go1.22, google-oauth-java-client, jetty-minimal, openssl-1_0_0, python310, sudo, wpa_supplicant, and xmlgraphics-batik), and Ubuntu (libhtmlcleaner-java, linux, linux-azure, linux-azure-5.15, linux-azure-fde, linux-azure-fde-5.15, linux-gcp, linux-gcp-5.15, linux-gke, linux-gkeop, linux-gkeop-5.15, linux-hwe-5.15, linux-ibm, linux-ibm-5.15, linux-lowlatency-hwe-5.15, linux-nvidia, linux-azure, linux-azure-6.5, linux-hwe-6.5, mqtt-client, ncurses, and puma).

While programmers are used to having tools to check their code forstylistic problems, writers often limit automatic checks of their texts tospelling and, sometimes, grammar, because there are not a lot of optionsfor further checking. If that is the case, Vale, an open-source, command-line tool to enforce editorial-style guidelines, wouldmake auseful addition to their toolbox. The recent release ofVale3.0 warrants a look at this versatile tool, which assists writers byidentifying common errors and helping them maintain a consistent voice in theirprose.

Security updates have been issued by Debian (chromium and yard), Fedora (cpp-jwt, golang-github-tdewolff-argp, golang-github-tdewolff-minify, golang-github-tdewolff-parse, and suricata), Mageia (wpa_supplicant), Oracle (curl, edk2, golang, haproxy, keylime, mysql, openssh, and rear), Red Hat (kernel and postgresql:12), SUSE (containerd, giflib, go1.21, gstreamer-plugins-bad, java-1_8_0-openjdk, python3, python311, python39, sudo, and vim), and Ubuntu (frr, linux, linux-gcp, linux-gcp-5.4, linux-gkeop, linux-hwe-5.4, linux-iot, linux-kvm, linux-raspi, and linux, linux-gcp, linux-gcp-6.5, linux-laptop, linux-lowlatency, linux-lowlatency-hwe-6.5, linux-oem-6.5, linux-oracle, linux-raspi, linux-starfive, linux-starfive-6.5).

The LWN.net Weekly Edition for March 7, 2024 is available.

The Fedora Project switchedto MariaDB as the default implementation of MySQL in Fedora19 in 2013. Once a drop-inreplacement for MySQL, MariaDB has diverged enough that this is no longerthe case-and, despite concerns about Oracleand optimism that MariaDB would supplant MySQL, the reality is that MySQLand MariaDB seem to be here to stay. With that in mind, Fedora developerMichal Schormproposed that the project revise the way MySQL and MariaDBare packaged in Fedora starting with Fedora40.

The postmarketOS project, which producesa Linux distribution for phones and mobile devices,has announcedthat it is in the early stages of adding systemd to make it easier to support GNOME and KDE.Users who prefer the OpenRCinit system are assured they will still have that option when building their ownimages "as long as OpenRC is in Alpine Linux (on which postmarketOS is based)":

QUIC is a UDP-based transport protocol that forms the foundation ofHTTP/3.It was initially developed at Google in 2012, and became anIETF standard in2021. Work on the protocol did not stop with its standardization, however. TheQUIC Working Grouppublished several follow-up standards. Now, it is working onfour more extensions to QUIC intended to patch over various shortcomings in thecurrent protocol - although progress has not been quick.

Greg Kroah-Hartman has announced another round of stable kernel updates:6.7.9, 6.6.21,6.1.81, 5.15.151,5.10.212, 5.4.271,and 4.19.309 have all beenreleased. Each contains a set of important fixes.

Security updates have been issued by Debian (libapache2-mod-auth-openidc, libuv1, php-phpseclib, and phpseclib), Red Hat (buildah, cups, curl, device-mapper-multipath, emacs, fence-agents, frr, fwupd, gmp, gnutls, golang, haproxy, keylime, libfastjson, libmicrohttpd, linux-firmware, mysql, openssh, rear, skopeo, sqlite, squid, systemd, and tomcat), Slackware (mozilla), SUSE (kernel-firmware-nvidia-gspx-G06, nvidia-open- driver-G06-signed, postgresql-jdbc, python, python-cryptography, rubygem-rack, wpa_supplicant, and xmlgraphics-batik), and Ubuntu (c-ares, firefox, libde265, libgit2, and ruby-image-processing).

The kernel's memory-management subsystem is built on the concept of"zones", which were initially added to describe the physicalcharacteristics of the memory pages contained within them. Over time,zones have taken on more of a policy-related role as well. With a patchset called THPallocator optimizations, Yu Zhao has set out to better define the roleof policy-related zones on the path toward adding two more of them, withthe ultimate purpose of improving the kernel's support for transparent hugepages (THPs).

Security updates have been issued by Debian (yard), Oracle (buildah and kernel), Red Hat (389-ds:1.4, edk2, frr, gnutls, haproxy, libfastjson, libX11, postgresql:12, sqlite, squid, squid:4, tcpdump, and tomcat), SUSE (apache2-mod_auth_openidc and glibc), and Ubuntu (linux-gke, python-cryptography, and python-django).

It has long been possible to run multiple Python interpreters in the sameprocess - via the C API, but not within the language itself.Eric Snow has been working to make this abilityavailable in the language for many years.Now, Snow has publishedPEP 734 ("Multiple Interpretersin the Stdlib"), the latest work in hisquest, andsubmittedit to the Python steering council for a decision.If the PEP is approved, users will havean additional option for writing performant parallel Python code.

Security updates have been issued by Debian (firefox-esr and thunderbird), Fedora (dotnet6.0, dotnet8.0, and mod_auth_openidc), Gentoo (Blender, Tox, and UltraJSON), Oracle (kernel), Red Hat (edk2), SUSE (sendmail and zabbix), and Ubuntu (nodejs and thunderbird).

The 6.8-rc7 kernel prepatch is out fortesting.

The6.7.8 and6.6.20stable kernel updates have been released. They contain a single patchaddressing an ntfs3 filesystem build error introduced in the previousround of updates.

One of the outcomes of the (extremely) lengthy discussion about usingCommon Lisp features in Emacs Lisp (Elisp), which we looked at back in November, was an effort tostart removing some of those uses from Emacs. The rewrite of some of theElisp in Emacs that uses the Common Lisp library (cl-lib) was started byRichard Stallman as a way to reduce the cognitive load needed formaintaining Emacs itself. Since then, he has broadened his efforts tosimplify Elisp by adding a new pattern-matchingconditional that would be a competitor to pcase,which is a longstanding macro that he finds overly complex.

On February 29, the musl projectannounced release1.2.5, including support for loongarch64 and riscv32. Thisrelease also contains support for thestatx(),preadv2(),and pwritev2() system calls.

Greg Kroah-Hartman has announced the release of seven new stable kernels:6.7.7,6.6.19,6.1.80,5.15.150,5.10.211,5.4.270, and4.19.308.As usual, they contain many important fixes throughout the kernel tree.

Security updates have been issued by CentOS (firefox and thunderbird), Debian (gsoap, python-django, and wireshark), Fedora (dotnet7.0 and gifsicle), Mageia (sympa), Oracle (postgresql:10, postgresql:12, thunderbird, and unbound), Red Hat (kpatch-patch, python-pillow, and squid:4), SUSE (nodejs12, nodejs14, nodejs16, nodejs18, and openvswitch3), and Ubuntu (linux-azure, linux-lowlatency, linux-starfive-6.5, php-guzzlehttp-psr7, and php-nyholm-psr7).

Over on the Collabora blog, Faith Ekstrand has announced that the NVK Vulkan driver for NVIDIA devices will be part of Mesa 24.1 and is ready for real-world use. It should be appearing in Linux distributions later this year.

The Linux kernel follows a monolithic design, and that brings a well-knownproblem: all code in the kernel has access to the entirety of the kernel'saddress space. As a result, a bug in (for example) an obscure driver maywell be exploitable to wreak havoc on core-kernel data structures. Variousattempts have been made over the years to increase the degree of isolationwithin the kernel. The latest of these, "SandBoxMode" proposed by Petr Tesaik, makes it possible for the kernel to runsome limited code safely, but it has encountered a bit of a chilly reception.

Security updates have been issued by Debian (chromium), Fedora (moodle), Red Hat (kernel, kernel-rt, and postgresql:15), Slackware (wpa_supplicant), SUSE (Java and rear27a), and Ubuntu (libcpanel-json-xs-perl, libuv1, linux-aws, linux-aws-5.15, linux-azure, linux-azure-5.4, linux-lowlatency, linux-lowlatency-hwe-6.5, linux-oem-6.5, python-openstackclient, and unbound).

The LWN.net Weekly Edition for February 29, 2024 is available.