LWN.net

It is with sadness that we report that Linux Journal has ceased publication. The magazine announced its demise at the end of 2017, then was happily reborn in early 2018, but apparently that was not to last. Editor Kyle Rankin posted "An Awkward Goodbye" on August 7. "After dying and being revived, it was finally starting to look like some day soon we would be able to walk on our own.Unfortunately, we didn't get healthy enough fast enough, and when we found out we needed to walk on our own strength, we simply couldn't. So here we are giving our second, much more awkward, goodbye. What happens now? We gave each other a proper hug during the first goodbye, do we hug again this time? Do we do the hand-shake-that-turns-into-a-single-arm-hug thing? Do we just sort of wave and smile?" LJ will be missed.

The LWN.net Weekly Edition for August 8, 2019 is available.

The "Web ofThings" (WoT) is meant as a way to enable Internet ofThings (IoT) devices to appear on the web. Mozilla's entry into theWoT world is the WebThings project,which consists of both a Framework API and a Gateway software distributionto host applications. On July 25, the project announcedthe Gateway 0.9 release with support for the TurrisOmnia wireless home router.

A change for Python 3.8—currently in beta—has produced someuser-visible warnings, but the problem is often in code that a user cannot(or should not) change: third-party modules. The problem that the warningis trying to highlight is real, however. The upshot is that the handling ofescape sequences (or non escape sequences, in truth) inPython string literals is in a rather messy state at this point.

The Free Software Foundation Europe has an announcementabout the release of the REUSE 3.0 specification. "The licensing of asoftware project is critical information. Developers set the terms underwhich others can reuse their software, from individuals to giantcorporations. Authors want to make sure that others adhere to their chosenlicenses; potential re-users have to know the license of third-partysoftware before publication; and companies have to ensure licensecompliance in their products that often build on top of existingprojects. The REUSE project, led bythe Free Software Foundation Europe (FSFE), helps all of theseparties."

Security updates have been issued by Fedora (hostapd), openSUSE (aubio and spamassassin), Oracle (kernel), Red Hat (augeas, kernel-rt, libssh2, perl, procps-ng, redis:5, and systemd), SUSE (bzip2, evince, kernel, linux-azure, nodejs4, nodejs8, osc, python, python-Twisted, and python3), and Ubuntu (BWA and Mercurial).

Lars Knoll describesthe goals for the next major version of the Qt graphics toolkit."Qt has been growing a lot over the last years, to the point wheredelivering a new version of it is a major undertaking. With Qt 6 there isan opportunity to restructure our product offering and have a smaller coreproduct that contains the essential frameworks and tooling. We will use themarket place to deliver our add-on frameworks and tools, not as a tightlycoupled bundle with the core Qt product."

Lisp is one of the oldest programming languages still inuse today—Fortran is older by a year, but the Lisp community (orcommunities) seems to be the more dynamic of the two. In any case, the Lisplandscape has a lot of nooks and crannies to explore; I recently ran into adialect that I had not encountered before: Racket. That may simply reflectignorance on my part, but, while I was introduced to Lisp (too) many moonsago, I had not really paid it much mind until I sat in on a talk about Lisp at linux.conf.au earlier thisyear. Something about Racket caught my eye, so I did some poking around tosee what it is all about.

Version 4.2 of the FFmpegmultimedia framework is out. It features a long list of new filters anddecoders, including a long-awaited AV1 decoder.

Stable kernels 5.2.7, 4.19.65, 4.14.137, 4.9.188, and 4.4.188 have been released. They all containimportant fixes and users should upgrade.

The Compact C Type Format (CTF) is a way of representing information abouta binary program; it can be seen as a simpler alternative to the widelyused DWARF format. While CTF has been around for some years, it has not seen much usein the Linux world. According to Elena Zannoni, who talked about CTF atthe 2019 Open Source Summit Japan, that situation may be about to change;work is underway to bring CTF support to the GNU tools shipped universallywith Linux systems.

Red Hat has announcedthe release of Red Hat Enterprise Linux 7.7. "Beyond new capabilities, Red Hat Enterprise Linux 7.7 also marks the transition of Red Hat Enterprise Linux 7 to Maintenance Phase I within the Red Hat Enterprise Linux 10-year lifecycle. Maintenance Phase I emphasizes maintaining infrastructure stability for production environments and enhancing the reliability of the operating system. Future minor releases of Red Hat Enterprise Linux 7 will now focus solely on retaining and improving this stability rather than net-new features."

Security updates have been issued by Arch Linux (chromium), Debian (glib2.0 and python-django), Fedora (gvfs, kernel, kernel-headers, kernel-tools, and subversion), Oracle (icedtea-web, nss and nspr, and ruby:2.5), Red Hat (advancecomp, bind, binutils, blktrace, compat-libtiff3, curl, dhcp, elfutils, exempi, exiv2, fence-agents, freerdp and vinagre, ghostscript, glibc, gvfs, http-parser, httpd, kde-workspace, keepalived, kernel, kernel-rt, keycloak-httpd-client-install, libarchive, libcgroup, libguestfs-winsupport, libjpeg-turbo, libmspack, libreoffice, libsolv, libssh2, libtiff, libvirt, libwpd, linux-firmware, mariadb, mercurial, mod_auth_openidc, nss, nss-softokn, nss-util, and nspr, ntp, opensc, openssh, openssl, ovmf, patch, perl-Archive-Tar, polkit, poppler, procps-ng, python, python-requests, python-urllib3, qemu-kvm, qemu-kvm-ma, qt5, rsyslog, ruby, samba, sox, spice-gtk, sssd, systemd, tomcat, udisks2, unixODBC, unzip, uriparser, Xorg, zsh, and zziplib), SUSE (ardana packages, ceph, mariadb, postgresql10, python-requests, and python3), and Ubuntu (bash and glib2.0).

Freedombone4.0 is available. Freedombone is a distribution (based onDebian 10) focused on the hosting network services under one's owncontrol on home servers. "There is no freedom without freedom ofassociation. That is, having the ability to define who you are and whatkind of community you want to live in. This release includes CommunityNetworks as an initial step towards networks run by and for the people whouse them." Support for the Wireguard VPN has been added, but the"Fediverse" applications (GNU Social, PostActiv, and Pleroma) have beenremoved as being too hard to manage.

The 5.3-rc3 kernel prepatch is out."Interesting. Last Sunday, rc2 was fairly large to match the biggishmerge window, but this last week has actually been quite calm, and rc3is actually smaller than usual, and smaller than rc2 was"

Stable kernels 5.2.6, 4.19.64, 4.14.136, 4.9.187, and 4.4.187 have been released. They all containimportant fixes and users should upgrade.

Security updates have been issued by Debian (proftpd-dfsg and vim), Fedora (java-11-openjdk and matrix-synapse), Gentoo (binutils and libpng), Mageia (kernel), and SUSE (openexr and python-Django).

The seccomp()mechanism is notoriously difficult to use. It also turns out to be easy tobreak unintentionally, as the development community discovered when atimekeeping change meant to address the year-2038 problem created a regression forseccomp() users in the 5.3 kernel. Work is underway to mitigatethe problem for now, but seccomp() users on 32-bit systems arelikely to have to change their configurations at some point.

Security updates have been issued by Debian (firefox-esr and thunderbird), openSUSE (openexr and rmt-server), Oracle (bind, container-tools:rhel8, cyrus-imapd, dotnet, edk2, firefox, flatpak, freeradius:3.0, ghostscript, gvfs, httpd:2.4, java-1.8.0-openjdk, java-11-openjdk, kernel, mod_auth_mellon, pacemaker, pki-deps:10.6, python-jinja2, python27:2.7, python3, python36:3.6, systemd, thunderbird, vim, virt:rhel, WALinuxAgent, and wget), Slackware (mariadb), SUSE (java-1_8_0-openjdk, polkit, and python-Django1), and Ubuntu (Sigil and sox).

Version 2.30 of the GNU CLibrary (glibc) has been released. New features include Unicode 12.1.0support; wrappers for the getdents64(),gettid(), and tgkill()system calls on Linux; addition of a bunch of POSIX-proposed pthreadscalls; protections for memory allocation functions so that they cannotcause ptrdiff_t overflows; and more, such as fixes for twosecurity problems:CVE-2019-7309: x86-64 memcmp used signed Jcc instructions to check size. For x86-64, memcmp on an object size larger than SSIZE_MAX has undefined behavior. On x32, the size_t argument may be passed in the lower 32 bits of the 64-bit RDX register with non-zero upper 32 bits. When it happened with the sign bit of RDX register set, memcmp gave the wrong result since it treated the size argument as zero. Reported by H.J. Lu.CVE-2019-9169: Attempted case-insensitive regular-expression match via proceed_next_node in posix/regexec.c leads to heap-based buffer over-read. Reported by Hongxu Chen.

The GNOME and KDE projects are teaming up to host the Linux App Summit (LAS) that will beheld in Barcelona, November 12-15. "LAS is the first collaborative event co-hosted by the two organizations since the Desktop Summit in 2009. Both organizations are eager to bring their communities together in building an application ecosystem that transcends individual distros and broadens the market for everyone involved. KDE and GNOME will no longer be taking a passive role in the free desktop sector. With the joint influence of the two desktop projects, LAS will shepherd the growth of the FOSS desktop by encouraging the creation of quality applications, seeking opportunities for compensation for FOSS developers, and fostering a vibrant market for the Linux operating system." The CfP is open until August 31.

The C switch statement has, since the beginning of the language,required the use of explicit break statements to prevent executionfrom falling through from one case to the next. This behavior canbe a useful feature, allowing for more compact code, but it can also leadto bugs. The effort to rid the kernel of implicit fall-through codingpatterns came to a conclusion with the 5.3-rc2 release, wherethe last cases were fixed. There is a good chance that these fixes willhave to be redone in the future, though.

Security updates have been issued by CentOS (httpd, libssh2, and qemu-kvm), Debian (glib2.0, squirrelmail, subversion, and wpa), Fedora (proftpd), Oracle (icedtea-web), Red Hat (icedtea-web), Scientific Linux (icedtea-web), SUSE (icedtea-web, java-1_7_0-openjdk, subversion, and zypper, libzypp and libsolv), and Ubuntu (linux-hwe, openjdk-lts, pango1.0, python-django, and subversion).

The LWN.net Weekly Edition for August 1, 2019 is available.

In theory, the public API of a Python standard library module is fullyspecified as part of its documentation, but in practice it may not be quite so clear cut. There are other ways to specify the names in a module thatare meant to be public, and there are naming conventions for things thatshould not be public (e.g. the name starts with an underscore), butthere is no real consistency in how those are used throughout the standard library.A mid-July discussion on the python-dev mailing list considered the problem and some possiblesolutions; the main outcome seems to be interest in making the rules moreexplicit.

It has been the better part of a decade since the last KernelShark article appeared here; in theinterim, the kernel-tracing visualization tool has undergone some major changes.While the high-level appearance is largely similar, the underlying codehas switched from GTK+ 2.0 to Qt 5. On July 26,maintainer Steven Rostedt announcedthe release of KernelShark version 1.0, which makes it a good time totake another peek.

BPF programs have gained significantly in capabilities over the last fewyears and can now perform many useful operations. That said, BPFdevelopers have had to work around an annoying limitation until recently: they could not use loops. This restriction was recently liftedby a patchset from Alexei Starovoitov that was merged for Linux 5.3. In addition toadding support for loops, it also greatly decreases the load time ofmost BPF programs.

Stable kernels 5.2.5, 4.19.63, and 4.14.135 have been released. These updates areon the large side. The 4.14 kernel is largest with 4748 insertions and 3145deletions. As usual, users should upgrade.

Security updates have been issued by CentOS (389-ds-base, curl, and kernel), Debian (libssh2), Fedora (kernel, kernel-headers, and oniguruma), openSUSE (chromium, openexr, thunderbird, and virtualbox), Oracle (389-ds-base, curl, httpd, kernel, and libssh2), Red Hat (nss and nspr and ruby:2.5), Scientific Linux (httpd and kernel), SUSE (java-1_8_0-openjdk, mariadb, mariadb-connector-c, polkit, and python-requests), and Ubuntu (openjdk-8, openldap, and sox).

This is the final call for proposals for the containersand checkpoint/restore microconference at the Linux Plumbers Conference; thedeadline is Friday, August 2. LPC will take place September 9-11 in Lisbon,Portugal.

This is the final call for proposals for the 3 day networking track at theLinux Plumbers Conference; the deadline is Friday, August 2. LPC will takeplace September 9-11 in Lisbon, Portugal. "Any kind of advancednetworking-related topic will be considered."

The Collabora blog announcessome ongoing work to integrate Linux desktop environments with head-mounteddisplays. "In contrast to these approaches xrdesktop aims to integrate into existing Linux desktop environments, eliminating the necessity of running a dedicated compositor for only VR and thus making it usable in current setups. For our initial release, we focused on integration in the most popular Linux desktops, GNOME and KDE, but xrdesktop is designed to be integrated into any desktop. This can be done with Compiz-like plugins as for KWin or patches on the compositor in the case of GNOME Shell.This integration of xrdesktop into the window managers enables mirroring existing windows into XR and to synthesize desktop input through XR actions."

Version 2.80of the Blender 3D animation system has been released. "Blender 2.80features a redesigned user interface that puts the focus on the artworkthat you create. A new dark theme and modern icon set wereintroduced. Keyboard, mouse and tablet interaction got a refresh with leftclick select as the new default. Quick Favorites menus provide rapid accessto often-used tools."

There is anincreasingly active development effort, known as Darling, that is aiming to provide atranslation layer for macOS software on Linux; it is inspired in part by Wine. While Darling isn't nearlyas mature as Wine, contributors are continuing to build out capabilitiesthat could make the project more useful to a wider group of users in thefuture.Subscribers can read on for a look at Darling from this week's edition.

Security updates have been issued by Fedora (cutter-re and radare2), Oracle (389-ds-base, httpd, kernel, libssh2, and qemu-kvm), Red Hat (389-ds-base, chromium-browser, curl, docker, httpd, keepalived, kernel, kernel-alt, kernel-rt, libssh2, perl, podman, procps-ng, qemu-kvm, qemu-kvm-ma, ruby, samba, and vim), Scientific Linux (389-ds-base, curl, libssh2, and qemu-kvm), SUSE (bzip2 and openexr), and Ubuntu (python-urllib3 and tmpreaper).

The NumPy team has announced the release of NumPy 1.17.0. NumPy is afundamental package for scientific computing with Python. "The 1.17.0release contains a number of new features that should substantially improveits performance and usefulness. The Python versions supported are 3.5-3.7,note that Python 2.7 has been dropped."

For those didn't quite get around to putting in a proposal forlinux.conf.au 2020 (Gold Coast, January 13 to 17), there'sanother chance: the proposal deadline has been extended to August 11."We have heard that some of you would like a bit more time to submit your proposals for linux.conf.au 2020. So, we have decided to extend the due date by two weeks to help everyone have a chance to submit."

Security updates have been issued by Debian (patch, sdl-image1.2, and unzip), Fedora (deepin-clone, dtkcore, dtkwidget, and sqlite), Mageia (virtualbox), openSUSE (firefox), and SUSE (cronie and firefox).

The 5.3-rc2 kernel prepatch is availablefor testing. "There are fixes all over, I don't think there's much of a patternhere. The three areas that do stand out are Documentation (more rstconversions), arch updates (mainly because of the netx arm platformremoval) and misc driver fixes (gpu, iommu, net, nvdimm, sound..)".

The 5.2.4,5.1.21, and4.19.62stable kernel updates have been released; each contains another set ofimportant fixes. Note that 5.1.21 is the end of the line for the 5.1.xseries.

ZDNet reportson GitHub's blocking of users from Crimea and Iran."As GitHub notes on its page about US trade controls, US sanctionsapply to its online hosting service, GitHub.com, but its paid-foron-premise software -- aimed at enterprise users -- may be an option forusers in those circumstances. It also claims to be in discussions with USregulators about how to rectify the situation."

Over the last few kernel releases, the kernel has gained the concept of a"pidfd" — a file descriptor that represents a process. What started as away of sending signals to processes without race conditions has evolvedinto a more complete process-management interface. Now one of the lastpieces is being put into place: the ability to wait for processes usingpidfds. But, naturally, that API has had to go through some revisionsfirst.

Three new stable kernels have been released: 5.2.3, 5.1.20,and 4.19.61. These are rather largerupdates than most and, as usual, contain fixes throughout the kernel tree;users should upgrade.

Security updates have been issued by Debian (libssh2 and patch), Fedora (kernel and kernel-headers), Mageia (vlc), Red Hat (rh-redis32-redis), SUSE (libgcrypt, libsolv, libzypp, zypper, and rmt-server), and Ubuntu (exim4, firefox, libebml, linux, linux-aws, linux-kvm, linux-raspi2, and vlc).

Laurent Pinchart began his OpenSource Summit Japan 2019 talk with a statement that, once upon a time, camera devices were simple pipelines thatproduced a sequence of video frames. Applications could control cameras usingthe Video4Linux (V4L) API by way of a single device node; there were "lots ofknobs", but the overall task was straightforward. That situation haschanged over the years, and application developers need more help; that iswhere the libcamera project comes in.

Security updates have been issued by CentOS (java-1.7.0-openjdk, java-1.8.0-openjdk, and java-11-openjdk), Debian (exim4), Fedora (java-latest-openjdk), openSUSE (libsass, tomcat, and ucode-intel), Oracle (java-1.7.0-openjdk and thunderbird), SUSE (OpenEXR, spamassassin, and thunderbird), and Ubuntu (ansible and patch).

The LWN.net Weekly Edition for July 25, 2019 is available.

Python is often mentioned in the same breath with the phrase "batteriesincluded", which refers to the breadth of its standard library. But thereis an effort underway to trim back thestandard library by removing some unloved modules. In addition, there hasbeen persistent talk of a major restructuring of the library, into a fairlyminimal core as described in Amber Brown's talkat this year's Python Language Summit, or in other ways as discussed on the python-dev mailing list inJanuary (though it has come up many times before that as well).A mid-July python-ideas mailing list thread picked up on some of that; itended up showing, once again, that there is no real consensus on what the standardlibrary is—or should be.

Fedora Magazine covers thefirst preview release of Fedora CoreOS, a new Fedora edition builtspecifically for running containerized workloads. "It's the successor to both Fedora Atomic Host and CoreOS Container Linux. Fedora CoreOS combines the provisioning tools, automatic update model, and philosophy of Container Linux with the packaging technology, OCI support, and SELinux security of Atomic Host."

Security updates have been issued by Debian (kernel, linux-4.9, and neovim), Fedora (slurm), openSUSE (ImageMagick, libgcrypt, libsass, live555, mumble, neovim, and teeworlds), Oracle (java-1.7.0-openjdk, java-1.8.0-openjdk, and java-11-openjdk), Red Hat (java-1.7.0-openjdk), Scientific Linux (java-1.7.0-openjdk), SUSE (glibc and openexr), and Ubuntu (mysql-5.7 and patch).