-
Simon McVittie authored
Signed-off-by:
Simon McVittie <smcv@collabora.com>
Simon McVittie authoredSigned-off-by:
Simon McVittie <smcv@collabora.com>
pressure-vessel — tools to put Steam in containers
pressure-vessel is a bit like a simplified version of Flatpak for Steam games.
Use cases
Using an alternative runtime
We can get a more predictable library stack than the
LD_LIBRARY_PATH
-based Steam Runtime by making an alternative runtime
available over /usr
, /lib*
, /bin
, /sbin
, analogous to Flatpak
runtimes, using some or all of the host system's graphics stack.
In particular, this would avoid or mitigate the following problems with
the LD_LIBRARY_PATH
-based Steam Runtime:
-
The Steam Runtime cannot contain glibc, because the path to
ld.so(8)
is hard-coded into all executables (it is the ELF interpreter, part of the platform ABI), the version ofld.so
is coupled tolibdl.so.2
, and the version oflibdl.so.2
is coupled to the rest of glibc; so everything in the Steam Runtime must be built for a glibc at least as old as the oldest system that Steam supports. This makes it difficult to advance beyond the Ubuntu 12.04-based 'scout' runtime: everything that is updated effectively has to be backported to Ubuntu 12.04. -
The Steam Runtime was originally designed to prefer its own version of each library even if the version in the host system was newer, but this broke any graphics driver that relied on a newer version of a host library, notably
libstdc++
. -
More recent versions of the Steam Runtime prefer the "pinned" host system version of most libraries that appear to be at least as new as the Runtime's own version, but this can also break things if libraries claim to be compatible (by having the same ELF
DT_SONAME
) but are in fact not compatible, for example:-
libcurl.so.4 linked to libssl 1.0 is not completely compatible with libcurl.so.4 linked to libssl 1.1
-
The history of libcurl.so.4 in Debian/Ubuntu has involved two incompatible sets of versioned symbols, due to some decisions made in 2005 and 2007 that, with hindsight, were less wise than they appeared at the time
-
Various libraries can be compiled with or without particular features and dependencies; if the version in the Steam Runtime has a feature, and the host system version is newer but does not have that feature, then games cannot rely on the feature
-
In the worst-case, compiling a library without a particular feature or dependency can result in symbols disappearing from its ABI, resulting in games that reference those symbols crashing
-
There is a fairly subtle interaction between libdbus, libdbusmenu-gtk, libdbusmenu-glib and Ubuntu's patched GTK 2 that has resulted in these libraries being forced to be taken from the Steam Runtime, to avoid breaking the Unity dock
-
-
Preferring the "pinned" host system libraries makes it very easy for a game developer to make their game depend on a newer host-system library without realising that they have done so, resulting in their game not running correctly on older host systems, or on host systems that do not have a library with a matching
DT_SONAME
.
A future goal is to use libcapsule to avoid the library dependencies of the host system's graphics stack influencing the libraries loaded by games at all, and in particular allow game logic to use the Runtime's libstdc++ while the host system graphics driver uses a different, newer libstdc++. This is not yet implemented.
$HOME
Protecting (This feature is not being actively developed right now.)
If we change the meaning of /home
for a game to be a fake
app-specific directory, then the game can't write random files in unknown
subdirectories of $HOME, and we can be reasonably sure that uninstalling
a game removes all of its files. As a side benefit, this could make it
easier to be sure that all the necessary files have been selected for
Steam Cloud Sync, because we could prevent the game writing anywhere
that won't be synchronised, other than /tmp or similar.
Building a local test version of pressure-vessel
pressure-vessel is a reasonably ordinary Meson project. It depends on GLib and libXau.
If you are using it with the under-development Steam Linux Runtime, you will probably want to compile it with an unusual ${prefix}:
prefix="${XDG_DATA_HOME:-"$HOME/.local/share"}/Steam/steamapps/common/SteamLinuxRuntime/pressure-vessel"
libdir="lib/x86_64-linux-gnu"
meson --prefix="$prefix" --libdir="$libdir" _build
ninja -C _build
meson test -v -C _build # optional
ninja -C _build install
Note that this will give you a non-production version of pressure-vessel that is likely to depend on libraries from your host system, which is good for quick turnaround and debugging, but not suitable for deployment to the public. For that, you'll want a relocatable installation: see below.
If you are developing pressure-vessel, you might well want to alter the bundled libcapsule tools. You can do this by building your own copy of libcapsule. This requires 32- and 64-bit copies of libelf (the version from elfutils) and its development files.
git clone https://gitlab.collabora.com/vivek/libcapsule.git
cd libcapsule
prefix="${XDG_DATA_HOME:-"$HOME/.local/share"}/Steam/steamapps/common/SteamLinuxRuntime/pressure-vessel"
libdir="lib/x86_64-linux-gnu"
NOCONFIGURE=1 ./autogen.sh
mkdir _build _build/i386 _build/x86_64
( cd _build/x86_64; ../../configure
--host=x86_64-linux-gnu --enable-host-prefix=x86_64-linux-gnu- \
--prefix="$prefix" --libdir="\${prefix}/$libdir" \
--disable-gtk-doc --disable-shared --without-glib )
( cd _build/i386; ../../configure
--host=i686-linux-gnu --enable-host-prefix=i386-linux-gnu- \
--prefix="$prefix" --libdir="\${prefix}/$libdir" \
--disable-gtk-doc --disable-shared --without-glib )
make -C _build/x86_64
make -C _build/i386
make -C _build/x86_64 install
make -C _build/i386 install
Use --host=i586-linux-gnu
instead of --host=i686-linux-gnu
if your
distribution uses that tuple for its 32-bit compiler. For the i386 build,
if you don't have an i?86-linux-gnu-gcc
you might have to add
CC="gcc -m32"
to the i386 configure command line.
Again, this will give you a non-production version of libcapsule that is likely to depend on libraries from your host system.
Building a relocatable install for deployment
To make the built version compatible with older systems, you will need a SteamRT 1 'scout' environment.
For this, you need prebuilt versions of libcapsule-tools-relocatable:amd64 and libcapsule-tools-relocatable:i386 either in your build environment or available via apt-get. For example, you could do the build in a SteamRT 1 'scout' SDK Docker image that has those packages already. Then you can do:
meson --prefix="$(pwd)/_build/prefix" -Dsrcdir=src _build
ninja -C _build
meson test -v -C _build # optional
ninja -C _build install
rm -fr _build/relocatable-install
_build/prefix/bin/pressure-vessel-build-relocatable-install \
--output _build/relocatable-install \
--archive .
./tests/relocatable-install.py _build/relocatable-install # optional
For more convenient use on a development system, if you have a
SteamRT 1 'scout' SDK tarball or an unpacked sysroot, you can place a
tarball at _build/sysroot.tar.gz
or unpack a sysroot into
_build/sysroot
, and prefix those commands with
./sysroot/run-in-sysroot.py
:
./sysroot/run-in-sysroot.py apt-get update
./sysroot/run-in-sysroot.py meson --prefix="$(pwd)/_build/prefix" _build
./sysroot/run-in-sysroot.py ninja -C _build
(etc.)
(Or put them in different locations and pass the --sysroot
and
--tarball
options to ./sysroot/run-in-sysroot.py
.)
The relocatable install goes into relocatable-install
(or
whatever you used as the --output
), and a compressed version ends
up in the directory passed as an argument to --archive
.
Instructions for testing
-
Install Steam and some games. Convenient choices for a reasonably small free-to-play game on various engines include:
- Floating Point (game ID 302380)
- very small/quick to install, works OK on weak hardware
- UnityPlayer 4.3.4f1
- Life is Strange, episode 1 (319630)
- Unreal Engine 3
- Team Fortress 2 (440)
- Source engine
- Unturned (304930)
- UnityPlayer 5.5.3f1
- Floating Point (game ID 302380)
-
Install bubblewrap or Flatpak (in Debian, Ubuntu or SteamOS:
sudo apt-get install bubblewrap
). pressure-vessel bundles its own fallback copy of bubblewrap, but that one will only work on kernels that are configured to allow unprivileged user namespaces, such as recent Ubuntu and Fedora (but not, for example, Debian, Arch Linux or Red Hat Enterprise Linux unless specially configured). -
Install Python 3, PyGI and GTK 3 introspection data (in Debian, Ubuntu or SteamOS:
sudo apt-get install python3-gi gir1.2-gtk-3.0
). This is not necessary for production use but is very convenient when testing interactively. -
Unpack
pressure-vessel-
VERSION-bin.tar.gz
(or...-bin+src.tar.gz
) in some convenient place, for example~/.steam/steam/steamapps/common/SteamLinuxRuntime/pressure-vessel
:$ rm -fr ~/.steam/steam/steamapps/common/SteamLinuxRuntime/pressure-vessel $ mkdir -p ~/.steam/steam/steamapps/common/SteamLinuxRuntime/pressure-vessel $ tar \ --strip-components=1 \ -C ~/.steam/steam/steamapps/common/SteamLinuxRuntime/pressure-vessel \ -xzvf ~/pressure-vessel-*-bin.tar.gz
-
Put some Flatpak-style runtimes alongside pressure-vessel, for example
~/.steam/steam/steamapps/common/SteamLinuxRuntime/scout
, so that you have a~/.steam/steam/steamapps/common/SteamLinuxRuntime/scout/files/
directory and a~/.steam/steam/steamapps/common/SteamLinuxRuntime/scout/metadata
file. For example, download acom.valvesoftware.SteamRuntime.Platform-amd64,i386-scout-runtime.tar.gz
from http://repo.steampowered.com/steamrt/steamrt-scout/snapshots/ and unpack it like this:$ rm -fr ~/.steam/steam/steamapps/common/SteamLinuxRuntime/scout $ mkdir -p ~/.steam/steam/steamapps/common/SteamLinuxRuntime/scout $ tar \ -C ~/.steam/steam/steamapps/common/SteamLinuxRuntime/scout \ -xzvf ~/com.valvesoftware.SteamRuntime.Platform-amd64,i386-scout-runtime.tar.gz
Or to have a SDK environment with more debugging tools, and optionally detached debugging symbols, download a
com.valvesoftware.SteamRuntime.Platform-amd64,i386-scout-runtime.tar.gz
and optionally a matchingcom.valvesoftware.SteamRuntime.Platform-amd64,i386-scout-debug.tar.gz
, and unpack them like this:$ rm -fr ~/.steam/steam/steamapps/common/SteamLinuxRuntime/scout_sdk $ mkdir -p ~/.steam/steam/steamapps/common/SteamLinuxRuntime/scout_sdk $ tar \ -C ~/.steam/steam/steamapps/common/SteamLinuxRuntime/scout_sdk \ -xzvf ~/com.valvesoftware.SteamRuntime.Sdk-amd64,i386-scout-runtime.tar.gz $ tar --strip-components=1 \ -C ~/.steam/steam/steamapps/common/SteamLinuxRuntime/scout_sdk/files/lib/debug/ \ -xzvf ~/com.valvesoftware.SteamRuntime.Sdk-amd64,i386-scout-debug.tar.gz
Or if you have a
chroot
environment with extra packages installed, such as the/var/chroots/steamrt_scout_amd64
generated bysetup_chroot.sh
or an unpacked copy ofcom.valvesoftware.SteamRuntime.Sdk-amd64,i386-scout-sysroot.tar.gz
, you can use that by makingfiles
a symbolic link to it:$ rm -fr ~/.steam/root/common/SteamLinuxRuntime/scout-chroot $ mkdir -p ~/.steam/root/common/SteamLinuxRuntime/scout-chroot $ ln -s /var/chroots/steamrt_scout_amd64 \ ~/.steam/root/common/SteamLinuxRuntime/scout-chroot/files
Note that to use a
chroot
in this way, it must have at leastlibc6:amd64
andlibc6:i386
installed.pressure-vessel
does not currently support containers that do not have both word-sizes. -
Launch a game once without pressure-vessel
-
Configure the launch options for the chosen game. Either use the Steam (non-Big-Picture) UI, for example by logging in as the
desktop
user on SteamOS, or:-
be the Steam user, possibly via sudo -u steam -s
-
$ nano ~/.steam/steam/userdata/[0-9]*/config/localconfig.vdf
-
navigate to UserLocalConfigStore/Software/Valve/Steam/Apps/game ID
-
below LastPlayed, add:
"LaunchOptions" "~/.steam/steam/steamapps/common/SteamLinuxRuntime/pressure-vessel/bin/pressure-vessel-unruntime-test-ui -- %command%"
-
restart Steam (on SteamOS use
sudo systemctl restart lightdm
)- TODO: Is there a scriptable way to make Steam edit
localconfig.vdf
itself, or to make it reload an editedlocalconfig.vdf
?
- TODO: Is there a scriptable way to make Steam edit
-
-
Run the game. If successful, you will get a GUI launcher that lists possible runtimes. Choose one and click Run. You should get a game.
pstree -pa
will look something like this:|-SteamChildMonit,13109 | `-sh,13110 -c... | `-bwrap,13132 --new-session --setenv LD_LIBRARY_PATH... | `-Floating Point.,13133
-
The test UI automatically looks for runtimes in the following locations:
- Next to pressure-vessel's
bin
andlib
directories - The directory above pressure-vessel's
bin
andlib
directories
Runtimes intended for the test UI must have a
files
subdirectory, like Flatpak runtimes.You can also choose to use the host system
/usr
directly. - Next to pressure-vessel's
-
For a more production-ready version without the test UI, set the launch options to:
"LaunchOptions" "~/.steam/steam/steamapps/common/SteamLinuxRuntime/pressure-vessel/bin/pressure-vessel-unruntime-scout -- %command%"
This mode does not require Python 3, PyGI, GTK or a normal window manager, and is probably more suitable for Big Picture mode. It assumes this directory layout:
SteamLinuxRuntime \- pressure-vessel \- bin \- pressure-vessel-unruntime-scout (etc.) \- scout \- files \- metadata
Or for more flexibility, use
"LaunchOptions" "~/.steam/steam/steamapps/common/SteamLinuxRuntime/pressure-vessel/bin/pressure-vessel-unruntime -- %command%"
and then add more options just before the
--
as desired. This mode does not require Python 3, PyGI, GTK or a normal window manager, and is probably more suitable for Big Picture mode. -
The default runtime for
pressure-vessel-unruntime
is the host system, with theLD_LIBRARY_PATH
Steam Runtime overlaid onto it. You can specify a runtime with the--runtime
option:pressure-vessel-unruntime-scout
is just a shortcut for usingpressure-vessel-unruntime --runtime DIR/../../scout/files
where DIR is the directory containingpressure-vessel-unruntime-scout
itself.The runtime can be any of these:
-
The
files
subdirectory of a Flatpak-style runtime such as~/.steam/steam/steamapps/common/SteamLinuxRuntime/scout
or~/.local/share/flatpak/runtime/com.valvesoftware.SteamRuntime.Platform/x86_64/scout/active
, for example produced by [flatdeb][] (this is a special case of a merged/usr
). For example, you could use:/opt/pressure-vessel/bin/pressure-vessel-unruntime --runtime=$HOME/.steam/steam/steamapps/common/SteamLinuxRuntime/scout -- %command%
or:
/opt/pressure-vessel/bin/pressure-vessel-unruntime --runtime=$HOME/.local/share/flatpak/runtime/com.valvesoftware.SteamRuntime.Platform/x86_64/scout/active -- %command%
-
A merged
/usr
containingbin/bash
,lib/ld-linux.so.2
,bin/env
,share/locale
,lib/python2.7
and so on -
A sysroot containing
bin/bash
,lib/ld-linux.so.2
,usr/bin/env
,usr/share/locale
,usr/lib/python2.7
and so on, optionally withbin
,lib
etc. being symlinks intousr
. For example, if you have a chroot in/var/chroots/steamrt_scout_amd64
generated bysetup_chroot.sh
, you could use:/opt/pressure-vessel/bin/pressure-vessel-unruntime --runtime=/var/chroots/steamrt_scout_amd64 -- %command%
-