LXE

LXE is a shim of the Kubernetes Container Runtime Interface for LXD. This project is currently under heavy development, expect incompatible changes. The name of this project can change - we're open for suggestions - lxe was only an internal codename.

Requirements

You need to have LXD >= 3.3 installed, which packages are officially only available via snap. A LXD built by source is also sufficient.

Installing LXE from packages

There are no official builds right now. Migration of our internal pipeline to a public location in progress.

Installing LXE from source

LXE uses Go Modules so the minimum Go version required is 1.11. Clone this repo to your wished location. If you checked it out within $GOPATH, use GO111MODULE=on with the make commands.

Building

Build this project using the following command, which will give you the binary in ./bin/

make build

Getting started

LXD prerequisites

Please follow these steps carefully. Some parameters and arguments depend on whether you installed lxd by source or via snap.

Make sure that you have LXD running and your default profile only includes the root device and no interfaces, since LXE organizes the networking and so interface names could interfere. Here's an example default profile:

# lxc profile show default
config: {}
description: Default LXD profile
devices:
  root:
    path: /
    pool: default
    type: disk
name: default
used_by: []

Also make sure the LXD-client's remote configuration file exists (e.g. by running lxc list once), you'll need that later.

if you built LXD by source, this file is located in ~/.config/lxc/config.yml (LXE will guess this automatically by default)
if you installed LXD via snap, the file is located in ~/snap/lxd/current/.config/lxc/config.yml
or you wrote that configration file on a location of your choice

LXE might be run as user (* implementation incomplete), so give it access to lxd's socket

Running LXE

Parameters

The most important LXE options are the following:

      --lxd-remote-config string    Path to the LXD remote config (guessed by default)
      --lxd-socket string           LXD's unix socket (default "/var/lib/lxd/unix.socket")
      --socket string               The unix socket under which LXE will expose its service to Kubernetes (default "/var/run/lxe.sock")

You may need to provide the LXD socket path:

if you built LXD by source, the socket is located in /var/lib/lxd/unix.socket (which is also default in LXE)
if you installed LXD via snap, the socket is located in /var/snap/lxd/common/lxd/unix.socket

For all options, consider looking into lxe --help.

Starting the daemon

You might want to use --verbose for some feedback, otherwise the daemon is pretty silent when no errors occur. Warning: --debug is very verbose.

if you built LXD by source, lxe --verbose
if you installed LXD via snap, lxe --lxd-socket /var/snap/lxd/common/lxd/unix.socket --lxd-remote-config ~/snap/lxd/current/.config/lxc/config.yml --verbose

You should be greeted with:

INFO[10-03|19:02:07] Connected to LXD via "/var/lib/lxd/unix.socket" 
INFO[10-03|19:02:07] Starting streaming server on :44124 
INFO[10-03|19:02:07] Started LXE/0.1.21.gc4ee124.dirty CRI shim on UNIX socket "/var/run/lxe.sock"

Configure Kubelet to use LXE

Now that you have LXE running on your system you can define the LXE socket as CRI endpoint in kubelet. You'll have to define the following options --container-runtime=remote and --container-runtime-endpoint=unix:///var/run/lxe.sock and your kubelet should be able to connect to your LXE socket.

Bug reports

Bug reports can be filed at the github issue tracker

Contributing

Contribution guidelines are not yet defined.

Documentation / FAQ

A lot of options are missing and not yet implemented from the Kubernetes PodSpec. Limitations and decisions of the current state are described in the development preview FAQ.

auvipy / lxe

LXE