Skip to content

Run the deploy job on a systemd node - #40

Merged
vladimirhasko merged 1 commit into
docker_switchfrom
systemd-node
Aug 21, 2026
Merged

Run the deploy job on a systemd node#40
vladimirhasko merged 1 commit into
docker_switchfrom
systemd-node

Conversation

@LukasCuperDT

Copy link
Copy Markdown

Follow-up to #38 and #39.

Provisioning now reaches the application layer (ok=25 changed=14) and fails there:

System has not been booted with systemd as init system (PID 1). Can't operate.
Failed to connect to bus: Host is down

This is not a missing package. cloudmon deploys through systemd:

count
systemd module tasks 68
service module tasks 5
daemon_reload calls 14
*.service.j2 unit templates 15

systemd has to be PID 1, which cannot be arranged after a container starts, so gating those tasks would make the job green while deploying nothing. Instead the job moves to a node that has a real init.

Infra side (opentelekomcloud-infra/system-config): new zuul-debian-systemd label and image — systemd as PID 1, privileged, /sys/fs/cgroup writable (the cluster is cgroup v1), tmpfs on /run. Pinned to the HCE 5.10 nodes, because bookworm's systemd 252 will not run on the CentOS 7 nodes' 3.10 kernel. zuul-debian-docker is untouched, since zuul-infra's smoke test uses it.

This PR: point the nodeset at the new label, and let systemd own containerd/dockerd instead of nohup. Hand-started daemons would collide with the units the cloudmon roles enable. Daemon settings (MTU 1442, bridge: none, iptables: false, cgroupfs driver) move into /etc/docker/daemon.json, seeded by the pod spec. Diagnostics read the journal.

Verified on a probe pod on the cluster before changing the job:

PID 1             : systemd
is-system-running : running
daemon-reload     : OK
unit written at runtime -> enable --now -> active, side effect executed

Provisioning failed once it reached the application layer:

    System has not been booted with systemd as init system (PID 1).
    Can't operate. Failed to connect to bus: Host is down

cloudmon deploys through systemd -- 15 unit templates, 68 systemd tasks and 14
daemon_reload calls -- so the node needs a real init. Switch the nodeset to the
new zuul-debian-systemd label, which runs systemd as PID 1.

With systemd present, let it own containerd and dockerd instead of starting
them with nohup; hand-started daemons would collide with the units the
cloudmon roles enable. The daemon settings now come from /etc/docker/daemon.json
seeded by the pod spec. Diagnostics read the journal instead of the log files
the manual start used to write.

Verified on a probe pod on the cluster: PID 1 is systemd, is-system-running
reports running, daemon-reload succeeds, and a unit written at runtime can be
enabled and started.
@vladimirhasko
vladimirhasko merged commit 4e9eb89 into docker_switch Aug 21, 2026
1 check passed
@vladimirhasko
vladimirhasko deleted the systemd-node branch August 21, 2026 06:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants