---
title: VM gitbucket (GitBucket + navi instance pilar)
type: host
ip: 192.168.1.156
purpose: GitBucket git hosting + navi agent instance (pilar, profile navi_code)
owner: gmikcon
status: active
confidence: 100
last_reviewed: 2026-10-28
review_interval: 90d
source_of_truth: ssh-host-and-owner-confirmed
---

# VM gitbucket (GitBucket + navi instance pilar)

## Overview

KVM/QEMU VM on `hp-proliant-dl380-g6` (192.168.1.130). Primary role: GitBucket
git hosting (see [applications/gitbucket.md](../applications/gitbucket.md)).
Since 2026-09-19 the VM also hosts the navi-1 agent instance **pilar**
(profile `navi_code`), deployed by navi (rei) from the `deploy` branch.

## Technical Details

- **IP:** 192.168.1.156
- **OS:** Ubuntu 18.04.6 LTS (Bionic Beaver), kernel 4.15.0-213-generic
- **Users:** `gitbucket` (service owner, home = /home/ubuntu), `navi` (navi instance, home = /home/navi), `ubuntu` (admin; SSH/sudo credentials — see gnexus-creds secret `bserv@192.168.1.130`)
- **Resources:** 4 vCPU, 8 GiB RAM, 100G raw disk `/mnt/main/vm_main/gitbucket` (p1 root 28G — 21% used; p5 data 71G — 6% used; observed 2026-09-19)
- **Hypervisor storage:** /mnt/main 2.5T, 730G free (69%)

## Navi instance pilar (deployed 2026-09-19)

- **Instance name:** pilar
- **Instance ID:** c6962c3e-… (full value in /home/navi/navi-1/instance.json)
- **Repo:** /home/navi/navi-1 (branch `deploy`, commit e276b1e)
- **Service:** navi.service (systemd, enabled, Restart=always)
- **Server port:** 8099 (0.0.0.0), health endpoint http://127.0.0.1:8099/health
- **Postgres:** docker container `navi-postgres` (pgvector/pgvector:pg16) on **127.0.0.1:5433** — port shifted from the default 5432 because GitBucket's system PostgreSQL 10 occupies 5432; DATABASE_URL in .env points to 5433
- **Python:** standalone CPython 3.12.14 at /home/navi/navi-1/.python/ (system python 3.6 is too old)
- **Swarm:** .swarm-key copied from the hive host (rei, 192.168.1.168); HIVE_URL=http://192.168.1.168:8087; hive.announce_ok confirmed in journalctl; visible in `peer list` as `pilar — 192.168.1.156:8099 [online]`
- **Ollama backend:** OLLAMA_HOST=https://ollama.com, model glm-5.3-flash:cloud; Ollama Cloud credential configured in .env (value stored in gnexus-creds secret "Ollama Cloud API key (navi swarm)")
- **Webclient/auth:** NAVI_WEBCLIENT_ENABLED=false, NAVI_AUTH_ENABLED=false (default deploy shape)
- **Deploy notes:**
  - docker-ce 24.0.2 + docker-compose-plugin v2.18.1 installed from download.docker.com (bionic repo); git/curl installed via apt
  - asyncpg 0.29.0 has no wheel for glibc 2.27 and clang is absent — built from source with `CC=gcc CXX=g++` before re-running install.sh (script is idempotent)
  - user `navi` has NOPASSWD sudoers (/etc/sudoers.d/navi) so install.sh's internal sudo works over non-interactive SSH; the `navi` user password matches the hypervisor bserv credential (gnexus-creds)
- **Known non-critical:** /health embed.ok=false (embed backend 401) — same as other swarm instances

## Known behavior: load_high episodes from archive downloads (class since 2026-10-12)

Diagnosed 2026-10-28 21:33–21:37 UTC by navi rei (panel events #1083–#1097,
GHard server id 44). The 2026-10-28 episode (21:33 UTC, load1 2.1×cores, peak
load1 9.8, java 325% CPU) is the **6th episode of the same class** since
2026-10-12: 12.10 crawler storm, 13.10 spike, 25.10 01:55, 26.10 17:44,
27.10 17:50, 28.10 21:33. Recent episodes: 60–90 s each, self-recovered, no
service restart, GitBucket HTTP 200 throughout.

**Cause:** bursts of `GET /root/<repo>/archive/<path>/<sha>.zip` (and a few
`/raw/...` file downloads) through git.gnexus.space — GitBucket's web-UI
"download directory as ZIP" endpoint. Repos seen: smart-home-server, navi-1,
rpg, gnexus-ui-kit, vmk-ui-kit. Clients abort the download mid-stream
(`EofException` / `Broken pipe` in journalctl, logged as
`RepositoryViewerController - Catch unhandled error`), but GitBucket keeps
building the ZIP server-side — several concurrent archive builds saturate all
4 vCPUs. Baseline between episodes: CPU 10–27%, load1 0.2–1.5.

**Traffic source (attributed in earlier sessions):** requests arrive via the
nginx reverse-proxy VM at **192.168.1.183** (note: inventory entry
"internal-proxy-vps .226" is stale — .226 does not answer SSH/ICMP; actual
proxy is .183). Client seen in nginx access.log: **192.168.1.150** (ovpn VM,
SNAT) with browser UA rotation Chrome 142–145 Win/Mac (27.10); crawler UAs
GPTBot, meta-externalagent, Reflectionbot, ClaudeBot, SemrushBot, MJ12bot
observed in the 25.10 storm. robots.txt is absent (GitBucket returns an HTML
error page for it).

**Triage recipe (next episode):** `journalctl -u gitbucket --since '<start>' |
grep -o 'Request(GET [^)]*)'` — if archive/*.zip bursts are present, it is this
pattern; no restart needed, load decays within ~2 min after the burst ends.
For attribution: nginx access.log on 192.168.1.183 (creds
internal-proxy-vps-creds / bserv@192.168.1.130).

**Not applied (owner decision pending, 6th episode):** rate-limiting or
blocking `/archive/` for bots + robots.txt at the nginx proxy (192.168.1.183),
or a GitBucket plugin/config change. Escalation criterion: bursts ≥2/day or
non-decaying load. Related journals:
workspace/incident_gitbucket_cpu_2026-10-12.md,
workspace/incident_gitbucket_2026-10-25_load_high.md,
workspace/incident_gitbucket_cpu_2026-10-27_crawler_archives.md.

## Access

- SSH: `ubuntu@192.168.1.156`, credentials in gnexus-creds secret `bserv@192.168.1.130`; root SSH denied
- No QEMU guest agent on this VM; disk-level inspection via read-only loop mount on the hypervisor (`losetup -f --show -r -P /mnt/main/vm_main/gitbucket`, then `mount -o ro,noload`)

## Listening ports (TCP, verified 2026-09-19)

- 22 — sshd
- 80 — GitBucket (java, gitbucket.war)
- 5432 — system PostgreSQL 10 (GitBucket DB, localhost only)
- 5433 — navi-postgres docker (localhost only)
- 8099 — navi-server (pilar)

## Notes

- GitBucket java process has been running since Aug 13 with ~2.4G RSS; VM has 8G RAM — navi instance coexists comfortably.
- Do not bind anything else to 5432/5433; both are taken.
