feedBack/.specify/memory/constitution.md

# Slopsmith Constitution

> Slopsmith is a self-hosted, single-user web app for browsing, playing, and
> practicing interactive music notation, built around its own open `.sloppak`
> chart format (charts imported from Guitar Pro / MusicXML or authored in the
> built-in editor). This constitution captures the non-negotiable principles
> that govern its core (`server.py`, `lib/`, `static/`) and that all in-tree
> plugins (`plugins/<name>/`) inherit by default. It is a *retrospective*
> document — the codebase came first, the principles below were distilled from
> `CLAUDE.md`, `README.md`, and the shape of the existing implementation.

## Core Principles

### I. Self-Hosted, Single-User, Docker-First

Slopsmith targets one user running one container against a personal
song library folder. There is no multi-tenant model, no
authentication, no rate limiting, and no shared backend. Deployment is
expressed as a single `docker compose up -d` against the bundled
`Dockerfile`; everything required (vgmstream, FFmpeg, FluidSynth,
Python) is baked into the image so the host machine needs
only Docker. Native (non-Docker) launch is supported for development
but not the primary supported path.

**Non-negotiable rules**

- Do not introduce a user/account model, multi-tenant data partitioning,
  or auth middleware. All endpoints assume one trusted local user.
- New runtime dependencies (binaries, Python modules) must be installable
  inside the existing `Dockerfile`. If something cannot run in the
  container, it does not ship in core.
- `DLC_DIR` and `CONFIG_DIR` are the only required configuration inputs.
  Adding a new mandatory path/env var is a constitutional change.

### II. Vanilla Frontend — No Frameworks

The frontend (`static/app.js`, `static/highway.js`, `static/index.html`,
`static/style.css`) is plain JavaScript with the `fetch` API, direct DOM
manipulation, and the Canvas 2D / WebGL2 APIs. The only style framework
is Tailwind CSS, served as a prebuilt static stylesheet
(`static/tailwind.min.css`, regenerated by `scripts/build-tailwind.sh`)
— never the runtime Play CDN, whose on-the-fly JIT rescans the DOM on
the main thread and caused sustained frame drops with the 3D highway
(slopsmith-desktop#110). No React, Vue, Svelte, bundler, transpiler, or
TypeScript appears in the core static tree, and no build step runs on
the serve path: the Tailwind build is a maintainer-only one-shot whose
output is committed, so Docker / desktop / end users never build. New
features extend `app.js` and the existing globals (`window.playSong`,
`window.showScreen`, `window.createHighway`, `window.slopsmith`).

**Non-negotiable rules**

- Do not introduce a frontend framework, JSX, or a JS build pipeline in
  core. Plugins MAY ship their own bundled assets but core MUST remain
  source-served.
- Because the core Tailwind stylesheet is prebuilt, it contains only the
  classes present in core source at build time. Core's committed
  `static/tailwind.min.css` MUST stay in sync with source — CI enforces
  this by rebuilding and diffing. A plugin that uses Tailwind classes
  not guaranteed in core (notably arbitrary values like `w-[37px]`)
  MUST ship its own compiled stylesheet via the `styles` capability,
  built with `corePlugins.preflight = false` so it emits only utilities
  and does not re-apply the base reset core already provides. Plugins
  MUST NOT load the Tailwind Play CDN (or any runtime CSS JIT) — the
  same no-CDN, build-free-at-serve rule that binds core binds plugins.
- New UI state lives in `localStorage` (or a backend endpoint), not in a
  framework store.
- Naming: camelCase JS, kebab-case CSS, snake_case plugin IDs. Player
  layout invariants (`#player` flex-column, `#highway` flex:1,
  `#player-controls` at the bottom) MUST be preserved.

### III. Plugins Are the Extension Point — Isolated by `load_sibling`

Functionality that is not part of the irreducible "browse + play charts"
loop ships as a plugin under `plugins/<name>/`, not as core code. Each
plugin is its own directory (typically a separate git repo), discovered
at startup via `plugin.json`, and free to add nav links, screens,
settings panels, and `/api/plugins/<id>/...` routes. Plugins MUST
isolate their backend Python imports via `context["load_sibling"]` so
two plugins shipping a generic `extractor.py` / `util.py` / `client.py`
do not collide in `sys.modules`.

**Non-negotiable rules**

- Generic features (practice journal, setlist, metronome, tone player,
  tab view, MIDI control, stem mixing, editors, etc.) belong in a plugin
  repo, not in `lib/` or `server.py`.
- Plugin backend modules MUST use `context["load_sibling"]("name")` for
  sibling imports. Bare `import sibling` works during transition but
  triggers a startup warning when a name collides.
- Plugins MUST register routes under `/api/plugins/<plugin_id>/...`,
  use `window.slopsmith.emit/on` for cross-plugin communication, and
  prefix their `localStorage` keys with their plugin id.
- Plugins inherit this constitution and may layer additional rules in
  their own `CLAUDE.md`, but MUST NOT relax core principles (e.g. a
  plugin cannot require a frontend framework in core).

### IV. Backwards-Compatible Chart Library

The whole point of Slopsmith is that a user points it at an existing
song library folder and it Just Works. The library is scanned and
indexed in `meta.db` (SQLite via `MetadataDB`). The open Sloppak
format (`lib/sloppak.py`, `docs/sloppak-spec.md`) is the preferred
format and the home for new features; loose-folder XML charts
(`lib/loosefolder.py`) are also discovered and played as a first-class
format. Both must keep playing across releases.

**Non-negotiable rules**

- Never modify, move, or delete files inside the user's library folder
  without an explicit user-initiated action (retune, edit metadata).
- A library scan MUST be non-blocking: the user can browse already-
  scanned songs while import continues. Scans MUST tolerate corrupt or
  partial files without aborting the batch.
- Schema migrations on `meta.db` MUST be additive and idempotent;
  unrecognized columns from a newer build MUST not crash an older one.
- Existing arrangement IDs, sloppak manifests, and the highway
  WebSocket message shape are stable contracts. Breaking changes
  require a CHANGELOG entry under "Migration notes".

### V. Pure-Function Core Libraries, Tested

The shared Python in `lib/` (`song.py`, `tunings.py`, `sloppak.py`,
`loosefolder.py`, `gp2rs.py`, `gp2midi.py`, `retune.py`, etc.) is written
as flat-importable, side-effect-light modules — no `__init__.py`
package, no implicit IO at import time, no global mutable state beyond
the explicit `MetadataDB` and config singletons in `server.py`. The
pytest suite under `tests/` covers pure-function helpers (note/tempo/
tick math, tuning lookups, song wire format) and runs in CI on every
push and PR to `main` against Python 3.12.

**Non-negotiable rules**

- New `lib/` modules MUST be importable with `from <module> import X`
  (flat imports, `pyproject.toml` sets `pythonpath = [".", "lib"]`).
- Pure helpers added to `lib/` SHOULD ship with pytest coverage in
  `tests/test_<module>.py`. Network/filesystem-heavy code is exempt
  but should be split so the pure parts are testable.
- CI MUST stay green on `main`. A failing test on `main` is a P0.

### VI. Observability Over Chattiness

All backend output goes through the stdlib `logging` pipeline configured
by `lib/logging_setup.py`, controlled by `LOG_LEVEL` / `LOG_FORMAT` /
`LOG_FILE`. Plugins receive a pre-configured `context["log"]` namespaced
to `slopsmith.plugin.<id>` and MUST use it instead of `print`. HTTP
responses carry a `X-Request-ID` header from `CorrelationIdMiddleware`
and the same id appears as `request_id` in JSON log lines. The
"Settings → Export Diagnostics" bundle (`lib/diagnostics_bundle.py`)
collects logs, hardware, plugin inventory, browser console, and per-
plugin contributed diagnostics into a single redacted zip.

**Non-negotiable rules**

- New backend code MUST use `logging.getLogger(...)` (or the plugin
  `context["log"]`). `print()` and `traceback.print_exc()` are legacy
  and being migrated; do not add new ones.
- Diagnostic redaction is on by default. Anything that ships in the
  bundle (DLC paths, song filenames, IPs, bearer tokens) MUST be
  redacted via `lib/diagnostics_redact.py` rules before export.
- Plugins that contribute diagnostics MUST embed a versioned
  `schema` field (e.g. `"my_plugin.diag.v1"`) and keep payloads
  under 100 KB. Diagnostics is not a backup channel — that is
  `settings.server_files`.

### VII. Versioned, Migration-Aware Settings

User configuration lives in two places: server-side under `CONFIG_DIR`
(SQLite `meta.db`, `config.yaml`, plugin opted-in files) and client-
side in browser `localStorage`. Both can be exported and re-imported
as a single bundle (`POST /api/settings/import`,
`GET /api/settings/export`, slopsmith#113). Import is two-phase:
phase-1 validates the entire bundle (schema, paths, encoding) and
phase-2 commits each file atomically via temp+rename. Plugins opt
their server-side files into the bundle via
`settings.server_files` in `plugin.json` (relpaths under `CONFIG_DIR`,
no `..`, no absolute paths).

**Non-negotiable rules**

- Server-side settings imports MUST be all-or-nothing on safety-critical
  failures (path traversal, schema mismatch, decode failure). Plugin
  state mismatches between export and import are recoverable warnings,
  not hard failures.
- Plugins are responsible for their own internal data migration.
  Importing a bundle whose schema predates the running plugin's code
  MUST restore bytes verbatim — the plugin copes at next load.
- The `VERSION` file is the single source of truth for the running
  release; it is auto-bumped from `slopsmith-desktop` releases via
  `.github/workflows/sync-version.yml`. Manual edits are reserved for
  out-of-band recovery only.

## Operating Constraints

- **Concurrency model**: FastAPI + uvicorn, sync handlers for the bulk
  of routes, WebSockets for the highway data stream
  (`/ws/highway/{filename}`) and retune progress (`/ws/retune`).
  `MetadataDB` uses a `threading.Lock`; long-running work (rescan,
  retune, sloppak assembly) is dispatched via background threads or
  separate processes, never inline on the request path.
- **Data flow**:
  `library folder → scan (sloppak.py / loosefolder.py) → MetadataDB (SQLite) →
   /api/library*  → static/app.js → /ws/highway → static/highway.js`.
  Sloppak arrangements are served from `arrangements/<id>.json`.
- **Frontend layout invariants**: `#player` is `display:flex;
  flex-direction:column; position:fixed; inset:0`; `#highway` is
  `flex:1`; `#player-controls` sits at the bottom. Hiding the highway
  collapses the layout — use `margin-top: auto` on controls if you
  need to hide it.
- **Plugin load order**: alphabetical by directory name. The
  `playSong` wrapper chain runs outermost-first (last-loaded wrapper
  runs first). Plugins MUST tolerate dependent globals being absent
  at load time and check at runtime
  (`typeof window.X === 'function'`).

## Development Workflow

- **Branching**: never push directly to `main`. Always feature branch
  + PR. Exception: the automated `VERSION` bump from
  `slopsmith-desktop`'s release job, which commits to `main` as
  `github-actions[bot]`.
- **Reviews**: PRs run the local Codex review loop
  (`feedback_codex_preflight.md`) and the GitHub Copilot review pass
  (`feedback_copilot_review.md`) before being eligible to merge.
  After pushing a fix, the CodeRabbit loop
  (`feedback_coderabbit_review.md`) runs to silence.
- **Testing**: `pytest` for backend (`requirements-test.txt`),
  Playwright for browser interactions (`tests/browser/`), CI runs both
  on every push/PR to `main`.
- **CHANGELOG**: every PR updates `[Unreleased]`. Releases rename
  `[Unreleased]` to `[X.Y.Z] - YYYY-MM-DD` (the VERSION bump itself is
  automated).
- **Plugin gitlinks**: plugins under `plugins/` are typically separate
  git repos. Branch switches on the main repo can clobber plugin
  directories. Use `git update-index --assume-unchanged` and avoid
  `git clean -fd` near `plugins/`.

## Governance

- This constitution governs the core repo (`server.py`, `lib/`,
  `static/`, `tests/`, `.github/`, `Dockerfile`, `docker-compose.yml`).
- Plugins inherit these principles by default. A plugin MAY add
  stricter rules in its own `CLAUDE.md` / `README.md`, but MUST NOT
  weaken a core principle. A plugin requesting a relaxation (e.g.
  shipping its own SQLite DB outside `CONFIG_DIR`) requires an
  explicit constitutional amendment in this file.
- Amendments require: (a) a PR that updates this file alongside the
  code change, (b) an entry in `CHANGELOG.md` under "Migration notes"
  if user-visible, and (c) a corresponding update to `CLAUDE.md` so
  AI agents and humans see the same source of truth.
- The principles are listed in priority order. When two principles
  conflict (e.g. "vanilla frontend" vs. a plugin that wants to ship
  React), the lower-numbered principle wins by default; the
  higher-numbered principle's escape hatch is to live in a plugin
  with its own bundled assets.

**Version**: 1.1.0 | **Ratified**: 2026-05-09 | **Last Amended**: 2026-06-01