267 lines
22 KiB
Markdown
Executable File
267 lines
22 KiB
Markdown
Executable File
# Архив исходника docs/VIRFIELD-3-PLAN.md
|
||
|
||
Источник: Virfield, commit a1460d3372bdfbb5cb19d633d41dd5d3fb3164e6. Снимок перед релизной очисткой. Исторические утверждения ниже относятся к моменту исходной записи; актуальное состояние — в [[personal/projects/virfield]].
|
||
|
||
````markdown
|
||
# Virfield 3.0 implementation plan
|
||
|
||
Reconciled 2026-10-16 against source, installed receipts and live API. This is the
|
||
maintained checklist. [Verification](VERIFICATION.md) owns test evidence and
|
||
release acceptance; [Operations](OPERATIONS.md) owns deployed commands.
|
||
The candidate branch is `codex/retire-lume-release-hardening`; `main` has not been
|
||
promoted. `8bfff9f` / `0.0.0-acceptance-runbooks` is installed and pushed with schema 10;
|
||
nine baseline images are preserved. The corrected transfer and both full iPad
|
||
Monterey cycles passed. The earlier ASIF zero-size cache
|
||
correction passed a fresh factory/two clone live proof. Documentation
|
||
commits do not install binaries or update an already-running MCP process.
|
||
The deployed VM/MCP/production Broker acceptance passed within
|
||
[Verification](VERIFICATION.md)'s explicit scope. The wider3.0 architecture and
|
||
untested paths below remain separate.
|
||
|
||
## Decisions and current boundary
|
||
|
||
- Keep the standard VM account **`admin` / `admin`**. The operator explicitly
|
||
rejected automatic random account-password rotation on 2026-10-15. Removing it
|
||
is implemented and installed in `0f8bc20`; Samsung Monterey passed two full
|
||
cycles. Full standard-policy native cycles are now recorded for both Monterey
|
||
inventories, macOS 27, HTPC Sonoma and Sequoia. New identities use the
|
||
configured account name as the password.
|
||
An already-standard account is authenticated without password change. Legacy
|
||
image credentials/goldens stay intact; only a new disposable clone converts
|
||
its known inherited account password once, then verifies authentication and
|
||
migrates the keychain without discarding items. Unknown keychain credentials
|
||
still fail readiness; there is no reset/replacement fallback.
|
||
- Retain separate management/caller SSH keys, fresh VM host keys, host pinning,
|
||
inherited/cross-lease key rejection and key-only SSH. A standard console
|
||
password does not replace these checks. Physical shared accounts are unchanged.
|
||
- Preserve existing login-keychain items, workspace, goldens, keys, configuration
|
||
and signing/FDA identity. Define an inspected, journaled compatibility path for
|
||
previously rotated images; never silently reset a keychain or overwrite a
|
||
golden to make a gate pass.
|
||
- Lume runtime/factory/wrapper/build/install paths are removed. The separate old
|
||
service is disabled/unloaded; rollback files remain. No Lume reimplementation
|
||
is planned.
|
||
- Run CI locally; push only the working branch with `[skip ci]`. Do not merge
|
||
`main`, publish a release or change foreign resources. Inspect unknown outcomes
|
||
before replay; use durable keys and exact owned fixtures for authorized cleanup.
|
||
|
||
## Work order
|
||
|
||
| Order | Work | Current state | Completion evidence |
|
||
|---|---|---|---|
|
||
| 1 | Remove automatic account-password rotation | Installed; both Monterey inventories, new macOS 27 and HTPC Sonoma/Sequoia full cycles passed | Tests and installed image/lease/reboot cycles retain `admin/admin`; SSH isolation and native GUI/new SSH key storage still pass; old-image handling preserves data |
|
||
| 2 | Resolve current macOS 27 keychain and HTPC reboot failures | New macOS27 golden cycles passed. Earlier Sequoia reboot failed with a symbolicated guest-kernel snapshot/debugger stall; trigger unproven. Later4/4 matrix and targeted2,002-stackshot/reboot diagnostic passed; failed fixture recovered/exported/released without CPU/NVRAM changes | Bounded diagnosis, targeted correction and fresh full cycles on the exact installed candidate; no repeated unchanged VM/reboot attempts treated as a fix |
|
||
| 3 | Package and accept the corrected guest policy | 8bfff9f installed; Samsung/new macOS27/factory and transferred Monterey cycles passed; corrected cold-probe policy passed fresh concurrent Sequoia 2/2 and sequential Sonoma 2/2, all released | Clean exact-source local CI/security/archive checks; idle-pool install with private backup; Tart macOS 27 and both Monterey inventories plus HTPC Sonoma/Sequoia native GUI/new SSH, actual reboot/new UUID, 1920×1080, workload/artifact/RFB/release/revocation |
|
||
| 4 | Close client and production entrypoint acceptance | Actual owning MCP20/four exact runbooks/full VM native-reboot-Swift-artifact/release passed; default Broker script-only passed; fresh OAuth complete; production Story12f0932 independently passed real reviewer os.open/EPERM, quality and independent tests, hashes, exact two-file local commit, credential settlement and worker release; checked deny policy and no-tempfile probe preserve the actual saved owner plan | Actual connected clients serve current version/all four runbooks and complete their workflows; production Broker qualification/Story, independent tests, explicit denied-write and artifacts/settlement/cleanup |
|
||
| 5 | Implement the five operator feedback items below | 8bfff9f installed with schema10; nine baseline images/config/keys preserved; F1 recovery, F2 durable diagnostics, F3 arithmetic/refusal/Tart dispatch wait-resume/node one-byte cache cap, F4 sparse transfer and F5 factory/worker all have live receipts | Each item's tests, live evidence and updated runbooks |
|
||
| 6 | Complete remaining hardening/debug/DR gates | Debugserver listener correction installed; actual installed generated LLDB-DAP passed. Full off-host disk/config/NVRAM restore and cleanup passed. Complete signed package rollback466/forward8 passed with native/Swift/artifact/release on each side | Agreed scope below accepted separately; no promotion based solely on unit tests or another OS/version |
|
||
|
||
The full current-candidate acceptance, verification and branch push precede general
|
||
follow-up delivery. A narrowly needed dependency, such as verified storage
|
||
transfer for the iPad repeat, may be implemented earlier and must get its own
|
||
acceptance. The latest instruction requires documenting all five items now.
|
||
|
||
## Current evidence and open defects
|
||
|
||
| Area | Verified state as of 2026-10-16 |
|
||
|---|---|
|
||
| Service/install | `8bfff9f` installed/pushed; approved Background → Standard migration retained; signing identity/config/keys/nine baseline manifests preserved; schema 10 with private schema8/7 migration snapshots verified; exact installed HTTP/fresh stdio20/four-runbook checks passed |
|
||
| Native Apple browser | Installed layout, Safari URL handoff and real Apple sign-in page passed using a synthetic link; no account login or authenticated download completion tested; Mach-O minimum 13 verified, no live macOS 13 host test |
|
||
| HTPC Sequoia | Fresh corrected `466dbb8` concurrent 2/2 full native/reboot/workload/artifact/RFB/isolation/release cycles passed, including original-overlay F1 recovery within the original deadline. Earlier stalled kernel's snapshot/debugger path was symbolicated; original triggering fault remains unproven |
|
||
| HTPC Sonoma | Fresh `466dbb8` standard-policy full native/reboot/workload/artifact/RFB/cross-key/release/revocation passed 2/2; all workers released. The historical 1,200-second reboot stall cause remains unproven |
|
||
| macOS 27 | New exact UI-test golden passed two full worker cycles and production default script-only XCTest after the approved route switch. Full production Codex Story independently passed after the separate Broker reviewer-policy/probe correction. Old golden remains preserved; its historical copy-auth failure cause is unproven |
|
||
| Samsung Monterey | Two complete `0f8bc20` standard-password/native/reboot/Xcode 13.4.1/Swift/workspace/artifact/release cycles passed |
|
||
| iPad Monterey | `a45655f` verified local transfer plus two full standard-account/native/reboot/Xcode 13.4.1/Swift/workspace/artifact/RFB/release cycles passed; unchanged source and original eight manifests verified; macOS 12.7.6 |
|
||
| Factory/private GHCR | Complete fresh public-base factory → private portable push → pull → clone workload → cleanup passed on `2f23ae6`; preserve receipt, repeat only for relevant pipeline changes; no managed golden uploaded |
|
||
| Restore/rollback | Controller-state restore, full off-host disk/config/NVRAM restore, authorized cleanup and full signed CLI/daemon/MCP/Browser package rollback466/forward8 passed |
|
||
| Actual owning MCP | User Restart replaced the stale connection. Actual connected20/four exact packaged8 runbooks, acquire/replay/job/lease/tunnels, native/reboot/Swift/artifact and release/revocation passed |
|
||
| Existing HTPC file modes | Optional owner-only permission proposal unapproved; files unchanged; not required for VM functionality and not a keychain/reboot fix |
|
||
|
||
The new `0f8bc20` existing macOS 27 clone still fails login copy-auth and was
|
||
released. Fresh same-pinned security-v1 and exact UI-test goldens passed native
|
||
post-reboot qualification; worker acceptance exposed cached ASIF disk size zero
|
||
versus a fresh CLI 140 GB. The red/green-tested cache correction is installed and passed a fresh factory
|
||
with observed zero-to-140-GB recovery without daemon restart plus two full clones.
|
||
The new exact UI-test golden passed two full worker cycles and production
|
||
Broker/Prism script-only XCTest both by explicit per-run `image_id` and, after
|
||
the operator-approved idle route switch, through default `macos27`. The old
|
||
golden and all eight image manifests remain preserved. Full Codex
|
||
Story subsequently passed independent acceptance on run12f0932 after correcting
|
||
Python bytecode replay, reviewer ACP auto-grants and a heredoc-only evidence gap.
|
||
Actual reviewer tool output confirms os.open/EPERM; all four tests, exported
|
||
hashes, saved owner plan, credentials and worker cleanup were independently
|
||
verified. The reviewed Broker source patch/audit is retained in this branch;
|
||
its separate Broker source branch remains local. See Verification. `a1a6bd9` and `cab85c5` are pushed under explicit
|
||
session-wide working-branch authorization.
|
||
The new HTPC Sequoia attempt failed because an unrelated speech-dispatcher log
|
||
filled `/run/user/1000`, preventing Podman metadata writes despite free HDD space.
|
||
Its exact inspected partial clone was resolved/released. The operator then
|
||
approved a same-node HDD backup, SHA-256 verification and truncation of only that
|
||
log: 3,357,126,656 bytes preserved, 3.36 GB of runroot freed. Subsequent growth
|
||
was diagnosed: Speech Dispatcher 0.12.1 dumps voice-list entries at log level 1;
|
||
99.9% of the inspected file was that dump. On 2026-10-16 the operator explicitly
|
||
requested the fix and deletion including the backup. A private user config
|
||
changes only LogLevel to 0 and LogDir to persistent user state; three default
|
||
autospawn/module/idle-exit cycles left new logs at zero bytes. The old log and
|
||
backup (3,512,962,733 bytes total) were deleted after inode/owner/open-FD checks.
|
||
Fresh standard-policy Sequoia and Sonoma each passed 2/2 full cycles. The first
|
||
F4 transfer on installed `3d667d2` expanded physical disk allocation from 44.8 GB
|
||
to 106.4 GB; its owned copy was removed with a durable image-delete job.
|
||
The installed `a45655f` correction preserves sparse allocation (44.79 GB), full
|
||
hashes, source and identity; two complete native/reboot/workload cycles passed.
|
||
Actual owning MCP and full production Story acceptance passed, including
|
||
independent syscall/test/artifact/settlement/cleanup checks. See Verification.
|
||
|
||
Older successful Tart/macOS 27/HTPC matrices remain dated evidence, not proof that
|
||
these newer failures are fixed. Exact receipts and diagnostic boundaries are in
|
||
[Verification](VERIFICATION.md).
|
||
|
||
## Operator feedback backlog
|
||
|
||
All five items were explicitly requested on 2026-10-15. Implementation and live
|
||
acceptance are tracked separately in each item below. Order follows recovery/diagnosis, resource
|
||
explanation, image portability and optional toolchain support.
|
||
|
||
### F1 — recover a drifted lease without deleting its VM
|
||
|
||
The F1 source candidate implements durable `lease_revalidate`, HTTP/CLI and
|
||
`vm_revalidate` (20th MCP tool). Original caller-key proof binds the lease, exact
|
||
VM name and stable request key without transferring the private key. Read-only
|
||
checks verify fresh runtime/image provenance, management authentication, pinned
|
||
SSH, server acceptance of the existing caller key, account/key policy, OS/SIP and
|
||
unlocked desktop. Tart hardware identity and node overlay device/inode detect
|
||
same-name replacements. No preparation, credentials, workspace or deadline change
|
||
is allowed; a different address is accepted only after these checks. Final review
|
||
also reproduced/fixed fresh identity reads releasing an active transfer's POSIX
|
||
lock; reads now share its mutex and remain unknown while that lock is held.
|
||
|
||
Affected race/SSH-server tests pass for lost replies, owner isolation, restarts
|
||
under the original deadline, replacements, missing credentials, unchanged files,
|
||
expiry/callback races and same-endpoint tunnel revocation. Schema 9 protects the
|
||
new job kind from older executors and snapshots schema 8 privately before upgrade.
|
||
Legacy leases lacking a verified runtime baseline and physical hosts fail safely.
|
||
Installed since256d18f. Actual Tart and HTPC original-overlay stop/start,
|
||
checksum/key/workspace/expiry preservation, caller-proof/idempotent revalidation,
|
||
native GUI/SSH and subsequent official cleanup passed. F1 recovery does not
|
||
establish that the separate guest-initiated Sequoia reboot failure is fixed.
|
||
|
||
### F2 — retain drift and tunnel-close diagnostics
|
||
|
||
The F2 source candidate persists typed expected/observed snapshots atomically
|
||
before drift clears addresses. Separate bounded listener/stream events record
|
||
pause/resume and explicit close/release/expiry/endpoint change/shutdown/upstream
|
||
I/O; known errno/context causes and original error fingerprints are safe to
|
||
export. Tests cover restart, cleanup persistence, privacy and normal EOF versus
|
||
actual upstream reset. `89344ef` passed full local CI, final affected race/security,
|
||
archive and fresh stdio/runbook checks and is pushed. Installed since256d18f;
|
||
actual inventory failure/tunnel pause/resume/established-stream retention,
|
||
release and daemon-restart persistence passed on e80c194.
|
||
The historical Monterey drift's exact cause is still unknown.
|
||
|
||
Persist bounded expected/observed identity, IP, SSH port, state, observation time
|
||
and original backend error before transition. Record listener pause/resume/close
|
||
and stream termination separately, including explicit close, release, expiry,
|
||
verified drift, daemon shutdown and upstream I/O failure. Expose safe reasons in
|
||
API/events/help; private detail must omit credentials, desktop URLs and payloads
|
||
and survive owned-fixture cleanup. Test each cause and restart persistence. Never
|
||
invent a historical cause from later screenshots or successful SSH.
|
||
|
||
### F3 — explain resource admission arithmetic
|
||
|
||
The F3 source candidate now shares quota evaluation between controller admission
|
||
and fresh node rechecks, exposes structured estimates/refusals to status/CLI/MCP
|
||
and shows the selected estimate in Console. Overlay/golden device observations,
|
||
one-byte boundaries, cache, fallback, overflow and same-lease wait/resume tests
|
||
are included. `a2aab20` passed full local CI, affected race/security, archive and
|
||
fresh stdio MCP/runbook checks and is pushed. Installed since256d18f;
|
||
HTTP/CLI/MCP structured refusal during a real build passed. On466dbb8,
|
||
real external Tart CPU/full-disk load forced pre-clone wait; the original
|
||
job/key/deadline/TTL resumed unchanged after load removal. A real node-cache
|
||
limit exactly one byte below observed cache plus requested full image refused
|
||
before job/clone; original configuration and all nine images were preserved.
|
||
Fresh node post-wake failure injection is a separate unaccepted scenario.
|
||
|
||
Return and display the admission snapshot per host/storage: observed free,
|
||
already reserved growth, requested full potential size, safety reserve, remaining
|
||
headroom and failed constraint, using exact bytes plus explicit GB/GiB units.
|
||
Cover CPU/RAM, overlay/golden storage and image-cache limits; unknown metrics
|
||
must identify what is unavailable. Keep admission/recheck calculations consistent.
|
||
The reported historical 251 GB is not enough to establish that rejection's cause
|
||
without its contemporaneous reservations and storage selection. Test boundaries,
|
||
multiple destinations, concurrent reservations and CLI/MCP/Console explanations;
|
||
do not lower reserves to make a workload fit.
|
||
|
||
### F4 — transfer a verified golden between local storages
|
||
|
||
Current Tart acquire refuses cross-container clones before reservation. Registry
|
||
pull/publication is not a local managed-golden transfer and must not upload one.
|
||
The operator had to rebuild Monterey/Xcode in another container (~39 minutes).
|
||
|
||
The first implementation failed acceptance: actual copy expanded
|
||
44.8 GB allocated data to 106.4 GB. The owned failed-acceptance copy was removed
|
||
through its durable image-delete job, preserving the source and eight baseline
|
||
images. A source correction restores real holes before hash verification and
|
||
passes a genuine APFS red/green allocation regression. Corrected `a45655f` is
|
||
installed and accepted by actual transfer, full source/destination hashes and
|
||
two native/reboot/Xcode/workload/release cycles. The source and eight baseline
|
||
goldens are preserved; the accepted new copy is retained. The explicit journaled copy/transfer uses a new destination/name, preserving the
|
||
source by default. Check full destination capacity and source-not-in-use rules;
|
||
preserve image/recipe provenance, OS/build/security/toolchain verification and
|
||
private identity mapping. Verify copied contents/hashes and destination runtime
|
||
identity before atomic registration; invalidate or repeat verification if an
|
||
invariant changes. Keep partial copies quarantined and handle interruption/replay
|
||
without overwriting a target. Any source deletion is separately authorized.
|
||
Accept with an actual Monterey/Xcode transfer, fresh native/reboot/workload lease,
|
||
artifact hash, cleanup and unchanged source; this can unblock iPad storage.
|
||
|
||
### F5 — optional legacy iOS build profile
|
||
|
||
The F5 source candidate adds opt-in `legacy-ios-v1` on image create/CLI/MCP,
|
||
limited to approved Tart Monterey12.7.6/Xcode13.4.1. A separate recipe digest and
|
||
omitted default fields preserve ordinary image fingerprints/recipes. Native
|
||
Ruby3.3.12, OpenSSL3.5.9 LTS, LibYAML0.2.5, Bundler2.5.22, CocoaPods1.16.2,
|
||
Xcodeproj1.27.0, FFI1.17.4 and Ethon0.18.0 are pinned with all 44 source gems and
|
||
archive SHA-256. Rosetta runs only on Apple Silicon. Qualification requires real
|
||
native library loading, version/architecture checks and an actual unsigned armv7
|
||
compile/link against a local pod with frozen lockfiles after reboot.
|
||
|
||
Source tests and the actual host CocoaPods deployment fixture pass; all downloaded
|
||
source gems match primary RubyGems hashes. Independent disposable-worker testing
|
||
built all pinned tools and exposed/fixed real lipo argument ordering. Guest-readable
|
||
root-owned permissions, completion-marker ordering and bounded setup logging are
|
||
corrected. The fresh worker exposed/fixed noninteractive UTF-8 locale handling.
|
||
Current staged verifier/pinned tools passed actual armv7 builds before/after native
|
||
reboot, GUI/SSH/account/workspace/keys/RFB/export/isolation/release checks on stable
|
||
a45655f. Both workers were released and nine goldens preserved. On e80c194,
|
||
an actual fresh Packer factory installed/qualified the immutable profile and
|
||
registered image_ready; its worker passed real armv7/native/reboot/workload/
|
||
artifact/isolation/release. The extra temporary factory golden was then deleted
|
||
through the supported image-delete contract; all nine baseline goldens remain.
|
||
No immutable marker was rewritten. This does
|
||
not claim on-device armv7 execution or reuse historical iVim/Notepad evidence.
|
||
|
||
## Remaining 3.0 architecture
|
||
|
||
These phases retain the original target scope. They are not all implied to be
|
||
mandatory independent processes or already supported release features.
|
||
|
||
| Phase | Implemented slices | Remaining scope / exit gate |
|
||
|---|---|---|
|
||
| 1 — Tart and Orchard | Tart lifecycle/inventory/Console, account parameterization, SSH isolation, configured Cirrus/Packer adoption, dynamic factory/GHCR; installed generic Tart LLDB-DAP; dated Broker v1 smoke | Historical guest-kernel stall boundary above; real VS Code editor/DDG app debug; Orchard isolated access/factory/live pool acceptance. Tart and Orchard cannot share one daemon's primary provider |
|
||
| 2 — nodes and access | R1 pinned-SSH physical host leases/wake, R2 rootless Podman macOS VMs, R3 VM Screen Sharing; host exclusivity/sleep holds/cleanup; resource/cache admission and private HDD placement | Current HTPC/resource/quota matrix; signed node-agent inventory/heartbeats, same-L2 WoL relay, durable power intents, grants/connectors; physical-host desktop and browser noVNC. Intel Mac WoL capability/sleeping-Mac debug exit gate unaccepted |
|
||
| 3 — provider coverage | HTPC QEMU/OpenCore lab via rootless Podman; manual bootstrap | Full libvirt-QEMU, accepted Linux VM/Vetu profiles, mixed-primary-provider scheduling; optional licensed Anka/Parallels only on installed hosts; independent isolation/access/release acceptance per provider |
|
||
| 4 — user products and Broker | Generated VS Code workspaces and v1 template/IP Broker contract | `/api/v3` capability selection, durable Target/EnvironmentProfile/ConnectionGrant, short-lived Access, thin VS Code extension, Console terminal/noVNC/catalog creation/linked Broker runs, Broker requirements/grants migration |
|
||
| 5 — hardening | Local CI/security/archive/install, durable jobs/admission/cleanup, actual owning MCP, full VM-disk DR, complete signed package rollback/forward, drain cancellation, resource/cache live boundaries; Lume retirement | Broader provider crash/host loss/partition/full-disk matrix, metrics/alerts and signed promotion/revocation |
|
||
|
||
## Records and completion rules
|
||
|
||
The [original detailed design](history/VIRFIELD-3-PLAN-before-2026-10-14.md),
|
||
[dated verification checkpoints](history/VERIFICATION-checkpoints-through-2026-10-15.md)
|
||
and files under `superpowers/plans` preserve provenance. Their old requirements,
|
||
unchecked recipe steps and pending statuses do not override this checklist or the
|
||
operator's standard-password decision. Record source/package/client/test scope
|
||
separately. Mark work complete only after implementation, relevant local tests,
|
||
live acceptance, documentation and working-branch push; keep follow-up automation
|
||
active while required work or an external gate remains open.
|
||
````
|