93 lines
4.0 KiB
Markdown
93 lines
4.0 KiB
Markdown
---
|
|
source: raw/schema.sql
|
|
content_hash: 71b47e47b483834c887de14c76d5b16506d90ad64198d76a92a7b3731132dab8
|
|
namespace: work
|
|
last_synced: 2026-04-27
|
|
confidence: 0.9
|
|
tags: [schema, postgres, database, asana, wiki]
|
|
---
|
|
|
|
# Personal OS Database Schema
|
|
|
|
Postgres schema (`personal_os`) backing the Asana mirror, agent annotations,
|
|
file ingestion pipeline, semantic wiki, and memory store. Requires the
|
|
`vector` (pgvector) and `pg_trgm` extensions. Bootstrap with
|
|
`psql -U admin -d personal_os -f schema.sql`.
|
|
|
|
## Asana mirror
|
|
|
|
- **`tasks`** — one row per Asana task GID, upserted on each sync.
|
|
Stores due/start dates, completion, My Tasks section, assignee/creator,
|
|
primary project, timestamps, full `raw_json`, plus a `source` enum:
|
|
`my_tasks` (assigned to me) > `delegated` (I created, others assigned)
|
|
> `following` (CC'd) > `project` (project member, fallback).
|
|
Sync bookkeeping: `fetched_at`, `stories_fetched_before` cursor.
|
|
- **`stories`** — raw event log per task, keyed by Asana story GID.
|
|
`resource_subtype` covers comments, assignment changes, due-date edits,
|
|
section moves, dependency edits, attachments, completion, etc.
|
|
- **`task_edges`** — directed graph between tasks. `relation_type`:
|
|
`subtask`, `dependency` (blocked-by), `dependent` (blocking),
|
|
`project_sibling`, `mention` (referenced in a story).
|
|
`related_gid` may not yet exist in `tasks`.
|
|
- **`task_annotations`** — agent or user notes per (task, annotation_type).
|
|
Types: `irrelevant`, `watching`, `needs_action`, `snoozed`
|
|
(with `snoozed_until`). Never written by the fetcher.
|
|
- **`sync_state`** — one row per sync stream
|
|
(`my_tasks`, `following`, `delegated`, `project:{gid}`,
|
|
`workspace_events`). Tracks cursor, last sync, last full sync.
|
|
- **`task_embeddings`** — pgvector(1024) per task, HNSW index with
|
|
cosine ops; populated separately from sync.
|
|
|
|
The **`active_tasks`** view filters out completed and irrelevant tasks
|
|
and tasks snoozed past today, ordered by source priority then due date
|
|
then modified-at. Starting point for daily review.
|
|
|
|
## Phase 0 additions (2026-04-27)
|
|
|
|
All core tables gain `namespace TEXT NOT NULL DEFAULT 'work'` so a single
|
|
DB can serve work/personal/family contexts. `tasks` also gets
|
|
`possibly_deleted` and `last_seen_in_full_sync` to track tasks that
|
|
disappear between full syncs without explicit deletion events.
|
|
|
|
## File ingestion → wiki
|
|
|
|
- **`file_references`** — files (via macOS security-scoped
|
|
`bookmark_data` + cached `last_known_path`) and web URLs
|
|
queued for wiki ingestion. Tracks `content_hash` (SHA256),
|
|
`mime_type`, `tags`, a `modification_log` JSONB, and a
|
|
`wiki_stale` flag the [[wiki-ingest-process]] consumes.
|
|
Namespace-checked (`work`/`personal`/`family`).
|
|
- **`wiki_pages`** — LLM-synthesised markdown, never a raw copy.
|
|
Has `sources` JSONB (file_ref/url/title), `confidence` float,
|
|
`superseded_by` self-FK for version chains, `stale` flag,
|
|
`last_synced_hash`, and a pgvector(1536) embedding for semantic
|
|
search. The optional ivfflat index is left commented; rebuild
|
|
once the table has 1000+ rows.
|
|
|
|
## Memory store
|
|
|
|
**`memory_store`** — semantic memory from Discord, Claude sessions,
|
|
and manual entries. `type` ∈ {fact, preference, decision, person},
|
|
`source` ∈ {discord, claude, manual}, with entities JSONB,
|
|
confidence, optional `expires_at` (null = permanent), and a
|
|
pgvector(1536) embedding. Used by Hermes for cross-session context.
|
|
|
|
## Indexing notes
|
|
|
|
- Trigram GIN on `tasks.name` enables fuzzy task search.
|
|
- `tasks_due_on` is partial (only non-completed tasks).
|
|
- pgvector embedding indexes for `wiki_pages` and `memory_store`
|
|
are deferred until the tables have meaningful row counts.
|
|
- `task_embeddings` uses HNSW; the wiki/memory stores use ivfflat
|
|
(commented) — different recall/build trade-off per workload.
|
|
|
|
## Key constraints
|
|
|
|
- All `namespace` columns are CHECK-constrained to
|
|
`('work','personal','family')` on the new (Phase 0+) tables.
|
|
- Cascade deletes flow from `tasks` → `stories`, `task_edges`,
|
|
`task_annotations`, `task_embeddings`.
|
|
|
|
## Related
|
|
[[personal-os-architecture]] [[wiki-ingest-process]]
|