Concept — Index & Log

Two special files help the LLM (and you) navigate as the wiki grows. Their purposes differ.

index.md — Content-oriented Directory

A directory of everything in the wiki: one link per page, a one-line summary, and optional metadata (dates, source counts, etc.). Organized by category (entities / concepts / sources, etc.).

  • The LLM updates it on every ingest.
  • Before answering a query, the LLM reads the index to locate relevant pages, then drills in.
  • At medium scale (~100 sources, hundreds of pages) it works surprisingly well, without embedding-based RAG infrastructure.

log.md — Chronological Log

Append-only, recording what happened and when — ingest, query, lint.

  • Tip: prefix each entry consistently (e.g. ## [2026-04-02] ingest | Article Title), and the log becomes parseable with simple unix tools:
    grep "^## \[" log.md | tail -5 gives the 5 most recent entries.
  • Provides a timeline of the wiki’s evolution, helping the LLM understand what was done recently.

Instances in This Wiki

  • index — current directory
  • log — current log (first entry is this gist’s ingest)
  • three-operations — the role of index/log in ingest/query
  • AGENTS — this wiki’s maintenance conventions for index/log