Turning Conversation Logs into Obsidian Long-Term Memory: A Pipeline That Distills Them Every Night

Short summary

The author describes a nightly pipeline that distills Claude Code and Codex conversation logs into a structured Obsidian vault using launchd, headless claude -p, and git backups. Key engineering challenges include macOS TCC permission conflicts with iCloud-synced directories, silent failure detection, retry logic across multiple time slots, and preventing LLM fabrication of event details from raw logs. The article provides concrete code snippets and hard-won lessons on drawing boundaries between protected and unprotected filesystem areas.

• •Nightly launchd job distills 28h of Claude/Codex conversation logs into Obsidian vault via headless claude -p
• •Silent failure detection for macOS TCC + iCloud permission conflicts, with retry slots and done-markers
• •Countermeasures against LLM fabrication when summarizing raw conversation logs into structured notes

Generated with AI, which can make mistakes.