AI Ops Pack
Automation & Agents
AI stack audits, agent workflow design, skill authoring, prompt library, model benchmarking, vendor research, cost optimization.
agent-workflow-design
Spec a new multi-step Hermes automation — trigger, skills loaded, prompt, delivery target — and save it as a workflow spec ready to instantiate.
ai-adoption-briefing
Monthly 1-pager on what changed in AI in the last 30 days — filtered to what's worth acting on for this business — with a clear act/watch/ignore verdict for each item.
ai-risk-assessment
Structured risk assessment for a new AI use case — failure modes, data privacy concerns, hallucination risk, fallback plan, and monitoring — saved as a wiki page before the use case goes live.
ai-stack-audit
Inventory every AI tool in the stack — what it costs, how much it was used in the last 30 days, and whether it's earning its place.
ai-vendor-research
Evaluate a new AI tool or model against the current stack — what it does, what it costs, whether it earns a slot, and what the integration lift would be.
automation-failure-triage
When a Hermes cron or webhook fails, read the relevant logs, identify the root cause, surface the fix, and optionally apply it to the cron config.
data-pipeline-design
Spec how data flows from a source system (Stripe, HubSpot, Gmail, etc.) into agent context — triggers, transforms, storage, and freshness — saved as a DAG-style document.
llm-cost-optimization
Parse LangSmith, Langfuse, or OpenRouter usage data to identify expensive prompts, over-provisioned models, and missing caching opportunities — with a prioritized list of cuts and their estimated savings.
model-benchmarking
Send sample prompts to multiple models via OpenRouter, compare outputs on quality, speed, and cost, and save the comparison table to the wiki.
prompt-library-update
Create a new prompt entry or bump the version of an existing one in the versioned prompt library at wiki/prompts/ — with when-to-use, examples, antipatterns, and version history.
skill-file-authoring
Generate a new production-ready skill file from a task description — reads the skill template, fills it in, and saves it as a draft for review before it goes live.