Last-minute cheat sheet.
Core positioning
Treat Gen AI as an enterprise capability, not a single chatbot project. The focus is use-case prioritization, trusted data, secure architecture, the RAG-versus-fine-tuning decision, LLMOps, evaluation, observability, governance, and measurable business value.
2-minute reference architecture
- Start with use-case intake and risk tiering.
- Build governed data ingestion into object storage or a data lake.
- Classify data, scan for PII/PHI, and preserve lineage and access-control metadata.
- Chunk, embed, and index documents with hybrid search and metadata filters.
- Retrieve with reranking and document-level authorization.
- Generate with guardrails and citation-first prompting.
- Return grounded answers with citations and a stated confidence/limitation.
- Log trace, prompt version, model version, retrieval set, latency, cost, and safety result.
- Evaluate with golden datasets and human feedback on a schedule.
- Deploy with CI/CD, canary release, monitoring, and rollback.
RAG vs. fine-tuning vs. prompting
- Prompting: best for instructions, style, and task framing.
- RAG: best for private, factual, or frequently changing knowledge.
- Fine-tuning: best for consistent behavior, domain language, or output format.
- RLHF/RLAIF: best when enough preference feedback exists to optimize alignment.
LLMOps checklist
- Use-case inventory and risk tier assigned before build.
- Data and prompt governance in place.
- Prompt/model/tool version tracked per release.
- Golden evaluation set gating any change.
- Canary rollout with automatic rollback criteria.
- Cost, latency, and hallucination-rate monitoring in production.