Skip to content
Topic GuideCurated Reading Path

AI in Production

Reference architectures, RAG vs fine-tuning decisions, agent reliability, LLMOps, and evals for teams shipping AI to production.

Start here

Deep dive

AI Product Architecture: The Five Layers Behind Reliable Features

A plain reference stack for AI features: data, retrieval, model, output checks and monitoring, plus when a human should step in.

Read article
Opinion

RAG or Fine-Tuning? How to Choose for Your AI Product

A plain decision guide to RAG versus fine-tuning: when each wins on cost, accuracy, freshness and effort, and why many products use both.

Read article
How-to

Reliable AI Agents: Stop Loops, Retries and Costly Mistakes

How AI agents fail in production and the proven fixes: hard limits, safe retries, circuit breakers, tracing and human approval for risky actions.

Read article
Checklist/Template

LLMOps: Run AI in Production With Versioning and Cost Control

How to version prompts, pin models, track costs and latency, and respond when quality drops. An operations playbook for LLM products.

Read article
How-to

LLM Evals: How to Know Your AI Is Getting Better, Not Worse

A simple way to measure AI output quality before and after release, so prompt or model changes stop shipping on guesswork.

Read article
Opinion

Agent Engineering: The Discipline Your Team Is Missing

Many teams ship AI agents with no testing or monitoring. Here is the engineering practice, metrics and team habits that make agents safe to run.

Read article
Deep dive

MCP Explained: One Way to Connect AI Agents to Your Tools

What the Model Context Protocol is, why it saves integration work, how it runs in practice, and the security and versioning trade-offs.

Read article
How-to

AI Unit Economics: Cost Per Token, Request and Customer

Work out what each AI request and each customer really costs, so you know which users and features lose you money.

Read article

All articles on this topic

Deep dive

RAG as Core Infrastructure: Designing Retrieval You Can Run

Treat retrieval like a database, not a feature: ingestion, search, generation, reliability, cost and freshness for AI-native products.

Read article
Opinion

Choosing an Agent Framework: When LangGraph Fits and When Not

A CTO's checklist for picking an AI agent framework, why LangGraph is a good default for complex agents, and how to avoid lock-in.

Read article
How-to

Testing AI Systems: Pre-Release Evals Plus Live Monitoring

Run a fixed test set before every release and sample live traffic after it. A simple two-part testing plan for AI features and agents.

Read article
Problem-led

Why Demo Agents Fail in Production: The 7-Layer Stack

Demos only cover the tool layer. The seven layers a production AI agent needs, and the order to build them so it stays reliable.

Read article
How-to

Making Your API Ready for AI Agents: REST Plus MCP

How to add an agent-friendly interface next to your REST API: clear tool schemas, safe retries, versioning and tighter security.

Read article
Deep dive

Scaling a Vector Database: Sharding, Indexing and Storage Costs

What to do when vector search slows or gets expensive: read/write patterns, sharding, index choice, caching and storage tiering.

Read article
Problem-led

AI Agents That Write to Your Database: Keeping Data Consistent

What happens when an AI agent fails halfway through a write, and the patterns that prevent duplicates, lost updates and bad data.

Read article
Deep dive

Scaling Database Writes for AI Pipelines: Batch, Queue, Partition

AI jobs write in bursts. How to absorb them with batching, queues, partitioning, the right database and backpressure.

Read article
Deep dive

Multiple Databases for AI Systems: Patterns and Trade-offs

When an AI product needs relational, vector, document or graph stores, how to combine them, and why one Postgres is often enough to start.

Read article
How-to

AI-Assisted Database Migrations: Safer Schema Changes

How an AI agent can draft, check and test database migrations, with rollback plans and human approval for risky changes, to avoid downtime.

Read article
How-to

Caching for AI Apps: Cut LLM Cost and Response Time

What to cache in an AI product (answers, embeddings, retrieved context), where to keep it, and how to expire it without serving stale answers.

Read article
How-to

AI That Writes SQL Safely: Let Teams Query Data Without Engineers

How to let an AI answer data questions from your database without wrong results or runaway queries: schema context, validation and limits.

Read article
How-to

AI Agents for Database Monitoring: Catch Slow Queries Early

How an AI agent can watch database health, find the cause of slowdowns and suggest fixes, and how to build trust before it changes anything.

Read article
Deep dive

Where to Store AI Agent Memory: Redis, Postgres or Graph

Which database holds which kind of agent memory, and how to handle heavy writes, shared memory, retrieval speed and consistency.

Read article
Deep dive

Multi-Agent AI: Five Orchestration Patterns and When to Use Each

Supervisor, pipeline, shared-board, critic and bidding patterns for AI agent teams, with when each fits and how to keep them reliable.

Read article
Checklist/Template

Coding Agents in CI: Ship Faster Without Hidden Debt

Use your CI pipeline to check AI-written code: test gates, security scans, contract tests and review rules for risky changes.

Read article
Deep dive

Pinecone vs Weaviate vs pgvector vs Qdrant: Which to Pick

Which vector database fits your product? A side-by-side of cost, ops effort, search features and scale, with a default recommendation.

Read article
Opinion

AI Coding Tools: What They Do Well and Where You Need a Senior

Where Cursor, Copilot and coding agents save real time, where they quietly create risk, and the rules that keep AI-written code from becoming debt.

Read article
Deep dive

LLM Context Windows: Control Cost, Speed and Answer Quality

Bigger context windows do not fix the problem. How to trim, order and summarise what you send the model to keep costs, latency and quality in check.

Read article
Opinion

Reliable AI Agents Need Workflows, Not Longer Prompts

Why one giant prompt makes brittle agents, and how step-by-step workflows, stored state and human approval make agents dependable.

Read article
How-to

AI Automation That Pays Off: Start With the Workflow

How to put AI into a real business workflow with clear success metrics, safe failure handling, monitoring and costs that do not drift.

Read article