Infrastructure
The layer underneath the applications: retrieval, serving, protocols and the trade-offs each imposes.
Entries3 entries
- What is a vector database?A vector database stores embeddings — numeric representations of text, images or other data — and finds the ones closest to a query vector. It exists because exact nearest-neighbour search over millions of high-dimension…
- What is an inference provider?An inference provider runs models on its own accelerators and sells access per token or per GPU-hour. The category spans three different businesses: serverless token APIs for open-weight models, dedicated endpoints with …
- What is MCP (the Model Context Protocol)?The Model Context Protocol is an open protocol for connecting language-model applications to external tools, data sources and prompts through a common interface. Instead of every application writing bespoke integrations …