Meilisearch’s chat completions feature enables AI-powered conversational search, allowing users to ask questions in natural language and receive direct answers based on your indexed content. This feature transforms the traditional search experience into an interactive dialogue.
This is an experimental feature. Use the Meilisearch Cloud UI or the experimental features endpoint to activate it:
curl \
  -X PATCH 'MEILISEARCH_URL/experimental-features/' \
  -H 'Content-Type: application/json' \
  --data-binary '{
    "chatCompletions": true
  }'
When you enable the chat route for the first time, Meilisearch creates a new API key named “Default Chat API Key”.

​
What is conversational search?

Conversational search interfaces allow users to:
  • Ask questions in natural language instead of using keywords
  • Receive direct answers rather than just document links
  • Maintain context across multiple questions
  • Get responses grounded in your actual content
This approach bridges the gap between traditional search and modern AI experiences, making information more accessible and intuitive to find.

​
Traditional search workflow

  1. User enters keywords
  2. Meilisearch returns matching documents
  3. User reviews results to find answers

​
Conversational search workflow

  1. User asks a question in natural language
  2. Meilisearch retrieves relevant documents
  3. AI generates a direct answer based on those documents
  4. User can ask follow-up questions

​
Use conversational search when:

  • Users need direct answers to specific questions
  • Content is informational (documentation, knowledge bases, FAQs)
  • Users benefit from follow-up questions
  • Natural language interaction improves user experience

​
Use traditional search when:

  • Users need to browse multiple options
  • Results require comparison (e-commerce products, listings)
  • Exact matching is critical
  • Response time is paramount

​
Use chat completions to implement RAG pipelines

The chat completions feature implements a complete Retrieval Augmented Generation (RAG) pipeline in a single API endpoint. Meilisearch’s chat completions consolidates RAG creation into one streamlined process:
  1. Query understanding: automatically transforms questions into search parameters
  2. Hybrid retrieval: combines keyword and semantic search for better relevancy
  3. Answer generation: uses your chosen LLM to generate responses
  4. Context management: maintains conversation history automatically

​
Alternative: MCP integration

When integrating Meilisearch with AI assistants and automation tools, consider using Meilisearch’s Model Context Protocol (MCP) server. MCP enables standardized tool integration across various AI platforms and applications.

​
Architecture overview

Chat completions operate through workspaces, which are isolated configurations for different use cases. Each workspace can:
  • Use different LLM sources (openAi, azureOpenAi, mistral, gemini, vLlm)
  • Apply custom prompts
  • Access specific indexes based on API keys
  • Maintain separate conversation contexts

​
Key components

  1. Chat endpoint: /chats/{workspace}/chat/completions
    • OpenAI-compatible interface
    • Supports streaming responses
    • Handles tool calling for index searches
  2. Workspace settings: /chats/{workspace}/settings
    • Configure LLM provider and model
    • Set system prompts
    • Manage API credentials
  3. Index integration:
    • Automatically searches relevant indexes
    • Uses existing Meilisearch search capabilities
    • Respects API key permissions

​
Security considerations

The chat completions feature integrates with Meilisearch’s existing security model:
  • API key permissions: chat only accesses indexes visible to the provided API key
  • Tenant tokens: support for multi-tenant applications
  • LLM credentials: stored securely in workspace settings
  • Content isolation: responses based only on indexed content

​
Next steps