Skip to main content
The Better Data LLM Gateway is built on three main pillars: Backends, Tools, and Sessions. Understanding these concepts will help you design flexible and robust conversational commerce experiences.

1. Backends

Backends are where your data lives. They provide the gateway with access to your product catalog, shopping carts, and order management systems.
  • ProductBackend: Handles searching and retrieving product information.
  • CartBackend: Manages the lifecycle of a shopping cart.
  • OrderBackend: Facilitates order creation and status tracking.
Learn more about Backends ->

2. Tools (Capabilities)

Tools (often referred to as Capabilities in the marketing docs) are the specific actions an AI can perform. The gateway takes your backend logic and “adapts” it into a format the LLM can understand (like MCP for Claude or Function Calling for OpenAI). Common tools include:
  • search_products
  • get_product_details
  • add_to_cart
  • check_inventory
Learn more about Tools ->

3. Sessions

Sessions maintain the state of a conversation across multiple turns. They store things like the current cartId and user context.
  • Persistent: Sessions can be stored in Redis to survive server restarts.
  • Cross-Platform: A session started in Claude can be transferred to a web checkout or even another AI assistant.
Learn more about Sessions ->

Architecture Overview

The gateway acts as the orchestration layer between various LLM providers and your commerce infrastructure.

Getting Started

If you’re ready to start building, head over to the Quickstart guide.