Skip to content

LLM Providers

Fresh

Mem0 supports 20+ LLM providers for memory extraction and updates. OpenAI is the default.

Language Support

Python supports all providers. TypeScript currently supports OpenAI, Anthropic, and Groq.

Supported Providers

ProviderPythonTypeScriptNotes
OpenAIYesYesDefault provider
AnthropicYesYesClaude models
GroqYesYesFast inference
Azure OpenAIYesNoEnterprise Azure
OllamaYesNoLocal models
TogetherYesNoOpen-source models
Mistral AIYesNoEuropean AI
Google AIYesNoGemini models
AWS BedrockYesNoAWS managed
DeepSeekYesNoCoding models
MiniMaxYesNoChinese AI
xAIYesNoGrok models
Sarvam AIYesNoIndian languages
LM StudioYesNoLocal GUI
LangChainYesNoFramework bridge
vLLMYesNoHigh-throughput serving

Configuration

python
from mem0 import Memory

config = {
    "llm": {
        "provider": "openai",
        "config": {
            "model": "gpt-4.1-mini",
            "temperature": 0.1,
            "max_tokens": 2000,
        }
    }
}

memory = Memory.from_config(config)

Provider Examples

OpenAI

python
config = {
    "llm": {
        "provider": "openai",
        "config": {
            "model": "gpt-4.1-mini",
            "temperature": 0.1,
        }
    }
}

Anthropic

python
config = {
    "llm": {
        "provider": "anthropic",
        "config": {
            "model": "claude-sonnet-4-5-20250514",
            "temperature": 0.1,
        }
    }
}

Ollama (Local)

python
config = {
    "llm": {
        "provider": "ollama",
        "config": {
            "model": "llama3.2",
            "temperature": 0.1,
            "ollama_base_url": "http://localhost:11434",
        }
    }
}

Azure OpenAI

python
config = {
    "llm": {
        "provider": "azure_openai",
        "config": {
            "model": "gpt-4.1-mini",
            "api_key": "your-azure-key",
            "azure_deployment": "your-deployment",
            "azure_endpoint": "https://your-resource.openai.azure.com/",
            "api_version": "2024-02-01",
        }
    }
}

Together AI

python
config = {
    "llm": {
        "provider": "together",
        "config": {
            "model": "mistralai/Mixtral-8x7B-Instruct-v0.1",
            "temperature": 0.1,
        }
    }
}

Groq

python
config = {
    "llm": {
        "provider": "groq",
        "config": {
            "model": "llama-3.1-70b-versatile",
            "temperature": 0.1,
        }
    }
}

Google AI

python
config = {
    "llm": {
        "provider": "google_ai",
        "config": {
            "model": "gemini-1.5-flash",
            "temperature": 0.1,
        }
    }
}

AWS Bedrock

python
config = {
    "llm": {
        "provider": "aws_bedrock",
        "config": {
            "model": "anthropic.claude-v2",
            "region": "us-east-1",
        }
    }
}

DeepSeek

python
config = {
    "llm": {
        "provider": "deepseek",
        "config": {
            "model": "deepseek-chat",
            "temperature": 0.1,
        }
    }
}

Mistral AI

python
config = {
    "llm": {
        "provider": "mistral_ai",
        "config": {
            "model": "mistral-large-latest",
            "temperature": 0.1,
        }
    }
}

LM Studio

python
config = {
    "llm": {
        "provider": "lmstudio",
        "config": {
            "model": "lmstudio-community/Meta-Llama-3-8B",
            "lmstudio_base_url": "http://localhost:1234/v1",
        }
    }
}

Output Formats

  • Structured outputs -- Formatted JSON responses for data extraction
  • Unstructured outputs -- Flexible natural language responses

SOP Documentation Site for Mem0