LLM Providers
FreshMem0 supports 20+ LLM providers for memory extraction and updates. OpenAI is the default.
Language Support
Python supports all providers. TypeScript currently supports OpenAI, Anthropic, and Groq.
Supported Providers
| Provider | Python | TypeScript | Notes |
|---|---|---|---|
| OpenAI | Yes | Yes | Default provider |
| Anthropic | Yes | Yes | Claude models |
| Groq | Yes | Yes | Fast inference |
| Azure OpenAI | Yes | No | Enterprise Azure |
| Ollama | Yes | No | Local models |
| Together | Yes | No | Open-source models |
| Mistral AI | Yes | No | European AI |
| Google AI | Yes | No | Gemini models |
| AWS Bedrock | Yes | No | AWS managed |
| DeepSeek | Yes | No | Coding models |
| MiniMax | Yes | No | Chinese AI |
| xAI | Yes | No | Grok models |
| Sarvam AI | Yes | No | Indian languages |
| LM Studio | Yes | No | Local GUI |
| LangChain | Yes | No | Framework bridge |
| vLLM | Yes | No | High-throughput serving |
Configuration
python
from mem0 import Memory
config = {
"llm": {
"provider": "openai",
"config": {
"model": "gpt-4.1-mini",
"temperature": 0.1,
"max_tokens": 2000,
}
}
}
memory = Memory.from_config(config)Provider Examples
OpenAI
python
config = {
"llm": {
"provider": "openai",
"config": {
"model": "gpt-4.1-mini",
"temperature": 0.1,
}
}
}Anthropic
python
config = {
"llm": {
"provider": "anthropic",
"config": {
"model": "claude-sonnet-4-5-20250514",
"temperature": 0.1,
}
}
}Ollama (Local)
python
config = {
"llm": {
"provider": "ollama",
"config": {
"model": "llama3.2",
"temperature": 0.1,
"ollama_base_url": "http://localhost:11434",
}
}
}Azure OpenAI
python
config = {
"llm": {
"provider": "azure_openai",
"config": {
"model": "gpt-4.1-mini",
"api_key": "your-azure-key",
"azure_deployment": "your-deployment",
"azure_endpoint": "https://your-resource.openai.azure.com/",
"api_version": "2024-02-01",
}
}
}Together AI
python
config = {
"llm": {
"provider": "together",
"config": {
"model": "mistralai/Mixtral-8x7B-Instruct-v0.1",
"temperature": 0.1,
}
}
}Groq
python
config = {
"llm": {
"provider": "groq",
"config": {
"model": "llama-3.1-70b-versatile",
"temperature": 0.1,
}
}
}Google AI
python
config = {
"llm": {
"provider": "google_ai",
"config": {
"model": "gemini-1.5-flash",
"temperature": 0.1,
}
}
}AWS Bedrock
python
config = {
"llm": {
"provider": "aws_bedrock",
"config": {
"model": "anthropic.claude-v2",
"region": "us-east-1",
}
}
}DeepSeek
python
config = {
"llm": {
"provider": "deepseek",
"config": {
"model": "deepseek-chat",
"temperature": 0.1,
}
}
}Mistral AI
python
config = {
"llm": {
"provider": "mistral_ai",
"config": {
"model": "mistral-large-latest",
"temperature": 0.1,
}
}
}LM Studio
python
config = {
"llm": {
"provider": "lmstudio",
"config": {
"model": "lmstudio-community/Meta-Llama-3-8B",
"lmstudio_base_url": "http://localhost:1234/v1",
}
}
}Output Formats
- Structured outputs -- Formatted JSON responses for data extraction
- Unstructured outputs -- Flexible natural language responses