Deploy the hybrid model with both fast response and deep reasoning modes - now production-ready on Together's infrastructure
Starting today on Together AI, you can access DeepSeek-V3.1 — the hybrid model that supports both fast responses and deep reasoning modes through configurable chat templates. Choose non-thinking mode for speed or thinking mode for complex analysis.
TL;DR:
- DeepSeek-V3.1 API on Together AI: Choose between fast responses and deep reasoning modes in one model
- Efficiency breakthrough: Comparable quality to DeepSeek-R1 but significantly faster, making deep reasoning practical for production
- Built-in agent support: Native code and search agent capabilities with specialized tool-calling workflows optimized for production use on Together's optimized infrastructure
- Available now on Together AI: Serverless APIs with enterprise reliability and fine-tuning capabilities
How the Hybrid Model Works
DeepSeek-V3.1 operates in two modes through configurable chat templates. You can select non-thinking mode for tasks requiring fast responses or thinking mode for problems needing step-by-step analysis.
DeepSeek-V3.1's thinking mode achieves comparable answer quality to DeepSeek-R1 while responding significantly faster, making deep reasoning practical for production applications.
Fast responses for routine tasks
Code completion, simple queries, API calls
Deep reasoning for complex problems
Debugging, analysis, multi-step workflows
The model includes built-in support for code agents and search agents, with specialized formatting optimized for multi-turn tool-calling workflows. You control mode selection through the chat template configuration.
Built on DeepSeek-V3.1-Base through substantial long-context extension training - 630B tokens for 32K context and 209B tokens for 128K context, ensuring robust performance across extended conversations and large codebases.
Real Applications for Hybrid Intelligence
DeepSeek-V3.1's hybrid architecture delivers measurable improvements across established coding and agent tasks:
⚡ Non-thinking: Generate API endpoints, write unit tests, fix syntax errors
🧠 Thinking: Debug distributed system failures, architect microservices decomposition, design database migration strategies with zero-downtime requirements
⚡ Non-thinking: Basic fact lookup, simple database queries, standard search operations
🧠 Thinking: Multi-step research across enterprise knowledge bases, correlate information from multiple data sources, design complex search workflows with filtering and analysis
⚡ Non-thinking: Extract entities from contracts, classify document types, basic text parsing
🧠 Thinking: Analyze multi-document compliance workflows, cross-reference contract terms with regulatory requirements, synthesize insights from large document collections
The hybrid model allows you to choose the appropriate cognitive mode for your task complexity, eliminating the need to route between different specialized models for these workflows.
Performance Across Both Modes
| 📊 Benchmark | Non-Thinking | Thinking | Difference |
|---|---|---|---|
| 🎯 MMLU-Redux | 91.8% | 93.7% | +1.9% |
| 🔬 GPQA-Diamond | 74.9% | 80.1% | +5.2% |
| 💻 LiveCodeBench | 56.4% | 74.8% | +18.4% |
| 🧭 AIME 2024 | 66.3% | 93.1% | +26.8% |
The performance differences show where each mode excels. Non-thinking mode handles routine tasks efficiently, while thinking mode provides substantial improvements on complex problems requiring multi-step reasoning.
Production Deployment on Together AI
The new DeepSeek hybrid model is available both through our DeepSeek-V3.1 serverless API and Dedicated Endpoints.
✓ 671B total parameters
✓ 37B active per token
✓ 128K context (extended training)
✓ MIT licensed
✓ 99.9% uptime SLA
✓ North American data centers
✓ Serverless scaling
✓ SOC 2 compliant
✓ OpenAI-compatible APIs
✓ Fine-tuning available
✓ Batch processing
✓ Custom endpoints
Together AI's optimizations ensure both thinking and non-thinking modes perform reliably under production workloads. Our NVIDIA GPU infrastructure is specifically tuned for large mixture-of-experts models like DeepSeek-V3.1, with transparent pricing that scales with your usage patterns.
Getting Started
DeepSeek-V3.1 on Together AI provides both responsive interaction and deep reasoning capabilities and can be deployed immediately through Together AI's production APIs:
Use our Python SDK to quickly integrate DeepSeek-V3.1 into your applications:
from together import Together
client = Together()
response = client.chat.completions.create(
model="deepseek-ai/DeepSeek-V3.1",
messages=[],
stream=True
)
for token in response:
if hasattr(token, 'choices'):
print(token.choices[0].delta.content, end='', flush=True)
Start building today:
- Interactive Playground — Test complex workflows before production
- API Documentation — Integration guides and examples
{{custom-cta-1}}
Follow our step-by-step Quickstart to install, authenticate, and run your first GPT-OSS inference in minutes.