Models / Chat / Typhoon 2 8B Instruct
Typhoon 2 8B Instruct
Chat
Instruct Thai large language model with 8 billion parameters based on Llama3.1-8B.
Try our Typhoon 2 API
API Usage
How to use Typhoon 2 8B InstructModel CardPrompting Typhoon 2 8B InstructApplications & Use CasesAPI Usage
Endpoint
scb10x/scb10x-llama3-1-typhoon-18370
RUN INFERENCE
curl -X POST "https://api.together.xyz/v1/chat/completions" \
-H "Authorization: Bearer $TOGETHER_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "scb10x/scb10x-llama3-1-typhoon-18370",
"messages": [{"role": "user", "content": "What are some fun things to do in New York?"}]
}'JSON RESPONSE
RUN INFERENCE
from together import Together
client = Together()
response = client.chat.completions.create(
model="scb10x/scb10x-llama3-1-typhoon-18370",
messages=[{"role": "user", "content": "What are some fun things to do in New York?"}],
)
print(response.choices[0].message.content)JSON RESPONSE
RUN INFERENCE
import Together from "together-ai";
const together = new Together();
const response = await together.chat.completions.create({
messages: [{"role": "user", "content": "What are some fun things to do in New York?"}],
model: "scb10x/scb10x-llama3-1-typhoon-18370",
});
console.log(response.choices[0].message.content)JSON RESPONSE
Model Provider:
SCB10X
Type:
Chat
Variant:
Parameters:
8B
Deployment:
✔ Serverless ✔ Dedicated
Quantization
Context length:
Pricing:
$0.18
Run in playground
Deploy model
Quickstart docs
How to use Typhoon 2 8B Instruct
Model details
Prompting Typhoon 2 8B Instruct
Applications & Use Cases
Looking for production scale? Deploy on a dedicated endpoint
Deploy Typhoon 2 8B Instruct on a dedicated endpoint with custom hardware configuration, as many instances as you need, and auto-scaling.
