OpenAI SDK

Use the official OpenAI SDK with AllToken.

TypeScript

Install
$ npm install openai
TypeScript
1import OpenAI from 'openai';
2
3const client = new OpenAI({
4 apiKey: process.env.ALLTOKEN_API_KEY,
5 baseURL: 'https://api.alltoken.ai/v1',
6});
7
8const completion = await client.chat.completions.create({
9 model: 'deepseek-chat',
10 messages: [{ role: 'user', content: 'Hello!' }],
11});
12
13console.log(completion.choices[0].message.content);

Python

Install
$ pip install openai
Python
1from openai import OpenAI
2import os
3
4client = OpenAI(
5 api_key=os.environ["ALLTOKEN_API_KEY"],
6 base_url="https://api.alltoken.ai/v1",
7)
8
9completion = client.chat.completions.create(
10 model="deepseek-chat",
11 messages=[{"role": "user", "content": "Hello!"}],
12)
13
14print(completion.choices[0].message.content)

Streaming with the SDK

Both TypeScript and Python SDKs support streaming natively:

TypeScript streaming
1const stream = await client.chat.completions.create({
2 model: 'deepseek-chat',
3 messages: [{ role: 'user', content: 'Tell me a story' }],
4 stream: true,
5});
6
7for await (const chunk of stream) {
8 process.stdout.write(chunk.choices[0]?.delta?.content ?? '');