This is OpenAI Compatible. Just set the and api_key and you should be fine.
Usage Example:
from openai import OpenAI
key = "yourkeyhere" # key that you just generated
model = "your_model_here" # view models at https://api.voidai.xyz/v1/models
client = OpenAI(api_key=key, base_url="https://api.voidai.xyz/v1/")
messages = [{"role": "user", "content": "What is 1 + 1? Can you also give me the approach to it?"}]
response = client.chat.completions.create(model=model, messages=messages)
assistant_response = response.choices[0].message.content
print(assistant_response)
How to make it remember things?
It's simple! You attach assistant response(s) to the messages!
Here's a message "thread" example:
from openai import OpenAI
key = "yourkeyhere"
model = "your_model_here"
client = OpenAI(api_key=key, base_url="https://api.voidai.xyz/v1/")
messages = [
{ "role": "system", "content": "You're a math teacher."},
{ "role": "user", "content": "How much is 2 plus 2?" },
{ "role": "assistant", "content": "2 plus 2 equals 4." },
{ "role": "user", "content": "You're really good at math!" },
{ "role": "assistant", "content": "Thank you! I'm glad I could help you with your math question." },
{ "role": "user", "content": "What was the first question I asked you?" }
]
response = client.chat.completions.create(model=model, messages=messages)
assistant_response = response.choices[0].message.content
print(assistant_response)
You could also append things so you could sort of "make a terminal chat":
from openai import OpenAI
key = "yourkeyhere"
model = "your_model_here"
client = OpenAI(api_key=key, base_url="https://api.voidai.xyz/v1/")
system_prompt = input("Set your system prompt: ")
messages = [{"role": "system", "content": f"{system_prompt}"}]
print("Starting the chat. Type 'exit' to end the conversation.")
while True:
user_input = input("You: ")
if user_input.lower() == 'exit':
print("Ending the program.")
break
messages.append({"role": "user", "content": user_input})
response = client.chat.completions.create(
model=model,
messages=messages
)
assistant_response = response.choices[0].message.content
messages.append({"role": "assistant", "content": assistant_response})
print(f"Assistant: {assistant_response}")
