Groq Settings

Official links

• Website: https://groq.com/
• Console & keys: https://console.groq.com/keys
• OpenAI compatibility: https://console.groq.com/docs/openai
• Models: https://console.groq.com/docs/models

OpenAICompatible setup

from agently import Agently

Agently.set_settings("OpenAICompatible", {
  "base_url": "https://api.groq.com/openai/v1",
  "api_key": "YOUR_GROQ_API_KEY",
  "model": "llama-3.1-70b-versatile"
})