API Providers — Animate | AI Wisdom

← Back to topic
🎞 ANIMATE · Mode 3 of 5 · +100 XP— LLM API Providers
📋Abstraction
⚙️OpenAI
🔄Anthropic
✅Selection
🎯 Next: Test →
Step 1 / 4
Speed
Provider Abstraction
LLMProvider ABC: same interface for all providers — swap without changing business logic💡 Analogy
Like a power adapter — same interface, works with different country outlets.
Define a common interface (ABC) with a complete() method. Any provider implements this interface. Business logic calls complete() without knowing which provider.
Console Output
> LLMProvider.complete(system, user) → str
> Any implementation handles the details
> Business logic remains unchanged when switching providers
●api_providers.py
Provider AbstractionL6–9
1# Unified interface pattern for multiple LLM providers
2from abc import ABC, abstractmethod
3from openai import OpenAI
4import anthropic
5import google.generativeai as genai
6 
7class LLMProvider(ABC):
8    @abstractmethod
9    def complete(self, system: str, user: str) -> str: ...
10 
11class OpenAIProvider(LLMProvider):
12    def __init__(self, model="gpt-4o-mini"):
13        self.client = OpenAI()
14        self.model = model
15    def complete(self, system: str, user: str) -> str:
16        r = self.client.chat.completions.create(
17            model=self.model,
18            messages=[{"role":"system","content":system},
19                      {"role":"user","content":user}]
20        )
21        return r.choices[0].message.content
22 
23class AnthropicProvider(LLMProvider):
24    def __init__(self, model="claude-3-5-haiku-20241022"):
25        self.client = anthropic.Anthropic()
26        self.model = model
27    def complete(self, system: str, user: str) -> str:
28        r = self.client.messages.create(
29            model=self.model, max_tokens=1024,
30            system=system,
31            messages=[{"role":"user","content":user}]
32        )
33        return r.content[0].text
34 
35# Provider selection: cost vs capability
36PROVIDERS = {
37    "fast-cheap":    OpenAIProvider("gpt-4o-mini"),    # $0.15/1M in
38    "balanced":      AnthropicProvider("claude-3-5-haiku-20241022"),  # fast
39    "powerful":      OpenAIProvider("gpt-4o"),          # $5/1M in
40    "very-powerful": AnthropicProvider("claude-3-5-sonnet-20241022"), # best
41}
42 
43def run(tier: str, system: str, user: str) -> str:
44    return PROVIDERS[tier].complete(system, user)
44 lines
Timeline — 4 Steps
Provider Abstraction
LLMProvider ABC: same interface for all providers — swap without changing business logic💡 Analogy
Like a power adapter — same interface, works with different country outlets.
Define a common interface (ABC) with a complete() method. Any provider implements this interface. Business logic calls complete() without knowing which provider.
Console Output
> LLMProvider.complete(system, user) → str
> Any implementation handles the details
> Business logic remains unchanged when switching providers

Was this page helpful?

Discussion

LLMProvider ABC: same interface for all providers — swap without changing business logic

💡 Analogy

Like a power adapter — same interface, works with different country outlets.

Define a common interface (ABC) with a complete() method. Any provider implements this interface. Business logic calls complete() without knowing which provider.

Console Output

> LLMProvider.complete(system, user) → str
> Any implementation handles the details
> Business logic remains unchanged when switching providers

LLMProvider ABC: same interface for all providers — swap without changing business logic

💡 Analogy

Like a power adapter — same interface, works with different country outlets.

Define a common interface (ABC) with a complete() method. Any provider implements this interface. Business logic calls complete() without knowing which provider.

Console Output

> LLMProvider.complete(system, user) → str
> Any implementation handles the details
> Business logic remains unchanged when switching providers