Try SAVI on your laptop, in minutes.

1Install it

pip install "savi-sdk[openai]"

2Swap one line, and switch on the report

import os
from savi import SaviOpenAI, local_report

local_report.start()   # readable lines in your terminal, and a report file at the end

client = SaviOpenAI(api_key=os.environ["OPENAI_API_KEY"], local_mode=True)

response = client.chat.completions.create(
    model="gpt-4o-mini",
    messages=[{"role": "user", "content": "Summarise this contract."}],
)

3Run your code and read your terminal

[ OK  ] openai     gpt-4o-mini-2024-07-18   in   214  out    96    812 ms  cost ~$0.000090
[CACHE] openai     gpt-4o-mini-2024-07-18   in   214  out    96     14 ms  cost $0.00  answered from cache
[ OK  ] openai     gpt-4o-mini-2024-07-18   in   330  out    60    701 ms  cost ~$0.000085  personal data: EMAIL_ADDRESS x1
[FAIL ] openai     gpt-4o                   in     0  out     0   30.2 s  cost -  failed timeout

Summary  (this computer only; nothing was sent anywhere)
  8 calls, 1 failed   tokens in 3,842 / out 978   average response 1.1 s
  cost about $0.01. Cost covers 6 of 7 calls. No price for: mistral-small-latest.
  1 answered from the cache, saving about $0.000090