A model baked anywhere, served by an OpenAI-compatible server

A folder baked by Python's functai.bake (or by a trainer that wrote baked.json format 2), its weights served at url by an OpenAI-compatible server (vllm serve <folder>/model serves /v1/chat/completions). update(fn, lm = baked(...)) runs fn on it, laid out exactly as it was trained: the student's signature and layout, no worked examples, thinking off. A call is refused when fn changed since it was baked (baked-changed), or gives a fixed input another value (baked-fixed) or a derived one a pair the student never saw (baked-derived).

Usage

baked(folder, url, model = NULL, api_key = NULL, timeout = 120)

Arguments

folder

The baked folder (it holds baked.json).

url

The server's address (http://localhost:8000/v1).

model

The model's name on the server (default: the folder's).

api_key

The server's key, when it asks for one.

timeout

Seconds to wait for an answer.

Value

A baked model, for lm.