Optional Path - Real Local Model Bootstrap

Recommended default

Do one real local probe before you build any wrappers.

The goal is not to finish local AI. The goal is to confirm that your chosen runtime exposes a real endpoint you can script against.

Probe commands

python3 labs/local-model-bootstrap/probe.py --kind ollama --base-url http://127.0.0.1:11434 --list-models
python3 labs/local-model-bootstrap/probe.py --kind ollama --base-url http://127.0.0.1:11434 --model llama3.2
python3 labs/local-model-bootstrap/probe.py --kind openai-compatible --base-url http://127.0.0.1:1234 --list-models

Artifact

probe.py speaks either Ollama-style or OpenAI-compatible local endpoints.

Boundary

This is the first optional path where the model surface is expected to be real, not simulated.

Rejoin point

Once one prompt works, return to the bootstrap step and treat that local endpoint as your starting model surface.

Companions: local hosting and model artifacts and local hardware and runtime fit.