ML Servers — Overview

Model serving and local inference runtime options.

• TensorFlow Serving — production TF model serving
• Ollama / Llama.cpp — local LLM hosting and inference

Refer to the repo for full quick-starts and security notes.