The production framework for Predictive and Generative AI.
Turn any model into a production API in a single line of code. Serve predictive and
generative models on a Rust-powered core, and expose your tools to AI agents over the
Model Context Protocol (MCP).
Flama is the Framework for ightweight pplications, artificial intelligence
odels, and utomation. It packages a model from any of the mainstream frameworks
into a single portable format (the file), so every model looks the same to your API
no matter where it came from, and serves it over HTTP in seconds.
The production framework for Predictive and Generative AI. Serve any model as an API in one line, with OpenAI/Anthropic/Ollama-compatible endpoints, a built-in chat UI, and native MCP.
Estrelas
304
Ferramentas
—
Disponibilidade
—
L
A
M
A
.flm
📦 Any framework, one format. Package scikit-learn, TensorFlow, PyTorch, or an LLM into a single portable .flm artifact.
⬇️ Models on demand. Download and package any model from the HuggingFace Hub with one command.
🤖 Generative AI serving. Serve LLMs with OpenAI-, Anthropic-, and Ollama-compatible endpoints, side by side.
💬 Chatbot out of the box. Every served model ships a polished streaming chat UI at /chat/, with Markdown, LaTeX, and Mermaid.
🔌 Native MCP. Expose tools, resources, and prompts to AI agents with a single decorator, schemas derived from your type hints.
⚡ Rust-powered core. Routing, JSON encoding, request parsing, and compression compiled to native code, shipped as plain wheels.
🚀 Production-ready first. Go from a packaged model to a running service over the CLI, in Python, with a spec file, or inside a container.
Installation
Flama is published on PyPI and ships native wheels for every supported Python version on Linux, macOS, and Windows. No Rust toolchain required. It
needs one schema library, and Pydantic is the usual choice:
pip install "flama[pydantic]"
Everything else is an optional extra, so you install only what you need:
pip install "flama[typesystem]" # or marshmallow, instead of pydantic
pip install "flama[database]" # SQLAlchemy-backed resources
pip install "flama[llm]" # generative AI serving (vLLM on Linux, MLX on Apple Silicon; Python 3.10 to 3.13)
pip install "flama[full]" # everything
You get two endpoints, an OpenAPI schema at /schema/, and Swagger UI at /docs/.
GET /model/ returns the artifact's metadata; POST /model/predict/ runs inference:
From zero to a production API with a built-in chat UI in three commands:
pip install "flama[llm,pydantic]"
# 1. Download and package a model from HuggingFace into a portable .flm
flama get --family llm --source huggingface mlx-community/gemma-4-E2B-it-qat-4bit
# 2. Try it straight from your terminal, no server needed
echo '"What is Flama?"' | flama model mlx-community_gemma-4-E2B-it-qat-4bit.flm stream --set system="Be concise."
# 3. Serve it over HTTP
flama serve --model file=mlx-community_gemma-4-E2B-it-qat-4bit.flm,url=/,name=gemma
That is it: a full HTTP API, a streaming chat interface at
http://127.0.0.1:8000/chat/, and multi-dialect endpoints.
The same .flm file runs on vLLM (Linux with CUDA) or MLX (Apple Silicon), with
Flama selecting the backend at load time.
Step 2 above needs no server at all. Pipe a prompt into flama model ... stream and the
response streams straight into your shell:
Learn more in the Generative AI docs.
Speak the protocols your clients already use
A single model can serve multiple wire protocols simultaneously, so existing OpenAI,
Anthropic, and Ollama clients work without code changes, just point them at your server.
Every .flm file is self-describing. Alongside the weights it carries the framework and
version, the model class, its hyperparameters, the training metrics, and any auxiliary
files needed at inference time. The metadata sits ahead of the weights, so reading it is a
header parse rather than a full decompression, even on a multi-gigabyte artifact.
The schemas describe what run accepts and returns; without -f, inspect renders the same metadata for
reading, followed by an example request ready to pipe into run.
Because the metrics travel inside the file, a CI job can gate promotion on them without
standing up a server. The same command group runs inference offline, so a reference set is
scored on exactly the code path the server would use:
flama model model.flm run -i reference.json -o predictions.json -f json
Deploy several models from one file
flama start reads a flama.json describing the application and the models it serves,
which makes a deployment reviewable in a pull request:
flama start --create-config full # write a template to start from
flama start # run it
Every option also binds to a FLAMA_* environment variable, so one image serves every
environment. Official images ship per Python version and schema library, which leaves the
Dockerfile as a FROM and two COPYs:
FROM vortico/flama:latest-python3.12-pydantic
COPY models/ models/
COPY flama.json .
CMD ["start"]
Flama ships native, first-class support for the Model Context Protocol. Declare a
capability with a single decorator, mount the server, and Flama derives the JSON Schema
from your type hints and serves it over a stateless protocol:
from flama import Flama
app = Flama()
app.mcp.add_server("/mcp/tools/", "tools")
@app.mcp.tool("add", description="Add two integers", mcp="tools")
def add(a: int, b: int) -> int:
return a + b
Any MCP-capable client (Claude, Cursor, VS Code Copilot, or a custom agent) can discover
and invoke it. Tasks, Elicitation, and MCP Apps are included. Learn more in the
MCP docs.
And a full-featured API framework
Flama is also a complete toolkit for building production APIs:
Resources with standard CRUD methods over SQLAlchemy tables.
Dependency injection via Components, the base of the plugin ecosystem.
Adaptable schemas with Pydantic, Typesystem, or Marshmallow, all optional extras.
Auto-generated OpenAPI schema plus Swagger UI and ReDoc.
Pagination, background tasks, lifespan events, and JWT authentication.
Streaming-first HTTP with Server-Sent Events and NDJSON responses.
flama upgrade codemods that rewrite imports and renamed symbols across major versions.
Examples
A curated, documentation-aligned set of runnable examples lives in
vortico/flama-examples, covering fundamentals,
the CLI, advanced topics, predictive AI, generative AI, and domain-driven design.
This project is absolutely open to contributions, so if you have a nice idea, please read
our contributing docsbefore submitting a pull request.
Questions and ideas are welcome in GitHub Discussions.
Support
If you find Flama useful for building robust Machine Learning and Generative AI APIs, the
best way to support our work is to give us a ⭐ on GitHub, it is the best fuel for our
development efforts. You can also follow Vortico for updates.
The production framework for Predictive and Generative AI. Serve any model as an API in one line, with OpenAI/Anthropic/Ollama-compatible endpoints, a built-in chat UI, and native MCP.
Ainda não há lista de ferramentas. Servidores remotos recebem uma após a primeira verificação de saúde.
Perguntas frequentes
Perguntas
Como instalo Flama?
Copie nesta página a configuração stdio para Cursor, Claude Desktop, Claude Code ou VS Code. Ela usa a instalação do publicador, não um proxy do PlugMCP.
Flama precisa de uma chave de API?
Este registro não lista nenhuma variável de ambiente obrigatória.
Qual transporte Flama usa?
Flama roda localmente via stdio.
Quando Flama foi verificado pela última vez?
Última verificação: 2026-10-27. The production framework for Predictive and Generative AI. Serve any model as an API in one line, with OpenAI/Anthropic/Ollama-compatible endpoints, a built-in chat UI, and native MCP.