ai/deepseek-v4-flash-safetensors

Docker

Efficient 284B MoE language model with 1M token context and multi-mode reasoning capabilities

ai/qwen3-embedding

Docker

Qwen3 Embedding: multilingual models for advanced text/ranking tasks like retrieval & clustering.

ai/granite-docling

Docker

Granite Docling is a multimodal model for efficient document conversion.

ai/gemma3-vllm

Docker

Google’s latest Gemma, small yet strong for chat and generation

ai/llama3.1

Docker

Meta’s LLama 3.1: Chat-focused, benchmark-strong, multilingual-ready.

ai/kimi-k2.6

Docker

1T MoE multimodal agentic model with long-horizon coding, swarm orchestration, and native vision

ai/qwen3-coder-next-vllm

Docker

Advanced coding agent model with 80B params (3B active MoE) for code generation and debugging

ai/mxbai-embed-large

Docker

mxbai-embed-large-v1 is a top English embed model by Mixedbread AI, great for RAG and more.

ai/nomic-embed-text-v1.5

Docker

Nomic Embed Text v1 is an open‑source, fully auditable text embedding model

ai/devstral-small

Docker

Agentic coding LLM (24B) fine-tuned from Mistral-Small-3.1 with a 128K context window

redhat/granite-7b-lab-gguf

Red Hat, Inc.

4-bit quantized version of model Granite-7b-lab

ai/granite-embedding-multilingual

Docker

Granite Embedding Multilingual is a 278 million parameter, encoder‑only XLM‑RoBERTa‑style

ai/functiongemma-vllm

Docker

FunctionGemma is a 270M open model for fine-tuned, offline function-calling agents on small devices.

ai/kimi-k2-vllm

Docker

Kimi K2 Thinking: open-source agent with deep reasoning, stable tool use, fast INT4, 256k context.

ai/qwq

Docker

Experimental Qwen variant—lean, fast, and a bit mysterious

ai/qwen3.5-safetensors

Docker

397B-parameter MoE multimodal LLM with 17B active params, 262K context, 201 languages

ai/granite-4.0-h-nano

Docker

Granite-4.0-h-nano: lightweight instruct model trained via SFT, RL, and merging on diverse data.

ai/all-minilm-l6-v2-vllm

Docker

all-MiniLM-L6-v2 is a sentence-transformers, maps sentences & paragraphs to a 384 dimensional vector

ai/embeddinggemma-vllm

Docker

Embedding Gemma is a state-of-the-art text embedding model from Google DeepMind

ai/qwen3-vllm

Docker

Qwen3 is the latest Qwen LLM, built for top-tier coding, math, reasoning, and language tasks.

ai/glm-5-safetensors

Docker

744B MoE language model with 40B active params for reasoning, coding, and agentic tasks (FP8)

ai/qwen3-embedding-vllm

Docker

Qwen3 Embedding: multilingual models for advanced text/ranking tasks like retrieval & clustering.

ai/qwen3-reranker-vllm

Docker

Multilingual reranking model for text retrieval, scoring document relevance across 119 languages.

ai/gpt-oss-vllm

Docker

OpenAI’s open-weight models designed for powerful reasoning, agentic tasks

ai/qwen3-reranker

Docker

Multilingual reranking model for text retrieval, scoring document relevance across 119 languages.

ai/mistral-nemo

Docker

Mistral fine-tuned via NVIDIA NeMo for smoother enterprise use

ai/smollm2-vllm

Docker

SmolVLM: lightweight multimodal model for video, image, and text analysis, optimized for devices