NVIDIA DGX Spark (GB10, 128GB)

Scored against every model in our directory at Q4_K_M, using the ~110GB of GPU-usable memory on this machine and its 273 GB/s of memory bandwidth. Of 30 models, 28 run comfortably, 0 are a tight fit, and 2 will not load. The largest model that fits well here is OpenAI gpt-oss-120b.

How these are estimated: tokens/sec ≈ memory bandwidth × 0.65 ÷ active weights in GB. These are arithmetic estimates from published specifications, not lab measurements — BFWR does not run a hardware test lab. Real throughput varies with runner, quantization, context length and thermals.

Diffusion models size up differently from language models: the text encoder is often as large as the image model itself, and memory scales with resolution. Measured at 1024×1024, one image at a time, against the ~110GB of GPU-usable memory here, 11 of 11 open image models will run — the best being Qwen-Image at BF16 / FP16, peaking near 60.7GB.

Weight sizes are read from the real .safetensors files in each model’s Hugging Face repository. Activation memory is an approximation that varies with the attention implementation and sampler, so leave headroom. These are planning figures, not benchmarks.

What is the largest model the NVIDIA DGX Spark (GB10, 128GB) can run?

OpenAI gpt-oss-120b (116.8B (5.1B active)) is the largest model that fits, at roughly 65GB in Q4_K_M against ~110GB of GPU-usable memory. It is rated "Comfortable" here, with an estimated 62.5 tokens/sec.

How many tokens per second should I expect?

Speed depends on the model, not just the machine. On this hardware the estimates range from about 98.6 tokens/sec for the smallest models down to single digits for the largest that still fit. The estimate uses memory bandwidth (273 GB/s here) × 0.65 ÷ active weights in GB, and is not a measured benchmark.

Can the NVIDIA DGX Spark (GB10, 128GB) run a 70B model?

Yes — OpenAI gpt-oss-120b is rated "Comfortable" here at roughly 65GB in Q4_K_M, with an estimated 62.5 tokens/sec. Expect to keep the context modest.

How much context can I use?

128k tokens is a sensible ceiling on this machine at Q4_K_M / Q5_K_M. Context is stored in the KV cache, which grows with every token and competes with the model weights for the same memory, so a longer context means a smaller model.

Can the NVIDIA DGX Spark (GB10, 128GB) generate images with Flux or Stable Diffusion?

Yes. 11 of 11 open image models fit at 1024x1024, the best being Qwen-Image at BF16 / FP16, peaking near 60.7GB. Higher resolutions and larger batches cost proportionally more.

Which runner works best on the NVIDIA DGX Spark (GB10, 128GB)?

Ollama, LM Studio, llama.cpp are all expected to run on this hardware. Ollama is the simplest starting point, and `ollama run gpt-oss:120b` is a good first model for this machine.

In-depth reads that pair with this machine — sizing memory, picking a runner, and choosing quantization for ~110GB of usable memory.

• DGX Spark vs Strix Halo for Local AISame 256-bit memory bus; what the Spark's price actually buys.Read the guide
• Running Giant Open Models LocallyHardware sizing for DeepSeek V4, Qwen3.8 and Llama 4.Read the guide
• How to Run Qwen3.8-Flash-Next Locally180B with 6B active: which build fits 128GB, real speeds, licence.Read the guide