Answers are grounded in this paper and cite their sources.
A physician's field report on standing up local LLM inference for production health-care agents. An ASUS Ascent GX10 (NVIDIA GB10 Grace Blackwell, 128 GB unified memory) went from the box to serving a 35-billion-parameter mixture-of-experts model (Qwen3.6-35B, NVFP4, vLLM) in 17 days. The note reports measured latency and throughput, the inference-engine configuration and why each option was chosen, the failure modes seen in production and their mitigations, the routing layer that lets agents switch between local and cloud models, and how models are selected through the author's own head-to-head evaluation arenas. A technical appendix details the memory budget, benchmark methodology, vLLM flags, and the arenas run. Version 1.2 adds an appendix with the downloadable report of each arena (nine reports, in Spanish; four of them reconstructed afterwards from the notes taken on the day of the test, and labelled as such). Web versions: English · Español.
No takes yet. Share an insight, caveat, or question.
Juan Manuel Fraga-Sastrías (2026) studied this question.
Synapse has enriched 8 closely related papers on similar clinical questions. Consider them for comparative context: