Docker Blog: Run and Iterate on LLMs Faster with Docker Model Runner on DGX Station

With 252GB of GPU memory at 7.1 TB/s of bandwidth and a total of 748GB of coherent memory, the DGX Station doesn’t just let you run frontier models, it lets you run trillion-parameter models, fine-tune massive architectures, and serve multiple models simultaneously, all from your desk.