Batch size / VRAM calculator
Use a simplified memory model: optimizer/parameter footprint plus activations that scale with batch × sequence × hidden × layers. Results are planning estimates, not CUDA profiler numbers.
Use a simplified memory model: optimizer/parameter footprint plus activations that scale with batch × sequence × hidden × layers. Results are planning estimates, not CUDA profiler numbers.