>250GB, how do you guys run this stuff? | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

efilife on Aug 22, 2025 | parent | context | favorite | on: DeepSeek-v3.1

>250GB, how do you guys run this stuff?

danielhanchen on Aug 22, 2025 [–]

I'm working on sub 165GB ones!

165GB will need a 24GB GPU + 141GB of RAM for reasonably fast inference or a Mac

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact