Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
kccqzy
71 days ago
|
parent
|
context
|
favorite
| on:
GLM-5.2 – How to Run Locally
The AMD 395 supports up to 128GB unified RAM. So still not enough even at 1-bit quant unfortunately.
monksy
70 days ago
[–]
96gb vram is the max it supports.
cpburns2009
70 days ago
|
parent
|
next
[–]
That's the max you can statically allocate in the BIOS. It's best to leave that at the minimum (500 MB I think), and let the drivers dynamically allocate. You can use up to about 120 GB on Linux.
selfhoster11
70 days ago
|
parent
|
prev
[–]
Under Linux it is allegedly 110GB, but I’m not sure.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
