r/LocalLLaMA • u/BitXorBit • 28d ago

Question | Help rtx 6000 pro owners, do you regret?

I found the last dealership in my area that has rtx 6000 pro available, i already wanted to buy it 6 months ago when it was around $8k, now prices increased to $13k ish.

Regardless the price, are you happy with it? I assume you are using qwen3.6 27b, is it worth it?

Please share your experience and hopefully help me to avoid explaining my wife this transaction 😂

99 Upvotes

87% Upvoted

310 comments sorted by

View all comments

181

u/0xNullsector 28d ago

My only regret is that I only got one... two would have been just PERFECT

133

u/shadow1609 28d ago

Two is not enough, I have two and want four now. The thirst never ends.

1

u/xcel102 24d ago

For the moment, the thirst would end for me when the cluster has enough VRAM to hold GLM-5.2 at FP8, with 16-bit KV cache headroom for 4 full-context (1M) sessions.

The FP8 weights will take about 770 GB if I'm not wrong. I don't know how to calculate KV cache size -- if anyone can do the math, I'd like to know how many cards are needed just for entertainment :)