QuantTrio
/

DeepSeek-V3.2-AWQ

Text Generation

4-bit precision

Model card Files Files and versions

Resources

View closed (0)

Sadly, Amperes are not supported😢

#3 opened 5 days ago by

Did someone get it running on 4 NVIDIA RTX PRO 6000 Blackwell (96 GB) GPUs?

#2 opened 6 days ago by

Aww Man!

#1 opened 8 days ago by