Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Some of us also worry about energy consumption


They idle at pretty low wattages, and since the bulk of the TDP is rated for raster workloads you usually won't see them running at full-power on compute workloads.

My 300w 3070ti doesn't really exceed 100w during inference workloads. Boot up a 1440p video game and it's a different story altogether, but for inference and transcoding those 3060s are some of the most power efficient options on the consumer market.


Interesting, my 3060 uses 150-170W with 14B model on Ollama, according to nvidia-smi.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: