Building a Machine Learning Rig | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		Building a Machine Learning Rig (tuananh.net)
		1 point by tuananh on March 1, 2024 \| hide \| past \| favorite \| 1 comment

aimonster2 on March 1, 2024 [–]

2x3090s run 70B at 4bit pretty well. Dolphin does great at least for chat. Very coherent.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact