☆ Yσɠƚԋσʂ ☆@lemmy.ml to Technology@lemmy.mlEnglish · 1 month agoBonsai 27B: The First 27B-Class Model to Run on a Phoneprismml.comexternal-linkmessage-square1linkfedilinkarrow-up111arrow-down12cross-posted to: [email protected]
arrow-up19arrow-down1external-linkBonsai 27B: The First 27B-Class Model to Run on a Phoneprismml.com☆ Yσɠƚԋσʂ ☆@lemmy.ml to Technology@lemmy.mlEnglish · 1 month agomessage-square1linkfedilinkcross-posted to: [email protected]
minus-squareIrdial@lemmy.mllinkfedilinkEnglisharrow-up2·1 month agoI’m surprised that the model’s benchmark performance isn’t that much worse than the base given that it’s running with 1-bit quantization. Impressive.
I’m surprised that the model’s benchmark performance isn’t that much worse than the base given that it’s running with 1-bit quantization. Impressive.