@ahmadmanga's thread

About Fable 5's Distillation Attacks

I believe that if your LLM was distilled, and a model close to it resulted from that distillation, your LLM wasn't that good in the first place.

A revolutionary LLM should be as good as possible at the smallest size that quality can be achieved in. If a competitive model reached better quality at a smaller size, your architecture wasn't that good in the first place! #technology #askleo