Small Number is a young boy who gets into a lot of mischief. He lives in a big city with his mother and his older sister Perfect Number. Every Sunday afternoon, Small Number does his math homework.

Microsoft found that small language models can exceed the performance of much larger ones when trained to specialize in a single area. Researchers fine-tuned the Mistral 7B model to create Orca-Math, ...