Watch Your Language: Create Small Language Models That Run On-Device

Large language models are great for complex tasks like writing code or translating Japanese into Greek, but they're overkill if you just need a nonplayer character dialog generator in a single language. We'll present tools and techniques you can use today to generate, curate, and distill a dataset, then train a small language model (SLM) that can perform the tasks you designed it for.