- What people assume it means
- That “SLM,” meaning small language model, is simply the smaller, more advanced, or more premium option, maybe even running on your own servers.
- What the marketing says
- Vendors pitch hybrid setups, LLMs as generalists and SLMs as specialists, and use “small” to imply a leaner, more private, more exclusive setup, often alongside a higher price.
- What it actually means
- An LLM is a very large, general-purpose model trained on huge amounts of internet text. An SLM is a smaller, more narrowly trained model, cheaper and faster, sometimes more accurate on a narrow task, worse at open-ended reasoning. “Small” refers to the training data, not where the model lives or runs.
- What it looks like in practice
- One legal vendor pitches LLMs as “versatile legal interns” and SLMs as “expert paralegals.” Often this signals a cost and control play, cheaper to run and easier to keep data contained, more than a proven accuracy edge. Paying more for a vendor’s product doesn’t by itself mean you’re getting a smaller, more contained model.
- Legitimate or hype, the test
- Ask directly what “small” refers to in their pitch, the training data, the deployment, or just the price tier, and ask for accuracy comparisons on your own sample documents. This is an architecture choice a vendor can show without difficulty.