Model Watch

LFM made small models an architecture question

2 min read

Liquid Foundation Models made small models feel like a placement question.

The useful choice is not whether a small model can imitate a large one. It is where the model should live, what hardware it needs, and which local job it can own.

local job why a small model fits
prefilter obvious spam cheap and fast
redact secrets before upload narrow and sensitive
classify a note or file bounded output
suggest a filename or tag low stakes
offline device helper no server required

Local placement changes the product map. It enables privacy-sensitive preprocessing, offline helpers, and cheap first passes near the data or the user.

The tradeoff is still a system design problem. Local-first needs escalation, update policy, privacy boundaries, and hardware-specific evals. A small model that cannot abstain or hand off safely is just a smaller version of the same failure.

Choose placement before choosing the model. Keep sensitive inputs local when possible. Use the small route as a prefilter when broad reasoning is needed. Put the model near the user when latency dominates.

The architecture is the feature. Size is only one variable.

Jeremy London

About Jeremy London

Engineering leader and builder in Denver. I write about AI platforms, agents, security, reliability, homelab infrastructure, and the parts of engineering work that have to survive production.