Model Watch

LFM made small models an architecture question

2 min read

Liquid Foundation Models made small models feel like an architecture question.

The useful shift was not “can a small model imitate a big one.” It was “where should this model live, what hardware does it want, and which local jobs can it own.”

I think the interesting design space opens up once the model gets a job instead of a benchmark.

local job why a small model fits
prefilter obvious spam cheap and fast
redact secrets before upload narrow and safety sensitive
classify a note or file bounded output
suggest a filename or tag low stakes
offline helper for a device needs to work without a server

Efficiency changes the product map. It opens up prefiltering, redaction, offline helpers, and other narrow tasks that do not deserve a remote frontier route. The point is not that the small model is smarter. The point is that it can sit closer to the work and cheaper to run.

The catch is simple: local-first still needs escalation, privacy boundaries, updates, and hardware-aware evals. Otherwise it is just a smaller box with the same old problems. The architecture question is what makes the box useful.

I would even sketch the deployment choice before I picked the model. If the device can run the model cheaply, keep the job local. If the job is sensitive, keep the raw inputs local and only escalate a narrow result. If the task needs broad reasoning, use the smaller model as a prefilter or assistant and stop pretending it has to do everything. That decision tree is the real product.

That is why small models are not a one-line efficiency win. They are a placement question. Put them near the data when privacy matters, near the user when latency matters, and near the routing layer when you want a cheap first pass. The architecture is the feature.

Jeremy London

About Jeremy London

Engineering leader and builder in Denver. I write about AI platforms, agents, security, reliability, homelab infrastructure, and the parts of engineering work that have to survive production.