The first good output proves that a generative model can make something. It does not prove that the product is useful.
Diffusion models make the distinction visible because they begin with noise and gradually denoise toward a sample shaped by conditioning. The output looks sudden. The process is incremental:
noise
-> rough structure
-> specific structure
-> sample that satisfies constraints
The controls around that process are part of the product. A seed gives reproducibility. A mask limits where change can occur. Guidance changes how tightly the sample follows its prompt. A reference image anchors the result. Samplers trade speed and fidelity.
The real question is what the user is allowed to change.
For a marketing image, composition may vary while the product shape stays fixed. For an editor, the background may change while the subject stays put. For a diagram, labels may be locked while color is flexible. A prompt is only one constraint. The product needs a contract:
- these fields are locked
- these fields can vary
- this region may be regenerated
- this region must remain exact
- these outputs need review before export
Without that contract, the model is being asked to enforce policy through generation. It is not a good boundary.
Polished failures are difficult because the output looks finished. A face changes between frames, a chart label moves, a product detail is wrong, or a paragraph cites the wrong rule. Review needs more than surface quality:
- original input
- generated output
- model and prompt version
- seed or sampling settings
- locked constraints
- reviewer decision
- reason for rejection
Editing is usually more useful than regeneration. Masks, layers, locked text, object references, and region-level regeneration let users preserve one part while changing another. The same principle applies to text: pin the source, revise a paragraph, protect a required clause.
Measure the constraint the product claims to honor. For images, that might include prompt adherence, identity consistency, text rendering, and protected-asset drift. For text, it might be source faithfulness, prohibited claims, required fields, and human edit distance.
The strongest generative systems know what should stay still. The model supplies variation. The product supplies boundaries, review, and a place for the result to land.
Related posts

About Jeremy London
Engineering leader and builder in Denver. I write about AI platforms, agents, security, reliability, homelab infrastructure, and the parts of engineering work that have to survive production.