Lab · the instrument
Your own UI AI lab,
running locally.
Every AI product this year says "personalized." Ask any of them for the experiment behind the word and the room goes quiet. uistash takes the opposite bet: ship the measurement, let it argue.
There's a harder problem underneath, and the Lab is built around it: when you test your own taste, the experimenter and the subject are the same person — and the person most motivated to see the "with taste" arm win is you. So the Lab isn't designed to convince your followers. It's designed to survive you.
01 · Sealed experiments
The lock is the only referee.
An experiment is a pre-registered bundle: the briefs, the arms, the number of rounds, and the stopping rule are all fixed before the first round generates — then sealed. No editing mid-run, no stopping early on a hot streak, and no running score anywhere until the series completes.
This is friction on purpose — friction as scientific integrity. Convenience is what p-hacking feels like from the inside.
02 · Verdicts
You're allowed to say neither.
Each round shows candidates blind — shuffled, unlabeled, identical chrome. Most eval tools force a winner. The Lab gives your eye its full vocabulary:
03 · Controls
Some rounds are traps. On purpose. For you.
Blinding the labels isn't enough when you know a "with taste" arm exists somewhere — wanting it to win leaks into your picks. So inside a sealed experiment, the Lab hides the composition itself, and salts the series:
- Both candidates are bare — no taste arm exists.
- You can't tell a catch from a real round.
- You can't favor what you can't find.
- Your picks on catches measure your bias directly.
- A pair you already judged returns later — sides swapped.
- No new generation. Costs nothing.
- Agree with yourself? That's your consistency ceiling.
- Always pick the left one? That's your position bias, caught.
No other eval setup we know of measures the evaluator. At N=1, it's the only honest option: before the Lab claims your taste file works, it tells you how reliable your own eye is.
04 · Honest numbers
Steer yes, brag no.
Results speak plain language, computed from exact odds — never dashboard confidence. Seven of ten sounds like victory; it's a coin flip's good day, and the Lab says so to your face:
A percentage over four picks is disinformation with an axis — so below ten rounds you'll see "5 of 8", never "62.5%". The word "significant" doesn't appear in the product. Neither does a p-value.
05 · The refuse-list
Numbers this product will never show you.
A measurement tool is defined as much by what it declines to display. These are constitutional — no setting turns them on:
06 · The judge
The machine earns its opinions.
After you pick, a machine judge — anchored to your actual saved references, never to "good design" — predicts what you chose. It starts with zero authority and buys each role with accuracy:
07 · What it's for
Three questions only this can answer.
The evidence is being collected. Join the study.
The instrument is built — sealed experiments, controls, honest tiers, the ladder, all of it, running locally on the buyer's machine. What's pending is the thing everyone else skips: the results. They'll be published either way — a negative result is still a contribution, and pretending otherwise is how this industry got here.