SettleTop AI Registry

Methodology

The registry is a record of what each marketplace listing said, when we looked, and what changed. It is not a catalogue and it does not rate agents. This page explains how a passport is built so that every number on it can be checked.

What we capture

Each capture is one observation of one listing at one moment: the listing page, and where the marketplace publishes one, the app certification page. Captures are never edited or deleted. A correction arrives as a new capture, so the timeline is the record.

The twelve layers

Every agent, on every marketplace, is measured on the same twelve layers. A layer is known only when the listing or its certification page states it in so many words. Three layers are only ever stated on a certification page, so a listing without one is scored on the nine it can state.

  1. vendor identity
  2. model
  3. framework
  4. tools and MCP
  5. data sources
  6. integrations
  7. hosting (certification page only)
  8. data residency (certification page only)
  9. permission scope (certification page only)
  10. pricing
  11. access model
  12. support channel

Reach

Reach is the share of the layers a source can disclose that it actually does. It is a count of what is stated, not a judgement of what is stated.

Evidence risk

Evidence risk is the share of the build you cannot see before you deploy, not a security rating. It starts at the attestation level, then moves one band on how much of the build this source can disclose that it actually does. A High band means the listing says little about what is behind the agent. It does not mean the agent is unsafe.

Unknown means Unknown

If a source does not state something, the passport says Unknown. We never infer a value from a neighbouring field, substitute a sensible default, or copy a value the source does not contain. A stated build fact is recorded only when that exact string appears in the capture, and the database enforces it.

What changed

Because captures are kept, the registry can say when a listing re-priced, dropped a plan, or changed a claim. The recent changes page lists pricing and plan changes today; other kinds of change are recorded but not yet surfaced there.

Maintained by Niles Madison, Chief Product Officer. Last reviewed 4 September 2026. Questions and corrections: support@settletop.com.