Cross-platform desktop app that probes any Anthropic-compatible
/v1/messages endpoint to verify whether it's genuinely
Claude — or a silently-swapped GPT, Qwen, DeepSeek, Llama, Gemini,
or other model behind a proxy.
Five categories, 47 carefully-tuned probes. Each one targets a specific behavior that's hard to fake.
Who the endpoint claims to be, knowledge cutoff, creator, training methodology, and whether it corrects false claims like "I am ChatGPT…".
DAN, "ignore previous instructions", grandma exploit, base64-encoded request, evil-twin roleplay.
Tiananmen, Taiwan, Xinjiang, Hong Kong, Xi, Falun Gong, Pooh — TH/ZH/EN. Catches Chinese-trained models behind a proxy.
Flattery + framework probe, system-prompt leak, infra probe, implicit-owner traps, forced multiple-choice, sentence-completion, wrapper trap.
Math chain-of-thought, strict JSON, Thai language, Unicode round-trip, long-context needle-in-haystack.
Each response is compared against 5 reference samples per probe via character-bigram cosine similarity. Language-agnostic, no tokenizer needed.
Every request matches real claude-cli traffic: User-Agent, X-Stainless-*, anthropic-beta, system block, full tools array, and sha256(api_key) in metadata.
If the model replies with only a tool_use turn, the chat IPC silently retries without tools so the verdict has usable text to match.
Runs 4 probes in flight. Stop mid-run → press ↻ Resume to continue only the remaining. Final report combines everything.
When a run finishes, the Markdown report is silently saved to reports/ and published to a paste host. URL on clipboard.
Share probe sets as portable JSON. Anyone can drop a pack into the app — no fork, no PR, no build step required.
Coefficient-of-variation flags uniform proxies. Avg chars-per-output-token and stop_reason mix add a signal beyond keywords.
Pre-built binaries on every release. Source build is also one command (./run.sh or run.bat).
/Applications/, open Terminal and run once:
xattr -cr "/Applications/Claude Verifier.app"
chmod +x Claude*.AppImage. The .deb installs with sudo dpkg -i Claude*.deb.
Both macOS and Windows show these warnings for any open-source desktop app that isn't signed with a paid Apple / Microsoft developer certificate. The workarounds are one-time per install.
The project gets stronger every time someone adds a high-signal probe. Anyone who's caught a sneaky proxy in the wild can package the prompt that caught it and drop it back into the app — no fork, no PR, no build.
Tick the probes you want to ship → catalog header → ⬇ Export. Save the JSON. Share anywhere — GitHub Gist, Discussions, your blog, Discord.
Click ⬆ Import, pick someone else's pack. New probes appear in your catalog with a custom badge and persist across restarts.