Gumshoe connects directly to AI models through their APIs rather than using public web interfaces. This approach provides a controlled testing environment that ensures consistent, unbiased results reflecting how AI models truly perceive brands. We also run periodic cross-checks to confirm our API responses align with real-world interface results. This method lets us introduce the necessary context and personalization biases for testing while preventing the models from skewing their answers toward Gumshoe itself.
Gumshoe connects directly to major AI models via their APIs rather than scraping their public chat interfaces. This approach ensures that every test is consistent, controlled, and reflective of how AI models behave in the real world, without the noise of user-specific bias.
Why We Use APIs Instead of Interfaces:
- Controlled Environment: Each query begins with a clean state with no cookies or chat history. Then Gumshoe communicates the ideal personas and their traits to the LLMs, creating a controlled reproduction of logged-in user experiences.
- Consistency and Reproducibility: The API allows us to standardize prompts and conditions across models, making it possible to measure brand visibility with confidence. Scraping produces wild differences in model responses and triggers more model hallucinations.
- Transparency and Compliance: Gumshoe works directly with all major AI model providers and uses their services in full compliance with each model's Terms of Service. Gumshoe also communicates closely with the models to ensure the API remains "true" to the real-world user experience.
How We Ensure Accuracy:
Gumshoe regularly compares API-based results to those generated through the model's native interface (like ChatGPT or Gemini). This testing verifies that API outputs closely mirror real-world responses that users would encounter.
See these articles for more information:
- How Does Gumshoe Ensure Accurate AI Search Results for My Brand?
- How does Gumshoe ensure unbiased and consistent results?
The Result:
Brands get visibility data that is both fair and realistic, capturing how AI models perceive them, without distortion from personalization or user history. This makes Gumshoe's insights more accurate, more consistent, and ultimately more actionable than those of other tools that rely solely on scraping public interfaces.