You choose which AI models your Visibility Audit runs against, and you can change that selection at any time from your project settings.
Does Gumshoe add new models to my audit for me?
Only when a model you already have moves to a newer version. Gumshoe keeps your existing selection on the most recent version of each model, so you do not have to manage version numbers.
A brand new model is different. When a model family is added to Gumshoe, it appears in your Model families list unselected, and your audit carries on exactly as before until you add it yourself. That is deliberate: adding a model changes what your audit measures and what it costs, so it is your call rather than an automatic change.
If you want to know what is newly available, open your project settings and look through the Model families list for anything that is not ticked.
How do I change which models my audit uses?
- Open your project and click Settings in the left menu, under Project.
- Scroll to the Model families section.
- Check or uncheck the models you want. They are grouped by provider, with a checkbox for each one.
- Scroll to the bottom of the page and click Save to confirm your changes.
Your next scheduled Visibility Audit will use the updated set of models. Runs that have already happened are not affected.
Does adding a model change what I pay?
It can. Every model you select answers every prompt in your audit, so your conversation total is your prompt count multiplied by your model count. Adding one model adds one conversation per prompt per run.
The Model families section recalculates that total as you tick and untick, and shows it just below the list, so you can see the effect before you save. If the new total goes past the conversations included with your plan, the extra conversations are billed as overage.
What happens if I remove a model?
Results you have already collected from that model stay in your past runs. Future runs simply will not include it.
Worth knowing either way: your visibility score reflects the mix of models in your audit, so a run with a different set of models is not directly comparable to the runs before it. Treat the first run after a change as a new baseline rather than a month-over-month comparison.
How can I tell what a model is and whether it searches the web?
Select the help icon next to any model. The tooltip describes the model, who typically uses it, and whether it has live web search turned on in Gumshoe.
You will also see some models listed with (Web Search) in the name. Those run with live web search, and they return the source URLs that feed your Citations. A model without it answers from what it learned during training and returns no sources.
Check the tooltips rather than relying on a list in an article. Providers release new models often, and the list in your settings is always the current answer.
See also: A new AI model was added. Do I need to do anything?