Is AI rank tracking actually meaningful? Or just a vanity metric?

I work at a Series B SaaS with \~$8M ARR, PLG motion with a sales team to help bigger clients get started. I manage growth, and our CEO just got back from a conference and suddenly wants AI visibility added to our monthly metrics dashboard.

So I’ve done a deep dive into AI rank tracking. And I know buyers are asking ChatGPT, Gemini, etc which tools to use before they ever (if they ever) do a Google search. So if we’re not showing up in those responses we’re losing TOFU without even realizing it. I get that.

But I’m stuck on what ranking even means in an LLM context. Google rankings are deterministic. LLM outputs are very much not. The same prompt returns different results depending on the day, the user, whatever. And even if a tool tells me I’m ranking #2 for [insert KW], what does that even mean? I don’t see how that’s a real signal I can act on. More importantly, I have yet to see a case study that draws a direct line from AI citations to revenue. How does any of this connect to the pipeline?

TLDR: Is AI rank tracking a meaningful input for decisionmaking?

Author: BiGbAnG050702