Short answer
Yes. Most organisations start with an AI security assessment and shadow AI discovery for one team, then expand.
In detail: Starting Small with AI Security
From there you add prompt and data controls, AI Gateway for your own applications, or MCP server portals for AI agents as the need grows.
The assessment covers which AI tools, agents and data are in play for that team and where the gaps are. Controls start in logging mode and only move to blocking once the rules are proven, so nobody is cut off by surprise. When the first team is settled, the same policies extend to the next team with the approved tools and data rules already agreed with your risk owners.