What Scale and Google Cloud Just Published
On September 22, 2026, at the Google Cloud Doha Summit, Scale AI and Google Cloud released a joint reference architecture for deploying enterprise AI agents on Google Cloud infrastructure, integrated with Gemini Enterprise. The document gives technical teams a documented deployment pattern, specifying how the Scale GenAI Portfolio (SGP) connects to Google Cloud services, rather than leaving teams to resolve each integration independently (Scale AI, September 22, 2026).
The reference architecture addresses a problem that every organization adopting AI agents eventually hits: getting a pilot to work is only part of the job. Running it in production requires decisions about infrastructure, enterprise data, access controls, and ongoing performance evaluation. Those decisions often take more work than the initial prototype.
How the Architecture Works
The reference architecture connects two ecosystems:
Google Cloud's Role
- Infrastructure: Google Kubernetes Engine (GKE), GPUs, TPUs for compute
- Models: Access to Google and third-party models through Vertex AI
- Identity and governance: Shared governance framework with identity, data loss prevention, audit, and spending controls
- Gemini Enterprise: The employee-facing interface where agents are discovered and used within existing workflows
Scale's Role
- SGP (Scale GenAI Portfolio): Agent development, orchestration, and deployment
- Evaluation and tracing: Built-in evaluation, tracing, and human review capabilities
- Domain expertise: Delivery teams that remain involved after deployment
- Language support: Including specialized Arabic-language capabilities for MENA deployments
Key Interoperability Standards
The architecture uses two open standards for agent interoperability:
- A2A (Agent-to-Agent): Allows agents built in one system to be called by another
- MCP (Model Context Protocol): Standardizes how agents connect to enterprise data sources and tools
An agent built and evaluated in SGP is deployed within the customer's Google Cloud project using their own VPC and encryption keys. The same agent can then be made available through both a dedicated business application and through Gemini Enterprise, without rebuilding its underlying logic.
What This Means for Smaller Organizations
The reference architecture is aimed at large enterprises, but it surfaces design decisions that apply regardless of your size.
The One-Use-Case Principle
Scale reports that across deployments in MENA and globally, success starts with identifying one use case that has a clear owner and a measurable outcome. This mirrors what we have seen in practice: organizations that try to deploy multiple agents simultaneously across disconnected workflows struggle with evaluation and ownership, while those that pick one well-defined use case build the operational muscle for subsequent deployments.
Standardized Interfaces Reduce Lock-In
The choice of A2A and MCP as interoperability standards is significant. It means an agent built today can be exposed through Gemini Enterprise, a custom application, or potentially another platform later, without a rebuild. For smaller organizations, this principle matters even more: choosing platforms that support open standards reduces the risk of being trapped in a single vendor's ecosystem.

Evaluation as a Deployment Requirement, Not an Afterthought
The architecture embeds evaluation, tracing, and human review into the deployment pipeline. This is a design decision that many smaller organizations skip, treating evaluation as something to add later. Scale's approach makes it a structural component: you establish what acceptable performance looks like before launch and how the team will monitor it afterward.
Comparing This to Other Enterprise Agent Platforms
| Feature | Scale + Google Cloud | Microsoft Copilot Studio | Salesforce Agentforce |
|---|---|---|---|
| Interoperability standards | A2A + MCP | Copilot Studio API | Agentforce API |
| Employee-facing interface | Gemini Enterprise | Microsoft 365 Copilot | Salesforce CRM |
| Evaluation built in | Yes (SGP) | Limited (via Copilot Analytics) | Limited (via Einstein Trust Layer) |
| VPC deployment | Customer VPC + encryption | Customer tenant | Salesforce cloud |
| Model flexibility | Google + third-party via Vertex | OpenAI + select others | Primarily Salesforce + select partners |
This comparison is not exhaustive, but it highlights a key differentiator: Scale and Google Cloud have made interoperability standards and evaluation structural rather than optional.
The Practical Implication: Infrastructure Decisions Precede Agent Decisions
The most important takeaway from the reference architecture is not about any single component. It is the implicit argument that infrastructure decisions, governance decisions, and evaluation decisions precede agent decisions. Organizations that start by building an agent and then try to retrofit governance, security, and evaluation are doing the work backwards.

For small and mid-sized businesses, the lesson is transferable. You do not need GKE or TPUs, but you do need to answer these questions before building:
- Where will the agent run? Your cloud environment or a managed platform?
- What data will it access? And how is that access controlled?
- How will you evaluate performance? What does success look like, and who monitors it?
- What interoperability standards does your platform support? Can your agent move to another interface later?
- Who owns this use case? If the answer is "everyone," no one owns it.
These questions map directly to the sections of Scale and Google Cloud's reference architecture, just at a different scale.
What This Does Not Solve
The reference architecture does not address the organizational change management that determines whether an agent adoption succeeds. It does not address the cultural readiness of teams, the decision rights around agent behavior, or the change management needed when agents start handling work that people used to do. Microsoft's Frontier Playbook, published earlier in 2026, argued that workflow redesign, proprietary evaluations, data, and feedback loops can matter more than the technology choice. Both perspectives are worth holding at once: the infrastructure matters, and so does the human system around it.
Read next:
- What AI Agent Implementation Actually Costs Small Businesses in 2026
- HBR: AI-Generated Ads Perform 14% Worse Than Human-Made Ones
- Wiz MCP Agent Integrations: A New AI Security Layer
- CMI 2026: 95% of B2B Marketers Use AI, Only 39% See Results
Thinking about deploying your first AI agent? Contact Vivid for a deployment plan that fits your scale.



