Azure AI Foundry to Microsoft Foundry: The Platform Evolution Architects Need to Know

Microsoft used Ignite 2025 to send a clear message: AI tooling is no longer meant to be fragmented. Azure AI Foundry is now Microsoft Foundry—a more unified, streamlined platform for building and managing AI agents. The rebrand signals Microsoft’s move toward an agent-first, enterprise-ready future with models, knowledge, and governance all in one place.

Here’s a look at what’s new, why the change is significant, and what to expect as organisations start adopting Microsoft Foundry.

A Quick Look at the Evolution

What is Microsoft Foundry?

Microsoft Foundry is a platform that helps you build AI agents—think of them as smart assistants that can understand questions, access information, and complete tasks automatically.

Here's a simple example: instead of manually searching through company documents to answer customer questions, you could create an AI agent that does this instantly. The agent searches, finds the right information, and provides accurate answers—all in seconds.

Microsoft Foundry includes everything you need:

  • A web portal where you work (formerly called Azure AI Studio)

  • Programming tools (SDKs) for Python and C#

  • Pre-built AI capabilities you can use right away

  • Templates to get started quickly

The Main Parts of Microsoft Foundry

Think of Microsoft Foundry as having six main parts that work together:

1. Models: Choose the Right AI Brain

Models are the AI "brains" that power your agents. Microsoft Foundry now offers access to over 11,000 different models. Why so many? Because different tasks need different capabilities.

Think of models like tools in a toolbox:

  • Quick fixes? Use a small, lightweight tool (like a screwdriver).

  • Heavy, complex tasks? Use a powerful tool (like a power drill).

  • Special cases? There’s always a specialized tool built for that job.

Some popular models now available:

  • Claude models (Sonnet 4.5, Opus 4.1, Haiku 4.5) - Great for long conversations

  • GPT models from OpenAI - Excellent for general tasks

  • Llama 3.3 from Meta - Good open-source option

  • Specialized models for specific industries

Model Router is a new feature that automatically picks the best model for each task, balancing speed, quality, and cost. It's like having a smart assistant that chooses the right tool for each job.

2. Agent Service: Where Your Agents Live and Work

The Agent Service is where you deploy your AI agents so people can actually use them.

Three important features:

Hosted Agents: Deploy your agent without worrying about servers or infrastructure. Microsoft handles all the technical stuff behind the scenes. Just build your agent and click deploy.

Multi-Agent Workflows: Create multiple specialized agents that work together. Here's how it works:

Example: For customer service, you might have:

  • A routing agent that figures out what the customer needs

  • A technical support agent that handles product questions

  • A billing agent that handles payment questions

Each agent is good at one thing, and they work together seamlessly.

Built-in Memory: Agents can remember previous conversations with users, making interactions feel more natural and helpful.

3. Foundry IQ: Help Agents Find Information

Foundry IQ connects your agents to different sources of information:

  • Files stored in Azure

  • SharePoint documents

  • Company databases

  • Information from the web

The clever part? It automatically checks permissions. If a user shouldn't see a document, the agent won't retrieve it for them.

4. Foundry Tools: Connect to Business Systems

Foundry Tools provides over 1,000 ready-made connections to systems like:

  • Salesforce (customer management)

  • SAP (business operations)

  • HubSpot (marketing)

  • UiPath (automation)

This means your agents can read from and write to these systems, just like a human user would.

Example: An agent could check a customer's order status in Salesforce, look up inventory in SAP, and send an update email—all automatically.

5. Control Plane: Manage Everything in One Place

The Control Plane is like a dashboard that shows you everything about your agents:

What you can do:

  • See all your agents in one place

  • Control who can use each agent

  • Monitor for security issues

  • Track costs and usage

  • View performance metrics

6. Foundry Local: Run Agents On Your Device

Foundry Local lets agents run directly on computers or devices, even without an internet connection. This is useful for situations where data privacy is critical or internet access is limited.

Agent 365: Managing Agents Across Your Organization

Think of Agent 365 as “Azure AD for Agents.”

It provides:

  • A registry of all agents

  • Identities for each agent

  • Access control

  • Compliance and threat detection

This works even if the agent isn’t built on Microsoft Foundry.

What This Means for Architects

The rebrand from Azure AI Foundry to Microsoft Foundry signals more than a name change—it represents Microsoft's strategic shift toward making AI agents a fundamental part of enterprise architecture. Here's what architects need to focus on:

1. Unified Control Becomes Reality

The new Foundry Control Plane closes long-standing governance gaps. Every agent now receives a Microsoft Entra Agent ID, enabling:

  • Identity-first design: Agents become part of your security fabric—not shadow IT

  • Built-in auditability: Full OpenTelemetry tracing

  • Consistent policy enforcement: Security controls apply everywhere

This works across GitHub, Visual Studio, and Copilot Studio—not just Microsoft-native deployments.

2. Multi-Cloud Strategy Gets Clearer

Microsoft Foundry now offers both OpenAI GPT and Anthropic Claude models in one platform—something no other cloud provider can claim. The Model Router automatically optimizes for cost, latency, and quality across this catalogue of 11,000+ models.

Architectural implication: Design model-agnostic systems—your AI layer should let you swap models without touching application logic.

3. Agent 365 Changes the Operating Model

Agent 365 extends identity and management to agents built anywhere—not just Microsoft tools. This matters because:

  • Your agent strategy can span multiple platforms while maintaining central governance

  • Security teams get unified visibility through Defender integration

  • Compliance teams can audit agent behaviour across the entire estate

Treat agents like applications: centrally registered, monitored, and policy-controlled.

4. Cost Architecture Needs Attention

Model Router's intelligent model selection can significantly reduce costs—early customer deployments reported up to 50% reduction in model costs—but architects need to design for cost optimization from day one:

  • Development environments: Use smaller, cheaper models for testing

  • Production routing: Let Model Router balance cost vs. quality dynamically

  • Provisioned capacity: Lock in predictable pricing for steady-state workloads

The Control Plane's cost tracking becomes your primary tool for FinOps on AI workloads. Build cost monitoring into your architecture review process.

5. Multi-Agent Patterns Are Now First-Class

The new multi-agent workflows capability changes how we think about system design. Instead of monolithic agents, design for:

  • Specialist agents: Each focused on one domain (billing, technical support, analytics)

  • Orchestration layers: Router agents that direct requests to appropriate specialists

  • Graceful degradation: If one agent fails, others continue operating

Traditional approaches will give way to multi-agent patterns as shown below:

This architectural pattern improves maintainability, reduces blast radius, and enables independent scaling.

6. Integration Becomes Easier

With Managed Instance on Azure App Service, existing .NET apps can adopt AI incrementally.
Foundry’s 1,000+ connectors (MCP + OpenAPI) mean integration follows familiar patterns—no reinvention.

7. Security is Built-In, Not Added On

Defender + Purview + Entra Agent ID give agents the same protection as enterprise apps:

  • Zero-trust access

  • Data classification and policy enforcement

  • Threat monitoring

  • Observability for anomalies

Security teams get full visibility from day one.

Action Items for the Next 6 Months

Next 30 Days

  • Inventory existing Foundry deployments

  • Train teams on the new Control Plane

  • Review current AI governance gaps

Next 90 Days

  • Define your Entra Agent ID strategy

  • Pilot a multi-agent workflow

  • Establish baseline cost monitoring

Next 6 Months

  • Migrate current AI projects into Foundry governance

  • Build reusable reference architectures

  • Integrate agent monitoring into SOC processes

Final Thoughts

Microsoft Foundry marks a shift in how enterprises will design, govern, and operate AI systems. For architects, the opportunity is clear: reshape your patterns now so your organization can move faster, stay secure, and control costs as AI becomes a foundational layer - not an add-on.

If you found this useful, tap Subscribe at the bottom of the page to get future updates straight to your inbox.

Keep Reading

No posts found