Create No Code Powerful AI Agents – Azure AI Foundry
Introduction
An AI agent is a smart program that can think, make decisions, and do tasks. Sometimes it works alone, and sometimes it works with people or other agents. The main difference between an agent and a regular assistant is that agents can do things on their own. They don’t just help—you can give them a goal, and they’ll try to reach it.
Every AI agent has three main parts:
- Model: This is the brain that helps the agent understand language and think.
- Instructions: These tell the agent what it should do and what rules to follow.
- Tools: These help the agent find information or take action.
Agents can take input like a message or a prompt and respond with answers or actions.
For example, they might look something up or start a process based on what you asked.
Azure AI Foundry is a platform that brings all these things together; so you can build, train, and manage AI agents easily.
References
Usage
Firstly, we create a project in Azure AI Foundry.
I'm currently using GPT-4o Mini. It also includes descriptions for all the available models.
Then we configure the deployment details.
There are multiple deployment types available such as -
Global Deployments
- Global deployments [GlobalStandard] use Azure’s worldwide network to automatically send requests to the most available data center.
This provides high usage limits and removes the need for manual load balancing.
For apps with heavy, steady traffic, response times may vary.
To reduce delays and ensure consistent performance, consider using provisioned throughput. - Global Provisioned [GlobalProvisionedManaged] deployments also use Azure’s global network but include reserved processing power.
They're designed for high and predictable workloads, offering better performance and reliability at scale. - Global Batch [GlobalBatch] is made for processing large amounts of data efficiently and at a lower cost—around 50% cheaper than global standard.
Instead of sending requests one by one, you send them all at once in a file. The system processes them asynchronously within 24 hours.
It also uses a separate quota, so it doesn’t affect your live traffic.
- Data Zone Standard [DataZoneStandard] deployments send requests to the best data center within a Microsoft-defined data zone, using Azure's global network.
They offer higher default quotas than region-based setups. However, if your traffic is steady and high, response times may vary.
For more stable performance, go with provisioned deployments. - Data Zone Provisioned [DataZoneProvisionedManaged] deployments also operate within a Microsoft-defined data zone but with reserved model capacity.
This ensures more consistent and reliable performance, especially for high-volume workloads. - Data Zone Batch [DataZoneBatch] deployments work just like Global Batch, but all processing happens inside a specific Microsoft-defined data zone.
It’s ideal for large-scale tasks where data residency within that zone is important.
Standard deployments [Standard] follow a pay-per-use model perfect for getting started quickly.
They're best for low to medium usage with occasional traffic spikes.
They're best for low to medium usage with occasional traffic spikes.
However, for high and steady loads, performance may vary.
Provisioned deployments [ProvisionedManaged] let you pre-allocate the amount of processing power you need.
This is measured using Provisioned Throughput Units (PTUs).
This is measured using Provisioned Throughput Units (PTUs).
Each model and version requires a different number of PTUs and offers different performance levels.
Provisioned deployments ensure predictable and stable performance for large or mission-critical workloads.
This is how the deployment details look for in Global Standard.
Once the deployment is completed, you can give your agent a name and some instructions for their behavior. You should specify the tone, end goal, verbosity, etc as well.
You can also specify the Temperature and Top P values which are both a control on the randomness or creativeness of the model.
Temperature controls how bold or cautious the model is.
Lower temperature = Safer, more predictable answers. (Factual Q&A, Code Summarization)Higher temperature = More creative or surprising answers. (Poetry/Creative writing)
Top P (Nucleus Sampling) controls how wide the model’s word choices are.
Lower Top P = Only picks from the most likely words. (Legal or financial writing)
Higher Top P = Includes less likely, more diverse words. (Brainstorming names)
For this example, I'll just upload a single file.
However, you have the option to add an sharepoint folder or files, connect it to Bing Search, MS Fabric, Azure AI search, etc as required.
A Vector store in Azure AI Foundry helps your AI agent retrieve relevant information based on meaning rather than just keywords.
It works by breaking your content (like a PDF) into smaller parts, converting them into numerical representations (embeddings), and storing them.
When a user asks a question, the AI finds the most semantically similar parts from the vector store and uses them to generate accurate, context-aware responses.
It works by breaking your content (like a PDF) into smaller parts, converting them into numerical representations (embeddings), and storing them.
When a user asks a question, the AI finds the most semantically similar parts from the vector store and uses them to generate accurate, context-aware responses.
To "play around" with your model, click on the "Try in Playground" button.
Everytime the agent is invoked for processing the provided input is called a "run".
Every interaction session with the agent is called a "thread".
We can see all the open threads in the threads section.
Conclusion
Azure AI Foundry makes it easy to build and use AI agents without writing any code.
You can choose models, set how they behave, and connect your own data all through a simple interface. Whether you're testing ideas, automating tasks, or building custom bots, Foundry gives you the tools to do it.
If you’re curious about AI or want to try building your own agent, Foundry is a great place to begin.
If you’re curious about AI or want to try building your own agent, Foundry is a great place to begin.
Comments
Post a Comment