Microsoft Developing AI Apps and Agents on Azure (AI-103) Free Practice Test
Question 1
You are building a speech processing solution in Microsoft Foundry for a customer support platform.
The platform will transcribe live phone calls, so that supervisors at your company can view call transcripts and detect issues while the calls are in progress. The call audio will arrive as a continuous stream from the telephony system.
You need to ensure that the call transcripts appear within only a few seconds of the audio stream.
What should you do?
The platform will transcribe live phone calls, so that supervisors at your company can view call transcripts and detect issues while the calls are in progress. The call audio will arrive as a continuous stream from the telephony system.
You need to ensure that the call transcripts appear within only a few seconds of the audio stream.
What should you do?
Correct Answer: C
Explanation: Only visible for TestSimulate members. You can sign-up / login (it's free).
Question 2
You need to configure an indexing pipeline for Agent1 to retrieve the relevant product information in storage1. The solution must meet the technical requirement.
Which two built-in skills should you use? Each correct answer presents part of the solution.
NOTE: Each correct selection is worth one point.
Which two built-in skills should you use? Each correct answer presents part of the solution.
NOTE: Each correct selection is worth one point.
Correct Answer: D,E
Explanation: Only visible for TestSimulate members. You can sign-up / login (it's free).
Question 3
You have a customer support agent built by using the Microsoft Foundry Agent Service. The agent calls an Azure OpenAl model deployment.
During load testing, calls intermittently fail and return an HTTP 429 rate limit exceeded error.
You need to handle throttling to reduce call failures and improve reliability under load. The solution must remain within the service and model limits.
What should you do?
During load testing, calls intermittently fail and return an HTTP 429 rate limit exceeded error.
You need to handle throttling to reduce call failures and improve reliability under load. The solution must remain within the service and model limits.
What should you do?
Correct Answer: C
Explanation: Only visible for TestSimulate members. You can sign-up / login (it's free).
Question 4
You need to recommend a plan to create a customer support agent by using the Microsoft Foundry Agent Service. The agent must meet the following requirements:
* Retain user preferences across multiple conversations.
* Enable users to provide contextual grounding by directly uploading documents during a chat.
Which Foundry capability should you recommend for each requirement? To answer, select the appropriate options in the answer area.
NOTE: Each correct selection is worth one point.
* Retain user preferences across multiple conversations.
* Enable users to provide contextual grounding by directly uploading documents during a chat.
Which Foundry capability should you recommend for each requirement? To answer, select the appropriate options in the answer area.
NOTE: Each correct selection is worth one point.
Correct Answer:
Explanation:
To retain user preferences across conversations, use: Agent memory that uses persistent storage To enable users to provide contextual grounding during chats, use the: file search tool The correct capability for retaining user preferences is agent memory that uses persistent storage .
Microsoft Foundry Agent Service memory is a managed long-term memory capability that enables continuity across sessions, devices, and workflows. It is specifically intended to let agents retain user preferences, maintain relevant historical context, and personalize responses across separate conversations. Memory stores provide the persistent storage layer, and scope can be used to segment memories for secure user-specific experiences.
The correct capability for contextual grounding from user-uploaded documents is the file search tool .
Microsoft describes file search as the tool that enables Foundry agents to search through documents and retrieve relevant information from outside the base model, including proprietary product information and user- provided documents. The file search workflow supports uploading files, creating a vector store, enabling the tool on the agent, and querying those documents through the agent.
Conversation history alone supports continuity within a conversation, but it is not durable preference memory across multiple conversations. An Azure AI Search tool is better for preconfigured enterprise indexes, while file search is the direct document-upload grounding capability. Reference topics: Foundry Agent Service memory, memory stores, File Search tool, vector stores, and grounded agent responses.
Question 5
You have a Microsoft Foundry project that contains a customer support agent grounded in internal documentation.
After a recent update, users report the following issues:
* Some answers are unsupported by retrieved documents.
* A small number of responses are flagged for policy violations.
You need to evaluate each issue.
Which observability signals should you use for each issue? To answer, drag the appropriate observability signals to the correct issues. Each observability signal may be used once, more than once, or not at all. You may need to drag the split bar between panes or scroll to view content.
NOTE: Each correct selection is worth one point.
After a recent update, users report the following issues:
* Some answers are unsupported by retrieved documents.
* A small number of responses are flagged for policy violations.
You need to evaluate each issue.
Which observability signals should you use for each issue? To answer, drag the appropriate observability signals to the correct issues. Each observability signal may be used once, more than once, or not at all. You may need to drag the split bar between panes or scroll to view content.
NOTE: Each correct selection is worth one point.
Correct Answer:
Explanation:
Unsupported responses: Groundedness evaluation metrics
Policy violations: Risk and safety metrics
For unsupported responses, use Groundedness evaluation metrics . In a Retrieval Augmented Generation scenario, the key question is whether the generated answer is supported by the retrieved context. Microsoft Foundry built-in evaluators define Groundedness as the RAG metric that measures how grounded a response is in retrieved context and returns a model-based score; Groundedness Pro evaluates whether the response is grounded in retrieved context by using Azure AI Content Safety. This directly matches answers that are unsupported by internal documentation.
For policy violations, use Risk and safety metrics . Microsoft Foundry risk and safety evaluators assess generated responses for safety risks such as hate and unfairness, sexual content, violence, self-harm, protected material, indirect attacks, code vulnerability, ungrounded attributes, prohibited actions, and sensitive data leakage. The guidance states that these evaluators assign risk and safety severity or pass/fail outcomes for AI responses and agent behavior.
Latency breakdown traces diagnose performance, not correctness or policy compliance. Token usage analytics diagnose cost and prompt/response size, not unsupported claims or safety violations. Reference topics:
Microsoft Foundry observability, RAG evaluators, groundedness, risk and safety evaluators, and agent quality evaluation.
Question 6
You have a Microsoft Foundry project that contains an agent and an image generation model deployment.
The agent generates original images from user-supplied product photos.
You need to ensure that the generated images maintain the product identity and visual characteristics of the provided photo.
What should you do?
The agent generates original images from user-supplied product photos.
You need to ensure that the generated images maintain the product identity and visual characteristics of the provided photo.
What should you do?
Correct Answer: C
Explanation: Only visible for TestSimulate members. You can sign-up / login (it's free).
Question 7
You have a Microsoft Foundry project that contains a prompt agent used by a customer support web app.
The agent is invoked from a Python service that does NOT run in the Foundry portal.
You need to implement end-to-end tracing to capture latency breakdowns and exceptions across agent runs.
Which two components can you use? Each correct answer presents a complete solution.
NOTE: Each correct selection is worth one point.
The agent is invoked from a Python service that does NOT run in the Foundry portal.
You need to implement end-to-end tracing to capture latency breakdowns and exceptions across agent runs.
Which two components can you use? Each correct answer presents a complete solution.
NOTE: Each correct selection is worth one point.
Correct Answer: A,C
Explanation: Only visible for TestSimulate members. You can sign-up / login (it's free).