Microsoft · AB-100
Testing AI solutions
AB-100 · Lesson 11 of 15 · 1:14:54
YouTube loads only after you press play. This chapter opens at its timestamp in the full course. Watch on YouTube ↗
In this lesson
Prepare for the AB-100 exam (Microsoft Certified: Agentic AI Business Solutions Architect Expert). In this lesson: agent evaluation in Copilot Studio with test sets and methods, validation criteria and red teaming for custom models, end-to-end scenarios across Dynamics 365 apps, and test cases generated with AI. Includes three original practice questions.
Preview the topics
- A team fine-tuned a model, and reports great accuracy, measured on the same examples it trained on. What should the architect require?
- After a change to a Sales topic, an order process that continues in Supply Chain Management broke, and nobody noticed. What would have caught it?
- A team needs a first set of test questions for a new agent quickly, before any real users. What should it do in Copilot Studio?