Watch the explanation. Practice the skill.
Evaluation and observability
Test whether an AI result meets the task, not just whether it contains a keyword.
Captions appear here during playback.
Evaluation and observability
Test whether an AI result meets the task, not just whether it contains a keyword.
Video playback is unavailable. Read the descriptive transcript below, go directly to practice, or open the video file.
Source-based teaching example · Fictional data · Reviewed 2026-10-03. Microsoft Mark · locally synthesized. On a small screen, use fullscreen for diagram details or read the transcript.
Read the descriptive transcript
0:00 · What you will learn
Test whether an AI result meets the task, not just whether it contains a keyword.
What appears on screen
Test whether an AI result meets the task, not just whether it contains a keyword.
0:08 · The idea
Write checks tied to what a good result means. Include misleading wording and important failures. Review unclear judgments and test the logging rules separately.
What appears on screen
Write checks tied to what a good result means. Include misleading wording and important failures. Review unclear judgments and test the logging rules separately.
0:21 · One useful term
Evaluation. Testing results against defined expectations using suitable cases.
What appears on screen
Testing results against defined expectations using suitable cases.
0:30 · A worked example
A keyword check finds “logistics” inside “no logistics experience” and passes it. The word is present, but the meaning is the opposite of the desired claim.
What appears on screen
A keyword check finds “logistics” inside “no logistics experience” and passes it. The word is present, but the meaning is the opposite of the desired claim.
0:43 · Your turn to think
Does the right keyword prove that the required experience is stated? Pause and decide before continuing.
What appears on screen
Does the right keyword prove that the required experience is stated? Pause the video if you need more time.
1:00 · Why this answer works
No. Check meaning and evidence. Treat a keyword test as an early screen, not a complete quality judgment.
What appears on screen
No. Check meaning and evidence. Treat a keyword test as an early screen, not a complete quality judgment.
1:11 · Check 1
Keep stable test-case IDs.
What appears on screen
Keep stable test-case IDs.
1:16 · Check 2
Report important failures separately.
What appears on screen
Report important failures separately.
1:21 · Check 3
Check that logs contain only allowed fields.
What appears on screen
Check that logs contain only allowed fields.
1:27 · Now try a different case
Open the lesson and try its different practice case. Use every check in the full task. Watching alone does not mark the lesson complete.
What appears on screen
Open the lesson Try the new case Check and revise The full task and its requirements are in the linked lesson.
Watching explains the example. Complete the lesson practice to check what you can do. Explore all visual lessons →