Question
A company tunes a fraud model repeatedly using the same validation set until metrics look strong. The model then performs poorly on a fresh holdout set. What happened?
Flashcard practice
Practice multiple choice certification questions for AWS Certified AI Practitioner and review the explanation after each answer.
A company tunes a fraud model repeatedly using the same validation set until metrics look strong. The model then performs poorly on a fresh holdout set. What happened?
Read aloud starts automatically.
Guest checks show correctness and the answer key. Log in to save history and unlock evaluator notes.
i Review the explanation and try similar questions to strengthen your understanding.
Issue reporting
Clara
Search across lessons, syllabus topics, provider capabilities, and certification questions.