miatz™
Verify a credentialLog inSit ChuunSit Chuun
  • Learners
  • Mentors
  • Business
CoursesApplied AIProgramResidencyPlaygroundsWar RoomsXookAtlasReadiness Check
miatz

The AI-era engineering institute. The machines got fast — we train the drivers. Real work, a daily loop that compounds, and a record that proves you can think.

Toggle theme
Explore
  • Courses
  • Applied AI
  • Program
  • Residency
  • Playgrounds
  • War Rooms
  • Xook
  • Atlas
  • Readiness Check
  • Tokenizer Lab
  • Chunking Lab
  • Prompt Anatomy
  • Calibration Lab
  • All playgrounds →
Learn
  • Courses
  • The Method
  • The Residency
  • Chuun · Entrance Examination
  • Manifesto
  • The Itz'at credential
  • Verified engineers
  • Playground Catalog
  • AI Use-Case Atlas
  • AI Readiness Check
  • Guides
  • Glossary
  • Compare approaches
  • Blog
  • What's New
For teams
  • For Students
  • For Mentors
  • For Business
  • Classroom migration
  • Miatz Index
  • API reference
  • Sit Chuun
  • Log in
Company
  • About
  • Experts
  • Why it's free
  • Pricing
  • FAQ
  • Contact
  • Privacy Policy
  • Terms of Service
  • Your data & privacy requests
  • Grievance redressal
  • Security & disclosure
  • Subprocessors
  • Data Processing Agreement
Take miatz with you

The Android app is live. iOS is on the way.

Available on AndroidGet it on Google Play
Not yet on iPhoneiOS — use the web app

Miatz Private Limited

Registered office:
C-101, Lotus Tower, Arge Urban Bloom, 30/A, 4th Main, 2nd Stage, Yeswanthpur, Bengaluru, Karnataka 560022, India
CIN:
U62013KA2026PTC226418
GSTIN:
29AAVCM3922D1Z6
Phone:
+91 82802 73456
Email:
hello@miatz.com
Website:
miatz.com
Grievance Officer:
Aishwarya · aishwarya@miatz.com · replies within 30 days
© 2026 miatz · Miatz Private Limited · Built in Bangalore·PrivacyTerms

miatz™, Itz'at™, Tuukul™, T'aan™, Kanan™, Xook™ and Chuun™ are trademarks of Miatz Private Limited (registrations in progress) · what the names mean

miatz
AI Engineering · 400-level

Evals & Quality Systems

Sit Chuun — free All modules
AIE-4013 creditscorebadge: evaluatorprereqs: AIE-203, AIE-301
Start this course — free

Earn the evaluator credential

What's inside

Sections & lessons

01

Golden datasets & rubric design

  • Writing the 20 cases a system must passconcept45 min
02

Code graders vs. LLM-as-judge

  • Deterministic checks next to a judge model, run togetherconcept60 min
03

The disagreement heat-map

  • Where the code grader and the AI judge part waysconcept60 min
04

Grader-hacking

  • Crafting an output that fools the judge but still fails the code graderconcept60 min
05

Reward-model bias & judge drift

  • Teaching a simple reward model your own bias, then seeing itconcept60 min
06

Quiz: eval-design judgment

  • Checkpoint on rubric gaps and grader-hacking riskconcept30 min
07

Lab + eval-gate: golden set + grading suite

  • 20-case golden set, two graders, threshold pass (Evaluator badge)concept120 min
Start this course — free
Learn it from the inside

This module's playgrounds

  • Evals Runner

    Coming soon

    Where the code grader and the AI judge disagree, look closer.

    AiAIE-401BYOK AIMedium
    Play it now

  • Train the Judge

    Coming soon

    You train the judge, then we expose its bias.

    AiAIE-401BYOK AIMedium
    Play it now
AI Engineering

Next in this path

Where this specialization goes from here — in (level, code) order.

  • AIE-402

    LLMOps: Cost, Latency, Observability

    3 creditselectivebadge: operator
    Start
  • AIE-403

    AI System Design

    3 creditselectivebadge: architect
    Start
  • AIE-490

    Capstone: Ship & Evaluate an AI System

    4 creditscapstonebadge: ai-engineer
    Start
Vocabulary

Key concepts in this course

Golden Dataset Code Grader LLM-as-Judge Eval Gate

Compare related approaches

Code Grader vs LLM-as-Judge
Optional · watch & try

Go deeper, elsewhere

Hand-picked public explainers and open tools — always optional, never required, never graded.

Introduction to LLM Evaluations – Model Evals vs Application EvalsDistinguishes model-level evals from application-level evals Intro to LLM Evaluation w/ OpenAI Evals [Walk-Thru]Hands-on walkthrough building a golden-set eval How to Systematically Setup LLM Evals (Metrics, Unit Tests, LLM-as-a-Judge)Covers code graders vs. LLM-as-judge tradeoffs PromptfooFree open-source tool for running golden-set evals and red-team tests against prompts

This module ends in a gate you can fail.

That's what makes passing it mean something. Sit Chuun, get placed, and start earning.

Sit Chuun — free All modules