Tutor playbook

How to learn with Beatriz Moura

A practical, profile-specific playbook for learning AI system evaluation, benchmark design, representative test sets, rubrics, golden examples, error taxonomies, human evaluation, automated metrics...

Updated August 22, 2026 8 min read Apply, rehearse, decide, and document
Beatriz Moura, AI evaluation, benchmarks, and red-teaming tutor AI tutor portrait Beatriz Moura AI evaluation, benchmarks, and red-teaming tutor
On this page

Best fit

Is Beatriz Moura right for your goal?

Learners who need evidence that an AI feature works for its actual users and risks, not just a high score on a convenient public benchmark.

Learning focus
AI system evaluation, benchmark design, representative test sets, rubrics, golden examples, error taxonomies, human evaluation, automated metrics, LLM-as-judge limitations, factuality, safety testing, red teaming, regression suites, online monitoring, and evaluation governance
Best level
AI builders, quality engineers, researchers, product teams, risk teams, technical leaders, and advanced students
Lesson format
Evaluation plans, rubric workshops, dataset audits, error labeling, pairwise comparisons, judge-calibration labs, red-team scenarios, regression reviews, and monitoring dashboards
Languages
Portuguese, English, Spanish basics

Tutor fit

Why choose Beatriz?

Compare teaching strengths, lesson style, and learner fit before you begin.

Best for
  • AI evaluation strategy and test sets
  • Rubrics, metrics, and human judgment
  • LLM-as-judge calibration and limits
  • Safety red teaming and error taxonomies
Strengths
  • Skeptical metric review
  • Clear rubric design
  • Failure-case curiosity
  • Careful judge calibration
Specialties
  • AI evaluation strategy and test sets
  • Rubrics, metrics, and human judgment
  • LLM-as-judge calibration and limits
  • Safety red teaming and error taxonomies
  • Regression suites and production monitoring
Teaching approach
Core methods: Skeptical metric review, Clear rubric design, Failure-case curiosity. Lesson format: Evaluation plans, rubric workshops, dataset audits, error labeling, pairwise comparisons, judge-calibration labs, red-team scenarios, regression reviews, and monitoring dashboards.
Example lesson
Define claims and risks, sample representative cases, write rubrics, select human and automated measures, calibrate judges, analyze failures, set thresholds, and monitor regressions.
Who benefits most
Learners who need evidence that an AI feature works for its actual users and risks, not just a high score on a convenient public benchmark.

Tutor comparison

Choose by learning goal

See where this tutor is strongest beside relevant alternatives. The comparison uses published specialties and teaching focus, not a made-up score.

Profile-based

Quality signals

What learners can verify

Live platform data

Published learner ratings and recorded VibeTutor activity. Counts are real platform totals, never simulated.

Not rated Student satisfaction Waiting for the first published learner rating
0 Completed lessons No recorded calls yet
0 Conversations 0 chats + 0 calls
Not yet Average session Available after the first 1+ minute lesson
Common learning goals Suggested from this tutor's published specialties
Profile-based
  • AI evaluation strategy and test sets
  • Rubrics, metrics, and human judgment
  • LLM-as-judge calibration and limits
  • Safety red teaming and error taxonomies

Profile-based goals are shown until at least 3 saved learner goals can form a private aggregate.

How these signals are calculated

Satisfaction converts the average of published learner ratings into a percentage.

Completed lessons counts recorded calls lasting at least one minute. Short starts under one minute are excluded.

Conversations counts recorded chat sessions and calls, while average session length uses completed lessons only.

Learning goals use broad categories after at least three saved goals; otherwise they are clearly marked as profile-based.

Lessons are focused and exact, with clear standards, careful reasoning, and direct feedback that respects the learner’s time.

Serious Precise Methodical
Strong starting points
  • AI evaluation strategy and test sets
  • Rubrics, metrics, and human judgment
  • LLM-as-judge calibration and limits
  • Safety red teaming and error taxonomies
  • Regression suites and production monitoring

Before lesson one

Plan a focused first session

Specific evidence gives Beatriz a better starting point than a broad request to teach the whole subject. Use this four-part setup.

  1. Arrive with evidence

    Bring a real scenario, draft, role description, dataset, plan, decision, meeting, or work sample. A real sample gives Beatriz something concrete to diagnose.

  2. Define one result

    Aim for one usable decision, communication, plan, analysis, or work sample. State that result in the lesson request so the automatic lesson focus stays useful.

  3. Attempt before the model

    Show what you currently think or can do. Ask for a hint or question before requesting the completed answer.

  4. Leave with retrieval

    Explain the lesson back, save the hardest point as a review card, and schedule the smallest useful follow-up.

Choose the right lesson mode

Text chat

Drafting professional material, comparing options, analyzing evidence, and keeping precise notes.

Paste the exact material and state the feedback format you want.

Voice call

Interviews, presentations, difficult conversations, negotiation, and thinking through decisions under questions.

Think aloud and ask Beatriz to pause after each correction or question.

Classroom

Case maps, roleplay, live documents, decision logs, plans, and portfolio-ready work samples.

Share each workspace explicitly so the tutor can see the latest version.

First lesson preview

What happens in your first lesson

A clear, flexible outline drawn from Beatriz's teaching plan, so you know what to expect before you begin.

  1. Step 1 Creative goal

    Choose one practical result you want from AI system evaluation, benchmark design, representative test sets, rubrics, golden examples, error taxonomies, human evaluation, automated metrics, LLM. Beatriz will use it to focus the lesson.

  2. Step 2 Work sample review

    Name the system decision, real users, unacceptable failures, available examples, and the evidence required before launch or continued operation.

  3. Step 3 Guided revision

    Define claims and risks, sample representative cases, write rubrics, select human and automated measures, calibrate judges, analyze failures, set thresholds, and monitor regressions.

  4. Step 4 Next creative step

    Evaluation plans, rubric revisions, edge-case collections, pairwise ratings, judge-agreement checks, failure taxonomies, red-team cases, and regression dashboards.

What to bringBring a goal, question, example, or problem. No formal preparation is required.

Flexible by designBeatriz adapts this sequence to your level, chosen lesson length, and what becomes useful in the moment.

Example conversation

See how Beatriz teaches

Illustrative exchange based on this tutor's profile and teaching approach.

Student Example question

I have ideas for AI evaluation strategy and test sets, but I do not know how to improve this draft.

Beatriz Moura Teaching response

Choose one effect you want the audience to feel or understand. We will keep the strongest detail, identify one place where the draft loses that effect, and revise only that part before judging the whole piece.

Common questions

Questions before your first lesson

Practical answers about level, feedback, continuity, speaking, and writing with Beatriz.

5 tutor-specific answers
Can beginners use this tutor?

Beatriz Moura is best listed for AI builders, quality engineers, researchers, product teams, risk teams, technical leaders, and advanced students. Beginners can still request a foundational explanation, but a tutor marked for beginners may offer a smoother starting path.

Will grammar be corrected?

Beatriz can correct grammar when it affects clarity, but the main lesson focus is AI evaluation, benchmarks, and red-teaming tutor. For dedicated language correction, compare a language or writing tutor.

Does the tutor remember previous lessons?

When you are signed in, Beatriz can use saved tutor memories, learning-path progress, relevant self-test results, and recent chat history. This is selective context rather than perfect recall, and you can review or change saved information in Settings.

Are speaking exercises included?

Yes. Start a voice lesson or a typed-input call with spoken tutor replies. Beatriz can use verbal explanations, follow-up questions, presentation practice, or spoken rehearsal related to AI evaluation, benchmarks, and red-teaming tutor.

Can I practice writing?

Yes. Use text chat or the classroom Document and Notebook tools to work on drafts, essays, stories, scenes, descriptions, structure, and revision choices. Beatriz can comment, revise with you, and explain the reason for suggested changes.

Repeatable value

Use Beatriz's lesson rhythm

A good session should produce something you can attempt, inspect, and revisit. This profile is designed around the following rhythm.

Start
Name the system decision, real users, unacceptable failures, available examples, and the evidence required before launch or continued operation.
Work
Define claims and risks, sample representative cases, write rubrics, select human and automated measures, calibrate judges, analyze failures, set thresholds, and monitor regressions.
Continue
Evaluation plans, rubric revisions, edge-case collections, pairwise ratings, judge-agreement checks, failure taxonomies, red-team cases, and regression dashboards.

Progress roadmap

What steady practice with Beatriz can build

A possible four-week direction based on this tutor's subject focus. Use it as a target, then adapt it to your starting point.

Pace adapts
  1. Week 1 A clear creative intention

    Choose the effect, audience, or craft goal you want to explore with Beatriz.

  2. Week 2 Purposeful revision

    Use specific feedback to strengthen one draft, performance, or design choice.

  3. Week 4 A finished piece and repeatable process

    Complete a focused work and explain how you will revise the next one.

Example, not a guaranteeThese are example targets with regular practice, not promised outcomes. Your starting point, schedule, and results will vary.

Collaborative classroom

Use each classroom tool with a purpose

The whiteboard opens as the main lesson surface. Beatriz can work with Whiteboard, Canvas, HTML, Document, Code Editor, Quiz, and Homework when each format helps. HTML is useful for responsive presentations, SVG, animation, and small interactions; it runs inside an isolated iframe. Whiteboard changes can auto-sync or be shared with Show tutor; the other tools display activity and save status while updates run.

Whiteboard

Classroom

Map the objective, people affected, constraints, evidence, options, risks, and next decision.

Best move: Draw or place the first version yourself, then use Show tutor or Update tutor so Beatriz can respond to the current board.

Canvas

Classroom

Interactive demonstrations, animated explanations, plotted relationships, and free-form visual experiments that benefit from executable JavaScript.

Best move: Ask for one focused interactive model, test a changed input, and describe what the visual behavior proves.

Document

Classroom

Keep a decision and feedback log with actions, owners, dates, assumptions, and what evidence would change the plan. Draft the actual email, brief, report, plan, presentation notes, or portfolio artifact and revise it for the intended reader.

Best move: Keep your wording and decisions visible, then ask for a precise append, replacement, rewrite, table, or original SVG illustration.

Quiz

Classroom

Rehearse a realistic scenario, pause at the hard decision, compare options, and repeat with a new constraint. Create cards for frameworks, terminology, decision cues, objections, and short scenario questions.

Best move: Attempt each question before asking for help, then ask Beatriz to adjust the next quiz around the mistakes that matter most.

Homework

Classroom

Evaluation plans, rubric revisions, edge-case collections, pairwise ratings, judge-agreement checks, failure taxonomies, red-team cases, and regression dashboards.

Best move: Agree on one realistic assignment, complete it after class, and reopen the saved work with Beatriz in a later lesson.

Beatriz's methods

Profile-specific teaching tools

These methods come directly from this tutor profile. The surface label shows where to make the result visible during a classroom lesson.

Whiteboard

Evaluation matrix

Connects user segment, task, input condition, desired behavior, failure mode, rubric, metric, threshold, and reviewer.

Try it with AI evaluation strategy and test sets in Whiteboard, make one attempt yourself, then ask Beatriz to correct only what blocks the next step.
Canvas

Judge calibration desk

Compares human ratings, model-based ratings, disagreements, bias, variance, and adjudication rules.

Try it with AI evaluation strategy and test sets in Canvas, make one attempt yourself, then ask Beatriz to correct only what blocks the next step.
Document

Failure observatory

Clusters factual, relevance, safety, robustness, latency, cost, and user-experience failures across releases.

Try it with AI evaluation strategy and test sets in Document, make one attempt yourself, then ask Beatriz to correct only what blocks the next step.

Ready to use

Prompts that fit this tutor

These prompts use Beatriz Moura's actual subjects, lesson format, and current classroom tools. Replace the topic with your own material when needed.

  1. Name the system decision, real users, unacceptable failures, available examples, and the evidence required before launch or continued operation.

  2. I want to improve AI evaluation strategy and test sets. Use Evaluation plans, rubric workshops, dataset audits, error labeling, pairwise comparisons, judge-calibration labs, red-team scenarios, regression reviews, and monitoring dashboards. Check what I can already do, let me attempt something, and give one correction at a time.

  3. Open the classroom for Rubrics, metrics, and human judgment and begin in Document. Keep the task small, make me explain my choices, and finish with a short quiz plus one next-session goal.

Progress evidence

Know whether the lessons are working

Do not measure progress only by how clear the explanation felt. Look for changes in what you can retrieve, decide, produce, or explain without support.

  • Frames the decision and audience more clearly
  • Uses evidence to compare realistic options
  • Communicates the recommendation with less filler
  • Turns feedback into a dated next action

Responsible use

Use Beatriz as a tutor, not an authority

Supports authorized quality and defensive safety testing only; no benchmark gaming, harmful real-world targeting, unauthorized vulnerability testing, evasion of safeguards, or use of one aggregate score as proof of universal safety. Product behavior changes quickly, so this tutor separates durable concepts from dated examples and asks learners to verify current official documentation, licenses, costs, data handling, and policy before deployment.

Beatriz Moura is a fictional, unaffiliated AI tutor profile for high-technology AI education. It does not represent a real person, employer, product vendor, standards body, regulator, university, or certification provider, and it does not claim personal employment history, credentials, access, or endorsements.

Ready when you are

Begin learning with Beatriz now

Start a live voice lesson, or open the text chat window with lower credit use than voice.

Start small

Hosted AI tutor. Uses your plan's monthly AI credits. No tutor surcharge; actual usage varies by model and token mix. You can stop whenever you need.