Tutor playbook
How to learn with Beatriz Moura
A practical, profile-specific playbook for learning AI system evaluation, benchmark design, representative test sets, rubrics, golden examples, error taxonomies, human evaluation, automated metrics...
Beatriz Moura
AI evaluation, benchmarks, and red-teaming tutor
On this page
Best fit
Is Beatriz Moura right for your goal?
Learners who need evidence that an AI feature works for its actual users and risks, not just a high score on a convenient public benchmark.
- Learning focus
- AI system evaluation, benchmark design, representative test sets, rubrics, golden examples, error taxonomies, human evaluation, automated metrics, LLM-as-judge limitations, factuality, safety testing, red teaming, regression suites, online monitoring, and evaluation governance
- Best level
- AI builders, quality engineers, researchers, product teams, risk teams, technical leaders, and advanced students
- Lesson format
- Evaluation plans, rubric workshops, dataset audits, error labeling, pairwise comparisons, judge-calibration labs, red-team scenarios, regression reviews, and monitoring dashboards
- Languages
- Portuguese, English, Spanish basics
Tutor fit
Why choose Beatriz?
Compare teaching strengths, lesson style, and learner fit before you begin.
Strengths
-
- Skeptical metric review
- Clear rubric design
- Failure-case curiosity
- Careful judge calibration
Specialties
-
- AI evaluation strategy and test sets
- Rubrics, metrics, and human judgment
- LLM-as-judge calibration and limits
- Safety red teaming and error taxonomies
- Regression suites and production monitoring
Teaching approach
- Core methods: Skeptical metric review, Clear rubric design, Failure-case curiosity. Lesson format: Evaluation plans, rubric workshops, dataset audits, error labeling, pairwise comparisons, judge-calibration labs, red-team scenarios, regression reviews, and monitoring dashboards.
Example lesson
- Define claims and risks, sample representative cases, write rubrics, select human and automated measures, calibrate judges, analyze failures, set thresholds, and monitor regressions.
Who benefits most
- Learners who need evidence that an AI feature works for its actual users and risks, not just a high score on a convenient public benchmark.
Tutor comparison
Choose by learning goal
See where this tutor is strongest beside relevant alternatives. The comparison uses published specialties and teaching focus, not a made-up score.
Beatriz Moura
AI evaluation, benchmarks, and red-teaming tutor
Nkiru Umeh
RAG and enterprise knowledge-search tutor
Jakub Zieliński
LLM and AI-agent security tutor
Quality signals
What learners can verify
Published learner ratings and recorded VibeTutor activity. Counts are real platform totals, never simulated.
- AI evaluation strategy and test sets
- Rubrics, metrics, and human judgment
- LLM-as-judge calibration and limits
- Safety red teaming and error taxonomies
Profile-based goals are shown until at least 3 saved learner goals can form a private aggregate.
How these signals are calculated
Satisfaction converts the average of published learner ratings into a percentage.
Completed lessons counts recorded calls lasting at least one minute. Short starts under one minute are excluded.
Conversations counts recorded chat sessions and calls, while average session length uses completed lessons only.
Learning goals use broad categories after at least three saved goals; otherwise they are clearly marked as profile-based.
Lessons are focused and exact, with clear standards, careful reasoning, and direct feedback that respects the learner’s time.
- AI evaluation strategy and test sets
- Rubrics, metrics, and human judgment
- LLM-as-judge calibration and limits
- Safety red teaming and error taxonomies
- Regression suites and production monitoring
Before lesson one
Plan a focused first session
Specific evidence gives Beatriz a better starting point than a broad request to teach the whole subject. Use this four-part setup.
-
Arrive with evidence
Bring a real scenario, draft, role description, dataset, plan, decision, meeting, or work sample. A real sample gives Beatriz something concrete to diagnose.
-
Define one result
Aim for one usable decision, communication, plan, analysis, or work sample. State that result in the lesson request so the automatic lesson focus stays useful.
-
Attempt before the model
Show what you currently think or can do. Ask for a hint or question before requesting the completed answer.
-
Leave with retrieval
Explain the lesson back, save the hardest point as a review card, and schedule the smallest useful follow-up.
Choose the right lesson mode
Text chat
Drafting professional material, comparing options, analyzing evidence, and keeping precise notes.
Paste the exact material and state the feedback format you want.Voice call
Interviews, presentations, difficult conversations, negotiation, and thinking through decisions under questions.
Think aloud and ask Beatriz to pause after each correction or question.Classroom
Case maps, roleplay, live documents, decision logs, plans, and portfolio-ready work samples.
Share each workspace explicitly so the tutor can see the latest version.First lesson preview
What happens in your first lesson
A clear, flexible outline drawn from Beatriz's teaching plan, so you know what to expect before you begin.
-
Step 1 Creative goal
Choose one practical result you want from AI system evaluation, benchmark design, representative test sets, rubrics, golden examples, error taxonomies, human evaluation, automated metrics, LLM. Beatriz will use it to focus the lesson.
-
Step 2 Work sample review
Name the system decision, real users, unacceptable failures, available examples, and the evidence required before launch or continued operation.
-
Step 3 Guided revision
Define claims and risks, sample representative cases, write rubrics, select human and automated measures, calibrate judges, analyze failures, set thresholds, and monitor regressions.
-
Step 4 Next creative step
Evaluation plans, rubric revisions, edge-case collections, pairwise ratings, judge-agreement checks, failure taxonomies, red-team cases, and regression dashboards.
What to bringBring a goal, question, example, or problem. No formal preparation is required.
Flexible by designBeatriz adapts this sequence to your level, chosen lesson length, and what becomes useful in the moment.
Example conversation
See how Beatriz teaches
Illustrative exchange based on this tutor's profile and teaching approach.
Common questions
Questions before your first lesson
Practical answers about level, feedback, continuity, speaking, and writing with Beatriz.
Can beginners use this tutor?
Beatriz Moura is best listed for AI builders, quality engineers, researchers, product teams, risk teams, technical leaders, and advanced students. Beginners can still request a foundational explanation, but a tutor marked for beginners may offer a smoother starting path.
Will grammar be corrected?
Beatriz can correct grammar when it affects clarity, but the main lesson focus is AI evaluation, benchmarks, and red-teaming tutor. For dedicated language correction, compare a language or writing tutor.
Does the tutor remember previous lessons?
When you are signed in, Beatriz can use saved tutor memories, learning-path progress, relevant self-test results, and recent chat history. This is selective context rather than perfect recall, and you can review or change saved information in Settings.
Are speaking exercises included?
Yes. Start a voice lesson or a typed-input call with spoken tutor replies. Beatriz can use verbal explanations, follow-up questions, presentation practice, or spoken rehearsal related to AI evaluation, benchmarks, and red-teaming tutor.
Can I practice writing?
Yes. Use text chat or the classroom Document and Notebook tools to work on drafts, essays, stories, scenes, descriptions, structure, and revision choices. Beatriz can comment, revise with you, and explain the reason for suggested changes.
Repeatable value
Use Beatriz's lesson rhythm
A good session should produce something you can attempt, inspect, and revisit. This profile is designed around the following rhythm.
- Start
- Name the system decision, real users, unacceptable failures, available examples, and the evidence required before launch or continued operation.
- Work
- Define claims and risks, sample representative cases, write rubrics, select human and automated measures, calibrate judges, analyze failures, set thresholds, and monitor regressions.
- Continue
- Evaluation plans, rubric revisions, edge-case collections, pairwise ratings, judge-agreement checks, failure taxonomies, red-team cases, and regression dashboards.
Progress roadmap
What steady practice with Beatriz can build
A possible four-week direction based on this tutor's subject focus. Use it as a target, then adapt it to your starting point.
-
Week 1
A clear creative intention
Choose the effect, audience, or craft goal you want to explore with Beatriz.
-
Week 2
Purposeful revision
Use specific feedback to strengthen one draft, performance, or design choice.
-
Week 4
A finished piece and repeatable process
Complete a focused work and explain how you will revise the next one.
Collaborative classroom
Use each classroom tool with a purpose
The whiteboard opens as the main lesson surface. Beatriz can work with Whiteboard, Canvas, HTML, Document, Code Editor, Quiz, and Homework when each format helps. HTML is useful for responsive presentations, SVG, animation, and small interactions; it runs inside an isolated iframe. Whiteboard changes can auto-sync or be shared with Show tutor; the other tools display activity and save status while updates run.
Whiteboard
ClassroomMap the objective, people affected, constraints, evidence, options, risks, and next decision.
Best move: Draw or place the first version yourself, then use Show tutor or Update tutor so Beatriz can respond to the current board.Canvas
ClassroomInteractive demonstrations, animated explanations, plotted relationships, and free-form visual experiments that benefit from executable JavaScript.
Best move: Ask for one focused interactive model, test a changed input, and describe what the visual behavior proves.Document
ClassroomKeep a decision and feedback log with actions, owners, dates, assumptions, and what evidence would change the plan. Draft the actual email, brief, report, plan, presentation notes, or portfolio artifact and revise it for the intended reader.
Best move: Keep your wording and decisions visible, then ask for a precise append, replacement, rewrite, table, or original SVG illustration.Quiz
ClassroomRehearse a realistic scenario, pause at the hard decision, compare options, and repeat with a new constraint. Create cards for frameworks, terminology, decision cues, objections, and short scenario questions.
Best move: Attempt each question before asking for help, then ask Beatriz to adjust the next quiz around the mistakes that matter most.Homework
ClassroomEvaluation plans, rubric revisions, edge-case collections, pairwise ratings, judge-agreement checks, failure taxonomies, red-team cases, and regression dashboards.
Best move: Agree on one realistic assignment, complete it after class, and reopen the saved work with Beatriz in a later lesson.Beatriz's methods
Profile-specific teaching tools
These methods come directly from this tutor profile. The surface label shows where to make the result visible during a classroom lesson.
Evaluation matrix
Connects user segment, task, input condition, desired behavior, failure mode, rubric, metric, threshold, and reviewer.
Try it with AI evaluation strategy and test sets in Whiteboard, make one attempt yourself, then ask Beatriz to correct only what blocks the next step.Judge calibration desk
Compares human ratings, model-based ratings, disagreements, bias, variance, and adjudication rules.
Try it with AI evaluation strategy and test sets in Canvas, make one attempt yourself, then ask Beatriz to correct only what blocks the next step.Failure observatory
Clusters factual, relevance, safety, robustness, latency, cost, and user-experience failures across releases.
Try it with AI evaluation strategy and test sets in Document, make one attempt yourself, then ask Beatriz to correct only what blocks the next step.Ready to use
Prompts that fit this tutor
These prompts use Beatriz Moura's actual subjects, lesson format, and current classroom tools. Replace the topic with your own material when needed.
Name the system decision, real users, unacceptable failures, available examples, and the evidence required before launch or continued operation.
I want to improve AI evaluation strategy and test sets. Use Evaluation plans, rubric workshops, dataset audits, error labeling, pairwise comparisons, judge-calibration labs, red-team scenarios, regression reviews, and monitoring dashboards. Check what I can already do, let me attempt something, and give one correction at a time.
Open the classroom for Rubrics, metrics, and human judgment and begin in Document. Keep the task small, make me explain my choices, and finish with a short quiz plus one next-session goal.
Progress evidence
Know whether the lessons are working
Do not measure progress only by how clear the explanation felt. Look for changes in what you can retrieve, decide, produce, or explain without support.
- Frames the decision and audience more clearly
- Uses evidence to compare realistic options
- Communicates the recommendation with less filler
- Turns feedback into a dated next action
Responsible use
Use Beatriz as a tutor, not an authority
Supports authorized quality and defensive safety testing only; no benchmark gaming, harmful real-world targeting, unauthorized vulnerability testing, evasion of safeguards, or use of one aggregate score as proof of universal safety. Product behavior changes quickly, so this tutor separates durable concepts from dated examples and asks learners to verify current official documentation, licenses, costs, data handling, and policy before deployment.
Beatriz Moura is a fictional, unaffiliated AI tutor profile for high-technology AI education. It does not represent a real person, employer, product vendor, standards body, regulator, university, or certification provider, and it does not claim personal employment history, credentials, access, or endorsements.