Interactive portfolio demonstration

Coach Response Quality Model

Purpose: give staff a consistent way to review sample AI-coach responses for accuracy, helpfulness, and fit with course materials. People—not automation—decide when a change reaches learners.

My role: Review workflow, scoring criteria, and AI behavior requirements.

Portfolio note: Representative staff-only scenario. No learner data, live model, or production record is used.

A.J. Merlino / Coach quality review
Portfolio demonstration / staff-only

Interactive walkthrough

People review the coach before it changes.

Instructional designers score sample responses. The team tests possible improvements separately, and a person signs off before learners see any change.

People decide before a learner-facing change

One reply. Three steps.

Choose it, review it, then test a possible update before a person approves any change.

Choose a reply

Review the reply.

Learner asked“What should I do first when framing the problem?”

Select a reply to begin.

Reply from AI-Enabled Design StudioCoach

Start with the decision your research needs to support and the people affected by it. That gives you a focused first question to test.

AI-Enabled Design Studio / Framing feedback
Rate the reply

1 = weak / 5 = strong

Accurate information
Uses course materials well
Helps the learner
Easy to understand

Save when you are ready.

Accurate information5/5
Uses course materials well5/5
Helps the learner4/5
Easy to understand5/5

Example staff review record

Displayed intentionally for this portfolio walkthrough. After the review is saved, this record is sent to the ANN training dataset, where it can be curated and prepared for a later training and evaluation cycle.