About Alpha School

Alpha School empowers students to accelerate their learning and achieve their full potential. It emphasizes personalized education, leveraging technology to tailor content to individual learning styles and paces. The school integrates project-based learning, critical thinking, and collaborative problem-solving — fostering skills that prepare students for the modern world. Alpha School is built to challenge conventional models, focusing on mastery and engagement rather than rote memorization or standardized testing.

Alpha students achieve 2.6x more growth compared to their peers. The top 20% of Alpha students reached new heights with a 6.5x growth rate. The majority of Alpha students score in the 99th percentile nationwide.

Post Test Coach is an AI-powered app designed to assist users in evaluating their performance on tests and identifying areas for improvement. Its primary focus is to enhance learning outcomes by helping users distinguish between careless mistakes and gaps in knowledge, without attempting to tutor directly. The app operates as a virtual coach, offering guidance, constructive feedback, and motivational support to foster self-assessment and accountability.

  • Mistake Analysis: Differentiates between knowledge gaps and minor errors, providing targeted insights for improvement.
  • Constructive Feedback: Encourages users to reflect on their answers and improve their problem-solving skills through tailored suggestions.
  • Adaptive Questioning: Utilizes a prompting system to guide users toward correct answers without explicitly tutoring them.
  • Human-like Interaction: Strives to exceed the naturalness of human coaching through empathetic, non-judgmental, and positive interactions.
  • Progress Tracking: Tracks user performance over time, offering summaries and actionable recommendations for continual growth.
  • Ownership Mentality: Encourages users to take responsibility for their learning process by identifying and addressing their own mistakes.
  • Steelmanning Approach: Promotes critical thinking by empathizing with and refining counterarguments to improve overall understanding.

The project aims to:

  • Improve the user experience to match or exceed the quality of human coaching.
  • Foster a culture of self-driven learning and accountability.
  • Provide users with actionable insights that translate into tangible performance improvements.
  • Enhance engagement and reduce frustration through intuitive and supportive interactions.

By combining AI capabilities with principles of effective coaching, the Post Test Coach app seeks to empower users to achieve better outcomes, build confidence, and cultivate long-term learning habits.


 

Challenges

  • Engagement Gaps: Students found existing feedback mechanisms too generic and impersonal, reducing the effectiveness of post-test analysis.
  • Workflow Complexity: Teachers struggled with the lack of integration between test results and actionable recommendations, leading to inefficiencies.
  • Scalability Issues: Relying on human coaches to evaluate students was a blocker to scalability, hindering growth.

 

 

The Team

I worked closely with developers, stakeholders, educational specialists and third-party vendors, owning the visual and interaction design for the platform. My role included designing the experience to be as intuitive and frictionless as possible, managing the roadmap, presenting to the client, collaborating on the implementation, and refining the system iteratively based on user testing and feedback.

 

 

Goals

  • Replace Human Coaches: Develop interactive, voice-driven coaching sessions to mimic real-time conversations and foster deeper learning. Natural language interfaces will become the default way we interact with data
  • Streamline Feedback Delivery: Implement a seamless process for post-test analysis that provides targeted recommendations without overwhelming students or teachers.
  • Leverage Chain of Thought Reasoning: Design interactive feedback mechanisms that highlight the student’s problem-solving approach, helping them reflect on their reasoning and identify areas for improvement.
  • Diagnose Root Causes of Mistakes: Create tools that rapidly identify whether a student’s error stems from a careless mistake (e.g., rushing or misreading) or a deeper misunderstanding of the material, providing targeted feedback to accelerate learning and correction.
  • Increase Engagement: Integrate entertaining and dynamic video avatars to create a more interactive and engaging learning experience, helping students stay motivated and excited while receiving personalized feedback.
  • Scalable Automation: Develop a “no human in the loop” solution to replace the need for human coaches in assessing student performance, allowing Alpha School to scale its operations efficiently while maintaining high-quality, personalized feedback for learners.
  • Personalized Student Profiles: Design a system that leverages personalized profiles to engage students on a friendly, peer-like level, incorporating their interests, learning habits, and quirks to deliver tailored communication and enhance their overall experience.

 

Solution

Research
  • User Insights: Conducted in-depth user research, including interviews with students and educators, to understand pain points and existing workflows.
  • Competitor Analysis: Benchmarked the platform against similar educational tools to identify opportunities for differentiation and innovation.

 

Implementation & Action
  • Interactive Coaching Sessions: Designed an AI-driven interface that uses a Socratic questioning approach, helping students analyze mistakes and learn from them in real-time.
  • Error Classification and Feedback: Developed a system to classify errors as “knowledge gaps” or “careless mistakes,” providing actionable insights tailored to each student’s needs.

 

 

Transformations, Impact & Results

  • Student Engagement: Interactive features like real-time coaching and instant feedback improved student satisfaction and learning outcomes.
  • Positive Feedback: Educators reported a significant reduction in frustration with the platform, citing clearer workflows and better integration of test results.
  • Scalability: The standardized design approach laid the foundation for future growth, allowing the platform to expand into new subject areas.
 
 

Elevating the User Experience

  • Dynamic Reports: Introduced comprehensive reports summarizing each session, highlighting student strengths and areas for improvement.
  • Modern Aesthetic: Redesigned the interface with a clean, student-friendly layout, incorporating consistent typography and visually engaging elements.

 

Chris Hughes — Product Designer