Evaluating Designs with Users Course

Editorial Take

The University of Michigan's 'Evaluating Designs with Users' course offers a focused, practical entry point into the world of UX research. As part of Coursera’s broader UX Research and Design specialization, it fills a critical gap by teaching how to observe, interpret, and act on user behavior—skills essential for creating intuitive digital experiences.

With a strong emphasis on usability testing, this course stands out for its hands-on approach to understanding real user needs. It’s designed for beginners but delivers lasting value through structured methodologies that professionals can apply immediately.

Standout Strengths

• Hands-On Testing Framework: Teaches learners how to design realistic test scenarios that mirror actual user goals, ensuring insights are both valid and actionable. This foundation helps bridge the gap between theory and practice in UX research.
• Methodological Clarity: Clearly distinguishes between formative and summative testing, helping learners choose the right method at each design stage. This structured thinking is vital for effective research planning and execution.
• Participant Recruitment Guidance: Offers practical advice on identifying and recruiting representative users, reducing bias and improving test validity. These skills are often overlooked but are critical to reliable results.
• Observation Techniques: Emphasizes non-intrusive observation and note-taking strategies that preserve natural user behavior. Learners gain skills to detect subtle usability issues that surveys or analytics might miss.
• Ethical Research Practices: Integrates principles of informed consent, privacy, and participant respect throughout the testing process. This responsible approach builds trust and ensures long-term research integrity.
• Iterative Design Mindset: Encourages continuous improvement based on user feedback, reinforcing agile UX principles. This cyclical approach prepares learners for real-world product development environments.

Honest Limitations

• Limited Technical Depth: Focuses on qualitative observation rather than quantitative metrics or A/B testing. Learners seeking data-driven analysis may need supplementary resources to expand their toolkit.
• Basic Tools Emphasis: Relies on low-tech solutions like paper notes and basic screen recording, which may not reflect industry-standard platforms. Advanced tools like Lookback or UserTesting.com are not covered in depth.
• Peer Feedback Dependency: Assignments often require peer review, which can lead to inconsistent or delayed feedback. This may slow progress for self-paced learners without active course cohorts.
• Narrow Scope: Concentrates solely on usability testing, excluding related areas like accessibility testing or remote unmoderated studies. Broader UX research methods are addressed in other courses in the specialization.

How to Get the Most Out of It

• Study cadence: Aim for 3–4 hours per week to fully engage with videos, readings, and assignments. Consistent pacing ensures better retention and practical application of testing techniques.
• Parallel project: Apply lessons to a personal or open-source design project. Testing real interfaces reinforces learning and builds a portfolio of research work.
• Note-taking: Use structured templates for observations to identify patterns across sessions. This builds analytical discipline crucial for professional UX roles.
• Community: Engage actively in discussion forums to share test plans and get peer feedback. Collaboration enhances learning and mimics team-based design environments.
• Practice: Conduct informal tests with friends or colleagues early and often. Repeated practice builds confidence in moderating and interpreting sessions.
• Consistency: Complete modules in sequence to build cumulative knowledge. Each section scaffolds the next, making continuity key to mastery.

Supplementary Resources

• Book: 'Don't Make Me Think' by Steve Krug complements the course with concise usability principles. It reinforces the importance of intuitive design and user-centered thinking.
• Tool: Use Otter.ai for automated transcription of user sessions to speed up analysis. This saves time and improves accuracy when reviewing verbal feedback.
• Follow-up: Enroll in 'Conducting User Research' to deepen foundational skills. This next step broadens methodological range and strengthens research design capabilities.
• Reference: Nielsen Norman Group articles provide expert insights on usability testing best practices. These resources offer real-world case studies and evidence-based guidelines.

Common Pitfalls

• Pitfall: Assuming all feedback requires immediate design changes. Learners should distinguish between isolated comments and systemic usability issues through pattern recognition and triangulation.
• Pitfall: Leading users during test sessions with suggestive language. Maintaining neutrality is essential to avoid biasing results and misrepresenting user behavior.
• Pitfall: Overlooking context of use when interpreting test outcomes. Environmental factors, device type, and user mindset all influence performance and must be considered.

Time & Money ROI

• Time: At 10 weeks with moderate weekly effort, the time investment is reasonable for the depth of skill gained. Most learners can complete it alongside other commitments.
• Cost-to-value: While not free, the course offers strong value through university-backed content and a shareable certificate. The skills directly apply to high-demand UX roles.
• Certificate: The credential enhances resumes and LinkedIn profiles, especially when combined with the full specialization. It signals practical competence to employers.
• Alternative: Free resources exist, but few offer structured learning with academic rigor. This course justifies its cost through guided progression and expert instruction.

Editorial Verdict

This course successfully demystifies the process of evaluating designs through direct user interaction. It equips beginners with essential skills to plan, conduct, and learn from usability tests—competencies that are foundational in UX design. The University of Michigan delivers content with clarity and purpose, making complex research concepts accessible without oversimplifying them. By focusing on observation and iteration, it instills a user-first mindset that is crucial in today’s design landscape. The integration with the broader UX specialization enhances its value, allowing learners to build a comprehensive skill set over time.

While not the most technically advanced course available, its strength lies in practicality and real-world relevance. It avoids unnecessary jargon and instead emphasizes actionable methods that produce tangible results. Learners who apply the techniques to real projects will see immediate improvements in their design process. For those entering UX or transitioning from related fields, this course provides a solid, credible foundation. We recommend it as a must-take for aspiring UX researchers and designers who want to ground their work in authentic user insights.