Part 1. UX and Quantitative UX

Chapter 1.
Getting started
1.1 Who is the Author? Why You Should Read This Book
1.2 What is different about this book?
1.3 Who is the intended audience for this book?
____1.3.1 Check your interests
1.4 What will you learn from this book?
1.5 How to Use This Book
____1.5.1 Assumptions
____1.5.2 Note on Terminology
____1.5.3 Examples for each chapter
1.6 Online Resources
____1.6.1 Code and Data Sources
____1.6.2 Help, Updates, and Errors
1.7 Key Points

Chapter 2. UX and UX Research
2.1 User Experience
____2.1.1 UX Jobs
____2.1.2 UX Design and Software Engineering
____2.1.3 Product Management
2.2 UX Research
____2.2.1 Types of UXR
____2.2.2 UXR Research Lifecycle
____2.2.3 Typical Research Projects Along the Product Life Cycle
2.3 Key Points
2.4 Learn more

Chapter 3.
Quantitative UX Research: An Overview
3.1 Quantitative UX Research
3.2 Weekly Tasks of Quantitative UX Research
____3.2.1 General Weekly Activities
____3.2.2 Common Research Questions for Quantitative UXR
____3.2.3 Stakeholder Questions
3.3 Different Types of Quant UXR
3.4 Differences between Quant UXR and Other Jobs
____3.4.1 Quant UXR vs. General UXR
____3.4.2 Quantitative UXR vs. Mixed Methods UXR
____3.4.3 Quant UXR vs. Survey Scientist
____3.4.4 Quantitative UXR vs. Marketing Research
____3.4.5 Quant UXR vs. Data Scientist
____3.4.6 Quantitative UXR vs. Business or Product Analyst
____3.4.7 Quant UXR vs. Research Scientist
____3.4.8 Quantitative UXR vs. Academic Research
3.5 Are you a good fit for the Quant UXR role?
3.6 Key Points
3.7 Learn more

Part 2.
Core technology

Chapter 4. UX Research
4.1 Basic and Advanced Techniques for Quantitative UXR
____4.1.1 'T-shaped' technology
4.2 Focus on the user
____4.2.1 Adopting the User's Perspective
____4.2.2 Evaluating User-Centric Variables and Outcomes
____4.2.3 Answering the question 'why' with a cognitive approach
____4.2.4 Focus on Unmet Needs
____4.2.5 Implementing UX and Engaging with Stakeholders
4.3 Research Validity
4.4 User and Product Reviews
4.5 Research Ethics
____4.5.1 Risks and Benefits of Research
____4.5.2 Privacy and Legal Requirements
____4.5.3 Minimum collection amount
____4.5.4 Scientific Standards
____4.5.5 Impact on Society
____4.5.6 Newspaper Test
4.6 Research Plan
4.7 Key Points
4.8 Learn more

Chapter 5.
statistics
5.1 Why Statistics?
____5.1.1 Statistics vs. Machine Learning
5.2 Fundamentals: Sampling and Data Quality
5.3 Core Statistical Analysis Skills
____5.3.1 Exploratory Data Analysis and Visualization
____5.3.2 Technical Statistics
____5.3.3 Inferential Statistical Tests and Substantive Significance
____5.3.4 A/B Testing Basics
____5.3.5 Linear Model
5.4 Frequently Observed Problems
____5.4.1 Inaccurate or biased data
____5.4.2 Loss of perspective on decision-making due to focus on discovery
____5.4.3 Prematurely Assuming Results
____5.4.4 Interpreting Statistical Significance
____5.4.5 Applying Advanced Models
5.5 Key Points
5.6 Learn more
5.7 Questions and Examples

Chapter 6.
Programming
6.1 Overview
____6.1.1 The Need for Programming
____6.1.2 Programming Language
6.2 Procedural Programming Fundamentals
____6.2.1 Algorithm
____6.2.2 Data Structures
6.3 SQL
6.4 Other Coding Topics
____6.4.1 Code Reproducibility
____6.4.2 Performance and Scalability
6.5 Key Points
6.6 Learn more
6.7 Example

Part 3.
Analysis Tools and Techniques

Chapter 7.
User Experience Metrics
7.1 HEART Framework
____7.1.1 Happiness
____7.1.2 Participation
____7.1.3 Adoption
____7.1.4 Retention
____7.1.5 Task Success
7.2 Goal-Signal-Indicator Process
____7.2.1 Objectives
____7.2.2 Signal
____7.2.3 Indicators
7.3 Method Integration Application
7.4 Gmail Label Redesign
7.5 Lessons Learned from Experience
____7.5.1 Individual Traps
____7.5.2 Organizational Issues
7.6 Key Points
7.7 Learn more
7.8 Example

Chapter 8.
Customer Satisfaction Survey
8.1 Objectives of the CSat Program
8.2 Components of Customer Research
____8.2.1 Customer population and sample
____8.2.2 Survey Mechanism
____8.2.3 Sequence Evaluation
____8.2.4 Subjective Opinion
____8.2.5 Demographic and Behavioral Information
____8.2.6 Comparison over time instead of between groups
____8.2.7 Follow-up with stakeholders and customers
8.3 Common Problems in CSat Analysis
8.4 Example Analysis Using R
____8.4.1 Initial Data Check
____8.4.2 CSat for a specific period
____8.4.3 CSat over time
____8.4.4 TOP 2 Box Ratio
____8.4.5 Is CSat Changing? Initial Analysis
____8.4.6 Country-by-Country Review
____8.4.7 A better model for CSat changes in data
8.5 Key Points
8.6 Learn more
8.7 Example

Chapter 9.
Log sequence visualization
9.1 Example Sequence Data
____9.1.1 Sunburst chart for buffet data
9.2 Sunburst Visualization of Website Data
____9.2.1 Converting logs to sequences
____9.2.2 Sunburst Visualization of EPA Data
____9.2.3 Additional Analysis Steps
9.3 Key Points
9.4 Learn more
9.5 Example

Chapter 10.
MaxDiff: Prioritizing Features and User Requirements
10.1 MaxDiff Overview
____10.1.1 MaxDiff Analysis Example
____10.1.2 Calculating Pizza Demand
____10.1.3 Summary of MaxDiff's Advantages
10.2 A Detailed Introduction to MaxDiff Estimation
____10.2.1 Common UX Topics in the MaxDiff Survey
____10.2.2 Creating and Distributing a MaxDiff Survey
____10.2.3 Survey Creation Platform
____10.2.4 MaxDiff and Accessibility
____10.2.5 MaxDiff statistical model
10.3 Example: Information Exploration Use Case
____10.3.1 MaxDiff Overview for Information Exploration
____10.3.2 Survey Format
____10.3.3 Data Format
____10.3.4 Estimation using the choicetools package
____10.3.5 Next Steps
10.4 Key Points
10.5 Learn more
10.6 Example

Part 4.
Organization and Career

Chapter 11. UX Organization
11.1 General UX Organizational Model
____11.1.1 Job-Based Organization
____11.1.2 Product-Oriented Organization
11.2 Other Organizational Models for Quantitative UXR
____11.2.1 Centralized Quantitative UX Research Team
____11.2.2 Quantitative UX for Data Science or Analytics Teams
11.3 Advice for Quantitative UXR Managers
____11.3.1 Stakeholders and Access to Data
____11.3.2 Blocking random requests
____11.3.3 Opportunities for Growth
____11.3.4 Help with Proving Influence
____11.3.5 Do not disturb
11.4 Key Points
11.5 Learn more

Chapter 12.
Interview and Job Postings
12.1 Typical Quantitative UXR Interview Process
12.2 Two Formats of Interview Panels
____12.2.1 Format 1: Interview Loop
____12.2.2 Format 2: Practical Interview
____12.2.3 Interviewer Evaluation Method
____12.2.4 Hiring Decision Maker
12.3 Before, During, and After the Field Interview
____12.3.1 Before the Interview: What the Company Should Do
____12.3.2 Before the Interview: What Applicants Should Prepare
____12.3.3 Interview in progress
____12.3.4 After the interview
12.4 Job Announcements and Applications
____12.4.1 Finding Job Information
____12.4.2 Other suggestions for completing the application
12.5 Key Points
12.6 Learn more

Chapter 13.
Research Process, Reporting, and Stakeholders
13.1 Initial Stakeholders
____13.1.1 Stakeholder Demands and Needs
____13.1.2 Focus on decision making
____13.1.3 Reverse Operation
13.2 Results Report
____13.2.1 Stakeholders as Users of Research
____13.2.2 Two Models: Presentation and Documentation
13.3 Principles of Good Results
____13.3.1 Concise and focused explanation for decision making
____13.3.2 Minimum Technical Report
____13.3.3 Bias exclusion
____13.3.4 Reproducibility and Generalizability
13.4 Research Archive
13.5 General Issues Concerning Stakeholders
____13.5.1 Absence of decision-making criteria
____13.5.2 Temporary Projects
____13.5.3 Opportunity Cost
____13.5.4 Validation Research
____13.5.5 Statistical Significance
____13.5.6 Cherry Picking Results
____13.5.7 Conflicting Results
____13.5.8 Objection limited to negative results
13.6 Finding Good Stakeholders
13.7 Key Points
13.8 Learn more

Chapter 14.
Career Development for Quantitative UXRs
14.1 Key Elements of an Industry Career Path
____14.1.1 Rank
____14.1.2 Career Ladder
____14.1.3 Career Tracks: IC and Manager
____14.1.4 Distribution of ranks
____14.1.5 Choosing between IC and Manager
14.2 Issues regarding rank
14.3 Performance Evaluation and Promotion
____14.3.1 Performance Evaluation
____14.3.2 Influence
____14.3.3 Promotion
14.4 Personality and Goals
____14.4.1 Maximization vs.
Satisfaction
____14.4.2 Builder vs.
explorer
14.5 Building Skills in Your Career Path
____14.5.1 Skill Development Areas
____14.5.2 Finding a Mentor
14.6 Pathways for Senior ICs
____14.6.1 Staff and above rank pattern 1.
Tech Lead
____14.6.2 Staff and above rank pattern 2: Evangelist
____14.6.3 Staff and above pattern 3: Strategic Partner
14.7 Key Points
14.8 Learn more

Chapter 15.
The Future of Quant UX
15.1 Outlook 1: UX Data Science
15.2 Perspective 2: Computational Social Sciences
15.3 Perspective 3: Mixed Methods UX
15.4 Outlook 4: The Evolution of Quantitative UX
15.5 Learn more
15.6 Conclusion

Appendix A.
Quantitative UX Job Description Example
Appendix B.
Quantitative UX Recruitment Rubric Example
Appendix C.
References

Quantitative UX Research Answers "Is This Design Really Effective?"
Analytical techniques and growth roadmaps from Silicon Valley experts

Quantitative UX research answers the product team's eternal question: "Will this design really work?" with data.
Today, businesses have more user behavior data than ever before.
Quantitative UX researchers analyze this massive data to understand usage patterns, measure the impact of design changes, and provide insights needed for strategic decision-making.
It's this very role that makes quantitative UX researchers key players in product development.

This book systematically introduces the rapidly growing role of quantitative UX research in product design development.
It contains insights from decades of experience from some of the most renowned practitioners in quantitative UX research.
We provide a comprehensive overview of the skills you need for practical work, from conducting customer satisfaction surveys to understanding user behavior through log analysis and statistical methods used to evaluate user experience.
In particular, it is structured so that readers can learn through hands-on practice by providing reusable code and real-world examples.

Beyond fundamental skills, we focus on the unique areas of Quant UX, offering practical advice for starting and developing a career in this field.
This practical guide guides readers from diverse academic backgrounds to leverage analytics to understand user needs, collaborate effectively with engineering and design teams, and ultimately optimize the product's user experience.

What this book covers

Learn about Quantitative UX Research jobs
Understanding the Difference Between Quantitative UX Research and Data Science
● Learn how to plan and successfully execute a typical quantitative UX research project.
● Deploying quantitative UX work activities across product development, engineering, and UX organizations
● Measuring user experience performance using the HEART framework
● Assessing your skills and potential for employment as a quantitative UX researcher
● Learn how job interviews are conducted
● Explore examples of quantitative UX projects using R code and datasets.