Prepare for and practice interview questions from Earnest Research across topics like Analytics, SQL, Product Metrics and more.

Earnest Research Interview Questions

Earnest Research Interview Guides

Suppose there exists a new airline named Jetco that flies domestically across North America. Jetco recently had a study commissioned that tested the boarding time of every airline, and it came out that Jetco had the fastest average boarding times of any airline.

What factors could have biased this result, and what would you look into?

What could potentially bias the average boarding time in favor of an airline that only flies domestically?

What could potentially bias the average boarding time in favor of an airline that only flies domestically?

Boarding Times Bias

A new airline came out as the fastest average boarding times compared to other airlines.  What factors could have biased this result and what would you look into?

Statistics

Let’s say you work for a social media company that has just done a launch in a new city. Looking at weekly metrics, you see a slow decrease in the average number of comments per user from January to March in this city.

The company has been consistently growing new users in the city from January to March.

What are some reasons why the average number of comments per user would be decreasing and what metrics would you look into?

What metric could be used to measure if active users are still engaging on the platform despite an overall decrease in the average number of comments per user?

What metric could be used to measure if active users are still engaging on the platform despite an overall decrease in the average number of comments per user?

Decreasing Comments

How would you investigate a decline in the average number of comments per user?

Product Sense & Metrics

Let’s say that your company is running a standard control and variant AB test on a feature to increase conversion rates on the landing page. The PM checks the results and finds a .04 p-value.

How would you assess the validity of the result?

Question	Topic	Difficulty	Ask Chance
Boarding Times Bias	Statistics	Medium	Very High
Decreasing Comments	Product Sense & Metrics	Easy	Very High
Experiment Validity	A/B Testing	Medium	Very High