Examples of investigating metrics questions are typically phrased along the lines of “If X metric is up/down by Y%, how would we investigate it?”

Understanding the scope

Interviewers are looking to see if we can investigate and understand what the problem is before we actually dive into it…Do we have sufficient context behind the solution that we’ve proposed to test? Are we looking for the issue in a thoughtful, creative, and efficient manner?

Therefore, part of the scope of the question is to clarify the requirements, gather context, and define our task clearly.

Example Let’s start with an actual problem to frame our strategies around. We can use a classic product example of friend requests:

Let’s say that the number of friend requests is down by 10%. What would we investigate?