Product Interviews: SUCCESS METRICS (Execution/Analytical) for Facebook

Hi Dianna, thanks for the great video. Do we need to break-down the user journey across both sides of the ecosystem i.e., hosts and attendees in this case? I have noticed some frameworks break-down for both vs. others do detailed break-down only for the consumer side. What do you think is a better approach?

Hi Diana, would you recommend providing only 1 Northstar metric for these types of questions? In this case, I actually think there should be 2 North Star metrics, with one measuring the scale of the impact, and the other measuring the depth of the impact. Ex. # of users / week that RSVP for events, and # events RSVP'ed / week. The example you chose, # of people that RSVP to at least 1 event does not measure the depth of the impact.

Amazing answer. ❤❤❤

Thank you for such a great answer, Dianna! I have a quick question: For the north star metric, why do you focus on people who attend events (# of people who RSVP to at least 1 event) rather than the # of events (E.G. # of events with at least 5 attendees). I think the latter could also cover the cases other than power users. Is it because our goal should focus more on user interest, which is something the event number cannot be covered? Thank you!

Wow taking notes from all ur videos coming up with my own Framework thank you!!

What is RSVP ?

Hi Dianna when watching other PM interview tools you mentioned in another video (e.g. Exponent) the answers for this type of metric question are usually around 20-30 minutes long with the interviewee talking most of that time. They go through a framework called GAME (Goals, Actions, Metrics, Evaluate). Interviewees call out a high level metric during the Goals step, e.g., engagement or retention. Then dive into user actions that related to that high level bucket. The section that takes the most time is the Actions step. I’ve seen interviewees making a table with 3 columns (1. Funnel steps, 2. User Actions, 3. Metrics). Then they prioritize those metrics into one north start metric using dimensions such as, does is align with the mission, does it increase the health of the product, is it an actionable metric, how likely can it be gamed. Only then do they reach the North Star metric. So the North Star metric is reached towards the middle/end of the interviews. What’s your opinion on these much longer frameworks?

Hi Dianna, your videos are great, but this one was less than 5 min... how does this translate to the full 30-40min???

Sometimes I find the downstream impact metrics coincides with the Northstar breakdown metrics. For example, the Northstar metric is the number of RSVP to Events. This could be further broken down by the number of conversations that occur between Event hosts and attendees or between Event attendees. In the video, you identified the increase in conversations between user profiles as a downstream impact. So I find that there can be cases where downstream impact examples and Northstar metric breakdowns can overlap.

Hi Dianna, thanks for your videos. All of it help me a lot. I have a question about this kind of product execution question. For a product execution question which is asking "how would you set the goals for the next 6 months for Messenger's Video Calling feature", how would you suggest I approach such a question? I'm not sure if the goal should be really specific with numbers or hypothetical?

Thanks for putting out such great content, really appreciate the clean/straightforward frameworks (subscribed)

Hi Dianna, Thank you!. Great video. I am trying to find where do you mention Goal? Are you referring to Sucess metrics as Goal? In other video for AirBnB the video title was "How to define success metrics and goals", you beautifully broke down the NSM. I am trying to understand where the "Goal" fits and why you didn't mention about it? Many thanks!

Hi Dianna,

Great video! I noticed the video ended before you could touch upon the counter metrics and why you chose these. Is there a separate video that touches upon this topic?

is there a right/wrong answer for choosing a NS metric? Obviously, there are good and better options to choose a NS metric, but sometimes it's difficult to think through that in an interview setup. Would appreciate any thoughts on this.

Super helpful video and excellent demonstartion using the example. Thanks a lot for the video!

Hi Dianna, thanks for the informative videos! How do we decide specific timeframe of metrics, such as per week or month? Are there any rules of thumb? Also, how do you decide between average # and total # ?

Content is great. I actually like the delivery of the content in earlier videos. I feel a little bit like i'm being yelled at when you emphasize words in the newer videos. just a little tiny bit.

thanks a lot for your help Dianna - I chose number of events with healthy engagement as my Northstar - further broke it down to 
Number of events with at least x RSVPS & Number of event creators to check the supply
Number of users interacting with the events/interested/going to check the funnel on demand

Very informative content. Can you help create content for 1) user segmentation 2) strategy questions?

I can’t thank you enough for all of your tips and for you taking the time to teach and prepare me for the FB interviews! I’m so excited to say that I got a FB offer and I certainly credit it to you.

Thank you for your personal sessions with me and creating relevant and real content that can’t be copied. I love your authenticity and your passion to help others excel.

Great! Can you please do something non Facebook ? eg. lets say Goals for UBER Eats ?

Wow this is one of your best yet! You covered so much in less than 5 mins. I need to become better like this!