Facilitating post-experiment discussion sessions

Overview

Running experiments is a valuable way to quickly gain insights. However, without proper coordination in sharing results and outlining next steps, valuable momentum can be lost.

Result

Our Product Ops Assistant will coordinate summary and discussion of experiment results with key organizational members to determine actionable next steps.

Share playbook

Process

Gather experiment results

Product Ops Assistant

‍Ensure that experiment results are clearly documented. If using an experiment canvas, complete the Results section of the document.

‍Product Ops Assistant & Product Leader

‍Meet to review the experiment results and determine who should participate in a post-experiment discussion session.

This could include the original team involved in the experiment, as well as other stakeholders interested in the outcomes and having input on subsequent actions.

Prepare team for discussion session

‍Product Ops Assistant

‍Send out a meeting invitation along with a summary of the experiment to all participants. Be sure to provide context for those who weren’t involved in the experiment. The summary should include:

The priority of the experiment and its alignment with business goals.
The question the experiment aimed to answer.
The hypothesis.
A brief overview of the experimental setup and execution team.
A summary of the results.

Include an agenda outlining the meeting’s objectives:

Review the experiment results to determine whether the hypothesis was validated, invalidated, or inconclusive.
Define next steps based on the findings.

Meet to review results and define next steps

‍Product Ops Assistant

‍Ensure that the majority of the meeting time is focused on discussing the experiment results and agreeing on next steps.

‍Product Ops Assistant & Product Leader

‍After the meeting, discuss the conclusions and next steps. Ensure that any decisions impacting the product organization are incorporated into the product priorities or roadmap. Additionally, share the results with others in the organization who may have an interest in the experiment and its outcomes. For guidance on this, consult our "Communicating About Experiments to Teams and Stakeholders" playbook.

To prevent the discussion from going off-topic, ensure that the team stays focused on the experiment at hand. Any unrelated conversations or new experimental ideas should be noted and scheduled for a separate meeting.