دوره آزمایش و تست ریفورج (Reforge) با زیر نویس فارسی

▼ Strategic Experimentation

• The Value of Experimentation

                — Why Experimentation is Critical

                — Cultural Barriers to Experimentation

                — Five Myths of Experimentation

                — Strategic vs. Ad Hoc Experimentation

▼ Identifying A Strategic Opportunity

• Building a Strategic Foundation

                — When To Use Experimentation

                — Three Components of a Strategic Opportunity

• Understanding Your Strategy

                — Defining Your Strategy

                — Growth Model: Acquisition and Retention

                — Growth Model: Monetization and Defensibility

• Customer Problem

                — Defining a Customer Problem

                — User Insight to Customer Problem

                — Data Insight to Customer Problem

                — Mistakes in Defining Customer Problems

• Business Outcome

                — Outcome Metrics

                — Acquisition Outcome Metrics

                — Retention Outcome Metrics

                — Monetization Outcome Metrics

• Prioritizing and Communicating

                — Prioritizing Your Strategic Opportunities

                — Creating a Narrative

• BONUS: Module Recap

                — Recap: Identifying a Strategic Opportunity

▼ Solution Ideation

• Intro to Solution Ideation

                — Introduction

• Generating Solutions

                — Good vs. Great Solution Development

                — Design Modifications

                — User Psych

                — Solution Pitch Workshop

                — Alternative Worlds Workshop

• Building an Experimentation Roadmap

                — Solution Evaluation Metrics

                — Initial Solution Evaluation

                — Provisional Solutions

                — Experimentation Roadmap

• BONUS: Module Recap

                — Recap: Solution Ideation

▼ Test & Learn 1: Test Preparation

• Introduction to Test Preparation

                — Test Preparation Preview

• Experimentation Statistics

                — True vs. Observed Probabilities

                — A/B Test Outcomes

                — Statistical Significance

                — Sample Size

• Prioritizing Solutions

                — Test Prioritization

                — Time to Get Results

                — Sizing Opportunity + Time to Build

                — Simultaneous vs. Sequential Testing

• Building Tests

                — Minimizing Build Complexity

                — User Assignment

                — Client-Side vs. Server-Side Tests

• BONUS: Test & Learn 1

                — Continuous Variables

                — One-Tail A/B Tests

                — Multivariate Testing

                — Multi-Armed Bandit Testing

                — Avoiding Solution-Control Interference

• BONUS: Module Recap

                — Recap: Test Preparation

▼ BONUS: The Bayesian Approach

• Bayesian Statistics

                — What is the Bayesian Approach?

                — Bayesian vs. Frequentist Outcomes

                — Bayes Theorem

                — Beta Distributions

• Bayesian A/B Testing

                — Defining Priors

                — Analyzing Data

                — Applying Decision Criteria

▼ Test & Learn 2: Analyzing Test Results

• Module Preview

                — Intro to Analyzing Test Results

• Test Launch

                — Launch Timing

                — Launch Authority

                — Ramping a Test

                — Use of A:A Tests

• Calling a Test Complete

                — Monitoring Test Data

                — Calling a Test Early

                — Extending Tests Longer

• Evaluating Test Results

                — Turning Outcomes Into Action

                — Segmenting Test Results

                — Conflicting User Segments

                — Simpson's Paradox

• Iterating

                — Learning From Test Results

                — Iterating on Losses

                — Iterating on Wins

• BONUS: Module Recap

                — Recap: Analyzing Test Results

▼ Productizing Wins

• Introduction to Productizing Wins

                — Intro to Productizing Wins

• Implementing Test Wins

                — Decision Maker Buy-In

                — Full vs. Partial Implementation

                — Implementation Plan

• Measuring Value

                — Test Impact vs. Actual Impact

                — Holdout Tests

                — Alternatives to Holdout Groups

• Communicating Results

                — The Value of Communication

                — Institutionalizing Education

                — Evangelizing Experimentation

• BONUS: Module Recap

                — Recap: Productizing Wins

• Productizing Wins

                — BONUS: Slack Case Study Analysis

▼ Managing An Experimentation Program

• Module Preview

                — Intro to Managing an Experimentation Program

• Starting and Expanding Experimentation

                — Common Mistakes of Early Experimentation

                — Running Early Experiments

                — 3 Phases of Experimentation Maturity

• Expanding Scope

                — Leveraging the Experience Curve

                — Diversifying the Experiment Portfolio

                — Experimentation at Scale

• Measuring Success

                — Perverse Incentives

                — Quantitative Evaluation

                — Qualitative Evaluation

• Creating an Experimentation Culture

                — Achieving an Experimentation Culture

• BONUS: Module Recap

                — Recap: Managing an Experimentation Program

▼ Templates

• Templates

                — Strategic Opportunity Planning Map

                — Example Planning Map: SurveyMonkey & Credit Karma

                — Reforge EVELYN Template

                — MongoDB Test Data

                — Bayesian A/B Test Template