Skip to content

Build a weekly social media experiment log

Write the decision, variation and comparison rule before publishing. Record the exact assets and consistent observation windows. Use the log to understand what changed; a small uncontrolled comparison is a clue for the next test, not proof of a universal best practice.

Your working document

Complete the record

Log entryFictional exampleInterpretation
QuestionDoes a close-up opening help viewers understand the product?One production decision
VariationClose-up first versus packaging firstKeep the later explanation comparable
MeasureCompletion under one consistent platform definitionUse the same observation window
ConditionsDifferent topics and audiences may still affect resultsRecord differences instead of concealing them
Next stepRepeat with another suitable product explanationCheck whether the finding holds

Check before sharing

  • Change one main feature when the question allows it.
  • Record both the numerator and denominator for ratios.
  • Avoid choosing the winning metric after seeing the results.
  • State when the evidence is too sparse or inconsistent for a decision.

Use the worksheet in practice

A post with eight saves from 200 reached accounts has a 4% saves-per-reach ratio; another with twelve saves from 600 has 2%. The second has more saves in total. Which matters depends on the decision and consistent metric definitions, not whichever number looks better.

An experiment log preserves the context for a follow-up. It should include changed offers, paid distribution, unusual events and delayed publication when those affect the comparison. Do not remove an inconvenient result from the record.