CryptoBridge Korea
Skip to main content

NO. 11 / Korea entry / FULL PAPER

Attention Needs a Counterfactual

Separate delivered attention, attributed actions and incremental impact when evaluating KOL campaigns and AMAs.

Series period 2025.11Published 2026-10-18Updated 2026-10-194 min read

The series period is a retrospective topic label, not a historical publication date. Source observation and publication dates are identified separately. Full English edition updated on 19 October 2026.

Attention Needs a Counterfactual · CryptoBridge Korea Research 11
In this paper
  1. Key findings
  2. Which problem is the AMA supposed to solve?
  3. Interested people select themselves into the audience
  4. One campaign, two cost interpretations
  5. Quality remains after the broadcast ends
  6. With small samples, report the uncertainty
  7. Select creators for problem fit
  8. Scope & limitations
  9. Sources

Key findings

  1. An AMA audience is not the same population as a product’s customers.
  2. Tagged traffic shows an observed path, not necessarily incremental demand.
  3. Report delivery, attributed actions and causal estimates separately, with uncertainty.

Which problem is the AMA supposed to solve?

An AMA can address product questions, launch concerns, usage errors and operating judgments. X Spaces enables public live audio; the format itself does not establish adoption or revenue. [1]

Choose whether the goal is awareness, resolving uncertainty among interested people or helping existing users. Each goal implies a different host and question set. The largest audience is not always the best fit.

FIGURE 01Three layers of performance
LayerExample measureInterpretation
DeliveryImpressions, listeners, questionsReach of the content
Observed pathwayTagged visits, sign-ups, returnsRecorded connected actions
Incremental effectDifference against a comparisonEstimated behavior caused by the campaign

CBK analysis. This is an analytical framework, not observed customer performance or a market benchmark.

Interested people select themselves into the audience

Participants are not randomly sampled. Existing supporters, reward seekers or people anticipating price news can be overrepresented. Applying their conversion rate to the entire market compounds selection bias.

Lewis and Rao examine the difficulty of separating small advertising effects from noisy outcomes. Their retail effect sizes cannot be transferred to crypto, but the distinction between observed and additional behavior remains useful. [3]

One campaign, two cost interpretations

A hypothetical KRW 10 million campaign with 200 tagged valid actions costs KRW 50,000 per observed action. If a comparison suggests only 40–100 additional actions, incremental cost is KRW 100,000–250,000. The difference reflects different questions, not an arithmetic error.

Do not manufacture a control group. Public broadcasts spill across audiences and market news affects everyone. Staggered releases, time series or similar cohorts can still be useful when their causal limitations are explicit.

FIGURE 02Illustrative cost per action under different denominators
200 observed50 k KRW
100 incremental100 k KRW
40 incremental250 k KRW

Hypothetical total cost: KRW 10 million. This is not actual campaign performance or a market price.

Quality remains after the broadcast ends

Group questions by product understanding, access conditions, risk and roadmap. Record what was resolved. Recurring misunderstandings can become FAQs or search content, while unanswered questions need follow-up ownership.

Campaign identifiers help distinguish subsequent visits. They do not require personal information in URLs or unnecessary tracking of individual questioners. Campaign-, content- and cohort-level measurement can support many decisions. [2]

With small samples, report the uncertainty

If eight of 100 people act in group A and five of 100 in group B, the observed difference is three percentage points. Even assuming independent randomized groups, a simple normal-approximation standard error is about 3.5 percentage points. A small-sample interval needs more care; the example already shows that uncertainty may exceed the difference.

Saying conversion was 60% higher hides the counts and absolute gap. Show denominators, absolute differences and design conditions. Voluntary AMA attendance and overlapping exposure make actual causal comparisons harder, not easier.

FIGURE 03A small hypothetical comparison
GroupActions / peopleRate
A8 / 1008%
B5 / 1005%
Observed difference3 actions with equal denominators3 percentage points
Approximate standard error√(0.08×0.92/100 + 0.05×0.95/100)3.48 percentage points

CBK analysis. This is an analytical framework, not observed customer performance or a market benchmark.

Select creators for problem fit

Beginners need accurate, accessible explanation; institutional products need relevant expertise and trust. Review format, previous work, response quality and audience interests alongside reach.

Brand memory and trust may take time to measure, but long-term value should not explain away every weak outcome. Keep short-term observations and long-term hypotheses separate and define the next evidence to collect.

Scope & limitations

Analysis draws on X feature documentation and advertising-measurement research, not measured CBK customer campaigns. Examples are not fee quotes or ROI guarantees; no audience personal data was collected.

CryptoBridge Korea analysis based on public materials. Source facts are distinguished from interpretation and hypothetical calculations. References to organizations or projects do not imply their sponsorship or review of this paper.

Sources & scope

  1. X Help, About X Spaces ↗Continuously updated · Accessed 2026-10-18Live-audio format and operating features, not campaign outcome data.
  2. Google Analytics, URL builders: Collect campaign data ↗Continuously updated · Accessed 2026-10-18Campaign source tagging, distinct from causal-effect estimation.
  3. Lewis·Rao, On the Near Impossibility of Measuring the Returns to Advertising ↗2013-12-11 working paper; 2014 NBER materials · Accessed 2026-10-18Statistical difficulty of estimating advertising returns. Effect sizes are not imported as crypto-market benchmarks.