Experimental Kit: Stage 2

Implementation

Stage 2: Implementation

After the experiment is designed, it is time to put the plan into action and begin the trial. This stage involves moving from theoretical design to real-world execution.

Recruitment

Participants are the lifeblood of experiments, providing the real-world evidence (or lack thereof) for your intervention. Getting recruitment numbers right is crucial, as under-recruitment may lead to an underpowered trial, which can affect the ability to produce reliable findings. Researchers must actively recruit participants – whether they are individuals, firms, or other units – and secure their “buy-in” by explaining the wider benefits of the trial.

Randomisation

Experiments are effective because of randomisation, the process that ensures groups are statistically equivalent at the start of the study. There are many ways to randomise, such as simple, blocked, and stratified randomisation. A clear plan, and clear records for, randomisation ensures the allocation sequence remains unpredictable and concealed from those recruiting participants, preventing selection bias.

Outcome data collection

Data collection takes place at several key stages. Baseline data should be collected after recruitment but before randomisation to ensure participant knowledge of their group does not influence their responses. Post-intervention data collection must then be performed for all groups at the same time and under the same conditions to maintain study validity.

Funding, agreements, and piloting

Successful implementation often requires securing necessary research funding, establishing agreements with partner organisations (such as a contract, memorandum of understanding or data-sharing agreement), and conducting pilot trials to test if all main parts of the study work together.