Innovating product design is crucial for firms operating in the digital sector as it is closely linked with innovation capability and, therefore, with firm performance and productivity. In this paper, we run a randomized controlled trial to assess if participating in an open innovation initiative increases SMEs’ capability to design more competitive digital products. More specifically, the intervention aimed at increasing firms’ knowledge of the Design Sprint and their readiness to implement user-centered design techniques.
IGL Trials Database
IGL curates a database with randomised controlled trials in the field of innovation, entrepreneurship and growth. Browse our list of topics, see it as a map, or use the search function below.
2024
We evaluate the impact of the UK’s Growth Vouchers Programme, which offered subsidised business advice to 15,207 randomly selected small and medium size enterprises. Using administrative and survey data, we show that the programme increased turnover by 8.2% but only in the short-term and potentially at the expense of non-supported firms. We find that subsidised advice appears to improve firms’ capabilities and practices in a way that is consistent with the increase in turnover.
2024
Business-science collaboration is essential for fostering innovation and economic development, particularly in rapidly evolving sectors like AI and Energy Efficiency and Sustainability. We study how to enhance the collaboration between firms and scientists given persistent barriers such as information frictions, behavioral biases, and high transaction costs. To address existing challenges, the research investigates the potential of matchmaking interventions.
2023
While evidence indicates that the notice and comment (N&C) process improves regulatory compliance by increasing trust in government, there is reason to doubt this mechanism’s viability in the digital realm. The lack of direct human interactions online can lead participating firms to feel unheard and unengaged. As a result, online N&C efforts can actually undermine firms’ views of the government’s regulatory authority and hamper efforts towards compliance.
2023
We study the allocation and productivity consequences of training production line supervisors in soft skills via a randomized controlled trial. Consistent with standard practice for training investments within firms, we asked middle managers – who sit above supervisors in the hierarchy – to nominate members of their supervisory team for training. Program access was randomized within these recommendation rankings. Highly recommended supervisors experienced no productivity gains; in contrast, less recommended supervisors’ productivity increased 12% relative to controls.
2023
Although entrepreneurship training programs are designed to help necessity entrepreneurs acquire skills and capabilities to take entrepreneurial action, participants in these programs often fail to do so. In partnership with a local government agency, we conducted a randomized field experiment involving 165 entrepreneurs in rural Tanzania where in addition to providing technical-skills training, approximately half of the participants also received “growth mindset” psychological training.
2023
Gender differences in research funding exist, but bias evidence is elusive and findings are contradictory. Bias has multiple dimensions, but in evaluation processes, bias would be the outcome of the reviewers’ assessment. Evidence in observational approaches is often based either on outcome distributions or on modeling bias as the residual. Causal claims are usually mixed with simple statistical associations.
2023
Can artificial intelligence (AI) assist human employees in increasing employee creativity? Drawing on research on AI-human collaboration, job design, and employee creativity, we examine AI assistance in the form of a sequential division of labor within organizations: in a task, AI handles the initial portion which is well-codified and repetitive, and employees focus on the subsequent portion involving higher-level problem-solving. First, we provide causal evidence from a field experiment conducted at a telemarketing company.
2023
Many school systems across the globe turned to online education during the COVID-19 pandemic. This context differs significantly from the prepandemic situation in which massive open online courses attracted large numbers of voluntary learners who struggled with completion. Students who are provided online courses by their high schools also have their behavior determined by actions of their teachers and school system.
2023
Structured management practices are robustly correlated with superior performance, but while some firms change practices quickly, wide dispersion of management quality persists. Uniquely, combining evidence from two novel business surveys and a failed management mentoring field experiment, we observe firms’ intentions to improve their management practices and firms’ subjective barriers to improving their management practices. We find clear evidence of positive selection into a free management mentoring scheme: the worst managed firms were the least likely to seek help.
2023
Agricultural extension programs often train a few farmers and count on diffusion through social networks for the innovation to spread. However, if markets are imperfectly integrated, this may also inflict negative externalities. In a two-step experiment of an agronomy training program among Rwandan coffee farmers, we first randomize the concentration of trainees at the village level and then randomly select within each village. Knowledge increased, and yields were 6.7% higher for trained farmers.
2023
India is host to 63 million Micro, Small and Medium scale Enterprises (MSMEs), contributing to a large share of employment, industrial output as well as high volume of emissions per unit of output. Therefore, adoption of energy efficient (EE) technologies by MSMEs is crucial in improving not only their competitiveness through cost reduction but also worker wellbeing and productivity through improvements in the work environment. Enterprise owners most often do not internalize the benefits of the latter; like productivity gains due to reduction in exposure of workers to heat, pollution etc.
2023
Early-stage researchers (ESRs - PhDs and Post-docs) are repeatedly touted as an untapped source of high-potential entrepreneurship. However, most entrepreneurship initiatives have either focused on undergraduate students or on consolidated scientists (PIs and professors). We argue that attempts to translate these initiatives to engage early-stage researchers (ESRs) are missing the positive impact of entrepreneurship beyond the direct commercialization of scientific outputs.
2023
We use a field experiment to test whether financial incentives can improve the quality of apprenticeship training. Trainers (firm owners) in the treatment group participated in a tournament incentive scheme where they received a payment based on their apprentices’ rank-order performance on a skills assessment. Trainers in the control group received a fixed payment based on their apprentices’ participation in the assessment. Performance on the assessment was higher in the treatment group.
2023
Innovation plays a pivotal role in fostering economic growth, yet there is a limited understanding of whether it can be taught. I conduct a randomized evaluation of an education program implemented by a state government and a nonprofit organization, providing an opportunity to 6,224 8th-grade students from disadvantaged backgrounds to develop frugal innovations for global and local problems. To assess students’ innovative ability, I created a novel scale with inputs from experienced inventors and used a lab-in-the-field game from experimental economics.
2023
We conducted two randomized controlled trials (RCTs) to evaluate the impact of government-guaranteed loans offered by the Chilean and Colombian governments. The public funds of these programs greatly expanded following the start of the Covid-19 pandemic and offered loans to Micro, Small and Medium Enterprises to mitigate the negative impact of the shock. Through a collaboration with private banks, we launched two experiments which offered loans to a sub-set of the 10,072 Chilean and 3,079 Colombian small businesses that took part in our experiments.
2023
We report the results of a field experiment that randomly placed unemployed young people as apprentices with small firms in Ghana and included no cash subsidy to firms (or workers) beyond in-kind recruitment services. Treated firms experienced increases in firm size of approximately half a worker and firm profits of approximately 10 percent for each apprentice placement offered, documenting frictions to novice hiring.
2023
The public release of Large Language Models (LLMs) has sparked tremendous interest in how humans will use Artificial Intelligence (AI) to accomplish a variety of tasks. In our study conducted with Boston Consulting Group, a global management consulting firm, we examine the performance implications of AI on realistic, complex, and knowledge-intensive tasks. The pre-registered experiment involved 758 consultants comprising about 7% of the individual contributor-level consultants at the company.
2023
This study is focused on the relationship between borrowing constraints, access to cutting-edge technology and information about cutting-edge technology on the performance of U.S. online businesses. With the help of two large U.S. technology companies we will be able to randomize access to loans and free cloud computing credits (as well as information about the potential use of technology) to otherwise identical (generally small, but fast growing) firms, to see if they will have a causal impact on firm development.
2023
Purpose
This article reports the results of a randomized field experiment that tested the effects of a new business intervention among managers of small- and medium-sized enterprises (SMEs) in England.
Design/methodology/approach
Individual managers (learners) were randomly assigned in clusters (companies) to either an intervention group (265 learners; 40 SMEs) receiving a novel virtual, blended training program designed to stimulate a change in management behavior or a no-intervention group (118 learners; 22 SMEs).
2023
Female innovators raise fewer resources from investors, even when their ventures are similar to those of all-male teams. Efforts to mitigate the disparities have typically focused on changing how founders seek investment. However, the causes of gender disparities are systemic: in uncertain contexts, evaluators value women’s competence or leadership potential lower than men’s, and investors inquire more about risks when facing female founders than males.
2023
The design of research grants has been hypothesized to be a useful tool for influencing researchers and their science. We test this by conducting two thought experiments in a nationally representative survey of academic researchers. First, we offer participants a hypothetical grant with randomized attributes and ask how the grant would influence their research strategy. Longer grants increase researchers' willingness to take risks, but only among tenured professors, which suggests that job security and grant duration are complements.
2023
There is a growing belief that scalable and low-cost AI assistance can improve firm decision-making and economic performance. However, running a business involves a myriad of open-ended problems, making it hard to generalize from recent studies showing that generative AI improves performance on well-definedwriting tasks. In our field experiment with 640 Kenyan entrepreneurs, we assessed the impact of AI-generated advice on small business revenues and profits.
2023
Measuring the returns of advertising opportunities continues to be a challenge for many businesses. We design and run a field experiment in collaboration with Yelp across 18,294 firms in the restaurant industry to understand which types of businesses gain more from digital advertising. We randomly assign 7,209 restaurants to freely receive Yelp’s standard ads package for three months. The scale of the experiment gives us a unique opportunity to assess the heterogeneity in advertising effectiveness across a variety of business attributes.
2023
Effective workplace management plays a crucial role in determining employee performance, retention, and subsequently, overall firm performance. While conventional management strategies often emphasize hierarchical relationships, peer-to-peer management, or "managing across," represents a promising yet largely unexplored approach. This study aims to investigate the impact of peer-to-peer management training on various employee outcomes and identify the conditions under which the intervention proves most effective.
2023
Understanding how to design policies to effectively reduce firm-level carbon emissions while minimizing impacts on economic growth is a question of central importance in the battle to mitigate climate change. The EU is proposing a Carbon Border Adjustment Mechanism (CBAM) that will tax imports to better reflect their carbon content. This project evaluates three policies that provide firms with training and assistance obtaining loans with the goal of mitigating the impacts of CBAM on Turkish SMEs.
2023
Whose problems do investors see as worth solving? I experimentally study how investors evaluate a startup idea based on the socioeconomic background of the founder, the target customer, and the (in)congruence between the two. I am also interested in how the socioeconomic background of investors themselves affect these evaluations. I aim to contribute to the research on diversity and inequality in entrepreneurial funding in which socioeconomic backgrounds have been relatively understudied.
2023
Management strategies significantly influence worker productivity, retention, career growth, and the overall performance of a firm. Traditional top-down approaches have typically underscored the importance of supervisors in shaping managerial quality and employee performance. Much research suggests that training supervisors to effectively manage their subordinates may be a useful way to enhance supervisor-worker relationships and, in turn, boost firm productivity. However, these approaches may face two primary challenges.
2023
In an RCT with US small businesses, we document that a large share of firms are not well-informed about bankruptcy. Many assume that bankruptcy necessarily entails the death of a business and do not know about Chapter 11 bankruptcy, where debts are renegotiated so that the business can continue operating. Small businesses are also unaware of a recent major reform that lowered the costs of bankruptcy procedures to enhance their protection.
2023
Does growth training help entrepreneurs scale-up new ventures? Our field experiment answers this question using data from 181 Singapore-based, early-growth entrepreneurs drawn from a broad range of industry sectors. Treatment content focused on three growth-catalyst tools relevant for formulating and executing innovation-led growth: business-model design, leveraging external networks, building internal teams. Treatment format comprised interactive lecture sessions and workshops on these tools supplemented by personalized coaching in applying the tools to entrepreneurs’ specific challenges.