IGL Trials Database

IGL curates a database with randomised controlled trials in the field of innovation, entrepreneurship and growth. Browse our list of topics, see it as a map, or use the search function below.

2023
Cruz-Castro, L., Sanz-Menéndez, L.

Gender differences in research funding exist, but bias evidence is elusive and findings are contradictory. Bias has multiple dimensions, but in evaluation processes, bias would be the outcome of the reviewers’ assessment. Evidence in observational approaches is often based either on outcome distributions or on modeling bias as the residual. Causal claims are usually mixed with simple statistical associations.

2023
Asanov, I., Asanov, A.-M., Åstebro, T., Buenstorf, G., Crépon, B., McKenzie, D., Flores T., F.P., Mensmann, M., Schulte, M.

Many school systems across the globe turned to online education during the COVID-19 pandemic. This context differs significantly from the prepandemic situation in which massive open online courses attracted large numbers of voluntary learners who struggled with completion. Students who are provided online courses by their high schools also have their behavior determined by actions of their teachers and school system.

2023
Meng, C.C., Mizen, P., Riley, R., Schneebacher, J.

Structured management practices are robustly correlated with superior performance, but while some firms change practices quickly, wide dispersion of management quality persists. Uniquely, combining evidence from two novel business surveys and a failed management mentoring field experiment, we observe firms’ intentions to improve their management practices and firms’ subjective barriers to improving their management practices. We find clear evidence of positive selection into a free management mentoring scheme: the worst managed firms were the least likely to seek help.

2023
Fang, Z., Jia, N., Liao, C., Luo, X.

Can artificial intelligence (AI) assist human employees in increasing employee creativity? Drawing on research on AI-human collaboration, job design, and employee creativity, we examine AI assistance in the form of a sequential division of labor within organizations: in a task, AI handles the initial portion which is well-codified and repetitive, and employees focus on the subsequent portion involving higher-level problem-solving. First, we provide causal evidence from a field experiment conducted at a telemarketing company.

2023
Duflo, E., Keniston, D., Suri, T., Zipfel, C.

Agricultural extension programs often train a few farmers and count on diffusion through social networks for the innovation to spread. However, if markets are imperfectly integrated, this may also inflict negative externalities. In a two-step experiment of an agronomy training program among Rwandan coffee farmers, we first randomize the concentration of trainees at the village level and then randomly select within each village. Knowledge increased, and yields were 6.7% higher for trained farmers.

2023
Adhvaryu, A., Dhanaraj, S., Gade, S., Nyshadham, A.

India is host to 63 million Micro, Small and Medium scale Enterprises (MSMEs), contributing to a large share of employment, industrial output as well as high volume of emissions per unit of output. Therefore, adoption of energy efficient (EE) technologies by MSMEs is crucial in improving not only their competitiveness through cost reduction but also worker wellbeing and productivity through improvements in the work environment. Enterprise owners most often do not internalize the benefits of the latter; like productivity gains due to reduction in exposure of workers to heat, pollution etc.

2023
Giones, F., Lichius, K., Wahl, A.

Early-stage researchers (ESRs - PhDs and Post-docs) are repeatedly touted as an untapped source of high-potential entrepreneurship. However, most entrepreneurship initiatives have either focused on undergraduate students or on consolidated scientists (PIs and professors). We argue that attempts to translate these initiatives to engage early-stage researchers (ESRs) are missing the positive impact of entrepreneurship beyond the direct commercialization of scientific outputs.

2023
Brown, G., Hardy, M., Mbiti, I., McCasland, J., Salcher, I.

We use a field experiment to test whether financial incentives can improve the quality of apprenticeship training. Trainers (firm owners) in the treatment group participated in a tournament incentive scheme where they received a payment based on their apprentices’ rank-order performance on a skills assessment. Trainers in the control group received a fixed payment based on their apprentices’ participation in the assessment. Performance on the assessment was higher in the treatment group.

2023
Gupta, S.

Innovation plays a pivotal role in fostering economic growth, yet there is a limited understanding of whether it can be taught. I conduct a randomized evaluation of an education program implemented by a state government and a nonprofit organization, providing an opportunity to 6,224 8th-grade students from disadvantaged backgrounds to develop frugal innovations for global and local problems. To assess students’ innovative ability, I created a novel scale with inputs from experienced inventors and used a lab-in-the-field game from experimental economics.

2023
Cerda, M., Gertler, P., Higgins, S., Montoya, A.M., Parrado, E., Undurraga, R.

We conducted two randomized controlled trials (RCTs) to evaluate the impact of government-guaranteed loans offered by the Chilean and Colombian governments. The public funds of these programs greatly expanded following the start of the Covid-19 pandemic and offered loans to Micro, Small and Medium Enterprises to mitigate the negative impact of the shock. Through a collaboration with private banks, we launched two experiments which offered loans to a sub-set of the 10,072 Chilean and 3,079 Colombian small businesses that took part in our experiments.

2023
Hardy, M., McCasland, J.

We report the results of a field experiment that randomly placed unemployed young people as apprentices with small firms in Ghana and included no cash subsidy to firms (or workers) beyond in-kind recruitment services. Treated firms experienced increases in firm size of approximately half a worker and firm profits of approximately 10 percent for each apprentice placement offered, documenting frictions to novice hiring.

2023
Candelon, F., Dell'Acqua, F., Kellogg, K., Krayer, L., Lakhani, K.R., Lifshitz-Assaf, H., McFowland, E., Mollick, E.R., Rajendran, S.

The public release of Large Language Models (LLMs) has sparked tremendous interest in how humans will use Artificial Intelligence (AI) to accomplish a variety of tasks. In our study conducted with Boston Consulting Group, a global management consulting firm, we examine the performance implications of AI on realistic, complex, and knowledge-intensive tasks. The pre-registered experiment involved 758 consultants comprising about 7% of the individual contributor-level consultants at the company.

2023
Bloom, N., Codreanu, M.A.

This study is focused on the relationship between borrowing constraints, access to cutting-edge technology and information about cutting-edge technology on the performance of U.S. online businesses. With the help of two large U.S. technology companies we will be able to randomize access to loans and free cloud computing credits (as well as information about the potential use of technology) to otherwise identical (generally small, but fast growing) firms, to see if they will have a causal impact on firm development.

2022
Dimitriadis, S., Koning, R.

What is preventing entrepreneurs and managers from forming peer connections themselves? This paper argues that entrepreneurs may be under-networked because they lack the necessary social skills that allow them to match efficiently with knowledgeable peers.

2022
Espinosa, M., Stanton, C.

We study direct productivity changes and spillovers after a randomized training program for the frontline workers in a Colombian government agency. While trained workers improved their individual production, we also find substantial spillovers that affected managers' productivity. We use email data and a survey to explore the mechanisms behind these spillovers and find that managers' increased output arises from reductions in the need to help lower level employees.

2022
Cusolito, A.P., Darova, O., Mckenzie, D.J.

The limited market size of many small emerging economies is a key constraint to the growth of innovative small and medium enterprises. Exporting offers a potential solution, but firms may struggle to locate and appeal to foreign buyers. A six-country randomized experiment was conducted with 225 firms in the Western Balkans to test the effectiveness of 30 hours of live group-based training and 5 hours of one-on-one remote consulting in overcoming these constraints.

2022
Levine, S., Stein, C., Williams, H.

In many scientific contexts, peer review can be either single-blind or double-blind: in single-blind review, research work (e.g., manuscripts, proposals) is reviewed alongside information on the author(s), whereas in double-blind review, information on the author(s) is withheld. We will report results from a randomized experiment conducted in collaboration with a grantmaking body, in the context of the grantmaker reviewing proposals in one field of science.

2022
Huneeus, F., Martínez Alvear, C., Woodruff, C.

This impact evaluation aims to measure the effect of a program that combines business training, mentoring, and a large cash transfer on high-potential small and medium businesses in Chile. 250 out of the top 500 firms participating in a business plan competition will be randomly selected to receive all three components of the program, while the remaining firms will receive none of them. In-person surveys with the entrepreneurs will be conducted before and 12 months after the program.

2022
Crusan, J., Lakhani, K., Lane, J., Menietti, M., Szajnfarber, Z.

Resource allocation decisions play a dominant role in shaping a firm’s technological trajectory and competitive advantage. Recent work indicates that innovative firms and scientific institutions tend to exhibit an anti-novelty bias when evaluating new projects and ideas. In this paper, we focus on shedding light into this observed pattern by examining how evaluator expertise in the problem’s focal domain shapes the relationship between novelty and feasibility in evaluations of quality for technical solutions.

2022
Buehren, N., Papineni, S.

This lab-in-the-field experiment will measure the gender bias in entrepreneurship and investment among youth and credit officers in Ethiopia. Chigign Tobiya “Ethiopia Emerges” is a television show in Ethiopia where entrepreneurs pitch their business ideas to a panel of business tycoons for a chance to get investment funding.

2022
Cohodes, S., Ho, H., Robles, S.C.

The federal government and many individual organizations have invested in programs to support diversity in the STEM pipeline, including STEM summer programs for high school students, but there is little rigorous evidence of their efficacy. We fielded a randomized controlled trial to study a suite of such programs targeted to underrepresented high school students at an elite, technical institution. The STEM summer programs differ in their length (one week, six weeks, or six months) and modality (on-site or online).

2022
deGrazia, C., Pairolero, N., Pappas, P.-A., Teodorescu, M., Toole, A.

Women are underrepresented in patenting and the gap is not closing quickly. One major roadblock to progress is a dearth of causal evidence on the potential effectiveness of policies to reduce the gender gap in patenting. Analyzing a randomized control trial at the United States Patent and Trademark Office that was designed to provide additional help to applicants who do not have legal representation, we find heterogeneous causal impacts across gender and technologies on the probability of obtaining patent rights.

2022
Iacovone, L., Maloney, W., McKenzie, D.

Differences in management quality are an important contributor to productivity differences across countries. A key question is then how to best improve poor management in developing countries. We test two different approaches to improving management in Colombian auto parts firms. The first uses intensive and expensive one-on-one consulting, while the second draws on agricultural extension approaches to provide consulting to small groups of firms at approximately one-third of the cost of the individual approach.

2022
Howell, S., Kuchler, T., Snitkof, D., Stroebel, J., Wong, J.

By enabling smaller loans, broader geographic reach, and less human bias in decision-making, process automation may reduce racial disparities in access to financial services. We find evidence for all three channels in a setting where private lenders faced no credit risk but decided who to serve: the Paycheck Protection Program (PPP), which provided loans to small businesses during COVID-19. Black-owned firms disproportionately obtained their PPP loans from fintech lenders, especially in areas with high racial animus.

2022
Gorodnichenko, Y., Kumar, S., Coibion, O.

Using a new survey of firms in New Zealand, we document how exogenous variation in the macroeconomic uncertainty perceived by firms affects their economic decisions. We use randomized information treatments that provide different types of information about the first and/or second moments of future economic growth to generate exogenous changes in the perceived macroeconomic uncertainty of some firms. The effects on their decisions relative to their initial plans as well as relative to an untreated control group are measured in a follow-up survey six months later.

2022
Custodio, C., Hansman, C., Mendes, D.

This paper studies whether informational frictions prevent firms from accessing government support using a randomised controlled trial. We focus on two Portuguese COVID-19 relief programs, providing (i) wage support for workers who are kept on payroll and (ii) credit lines backed by government guarantees. We randomly assign firms to a treatment providing either simplified information about a program, or a combination information and step-by-step application support. We find a significant treatment effect on take up of the wage support program.

2022

We analyze, benchmark, and run randomized controlled trials on a panel of 7,463 U.S. entrepreneurs making incentivized sales forecasts. We assess accuracy using a novel administrative dataset obtained in collaboration with a leading US payment processing firm. At baseline, only 13% of entrepreneurs can forecast their firm’s sales in the next three months within 10% of the realized value, with 7.3% of the mean squared error attributable to bias and the remaining 92.7% attributable to noise.

2022
Fairlie, R., Turner, P.

This project is a collaboration with Corner to Corner to study the impact of their entrepreneurship training course on financial stability. Corner to Corner, a Nashville-based nonprofit, is focused on their mission of helping their neighbors to flourish and addressing the racial wealth gap. One of their primary programs is The Academy, a 10-week entrepreneurship training course that teaches students the fundamentals of starting and operating their own business.

2022
Carson, R., Graff Zivin, J.S., Louviere, J., Sadoff, S., Shrader Jr, J.G.

This experiment tries to understand how managers respond to uncertainty when making research and development decisions. Three experiments were conducted with master’s degree students in a program focused on the intersection of business and technology.

2022
Brune, L., Giné, X., Karlan, D.

Microcredit promised business growth for small firms lacking access to banking loans. Although microcredit has reached millions, recent randomized evaluations find limited average business impacts. Critics often blame contract rigidity, specifically the fixed and frequent installments, for the lack of productive risk-taking. But such rigidity may instill borrower discipline. This study partnered with a Colombian lender that offered first-time borrowers a flexible loan that permitted delaying up to three monthly repayments.

Pages