We show in a large-scale field experiment that a brief exposure to female role models working in scientific fields affects high school students’ perceptions and choices of undergraduate major. The classroom interventions reduced the prevalence of stereotypical views on jobs in science and gender differences in abilities. They also made high-achieving girls in grade 12 more likely to enrol in selective and male-dominated science, technology, engineering and mathematics programs in college.
IGL Trials Database
IGL curates a database with randomised controlled trials in the field of innovation, entrepreneurship and growth. Browse our list of topics, see it as a map, or use the search function below.
2023
Drawing the attention of innovators to climate change is important for green innovation. We report an email field experiment with MIT using messages about the impact of climate change to invite innovators (SBIR grantees) to apply to a technology competition. We vary our messages on the time frame and scale of the human cost of climate change across scientifically valid scenarios. Innovator attention (clicks) is sensitive to climate change messaging. These changes in clicks also predict higher application rates.
2023
We document interest in labor reallocation among small firm owners in Ghana; 60% and 41%, respectively, self-report willingness to hire or work for the average local firm owner. Firm owners also exhibit high willingness-to-pay for information on a random subset of hiring firms and jobseeking firm owners, during a Becker-Degroot-Marschak exercise. Conditionally random variation in access to this information generates immediate labor adjustments within and between firms, though rarely of firm owners themselves, and impacts firm closure 5-months post-intervention.
2023
First, we will recruit people to provide advice on whether to invest in actual start-up firms and to provide a justification for their decision. We create pairs of advisors that provide the same recommendation but differ by race and gender. Next, we recruit participants for the role of investors. Each participant is endowed with one dollar for each of the four investment rounds. The adviser provides her/his assessment and investment recommendation. The investor then decides how much to invest, and the outcome is revealed.
2023
Can a set of low-cost behavioural nudges encourage more small businesses to adopt productivity-raising digital technologies? This randomised controlled trial sought to test whether businesses could be nudged into using a cloud-based system to improve the efficiency of invoice processing. All participants in the trial were offered access to the system free of charge for a 12-month period, with a treatment group receiving weekly email reminders to make use of the system.
2023
Effective managers play a vital role in successful teams by creating a positive and productive team environment, assigning tasks, setting clear goals and expectations, and facilitating communication and collaboration among team members. In this paper, we employ a distinctive experimental design to identify the marginal advantage of effective managers, and the specific attributes that yield the greatest benefits to team performance.
2023
We study the allocation and productivity consequences of training production line supervisors in soft skills via a randomized controlled trial. Consistent with standard practice for training investments within firms, we asked middle managers – who sit above supervisors in the hierarchy – to nominate members of their supervisory team for training. Program access was randomized within these recommendation rankings. Highly recommended supervisors experienced no productivity gains; in contrast, less recommended supervisors’ productivity increased 12% relative to controls.
2023
While evidence indicates that the notice and comment (N&C) process improves regulatory compliance by increasing trust in government, there is reason to doubt this mechanism’s viability in the digital realm. The lack of direct human interactions online can lead participating firms to feel unheard and unengaged. As a result, online N&C efforts can actually undermine firms’ views of the government’s regulatory authority and hamper efforts towards compliance.
2023
Although entrepreneurship training programs are designed to help necessity entrepreneurs acquire skills and capabilities to take entrepreneurial action, participants in these programs often fail to do so. In partnership with a local government agency, we conducted a randomized field experiment involving 165 entrepreneurs in rural Tanzania where in addition to providing technical-skills training, approximately half of the participants also received “growth mindset” psychological training.
2023
Gender differences in research funding exist, but bias evidence is elusive and findings are contradictory. Bias has multiple dimensions, but in evaluation processes, bias would be the outcome of the reviewers’ assessment. Evidence in observational approaches is often based either on outcome distributions or on modeling bias as the residual. Causal claims are usually mixed with simple statistical associations.
2023
Can artificial intelligence (AI) assist human employees in increasing employee creativity? Drawing on research on AI-human collaboration, job design, and employee creativity, we examine AI assistance in the form of a sequential division of labor within organizations: in a task, AI handles the initial portion which is well-codified and repetitive, and employees focus on the subsequent portion involving higher-level problem-solving. First, we provide causal evidence from a field experiment conducted at a telemarketing company.
2023
Many school systems across the globe turned to online education during the COVID-19 pandemic. This context differs significantly from the prepandemic situation in which massive open online courses attracted large numbers of voluntary learners who struggled with completion. Students who are provided online courses by their high schools also have their behavior determined by actions of their teachers and school system.
2023
Structured management practices are robustly correlated with superior performance, but while some firms change practices quickly, wide dispersion of management quality persists. Uniquely, combining evidence from two novel business surveys and a failed management mentoring field experiment, we observe firms’ intentions to improve their management practices and firms’ subjective barriers to improving their management practices. We find clear evidence of positive selection into a free management mentoring scheme: the worst managed firms were the least likely to seek help.
2022
We seek to understand what is limiting women's access to finance, in particular for highly skilled start-up entrepreneurs. To investigate supply side constraints, we run a lab-in-the-field experiment in which loan officers in Uganda evaluate several business ideas based on real pitch decks from start-ups. We separate biases in idea evaluation from other constraints (such as gender specific differences in the ability to implement a project, or in external constraints that start-up entrepreneurs are facing).
2022
This impact evaluation aims to measure the effect of a program that combines business training, mentoring, and a large cash transfer on high-potential small and medium businesses in Chile. 250 out of the top 500 firms participating in a business plan competition will be randomly selected to receive all three components of the program, while the remaining firms will receive none of them.
2022
We study the demand for government participation in China’s venture capital and private equity market. We conduct a large-scale, non-deceptive field experiment in collaboration with the leading industry service provider, through which we survey both sides of the market: the capital investors and the private firms managing the invested capital by deploying it to high-growth entrepreneurs. Our respondents together account for nearly $1 trillion in assets under management.
2022
The limited market size of many small emerging economies is a key constraint to the growth of innovative small and medium enterprises. Exporting offers a potential solution, but firms may struggle to locate and appeal to foreign buyers. A six-country randomized experiment was conducted with 225 firms in the Western Balkans to test the effectiveness of 30 hours of live group-based training and 5 hours of one-on-one remote consulting in overcoming these constraints.
2022
What is preventing entrepreneurs and managers from forming peer connections themselves? This paper argues that entrepreneurs may be under-networked because they lack the necessary social skills that allow them to match efficiently with knowledgeable peers.
2022
We study direct productivity changes and spillovers after a randomized training program for the frontline workers in a Colombian government agency. While trained workers improved their individual production, we also find substantial spillovers that affected managers' productivity. We use email data and a survey to explore the mechanisms behind these spillovers and find that managers' increased output arises from reductions in the need to help lower level employees.
2022
This lab-in-the-field experiment will measure the gender bias in entrepreneurship and investment among youth and credit officers in Ethiopia. Chigign Tobiya “Ethiopia Emerges” is a television show in Ethiopia where entrepreneurs pitch their business ideas to a panel of business tycoons for a chance to get investment funding.
2022
In many scientific contexts, peer review can be either single-blind or double-blind: in single-blind review, research work (e.g., manuscripts, proposals) is reviewed alongside information on the author(s), whereas in double-blind review, information on the author(s) is withheld. We will report results from a randomized experiment conducted in collaboration with a grantmaking body, in the context of the grantmaker reviewing proposals in one field of science.
2022
This impact evaluation aims to measure the effect of a program that combines business training, mentoring, and a large cash transfer on high-potential small and medium businesses in Chile. 250 out of the top 500 firms participating in a business plan competition will be randomly selected to receive all three components of the program, while the remaining firms will receive none of them. In-person surveys with the entrepreneurs will be conducted before and 12 months after the program.
2022
Resource allocation decisions play a dominant role in shaping a firm’s technological trajectory and competitive advantage. Recent work indicates that innovative firms and scientific institutions tend to exhibit an anti-novelty bias when evaluating new projects and ideas. In this paper, we focus on shedding light into this observed pattern by examining how evaluator expertise in the problem’s focal domain shapes the relationship between novelty and feasibility in evaluations of quality for technical solutions.
2022
The federal government and many individual organizations have invested in programs to support diversity in the STEM pipeline, including STEM summer programs for high school students, but there is little rigorous evidence of their efficacy. We fielded a randomized controlled trial to study a suite of such programs targeted to underrepresented high school students at an elite, technical institution. The STEM summer programs differ in their length (one week, six weeks, or six months) and modality (on-site or online).
2022
Women are underrepresented in patenting and the gap is not closing quickly. One major roadblock to progress is a dearth of causal evidence on the potential effectiveness of policies to reduce the gender gap in patenting. Analyzing a randomized control trial at the United States Patent and Trademark Office that was designed to provide additional help to applicants who do not have legal representation, we find heterogeneous causal impacts across gender and technologies on the probability of obtaining patent rights.
2022
By enabling smaller loans, broader geographic reach, and less human bias in decision-making, process automation may reduce racial disparities in access to financial services. We find evidence for all three channels in a setting where private lenders faced no credit risk but decided who to serve: the Paycheck Protection Program (PPP), which provided loans to small businesses during COVID-19. Black-owned firms disproportionately obtained their PPP loans from fintech lenders, especially in areas with high racial animus.
2022
Using a new survey of firms in New Zealand, we document how exogenous variation in the macroeconomic uncertainty perceived by firms affects their economic decisions. We use randomized information treatments that provide different types of information about the first and/or second moments of future economic growth to generate exogenous changes in the perceived macroeconomic uncertainty of some firms. The effects on their decisions relative to their initial plans as well as relative to an untreated control group are measured in a follow-up survey six months later.
2022
This paper studies whether informational frictions prevent firms from accessing government support using a randomised controlled trial. We focus on two Portuguese COVID-19 relief programs, providing (i) wage support for workers who are kept on payroll and (ii) credit lines backed by government guarantees. We randomly assign firms to a treatment providing either simplified information about a program, or a combination information and step-by-step application support. We find a significant treatment effect on take up of the wage support program.
2022
We analyze, benchmark, and run randomized controlled trials on a panel of 7,463 U.S. entrepreneurs making incentivized sales forecasts. We assess accuracy using a novel administrative dataset obtained in collaboration with a leading US payment processing firm. At baseline, only 13% of entrepreneurs can forecast their firm’s sales in the next three months within 10% of the realized value, with 7.3% of the mean squared error attributable to bias and the remaining 92.7% attributable to noise.
2022
This project is a collaboration with Corner to Corner to study the impact of their entrepreneurship training course on financial stability. Corner to Corner, a Nashville-based nonprofit, is focused on their mission of helping their neighbors to flourish and addressing the racial wealth gap. One of their primary programs is The Academy, a 10-week entrepreneurship training course that teaches students the fundamentals of starting and operating their own business.