|
|
|
@@ -32,7 +32,15 @@ So light help is cheap and fades, and heavier help might work but hasn't been te
|
|
|
|
|
|
|
|
|
|
### The draw
|
|
|
|
|
|
|
|
|
|
The reviewers, not the bank, draw half the groups by lottery, using a method filed in advance. The draw is balanced by industry, region, and the founders' gender, race and wealth. As with the support lottery, groups agree to the lottery when they apply, and an independent research ethics board approves the design. Groups that weren't drawn can apply for a loan at any time, and are offered the same help after the year-four measurement if the pilot's help budget has money left. Offering it sooner would give the comparison half help before year four and blur the result the [cost ceiling](#the-cost-ceiling) depends on.
|
|
|
|
|
The reviewers, not the bank, draw half the groups by lottery, using a method filed in advance. The draw is balanced by industry, region, the founders' wealth and prior earnings, and which sponsor, if any, applied for the group. No one sponsor can enter more than a set share of the groups. As with the support lottery, groups agree to the lottery when they apply, and an independent research ethics board approves the design. Groups that weren't drawn can apply for a loan at any time, and are offered the same help after the year-four measurement if the pilot's help budget has money left. Offering it sooner would give the comparison half help before year four and blur the result the [cost ceiling](#the-cost-ceiling) depends on.
|
|
|
|
|
|
|
|
|
|
**The draw doesn't use race or gender.** The rule across the model is that race and sex can be used to measure results, never to decide who gets anything, and the draw decides who gets help. Balancing a lottery on them is ordinary research practice. Federal law even requires government-funded medical research to include women and minorities ([42 U.S.C. § 289a-2](https://www.law.cornell.edu/uscode/text/42/289a-2)), and nobody's odds would change: every group has the same even chance. But a court might still treat it as sorting people by race. The Supreme Court reviews government "distributions of burdens or benefits based on individual racial classifications" under its strictest test ([*Parents Involved v. Seattle School District*, 2007](https://www.law.cornell.edu/supremecourt/text/05-908)), including when a policy "may be said to burden or benefit the races equally" ([*Johnson v. California*, 2005](https://www.law.cornell.edu/supremecourt/text/543/499)), and in 2023 it said "eliminating racial discrimination means eliminating all of it" ([*SFFA v. Harvard*](https://www.law.cornell.edu/supremecourt/text/20-1199)). No court has ruled on a research lottery balanced this way, and sharper statistics are unlikely to count as the compelling reason that test asks for. Sex gets a lighter test, and balancing on it would be easier to defend; it's left out so the rule is the same for both. With about 500 groups, a plain draw rarely leaves the halves more than a few points apart on any group that's a sizable share of applicants, so little precision is lost.
|
|
|
|
|
|
|
|
|
|
- **Wealth and earnings are there for their own sake.** They predict whether a group gets a co-op running, and helping founders without money is what this lottery is for. They're taken from tax and wage records where founders allow it, not only from what they say.
|
|
|
|
|
- **Answering is optional.** Founders' race and gender are asked on a separate form, with "prefer not to say," and the answer changes nothing about the group's chances. The form goes to a separate custodian and stays sealed until the draw has been run on coded IDs and its results published. Refusal rates are reported for each half.
|
|
|
|
|
- **One draw, no reruns.** The random seed is committed publicly before sign-ups open, and the draw is run once. Mistakes are fixed case by case under a rule filed in advance, never by drawing again.
|
|
|
|
|
- **The analysis is fixed in advance.** The main result is adjusted for the same things the draw was balanced on, and nothing else, whatever the draw looks like. Results by race and gender are published as estimates, next to the smallest difference each could detect, which for a group making up a fifth of applicants is about 25 points. So they describe who was reached; they can't settle whether help works better for one group than another. A group counts toward a category if at least half its founders report it; mixed groups are reported as their own category.
|
|
|
|
|
- **Never targets.** No group's odds, help or verdict depends on its founders' race or sex, and none of these figures is a goal.
|
|
|
|
|
|
|
|
|
|
### What the helped groups get, for up to a year
|
|
|
|
|
|
|
|
|
@@ -61,7 +69,7 @@ About 250 groups in each half, so $10 million for the help. With groups that siz
|
|
|
|
|
- **Are they running a co-op?** The main result: the share of all groups in each half that have a co-op operating two years after the draw, with at least three members and a minimum level of sales, however it was financed. It's measured from government business records by the reviewers, not decided by the bank. So the result can't come from helped groups simply being coached to pass the bank's own underwriting.
|
|
|
|
|
- **Are they still running at year four?** The share of all groups in each half with a co-op still open and paying fairly four years after the draw. That counts every group, so help that pushes weak groups into launching and failing shows up as a cost, not a benefit.
|
|
|
|
|
- **What did it cost?** The public cost for each extra co-op the help created, and for each extra co-op still open at year four. At the smallest effect the lottery can detect, about 30 extra co-ops for $10 million, that's roughly $330,000 each. A ceiling is set in advance, [below](#the-cost-ceiling). Above it, the help isn't recommended for any larger program, however many co-ops it creates.
|
|
|
|
|
- **Who did it reach?** Founders' prior earnings, wealth, gender, race, immigration status and language, in each half.
|
|
|
|
|
- **Who did it reach?** Founders' prior earnings, wealth, gender, race, whether they were born abroad, and language, in each half, from the optional form.
|
|
|
|
|
- **Where else did groups get help?** Groups report other help and funding they used, so any effect from help found elsewhere, or co-ops simply moving from other lenders to this one, can be estimated.
|
|
|
|
|
|
|
|
|
|
### The cost ceiling
|
|
|
|
@@ -81,7 +89,7 @@ About 250 groups in each half, so $10 million for the help. With groups that siz
|
|
|
|
|
- **Not worth it:** even the low end is over the ceiling.
|
|
|
|
|
- **Not settled:** anything else. The report says so and gives the size of trial that could settle it, but it doesn't recommend the help.
|
|
|
|
|
|
|
|
|
|
**Reported by group, judged as a whole.** The cost per extra co-op is also published by founders' wealth, race and immigration status, and for struggling areas against the rest. Help that works mainly for low-wealth founders may be worth more than a single national line admits. But the verdict uses the one ceiling, so a favorable slice can't be picked out afterward. The cost is reported again at year six, since the effects of help often fade.
|
|
|
|
|
**Reported by group, judged as a whole.** The cost per extra co-op is also published by founders' wealth, race and whether they were born abroad, and for struggling areas against the rest. Help that works mainly for low-wealth founders may be worth more than a single national line admits. But the verdict uses the one ceiling, so a favorable slice can't be picked out afterward. The cost is reported again at year six, since the effects of help often fade.
|
|
|
|
|
|
|
|
|
|
The co-ops from both halves count in the main test, and the main result is also reported without the helped half's extra co-ops. So help can't quietly change what the main test measures.
|
|
|
|
|
|
|
|
|
|