Community Safety and Policing Research Program, Global Justice Lab,
          Munk School of Global Affairs and Public Policy, University of Toronto

external partners only · the results, recomputed on seven organizations

What predicts a school's ties to outside organizations

A project of the Community Safety and Policing Research Program, Global Justice Lab, Munk School of Global Affairs & Public Policy, University of Toronto. Findings are associational and self-reported.

Results

Schools differ in how many, not in which

Schools differ mainly in how many of the seven they work with. Which ones they pick is close to unpredictable, and knowing the count barely narrows them down.

Count how much schools differ from one another, and compare it with how much they would differ if every school decided each of the seven separately. The spread is 2.74 times what independence allows. That holds inside every kind of school: 2.72 in primary schools, 2.66 in high schools, 2.75 in cities, 2.67 in towns. Not one of the 21 pairs of organizations is negatively related, so no two are treated as alternatives.

Table 13. Spread against independence, mean pair correlation and negative pairs, within each kind of school

School-years Spread against independence Mean pair correlation Negative pairs, of 21
All schools 15,195 2.74 0.288 0
Grade level
Primary 3,823 2.72 0.286 0
Middle 5,317 2.58 0.262 0
High 5,408 2.66 0.277 0
Location
City 4,043 2.75 0.291 0
Suburb 5,517 2.71 0.283 0
Town 2,020 2.67 0.279 0
Rural 3,615 2.79 0.297 0
The crime reading
High 912 2.51 0.251 0
Moderate 2,949 2.69 0.281 0
Low 11,334 2.77 0.294 0

Note: The first column is the variance of the count divided by what it would be if every school decided each of the seven separately, so a value above one means schools differ more than independence allows. Survey-weighted, on all school-years including those working with all seven or with none, because the restriction used elsewhere removes exactly the tails whose spread this measures.

A model of the whole network says the same. Fitted to the 2015-16 wave, the term for how unevenly ties are spread across schools comes out at -1.096, and the minus sign means some schools hold far more ties than chance would give them.

The same model carries the study's other result inside it. Put the crime reading in on its own and it predicts the ties, at +0.040. Add what the school runs for itself and the crime coefficient falls to +0.023 and stops separating from zero, while security staffing comes in at +0.278. What the principal sees in the neighborhood works partly through what the school has built.

Table 11. Bipartite exponential random graph model of schools and the seven organizations, 2015-16 wave

(1) The neighborhood on its own (2) Adding what the school runs
Baseline rate at which schools and organizations are tied (edges) +0.129 (0.023)*** -0.086 (0.041)*
How unevenly ties are spread across schools (gwb1degree, decay 0.4) -1.096 (0.133)*** -1.005 (0.139)***
Crime level the principal reports for the area +0.040 (0.017)* +0.023 (0.019)
Size of the school +0.104 (0.017)*** +0.035 (0.020)
Employs security staff +0.278 (0.043)***
Recorded incidents of crime and violence +0.053 (0.021)*

Note: A coefficient is the change in the log odds of a school working with a given organization. Column 1 puts the neighborhood in on its own; column 2 adds what the school runs for itself, which here is security staffing and recorded incidents, because the formal parent-consultation process is a parent measure and this variant excludes it. The neighborhood coefficient falls from +0.040* to +0.023, which is the direct-and-indirect result inside the model. Unweighted, since exponential random graph models do not take survey weights. ***p < 0.001, **p < 0.01, *p < 0.05.

One faint pattern does survive. Among the seven, three pairs turn up together slightly more often than chance: social services with mental-health providers, juvenile justice with the police, and civic groups with businesses. Against 300 reshuffles that hold every school's number of ties and every organization's popularity exactly fixed, the within-side z runs from 12.5 to 18.6 across the six surveys. It is small, and it sorts the organizations rather than the schools, so the finding that schools have no types still stands.

Table 12. Co-occurrence of organizations on the same side, against randomizations holding the margins fixed, by survey

Wave Within-side co-occurrence, z Social services with mental health, z Juvenile justice with the police, z Civic groups with businesses, z
2005-06 18.6 8.2 8.8 10.2
2007-08 16.3 7.6 7.8 7.9
2015-16 12.5 8.8 6.0 5.9
2017-18 17.3 7.2 4.5 9.4
2019-20 14.1 5.0 5.6 7.5
2021-22 14.6 6.4 4.7 6.9

Note: Each z compares the observed number of schools holding both ties in a pair, summed over the nine within-side pairs in the first column and single pairs in the others, against 300 curveball randomizations that hold every school's count of ties and every organization's prevalence exactly fixed, so the margins explain none of it. The community side has three members here rather than four, because parents' groups was a community tie and this variant excludes it, which is why there are nine within-side pairs rather than twelve. The structure is present in every wave, with the within-side z running from 12.5 to 18.6. Randomization seed 7, matching the published table.

How many organizations a school works with

A school works with 3.40 of the seven on average. The police are the commonest partner, held by 84% of schools, then social services at 68% and mental-health providers at 66%. Churches are the rarest at 22%.

The number rises with the crime a principal reports. Schools in the areas principals call low-crime work with 3.34 of the seven. In the areas they call moderate, 3.55. In the areas they call high, 3.62.

Table 2. The crime level the principal reports as a predictor of the number of organizations, by survey

School-years Coefficient Clustered SE p
2005-06 2,273 +0.177*** 0.034 0.000
2007-08 2,125 +0.092 0.048 0.056
2015-16 1,726 +0.224*** 0.060 0.000
2017-18 2,306 +0.122* 0.054 0.024
2019-20 1,981 +0.113* 0.054 0.035
2021-22 2,280 -0.047 0.044 0.293
All six waves 12,691 +0.109*** 0.024 0.000

Note: Per standard deviation of the principal's description of the crime level in the area where the school is located, reversed so that higher means more crime, and standardized. Controlling for size, grade level and urbanicity, and wave in the pooled row. Standard errors clustered on the sampling stratum within wave. ***p < 0.001, **p < 0.01, *p < 0.05.

What the school runs for itself

Schools with more security staff and more security equipment work with more outside organizations, at +0.232 per standard deviation on its own and +0.225 with the crime reading also in the model.

This comes out weaker than the companion study reports, for a reason. That version puts a third item in the same index, a formal process for consulting parents, and gets +0.48. Half of what "what the school runs" was measuring there is a parent arrangement. Take it out and what remains, the security side of the house, predicts about half as much.

Table 1. What a school runs for itself, and the crime level its principal reports, as predictors of how many of the seven external organizations it works with

Entered alone Entered together
What the school runs: security staff and equipment +0.232*** (0.021) +0.225*** (0.021)
The crime level the principal reports, for the area +0.109*** (0.024) +0.094*** (0.024)
The two multiplied -0.032* (0.016)
...the reading of where the students live (10,927 school-years) +0.156*** (0.023) +0.140*** (0.023)
Does advantage build reach?
Share of students expected to go to college -0.073*** (0.021) -0.045* (0.021)
Share testing in the bottom fifteen per cent +0.059** (0.019) +0.020 (0.020)
Average daily attendance +0.017 (0.016) +0.034* (0.016)

Note: n = 12,691. Survey-weighted, standard errors clustered on the sampling stratum within wave, in brackets. All predictors standardized. What the school runs is security staffing (harmonized to any-versus-none across a wording change in 2015-16) and security equipment, each standardized, averaged, and the average restandardized. The published analysis puts a third item in that index, a formal process for consulting parents; it is a parent measure and this variant excludes it, which is most of why the coefficient here is smaller. The last three rows test whether advantage builds reach. ***p < 0.001, **p < 0.01, *p < 0.05.

The crime level the principal reports

The crime reading predicts the count at +0.109 per standard deviation on its own, and +0.094 once what the school runs is in the model too.

The survey asks the question twice, once about the area where the school is and once about the areas where its students live. The second predicts better than the first, +0.156 against +0.109.

Does the principal's answer mean anything?

The crime level here is not a police statistic. It is one thing a principal typed into a form. So we checked it against two things this study never uses it to predict.

Schools whose principals report more crime have more crimes actually recorded against them that year, at +0.112. Staff at those schools report more bullying, harassment and verbal abuse, at +0.179.

The companion study has a third check here, how many parents turn up to school events. It is a parent measure, so it is not in this version.

Table 9. The crime level the principal reports against things this variant never uses it to predict, and each tie with the regression turned around

Coefficient Clustered SE p
The reading against things that are not the outcome
Recorded incidents of crime and violence +0.112*** 0.012 0.000
Reported bullying, harassment and verbal abuse +0.179*** 0.012 0.000
Each tie against the reading, if the arrow ran the other way
Civic organizations (community) +0.029* 0.013 0.023
Local businesses (community) +0.067*** 0.019 0.000
Churches (community) +0.076*** 0.018 0.000
Social services (government) +0.060*** 0.014 0.000
Mental-health providers (government) +0.075*** 0.017 0.000
Juvenile justice (government) +0.037* 0.016 0.021
Police (government) -0.083*** 0.025 0.001
A count of businesses and churches only +0.061*** 0.013 0.000

Note: The top panel asks whether the principal's reading tracks anything beyond the ties it is used to predict. The published analysis has a third row there, how many parents turn up to school events; it is a parent measure and this variant excludes it. The bottom panel reverses the regression: if a school came to describe its area as rougher because its partners told it so, the partners with a crime remit would be the ones going with a higher reading. ***p < 0.001, **p < 0.01, *p < 0.05.

Which of the seven schools in rougher areas add

Both sides of the field rise. The three community organizations rise by +0.061 per standard deviation, the four government ones by +0.048, and the balance between them stays flat, at -0.014.

Table 7. The crime level against the count of community organizations, the count of government organizations, and the balance between them

Coefficient Clustered SE p
Count of the three community organizations +0.061*** 0.013 0.000
Count of the four government organizations +0.048** 0.015 0.002
Balance, government minus community -0.014 0.016 0.396
Balance, holding the total constant -0.026 0.016 0.099

Note: The sides are uneven here, three community organizations against four government ones, because parents' groups was a community tie and this variant excludes it. Per standard deviation of the reported crime level, survey-weighted, clustered on the sampling stratum within wave, same controls throughout. ***p < 0.001, **p < 0.01, *p < 0.05.

Taken one at a time, churches rise most and the police do not rise at all.

Table 3. Each of the seven organizations against the crime level the principal reports

Organization Side Coefficient Clustered SE Share of schools with the tie
Civic organizations community +0.013* 0.006 42%
Local businesses community +0.024*** 0.006 27%
Churches community +0.024*** 0.006 22%
Social services government +0.024*** 0.006 68%
Mental-health providers government +0.030*** 0.007 66%
Juvenile justice government +0.013* 0.006 33%
Police government -0.020*** 0.006 84%

Note: One model per organization, per standard deviation of the reported crime level, controlling for size, grade level, urbanicity and wave, with standard errors clustered on the sampling stratum within wave. The last column gives the share of schools reporting the tie, which bounds how far a coefficient can go. ***p < 0.001, **p < 0.01, *p < 0.05.

The police are the one partner schools do not add

Of the seven, the police are the one a school in a high-crime area does not add. Three checks say so, and none of them depends on the others.

The first takes the police out of the count of organizations, so the outcome becomes the other six. If the real story were that rougher areas simply get more police into schools, then counting only those six should make the pattern weaker. It makes it stronger: +0.129 per standard deviation, against +0.109 with the police counted in. Leave juvenile justice agencies out as well and it is +0.116. Count only civic groups, businesses and churches, with no government body among them at all, and it is +0.061.

Table 6. The crime level as a predictor, with the enforcement organizations taken out of the count

Count taken over Coefficient Clustered SE
All seven organizations +0.109*** 0.024
The six without the police +0.129*** 0.022
The five without the police or juvenile justice +0.116*** 0.020
Only civic groups, businesses and churches +0.061*** 0.013

Note: n = 12,691. Per standard deviation of the reported crime level, survey-weighted, with standard errors clustered on the sampling stratum within wave and the same controls throughout. If the association were police arriving in schools under another name, it should weaken as the enforcement organizations are removed. ***p < 0.001, **p < 0.01, *p < 0.05.

The second holds the number of partners still and asks which ones they are. Take two schools that work with the same number of organizations. The one in the area its principal calls rougher is less likely for one of those to be the police, by -0.028 per standard deviation. On the survey's own three-point scale that is about 10 percentage points from a low-crime area to a high-crime one.

That is not an accident of putting young children's schools and high schools in one pot. Look at each kind on its own and the answer is the same in all three: -0.036 in primary schools, -0.015 in middle schools and -0.019 in high schools. Leaving any one of the six surveys out of the pooled estimate leaves it between -0.025 and -0.030.

Table 4. Each of the seven organizations against the crime level, holding the total number constant

Organization Side Coefficient Clustered SE p
Civic organizations community -0.007 0.005 0.127
Local businesses community +0.008 0.005 0.138
Churches community +0.012** 0.004 0.007
Social services government +0.005 0.005 0.290
Mental-health providers government +0.013* 0.005 0.014
Juvenile justice government -0.002 0.005 0.639
Police government -0.028*** 0.005 0.000

Note: Linear probability models, one per organization, per standard deviation of the reported crime level, survey-weighted, standard errors clustered on the sampling stratum within wave, controlling for size, grade level, urbanicity, wave and the total count of organizations. Because the count is held constant, a coefficient reads as a change in the share of schools holding that tie at a given number of ties: the mix, not the amount. On the survey's own three-point scale rather than in standard deviations the police estimate is -0.049*** per step, so of two schools working with the same number of organizations, the one whose principal calls the area high-crime is about 10 percentage points less likely to count the police among them than the one whose principal calls it low-crime. ***p < 0.001, **p < 0.01, *p < 0.05.

Table 5. The police tie at a fixed number of organizations, within each grade level

School-years Coefficient Clustered SE p
Primary 3,196 -0.036*** 0.008 0.000
Middle 4,585 -0.015** 0.005 0.005
High 4,383 -0.019*** 0.005 0.000
All schools 12,691 -0.028*** 0.005 0.000

Note: Linear probability models, per standard deviation of the reported crime level, survey-weighted, standard errors clustered on the sampling stratum within wave, controlling for size, urbanicity, wave and the total count of organizations. The association is negative at every grade level. Leaving any single wave out of the pooled estimate gives -0.029***, -0.028***, -0.026***, -0.029***, -0.030***, -0.025***. ***p < 0.001, **p < 0.01, *p < 0.05.

The third check is simply how common the police already are. 84% of schools work with them, more than any of the other six, so there is very little room for that share to go up.

What those schools take instead

Saying the police are the one they do not add leaves a question open. If a school in a rougher area works with more organizations, and the police are not among the extras, then what is?

Take only the schools that work with exactly one of the police and mental-health providers. Every school in that group faces the same either-or and has landed on one side of it. Then ask whether the crime the principal reports predicts which side.

It does. The rougher the principal calls the area, the more likely the one they have is the mental-health provider, at +0.051 per standard deviation on 4,274 schools facing that choice. Social services is the same, at +0.053 on 4,174.

It happens against the community organizations too, more weakly: +0.027 for local businesses, +0.025 for civic groups, +0.023 for churches. Against juvenile justice agencies, the other body with a crime remit, the police barely give way at all, at +0.008.

So the police do not simply thin out. They give way, and they give way to the organizations that look after children rather than to the other one that enforces.

Table 8. Which one a school holds, among the schools holding exactly one of the police and the organization named

The police against Coefficient Clustered SE p School-years Holding the other one
Civic organizations +0.025*** 0.006 0.000 6,829 11%
Local businesses +0.027*** 0.006 0.000 8,744 6%
Churches +0.023*** 0.005 0.000 9,055 5%
Social services +0.053*** 0.011 0.000 4,174 28%
Mental-health providers +0.051*** 0.011 0.000 4,274 26%
Juvenile justice +0.008* 0.003 0.013 5,938 3%

Note: n varies by row because each keeps only the school-years holding exactly one of the two ties named, so the comparison is between schools facing the same either-or. A positive coefficient means that as the reported crime level rises, a school facing that choice holds the other organization rather than the police. Not a prevalence artefact: cutting schools by how many organizations they work with, the police coefficient at a fixed count is -0.048*** on 1 or 2 organizations (police share 67%), -0.020** on 3 or 4 organizations (police share 89%), -0.022*** on 5 or 6 organizations (police share 97%). Not selected on the predictor either: whether a school falls in the either-or group at all is unrelated to the crime level its principal reports, at -0.016* for mental-health providers, -0.013* for social services. ***p < 0.001, **p < 0.01, *p < 0.05.

Could it be the other way round?

So far this reads one way. A principal thinks the area is rough, and the school works with more organizations.

But maybe it works the other way. Maybe the school already works with a lot of organizations. They tell the principal the area is rough. And that is why the principal says so.

If partners were doing the telling, it would be the crime ones doing it. So turn the question around. For each of the seven, ask which ones go with a rougher description.

The answer comes out backwards for that story. Schools that work with the police have principals who report less crime, at -0.083. The two tied most closely to a rough description are churches at +0.076 and mental-health providers at +0.075. Count only businesses and churches, which have nothing to do with crime, and it is still there at +0.061.

None of this settles the direction. Every survey is a fresh sample taken at one moment. No school is followed over time.

What changed over the sixteen years

Table 10. Share of schools working with each of the seven organizations, by survey

Organization 2005-06 2007-08 2015-16 2017-18 2019-20 2021-22 Change
Police 85% 86% 81% 85% 88% 81% -4 pts
Social services 69% 69% 64% 66% 72% 66% -4 pts
Mental-health providers 55% 53% 61% 66% 80% 78% +23 pts
Civic organizations 47% 45% 41% 42% 43% 33% -14 pts
Juvenile justice 42% 41% 30% 28% 31% 26% -16 pts
Local businesses 29% 27% 26% 29% 28% 20% -9 pts
Churches 18% 17% 25% 25% 26% 21% +3 pts

Note: Survey-weighted shares of the analyzed panel. ***p < 0.001, **p < 0.01, *p < 0.05.