PAN Lab example
Predict-Align-Prevent
The map, not the score: a place-based risk surface and the records it concentrates
A nonprofit's model ranks small map cells by child maltreatment risk, scoring no family. In New Hampshire, teams aimed outreach and funding where it pointed.
See more
Predict-Align-Prevent, a Texas nonprofit, maps where child maltreatment risk is higher, to plan prevention services. Its model sorts small grid cells covering a city or region into five risk tiers, from past child-welfare cases and nearby crime, blight, and land uses. It scores places, never households, and gives the maps to prevention planners.
How it was used
In September 2018 New Hampshire was awarded a federal Children's Bureau cooperative agreement, a form of federal grant, for community collaborations. Predict-Align-Prevent mapped three regions for it: Manchester, the Winnipesaukee region, and Coos County.
The three were chosen partly using the Social Vulnerability Index of the Centers for Disease Control and Prevention (CDC). It ranks areas by census measures of hardship, such as poverty. Casey Family Programs, a foundation, funded the mapping.
Mapping was finished for all three regions before they received implementation resources. Community teams led by family resource centers then targeted family outreach at the mapped areas of need. They issued requests for proposals, with stipends, to community agencies to fill those needs.
A federal report profiling the grant's recipients, from March 2024, records this. The agreement ended in September 2023.
What the builders report
The 2016 Fort Worth study trained on state child-welfare cases confirmed as maltreatment in 2013, and city police data. In 2014 the top tenth of its cells held 52 percent of cases, against 43 percent for a simpler hotspot map of past cases. A 2021 systematic review confirmed those figures independently.
In Richmond, Virginia, in 2019, the builders kept some cases back to test the model. Its top risk tier held about 70 percent of them, on about 10 percent of the city's land. A simpler map of past cases held about 35 percent. These are the builders' own figures.
The builders also published their own audit. The model "generalizes well across neighborhoods of varying poverty rates, but does not generalize well across neighborhoods of varying race." Race and income had been left out of its inputs.
What scoring places changes
No family is scored, and no caseworker sees a score. So no wrong number is ever attached to a family.
The usual safeguard is missing too. There is no override to log and no per-case decision to audit. No record shows when a planner set a map aside.
The mistakes that remain are about places. Prevention money can go to the wrong areas, and whole neighborhoods can be stigmatized by a high-risk label.
The loop to watch
The case file names a loop, as its own reading. The model is trained on geocoded child-welfare and police records. The map concentrates attention in its top tiers, which may raise reporting there, and the next model is trained on those reports.
No source measures whether reporting rose in any targeted area. The loop runs through places instead of case decisions. It is slow enough to last a whole grant cycle.
Who reviewed it
The only oversight was the grant's own. Its quality-improvement requirements covered how the maps were used and where resources went, never how well the model performed.
No inspector general audit, court filing, or independent outcome evaluation of any Predict-Align-Prevent deployment was found. No outside body is documented acting on the builders' own finding about race.
Where things stand
The current program is a published study plan, a protocol, from 30 December 2025. It adds a stage that matches services to individual households in high-risk cells, which its authors call voluntary.
It reports no external funding. As of September 2025 a participating jurisdiction was under recruitment, and the sources show no newer enrollment as of mid-2026.
What the available tools can and cannot address
A failure pathway is a link between two parts of the network, where a mistake made by one part can be passed on to the other. A closed pathway passes on so few mistakes that the Lab no longer counts it as open. The work along it may go on.
This case has a budget of 10 units. Explore (No Targets) sets no targets. Contained means the network's mistakes are corrected rather than building on one another.
The Lab starts with lingering effects on. Then, under Explore and Service Targets Only, the cheapest combinations that keep the mistakes contained use three tools and cost 7 of the 10 units. Under Service Targets Only the same combinations also meet the service target, which asks for the model to be helping the work.
One is Understand the system, Vet connections, and Keep skills sharp. Vet connections limits which records and data the model is trained on. With lingering effects on, it works at reduced strength unless Understand the system is also on. Understand the system costs 3 units at these two levels, and 4 at the two higher ones.
With lingering effects off, two tools costing 5 units are enough at both levels. Each such pair is Vet connections with one of Assign a challenger, Keep skills sharp, or Peer sharing rules.
Under Service and Safety Targets and All Governance Targets, the targets are not fully addressable with the available tools. Both levels ask you to close every failure pathway, among other targets.
On this network only Pause AI on alarms closes Risk maps to state planners. While it holds, the maps inform none of the planners' decisions. The model then does not help the work enough to meet the service target.
Money is not what stops it. With the budget set aside, the Lab tried all 472,392 combinations of the thirteen tools and their settings at each of the two levels. None meets every target. This is a finding about the deployment, not a gap in your approach.
Open this example in PAN Lab v0.1 to apply pressures and levers and watch what the system does.
What this models
This example runs on the Predict-Align-Prevent-class place-based risk terrain mapping network: 8 components and 14 pathways between them. Every context in the Lab is a stylized model, never a reconstruction of any actual deployment, and each assumption behind it carries a provenance label.
Evidence base: 4 assumed · 6 published baseline. In the Lab, the shaded evidence band behind each headline readout draws its width from the least-established class below.
Show all 10 assumptions
- assumed
This network follows the place-based prevention mapping in the Predict-Align-Prevent case file. It does not rebuild the actual models. It has no intake screener, investigator, or caseworker, because the sources say no frontline worker ever receives a score about a family. Frontline child-protection decisions are untouched by the model. Every other child-welfare network in the Lab puts something about a single case between the model and a person. This one puts a map there. The 2025 protocol adds a household-level stage that weakens this claim for future work. Its authors frame it as voluntary service matching for households in high-risk cells, not family risk scoring. The sources show no jurisdiction enrolled to run it, so the claim holds for the 2016 to 2023 deployments drawn here.
- baseline
The network draws two groups of staff, because the sources describe two bodies with different roles and actions. State agency program staff receive the maps and decide what they mean. Coalitions led by family resource centers in Manchester, the Winnipesaukee region, and Coos County turned mapped need into targeted outreach and funded requests for proposals with stipends. Two federal reporting sources fix the order of events. Mapping was completed for all three service areas before those sites received implementation resources. The coalitions then issued funded requests for the areas the process identified. The sources describe no step in between that works out the need independently. This hand-off is the deployment's best-documented way the maps changed what people did.
- baseline
The network draws two inputs into the model, and the sources give a different reason for each. The environmental data carries more than 200 measures per cell, against one count of past cases. The measures are counts, straight-line distances, and average distances to the five nearest examples of each risk and protective factor. The case records are read again, years of them, every time the model is rebuilt. Richmond used 6,500 accepted cases over four years. The 2016 Fort Worth study used a year of state substantiations plus city police data. Only the case records are marked as sensitive, because they are address-level records about children, while the environmental data describes places.
- baseline
The network draws the builders' own test as a working check, unlike most checks in child-welfare networks, because the sources show it ran. The builders held out one neighborhood at a time across 149 neighborhoods, and read three sub-models against each other. They compared the result with a simpler map of past cases. The 2025 protocol keeps a similar test against the same kind of map. The test produced an adverse published result, although race and income were left out of the model's inputs. The model "generalizes well across neighborhoods of varying poverty rates, but does not generalize well across neighborhoods of varying race." The sources document no outside body responding to it. The Richmond performance figures are the builders' own, from a commissioned report. Only the Fort Worth figures were confirmed independently, by a 2021 systematic review.
- assumed
The pathway from community outreach into the geocoded records is the case file's own reading, not a claim any cited source makes. Outreach concentrated in the top-tier cells can raise detection and reporting there. New records would then gather where the map pointed, and the next model would read them as signal. Predict-Align-Prevent acknowledges something narrower: high-risk labels can stigmatize individuals, households, and neighborhoods. In its account that risk is reduced because the intervention offers optional supportive services rather than punitive measures. The often-quoted phrase "before there is a suspicion of maltreatment" comes from the organization's own website, not from the cited sources. No cited source measures whether reporting rose in any targeted area, so the network shows this pathway as a possibility, not a measured effect.
- baseline
Review in this deployment covered how the maps were used, not how the model worked, and the network draws it that way. The mapping took place inside a federal Children's Bureau cooperative agreement, a form of federal grant, with continuous quality-improvement requirements. The mapping data was used in the grant's reporting, and a cross-site account of its grantees was published in March 2024. The review covered how the maps were used and where implementation resources went. Every institutional response to the maps in the federal documents is a decision about where resources go. The agreement ran from September 2018 to September 2023 and is the only documented operational use by planners. Fort Worth remained a published study plus local advocacy, with no evidence of resources allocated by the maps. The Arkansas, Washington, and Oregon engagements are claims on Predict-Align-Prevent's own website, with no independent confirmation for Washington and Oregon. The current program is a protocol published on 30 December 2025. As of the paper's September 2025 status statement, a participating jurisdiction was under recruitment. The sources show no newer enrollment as of mid-2026, so it is research at the recruitment stage, not an operating system.
- baseline
The network draws a pathway from the records to the outside modelers because parties outside the jurisdiction did the modeling: a Texas nonprofit and a private consultancy. They needed the jurisdiction's geocoded child-welfare records. In Richmond that meant 6,500 accepted cases. In New Hampshire, state staff accessed stewarded state databases for the mapping, which Casey Family Programs, a private foundation, funded. The modelers are drawn beyond the network's boundary, not as a group of staff inside it, because the jurisdiction does not govern what happens there. The Lab names pathways across that boundary and measures nothing beyond them. The 2025 protocol makes jurisdiction-level data-governance agreements and masking of personal identifiers explicit requirements of the transfer.
- assumed
The network includes a pathway for the model writing into the jurisdiction's own records, although the sources say the deployments made no such write. Unlike systems that score cases, no per-case decision was written back to a family's record, and the products were maps and reports. Two other pathways are left out entirely. There is no link to a second model system, because the method moved between jurisdictions as consecutive consulting engagements with published open-source code. There is no peer-review check inside either group of staff, because the sources record no peer challenge or case conferences over the maps. The scrutiny the field received came from outside this deployment: a national prevention nonprofit's research review that declines to endorse the methods, and civil-liberties reporting.
- baseline
The network assumes a light standing workload, because the planners work to a planning schedule the sources fix, not a stream of referrals. A ten-month planning period followed the September 2018 award, and the implementation plan was approved in September 2019. Mapping was completed once per service area before resources were released, within a five-year agreement. The network also assumes the work would go reasonably well without the model, because a working alternative ran beside the maps. The three communities were chosen partly using the CDC Social Vulnerability Index, an established federal targeting index. No independent outcome evaluation of any deployment shows the model's targeting did better. Prevent Child Abuse America's research review of these methods states that it is not intended as an endorsement of any of them.
- assumed
The families, children, and neighborhood residents served are not part of this network. The Lab traces how mistakes pass between the model, staff, and records, not between groups of people. This case's documented harms are about places and groups. They include stigma for neighborhoods labeled high risk, uneven institutional attention in mapped places, and the model's documented failure to generalize across neighborhoods of differing racial composition. They are recorded in the case file and outside this network, and never computed here. The same cells receive both the benefit and the exposure, because the voluntary services and the concentrated attention arrive together. Every impact claim is reported by Predict-Align-Prevent itself: lead-poisoning training books, vaccine administration, and enrollments in a nutrition program. No deployment has an independent outcome evaluation.
What this example does not show
Show all 5 limitations
- This network draws a loop. Outreach in the top-tier cells may raise detection and reporting there, and the next model is trained on those records. That loop is the case file's own reading, not an admission by Predict-Align-Prevent. What its 2025 protocol acknowledges is narrower: high-risk labels can stigmatize individuals, households, and neighborhoods. In the protocol's account, that risk is reduced because the intervention offers optional supportive services rather than punitive measures. The often-quoted phrase "before there is a suspicion of maltreatment" comes from the organization's own website. It appears in none of the cited sources. No cited source measures whether reporting rose in any targeted area, so this example shows the loop as a possibility, not a measured effect.
- The families, children, and neighborhood residents served are not part of this network. The Lab traces how mistakes pass between the model, staff, and records, and estimates no unequal harm to the people served. This case's documented harms are about places and groups: stigma for neighborhoods labeled high risk, and uneven institutional attention in mapped places. They also include the builders' own finding that the model does not generalize across neighborhoods of differing racial composition. These are recorded in the case file and measured outside any network like this one.
- The evidence behind each figure differs. In Fort Worth the top tenth of cells held 52 percent of the next year's cases, against 43 percent for a simpler hotspot map of past cases. Those figures were confirmed independently. A 2021 systematic review repeated them word for word. Every other performance figure, including Richmond's roughly 70 percent against roughly 35 percent and its error measure, comes from the builders' commissioned reports. Predict-Align-Prevent reports its own impact claims: lead-poisoning training books, vaccine administration, and enrollments in a nutrition program. Its claimed work in Washington and Oregon has no independent confirmation at all.
- The deployment reached fewer places than the method's spread suggests. Fort Worth remained a published study plus local advocacy, and no evidence shows child protection there allocating resources by the maps. The only documented operational use by planners is New Hampshire's three-region federal cooperative agreement, from September 2018 to September 2023. The current program is a protocol published on 30 December 2025. As of the paper's own September 2025 status statement, a participating jurisdiction was under recruitment. The sources show no newer enrollment as of mid-2026, so it is research at the recruitment stage, not an operating system.
- The field's view of this method is contested, and this example leaves it contested. Prevent Child Abuse America's research review of these methods states that it "is not intended to be an endorsement of any of these techniques." Reporting in 2021 collected named critics of mapping hot spots in child welfare. Nothing here settles that dispute. The network shows the pathways, not a verdict on the approach.
Sources and evidence
What this example rests on, claim by claim. Every entry resolves to the same ledger the Evidence Registry publishes.
In Richmond, Virginia, Predict-Align-Prevent's open-source place-based model (built with Urban Spatial; report byline Ken Steif, Matthew D. Harris, and Sydney Goldstein, 2019) reported its highest risk tier capturing about 70% of held-out child-maltreatment events against about 35% for a kernel-density baseline, while covering about 10% of city land area holding roughly 48,500 residents including about 8,200 children — builder-generated figures from a commissioned report — and the builders' own published fairness audit stated verbatim that the meta-model 'generalizes well across neighborhoods of varying poverty rates, but does not generalize well across neighborhoods of varying race,' despite race and income being excluded from the feature set.
empirical- Vendor Steif, Harris and Goldstein, Predicting child maltreatment risk in Richmond, VA: An open source framework (Urban Spatial with Predict-Align-Prevent, 2019) https://urbanspatial.github.io/PredictingChildMaltreatmentInRichmondVA/
- Vendor Urban Spatial, An open source geospatial risk predictive framework for child maltreatment (portfolio summary, 2019) https://urbanspatialanalysis.com/portfolio/an-open-source-geospatial-risk-predictive-framework-for-child-maltreatment/
New Hampshire's 2018-2023 federal Community Collaborations cooperative agreement is the only documented operational planner use of Predict-Align-Prevent's maps: state narratives confirm the mapping (funded by Casey Family Programs, using address-level inputs accessed through stewarded databases) was completed for all three service areas before sites received implementation resources, and the March 2024 ACF/OPRE grantee profile documents that Community Implementation Teams used PAP-identified areas of need to target family outreach and issued funded requests for proposals with stipends — documented resource-routing behavior change, with no independent outcome evaluation of maltreatment effects in any deployment.
empirical- Government Administration for Children and Families, Office of Planning, Research, and Evaluation, New Hampshire CWCC Grantee Profile: Community Collaborations to Strengthen and Preserve Families (2024) https://acf.gov/system/files/documents/opre/NH%20CWCC%20Grantee%20Profile_2024.03.28_5082.pdf
- Government State of New Hampshire, Title V MCH Block Grant narrative: Other MCH Data Capacity Efforts (HRSA TVIS, 2020) https://mchb.tvisdata.hrsa.gov/Narratives/Other%20MCH%20Data%20Capacity%20Efforts/9510ebf8-ac54-4449-ab5c-eb868c982cbe
The 2016 Fort Worth study (Daley et al., Child Abuse & Neglect), trained on 2013 state child-welfare substantiations and Fort Worth police data, reported the top 10% of grid cells capturing 52% of 2014 maltreatment cases against 43% for a conventional hotspot model — figures independently corroborated verbatim by the Marchment and Gill (2021) Crime Science systematic review, which also found it to be the single child-maltreatment application of risk terrain modeling in the reviewed literature; Fort Worth remained a published study plus local advocacy, with no evidence of operational resource allocation by the maps.
empirical- Academic Daley, Bachmann, Bachmann, Pedigo, Bui and Coffman, Risk terrain modeling predicts child maltreatment (Child Abuse and Neglect, 2016) https://pubmed.ncbi.nlm.nih.gov/27780111/
- Academic Marchment and Gill, Systematic review and meta-analysis of risk terrain modelling (RTM) as a spatial forecasting method (Crime Science, 2021) https://crimesciencejournal.biomedcentral.com/articles/10.1186/s40163-021-00149-6
Where this connects
Institutional pressures in this domain
- Workload surge — Demand outruns staffing; per-case attention shrinks and review becomes triage.
- Deadline pressure — Statutory or managerial timeliness rules reward fast approval of machine output over slow disagreement.
- Staff turnover — Experienced skepticism leaves; new staff calibrate their trust on the tool itself.
- Data & policy drift — The world, the intake process, and the rules change under a system trained on how things used to be — two mechanisms with different remedies: the statistical properties of what the system processes move (concept drift), or the mixture of inputs arriving in deployment differs from the mixture it was trained on (covariate shift).
- Compliance over substance — Paper controls (sign-offs, checklists) satisfy audits while the behavior they describe erodes.
All of them in context on the Child welfare & family services domain page.
Levers available here and the patterns behind them
- Gate vendor updates — Vendor quality gate
- Understand the system — Understand the system
- Vet connections — Connection authorization
- Store less data — Data minimization
- Mark AI-written records — Provenance labeling
- Assign a challenger — Structured dissent
- Check with a second model — Cross-model verification
- Review on schedule — Oversight cadence & retrospectives
- Keep skills sharp — Deskilling-arrest mandate
- Peer sharing rules — Peer-edge governance
- Pause AI on alarms — Deployment circuit-breaker
- Gate record entries — Human-in-the-loop write gating
- Upgrade model — Improve the model
Documented case histories
- The map, not the score: place-based risk terrain and the records it concentrates
- Allegheny Family Screening Tool
- Allegheny Hello Baby
- Douglas County Decision Aide
- The score nobody sees: New York City's concealed severe-harm QA algorithm
- The audit that reached the legislature before it reached the tools: Colorado's safety and risk instruments
- Eckerd Rapid Safety Feedback: origin and spread
- Illinois Rapid Safety Feedback
- The vendor's ledger: Family-Match, the eharmony-derived adoption matcher the states kept coming back to
- ProKid (Netherlands)
- Insight Bristol / Think Family Database
- Hackney / Xantura Early Help Profiling
- Sistema Alerta Niñez (Chile)
- The guardrail's blind side: DC's walled-off child-welfare chatbot that began writing into the case record
- US Birth Match
- Oregon Safety at Screening
- Los Angeles County Project AURA
- What Works for Children's Social Care ML pilots
- New Zealand MSD Predictive Risk Modelling
- Gladsaxe model