Appendices
Read more
Appendix 1:
Cost of Lost Opportunities in the Early Years, 2018/2019
© Care Policy and Evaluation Centre, London School of Economics and Political Science
Basic assumptions and data considerations
The following is an overview of the methods and data sources used to estimate the cost to England of lost opportunities in the early years i.e. expenditure that might reasonably be avoided or replaced by preventative action in early childhood. The estimate includes longterm expenditure associated with adverse childhood experiences (ACEs), taking into account population attributable fractions [1] (PAFs), i.e. the fraction of expenditure related to the problem in question that may be causally linked to ACEs.
The latest complete set of available data were used in the analysis (2018/19), and all costs are presented in 2018/19 prices. Our analysis includes data for England only.
Incidence data are drawn from publicly available figures for England. The primary sources for unit costs are the national schedule of NHS reference costs [2], the PSSRU volume Unit Costs of Health and Social Care 2019 [3], the New Economy Manchester unit cost database for cost-benefit analysis (NEM) [4], previous analysis by the Early Intervention Foundation (EIF) [5] and our own calculations based on the principles of unit costing [6]. Where unit costs needed to be uprated, the GDP deflators presented in the NEM the were used.
Here we provide information on data sources for incidence and unit costs for each category of cost. Where decisions had to be made around choice of parameters and inclusion of cost categories in a grand total calculation, we have as a rule opted for the one that results in a more conservative estimate.
Children’s social care
Annual spend on looked after children
The total number of looked after children (LAC) by local authorities on census day (31 March; 78,1407) in 2018/19 was taken from DfE data [8]. The total spend associated with LAC was calculated as the sum of the total net expenditure on LAC and 50% of net expenditure on safeguarding, taken from DfE Section 251 returns [9]. This amounts to £5,709,278,000.
Number of Children in Need
The number of children in need (CiN; 338,450), here defined as the ‘number of children with an episode of need at any point during the year’, was taken from DfE data [10] The unit cost associated with the case management process (average total cost of case management over six months; £1,668) was taken from the NEM.
Injuries and self-harm in children and young people
Data on hospital admissions and A&E visits due to injuries were drawn from the PHE Fingertips dashboard (https://fingertips.phe.org.uk/). Incidence for each indicator is shown in Table 1.
Unit costs were calculated from the National Schedule of NHS Costs (2018/19). The cost of A&E attendances was estimated as the weighted average of non-admitted episodes. Note that this unit cost is not specific to children, and therefore case mix and resource use may not accurately reflect the cost for children. The cost of hospital admissions for injuries was calculated as the weighted average for paediatric injuries. This may not include all relevant categories of admissions and may not adequately reflect resource use relating to young people.
NICE guidance on self-harm in children and young people [11] specifies that they should be admitted to a paediatric or adolescent ward overnight, following appropriate triage and assessment in children’s A&E, with a fuller assessment and decision about discharge or further treatment the next day. The cost associated with an admission for self-harm is therefore estimated as a contact with an A&E Mental Health Liaison Service plus the weighted average of child and adolescent mental health services (CAMHS) admissions, from NHS reference costs. Since we only include A&E attendances for children aged 0-4 above, and this indicator looks at children and young people (CYP) aged 10- 24, there is no risk of double counting. We do not make assumptions about further treatment, as this expenditure is captured elsewhere and the care pathway is likely to vary considerably between individuals.
Indicator | Incidence | Unit cost | Included in grand total? |
---|---|---|---|
A&E attendances (0-4 years) | 2,203,962 | £144 | Yes |
Hospital admissions for injuries (age 0-14) | 97,700 | £1,816 | Yes |
Hospital admissions for injuries (age 15-24) | 90,550 | £1,816 | Yes |
NHS expenditure on mental health
Overall NHS expenditure on mental health according to the Five Year Forward Plan mental health dashboard [12] was £12.51bn. This breaks down into £10.56bn spent by local Clinical Commissioning Groups (CCGs) and £1.95bn of specialised commissioning spend by NHS England. The total figure includes £2.1bn attributable to learning disabilities and dementia, leaving around £10.41bn spent on other mental health services. The population attributable fraction (PAF) of this figure is included in the grand total estimate.
The NHS cost data collection (NHS reference costs) covers £69bn, or 61% of total NHS expenditure for 2018/19 (£113bn). Of this, the total categorised as spend on mental health, Improving Access to Psychological Therapies (IAPT) and secure services is £7.5bn, with 62% costed against mental health care clustered and 38% against other mental health services (recorded in other units of activity).
Looking more closely at expenditure relating to CYP, the reported annual CCG expenditure on CYP mental health, excluding learning disabilities but including eating disorders, was £753.3m. The number of admissions for CYP under 18 in CAMHS Tier 4 wards for 2018/19 was 4,614, with 425,841 bed days [13]. We apply the weighted cost of admissions related to mental health presented above (£798). These figures are presented for information, but not included in the grand total.
School absence and exclusion
Persistent absence from school
The number of persistent absentees (771,863) was taken from Pupil absence in schools in England: 2018 to 2019 [14], Table 2. Note that there was a change in the definition of persistent absence from the academic year 2015/16 (‘pupil enrolments missing 10% or more of their own possible sessions’).
The unit cost associated with one person per effective year was taken from the NEM. Given the likely overlap with other problem categories, only the expenditure attributable to provision of alternative education falling on local authorities is included in the estimated grand total [15].
The number of persistent absentees (771,863) was taken from Pupil absence in schools in England: 2018 to 2019 [14], Table 2. Note that there was a change in the definition of persistent absence from the academic year 2015/16 (‘pupil enrolments missing 10% or more of their own possible sessions’).
The unit cost associated with one person per effective year was taken from the NEM. Given the likely overlap with other problem categories, only the expenditure attributable to provision of alternative education falling on local authorities is included in the estimated grand total [15].
Agency | Amount | Included in grand total? |
---|---|---|
Local Authority (Education) | £901 | Yes |
Local Authority (Social services) | £419 | No |
NHS | £66 | No |
Criminal Justice System | £541 | No |
Permanent exclusion from school
The number of permanent exclusions for the academic year 2018/19 (7,894) was retrieved from DfE data [16], while the unit cost was taken from the NEM. Given the likely overlap with other problem categories, only the expenditure attributable to provision of alternative education falling on local authorities is included in the estimated grand total [17].
Agency | Amount | Included in grand total? |
---|---|---|
Local Authority (Education) | £9,169 | Yes |
Local Authority (Social services) | £1,281 | No |
NHS | £81 | No |
Criminal Justice System | £1,239 | No |
Economic inactivity in young people
We use estimates of incidence from the Labour Force Survey (average for Q2-Q4 2018 and Q1 2019) to estimate the costs associated with being not in education, employment or training (NEET) [18]. Given a lack of more recent data, we use the unit cost provided by the EIF (uprated to 2018/19 costs), which includes only an estimate of benefits paid by the Department for Work and Pensions. Note that due to changes in the benefit system, there is much uncertainty around the accuracy of this figure.
16–17-year-olds who are NEET
There were an estimated 59,500 people aged 16 and 17 who were NEET during 2018/19 (average over four quarters). Note that the confidence interval around this estimate is large at +-13,000. The unit cost applied is £650 per person [19].
18–24-year-olds who are NEET
There were an estimated 619,000 people aged 18-24 who were NEET during 2018/19 (average). Note that this is an estimate, and the confidence interval is large at +-47,000. The unit cost applied is £3,638 per person [20].
Crime and antisocial behaviour
Reported antisocial behaviour incidents
The number of reported antisocial behaviour incidents (1,356,319) was taken from the 2019 Release of crime in England and Wales [21]. The unit cost of £368 per reported incident is taken from the NEM and is the average of incidents requiring further action and no further action [22].
Youth offending teams
The number of young people in the youth justice system (21,700; CYP who were cautioned or sentenced) was taken from Youth Justice Statistics: 2018 to 2019 [23]. The unit cost is based on funding for Youth Offending Teams (YOTs), assigned to different agencies based on the breakdown provided in the EIF report [5] (Technical Appendix, Table 7, p. 17). Total YOT funding from Youth Justice Boards (YJB) for England and Wales was £71,621,951, while other YOT funding was £182,308,895 (Annex F to Youth Justice Statistics 2018 to 2019). YJB YOT funding for England only was £66,995,612. Assuming the proportion of other YOT funding for England only is the same, and applying the EIF breakdown, funding and unit costs were calculated as follows:
Agency | % YOT funding (per EIF data) | Funding amount England only | Unit cost | Included in grand total? |
---|---|---|---|---|
Justice System | 82% | £194,547,882 | £8,965 | Yes |
Police | 13% | £30,651,390 | £1,413 | Yes |
NHS | 0% | £1,003,232 | £46 | Yes |
Local Government | 5% | £11,325,966 | £522 | Yes |
Reported cases of domestic violence and abuse
The number of recorded domestic abuse-related crimes in England was 704,687 in 2018/19 [24]. The average unit cost per incident was taken from Rhys et al. (2019), uprated to 2018/19 prices.
Agency | Unit cost | Included in grand total? |
---|---|---|
NHS | £1,245 | Yes |
Criminal Justice System | £918 | Yes |
Other 25 | £389 | Yes |
Long-term consequences of ACEs
Hospital admissions attributable to the physical health consequences of adverse childhood experiences are shown below. The average unit cost for an elective inpatient stay (£4,078; NHS reference costs 2018/19) was applied.
Smoking
Data on NHS hospital admissions with a primary diagnosis which can be caused by smoking, and those estimated to be attributable to smoking, were taken from Table 11 of the NHS smoking statistics for 2018/19 [26]. The total number of admissions attributable to smoking (excluding those related to circulatory disease) was 377,400.
Disease | Attributable numbers | Included in grand total? |
---|---|---|
Cancers | 175,200 | Yes |
Respiratory diseases | 154,900 | Yes |
Circulatory diseases | 126,800 | No |
Diseases of the digestive system | 20,200 | Yes |
Other diseases | 27,100 | Yes |
Heart and circulatory diseases; obesity
Data on admissions for heart and circulatory diseases were obtained from the British Heart Foundation compendium [27].
Disease | Attributable numbers | Included in grand total? |
---|---|---|
Cardiovascular disease (CVD) | 261,100 | Yes |
Diabetes | 56,900 | Yes |
Obesity | 11,300 | Yes |
Asthma in children
Data on hospital admissions for asthma in under-19s were taken from PHE data [28]. There were 22,495 admissions in 2018/19.
Homelessness
Local authority expenditure on homelessness was taken from LA revenue outturns for housing services (R04) [29]. We follow the calculation by Shelter [30] by looking at total expenditure and excluding the categories administration, prevention and support. Total spend is calculated at £1,086,316,000.
While we do not attempt to calculate a unit cost of homelessness, Table 7 shows the number of households owed a relief and prevention duty, by reason (based on Tables A2P and A2R [31]).
Reason | Owed relief duty | Owed prevention duty |
---|---|---|
End of assured shorthold tenancy (AST) (private) | 13,570 | 45,090 |
End of non-AST private tenancy | 2,140 | 3,760 |
Family/friends no longer willing/able to accommodate | 31,820 | 34,430 |
Non-violent relationship breakdown with partner | 11,980 | 9,390 |
Domestic abuse | 14,070 | 8,910 |
Other violence or harassment | 3,420 | 2,080 |
End of social rented tenancy | 4,560 | 8,530 |
Eviction from supported housing | 5,460 | 2,890 |
Left institution with no accommodation available | 3,510 | 1,060 |
Required to leave accommodation provided by Home Office as asylum support | 1,750 | 1,580 |
Other reason/not known | 29,350 | 30,150 |
Total | 121,630 | 147,880 |
Population attributable fractions for England (all ACEs)
Population attributable fractions (PAFs) were applied to total estimates of costs by problem category where those were available, to provide further insight into the amount of public expenditure that is attributable to adversity in the early years. However, it would be inappropriate to claim that the fact this fraction of costs is attributable to a risk factor such as ACEs means that it could necessarily be avoided through early action. Table 8 shows PAFs by outcome. The PAF for depression was applied to all expenditure related to mental health, i.e. all conditions and all ages. The PAF for self-harm was applied to all categories of injury.
No PAFs were applied to the following problem categories: children’s social care; school absences and exclusions; youth economic inactivity; crime and antisocial behaviour. Arguably, only a fraction of the associated costs in these categories will be attributable to ACEs, although this fraction will be higher for children’s social care than for other categories.
Outcome | PAF | Source |
---|---|---|
Alcohol use | 0.131 | (Hughes et al., 2020) |
Smoking | 0.165 | (Hughes et al., 2020) |
Drug use | 0.526 | (Hughes et al., 2020) |
High BMI | 0.022 | (Hughes et al., 2020) |
Depression | 0.303 | (Hughes et al., 2020) |
CVD | 0.117 | (Bellis et al., 2019) |
Diabetes | 0.079 | (Bellis et al., 2019) |
Respiratory disease | 0.185 | (Bellis et al., 2019) |
Homelessness | 0.533 | (Roos et al., 2013) |
Hospital injuries | 0.415 | (Afifi et al., 2008) |
A&E injuries | 0.415 | (Afifi et al., 2008) |
Self-harm | 0.415 | (Afifi et al., 2008) |
Child mental health | 0.303 | (Hughes et al., 2020) |
Endnotes
-
https://www.who.int/data/gho/indicator-metadata-registry/imrdetails/1287
-
https://www.england.nhs.uk/national-cost-collection/
-
https://www.pssru.ac.uk/projectpages/unit-costs/unit-costs-2019/
-
https://www.greatermanchesterca.gov.uk/what-we-do/research/research-cost-benefit-analysis/
-
EIF (2016), https://www.eif.org.uk/report/the-cost-of-lateintervention-eif-analysis-2016
-
Beecham (2000), https://www.pssru.ac.uk/publications/pub-4233/
-
While this is not the true number of LAC, the numbers of children starting and ceasing to be looked after during the year are similar, making this a close approximate estimate of the number of LAC adjusted for a 12-month period. This assumption about the denominator affects the top-down calculation of the unit cost, but not the total cost.
-
https://explore-educationstatistics.service.gov.uk/find-statistics/children-lookedafter-inengland-includingadoptions/2020#releaseHeadlinescharts; accessed 16/04/2021.
-
https://www.gov.uk/guidance/section-251-2018-to-2019#section251-outturn; accessed 16/04/2021; EIF (2016), technical appendix p. 10.
-
https://www.gov.uk/government/statistics/characteristics-ofchildren-in-need-2018-to-2019, Table A1.
-
https://www.nice.org.uk/guidance/cg16/chapter/1-guidance#specialissues-for-children-and-youngpeople-under-16-years
-
https://www.england.nhs.uk/publication/nhs-mental-healthdashboard/; 2018/19, Q4
-
https://www.england.nhs.uk/publication/nhs-mental-healthdashboard/; 2018/19, Q1-Q4
-
https://www.gov.uk/government/statistics/pupil-absence-in-schoolsin-england-2018-to-2019
-
Also see EIF (2016), technical appendix p. 8.
-
https://explore-education-statistics.service.gov.uk/find-statistics/permanent-and-fixed-periodexclusions-in-england; accessed 16/04/2021.
-
Also see EIF (2016), technical appendix p. 9.
-
https://www.gov.uk/government/statistics/participation-ineducation-training-andemployment-2019; NEET statistics annual brief 2019: tables (table 1b, second part)
-
EIF (2016), Technical Appendix p. 15.
-
EIF (2016), Technical Appendix p. 16.
-
https://www.ons.gov.uk/peoplepopulationandcommunity/crimeandjustice/bulletins/crimeinenglandandwales/yearendingmarch2019
-
EIF (2016), Technical Appendix p. 16.
-
https://www.gov.uk/government/statistics/youth-justice-statistics2018-to-2019
-
https://www.ons.gov.uk/peoplepopulationandcommunity/crimeandjustice/datasets/domesticabuseprevalenceandvictimcharacteristicsappendixtables; accessed 30/04/2021
-
Victim services and multi-agency work resulting from domestic violence and abuse.
-
https://digital.nhs.uk/data-andinformation/publications/statistical/statistics-on-smoking/statistics-onsmoking-england-2020/statisticson-smoking-2020-data-tables
-
https://www.bhf.org.uk/what-wedo/our-research/heart-statistics/heart-statistics-publications/cardiovascular-diseasestatistics-2021
-
https://fingertips.phe.org.uk/search/asthma#page/4/gid/8000003/pat/15/par/E92000001/ati/166/are/E38000004/iid/92780/age/220/sex/4/cid/4/tbm/1
-
https://www.gov.uk/government/statistics/local-authority-revenueexpenditure-and-financing-england2018-to-2019-individual-localauthority-data-outturn
-
https://england.shelter.org.uk/media/press_release/homelessness_crisis_costs_councils_over_1bn_in_just_one_year
-
https://www.gov.uk/government/statistical-data-sets/live-tableson-homelessness; Detailed local authority level tables: financial year 2018-19.
References
-
Afifi, T.O., Enns, M.W., Cox, B.J., Asmundson, G.J.G., Stein, M.B., Sareen, J., 2008. Population Attributable Fractions of Psychiatric Disorders and Suicide Ideation and Attempts Associated With Adverse Childhood Experiences. Am. J. Public Health 98, 946–952. https://doi.org/10.2105/AJPH.2007.120253
-
Bellis, M.A., Hughes, K., Ford, K., Ramos Rodriguez, G., Sethi, D., Passmore, J., 2019. Life course health consequences and associated annual costs of adverse childhood experiences across Europe and North America: a systematic review and meta-analysis. Lancet Public Health 4, e517–e528. https://doi.org/10.1016/S2468-2667(19)30145-8
-
Chowdry, Haroon, Fitzsimons, P., 2016. The cost of late intervention: EIF analysis 2016 – Technical Report. Early Intervention Foundation.
-
Hughes, K., Ford, K., Kadel, R., Sharp, C.A., Bellis, M.A., 2020. Health and financial burden of adverse childhood experiences in England and Wales: a combined primary data study of five surveys. BMJ Open 10. https://doi.org/10.1136/bmjopen-2019-036374
-
Rhys, O., Barnaby, Alexander, Roe, Stephen, Wlansy, Miriam, 2019. The economic and social costs of domestic abuse. Home Office, London.
-
Roos, L.E., Mota, N., Afifi, T.O., Katz, L.Y., Distasio, J., Sareen, J., 2013. Relationship Between Adverse Childhood Experiences and Homelessness and the Impact of Axis I and II Disorders. Am. J. Public Health 103, S275–S281. https://doi.org/10.2105/AJPH.2013.301323
Appendix 2:
Case Studies
Part 1: Economic evidence for interventions addressing maternal mental health
Author: Annette Bauer, Assistant Professorial Research Fellow, Care Policy and Evaluation Centre, London School of Economics and Political Science, a.bauer@lse.ac.uk
Key summary points
- Economic evaluations suggest that training health professionals, such as health visitors, in systematically assessing women’s mental health and providing or arranging for psychologically informed support techniques where needed is likely to be cost-effective.
- Treatments that have been shown in trials to be cost-effective include cognitive behavioural therapy, interpersonal therapy and guided self-help.
- Psychological interventions that target the mother-infant relationship can help with infant attachment where a mother is suffering from postnatal depression, and have the potential to be cost-effective.
- In addition to improving maternal outcomes, findings suggest that treatment, when incorporating mother-infant relationship components, might potentially achieve positive impacts on the infant, such as improved sleep or temperament as well as child development or behaviour.
- Evidence gaps remain regarding impacts of interventions in children, and how to best value child outcomes in economic evaluations
Introduction
Perinatal mental health problems, defined as mental health problems experienced during the period from pregnancy to one year after birth, affect one in five women [1]. The short- and long-term impacts of perinatal mental health problems on the child are well established [2]. A 2014/2015 study [1],[3], which estimated the economic consequences of perinatal mental health problems taking a life course modelling approach, demonstrated that costs linked to maternal mental ill health during this period were high (£8.1 billion per cohort of UK births), and that the largest proportion of costs (more than two-thirds) were attributed to the impact on children.
Impacts on children can take various forms. Children of mothers who experience perinatal mental health problems are exposed to a higher risk of being born pre-term or with low birth weight, and to develop intellectual, behavioural and socio-emotional problems. A number of mechanisms have a role in explaining the links between maternal mental ill health and developmental problems in the child. Fetal programming, which refers to biological reactions in-utero such as those between increased cortisol concentrations and the offspring’s brain development, is likely to play an important role in the prenatal period [4]. In the postnatal period, psychological rather than biological factors are more relevant. Mental health problems can, for example, affect mothers’ responsiveness to their infants or affect their nurturing [5]. Both insecure mother-infant attachment styles [6] and exposure to child maltreatment [7] are more common in children of mothers with maternal mental health problems during the perinatal period, and are exacerbated by factors like poverty, domestic violence, addictions and lack of social support [2].
Whilst the economic case for investing in perinatal mental health services has been successfully made in the UK and elsewhere, leading to substantial investments in specialist perinatal mental health services, questions remain about how to best allocate resources, and about which interventions are effective and cost-effective [8],[9].
In this summary, we provide an overview of the evidence on the economic impact of interventions, services or approaches that seek to address maternal mental health problems during the perinatal period. Whilst the focus of this funded study is on early child development, therefore posing the question as to which interventions can cost-effectively reduce the adverse impact on children, we have included economic evaluations that only consider mothers’ outcomes. We assume that in the absence of sufficient evidence on children in this area, interventions that are cost-effective from a mother’s perspective are important to consider.
Method
This review was based on pragmatic searches of the literature. Whilst we did not apply a cut-off year for including studies, our focus was on studies published within the last 10–15 years. Most of our studies were from the UK, or with direct relevance to the UK. This included studies of interventions that have been adopted in the UK. Our review covered studies of interventions that sought to identify, prevent or reduce maternal mental health problems during the perinatal period and that measured maternal mental health outcomes. We included studies that measured infant outcomes, either as primary or secondary outcome. We also included all types of economic evaluations, independent of study type, outcome or cost perspective.
Findings
In addition to studies identified in recent systematic reviews [9-12], we identified a small number of additional economic evaluations published since then [13-15]. In this summary, we present findings from systematic reviews alongside findings from single studies in the following categories: strategies for identifying mental health problems; intervention types; models of delivery. Although the focus of this summary is on the economic evidence, we present findings in the context of effectiveness evidence where feasible and useful.
Strategies for identifying perinatal mental health problems
Findings from a systematic review by Camacho et al. [10] on the cost-effectiveness of perinatal interventions for depression or anxiety suggested that screening-plus-treatment programmes were likely cost-effective. Cost per QALY thresholds ranged from £8,642 to £15,666. (QALY stands for quality-adjusted life years gained and is a generic measure of disease burden that combines quality and quantity of life, which is commonly used for economic evaluations of clinical interventions. A cost per QALY threshold is used to help decide if an intervention can be considered cost-effective. In the UK, interventions with cost per QALY thresholds of between £20,000 and £30,000 are typically considered cost-effective.)
Various decision-analytic modelling studies have been conducted, which investigate how to cost-effectively identify women using screening tools such as the Whooley questions, the Edinburgh Postnatal Depression Scale (EPDS), the Patient Health Questionnaire (PHQ-2/9) or Generalised Anxiety Disorder (GAD) scales. One of the modelling studies was conducted for a 2014 guideline on ante- and postnatal mental health problems by the National Institute for Health and Care Excellence (NICE) [16]. The study directly informed NICE’s recommendation for a two-stage application of the Whooley questions in combination with the Edinburgh Postnatal Depression Scale (EPDS) or the Patient Health Questionnaire (PHQ-9), which was found to be more cost-effective than using only one of these tools [13],[17]. Average cost per woman screened ranged from £50 to £104, whilst QALYs were very similar between strategies. It is perhaps important to note that modelling studies that compare the economic impact of different screening tools are based on a simplified assumption that false identification always leads to higher treatment costs without additional health improvements.
This might underestimate prevention effects of psychological treatments for women without mental health problems [18],[19].
Intervention types
Psychological and psychosocial interventions
1. Focused on mothers’ mental health
Findings from systematic reviews and meta-analyses [9], [20-24] suggest that psychological and psychosocial interventions, provided alone or alongside drug treatments, are effective in preventing and reducing maternal mental health problems. For example, cognitive behavioural therapy (CBT) and interpersonal therapy (IPT), together with other structured psychological approaches modified to include pregnancy-or parenting-related needs, have been found to prevent and improve common mental health problems during the perinatal period [9],[20],[25],[26]. In addition to improving maternal outcomes, findings from some studies suggest that these interventions might improve early neonatal outcomes such as sleep duration and temperament [27] as well child development and behaviour [28-30]. Questions remain regarding long-term effectiveness and impact on child outcomes [30], with findings from some studies suggesting that treatment alone is not sufficient to improve these [31].
One health technology assessment [9], which included a systematic review, meta-analysis and economic modelling covering a wide range of interventions to prevent postnatal depression, found that psychological and psychosocial interventions, such as person-centred psychological approaches, CBT and IPT were likely to be cost-effective. Cost per QALY ranged from £447 to £62,251 (in 2012/13 prices), although there was considerable uncertainty in estimates. Universally provided interventions were costed at less than £100 per woman. Interventions targeting women considered at risk because of their social circumstances cost between £70 and £495. Interventions targeting women with raised scores on mental health screening tools cost between £500 and £1,850. QALY gains of interventions ranged from below zero, indicating a loss in comparison with standard care, to 0.026. The evidence was based on 13 economic evaluations, including nine conducted alongside trials and three decision models.
NICE recommends psychosocial and psychological treatments in low- and high-intensity forms as part of a stepped care model [16] According to NICE, low-intensity treatment in the form of guided self-help should be offered to women with common mental health problems who do not require more intensive treatment. Findings from an economic evaluation [14] suggest that guided self-help is potentially not only effective but also cost-effective. When QALYs linked to a reduction in depressive symptoms were compared against costs, the cost per QALY was £7,200 (in 2015/16 prices). Mean costs of delivering the intervention were £418 per participant. Whilst this model referred to low-intensity treatment delivered as part of a mental health service, other psychological approaches have been studied as part of health visitor- or midwifery-led models of care, suggesting that these are cost effective (see section below). With regards to high-intensity treatment, we were unable to identify directly relevant cost-effectiveness evidence from the UK. However, findings from an economic modelling study from the US [32] suggest that an intensive treatment intervention (CBT) provided to women on low income in their own home was likely to be cost-effective from a government perspective.
2. Combined focus on mothers’ mental health and infant development
A few studies have investigated the effects of psychological or psychosocial interventions that specifically address the mother-infant relationship. Findings suggest that these can have positive effects on infant attachment for mothers with perinatal mental health problems [33-35]. Importantly, they might also have positive long-term effects on the child. For example, one recent study found that adding parenting interventions such as video feedback therapy to intensive treatment for women with severe and persistent depression improved child development outcomes measured when the child was two years old [30]. Findings from one older economic evaluation [19] conducted alongside a randomised controlled trial (RCT) showed a high probability of cost-effectiveness (71%), which was due to improvements in maternal mental health. Average costs per woman were £120 (in 2000 prices) higher in the intervention than in the control group, and the intervention achieved a mean net benefit of £384. Most studies [34-36] conclude that more research is needed on the (cost-)effectiveness of such integrated interventions, which should include evidence on long-term child outcomes in order to capture their full economic value.
Social support interventions
Lack of social support is a key risk factor for maternal mental health problems, and various interventions have been developed to address social support needs of women during the perinatal period, including befriending and peer support. Overall, there is a lack of robust evidence that would allow confirmation of the effectiveness of such interventions [24],[37],[38].
Findings from one economic evaluation conducted alongside a small, feasibility RCT of a telephone-delivered peer support intervention (Mums4Mums) [39] were reported in a PhD thesis [15]. They suggested that whilst the costs for other NHS expenditure were only half of the costs in the standard care group (£801 vs. £1,538; price year not reported), this was not enough to offset the intervention costs (£2,900). Findings from a study of the original intervention, which was first developed and implemented in Canada, also found that the intervention costs were not offset in the short term ($4,497 vs. $3,280; in 2011 Canadian dollars) [40]. In terms of cost-effectiveness, the Canadian study presented the cost per case of postpartum depression averted, which was $20,196. The authors concluded that this was in the range for other accepted interventions for this population.
In the UK, the planned cost-effectiveness analysis was not conducted, which, according to the researchers, was because of insufficient follow-up data. Since there was no detectable difference in depressive symptoms or mother-infant interaction, it is unlikely that the intervention was cost-effective within the studied timeframe. Interestingly, the researchers found that costs in the intervention group reduced over time in comparison with the control group, and women in the intervention group continued to improve whereas women in the control group did not. This might suggest that mobilising social support might have longer term effects that require longer evaluation periods. However, the study sample was small (N=28), the drop-out rate high (50%) and the reporting quality in the PhD thesis low, which means that caution needs to be applied.
We identified two economic evaluations of befriending interventions [41],[42]. Interventions were provided by third-sector organisations, which play an important role in providing support for women’s mental health during the perinatal period. One evaluation reported an average cost of the intervention of £2,230 per woman and short-term net benefits that ranged between £199 and £2,193. The other evaluation estimated long-term return on investment of £6.50 per £1 spent, of which £1.50 referred to government expenditure. However, the evaluations were simple cost-benefit models based on a range of assumptions, were not published in peer-reviewed journals and had low reporting quality.
A particular challenge of evaluating costs and benefits of these kinds of intervention is that they are designed to meet needs flexibly, depending on a person’s preferences and wishes, and that they develop over time in the local context. In addition, because they often reach out to women who would not engage in treatment or support provided as part of standard mental health services, or in standard research, their value is difficult to compare with other interventions. Therefore, evaluating costs and benefits of these programmes requires particular methodologies that are still in development, although examples from other areas of health and social care exist [43].
Psychoeducational interventions
Psychoeducation is a common component of psychological or psychosocial interventions. A few interventions have been designed to provide psychoeducation as a standalone intervention. The educational element of these can refer to parenting, mental health, infant behaviour or relationships. Modelling conducted for the above-mentioned health technology assessment [9] found that educating women in preparing for parenting was cost-effective. The interventions referred to women at risk of perinatal mental health problems due to their social circumstances, including first-time mothers and mothers of twins. The estimated mean total cost was £266 per woman (in 2012/13 prices) and the mean QALY gain was 0.0193. The resulting cost per QALY was £13,785 and the probability that the intervention was cost-effective was 86%.
Interventions with a primary focus on infant development
Various interventions exist that have a primary aim to improve infant development and health whilst addressing maternal mental health. An economic evaluation of an intensive home visiting programme (called the Family Partnership Model) reported a mean cost per unit improvement in maternal sensitivity and infant cooperativeness of £3,246 per woman (in 2004 prices) [44],[45]. Mothers’ mental health did not improve. The intervention was provided to families who had been identified as vulnerable by their community midwives, based on selected indicators including maternal mental health and suspected child abuse or neglect.
An example of an intervention that has been demonstrated to be cost-effective in Australia is a community-delivered behavioural intervention targeting infant sleep problems and maternal well-being in mothers who reported infant sleep problems [46]. The intervention led to significantly improved infant sleep problems (39% vs. 55%), a non-significant improvement in remission from depression (25% vs. 28%) and significantly reduced mean costs (£97 vs. £117; price year not reported). The authors concluded that the sleep intervention might lead to health gains for infants and mothers and to resource savings for the healthcare system.
Models and modes of delivery
The cost-effective of interventions is likely to be influenced by various intervention features, including the delivery mode and who is providing the intervention.
Online and group formats
We identified an older systematic review conducted as part of a health technology assessment[12] investigating the cost-effectiveness of group-based CBT in addressing postnatal depression. The review did not find enough evidence to derive conclusions about the cost-effectiveness of group-based CBT. There is, however, evidence that psychosocial or psychological interventions provided online [22],[47],[48], as well as group-delivered forms of treatment [25],[49],[50], are acceptable to some women, and can achieve similar effects for those women. Costs linked to interventions provided in group format and/or online are generally lower than for one-to-one and/or in-person treatment, so that for women who accept (and prefer) those modes of delivery, they are likely to be cost-effective.
Midwifery- and health visitor-led model of care
Midwives and health visitors, together with general practitioners, have an important role in identifying and supporting women with maternal mental health problems. Various UK studies [18],[19],[51-57] have been conducted over the past decades to generate knowledge about how to best train health visitors or midwives to enhance their role in identifying mental health problems and providing support, including how to do this cost-effectively.
They find that training health visitors and midwives in systematically assessing women’s mental health problems and providing psychologically informed support techniques is not only feasible but can also be (cost-)effective [9],[18],[52-54],[58]. Economic evidence refers only to health visitors thus far. QALY gains per woman ranged from 0.002 for women at high risk of mental health problems (i.e. women who received treatment) to 0.001 for women not at risk (i.e. who were screened or assessed but who did not receive treatment) [9],[18],[54]. Costs per woman were lower in the intervention groups than in the control groups. For women at high risk of mental health problems, total costs were between £3 and £35 lower in the intervention group than in the control group. For women not at risk they were £82 lower (in 2003/4 prices). Estimated probabilities that assessment and treatment of women by health visitors was cost-effective ranged between 90% and 99% at cost per QALY thresholds of £20,000 to £30,000.
Evidence gaps and methodological challenges
Overall, substantial evidence gaps remain in this area of research. Most of the economic evidence relates to women with depression. Economic evidence for interventions that target women with severe mental illness during the perinatal period is largely lacking. This might partly be due to methodological challenges in conducting such studies, for example due to the rarity of some of these conditions, and because of challenges to include an appropriate ‘standard care’ group that also meets ethical research requirements. In addition no, or insufficient, economic evidence is available for interventions that address populations particularly affected by perinatal mental health problems such as women living in, or at risk of, poverty, Black women and women from other ethnic backgrounds.
The impact of interventions on infants and on fathers is rarely included in economic evaluations [10]. There is currently no agreed standard approach for measuring and valuing infant outcomes for the purpose of economic evaluation. For example, insecure attachment is an important predictor for substantive long-term costs [59]. However, there is currently no agreed methodological approach for including these costs in economic evaluations. Without such approaches, it is likely that the cost-effectiveness of interventions is underestimated, and that interventions are prioritised that are cost-effective in the short term over those that are cost-effective in the long term.
References
-
Bauer, A., et al., Costs of perinatal mental health problems. 2014, Centre for Mental Health & London School of Economics and Political Science: London, UK.
-
Stein, A., et al., Effects of perinatal mental disorders on the fetus and child. The Lancet, 2014. 384(9956): p. 1800-1819.
-
Bauer, A., M. Knapp, and M. Parsonage, Lifetime costs of perinatal anxiety and depression. J Affect Disord, 2016. 192: p. 83-90.
-
Glover, V., Maternal depression, anxiety and stress during pregnancy and child outcome; what needs to be done. Best Pract Res Clin Obstet Gynaecol, 2014. 28(1): p. 25-35.
-
Pearson, R.M., et al., Disruption to the development of maternal responsiveness? The impact of prenatal depression on motherinfant interactions. Infant Behav Dev, 2012. 35(4): p. 613-26.
-
Hayes, L.J., S.H. Goodman, and E. Carlson, Maternal antenatal depression and infant disorganized attachment at 12 months. Attach Hum Dev, 2013. 15(2): p. 133-53.
-
Pawlby, S., et al., Antenatal depression and offspring psychopathology: the influence of childhood maltreatment. Br J Psychiatry, 2011. 199(2): p. 106-12.
-
Bauer, A., M. Knapp, and B. Adelaja, Best practice for perinatal mental health care: the economic case, in PSSRU Discussion Paper DP291. 2016, London School of Economics and Political Science.
-
Morrell, C.J., et al., A systematic review, evidence synthesis and meta-analysis of quantitative and qualitative studies evaluating the clinical effectiveness, the cost-effectiveness, safety and acceptability of interventions to prevent postnatal depression. Health Technol Assess, 2016. 20(37): p. 1-414.
-
Camacho, E.M. and G.E. Shields, Cost-effectiveness of interventions for perinatal anxiety and/or depression: a systematic review. BMJ Open, 2018. 8(8): p. e022022.
-
Gurung, B., et al., Identifying and assessing the benefits of interventions for postnatal depression: a systematic review of economic evaluations. BMC Pregnancy Childbirth, 2018. 18(1): p. 179.
-
Stevenson, M.D., et al., Group cognitive behavioural therapy for postnatal depression: a systematic review of clinical effectiveness, cost-effectiveness and value of information analyses. Health Technol Assess, 2010. 14(44): p. 1-107, iii-iv.
-
Littlewood, E., et al., Health Services and Delivery Research, in Identifying perinatal depression with casefinding instruments: a mixedmethods study (BaBY PaNDA – Born and Bred in Yorkshire PeriNatal Depression Diagnostic Accuracy). 2018: Southampton (UK).
-
Trevillion, K., et al., An exploratory parallel-group randomised controlled trial of antenatal Guided Self-Help (plus usual care) versus usual care alone for pregnant women with depression: DAWN trial. J Affect Disord, 2020. 261: p. 187-197.
-
Sembi, S., Mums4mums — structured telephone peer-support for women experiencing postnatal depression: a pilot RCT to test its clinical effectiveness. PhD thesis. 2018, University of Warwick.
-
NICE, Antenatal and postnatal mental health: clinical management and service guidance, in Clinical guideline [CG192]. 2014, NICE: London, UK.
-
National Collaborating Centre for Mental Health, Antenatal and Postnatal Mental Health: Clinical Management and Service Guidance (Updated Edition). National Clinical Guideline No. 192. . 2014, The British Psychological Society and the Royal College of Psychiatrists: Leicester and London.
-
Henderson, C., et al., Cost-effectiveness of PoNDER health visitor training for mothers at lower risk of depression: findings on prevention of postnatal depression from a cluster randomised controlled trial. Psychol Med, 2019. 49(8): p. 1324-1334.
-
Petrou, S., et al., Cost-effectiveness of a preventive counseling and support package for postnatal depression. Int J Technol Assess Health Care, 2006. 22(4): p. 443-53.
-
Dennis, C.-L. and E. Hodnett, Psychosocial and psychological interventions for treating postpartum depression. Cochrane Database of Systematic Reviews, Issue 4. Art. No.: CD006116. DOI: 10.1002/14651858. CD006116.pub2. 2007.
-
Alderdice, F., J. McNeill, and F. Lynn, A systematic review of systematic reviews of interventions to improve maternal mental health and wellbeing. Midwifery, 2013. 29(4): p. 389-99.
-
Ashford, M.T., E.K. Olander, and S. Ayers, Computer- or web-based interventions for perinatal mental health: A systematic review. Journal of Affective Disorders, 2016. 197: p. 134-146.
-
Loughnan, S.A., et al., A systematic review of psychological treatments for clinical anxiety during the perinatal period. Arch Womens Ment Health, 2018. 21(5): p. 481-490.
-
Fuhr, D.C., et al., Effectiveness of peer-delivered interventions for severe mental illness and depression on clinical and psychosocial outcomes: a systematic review and meta analysis. Soc Psychiatry Psychiatr Epidemiol, 2014. 49(11): p. 1691-702.
-
Scope, A., et al., Is group cognitive behaviour therapy for postnatal depression evidence-based practice? A systematic review. BMC Psychiatry, 2013. 13(1): p. 321.
-
Sockol, L.E., C.N. Epperson, and J.P. Barber, A meta-analysis of treatments for perinatal depression. Clinical Psychology Review, 2011. 31(5): p. 839-849.
-
Netsi, E., et al., Infant outcomes following treatment of antenatal depression: Findings from a pilot randomized controlled trial. J Affect Disord, 2015. 188: p. 252-6.
-
Milgrom, J., et al., Feasibility study and pilot randomised trial of an antenatal depression treatment with infant follow-up. Archives of Women’s Mental Health, 2015. 18(5): p. 717-730.
-
Milgrom, J., et al., Maternal antenatal mood and child development: an exploratory study of treatment effects on child outcomes up to 5 years. J Dev Orig Health Dis, 2019. 10(2): p. 221-231.
-
Stein, A., et al., Mitigating the effect of persistent postnatal depression on child outcomes through an intervention to treat depression and improve parenting: a randomised controlled trial. The Lancet Psychiatry, 2018. 5(2): p. 134-144.
-
Forman, D.R., et al., Effective treatment for postpartum depression is not sufficient to improve the developing motherchild relationship. Dev Psychopathol, 2007. 19(2): p. 585 602. 19
-
Ammerman, R.T., et al., Costeffectiveness of In-Home Cognitive Behavioral Therapy for low-income depressed mothers participating in early childhood prevention programs. J Affect Disord, 2017. 208: p. 475-482.
-
Nylen, K.J., et al., Maternal depression: A review of relevant treatment approaches for mothers and infants. Infant Ment Health J, 2006. 27(4): p. 327-343.
-
Fonagy, P., M. Sleed, and T. Baradon, RANDOMIZED CONTROLLED TRIAL OF PARENT INFANT PSYCHOTHERAPY FOR PARENTS WITH MENTAL HEALTH PROBLEMS AND YOUNG INFANTS. Infant Mental Health Journal, 2016. 37(2): p. 97-114.
-
Barlow, J., et al., Parent-infant Psychotherapy for Improving Parental and Infant Mental Health: A Systematic Review. Campbell Systematic Reviews, 2015. 11(1): p. 1-223.
-
Cooper, P.J., et al., Attempting to prevent postnatal depression by targeting the mother–infant relationship: a randomised controlled trial. Primary Health Care Research & Development, 2015. 16(4): p. 383-397.
-
Dennis, C.L. and D. Kingston, A systematic review of telephone support for women during pregnancy and the early postpartum period. J Obstet Gynecol Neonatal Nurs, 2008. 37(3): p. 301-14.
-
Cupples, M.E., et al., A RCT of peermentoring for first-time mothers in socially disadvantaged areas (the MOMENTS Study). Arch Dis Child, 2011. 96(3): p. 252-8.
-
Caramlau, I., et al., Mums 4 Mums: structured telephone peer-support for women experiencing postnatal depression. Pilot and exploratory RCT of its clinical and cost effectiveness. Trials, 2011. 12: p. 88.
-
Dukhovny, D., et al., Prospective Economic Evaluation of a Peer Support Intervention for Prevention of Postpartum Depression among High-Risk Women in Ontario, Canada. Am J Perinatol, 2013. 30(08): p. 631-642.
-
Ltd., G.C., An economic analysis of Acacia Family Support’s befriending service. 2012, Acacia Family Support.
-
Taylor, R., A. Lee, and D. Simmons, The benefits of family action: an economic assessment of the potential benefits from family action interventions for women at risk of perinatal depression. 2014, Pro Bono Economics: UK.
-
Bauer, A., et al., Costs and economic consequences of a help-at-home scheme for older people in England. Health Soc Care Community, 2017. 25(2): p. 780-789.
-
Barlow, J., et al., Role of home visiting in improving parenting and health in families at risk of abuse and neglect: results of a multicentre randomised controlled trial and economic evaluation. Arch Dis Child, 2007. 92(3): p. 229-33.
-
McIntosh, E., et al., Economic evaluation of an intensive home visiting programme for vulnerable families: a cost-effectiveness analysis of a public health intervention. J Public Health (Oxf), 2009. 31(3): p. 423-33.
-
Hiscock, H., et al., Improving infant sleep and maternal mental health: a cluster randomised trial. Arch Dis Child, 2007. 92(11): p. 952-8.
-
O’Mahen, H.A., et al., Netmums: a phase II randomized controlled trial of a guided Internet behavioural activation treatment for postpartum depression. Psychological Medicine, 2014. 44(8): p. 1675-1689.
-
Lee, E.W., et al., Web-based interventions for prevention and treatment of perinatal mood disorders: a systematic review. BMC pregnancy and childbirth, 2016. 16: p. 38-38.
-
Thomas, N., A. Komiti, and F. Judd, Pilot early intervention antenatal group program for pregnant women with anxiety and depression. Arch Womens Ment Health, 2014. 17(6): p. 503-9.
-
Miniati, M., et al., Interpersonal psychotherapy for postpartum depression: a systematic review. Arch Womens Ment Health, 2014. 17(4): p. 257-68.
-
MacArthur, C., et al., Effects of redesigned community postnatal care on womens’ health 4 months after birth: a cluster randomised controlled trial. The Lancet, 2002. 359(9304): p. 378-385.
-
Brugha, T.S., et al., Universal prevention of depression in women postnatally: cluster randomized trial evidence in primary care. Psychol Med, 2011. 41(4): p. 739-48.
-
Brugha, T.S., et al., Can community midwives prevent antenatal depression? An external pilot study to test the feasibility of a cluster randomized controlled universal prevention trial. Psychol Med, 2016. 46(2): p. 345-56.
-
Morrell CJ, et al., Psychological interventions for postnatal depression: cluster randomised trial and economic evaluation. The PoNDER trial. Health Technol Assess 2009;13(30).
-
MacArthur C, et al., Redesigning postnatal care: a randomised controlled trial of protocol-based midwifery-led care focussed on individual women’s physical and psychological health needs. Health Technol Assess 7(37). 2003.
-
Morrell, J., et al., Costs and benefits of community postnatal support workers: a randomised controlled trial. Health Technol Assess; 4(6). 2000.
-
Wiggins, M., et al., The Social Support and Family Health Study: a randomised controlled trial and economic evaluation of two alternative forms of postnatal support for mothers living in disadvantaged inner-city areas. Health Technol Assess, 2004. 8(32): p. iii, ix-x, 1-120.
-
Howard, L.M., et al., Accuracy of the Whooley questions and the Edinburgh Postnatal Depression Scale in identifying depression and other mental disorders in early pregnancy. The British Journal of Psychiatry, 2018. 212(1): p. 50-56.
-
Bachmann, C.J., et al., The cost of love: financial consequences of insecure attachment in antisocial youth. Journal of Child Psychology and Psychiatry, 2019. 60(12): p. 1343-1350.
Part 2: Economic evidence for parenting programmes addressing child behaviour problems
Authors: Madeleine Stevens, Assistant Professorial Research Fellow, Sheree Marshall, Research Assistant, Care Policy and Evaluation Centre, London School of Economics and Political Science, m.stevens@lse.ac.uk
Key summary points
- Systematic reviews report small benefits of parenting programmes in addressing behaviour problems in young children; however, there is some evidence that studies which find positive results are more likely to be published (publication bias).
- A small number of cost-effectiveness analyses based on trials suggest that programmes can bring about improvements in children’s behaviour problems at a reasonable cost.
- Cost-effectiveness studies which model longer-term costs and benefits based on a set of assumptions demonstrate how programmes could be cost-saving in the long term if effects on children’s behaviour are maintained. This is because of the relatively low implementation costs compared with the high costs associated with long-term antisocial and criminal behaviour that can be prevented with the intervention.
- More evidence is needed to understand:
- The degree to which benefits are lasting in the longer term;How (cost-)benefits differ for different population groups, and between types of delivery (e.g. group, one-to-one, online);
- What happens to those who drop out of programmes;
- The extent to which programmes are suitable for those people most likely to present with high-cost and high-harm behaviour in the long term: how can barriers to participation and benefit be addressed for those most in need?
Introduction
Common behavioural parenting programmes such as the Incredible Years (Webster-Stratton, 2000) and Triple P (Sanders, 2012) aim to help parents learn skills to increase their children’s prosocial behaviours and reduce ‘externalising’ problem behaviours including aggression, tantrums and excessive non-compliance, for example through play, consistent discipline and giving attention and praise to positive behaviours. A previous review (Stevens, 2014) found that existing evidence indicated that such programmes have the potential to be cost-saving in the long term, but also found the following gaps in research, limiting understanding of programmes’ economic value: lack of follow-up of families who drop out of programmes; absence of control groups in longer-term follow-ups; and little information about costs and effects of programmes in routine practice. The review concluded that the size of savings resulting from implementation of effective parenting programmes will depend on the extent to which those families who are most likely to be costly to society attend the programmes and experience lasting benefit.
What is the evidence that parenting programmes are effective in reducing behaviour problems in children aged 2–5?
Parenting programmes have been concluded to be effective in several systematic reviews of randomised and quasi-randomised trials of parent training programmes for parents of children between ages 3 and 12. For example, a ‘meta-meta analysis’ (a meta-analysis of 26 meta-analyses) of parentbased interventions for children with behaviour problems found overall moderate positive effects on children’s behaviour, although there was considerable variation within results (Mingebach et al., 2018). Statistically significant improvements have been found in the short term in children’s behaviour problems, parental mental health and parenting skills and reductions in harsh parenting (Dretzke et al., 2009; Furlong et al., 2012; Piquero et al., 2016). While evidence from systematic review suggests parenting programmes can improve maternal mental health, there was no evidence that effects remain after one year (Barlow et al., 2014).
While there is some evidence of maintenance of improvements in child behaviour up to two years post-intervention (Bywater et al., 2009; Högström et al., 2017), such measurements generally lack controlled comparisons. This is often because ‘no intervention’ groups are ‘waiting list’ controls, offered the intervention within a year (Edwards et al., 2016; Nystrand et al., 2020). However, one exception is a cluster randomised study which compared intervention and control groups after ten years with some suggestion of fewer externalising problems in the intervention (Triple P) group (Kim et al., 2018).
Reviews point to some evidence of publication bias (Piquero et al., 2016); trials are often conducted by programme developers, raising the possibility of bias (whether conscious or unconscious), as well as raising questions about differing ‘fidelity’ to the programme when developers are not involved (Epstein et al., 2015). Lower-quality studies have been reported to find on average larger effects (Ross et al., 2011).
There has been a trend for parenting programmes to move online which, if effective, could potentially provide a cost-effective alternative to in-person parent training (MacDonell & Prinz, 2017). Online programmes can potentially address some of the barriers to participation in programmes, including accessibility and stigma associated with attendance (Hall & Bierman, 2015; McGoron & Ondersma, 2015). Two meta-analytic reviews have examined the effectiveness of online parenting programmes for children’s behaviour problems (Spencer et al., 2019; Thongseiratch et al., 2020). Thongseiratch and colleagues found 12 studies with a lower age limit in the 2-5 years age range and including 2,025 participants in total. In their review they included only higher-quality (i.e. controlled, peer-reviewed) studies. They concluded that there were overall significant positive effects on children’s behavioural problems in addition to positive outcomes for child emotional and parental mental health problems. They also concluded that sending reminders to parents to undertake work on self-directed components of the programme contributed to effectiveness. Neither review found trials directly comparing online with in-person delivery, but Thongseiratch and colleagues reported that effect sizes were comparable between the two delivery modes.
A significant barrier to the cost-effectiveness of parenting programmes, often not considered in trials, is low take-up by parents and high drop-out rates (Koerting et al., 2013). Evidence has suggested that attrition in Internet-only programmes may be even higher (Hall & Bierman, 2015). A synthesis of high-quality qualitative research (Koerting et al., 2013) investigated barriers to accessing and engaging with (inperson) programmes; the review recommended raising awareness, providing flexible, individually tailored support and using highly skilled, trained and knowledgeable therapists. Salient components of programmes have also been investigated quantitatively; a meta-analytic review, after controlling for differences attributable to research design, found programme components consistently associated with larger effects included increasing positive parent-child interactions and emotional communication skills; teaching parents to use time out and the importance of parenting consistency; and requiring parents to practise new skills with their children during parent training sessions. Conversely, those components consistently associated with smaller effects included teaching parents problem solving; teaching parents to promote children’s cognitive, academic or social skills; and providing other, additional services (Wyatt Kaminski et al., 2008). A more recent meta-analysis of 154 trials which paid attention to the role of programme components found effects on child externalising problems where programmes included positive reinforcement (e.g. praise) and discipline techniques, in particular natural/logical consequences of the child’s behaviour (Leijten et al., 2019).
What is the evidence from trials that parenting programmes are cost-effective?
Interventions aimed at children’s externalising behaviour problems, if effective in preventing subsequent antisocial and criminal behaviour in adolescence and adulthood, are likely to be cost-effective (or even cost-saving) in the longer term (Stevens, 2014). But time horizons in trials are short and there is limited information to guide where resources should be targeted to support those most in need, or most likely to be helped (MacKenzie et al., 2012; Stevens, 2014). A growing number of economic evaluations based on randomised controlled trials (RCTs) have estimated a cost per unit of improvement in children’s behaviour in the short term (e.g. Edwards et al., 2007; Donal O’Neill et al., 2013; Sampaio et al., 2016). More recently the programme Parents Under Pressure, targeted at substance-misusing parents was concluded to be cost-effective in reducing child abuse potential (Barlow et al., 2019). Edwards and colleagues, using a pragmatic RCT of the Incredible Years programme, presented cost-effectiveness in terms of the proportion of 144 children moved below a threshold for problem levels of behaviour (an additional 23% over the number moving in the control group) for a cost per child of between £1,612 and £2,418).
Other trials have compared costs and effects of different types of programme, sometimes finding differences in costs but not effectiveness (Gross et al., 2019). Sonuga-Barke and colleagues, for example, concluded that the New Forest Parenting Programme was less costly than Incredible Years and had better attendance, while effectiveness outcomes did not differ (Sonuga-Barke et al., 2018). Studies have also estimated increased cost-benefits of adding interventions together, for example a teacher component added to a parenting intervention (Sayal et al., 2016). The Sayal trial found parent-only intervention most likely to be cost-effective, and changes were found in parental mental health and parent reporting of child behaviour but not in observed child behaviour. However, elsewhere the Incredible Years programme delivered simultaneously to teachers, parents and children (aged 3-8) was estimated more likely to be cost-effective than a single approach (Foster et al., 2007). Cost-effectiveness could be improved if it were known which families were most likely to benefit and how cost-effectiveness could therefore be maximised. Building on previous research (Gardner et al., 2015), Gardner and colleagues attempted to pool analyses of fourteen trials of the Incredible Years, using individual-level data, to consider the extent to which socially disadvantaged families benefit, and to examine moderators of effectiveness (Gardner et al., 2017). From the available data, they found no evidence that effects differed in socio-economically disadvantaged families, ethnic minority families, families with different parenting styles or children with comorbid ADHD or emotional problems. They found strongest effects in children where baseline behaviour problems were greatest and where parents were more depressed; although parental depression itself was not found to improve. From the five UK trials with economic data they found an average cost per person of £2,414 and concluded that the intervention would be considered effective 99% of the time if willingness to pay was £145 per onepoint improvement on the Eyberg Child Behaviour Inventory Intensity scale. As the authors note, the available data did not allow assessment of which population groups had access to the programmes.
What is the evidence from modelling studies of cost savings in the longer term?
Modelling studies have been used to make up for the lack of evidence from trials on longer-term effects on children’s behaviour and wellbeing (Bonin et al., 2011; Mihalopoulos et al., 2007; O’Neill et al., 2011; Sampaio et al., 2018). Based on the assumptions used in models (including about longer-term impacts), savings are estimated to accrue because of reduced costs to education and health services, improved productivity in adulthood (e.g. Nystrand et al., 2019, 2020, children age 5+) and reduced costs to criminal justice (E.-M. Bonin et al., 2011). Studies based on Triple P concluded that the programme would be considered cost-effective according to local levels of willingness to pay (Sampaio et al., 2018). Another study concluded that, with an assumption of a 7% reduction in conduct problems, Triple P would be cost-saving if delivered on a population level (Mihalopoulos et al., 2007). Incredible Years (Donal O’Neill et al., 2013) was concluded likely to be cost-effective in the longer term taking into account future estimated savings relating to education, crime and welfare benefits. Modelled savings often accrue to sectors other than those that made the initial outlay to fund programmes. However, Nystrand and colleagues also estimated savings for local authorities that implemented programmes. Their analysis concluded that four different parenting programmes would be cost-saving and that a fifth intervention, a self-help manual, would be the most cost-effective, due to its low implementation costs. These positive conclusions from modelling studies are, however, based on assumptions of lasting effects of programmes for which there is currently little evidence (see above).
Conclusions and further considerations
Benefits of programmes found in trials are generally small (Barlow et al., 2014; Stewart-Brown, 2004) and there remains a lack of evidence on long-term costs and effects (Schmidt et al., 2020). There are good reasons to suppose that more consistent support may be needed (Barlow, 2015). We should be wary of inadvertently favouring interventions because, being ‘manualised’ and contained, they are easier to research, compared with, for example, ongoing family support or social work intervention (Featherstone et al., 2011; Stevens, 2018b). While the role of volunteers has been raised as a potentially cost-effective alternative to professional parenting advisors (Scavenius et al., 2020), the evidence above suggests that the quality of the support is key. Online programmes have also been promoted as cost-effective but will not necessarily provide some of the (social and sometimes ongoing) benefits of group-based in-person programmes that are appreciated by parents, indeed sometimes cited by parents as the most important aspect (Koerting et al., 2013; Stevens, 2018b). However, the development of online peer support interventions has been accelerating over the course of the COVID-19 pandemic (Kostyrka-Allchorne et al., 2021).
A focus on changing parenting has been a feature of family support for some time (Klett-Davies, 2016) and there is some evidence of positive effects, as indicated above. However, qualitative research suggests that there is also potential for negative effects resulting from implicitly or explicitly thereby blaming parents for children’s behavioural difficulties, (Broomhead, 2013; MacDonald, 1990; Stevens, 2018b; White et al., 2009). Skilled practitioners and strengths-based approaches may help avoid such damaging discourses.Longitudinal evidence of impacts of interventions is lacking, but longitudinal study does suggest that improvements in the environment around the child and family (in terms of maternal hostility, maternal depression, maternal views of the neighbourhood and ease of paying the rent) are associated with a lower likelihood of children with difficult behaviour going on to display antisocial behaviour in adulthood (Stevens, 2018a). Which outcomes are measured is important. It may be, for example, that changes in how children are treated is more important than changes in observed child behaviour in the longer term; it may be that changes in maternal wellbeing, whether financial or psychological (for example through improved mood or improved social support), are more important to the child’s wellbeing in the longer term than short-term changes in child behaviour. The tentative evidence presented above suggests that effects of parenting programmes do not differ between population groups. However, many of those most in need may not attend programmes (and even less trials). Parents involved in child protection proceedings may be particularly reluctant or fearful, for example, and parenting training needs to be offered at the right time (Ward et al., 2014). Professionals need to be aware of their potential to both increase and reduce resistance to change (Forrester et al., 2012). Assessing ‘readiness to change’ prior to embarking on challenging intervention to change parenting may help make intervention more cost-effective (Barlow, 2015:136; Power et al., 2008:5).
References
-
Barlow, J. (2015). Preventing child maltreatment and youth violence using parent training and home-visiting programmes. In P. Donnelly & C. Ward (Eds.), Oxford Textbook of Violence Prevention: Epidemiology, Evidence, and Policy (p. 400). Oxford University Press. https://books.google.com/books?hl=en&lr=&id=0y4DBQAAQBAJ&pgis=1
-
Barlow, J., Sembi, S., Parsons, H., Kim, S., Petrou, S., Harnett, P., & Dawe, S. (2019). A randomized controlled trial and economic evaluation of the Parents Under Pressure program for parents in substance abuse treatment. Drug and Alcohol Dependence, 194, 184–194. https://doi.org/10.1016/j.drugalcdep.2018.08.044
-
Barlow, J., Smailagic, N., Huband, N., Roloff, V., & Bennett, C. (2014). Group based parent training programmes for improving parental psychosocial health. Cochrane Database of Systematic Reviews. https://doi.org/10.1002/14651858.CD002020.pub4
-
Bonin, E.-M., Stevens, M., Beecham, J., Byford, S., & Parsonage, M. (2011). Costs and longer-term savings of parenting programmes for the prevention of persistent conduct disorder: a modelling study. BMC Public Health, 11(1), 803. https://doi.org/10.1186/1471-2458-11-803
-
Bonin, E., Stevens, M., Beecham, J., Byford, S., & Parsonage, M. (2011). Parenting interventions for the prevention of persistent conduct disorders. In M. Knapp, D. McDaid, & M. Parsonage (Eds.), Mental health promotion and mental illness prevention: The economic case. Personal Social Services Research Unit, London School of Economics and Political Science. http://eprints.lse.ac.uk/38225/1/Knapp_et_al__MHPP_The_Economic_Case.pdf
-
Broomhead, K. (2013). Blame, guilt and the need for ‘labels’; insights from parents of children with special educational needs and educational practitioners. British Journal of Special Education, 40(1), 14–21. https://doi.org/10.1111/1467-8578.12012
-
Bywater, T., Hutchings, J., Daley, D., Whitaker, C., Tien Yeo, S., Jones, K., Eames, C., & Edwards, R. (2009). Long-term effectiveness of a parenting intervention for children at risk of developing conduct disorder. British Journal of Psychiatry, 195, 318–324.
-
Dretzke, J., Davenport, C., Frew, E., Barlow, J., Stewart-Brown, S., Bayliss, S., Taylor, R., Sandercock, J., & Hyde, C. (2009). The clinical effectiveness of different parenting programmes for children with conduct problems: a systematic review of randomised controlled trials. Child and Adolescent Psychiatry and Mental Health, 3(7). http://www.pubmedcentral.nih.gov/picrender.fcgi?artid=2660289&blobtype=pdf
-
Edwards, R. T., Ceilleachair, A., Bywater, T., Hughes, D., & Hutchings, J. (2007). Parenting programme for parents of children at risk of developing conduct disorder: cost effectiveness analysis. BMJ, 334(682). file:///V:/CHRPU/cops and cost effectiveness/Nuffield grant/literature/parenting/Edwards et al_ 334 (7595) 682 — BMJ.htm
-
Edwards, R. T., Jones, C., Berry, V., Charles, J., Linck, P., Bywater, T., & Hutchings, J. (2016). Incredible Years parenting programme: Cost-effectiveness and implementation. Journal of Children’s Services, 11(1), 54–72. https://doi.org/10.1108/JCS-02-2015-0005
-
Epstein, R., Fonnesbeck, C., Williamson, E., Kuhn, T., Lindegren, M., Rizzone, K., Krishnaswami, S., Sathe, N., Ficzere, C., Ness, G., Wright, G., Raj, M., Potter, S., & McPheeters, M. (2015). Psychosocial and Pharmacological Interventions for Disruptive Behavior in Children and Adolescents: Comparative effectiveness review. https://www.ncbi.nlm.nih.gov/books/NBK327222/
-
Featherstone, B., Broadhurst, K., & Holt, K. (2011). Thinking systemically—Thinking Politically: Building strong partnerships with children and families in the context of rising inequality. British Journal of Social Work, online, 1–16. https://doi.org/10.1093/bjsw/bcr080
-
Forrester, D., Westlake, D., & Glynn, G. (2012). Parental resistance and social worker skills: towards a theory of motivational social work. Child & Family Social Work, 17(2), 118–129. https://doi.org/10.1111/j.1365-2206.2012.00837.x
-
Foster, E. M., Olchowski, A. E., & WebsterStratton, C. H. (2007). Is stacking intervention components cost-effective? An analysis of the incredible years program. Journal of the American Academy of Child and Adolescent Psychiatry, 46(11), 1414–1424. http://www.crd.york.ac.uk/CRDWeb/ShowRecord.asp?ID=22008000676
-
Furlong, M., McGilloway, S., Bywater, T., Hutchings, J., Smith, S. M., & Donnelly, M. (2012). Behavioural and cognitive behavioural group-based parenting programmes for early-onset conduct problems in children aged 3 to 12 years. In M. Furlong (Ed.), Cochrane Database of Systematic Reviews. John Wiley & Sons, Ltd. https://doi.org/10.1002/14651858.CD008225.pub2
-
Gardner, F., Leijten, P., Mann, J., Landau, S., Harris, V., Beecham, J., Bonin, E.-M., Hutchings, J., & Scott, S. (2017). Could scale-up of parenting programmes improve child disruptive behaviour and reduce social inequalities? Using individual participant data meta-analysis to establish for whom programmes are effective and cost-effective.
-
Gardner, F., Montgomery, P., & Knerr, W. (2015). Transporting Evidence-Based Parenting Programs for Child Problem Behavior (Age 3–10) Between Countries: Systematic Review and Meta-Analysis. Journal of Clinical Child & Adolescent Psychology, 1–14. https://doi.org/10.1080/15374416.2015.1015134
-
Gross, D., Belcher, H. M. E., Budhathoki, C., Ofonedu, M. E., Dutrow, D., Uveges, M. K., & Slade, E. (2019). Reducing Preschool Behavior Problems in an Urban Mental Health Clinic: A Pragmatic, Non-Inferiority Trial. Journal of the American Academy of Child & Adolescent Psychiatry, 58(6), 572-581.e1. https://doi.org/10.1016/j.jaac.2018.08.013
-
Hall, C. M., & Bierman, K. L. (2015). Technology-assisted interventions for parents of young children: Emerging practices, current research, and future directions. In Early Childhood Research Quarterly (Vol. 33, pp. 21–32). Elsevier Ltd. https://doi.org/10.1016/j.ecresq.2015.05.003
-
Högström, J., Olofsson, V., Özdemir, M., Enebrink, P., & Stattin, H. (2017). Two-Year Findings from a National Effectiveness Trial: Effectiveness of Behavioral and Non Behavioral Parenting Programs. Journal of Abnormal Child Psychology, 45(3), 527–542. https://doi.org/10.1007/s10802-016-0178-0
-
Kim, J. H., Schulz, W., Zimmermann, T., & Hahlweg, K. (2018). Parent–child interactions and child outcomes: Evidence from randomized intervention. Labour Economics, 54, 152–171. https://doi.org/10.1016/j.labeco.2018.08.003
-
Klett-Davies, M. (2016). Under Pressure? Single Parents in the UK. BertelsmannStiftung. http://www.bertelsmann-stiftung.de/fileadmin/files/BSt/Publikationen/GrauePublikationen/Studie_WB_Under_Pressure_Summary_2016.pdf
-
Koerting, J., Smith, E., Knowles, M. M., Latter, S., Elsey, H., McCann, D. C., Thompson, M., & Sonuga-Barke, E. (2013). Barriers to, and facilitators of, parenting programmes for childhood behaviour problems: a qualitative synthesis of studies of parents’ and professionals’ perceptions. European Child & Adolescent Psychiatry, 22(11), 653–670. https://doi.org/10.1007/s00787-013-0401-2
-
Kostyrka-Allchorne, K., Creswell, C., Byford, S., Day, C., Goldsmith, K., Koch, M., Gutierrez, W. M., Palmer, M., Raw, J., Robertson, O., Shearer, J., Shum, A., Slovak, P., Waite, P., & Sonuga-Barke, E. J. S. (2021). Supporting Parents & Kids Through Lockdown Experiences (SPARKLE): A digital parenting support app implemented in an ongoing general population cohort study during the COVID-19 pandemic: A structured summary of a study protocol for a randomised controlled trial. Trials, 22(1), 1–3. https://doi.org/10.1186/s13063-021-05226-4
-
Leijten, P., Gardner, F., Melendez-Torres, G. J., van Aar, J., Hutchings, J., Schulz, S., Knerr, W., & Overbeek, G. (2019). Meta-Analyses: Key Parenting Program Components for Disruptive Child Behavior. Journal of the American Academy of Child & Adolescent Psychiatry, 58(2), 180–190. https://doi.org/10.1016/j.jaac.2018.07.900
-
MacDonald, G. (1990). Allocating Blame in Social Work. British Journal of Social Work, 20(6), 525–546.
-
MacDonell, K. W., & Prinz, R. J. (2017). A Review of Technology-Based Youth and Family-Focused Interventions. In Clinical Child and Family Psychology Review (Vol. 20, Issue 2, pp. 185–200). Springer New York LLC. https://doi.org/10.1007/s10567-016-0218-x
-
MacKenzie, M., Reid, M., Turner, F., Wang, Y., Clarke, J., Sridharan, S., Platt, S., & O’Donnell, C. (2012). Reaching the hard-to-reach: Conceptual puzzles and challenges for policy and practice. Journal of Social Policy, 41(3), 511–532. https://doi.org/10.1017/S0047279412000074
-
McGoron, L., & Ondersma, S. J. (2015). Reviewing the need for technological and other expansions of evidence based parent training for young children. Children and Youth Services Review, 59, 71–83. https://doi.org/10.1016/j.childyouth.2015.10.012
-
Mihalopoulos, C., Sanders, M. R., Turner, K. M. T., Murphy-Brennan, M., & Carter, R. (2007). Does the triple P-Positive Parenting Program provide value for money? Australian and New Zealand Journal of Psychiatry, 41(3), 239–246. isi:000245676900005
-
Mingebach, T., Kamp-Becker, I., Christiansen, H., & Weber, L. (2018). Meta-meta analysis on the effectiveness of parent-based interventions for the treatment of child externalizing behavior problems. PLoS ONE, 13(9). https://doi.org/10.1371/journal.pone.0202855
-
Nystrand, C., Feldman, I., Enebrink, P., & Sampaio, F. (2019). Cost-effectiveness analysis of parenting interventions for the prevention of behaviour problems in children. PLoS ONE, 14(12). https://doi.org/10.1371/journal.pone.0225503
-
Nystrand, C., Hultkrantz, L., Vimefall, E., & Feldman, I. (2020). Economic Return on Investment of Parent Training Programmes for the Prevention of Child Externalising Behaviour Problems. Administration and Policy in Mental Health and Mental Health Services Research, 47(2), 300–315. https://doi.org/10.1007/s10488-019-00984-5
-
O’Neill, D, McGilloway, S., Donnelly, M., Bywater, T., & Kelly, P. (2011). A cost-effectiveness analysis of the Incredible Years parenting programme in reducing childhood health inequalities. European Journal of Health Economics, online ear.
-
O’Neill, Donal, McGilloway, S., Donnelly, M., Bywater, T., & Kelly, P. (2013). A cost-effectiveness analysis of the Incredible Years parenting programme in reducing childhood health inequalities. European Journal of Health Economics, 14(1), 85–94. https://doi.org/10.1007/s10198-011-0342-y
-
Piquero, A. R., Jennings, W. G., Diamond, B., Farrington, D. P., Tremblay, R. E., Welsh, B. C., & Gonzalez, J. M. R. (2016). A meta-analysis update on the effects of early family/parent training programs on antisocial behavior and delinquency. Journal of Experimental Criminology, 12(2), 229–248. https://doi.org/10.1007/s11292-016-9256-0
-
Power, A., Lane, L., Photo, N. S., Smith, T., & Serle, N. (2008). Report to Incommunities on the About Turn Project. Incommunities; LSE Housing; CASE. http://sticerd.lse.ac.uk/dps/case/cr/CASEreport55.pdf
-
Ross, A., Duckworth, K., Smith, D. J., Wyness, G., & Schoon, I. (2011). Prevention and Reduction: A review of strategies for intervening early to prevent or reduce youth crime and anti-social behaviour. https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/182548/DFE-RR111.pdf
-
Sampaio, F., Barendregt, J. J., Feldman, I., Lee, Y. Y., Sawyer, M. G., Dadds, M. R., Scott, J. G., & Mihalopoulos, C. (2018). Population cost-effectiveness of the Triple P parenting programme for the treatment of conduct disorder: an economic modelling study. European Child & Adolescent Psychiatry, 27(7), 933–944. https://doi.org/10.1007/s00787-017-1100-1
-
Sampaio, F., Enebrink, P., Mihalopoulos, C., & Feldman, I. (2016). Cost-Effectiveness of Four Parenting Programs and Bibliotherapy for Parents of Children with Conduct Problems. The Journal of Mental Health Policy and Economics, 19(4), 201–212. http://www.ncbi.nlm.nih.gov/pubmed/27991419
-
Sanders, M. R. (2012). Development, Evaluation, and Multinational Dissemination of the Triple P-Positive Parenting Program. Annual Review of Clinical Psychology, 8(1), 345–379. https://doi.org/10.1146/annurevclinpsy-032511-143104
-
Sayal, K., Taylor, J. A., Valentine, A., Guo, B., Sampson, C. J., Sellman, E., James, M., Hollis, C., & Daley, D. (2016). Effectiveness and cost-effectiveness of a brief school-based group programme for parents of children at risk of ADHD: a cluster randomised controlled trial. Child: Care, Health and Development, 42(4), 521–533. https://doi.org/10.1111/cch.12349
-
Scavenius, C., Amilon, A., & Schultz, E. A. (2020). A Cost-effectiveness Analysis of Caring in Chaos—A Volunteer delivered Parent Training Program in Denmark. Journal of Child and Family Studies, 29(10), 2836–2849. https://doi.org/10.1007/s10826-020-01788-0
-
Schmidt, M., Werbrouck, A., Verhaeghe, N., Putman, K., Simoens, S., & Annemans, L. (2020). Universal Mental Health Interventions for Children and Adolescents: A Systematic Review of Health Economic Evaluations. In Applied Health Economics and Health Policy (Vol. 18, Issue 2, pp. 155–175). Adis. https://doi.org/10.1007/s40258-019-00524-0
-
Sonuga-Barke, E. J. S., Barton, J., Daley, D., Hutchings, J., Maishman, T., Raftery, J., Stanton, L., Laver-Bradbury, C., Chorozoglou, M., Coghill, D., Little, L., Ruddock, M., Radford, M., Yao, G. L., Lee, L., Gould, L., Shipway, L., Markomichali, P., McGuirk, J., … M JJ. (2018). A comparison of the clinical effectiveness and cost of specialised individually delivered parent training for preschool attention-deficit/hyperactivity disorder and a generic, group-based programme: a multi-centre, randomised controlled trial of the New F. In European Child and Adolescent Psychiatry (Vol. 27, Issue 6, pp. 797–809).
-
Spencer, C. M., Topham, G. L., & King, E. L. (2019). Do Online Parenting Programs Create Change?: A Meta-Analysis. Journal of Family Psychology. https://doi.org/10.1037/fam0000605
-
Stevens, M. (2014). The cost-effectiveness of UK parenting programmes for preventing children’s behaviour problems – A review of the evidence. Child and Family Social Work, 19(1). https://doi.org/10.1111/j.1365-2206.2012.00888.x
-
Stevens, M. (2018a). Preventing at-risk children from developing antisocial and criminal behaviour: a mixed methods longitudinal study examining the role of parenting, community and societal factors in middle childhood. BMC Psychology, 6(40).
-
Stevens, M. (2018b). Parents’ experiences of services addressing parenting of children considered at-risk for future antisocial and criminal behaviour: A qualitative longitudinal study. Children and Youth Services Review, 95, 183–190. https://doi.org/10.1016/J.CHILDYOUTH.2018.10.007
-
Stewart-Brown, S. (2004). Impact of a general practice based group parenting programme: quantitative and qualitative results from a controlled trial at 12 months. Archives of Disease in Childhood, 89(6), 519–525. https://doi.org/10.1136/adc.2003.028365
-
Thongseiratch, T., Leijten, P., & Melendez-Torres, G. J. (2020). Online parent programs for children’s behavioral problems: a meta-analytic review. European Child & Adolescent Psychiatry, 29(11), 1555–1568. https://doi.org/10.1007/s00787-020-01472-0
-
Ward, H., Brown, R., Hyde-Dryden, G., & Centre for Child and Family Research, L. U. (2014). Assessing parental capacity to change when children are on the edge of care: An overview of current research evidence. Department for Education. https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/330332/RR369_Assessing_parental_capacity_to_change_Final.pdf
-
Webster-Stratton, C. (2000). The Incredible Years Training Series. In Juvenile Justice Bulletin. U.S.Department of Justice, Office of Juvenile Justice and Delinquency Prevention.
-
White, S., Wastell, D., Peckover, S., Hall, C., & Broadhurst, K. (2009). Managing Risk in a High Blame Environment: Tales from the ‘Front Door’ in Contemporary Children’s Social Care. Lancaster University. http://www.research.lancs.ac.uk/portal/en/publications/managingrisk-in-a-high-blame-environment-talesfrom-the-front-door-in-contemporarychildrens-social-care(d88d93fb-4a57-41f4-8dc8-ef6c0234a34b).html
-
Wyatt Kaminski, J., Valle, L. A., Filene, J. H., & Boyle, C. L. (2008). A meta-analytic review of components associated with parent training program effectiveness. Journal of Abnormal Child Psychology, 36(4), 567–589. http://www.crd.york.ac.uk/CRDWeb/ShowRecord.asp?ID=12008106686