Improving police risk assessment of domestic violence: A follow-up validation study

Three sets of hands holding a paper-fold family
Abstract

This study examines how accurately the refined Family Violence Risk Assessment Tool (FVRAT) predicts repeat domestic violence. Developed on the basis of a previous validation study of an earlier, much longer version of the tool, the refined FVRAT consists of 10 checkbox items, along with sections recording victim and officer judgements. These are used to inform police responses in the Australian Capital Territory.

A sample of over 450 unique reports of violence involving current and former intimate partners between March and December 2020 in which police used the refined FVRAT were examined. Repeat domestic violence was measured based on whether a subsequent report of domestic violence was made to police within six months.

Consistent with the previous study, the refined FVRAT predicts repeat domestic violence at least moderately well. Victim judgements were also shown to enhance the tool’s ability to correctly identify repeat domestic violence, although the findings also suggest some caution is warranted in using these judgements.

References

URLs correct as at May 2023

ACT Government 2021. Canberra’s recovery plan: Easing of restrictions roadmap (as at 14 April 2021). Canberra: ACT Government. https://www.covid19.act.gov.au/__data/assets/pdf_file/0010/1706329/PICC0050-COVID-Recovery-Plan_April-2021.pdf

ACT Government 2020a. Canberra’s recovery plan: COVID-19 easing of restrictions roadmap. Canberra: ACT Government. https://www.commsatwork.org/wp-content/uploads/2020/03/Canberras-Recovery-Plan-1.pdf

ACT Government 2020b. Canberra’s recovery plan: COVID-19 easing of restrictions roadmap as at 06 August 2020. Canberra: ACT Government. https://www.act.gov.au/__data/assets/pdf_file/0011/1602695/CV_Roadmap_Recovery-plan_Ease_Restrictions_6_Aug.pdf

Ægisdóttir S et al. 2006. The meta-analysis of clinical judgment project: Fifty-six years of accumulated research on clinical versus statistical prediction. The Counseling Psychologist 34(3): 341–382. https://doi.org/10.1177/0011000005285875

Ariza JJM, Robinson A & Myhill A 2016. Cheaper, faster, better: Expectations and achievements in police risk assessment of domestic abuse. Policing: A Journal of Policy and Practice 10(4): 341–350. https://doi.org/10.1093/police/paw023

Australian Bureau of Statistics (ABS) 2011. Australian and New Zealand Standard Offence Classification (ANZSOC), 2011, 3rd edition. ABS cat. no. 1234.0. Canberra: ABS. https://www.abs.gov.au/ausstats/abs@.nsf/mf/1234.0

Australian Institute of Health and Welfare 2019. Family, domestic and sexual violence in Australia: Continuing the national story. Cat. no. FDV 3. Canberra: Australian Institute of Health and Welfare. https://www.aihw.gov.au/reports/domestic-violence/family-domestic-sexual-violence-australia-2019/contents/summary

Backhouse C & Toivonen C 2018. National risk assessment principles for domestic and family violence: Companion resource. A summary of the evidence-base supporting the development and implementation of the national risk assessment principles for domestic and family violence. Insights no. 9. Sydney: Australia’s National Research Organisation for Women’s Safety

Barr A & Stephen-Smith R 2020. Public health emergency declared for ACT. Media release, 16 March. https://www.cmtedd.act.gov.au/open_government/inform/act_government_media_releases/barr/2020/public-health-emergency-declared-for-act

Berk RA, Sorenson SB & Barnes G 2016. Forecasting domestic violence: A machine learning approach to help inform arraignment decisions. Journal of Empirical Legal Studies 13(1): 94–115. https://doi.org/10.1111/jels.12098

Boxall H & Morgan A 2021. Intimate partner violence during the COVID-19 pandemic: A survey of women in Australia. Research report issue 3. Sydney: Australia’s National Research Organisation for Women’s Safety. https://www.anrows.org.au/publication/intimate-partner-violence-during-the-covid-19-pandemic-a-survey-of-women-in-australia/

Boxall H, Morgan A & Brown R 2020. The prevalence of domestic violence among women during the COVID-19 pandemic. Statistical Bulletin no. 28. Canberra: Australian Institute of Criminology. https://www.aic.gov.au/publications/sb/sb28

Burgess A, Nguyen H, Chai W & Kelly S 2021. Police-recorded crime trends in Victoria during the COVID-19 pandemic: Update to end of December 2020. Brief no. 12. Melbourne: Crime Statistics Agency. https://www.crimestatistics.vic.gov.au/research-and-evaluation/publications/police-recorded-crime-trends-in-victoria-during-the-covid-19-1

Capaldi DM, Knoble NB, Shortt JW & Kim HK 2012. A systematic review of risk factors for intimate partner violence. Partner Abuse 3(2): 231–280. https://doi.10.1891/1946-6560.3.2.231

Dowling C & Morgan A 2019. Predicting repeat domestic violence: Improving police risk assessment. Trends & issues in crime and criminal justice no. 581. Canberra: Australian Institute of Criminology. https://www.aic.gov.au/publications/tandi/tandi581

Dowling C, Morgan A, Boyd C & Voce I 2018. Policing domestic violence: A review of the evidence. Research Report no. 13. Canberra: Australian Institute of Criminology. https://www.aic.gov.au/publications/rr/rr13

Freeman K & Leung F 2021. Domestic violence in NSW in the wake of COVID-19: Update to December 2020. Bureau Brief no. 154. Sydney: NSW Bureau of Crime Statistics and Research. https://www.bocsar.nsw.gov.au/Pages/bocsar_publication/Pub_Summary/BB/BB154-Summary-Domestic-Violence-COVID-update-Dec2020.aspx

Graham LW, Sahay KM, Rizo CF, Messing JT & Macy RJ 2021. The validity and reliability of available intimate partner homicide and reassault risk assessment tools: A systematic review. Trauma, Violence and Abuse 22(1): 18–40. https://doi.org/10.1177/1524838018821952

Green DM & Swets JA 1966. Signal detection theory and psychophysics. New York: Wiley & Sons

Hosmer DW & Lemeshow S 2004. Applied logistic regression. New Jersey: John Wiley & Sons

Janes H & Pepe MS 2009. Adjusting for covariate effects on classification accuracy using the covariate-adjusted receiver operating characteristics curve. Biometrika 96(2): 371–382. https://doi.org/10.1093/biomet/asp002

Kebbell MR 2019. Risk assessment for intimate partner violence: How can the police assess risk? Psychology, Crime & Law 25(8): 829–846. https://doi.org/10.1080/1068316X.2019.1597087

Kourti A et al. 2023. Domestic violence during the COVID-19 pandemic: A systematic review. Trauma, Violence and Abuse 24(7): 719–745. https://doi.org/10.1177/15248380211038690

Lauria I, McEwan TE, Luebbers S, Simmons M & Ogloff JR 2017. Evaluating the Ontario Domestic Assault Risk Assessment in an Australian frontline police setting. Criminal Justice and Behavior 44(12): 1545–1558. https://doi.org/10.1177/0093854817738280

Leung F & Trimboli L 2022. Improving police risk assessment of intimate partner violence. Crime and Justice Bulletin no. 244. Sydney: NSW Bureau of Crime Statistics and Research. https://www.bocsar.nsw.gov.au/Pages/bocsar_publication/Pub_Summary/CJB/CJB244-Summary-Improving-police-risk-assessment-of-intimate-partner-violence.aspx

Mazerolle L et al. 2018. Criminal justice responses to domestic and family violence: A rapid review of the evaluation literature: Final report. Brisbane: University of Queensland. https://espace.library.uq.edu.au/view/UQ:b915230

McEwan TE, Bateson S & Strand S 2017. Improving police risk assessment and management of family violence through a collaboration between law enforcement, forensic mental health and academia. Journal of Criminological Research Policy and Practice 3(2): 119–131. https://doi.org/10.1108/JCRPP-01-2017-0004

McEwan TE, Shea D & Ogloff J 2018. The development of the VP-SAFVR. Criminal Justice and Behaviour 46(4): 590–607. https://doi.org/10.1177/0093854818806031

Messing JT & Thaller J 2013. The average predictive validity of intimate partner violence risk assessment instruments. Journal of Interpersonal Violence 28(7): 1537–1558. https://doi.org/10.1177/0886260512468250

Morgan A & Boxall H 2020. Social isolation, time spent at home, financial stress and domestic violence during the COVID-19 pandemic. Trends & issues in crime and criminal justice no. 609. Canberra: Australian Institute of Criminology. https://doi.org/10.52922/ti04855

Morgan A, Boxall H & Payne JL 2022. Reporting to police by intimate partner violence victim-survivors during the COVID-19 pandemic. Journal of Criminology 55(3): 285–305. https://doi.org/10.1177/26338076221094845

Muller CJ & MacLehose RF 2014. Estimating predicted probabilities from logistic regression: Different methods correspond to different target populations. International Journal of Epidemiology 43(3): 962–970. https://doi.org/10.1093/ije/dyu029

Myhill A & Hohl K 2019. The ‘golden thread’: Coercive control and risk assessment for domestic violence. Journal of Interpersonal Violence 34(21–22): 4477–4497. https://doi.org/10.1177/0886260516675464

Payne JL, Morgan A & Piquero AR 2022. COVID-19 and social distancing measures in Queensland, Australia, are associated with short-term decreases in recorded violent crime. Journal of Experimental Criminology 18: 89–113. https://doi.org/10.1007/s11292-020-09441-y

Pfitzner N, Fitz-Gibbon K & True J 2020. Responding to the ‘shadow pandemic’: Practitioner views on the nature of and responses to violence against women in Victoria, Australia during the COVID-19 restrictions. Melbourne: Monash University. https://bridges.monash.edu/articles/report/Responding_to_the_shadow_pandemic_practitioner_views_on_the_nature_of_and_responses_to_violence_against_women_in_Victoria_Australia_during_the_COVID-19_restrictions/12433517

Queensland Government Statistician’s Office 2021. Domestic and family violence calls for police service: Research paper. Brisbane: State of Queensland (Queensland Treasury). https://www.qgso.qld.gov.au/statistics/theme/crime-justice/crime-justice-research/domestic-family-violence

Ringland C 2018. The Domestic Violence Safety Assessment Tool (DVSAT) and intimate partner repeat victimisation. Crime and Justice Bulletin no. 213. Sydney: NSW Bureau of Crime Statistics and Research. https://www.bocsar.nsw.gov.au/Pages/bocsar_publication/Pub_Summary/CJB/cjb213-The-Domestic-Violence-Safety-Assessment-Tool-DVSAT-and-intimate-partner-repeat-victimisation.aspx

Singh JP & Fazel S 2010. Forensic risk assessment: A metareview. Criminal Justice and Behavior 37(9): 965–988. https://doi.org/10.1177/0093854810374274

Spivak B, McEwan T, Luebbers S & Ogloff J 2021. Implementing evidence-based practice in policing family violence: The reliability, validity and feasibility of a risk assessment instrument for prioritising police response. Policing and Society 31(4): 483–502. https://doi.org/10.1080/10439463.2020.1757668

State of Victoria 2016. Royal Commission into Family Violence: Report and recommendations, vol. 3. Melbourne: State of Victoria. http://rcfv.archive.royalcommission.vic.gov.au/Report-Recommendations.html

van der Put CE, Gubbels J & Assink M 2019. Predicting domestic violence: A meta-analysis on the predictive validity of risk assessment tools. Aggression and Violent Behavior 47: 100–116. https://doi.org/10.1016/j.avb.2019.03.008