This paper reviewed open-source materials including electronic service provider (ESP) transparency reports to provide an overview of the contemporary problem of child sexual abuse material (CSAM) offending on ESP platforms, examine measures currently used by ESPs to detect and prevent CSAM offending, and explore the potential impact of end-to-end encryption on CSAM distribution and detection. The study found that the platforms with the highest user bases are actively detecting and removing CSAM. However, some are less transparent than others about the methods they use to prevent, detect and remove CSAM, omitting key information that is crucial for future best practice in reducing CSAM offending. Further, the adoption of end-to-end encryption by ESPs that detect and remove large amounts of CSAM from their platforms will likely provide a haven for CSAM offenders. Implications for ESPs and international law reform are discussed.
References
URLs correct as at March 2022
Allen E 2021. Defending the privacy of child sexual abuse victims online, in the EU and worldwide. https://www.weprotect.org/blog/defending-the-privacy-of-child-sexual-abuse-victims-online-in-the-eu-and-worldwide/
Allen E 2011. Facebook to use Microsoft’s PhotoDNA technology to combat child exploitation. https://blogs.microsoft.com/on-the-issues/2011/05/19/facebook-to-use-microsofts-photodna-technology-to-combat-child-exploitation/
Amnesty International 2016. Easy guide to encryption and why it matters. London: Amnesty International. https://www.amnesty.org/en/latest/campaigns/2016/10/easy-guide-to-encryption-and-why-it-matters/
Andrus M, Buckley J & Williams C 2021. Understanding the intentions of child sexual abuse material (CSAM) sharers. https://research.facebook.com/blog/2021/02/understanding-the-intentions-of-child-sexual-abuse-material-csam-sharers/
Apple 2021a. Expanded protections for children: Technology summary. https://web.archive.org/web/20210816220924/https://www.apple.com/child-safety/
Apple 2021b. iCloud security overview. https://support.apple.com/en-us/HT202303
Arthur C 2013. Twitter to introduce PhotoDNA system to block child abuse images. The Guardian, 22 July. https://www.theguardian.com/technology/2013/jul/22/twitter-photodna-child-abuse
Babchishin KM, Hanson RK & VanZuylen H 2015. Online child pornography offenders are different: A meta-analysis of the characteristics of online and offline sex offenders against children. Archives of Sexual Behaviour 44(1): 45–66. https://doi.org/10.1007/s10508-014-0270-x
Balfe M et al. 2015. Internet child sex offenders’ concerns about online security and their use of identity protection technologies: A review. Child Abuse Review 24: 427–439. https://doi.org/10.1002/car.2308
Brown R & Bricknell S 2018. What is the profile of child exploitation material offenders? Trends & issues in crime and criminal justice no. 564. Canberra: Australian Institute of Criminology. https://www.aic.gov.au/publications/tandi/tandi564
Bursztein E et al. 2019. Rethinking the detection of child sexual abuse imagery on the internet. International World Wide Web Conference, San Francisco, 13–17 May: 2601–2607. https://doi.org/10.1145/3308558.3313482
Canadian Centre for Child Protection (C3P) 2017. Survivors’ survey: Full report 2017. Winnipeg: C3P. https://www.protectchildren.ca/en/resources-research/survivors-survey-results/
Canegallo K 2021. Our efforts to fight child sexual abuse online. https://blog.google/technology/safety-security/our-efforts-fight-child-sexual-abuse-online/
Clayton J 2021. Apple criticised for system that detects child abuse. BBC News, 7 August. https://www.bbc.com/news/technology-58124495
Davis A 2021a. Preventing child exploitation on our apps. https://about.fb.com/news/2021/02/preventing-child-exploitation-on-our-apps/
Davis A 2021b. We’ll protect privacy and prevent harm, writes Facebook safety boss. The Telegraph, 20 November. https://www.telegraph.co.uk/business/2021/11/20/people-shouldnt-have-choose-privacy-safety-says-facebook-safety/
Davis A 2020. Facebook joins industry effort to fight child exploitation online. https://about.fb.com/news/2020/06/fighting-child-exploitation-online/
Davis A 2018. New technology to fight child exploitation. https://about.fb.com/news/2018/10/fighting-child-exploitation/
de Santisteban P, del Hoyo J, Alcázar-Córcoles MÁ & Gámez-Guadix M 2018. Progression, maintenance, and feedback of online child sexual grooming: A qualitative analysis of online predators. Child Abuse & Neglect 80: 203–215. https://doi.org/10.1016/j.chiabu.2018.03.026
Deahl D 2018. Skype now offers end-to-end encrypted conversations. The Verge, 20 August. https://www.theverge.com/2018/8/20/17725226/skype-private-conversation-end-to-end-encrypted-opt-in
Dropbox nda. Who can see the stuff in my Dropbox account? https://help.dropbox.com/accounts-billing/security/file-access
Dropbox ndb. How Dropbox keeps your files secure. https://help.dropbox.com/accounts-billing/security/how-security-works
eSafety Commission 2020. End-to-end encryption trends and challenges – position statement. Sydney: eSafety Commissioner. https://www.esafety.gov.au/about-us/tech-trends-and-challenges/end-end-encryption
Facebook nd. Community standards enforcement report: Child endangerment: Nudity and physical abuse and sexual exploitation. https://transparency.fb.com/data/community-standards-enforcement/child-nudity-and-sexual-exploitation/facebook
Farid H 2019. Testimony: House Committee on Energy and Commerce: Fostering a healthier internet to protect consumers. Washington DC: House Committee on Energy and Commerce. https://energycommerce.house.gov/committee-activity/hearings/hearing-on-fostering-a-healthier-internet-to-protect-consumers
Gewirtz-Meydan A, Walsh W, Wolak J & Finkelhor D 2018. The complex experience of child pornography survivors. Child Abuse & Neglect 80: 238–248. https://doi.org/10.1016/j.chiabu.2018.03.031
Gladstone N 2019. Child sexual abuse material spreading ‘exponentially’ on social media. Sydney Morning Herald, 2 July. https://www.smh.com.au/national/child-sexual-abuse-material-spreading-exponentially-on-social-media-20190701-p520nn.html
Google nda. Discover our child safety toolkit. https://protectingchildren.google/tools-for-partners/
Google ndb. Email encryption in transit. https://support.google.com/mail/answer/6330403?hl
Google ndc. Featured policies: Child safety. https://transparencyreport.google.com/youtube-policy/featured-policies/child-safety?hl
Google ndd. Fighting child sexual abuse online. https://protectingchildren.google/intl/en_au/
Google nde. How end-to-end encryption in Messages provides more security. https://support.google.com/messages/answer/10262381?hl
Google 2021. Google’s efforts to combat online child sexual abuse material. https://transparencyreport.google.com/child-sexual-abuse-material/reporting
Grant B, Shields B, Tabachnick J & Coleman J 2019. “I didn’t know where to go”: An examination of Stop It Now!’s sexual abuse prevention helpline. Journal of Interpersonal Violence 34(20): 4225–4253. https://doi.org/10.1177/0886260519869237
Gregoire C 2020. Microsoft shares new technique to address online grooming of children for sexual purposes. https://blogs.microsoft.com/on-the-issues/2020/01/09/artemis-online-grooming-detection/
Gruszczyk J 2021. End-to-end encryption for one-to-one Microsoft Teams calls now generally available. https://techcommunity.microsoft.com/t5/microsoft-teams-blog/end-to-end-encryption-for-one-to-one-microsoft-teams-calls-now/ba-p/3037697
Holt K 2021. The Android Messages app now offers end-to-end encryption. Engadget, 15 June. https://www.engadget.com/android-messages-end-to-end-encryption-update-191641092.html
Imgur 2019. Privacy Policy. San Francisco: Imgur. https://imgurinc.com/privacy
Internet Watch Foundation 2014–2021. Annual report (various issues). https://www.iwf.org.uk/about-us/who-we-are/annual-report/
Interpol 2020. Threats and trends: Child sexual exploitation and abuse: COVID-19 impact. Lyon: Interpol. https://www.interpol.int/News-and-Events/News/2020/INTERPOL-report-highlights-impact-of-COVID-19-on-child-sexual-abuse
Keller MH & Dance GJX 2019. Child abusers run rampant as tech companies look the other way. New York Times, 9 November. https://www.nytimes.com/interactive/2019/11/09/us/internet-child-sex-abuse.html
Kent G 2021. Messenger policy workshop: Future of private messaging. https://about.fb.com/news/2021/04/messenger-policy-workshop-future-of-private-messaging/
Langston J 2018. How PhotoDNA for Video is being used to fight online child exploitation. https://news.microsoft.com/on-the-issues/2018/09/12/how-photodna-for-video-is-being-used-to-fight-online-child-exploitation/
Microsoft nda. Digital safety content report. https://www.microsoft.com/en-us/corporate-responsibility/digital-safety-content-report
Microsoft ndb. Encryption in Outlook. https://support.microsoft.com/en-us/office/encryption-in-outlook-17149eb8-a82e-405b-af5a-4fb89ce4a418
Microsoft 2021a. Digital safety content report 2020 H1 – January–June 2020. https://www.microsoft.com/en-us/corporate-responsibility/digital-safety-content-report
Microsoft 2021b. Digital safety content report 2020 H2 – Jul–Dec 2020. https://www.microsoft.com/en-us/corporate-responsibility/digital-safety-content-report
Murdoch L 2016. Australian accused of child sex tourism arrested in the Philippines. Sydney Morning Herald, 1 September. https://www.smh.com.au/world/australian-accused-of-child-sex-tourism-arrested-in-the-philippines-20160901-gr6x8x.html
Napier S, Teunissen C & Boxall H 2021. How do child sexual abuse live streaming offenders access victims? Trends & issues in crime and criminal justice no. 642. Canberra: Australian Institute of Criminology. https://doi.org/10.52922/ti78474
National Centre for Missing and Exploited Children (NCMEC) 2022. CyberTipline 2021 report. https://www.missingkids.org/gethelpnow/cybertipline/cybertiplinedata
National Center for Missing and Exploited Children (NCMEC) 2021. 2020 CyberTipline reports by electronic service providers (ESP). https://www.missingkids.org/gethelpnow/cybertipline/cybertiplinedata#reports
National Center for Missing and Exploited Children (NCMEC) 2019. NCMEC’s statement regarding end-to-end encryption. https://www.missingkids.org/blog/2019/post-update/end-to-end-encryption
National Center for Missing and Exploited Children (NCMEC) 2014–2020. Annual report (various issues). https://www.missingkids.org/footer/about/annual-report
Netclean 2020. Netclean report: COVID-19 impact 2020: A report about child sexual abuse crime. https://www.netclean.com/netclean-report-2020/
Netclean 2019. Netclean report 2019: A report about child sexual abuse crime. https://www.netclean.com/netclean-report-2019/
Nicas J 2021. Apple’s iPhones will include new tools to flag child sexual abuse. New York Times, 5 August. https://www.nytimes.com/2021/08/05/technology/apple-iphones-privacy.html
Omegle 2022. Omegle Privacy Notice. https://www.omegle.com/static/privacy.html
Prichard J, Wortley R, Watters P, Spiranovic C, Hunn C & Krone T 2022. Effects of automated messages on internet users attempting to access “barely legal” pornography. Sexual Abuse 34(1): 106–124. https://doi.org/10.1177/10790632211013809
Reddit nd. Transparency report 2020. https://www.redditinc.com/policies/transparency-report-2020
Salter M et al. 2021. Production and distribution of child sexual abuse material by parental figures. Trends & issues in crime and criminal justice no. 616. Canberra: Australian Institute of Criminology. https://doi.org/10.52922/ti04916
Salter M & Hanson E 2021. “I need you all to understand how pervasive this issue is”: User efforts to regulate child sexual offending on social media. In J Baily, A Flynn & N Henry (eds), The Emerald International handbook of technology facilitated violence and abuse. Emerald Publishing: 729–748. https://doi.org/10.1108/978-1-83982-848-520211053
Schiemer J 2018. Strong and responsible: Can encryption be both? FlagPost, 3 October. https://www.aph.gov.au/About_Parliament/Parliamentary_Departments/Parliamentary_Library/FlagPost/2018/October/Encryption
Seto MC & Eke AW 2015. Predicting recidivism among adult male child pornography offenders: Development of the child pornography offender risk tool (CPORT). Law and Human Behaviour 39(4): 416–429. https://doi.org/10.1037/lhb0000128
Signal 2018. Signal partners with Microsoft to bring end-to-end encryption to Skype. Signal, 11 January. https://signal.org/blog/skype-partnership/
Snap Inc 2021a. Transparency report: January 1, 2020 – June 30, 2020. https://snap.com/en-US/privacy/transparency/2020-6-31
Snap Inc 2021b. Transparency report: July 1, 2020 – December 31, 2020. https://snap.com/en-US/privacy/transparency/2020-12-31
Statista 2022a. Number of Instagram users worldwide from 2019 to 2023 (in millions). https://www.statista.com/statistics/183585/instagram-number-of-global-users/
Statista 2022b. Number of monthly active Facebook users worldwide as of 4th quarter 2021 (in millions). Hamburg: Statista. https://www.statista.com/statistics/264810/number-of-monthly-active-facebook-users-worldwide/
Statista 2022c. Most popular global mobile messenger apps as of January 2022, based on number of monthly active users (in millions). https://www.statista.com/statistics/258749/most-popular-global-mobile-messenger-apps/
Steel CMS 2015. Web-based child pornography: The global impact of deterrence efforts and its consumption on mobile platforms. Child Abuse and Neglect 44: 150–158. https://doi.org/10.1016/j.chiabu.2014.12.009
Stevens D 2020. Consumers seek out apps with enhanced privacy features to keep in touch in our new normal. https://www.data.ai/en/insights/market-data/consumers-seek-enhanced-privacy-app-features/
Synstrom K 2014. 300 million: Sharing real moments. https://web.archive.org/web/20141210200422/http://blog.instagram.com/post/104847837897/141210-300million
Thorn 2021. Why an increase in reports of CSAM is actually a good thing. https://www.thorn.org/blog/why-an-increase-in-reports-of-csam-is-actually-a-good-thing/
Thorn 2016. Microsoft’s PhotoDNA: Leading the fight against child sexual abuse imagery. https://www.thorn.org/blog/photodna-leads-fight-against-child-sex-abuse-imagery/
TikTok 2022. Privacy policy. https://www.tiktok.com/legal/privacy-policy
TikTok 2021. Community guidelines enforcement report: July 1, 2020 – December 31, 2020. https://www.tiktok.com/safety/resources/transparency-report-2020-2
Titcomb J 2019. Snapchat adds end-to-end encryption to protect users’ messages. The Telegraph, 10 January. https://www.telegraph.co.uk/technology/2019/01/09/snapchat-adds-end-to-end-encryption-protect-users-messages/
Twitter 2021a. Rules enforcement Jan–Jun 2020. https://transparency.twitter.com/en/reports/rules-enforcement.html#2020-jan-jun
Twitter 2021b. Rules enforcement Jul–Dec 2020. https://transparency.twitter.com/en/reports/rules-enforcement.html#2020-jul-dec
Vincent J 2018. Skype starts testing new ‘private conversations’ with end-to-end encryption. The Verge, 11 January. https://www.theverge.com/2018/1/11/16878596/microsoft-skype-end-to-end-encryption-private-conversations
Wakefield J 2021. Apple delays plan to scan iPhones for child abuse. BBC News, 3 September. https://www.bbc.com/news/technology-58433647
WeProtect Global Alliance 2019. Global threat assessment 2019. London: WeProtect Global Alliance. https://www.weprotect.org/issue/global-threat-assessment/
WhatsApp 2021. How WhatsApp helps fight child exploitation. https://faq.whatsapp.com/general/how-whatsapp-helps-fight-child-exploitation/
WhatsApp 2020. Two billion users – Connecting the world privately. https://blog.whatsapp.com/two-billion-users-connecting-the-world-privately