{"id":8345,"date":"2025-09-25T17:52:51","date_gmt":"2025-09-25T17:52:09","guid":{"rendered":"https:\/\/www.law.georgetown.edu\/tech-institute\/insights\/ai-sycophancy-impacts-harms-questions-2\/"},"modified":"2026-07-16T20:36:19","modified_gmt":"2026-07-16T20:36:19","slug":"ai-companions-harms-to-children","status":"publish","type":"page","link":"https:\/\/www.law.georgetown.edu\/tech-institute\/research-insights\/insights\/ai-companions-harms-to-children\/","title":{"rendered":"AI Companions & Harms to Children"},"content":{"rendered":"

September 25, 2025<\/p>\n

 <\/p>\n

In August, <\/span>Reuters uncovered<\/span><\/a> an internal Meta policy document, establishing governing standards that showed that Meta\u2019s chatbots were allowed to engage in \u201cromantic or sensual\u201d conversations with minors. Further, <\/span>the Washington Post reported<\/span><\/a> that \u201cMeta suppressed research\u201d that \u201cmight have illuminated potential safety risks to children and teens on the company\u2019s virtual reality devices and apps.\u201d<\/span><\/p>\n

Since then, there has been high engagement on the topic from enforcers and policymakers. Senator Josh Hawley (R-MO) <\/span>launched<\/span><\/a> an investigation, <\/span>demanding document productions<\/span><\/a> from Meta following the report. A <\/span>bipartisan group of 44 State Attorneys General wrote a letter to tech companies<\/span><\/a>\u00a0(including Meta, Google, Apple, Microsoft, OpenAI, and Anthropic) warning they would be held accountable for their decisions on child safety. The Federal Trade Commission issued a <\/span>study inquiry<\/span><\/a> into AI chatbots acting as companions. Letters regarding AI were sent by Attorneys General from California and Delaware<\/a>,<\/span> putting <\/span>Open AI “on notice”<\/span><\/a>\u00a0about serious concerns with ChatGPT\u2019s safety.\u00a0<\/span><\/p>\n

Given the quickly moving developments, below is a high level list of interventions that lawmakers and enforcers might consider in the context of legislation or enforcement actions.\u00a0<\/span>
\n<\/span><\/p>\n

    \n
  1. Ban on AI chatbots: <\/b>Prohibiting the deployment of AI chatbots for children.<\/span><\/li>\n
  2. Duty of care: <\/b>Imposing on AI developers a duty of care in the design, deployment, and monitoring of AI systems for minors, analogous to obligations under the <\/span>Kids Online Safety Act<\/span><\/a>.\u00a0<\/span><\/li>\n
  3. Ban on data collection for AI training: <\/b>Banning the monetization of data collected from minors, including for AI training<\/span>.<\/b><\/li>\n
  4. Mandated assessments: <\/b>Requiring regular, formal impact assessments on child safety that are shared with independent auditors and government overseers.\u00a0<\/span><\/li>\n
  5. Whistleblower protections: <\/b>Providing whistleblower protections for employees or contractors who raise concerns about child safety in AI systems.\u00a0<\/span><\/li>\n
  6. Researcher Access & Evaluation: <\/b>Requiring controlled API access to researchers, ensuring oversight, and enabling independent evaluation of child safety risks. We note that key safeguards will be needed to ensure this intervention provides real value to researchers and the public without opening the door to privacy abuses.<\/span><\/li>\n<\/ol>\n

     <\/p>\n

    ***<\/span><\/p>\n

    Stephanie T. Nguyen<\/a> is a Senior Fellow at Georgetown Institute for Technology Law & Policy, Former Chief Technologist at the Federal Trade Commission<\/span><\/p>\n

    Erie Meyer<\/a> is a Senior Fellow at Georgetown Institute for Technology Law & Policy, Former CFPB Chief Technologist<\/span><\/p>\n

    Samuel A.A. Levine is a Senior Fellow at UC Berkeley Center for Consumer Law & Economic Justice, Former Bureau of Consumer Protection Director at the Federal Trade Commission<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"

    September 25, 2025   In August, Reuters uncovered an internal Meta policy document, establishing governing standards that showed that Meta\u2019s chatbots were allowed to engage in \u201cromantic or sensual\u201d conversations […]<\/p>\n","protected":false},"author":18544,"featured_media":0,"parent":7881,"menu_order":17,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_acf_changed":false,"_price":"","_stock":"","_tribe_ticket_header":"","_tribe_default_ticket_provider":"","_tribe_ticket_capacity":"0","_ticket_start_date":"","_ticket_end_date":"","_tribe_ticket_show_description":"","_tribe_ticket_show_not_going":false,"_tribe_ticket_use_global_stock":"","_tribe_ticket_global_stock_level":"","_global_stock_mode":"","_global_stock_cap":"","_tribe_rsvp_for_event":"","_tribe_ticket_going_count":"","_tribe_ticket_not_going_count":"","_tribe_tickets_list":"[]","_tribe_ticket_has_attendee_info_fields":false,"footnotes":"","_tec_slr_enabled":"","_tec_slr_layout":""},"class_list":["post-8345","page","type-page","status-publish","hentry"],"acf":[],"ticketed":false,"_links":{"self":[{"href":"https:\/\/www.law.georgetown.edu\/tech-institute\/wp-json\/wp\/v2\/pages\/8345","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.law.georgetown.edu\/tech-institute\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/www.law.georgetown.edu\/tech-institute\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/www.law.georgetown.edu\/tech-institute\/wp-json\/wp\/v2\/users\/18544"}],"replies":[{"embeddable":true,"href":"https:\/\/www.law.georgetown.edu\/tech-institute\/wp-json\/wp\/v2\/comments?post=8345"}],"version-history":[{"count":8,"href":"https:\/\/www.law.georgetown.edu\/tech-institute\/wp-json\/wp\/v2\/pages\/8345\/revisions"}],"predecessor-version":[{"id":9913,"href":"https:\/\/www.law.georgetown.edu\/tech-institute\/wp-json\/wp\/v2\/pages\/8345\/revisions\/9913"}],"up":[{"embeddable":true,"href":"https:\/\/www.law.georgetown.edu\/tech-institute\/wp-json\/wp\/v2\/pages\/7881"}],"wp:attachment":[{"href":"https:\/\/www.law.georgetown.edu\/tech-institute\/wp-json\/wp\/v2\/media?parent=8345"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}