[论文解读] Understanding Parents' Desires in Moderating Children's Interactions with GenAI Chatbots through LLM-Generated Probes

John Driscoll, Yulin Chen+4 more|arXiv (Cornell University)|Mar 4, 2026

AI in Service Interactions被引用 0

一句话总结

该论文研究父母希望如何对儿童与 GenAI 聊天机器人互动进行适度监管，利用 LLM 生成的情景来引出24位父母的担忧、监管偏好和透明度需求。

ABSTRACT

This paper studies how parents want to moderate children's interactions with Generative AI chatbots, with the goal of informing the design of future GenAI parental control tools. We first used an LLM to generate synthetic child-GenAI chatbot interaction scenarios and worked with four parents to validate their realism. From this dataset, we carefully selected 12 diverse examples that evoked varying levels of concern and were rated the most realistic. Each example included a prompt and a GenAI chatbot response. We presented these to parents (N=24) and asked whether they found them concerning, why, and how they would prefer the responses to be modified and communicated. Our findings reveal three key insights: (1) parents express concern about interactions that current GenAI chatbot parental controls neglect; (2) parents want fine-grained transparency and moderation at the conversation level; and (3) parents need personalized controls that adapt to their desired strategies and children's ages.

研究动机与目标

• 识别在儿童–GenAI 聊天机器人互动中触发父母担忧的因素。
• 了解父母希望对年龄相符、安全与价值观一致的互动进行的监管策略。
• 描述父母的透明度偏好以及他们希望如何参与。

提出的方法

• 用 LLM 生成合成的儿童–GenAI 聊天机器人互动情景，并与父母一起验证 realism。
• 通过迭代筛选和父母验证，选择多样化情景集合。
• 对 24 位父母进行半结构化访谈，使用选定的 12 个情景， eliciting concerns、moderation needs 和 transparency preferences。
• 对访谈文本进行主题分析，提取高级主题。

Figure 1 . We ➀ presented 12 simulated GenAI Chatbot scenarios to 24 parents and ➁ asked whether they found them concerning, why, and how they would prefer to modify the responses and be informed. Our analysis identifies the factors parents found concerning which includes ➂ types of questionable res

实验结果

研究问题

• RQ1 RQ1: 在儿童–GenAI 聊天机器人互动中，哪些因素会引发父母的担忧？
• RQ2 RQ2: 父母希望如何对孩子与 GenAI 聊天机器人互动进行监管？
• RQ3 RQ3: 父母在孩子与 GenAI 聊天机器人互动中的透明度偏好是什么？

主要发现

• 父母的担忧集中在两组：可疑的 GenAI 聊天机器人响应和可疑的孩子提示。
• 父母希望实现细粒度、对话层面的监管，目标包括使用适龄语言、纠正误解、并在需要时转介给人工支持。
• 透明度偏好聚焦于参与和数据-内容访问，许多父母希望对被标记的活动有实时警报。
• 父母寻求个性化、符合发展阶段的监管，能够随孩子年龄和家庭价值观进行调整。
• 访谈表明聊天机器人应作为调解者，支持父母在安全与发展方面的持续角色。

Figure 2 . Our study procedure. We design, generate, select, and present realistic scenarios to parents as probes in semi-structured interviews, then analyze parents’ responses.