{"id":11445,"date":"2023-10-03T11:22:44","date_gmt":"2023-10-03T18:22:44","guid":{"rendered":"http:\/\/35.90.209.29\/?p=11445"},"modified":"2025-05-13T10:17:39","modified_gmt":"2025-05-13T17:17:39","slug":"we-used-ai-to-analyze-40-million-family-school-messages-heres-what-we-found","status":"publish","type":"post","link":"https:\/\/talkingpts.org\/blog\/we-used-ai-to-analyze-40-million-family-school-messages-heres-what-we-found\/11445\/","title":{"rendered":"We used AI to analyze 40 million family-school messages. Here\u2019s what we found."},"content":{"rendered":"<p>Written by Leah Walker and Adrienne Luczkow<\/p>\n<p><span style=\"font-weight: 400;\">\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">\u00a0Decades of research have highlighted the importance of family engagement with schools.<sup>1,2<\/sup><\/span><span style=\"font-weight: 400;\">\u00a0The research suggests that the reason that family engagement works to improve student outcomes is that it helps families and schools to co-create more impactful instructional strategies and more inclusive school policies and procedures. This logic is reflected in best practices which recommend that schools and families communicate about student learning and behavior<\/span><span style=\"font-weight: 400;\"><sup>3<\/sup><\/span><span style=\"font-weight: 400;\"> and research has shown the importance of doing so in a positive way.<\/span><span style=\"font-weight: 400;\"><sup>4,5,6<\/sup><\/span><\/p>\n<p><span style=\"font-weight: 400;\">So even though technology has made it easier for parents and families to communicate more often, how well do their conversations cover these important topics in productive ways?\u00a0\u00a0\u00a0<\/span><\/p>\n<p>&nbsp;<\/p>\n<h2><b>How do teachers and families <em>actually<\/em> engage in the real world?<\/b><\/h2>\n<p><span style=\"font-weight: 400;\">As a universal family engagement technology platform, TalkingPoints is uniquely positioned to explore this question by studying how teachers and families actually engage with each other in the real world. We set out to better understand the content of the millions of conversations between educators and families on our platform and share what we learned with educators to help inform their family engagement activities.<\/span><\/p>\n<p>&nbsp;<\/p>\n<h2><b>How we used AI to explore school-home conversation dynamics<\/b><\/h2>\n<p><span style=\"font-weight: 400;\">We analyzed de-identified data consisting of 40,000,000 messages sent on the TalkingPoints platform over a 15-month period. We then used NLP techniques and leveraged machine learning tools to train, test, and ultimately use models specifically designed for sentiment and topic classification. With the help of Google\u2019s AutoML service and well-established repositories like TweetEval, we were able to categorize each of the 40,000,000 according to topic<\/span><span style=\"font-weight: 400;\"> (e.g., academics, behavior, logistics, etc.)<\/span><span style=\"font-weight: 400;\"> and tone (positive or negative).\u00a0\u00a0<\/span><\/p>\n<p>&nbsp;<\/p>\n<h2><b>What we learned from the data<\/b><\/h2>\n<p><span style=\"font-weight: 400;\">The data revealed interesting patterns that can inform recommendations to build and strengthen relationships between educators and families. \u00a0For more, see the <a href=\"https:\/\/learn.talkingpts.org\/research-to-action-recording\">recording of our webinar<\/a><i> Family Engagement: Is more really more? An analysis of quality vs. quantity dynamics in school-family communication<\/i> where we shared some of our findings, and view the webinar <a href=\"https:\/\/learn.talkingpts.org\/hubfs\/pdf\/GUIDE-TalkingPoints-Research-to-Practice-Webinar-Is-More-Really-More.pdf?utm_source=hs_email&amp;utm_medium=email&amp;_hsenc=p2ANqtz--7Xy7KIkQERvnnpToL5dI5AcX8xU0KdC9WUejdRtzopyr340WYDgGAw08EMGmRrlcShNpK\">companion guide<\/a>.<\/span><\/p>\n<p>&nbsp;<\/p>\n<h3><b>Finding 1:<\/b><span style=\"font-weight: 400;\"> Most conversations between teachers and families were about something other than student learning. <\/span><\/h3>\n<p><span style=\"font-weight: 400;\"><strong>More than three out of four messages &#8211; 78% &#8211; discussed logistics<\/strong> (\u201c<\/span><i><span style=\"font-weight: 400;\">The homework is on Google Classroom<\/span><\/i><span style=\"font-weight: 400;\">.\u201d) or were standard replies (\u201c<\/span><i><span style=\"font-weight: 400;\">Thanks for the update.<\/span><\/i><span style=\"font-weight: 400;\">\u201d). Meanwhile, <strong>only eight percent of conversations focused on academics<\/strong>; two percent discussed behavior.\u00a0<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">While sharing logistics information is important for communicating day-to-day information families need, proportionately, the conversations about student learning and classroom engagement are happening far less frequently.\u00a0<\/span><\/li>\n<\/ul>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">On an encouraging note, we found more emphasis on learning and behavior conversations among families with older students. Families with middle and high school children (6th to 12th grades) engaged in many more conversations about academics, homework, and behavior (24% of all messages) compared to similar messages for families with younger learners (11% of all messages).\u00a0 So middle and high school families are discussing learning and behavior at higher levels, which is positive; nevertheless, the low overall percentage reflects room for improvement.<\/span><\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<h3><b>Finding 2: <\/b><span style=\"font-weight: 400;\">Overall, we found a 5:1 ratio of positive to negative messages, which aligns with best practice recommendations for building trust in school-family relationships. <\/span><span style=\"font-weight: 400;\"><strong>The exception to this finding was conversations about student behavior, which were more often negative in tone.<\/strong><\/span><\/h3>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">The conversations about academics, homework, and assessment were largely positive in tone (91% and 87%, respectively).\u00a0<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">By contrast, fewer conversations about behavior and class participation were positive. Only 57% of messages about class participation and 56% about behavior were positive. This may indicate that behavior messages are sent primarily when there is an issue.<\/span><\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<h2><b>Recommendations<\/b><\/h2>\n<p><span style=\"font-weight: 400;\">Based on these findings, we recommend the following to increase emphasis on the high-impact conversation practices that lead to improved student outcomes:\u00a0\u00a0<\/span><\/p>\n<h3><b>Prioritize opportunities to discuss student learning and behavior: <\/b><\/h3>\n<ul>\n<li aria-level=\"1\"><span style=\"font-weight: 400;\">Educators should intentionally connect with each family regularly and consistently to share information about their student\u2019s learning and behavior and to learn more about each student\u2019s needs. In addition, schools should encourage families to initiate conversations with teachers and to share insights about their child\u2019s strengths and struggles. These conversations can help deepen the partnership between school and home and improve student outcomes. <\/span><\/li>\n<\/ul>\n<h3><b>Give praise as often as you can: <\/b><\/h3>\n<ul>\n<li aria-level=\"1\"><span style=\"font-weight: 400;\">Research shows that sharing positive behavior feedback with families helps spark more conversations at home between families and students, which in turn encourages students to feel more motivated and engaged in their learning. Sharing positive messages early and often about student behavior and engagement can help educators build relationships with families and motivate students. Conversely, waiting until there is a problem to communicate behavior updates with a family can work against this virtuous cycle. When a family\u2019s primary communication with their child\u2019s teacher is about behavior problems with their child, it can lead to mistrust and make it more difficult to form an effective partnership.\u00a0<\/span><\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<h2><b>Conclusion<\/b><\/h2>\n<p><span style=\"font-weight: 400;\">As part of our ongoing efforts to support building collaborative relationships between families and schools, we analyzed the more than 40 million messages they have sent to each other and now better understand the character of those conversations.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Inevitably, in any given week or month, teachers will have to communicate some good news, some bad news, some logistical information, and some academic updates. And while the data here can\u2019t reveal what a \u201cgood\u201d message is, it can see if the overall proportion of message type and tone is aligned with what research shows is the most likely to contribute to the outcomes families desire for their children. And it can help identify opportunities to use these conversations to address important behavior and academic progress.<\/span><\/p>\n<p>&nbsp;<\/p>\n<h2><b>Looking ahead<\/b><\/h2>\n<p><span style=\"font-weight: 400;\">Working with our school district partners and with guidance from TalkingPoints advisor and acclaimed Harvard researcher Dr. Karen Mapp, our upcoming research will describe the relationship between these conversation patterns and student outcomes. By collaborating with partners on understanding how communication can improve student outcomes, we will co-create new best practices and share these widely to equip schools and districts with actionable strategies they can use to build strong family-school partnerships.<\/span><\/p>\n<p>&nbsp;<\/p>\n<h4><i><span style=\"font-weight: 400;\">Sources:<\/span><\/i><\/h4>\n<ol>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Henderson, A. T., &amp; Mapp, K. L. (2002). <\/span><i><span style=\"font-weight: 400;\">A New Wave of Evidence: the Impact of School; Family;, and Community Connections on Student Achievement<\/span><\/i><span style=\"font-weight: 400;\">. National Center for family &amp; community connections with schools.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Mapp, K.L., Cuevas, S., Henderson, A., Franco, M.C., Ewert, S. (2022) <\/span><span style=\"font-weight: 400;\">Everyone Wins!: The Evidence for Family-School Partnerships and Implications for Practice.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">National Parent-Teacher Association (2022). <\/span><i><span style=\"font-weight: 400;\">PTA National Standards Overview.<\/span><\/i><span style=\"font-weight: 400;\"> Retrieved from <\/span><a href=\"https:\/\/www.pta.org\/docs\/default-source\/files\/runyourpta\/2022\/national-standards\/standards-overview.pdf\"><span style=\"font-weight: 400;\">https:\/\/www.pta.org\/docs\/default-source\/files\/runyourpta\/2022\/national-standards\/standards-overview.pdf<\/span><\/a><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Ames C., Khoju M., Watkins T. (1993). <\/span><i><span style=\"font-weight: 400;\">Parent involvement: The relationship between school-to-home communication and parents\u2019 perceptions and beliefs<\/span><\/i><span style=\"font-weight: 400;\"> Report No.: 15. Available at: <\/span><a href=\"http:\/\/files.eric.ed.gov\/fulltext\/ED362271.pdf\"><span style=\"font-weight: 400;\">http:\/\/files.eric.ed.gov\/fulltext\/ED362271.pdf<\/span><\/a><span style=\"font-weight: 400;\">.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Kohl G. O., Lengua L. J., McMahon R. J. (2000). Parental involvement in school: conceptualizing multiple dimensions and their relations with family and demographic risk factors. <\/span><i><span style=\"font-weight: 400;\">J. Sch. Psychol.<\/span><\/i><span style=\"font-weight: 400;\"> 38, 501\u2013523. <\/span><a href=\"https:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC2847291\/\"><span style=\"font-weight: 400;\">Pub Med Central<\/span><\/a><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Hoover-Dempsey K. V., Walker J. M. T. (2002). <\/span><i><span style=\"font-weight: 400;\">Family-school communication: A report for the Metropolitan Nashville Public Schools.<\/span><\/i><span style=\"font-weight: 400;\"> (Tennessee: Paper prepared for the Research Committee of the Metropolitan Nashville\/Davidson County Board of Public Education; ). <\/span><a href=\"https:\/\/scholar.google.com\/scholar_lookup?title=Family-school+communication:+A+report+for+the+Metropolitan+Nashville+Public+Schools.&amp;author=K.+V.+Hoover-Dempsey&amp;author=J.+M.+T.+Walker&amp;publication_year=2002&amp;\"><span style=\"font-weight: 400;\">Google Scholar<\/span><\/a><\/li>\n<\/ol>\n<p>&nbsp;<\/p>\n<h5><b>About\u00a0<\/b><b>TalkingPoints<\/b><\/h5>\n<p>TalkingPoints is an education technology nonprofit that drives student success by removing critical barriers to equitable family-school partnerships, such as language, time, mindsets, and capacity. Ten of the country\u2019s twenty largest school districts trust TalkingPoints to create a district culture where all families, no matter their background, can engage with their schools. Our simple, intuitive family engagement platform offers the highest-quality human- and AI-powered two-way translated communication available \u2014 in 150 languages and counting. Named by\u00a0<a href=\"https:\/\/www.commonsense.org\/education\/best-in-class\/the-best-family-communication-platforms-for-teachers-and-schools\">Common Sense Education<\/a>\u00a0as \u201cthe best overall family communication platform for teachers and schools\u201d, TalkingPoints leads to higher test scores and lower absenteeism, as shown by\u00a0<a href=\"https:\/\/talkingpts.org\/blog\/higher-scores-lower-absenteeism-read-the-research\/10444\/\">rigorous causal research<\/a>\u00a0that meets the ESSA Tier 2 standard of evidence. To learn more, view our\u00a0<a href=\"https:\/\/www.ted.com\/talks\/heejae_lim_the_most_powerful_yet_overlooked_resource_in_schools\">TED Talk<\/a>\u00a0or visit\u00a0<a href=\"https:\/\/talkingpts.org\/\">talkingpts.org<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Written by Leah Walker and Adrienne Luczkow \u00a0 \u00a0Decades of research have highlighted the importance of family engagement with schools.1,2\u00a0The research suggests that the reason that family engagement works to [&hellip;]<\/p>\n","protected":false},"author":55,"featured_media":11491,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"content-type":"","inline_featured_image":false,"_daextam_enable_autolinks":"","_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"categories":[11],"tags":[163],"class_list":["post-11445","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-blog","tag-featured"],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/talkingpts.org\/wp-json\/wp\/v2\/posts\/11445","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/talkingpts.org\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/talkingpts.org\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/talkingpts.org\/wp-json\/wp\/v2\/users\/55"}],"replies":[{"embeddable":true,"href":"https:\/\/talkingpts.org\/wp-json\/wp\/v2\/comments?post=11445"}],"version-history":[{"count":0,"href":"https:\/\/talkingpts.org\/wp-json\/wp\/v2\/posts\/11445\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/talkingpts.org\/wp-json\/wp\/v2\/media\/11491"}],"wp:attachment":[{"href":"https:\/\/talkingpts.org\/wp-json\/wp\/v2\/media?parent=11445"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/talkingpts.org\/wp-json\/wp\/v2\/categories?post=11445"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/talkingpts.org\/wp-json\/wp\/v2\/tags?post=11445"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}