Understanding Edtech Vulnerabilities

“HIPAA doesn’t apply to public schools.” That line has misled EdTech teams, confused school leaders, and put student data at risk for over two decades. It’s true that FERPA usually governs student records in K–12. But here’s what most people miss: HIPAA still matters, especially when schools use third-party platforms to handle health-related data. From school-based telehealth to IEP services to student mental health screening tools, the line between educational records and medical records is blurrier than ever. And when the wrong line gets crossed? It’s not just a compliance issue. It’s a breach. Here’s what I tell EdTech companies and school leaders: - Understand which privacy law governs each data set (there are many permutations of who owns and governs the data) - Avoid assuming FERPA coverage is a catch-all (again think of all the permutations in this hyper-connected, thirty-party platform driven world) - Build governance into your products and partnerships - Train teams on real-world data-sharing risks, not just legal theory Because when student privacy is mishandled, it’s not just trust that erodes. It’s the entire foundation of the EdTech ecosystem. #EdTech #FERPA #HIPPA #AIGovernance #StudentPrivacy

AI is revolutionizing education, offering tools that personalize learning and break down barriers. But with great power comes great responsibility. Let’s unpack the ethical challenges facing AI-EdTech: → Algorithmic Transparency How does AI decide which student gets which resources? Companies must ensure transparency, enabling educators and learners to understand and trust the system. → Combating Algorithmic Bias AI learns from data, but data isn’t always neutral. To prevent discrimination, algorithms need regular audits and updates. Equity isn’t optional—it’s essential. → Data Privacy & Security Student data is sensitive. From complying with regulations to protecting against breaches, EdTech companies must make privacy a top priority. Clear communication about data usage builds trust. → Balancing Profit with Purpose Profitability drives innovation, but it should never overshadow the mission to educate. Purpose-driven innovation focuses on solving real challenges, not just riding the AI wave. → Engaging Stakeholders Teachers and students know the classroom best. Collaborating with them ensures AI tools meet genuine needs while maintaining ethical integrity. → Navigating Regulatory Challenges The laws governing AI in education are still catching up. Companies should advocate for clear, ethical guidelines while proactively ensuring compliance. The bottom line? Corporate responsibility in AI-EdTech isn’t just good PR—it’s a necessity. By aligning profit with purpose, we can create tools that truly serve learners, uphold ethical standards, and build a future where education and innovation thrive together. The Bertrand Education Group (B.E.G) What are your thoughts on balancing ethics and business in AI-EdTech? Let’s discuss!

Good guidance from the U.S. Department of Education to developers of education technology; focus on shared responsibility, managing risks, and bias mitigation. 🛡️ One think I really like about this document is the use-case specific guidance and examples (clearly there were industry contributors that helped facilitate that). 🎓 Key Guidance for Developers of AI in Education -------------------------------------------------- 🔍 Build Trust: Collaborate with educators, students, and stakeholders to ensure fairness, transparency, and privacy in AI systems. 🛡️ Manage Risks: Identify and mitigate risks like algorithmic bias, data privacy issues, and potential harm to underserved communities. 📊 Show Evidence: Use evidence-based practices to prove your system's impact, including testing for equitable outcomes across diverse groups. ⚖️ Advance Equity: Address discrimination risks, ensure accessibility, and comply with civil rights laws. 🔒 Ensure Safety: Protect data, prevent harmful content, and uphold civil liberties. 💡 Promote Transparency: Communicate clearly about how AI works, its limitations, and its risks. 🤝 Embed Ethics: Incorporate human-centered design and accountability throughout development, ensuring educators and students are part of the process. BABL AI has done a lot of work in the edtech space, and I can see an opportunity for us to provide assurance that some of these guidelines are being followed by companies. #edtech #AIinEducation #aiassurance Khoa Lam, Jeffery Recker, Bryan Ilg, Jovana Davidovic, Ali Hasan, Borhane Blili-Hamelin, PhD, Navrina Singh, GoGuardian, Khan Academy, TeachFX, EDSAFE AI Alliance, Patrick Sullivan

There are already hundreds of new Generative AI Edtech companies and products on the market. Some great, some terrible and many in-between. So how can you vet GenAI EdTech companies to ensure that their product is safe, reliable, effective, and fit-for-purpose? To help we've put together our Top Six Questions to guide these conversations. You can download the PDF version and get the reasons "why" for each questions at this link: bit.ly/3qnP0ma. 1️⃣ We know that generative AI (GenAI) is a new technology with extensive limitations. How does your product indicate when it's uncertain or requires human review? What controls do you have in place to identify and lower hallucinations?   2️⃣ It’s important that the tools we use do not cause harm to our students or teachers. What steps are you taking to identify and mitigate biases in your AI models? How will you ensure fair and unbiased outputs? 3️⃣ Protecting student data privacy and ensuring ethical use of data is a top priority for our school. What policies and safeguards can you share to address these concerns? 4️⃣ Our educators need to validate and trust AI-generated content before use. What human oversight and quality control measures do you use? How do you ensure feedback from teachers/students is being collected and actioned? 5️⃣  We need evidence that your AI tool will improve learning outcomes for our student population and/or effectively support our teachers. Can you provide examples, metrics and/or case studies of positive impact in similar settings? 6️⃣ : Our school needs to accommodate diverse learners and varying technical skills among staff. How does your tool ensure accessibility and usability for all our students and staff? What PD is available? AI for Education #genai #edtech #aiforeducation #schoolleaders #AI