Five Key Questions to Ask Before Purchasing AI-Powered Educational Technology

Image credit: Pexels

 

Table of content

• Which Educational Problem Does the Product Solve?
• Is There Evidence That the Product Works?
• Were educators involved in the development of the product?
• What Educational Beliefs Shape This Product?
• Does the Product Level the Playing Field?

 

Emerging technologies often promise transformative impacts on education, and generative artificial intelligence (GenAI) is the latest innovation to enter this space. Advocates, such as Khan Academy’s founder, suggest that AI could herald one of the most significant positive shifts in educational history. However, history shows that educational technology often falls short of its grand promises.

Technologies like mechanical machines, early computers, mobile devices, and massive open online courses (MOOCs) have all faced scrutiny and, in many cases, failed to deliver on their lofty goals.
Given this history, it’s crucial for educators, administrators, parents, and policymakers to ask informed questions before investing in any new AI-driven educational product. Here are five essential questions to consider, grounded in past lessons and aimed at ensuring that new technologies genuinely benefit learners and educators.

1. Which Educational Problem Does the Product Solve?

 

Confident man typing on laptop while sitting in VR headset. Image: Freepik

 
Before investing in any educational technology, it's vital to determine whether the product addresses a genuine problem within the educational setting or is merely a solution in search of a problem. 
For example, if a product leverages GenAI to answer course-related questions, assess whether this capability solves a specific need or if it is being adopted simply because it is new and available. To make this assessment, schools and universities should conduct thorough needs analyses. These analyses help identify the most pressing concerns and gaps in current educational practices. Without a clear problem to address, new technologies risk being ineffective or irrelevant.

2. Is There Evidence That the Product Works?

 

Image credit: Pexels

 
One of the most critical questions to ask is whether there is compelling evidence that the GenAI product improves educational outcomes. While some argue that policymakers should wait for solid evidence before purchasing, others suggest evaluating the product based on its design and alignment with foundational research.

Since there is no central repository for evaluating educational technologies, it falls to the consumer to assess the product’s effectiveness. Ask vendors for independent, third-party studies and multiple forms of evidence, including peer reviews and primary research. Be cautious of claims that are not supported by substantial data or real-world testing. Understanding what actually happens when the product is used in classrooms is crucial for making an informed decision.

3. Were educators involved in the development of the product?
A common issue with educational technology is a disconnect between what developers create and what educators need. Many products are designed without input from the actual users teachers and students which can lead to features that do not align with real-world classroom challenges.

Inquire about the development process of the product: How were educators and learners involved in its creation? How did their feedback shape the final product? Was the development process inclusive of diverse student populations, considering factors such as age, gender, race, ethnicity, and socioeconomic status? Collaborations between developers and educators can lead to more practical and effective solutions.

4. What Educational Beliefs Shape This Product?

 

Study group of african people. Image: Freepik

 
Educational technology is rarely neutral; it reflects the beliefs, ideologies, and biases of its creators. Therefore, understanding the underlying educational principles that guide a product is essential. 
Ask about the pedagogical framework that supports the product. What types of learning does it encourage or hinder? Seek specifics rather than vague theories of learning. For example, does the product promote collaborative learning, individualized instruction, or experiential learning? Knowing these details helps ensure that the technology aligns with the educational goals and values of the institution.

5. Does the Product Level the Playing Field?
Finally, consider how the product addresses issues of educational equity. Does the technology help bridge gaps between different groups of learners, or does it primarily benefit already successful or privileged students? 

Evaluate whether the product takes an asset-based approach to addressing educational disparities, focusing on building upon students' existing strengths, or a deficit-based approach, which might emphasize remedial aspects. Understanding how the technology impacts various learner groups is crucial for ensuring that it contributes to a fair and inclusive educational environment.

While the potential of GenAI in education is exciting, the history of educational technology teaches us to approach new products with caution and critical evaluation. By asking these five essential questions about the problem the product solves, evidence of its effectiveness, involvement of educators and students in its development, the educational beliefs it reflects, and its impact on equity; schools and universities can make more informed decisions and potentially avoid the pitfalls experienced with past technologies. This careful scrutiny will help ensure that any new AI-powered tools adopted in educational settings truly enhance teaching and learning outcomes.