In This Section
Cultivating AI-Literate Researchers
Summer Course Bridges Evidence Synthesis and Emerging Technologies
By Sarah Bender
- Associate Dean of Marketing and Communications, MCS
- Email opdyke@andrew.cmu.edu
- Phone 412-268-9982
It鈥檚 no secret that academic research increasingly includes the use of AI.
AI tools like and can be useful when exploring and synthesizing existing research, and using algorithms to work with data can automate repetitive tasks and increase efficiency. Generative AI can aid in brainstorming, organizing and editing.
But research about AI literacy and its impact on education is an emerging area, and it鈥檚 rapidly evolving. When Libraries AI specialist and STEM Librarian offered his first interdisciplinary research course in summer 2025, this was the topic he wanted to give his students the chance to explore.
鈥淚 designed my course to help undergraduates cultivate their identities as researchers, while encouraging them to develop the AI literacy skills they鈥檒l need to succeed in today鈥檚 world,鈥 Lan explained. 鈥淭hrough conducting real-world, cutting-edge, interdisciplinary research, I wanted students to learn to assess and contribute to a conversation that will be increasingly relevant to them both academically and professionally.鈥
Core Literacies
Each Wednesday of the nine-week course, 22 students met virtually to dive into existing research and think about the direction of their own investigations. For many, it marked the first time they had considered AI beyond its technical foundations, thinking about responsible use rather than writing code or building models.
鈥淚 was not familiar with the term 鈥楢I literacy鈥 before the course,鈥 said Dietrich College of Humanities and Social Sciences junior Rachel Quaye-Asamoah, who is majoring in Statistics & Machine Learning. 鈥淏ut I had found my peers increasingly relying on LLM technology (like OpenAI's ChatGPT, Google's Gemini, and DeepSeek) the semester prior, so the concept was something I was interested in.鈥
After sharing the basics of AI literacy, Lan invited his class to begin developing their own relevant research questions. They identified topics like how generative AI affects academic integrity, how universities should craft policies around AI use, and what ethical considerations are missing from current undergraduate education.
To explore these questions in the context of recent studies about AI literacy, Lan then introduced the evidence synthesis methodology. This is a comprehensive and systematic way of gathering, screening, and synthesizing existing literature to answer a research question and identify research gaps.
鈥淭he course helped me understand that systematic reviews are very important for understanding gaps in certain topics,鈥 Quaye-Asamoah explained. 鈥淭his kind of scoping review was very, very fun for me, and I would love to do more in the field, especially topics that bridge the gap between something as technical as generative AI or computer engineering and the humanities, like children's education or maybe even history.鈥
鈥淓vidence synthesis is conclusive, comprehensive and unbiased,鈥 Lan added. 鈥淚t鈥檚 used every day by policy makers, as well as researchers in social and health sciences 鈥 regardless of discipline, it鈥檚 a very sought-after skill.鈥
Moving Research Forward
For their final project, one group focused on the question: 鈥淗ow does the knowledge of successful prompt engineering affect information-seeking behavior and conceptual understanding for undergraduate students?鈥
鈥淲e were really interested in this topic, and found two major outcomes,鈥 said Mellon College of Science junior Allison Ma, who is majoring in Mathematical Sciences. 鈥淔irst, the most successful strategy for prompting a generative AI agent is to use a single sentence to summarize your question.鈥
Research revealed that other methods, like copying and pasting a longer question from a homework assignment or sharing a list of related questions, led to a lower level of conceptual understanding in undergraduate students. In other words, simpler, more focused prompts result in deeper learning.
Her group also found a gap in the literature about the relationship between successful prompt engineering and information-seeking behavior in undergraduate students. 鈥淭his could be a future research topic,鈥 she explained.
Like Ma鈥檚 team, Quaye-Asamoah and her group found a gap as well 鈥 they explored how generative AI affects undergraduate creativity and problem-solving in fields like computer science and computer engineering and learned that more work needs to be done in order to reveal the full impact the technology has on undergraduate education.
Lan predicts that the field will keep evolving as more researchers complete studies 鈥 and he鈥檚 planning to teach his course again in the future to keep up with the most recent literature.
鈥淐ollaborating with the Office of the Vice Provost for Education on this course was a rewarding experience for me, and I know it was rewarding for the students as well,鈥 he said. 鈥淭hey went from knowing nothing about evidence synthesis review methodologies to being confident about leading an evidence synthesis project team. It鈥檚 exciting to see students become emerging scholars in such a short time, and in such a critical field.鈥