Gerald Ajam

Library / Glossary / The craft glossary

AI in learning products glossary

44 terms from R16, AI in learning products — 19 defined in the guide itself and 25 more from the field around it. Every term the guide teaches links to the slide that teaches it.

The whole craft glossary

R16 · How to improve

AI in learning products

Where does AI help learning, and how do we know?

Every term below is defined in the words of ai in learning products, guide R16 of craft guides for educational technologists, and opens the guide at the slide where it is taught. 25 of the 44 are the field’s vocabulary rather than the guide’s own: words a reader will meet around this subject, defined here because the guide assumes them. 1 term is also defined by another guide in the series; where the two differ, both wordings are given. The whole craft glossary holds all of them together.

TermDefinitionReferred to inRead further
A
Adaptive learning

Software that changes the content, difficulty or order of tasks for each student according to a running estimate of what that student knows.

  • R16AI in learning productsFrom the field · not in the guide
  • U.S. Department of Education, Office of Educational Technology. (2023). Artificial intelligence and the future of teaching and learning: Insights and recommendations. files.eric.ed.gov
  • OECD. (2026). OECD digital education outlook 2026: Exploring effective uses of generative AI in education. OECD Publishing. doi
AI agent

A system in which a model plans and carries out a multi-step task by calling tools such as search, code or other software, with limited human direction.

  • R16AI in learning productsFrom the field · not in the guide
  • Russell, S., & Norvig, P. (2021). Artificial intelligence: A modern approach (4th ed.). Pearson. doi
AI literacy

The knowledge and skills that let people understand what AI systems do, use them well and judge their output critically.

  • R16AI in learning productsFrom the field · not in the guide
  • Miao, F., & Holmes, W. (2023). Guidance for generative AI in education and research. UNESCO. unesco.org
  • Long, D., & Magerko, B. (2020). What is AI literacy? Competencies and design considerations. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, 1–16. doi
AI Risk Management Framework

The US National Institute of Standards and Technology's framework, which organises AI risk work into four functions: govern, map, measure and manage (National Institute of Standards and Technology, 2023).

  • National Institute of Standards and Technology. (2023). Artificial intelligence risk management framework (AI RMF 1.0) (NIST AI 100-1). U.S. Department of Commerce. doi
  • National Institute of Standards and Technology. (2024). Artificial intelligence risk management framework: Generative artificial intelligence profile (NIST AI 600-1). U.S. Department of Commerce. doi
AI-writing detector

A tool that labels text as human- or AI-written; seven detectors wrongly flagged most essays by non-native English writers, so a flag is a reason for a conversation, never proof (Liang et al., 2023).

  • Liang, W., Yuksekgonul, M., Mao, Y., Wu, E., & Zou, J. (2023). GPT detectors are biased against non-native English writers. Patterns, 4(7), Article 100779. doi
Algorithmic bias

Systematic differences in how well an automated system works for different groups of people, such as a marking model that is less accurate for some students than others.

  • R16AI in learning productsFrom the field · not in the guide
  • National Institute of Standards and Technology. (2023). Artificial intelligence risk management framework (AI RMF 1.0) (NIST AI 100-1). U.S. Department of Commerce. doi
  • Baker, R. S., & Hawn, A. (2022). Algorithmic bias in education. International Journal of Artificial Intelligence in Education, 32(4), 1052–1092. doi
Automated essay scoring

Software that assigns a mark to a piece of extended writing, using a model trained on essays that people have already marked.

  • R16AI in learning productsFrom the field · not in the guide
  • Shermis, M. D., & Burstein, J. (Eds.). (2013). Handbook of automated essay evaluation: Current applications and new directions. Routledge.
Automation bias

The tendency to accept an automated system's output without checking it, even when other evidence contradicts it. It weakens human review of AI decisions.

  • R16AI in learning productsFrom the field · not in the guide
  • Parasuraman, R., & Manzey, D. H. (2010). Complacency and bias in human use of automation: An attentional integration. Human Factors, 52(3), 381–410. doi
B
Benchmark

A public, standard test of a model's general ability. Useful for comparing models, weak evidence about a specific classroom task.

  • National Institute of Standards and Technology. (2024). Artificial intelligence risk management framework: Generative artificial intelligence profile (NIST AI 600-1). U.S. Department of Commerce. doi
C
Cognitive offloading

Using an action or tool to reduce the thinking a task demands (Risko & Gilbert, 2016).

  • Risko, E. F., & Gilbert, S. J. (2016). Cognitive offloading. Trends in Cognitive Sciences, 20(9), 676–688. doi
  • Cash, T. N., Kelly, M. O., Macnamara, B. N., & Risko, E. F. (2026). Is AI making us stupid? Trends in Cognitive Sciences, 30(8), 673–675. doi
  • Gerlich, M. (2025). AI tools in society: Impacts on cognitive offloading and the future of critical thinking. Societies, 15(1), Article 6. doi
Confabulation

Confident but false content produced by a generative model, often called hallucination (National Institute of Standards and Technology, 2024).

  • National Institute of Standards and Technology. (2024). Artificial intelligence risk management framework: Generative artificial intelligence profile (NIST AI 600-1). U.S. Department of Commerce. doi
  • Ji, Z., Lee, N., Frieske, R., Yu, T., Su, D., Xu, Y., Ishii, E., Bang, Y. J., Madotto, A., & Fung, P. (2023). Survey of hallucination in natural language generation. ACM Computing Surveys, 55(12), Article 248. doi
Context window

The most text, counted in tokens, that a model can take into account at once, including the prompt, any supplied documents and its own reply.

  • R16AI in learning productsFrom the field · not in the guide
    D
    Deep learning

    Machine learning with neural networks of many layers, each layer building more abstract features from the one before. It underlies modern speech, image and language models.

    • R16AI in learning productsFrom the field · not in the guide
    • LeCun, Y., Bengio, Y., & Hinton, G. (2015). Deep learning. Nature, 521(7553), 436–444. doi
    E
    Effect size

    The size of a difference between groups, often in standard deviations. Comparable only when tests and comparison groups are similar.

    R18 The size of a difference or relationship, in raw units or standardised against the spread.

    R21 A difference between groups expressed in standard deviations, so results from different tests can be compared.

    • von Hippel, P. T. (2024). Two-sigma tutoring: Separating science fiction from science fact. Education Next, 24(2). educationnext.org
    • Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Lawrence Erlbaum Associates.
    • Kraft, M. A., Blazar, D., & Hogan, D. (2018). The effect of teacher coaching on instruction and achievement: A meta-analysis of the causal evidence. Review of Educational Research, 88(4), 547–588. doi
    Embedding

    A list of numbers that represents a piece of text, an image or another item so that items with similar meaning sit close together. It is the basis of semantic search.

    • R16AI in learning productsFrom the field · not in the guide
    • Pennington, J., Socher, R., & Manning, C. D. (2014). GloVe: Global vectors for word representation. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), 1532–1543. doi
    EU AI Act

    The European Union's 2024 regulation laying down harmonised rules on artificial intelligence, which lists systems used to evaluate learning outcomes among high-risk uses (European Union, 2024).

    • European Union. (2024). Regulation (EU) 2024/1689 of the European Parliament and of the Council of 13 June 2024 laying down harmonised rules on artificial intelligence (Artificial Intelligence Act). Official Journal of the European Union, L 2024/1689. eur-lex.europa.eu
    • Council of the European Union. (2026, June 29). Artificial intelligence: Council gives final green light to simplify and streamline rules [Press release]. consilium.europa.eu
    Evaluation set

    A fixed collection of real tasks with agreed answers, used to test a feature each time the model or prompt changes.

    • National Institute of Standards and Technology. (2024). Artificial intelligence risk management framework: Generative artificial intelligence profile (NIST AI 600-1). U.S. Department of Commerce. doi
    • Department for Education. (2026). Generative AI: Product safety standards (Updated January 19, 2026). GOV.UK. gov.uk
    Explainability

    How far a system can give reasons for an output that the people affected can understand and check.

    • R16AI in learning productsFrom the field · not in the guide
    • National Institute of Standards and Technology. (2023). Artificial intelligence risk management framework (AI RMF 1.0) (NIST AI 100-1). U.S. Department of Commerce. doi
    • Khosravi, H., Shum, S. B., Chen, G., Conati, C., Tsai, Y.-S., Kay, J., Knight, S., Martinez-Maldonado, R., Sadiq, S., & Gašević, D. (2022). Explainable artificial intelligence in education. Computers and Education: Artificial Intelligence, 3, Article 100074. doi
    F
    Fine-tuning

    Further training of an already-trained model on a smaller, specific dataset so that it performs better on a particular task or in a particular style.

    • R16AI in learning productsFrom the field · not in the guide
    • Howard, J., & Ruder, S. (2018). Universal language model fine-tuning for text classification. Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 328–339. doi
    Foundation model

    A large model trained on broad data that can be adapted to many tasks, and on which many separate products are built.

    • R16AI in learning productsFrom the field · not in the guide
    • National Institute of Standards and Technology. (2024). Artificial intelligence risk management framework: Generative artificial intelligence profile (NIST AI 600-1). U.S. Department of Commerce. doi
    • Bommasani, R., Hudson, D. A., Adeli, E., Altman, R., Arora, S., von Arx, S., Bernstein, M. S., Bohg, J., Bosselut, A., Brunskill, E., Brynjolfsson, E., Buch, S., Card, D., Castellon, R., Chatterji, N., Chen, A., Creel, K., Davis, J. Q., Demszky, D., … Liang, P. (2021). On the opportunities and risks of foundation models [Preprint]. arXiv. doi
    G
    Generative AI

    AI that produces new text, images, audio or code in response to a prompt, by modelling patterns in the data it was trained on.

    • R16AI in learning productsFrom the field · not in the guide
    • Miao, F., & Holmes, W. (2023). Guidance for generative AI in education and research. UNESCO. unesco.org
    • National Institute of Standards and Technology. (2024). Artificial intelligence risk management framework: Generative artificial intelligence profile (NIST AI 600-1). U.S. Department of Commerce. doi
    Grounding

    Making a model answer from specific supplied material, so its answers can be traced and checked.

    • Kestin, G., Miller, K., Klales, A., Milbourne, T., & Ponti, G. (2025). AI tutoring outperforms in-class active learning: An RCT introducing a novel research-based design in an authentic educational setting. Scientific Reports, 15, Article 17458. doi
    • Lewis, P., Perez, E., Piktus, A., Petroni, F., Karpukhin, V., Goyal, N., Küttler, H., Lewis, M., Yih, W., Rocktäschel, T., Riedel, S., & Kiela, D. (2020). Retrieval-augmented generation for knowledge-intensive NLP tasks. Advances in Neural Information Processing Systems, 33.
    Guardrail

    A rule built into a product that limits what the model will do, such as refusing to give a full solution before an attempt.

    • Bastani, H., Bastani, O., Sungu, A., Ge, H., Kabakcı, Ö., & Mariman, R. (2025). Generative AI without guardrails can harm learning: Evidence from high school mathematics. Proceedings of the National Academy of Sciences, 122(26), Article e2422633122. doi
    • Department for Education. (2026). Generative AI: Product safety standards (Updated January 19, 2026). GOV.UK. gov.uk
    H
    High-risk AI system

    Under the EU AI Act, a system in a listed use, including evaluating learning outcomes, that carries extra obligations (European Union, 2024).

    • European Union. (2024). Regulation (EU) 2024/1689 of the European Parliament and of the Council of 13 June 2024 laying down harmonised rules on artificial intelligence (Artificial Intelligence Act). Official Journal of the European Union, L 2024/1689. eur-lex.europa.eu
    • Council of the European Union. (2026, June 29). Artificial intelligence: Council gives final green light to simplify and streamline rules [Press release]. consilium.europa.eu
    Human in the loop

    A design in which a person can see, question and override an AI system's output (U.S. Department of Education, 2023).

    • U.S. Department of Education, Office of Educational Technology. (2023). Artificial intelligence and the future of teaching and learning: Insights and recommendations. files.eric.ed.gov
    • Wang, R. E., Ribeiro, A. T., Robinson, C. D., Loeb, S., & Demszky, D. (2024). Tutor CoPilot: A human-AI approach for scaling real-time expertise [Preprint]. arXiv. doi
    I
    Inference

    Running a trained model to produce an output, as distinct from training it. Every response a student receives is one inference, with its own cost and delay.

    • R16AI in learning productsFrom the field · not in the guide
      Intelligent tutoring system

      Software that guides a learner step by step and adapts to their responses. It predates generative AI (VanLehn, 2011).

      • VanLehn, K. (2011). The relative effectiveness of human tutoring, intelligent tutoring systems, and other tutoring systems. Educational Psychologist, 46(4), 197–221. doi
      • Anderson, J. R., Corbett, A. T., Koedinger, K. R., & Pelletier, R. (1995). Cognitive tutors: Lessons learned. Journal of the Learning Sciences, 4(2), 167–207. doi
      K
      Knowledge tracing

      Estimating, from a student's sequence of right and wrong answers, the probability that they have mastered each skill. Adaptive systems use it to choose the next task.

      • R16AI in learning productsFrom the field · not in the guide
      • Corbett, A. T., & Anderson, J. R. (1994). Knowledge tracing: Modeling the acquisition of procedural knowledge. User Modeling and User-Adapted Interaction, 4(4), 253–278. doi
      L
      Large language model (LLM)

      A neural network trained on very large amounts of text to predict the next token, which lets it generate, summarise and transform language on request.

      • R16AI in learning productsFrom the field · not in the guide
      • Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021). On the dangers of stochastic parrots: Can language models be too big? Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency, 610–623. doi
      • Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., Krusche, S., Kutyniok, G., Michaeli, T., Nerdel, C., Pfeffer, J., Poquet, O., Sailer, M., Schmidt, A., Seidel, T., … Kasneci, G. (2023). ChatGPT for good? On opportunities and challenges of large language models for education. Learning and Individual Differences, 103, Article 102274. doi
      M
      Machine learning

      Building systems that learn patterns from examples instead of following rules written by hand. Most current AI, including generative AI, is machine learning.

      • R16AI in learning productsFrom the field · not in the guide
      • Jordan, M. I., & Mitchell, T. M. (2015). Machine learning: Trends, perspectives, and prospects. Science, 349(6245), 255–260. doi
      Model card

      A short document published with a model that states its intended uses, its limits and how it performed for different groups of people.

      • R16AI in learning productsFrom the field · not in the guide
      • Mitchell, M., Wu, S., Zaldivar, A., Barnes, P., Vasserman, L., Hutchinson, B., Spitzer, E., Raji, I. D., & Gebru, T. (2019). Model cards for model reporting. Proceedings of the Conference on Fairness, Accountability, and Transparency, 220–229. doi
      P
      Productive failure

      A design in which students attempt problems before instruction, and learn from the attempt (Kapur, 2008).

      • Kapur, M. (2008). Productive failure. Cognition and Instruction, 26(3), 379–424. doi
      • Sinha, T., & Kapur, M. (2021). When problem solving followed by instruction works: Evidence for productive failure. Review of Educational Research, 91(5), 761–798. doi
      Productive struggle

      Effort on the thinking a lesson exists to build, as distinct from effort wasted on confusion.

      • Kapur, M. (2008). Productive failure. Cognition and Instruction, 26(3), 379–424. doi
      • Sinha, T., & Kapur, M. (2021). When problem solving followed by instruction works: Evidence for productive failure. Review of Educational Research, 91(5), 761–798. doi
      • Ministry of Education, Singapore. (2026). Artificial intelligence in education (Last updated July 31, 2026). moe.gov.sg
      Progressive disclosure

      Giving help in increasing steps, with a full solution last and only after an attempt.

      • Department for Education. (2026). Generative AI: Product safety standards (Updated January 19, 2026). GOV.UK. gov.uk
      • Bastani, H., Bastani, O., Sungu, A., Ge, H., Kabakcı, Ö., & Mariman, R. (2025). Generative AI without guardrails can harm learning: Evidence from high school mathematics. Proceedings of the National Academy of Sciences, 122(26), Article e2422633122. doi
      Prompt

      The instruction and material given to a generative model as input. The model's output depends on it, so wording, examples and supplied context all matter.

      • R16AI in learning productsFrom the field · not in the guide
      • Liu, P., Yuan, W., Fu, J., Jiang, Z., Hayashi, H., & Neubig, G. (2023). Pre-train, prompt, and predict: A systematic survey of prompting methods in natural language processing. ACM Computing Surveys, 55(9), Article 195. doi
      R
      Red-teaming

      Deliberately trying to make a system fail or behave unsafely, to find problems before users do.

      • National Institute of Standards and Technology. (2024). Artificial intelligence risk management framework: Generative artificial intelligence profile (NIST AI 600-1). U.S. Department of Commerce. doi
      • Department for Education. (2026). Generative AI: Product safety standards (Updated January 19, 2026). GOV.UK. gov.uk
      Reinforcement learning from human feedback (RLHF)

      A training stage in which people rate or rank a model's outputs and the model is adjusted towards the responses they prefer. It is how chat assistants are made helpful and polite.

      • R16AI in learning productsFrom the field · not in the guide
      • Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C. L., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., Schulman, J., Hilton, J., Kelton, F., Miller, L., Simens, M., Askell, A., Welinder, P., Christiano, P., Leike, J., & Lowe, R. (2022). Training language models to follow instructions with human feedback. Advances in Neural Information Processing Systems, 35, 27730–27744. doi
      Retrieval

      Finding passages in an approved library and passing them to a model with the question, a common way to ground answers.

      • Lewis, P., Perez, E., Piktus, A., Petroni, F., Karpukhin, V., Goyal, N., Küttler, H., Lewis, M., Yih, W., Rocktäschel, T., Riedel, S., & Kiela, D. (2020). Retrieval-augmented generation for knowledge-intensive NLP tasks. Advances in Neural Information Processing Systems, 33.
      Retrieval-augmented generation (RAG)

      A design in which the system first searches a chosen collection of documents and then passes the passages it finds to the model to answer from.

      • R16AI in learning productsFrom the field · not in the guide
      • Lewis, P., Perez, E., Piktus, A., Petroni, F., Karpukhin, V., Goyal, N., Küttler, H., Lewis, M., Yih, W., Rocktäschel, T., Riedel, S., & Kiela, D. (2020). Retrieval-augmented generation for knowledge-intensive NLP tasks. Advances in Neural Information Processing Systems, 33, 9459–9474.
      S
      System prompt

      Standing instructions set by a product's developer, usually hidden from the user, that fix the model's role, tone and limits in every conversation.

      • R16AI in learning productsFrom the field · not in the guide
        T
        Token

        The unit of text a language model reads and writes, typically a word or a fragment of one. Context limits and usage prices are counted in tokens.

        • R16AI in learning productsFrom the field · not in the guide
        • Sennrich, R., Haddow, B., & Birch, A. (2016). Neural machine translation of rare words with subword units. Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 1715–1725. doi
        Training data

        The examples a model learns from. Their coverage, quality and biases shape what the model can do and whom it serves badly.

        • R16AI in learning productsFrom the field · not in the guide
        • National Institute of Standards and Technology. (2024). Artificial intelligence risk management framework: Generative artificial intelligence profile (NIST AI 600-1). U.S. Department of Commerce. doi
        • Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021). On the dangers of stochastic parrots: Can language models be too big? Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency, 610–623. doi
        • Gebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., Daumé, H., III, & Crawford, K. (2021). Datasheets for datasets. Communications of the ACM, 64(12), 86–92. doi
        Transformer

        The neural network design behind current language models. It uses attention to weigh every part of the input against every other part when producing each output.

        • R16AI in learning productsFrom the field · not in the guide
        • Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, Ł., & Polosukhin, I. (2017). Attention is all you need. Advances in Neural Information Processing Systems, 30, 5998–6008.
        Two sigma problem

        Bloom's (1984) challenge to find group teaching as effective as the two-standard-deviation gain he reported for tutoring.

        • Bloom, B. S. (1984). The 2 sigma problem: The search for methods of group instruction as effective as one-to-one tutoring. Educational Researcher, 13(6), 4–16. doi
        • von Hippel, P. T. (2024). Two-sigma tutoring: Separating science fiction from science fact. Education Next, 24(2). educationnext.org
        • VanLehn, K. (2011). The relative effectiveness of human tutoring, intelligent tutoring systems, and other tutoring systems. Educational Psychologist, 46(4), 197–221. doi
        Singapore