The trouble with Bloom’s taxonomy in an age of AI

By Eliza.Compton, 19 April, 2024
View
When using large language models to create learning tasks, educators should be careful with their prompts if the LLM relies on Bloom’s taxonomy as a supporting dataset. Luke Zaphir and Dale Hansen break down the issues
Article type
Article
Main text

Educators have always faced the challenge of how to determine if their students are thinking. Since the 1950s, Benjamin Bloom’s taxonomy of educational objectives has been one of the most influential pieces of educational psychology (see Figure 1). However, in an age where teachers may be using AI as tools to assist them in task creation, we need to reconsider how we design teaching for thinking. 

Large language models (LLMs) and AI tools such as ChatGPT and Gemini use Bloom’s taxonomy as one of the most significant influences on how critical thinking is defined. In this article, we explore the challenge of integrating AI into teaching, learning and assessment while Bloom’s taxonomy is a significant part of its training model.

What is Bloom’s taxonomy?

Bloom’s taxonomy, a six-category framework of educational goals, has been highly influential for educators for nearly 70 years because it creates a clear structure for learning, is highly versatile across contexts, and facilitates the creation of critical-thinking activities. 

Image
Bloom's taxonomy
Figure 1: Original Bloom’s taxonomy from 1956

 

It’s versatile but is Bloom’s accurate?

Criticisms of Bloom’s taxonomy have also been around for more than half a century, and many are well known. One of the major issues is that the taxonomy does not capture the complexity of cognitive skills. It can be seen as inaccurate as cognitive processes interrelate with each other rather than building on each other. 

To illustrate, let’s look at an “understanding” task (see Figure 2): “Define life.”

This is a deceptively complex task. Not only would it require a standard understanding of respiration, response to stimuli and reproduction, but it also merits discussion of more spiritual or existential issues. Ecosystems and stars may fit a definition of life. Any definition will be incomplete and debatable. A student would demonstrate high levels of critical thinking and insight if discussing the foundations of our understanding rather than merely explaining our definitions.

Image
Bloom's taxonomy as revised by David Krahwohl in 2002
Figure 2: Krahwohl’s revised edition of Bloom’s taxonomy. Source: Adobe stock photo

 

The taxonomy has seen revisions over time (notably by David R. Krahwohl in 2002), but these still don’t fully capture the interrelated and interdependent nature of thinking processes. Alternatives such as cognitive web models (as proposed by Peter Ellerton and co-authors from the University of Queensland Critical Thinking Project in 2022) argue that cognitive skills often require a host of related skills and tasks (see Figure 3), and this may be more useful in designing for learning objectives.

Image
Peter Ellerton's cognitive web model
Figure 3: The cognitive web model depicts some of the most significant thinking skills and recognises their interrelatedness to one another. Image reproduced with permission from Peter Ellerton

 

Prompting AI for assistance with teaching thinking

To illustrate, we prompted ChatGPT to create questions that demand increasing amounts of critical thinking on the following task: “Describe the structure of a cell.” It responded with:

  1. Basic understanding: Describe the basic structure of a cell, including its main components.
  2. Comparing cell types: Compare and contrast the structures of prokaryotic and eukaryotic cells, highlighting their key differences and similarities.
  3. Specialised cell structures: Explain how the structure of a plant cell differs from that of an animal cell, emphasising the unique organelles found in each type.
  4. Cellular functions: How do the various organelles within a eukaryotic cell contribute to its overall function and survival?
  5. Cellular adaptations: Analyse how the structure of cells in different organisms reflects their specialised functions and adaptations to their environments. Provide examples.
  6. Theoretical cell modifications: If you were to design a hypothetical cell with a specific function, how would you modify its structure to optimise its performance? Explain your reasoning.

When asked how it increased the critical thinking, ChatGPT responded that it incorporated elements of Bloom’s taxonomy in designing to promote higher-order thinking, then demonstrated how each question aligned to the taxonomy. Generative AI still “believes” that cognitive skills are hierarchical.

This is a problem for educators in two significant ways. 

First, the questions are wildly inconsistent in their level of difficulty. The sixth question (creating) is so challenging that it’s likely only a biology expert would be able to answer it. This might be addressed through using better prompting practices, but this leads to the second problem.

When asking AI for greater levels of critical thinking, it struggles to discern among levels. “Comparing and contrasting” is an “analysis” skill, yet ChatGPT has treated this as an “understanding” skill. We’d likely use both, too, further demonstrating that these skills are interrelated rather than hierarchical.

Create AI prompts that widen perspective or engage with ambiguity

The obvious conclusion is that educators need to be careful with their prompting when it comes to using AI as a design tool. More than that, we need to recognise that the AI may create hierarchies (which are potentially inaccurate to boot) whenever prompted for suggestions or during brainstorming. 

Educators will need to consider the specific cognitive skill they want to teach or assess (when analysing, do they really mean classifying?), along with the qualities of that thinking (do they care about having coherent classifications or broad classifications, for example).

Consider prompting AI for activities that require broader perspectives or engage with the ambiguities of the issue. “Create an activity that explores the many ways life can be defined” is going to produce greater variety and complexity than asking it to “add critical thinking or difficulty to this question”. Given that contemporary critical-thinking pedagogy recognises the interrelatedness of thinking skills as well as the different qualities of thinking, it’s essential that we exercise care when designing critical-thinking tasks.

Luke Zaphir and Dale Hansen are learning designers in the Institute of Teaching and Learning Innovation at the University of Queensland.

If you would like advice and insight from academics and university staff delivered direct to your inbox each week, sign up for the Campus newsletter.

Standfirst
When using large language models to create learning tasks, educators should be careful with their prompts if the LLM relies on Bloom’s taxonomy as a supporting dataset. Luke Zaphir and Dale Hansen break down the issues

comment2

THE_comment

7 months 3 weeks ago

Reported
False
User Id
3591950
User name
aplangton
Comment body
First, the verb 'define' in not an understanding task, but a remembering task. Therefore, it would be simply recalling a definition of knowledge already stored in memory. 'Understand the definition of' could be an appropriate understanding task, but the phrase 'definition of' in this statement is really redundant. Second, you have omitted the Knowledge Dimension of the revised Bloom's taxonomy. Had you done so you would have quickly realised that the statement "define life" is a poor statement for a learning objective, it is too vague. For example, does the noun 'life' refer to Factual Knowledge, Conceptual Knowledge, Procedural Knowledge, or Metacognitive Knowledge? The answer is it could be any of these depending on the context in which it is being applied, hence why the learning objective statement "define life" is far too vague. Unfortunately, criticising Bloom's taxonomy by misusing Bloom's taxonomy is a common error.
jwt token
eyJhbGciOiJIUzUxMiJ9.eyJuYW1lIjoiYXBsYW5ndG9uIiwiZW1haWwiOiJhcGxhbmd0b25AYmx1ZXlvbmRlci5jby51ayIsImlkIjoiMzU5MTk1MCIsImlhdCI6MTcxNDM4ODMyOSwiZXhwIjoxNzE2OTgwMzI5fQ.2ryLdPqc1Jb3eJDw3fVXjAM2K4WZXR1jS4yQug79VkhAYeL5q38bJ3UIGNAIdWDWlIGFYM0BOBU3pQTZTwmCmQ
Reviewed
On

THE_comment

7 months 3 weeks ago

Reported
True
User Id
1089308
User name
Christian Howusu
Comment body
Response to aplangton : The fact still remain that cognitive skills should not be construed to be hierachical as in Blooms . An error that is common and imbibed by AI.
jwt token
eyJhbGciOiJIUzUxMiJ9.eyJuYW1lIjoiQ2hyaXN0aWFuIEhvd3VzdSIsImVtYWlsIjoiY2hyaXN0aWFuQG1yY29sbGVnZS5hYy51ayIsImlkIjoiMTA4OTMwOCIsImlhdCI6MTcxNDc1MTQyOSwiZXhwIjoxNzE3MzQzNDI5fQ.l7U7xbjlDDCFsFmjeBOFU6yUqYR6AZfdJmB414S1BmV2uGMfgy8ZvY919G1CfynsUc-7GzTBzwaqAuEJKqmB3A
Reviewed
On