Measuring the Cognitive Habits Involved in Critical Thinking Skills Dispositions and Assessment

Critical thinking is not a single mental trick. It combines cognitive skills—such as interpreting information, evaluating evidence, drawing reasonable inferences, and checking one’s own reasoning—with dispositions or habits that make a person willing to use those skills consistently. Someone may know how to analyze an argument yet fail to do so when the conclusion supports a favorite belief. For that reason, educators and researchers often distinguish between critical-thinking ability and the disposition to think critically. The original version of this article used the example of a mother caring for a child with a rare neurological disease. That example mixed medical claims with critical-thinking concepts and did not actually explain how cognitive habits are measured. This rewrite focuses directly on the topic: what critical-thinking habits are, how they differ from skills, how major frameworks define them, and how they can be assessed without pretending that one test captures the whole person. A sound critical thinking assessment has to measure both reasoning skills and the habits that make people willing to use those skills.

Critical Thinking as Both Skill and Habit

The Facione — Delphi Report on Critical Thinking defines critical thinking as purposeful, self-regulatory judgment involving interpretation, analysis, evaluation, inference, explanation and self-regulation. Just as importantly, the report treats good critical thinking as more than the ability to perform those operations on demand; it also depends on the disposition to use them when evidence is incomplete, disagreement is uncomfortable, or a familiar belief may need revision. The influential American Philosophical Association Delphi project brought together experts to develop a consensus description of critical thinking. The report identifies core cognitive skills including: Interpretation.; Analysis.; Evaluation.; Inference.; Explanation.; Self-regulation..

These skills describe what a good thinker can do with information, arguments, evidence, and their own reasoning. Critical-Thinking Skills vs. Critical-Thinking Habits The distinction is essential.

A person can score well on a reasoning exercise and still behave dogmatically in real life. Conversely, someone can be curious and open-minded but lack the technical reasoning skills needed for a complex problem. The “Critical Spirit” The Delphi report emphasizes that strong critical thinkers often display what the panel called a “critical spirit”: inquisitiveness, dedication to reason, and a desire for reliable information. This language is important because it shows that critical thinking is partly motivational. Thinking carefully requires effort. People need reasons and habits that make them willing to spend that effort.

Dispositions: Why Good Reasoning Requires More Than Technique

Facione et al. — The Disposition Toward Critical Thinking identifies recurring dimensions such as truth-seeking, open-mindedness, analyticity, systematicity, critical-thinking confidence, inquisitiveness and cognitive maturity. These are best understood as tendencies rather than personality labels: a person may know how to evaluate evidence yet fail to do so consistently when a preferred conclusion is threatened. Research associated with the California Critical Thinking Disposition Inventory identified seven frequently discussed dimensions. 1. Truth-Seeking Truth-seeking means wanting the best available answer even when it challenges one’s current position. A truth-seeking person asks: What evidence would change my mind?; Am I ignoring inconvenient information?; What does the strongest opposing argument say?. 2. Open-Mindedness Open-mindedness is the willingness to consider alternative perspectives fairly.

It does not mean believing every claim. It means evaluating competing views before rejecting them. 3. Analyticity Analyticity involves anticipating consequences, noticing potential problems, and using reason when the situation requires it. An analytical thinker asks what follows from a decision rather than considering only the immediate result. 4. Systematicity Systematicity means approaching a problem in an organized and disciplined way. It can involve: Defining the question.; Separating facts from assumptions.; Collecting relevant evidence.; Comparing alternatives.; Documenting reasoning.. 5. Critical-Thinking Confidence This refers to confidence in one’s ability to reason through difficult questions. Healthy confidence should not become overconfidence. Strong thinkers remain aware that expertise has limits. 6. Inquisitiveness Inquisitiveness is intellectual curiosity: the desire to learn even when the information does not produce an immediate reward. Curiosity is important because good questions often precede good analysis. 7. Cognitive Maturity Cognitive maturity involves recognizing that some problems contain genuine uncertainty, incomplete information, and competing reasonable considerations.

It prevents critical thinking from becoming a search for false certainty. Self-Regulation as a Cognitive Skill Self-regulation is one of the most powerful elements of critical thinking. It means monitoring and correcting one’s own reasoning. Examples include: Checking whether evidence really supports the conclusion.; Noticing emotional reactions that may distort judgment.; Revisiting assumptions.; Correcting a calculation.; Admitting that a source was unreliable.. Self-regulation is different from emotional suppression. It is about evaluating the thinking process itself. Interpretation Interpretation is the ability to understand and clarify the meaning of information. A person interpreting a research result might ask: What does this number actually measure?; What population does it apply to?; What does the author mean by this term?; Is the graph showing absolute values or percentages?. Poor interpretation can make later analysis meaningless even if every subsequent logical step is correct. Analysis Analysis identifies relationships among claims, evidence, assumptions, and conclusions. For example, when reading an opinion article, analysis may involve identifying: The main claim.; Supporting reasons.; Unstated assumptions.; Counterarguments.; Evidence offered..

Evaluation Evaluation asks whether a claim or source deserves confidence. Useful questions include: Is the source authoritative for this topic?; Is the evidence current?; Was the study designed well?; Could there be a conflict of interest?; Does the conclusion exceed the evidence?. Evaluation is especially important online, where polished presentation can make weak information look credible. Inference Inference means drawing a conclusion from available evidence. Good inference requires proportionality. Strong evidence may justify a strong conclusion. Limited evidence usually justifies a cautious conclusion. For example, one customer complaint does not prove that an entire company has poor service. It may justify investigating whether a broader pattern exists. Explanation Explanation requires a thinker to make reasoning visible. A strong explanation answers: What did I conclude?; What evidence did I use?; Why does that evidence support the conclusion?; What uncertainty remains?. This makes reasoning easier for others to evaluate and easier for the thinker to correct.

How Critical Thinking Can Be Assessed

The AAC U VALUE Institute — Assessment and Rubric Framework illustrates why performance evidence and transparent criteria are useful when evaluating complex reasoning. A strong assessment system therefore combines multiple forms of evidence rather than assuming one test score can capture how a learner interprets information, evaluates claims, justifies conclusions and reflects on weaknesses in their own reasoning. No single method is perfect. A strong assessment program uses multiple forms of evidence. Standardized Reasoning Tests These tests present problems that require analysis, inference, evaluation, or interpretation. They can provide consistent comparisons but may not show whether a person uses the same skills outside a test environment. Disposition Inventories Self-report instruments ask respondents about tendencies such as curiosity, open-mindedness, truth-seeking, or systematicity. These can measure attitudes and preferences, but self-report has limitations. People may describe how they want to think rather than how they actually behave. Performance Tasks Students can be given a realistic problem with incomplete or conflicting evidence and asked to produce a reasoned decision. Performance tasks can reveal: Evidence use.; Reasoning structure.; Recognition of assumptions.; Quality of conclusions.; Communication.. Rubrics A rubric defines dimensions and performance levels for assessing student work. AAC&U’s VALUE approach uses rubrics to assess learning outcomes through student artifacts rather than relying only on multiple-choice tests. Think-Aloud Protocols

Researchers can ask participants to verbalize their reasoning while solving a problem. This can reveal strategies and misconceptions but is time-intensive and may itself change how people think during the task. Reflective Writing Reflection prompts can ask students to explain: What assumptions they began with.; What evidence changed their position.; What uncertainty remains.; What they would do differently next time.. This is especially useful for assessing self-regulation. Why One Test Score Is Not Enough Critical thinking is context-sensitive. A person may reason very well in an area of expertise and poorly in an unfamiliar domain. Background knowledge matters because reasoning cannot operate on information a person does not possess. Motivation also matters. A student may perform carefully on a graded assignment but respond impulsively on social media. Therefore, a single score should not be treated as a complete measure of someone’s judgment. Measuring Skills and Dispositions Together A useful assessment model might combine:

Critical Thinking in Research, Education and Everyday Decisions

Research methods provide a natural environment for practicing critical thinking. Researchers must decide: What question is actually being asked.; How variables should be measured.; Which sampling method is appropriate.; What bias could affect the result.; Whether a relationship is causal or merely correlational.. MyArticles’ guide to data collection methods and measurement of variables covers these decisions in more detail. Critical Thinking in Everyday Decisions The same habits apply outside school. Before sharing a dramatic claim online, a critical thinker might: Find the original source.; Check the date.; Distinguish reporting from opinion.; Look for independent confirmation.; Ask whether the headline overstates the evidence..

This turns critical thinking into a routine rather than an abstract academic skill. Critical Thinking and Confirmation Bias Confirmation bias is the tendency to notice or favor information that supports existing beliefs. Critical-thinking dispositions such as truth-seeking and open-mindedness are especially important because reasoning skills alone do not prevent motivated reasoning. A useful habit is to ask: What is the strongest evidence that I might be wrong? Critical Thinking and Emotion Emotion is not the enemy of critical thinking. Emotions can provide information about values, threats, injustice, or priorities. Problems arise when strong emotion causes a person to skip evidence or exaggerate certainty. Self-regulation means noticing emotion and deciding how much weight it should receive in the reasoning process. Critical Thinking and Expertise Experts often reason more effectively within their domain because they recognize patterns, know which evidence matters, and understand common errors. However, expertise can also create blind spots if confidence becomes resistance to new evidence. Cognitive maturity therefore includes both informed confidence and willingness to revise. How Teachers Can Develop Critical-Thinking Habits Instruction should do more than tell students to “think critically.” Useful strategies include:

Require evidence for claims.; Use problems with more than one plausible answer.; Ask students to identify assumptions.; Have students argue both sides of a question.; Require revisions after feedback.; Use reflection after major assignments.; Reward intellectual honesty when students change their minds.. How Students Can Build Better Cognitive Habits Slow down important decisions.; Separate what you know from what you assume.; Write down the evidence.; Search for counterevidence.; Explain your reasoning to another person.; Track recurring mistakes.; Revisit conclusions when new evidence appears..

What Weak Critical-Thinking Assessment Gets Wrong

Measuring Only Recall A test that asks students only to remember facts is not a strong measure of critical thinking. Using Vague Rubrics Criteria such as “good thinking” are difficult to score consistently. Rubrics should define observable evidence. Confusing Confidence With Competence A confident answer may still be poorly supported. Treating Disagreement as Poor Thinking Two strong thinkers can reach different conclusions when evidence is uncertain or values differ. Assessment should focus on reasoning quality rather than whether the scorer agrees. Ignoring Domain Knowledge People cannot reason well about technical evidence they do not understand. What Makes a Good Critical Thinker? A good critical thinker is not someone who criticizes everything. The stronger profile is a person who: Seeks reliable information.; Asks relevant questions.; Distinguishes evidence from assertion.; Recognizes uncertainty.; Considers alternatives.; Explains reasoning.; Corrects errors.; Changes conclusions when evidence changes..

Conclusion

Critical thinking is strongest when ability and disposition work together. People need the cognitive skills to interpret information, analyze claims, evaluate evidence, draw inferences, explain conclusions, and regulate their own reasoning. They also need habits that motivate them to use those skills when the answer is inconvenient or uncertain. That is why measuring critical thinking requires more than a single quiz. Standardized tasks can measure some reasoning skills; disposition inventories can examine attitudes; rubrics and real-world assignments can reveal applied judgment; reflection can show self-correction. The ultimate goal is not merely to produce a high score. It is to develop a stable pattern of asking better questions, seeking better evidence, explaining decisions, and changing one’s mind when the evidence requires it.