Type's Critics-Considerations and Responses

See more on "MBTI test" Criticism Here

By Roger Pearman
CEO, Leadership Performance Systems
July 22, 2014

I am grateful for the 1000 (plus) emails I've received in the last five days about an article recently posted about the MBTI assessment and psychological type entitled: "Why the MBTI is totally meaningless". The article is like many articles published over the last two decades. Below is my response for your review. Please accept my apologies for not responding to each of the personal emails. Share this as needed.

Psychological type and type assessment tools have a legion of critics, which is good as it means people are taking the models seriously enough to argue about it. From the National Science Foundation criticisms of the early 1990s to the Murphy (2005) review in The Cult of Personality and many other articles since, critics have more or less argued about the same issues identified below.

Let's establish that criticisms about psychological type are not the same as criticisms about the Myers-Briggs Type Indicator®--or other assessment tools such as the Golden Personality Profiler or Majors Personality Type Inventory. Often critics of the assessment tools use objections to the theory as part of their problem with the tool along with numerous arguments about the nature of the items, reliability, and validity. We need to keep in mind that the theory and measurement of the theory are two very different things and each deserves consideration.

Let's agree that reasonable arguments can be marshaled on all sides with reference to evidence regarding the theory or assessment tools. It is highly unlikely that we are going to wake up one day and all of the key issues have been resolved. Many researchers on a given side are absolutely convinced that their analysis of the data supersedes all previous efforts and they have "proven" their point. In this pull and push of intellectual banter, some good ideas emerge and lead us to pause with what and why we do what we do with type and associated assessment tools that are outlined below. My response to this is to recall the wisdom of my Cherokee grandmother: "Those with answers are enslaved; those with questions are free." I am also reminded of Myers' wise counsel to Mary McCaulley that she had learned we should "focus perception on the world, and judgment on ourselves"--meaning be open to following the flow of knowledge and information and apply the insights to your own self-management.

What is My Myers Briggs Personality Type? Take our online self-scoring "Personality Test" and learn more about Personality Types

Step-By-Step Guide to Verifying your 4 Letter MBTI Personality Type

As an observation from my 38 years of using psychological type and type tools, the published criticisms are more often about how psychological type or associated instruments are used. When you read the critics carefully, it is apparent that they are talking about how an assessment was used that caused trouble rather than the assessment itself or how the theory was used rather than the value of the theory. And as for the instruments such as the MBTI®, if you Google "MBTI criticism", you will find articles which generally criticize the instrument using pre-IRT revision information and using data from the 1985 manual. Sometimes you need to read that criticism very carefully to see the data source. So far in every group I've facilitated where someone brought in a published criticism, the article was based on pre-revision data. The most recent articles do the same thing: the writer relies on the 1985 manual and completely by-passes the sophisticated analysis that uses IRT statistical methods to both select and weigh items for sorting. And this is not to claim that this solves the empirical problems surrounding assessment tools or even the theory of psychological type.

In general, you will find the following objections:

Objection 1: "The tool isn't scientifically sound." Of course, a great deal depends on what one calls "science." This article is too brief to explore this arena but note that it is no small matter and this should prompt us to inquire about the nature of the "science" the individual is referring to. This criticism is usually leveled at the MBTI®, though in recent years the other type tools have been getting the same treatment. In 1998 the MBTI® was revised using a powerful statistical methodology known in assessment, Item Response Theory (IRT). Using a census sampling technique, the MBTI® tool was revised based on a national sample and analyzed with IRT methods. To date, there are no other personality-related tools based on both a national sample and IRT statistics. With IRT, biases related to race, age, gender, and education are reduced. This reduces error and increases the instrument's reliability. Other tools have used robust methods such as contrasting group analysis to enhance the stability of the tool.

Claims that the tools are based on an outdated and esoteric methods by individuals without psychometric training simply don't hold any water. A panel of Ph.D. specialists participated in the 1998 revision to insure the highest science standards in the application of IRT methods to the MBTI, and newer tools are developed by expert psychometricians and psychologists. Now with over 10,000 published research studies, including brain mapping analyses, this criticism reveals more of a lack of thorough research on the part of the critic than a problem with the tools.

We-as type users-could benefit from the idea that there will never be enough data to convince a large number of research psychologists that type merits recognition as a viable theory. Even though I could list catalogs of research about personality "variables" which any serious user of psychological type would easily recognize as a principle of type, those researchers almost immediately discount type as speaking to their data. I'll never forget talking with EQ assessment researchers about their description of the "proven" eight processes of emotional intelligence based on decades of evidence and multiple scientific strategies and their negative reaction when I suggested they had provided evidence that Jung was right about four ways of perceiving and four ways of acting on information. Social science in the United States is somewhat programmed to discredit data or models that fall outside of the conventional schools of thought. I would hope users of psychological type would be open to the evidence as genuine open research unfolds.

Objection 2: "The instrument stereotypes people." A careful reading of the various manuals of type assessments and other official documents related to the tools, clearly suggests that the assessments are about preferences, tendencies, and potentials in development. Usually any stereotyping is done by those who don't know how to use the instrument. Isabel Myers eagerly noted that she called it an Indicator rather than a test, a measuring tool, or a categorizing device. A description is not a prediction. All psychological tools can face this same criticism if not used appropriately. It is useful to point out to naysayers that the tool being used is providing a summary of an individual's votes and as such is identifying some personal baselines from which an individual can learn to flex. The goal is to know the baseline and to learn where to flex to increase effectiveness. Further, there is emerging evidence that behavioral patterns--"behavioral type" versus psychological type--may provide a more robust way of looking at how people respond and adapt to their environment. Perhaps Eleanor Roosevelt's suggestion that no one can make you feel a certain way without your consent is useful advice.

Objection 3: "People are more complex than four letters." If by this critics mean a fixed, trait-like quality, competent users of psychological type and type assessments around the world would agree. The model, articulated by Carl Jung, is simply that there are dimensions of perceiving information and acting on experience that affect how we adapt, learn, and grow throughout life. Among these ways of perceiving and judging, we have a dominant psychological energy around which the others are organized. It is often the proposition of a dominant and auxiliary process that leads to researchers and initial users of type objecting. Yet, when you patiently invite an individual to look at how he or she deals with the world through extraverted energies and process experience through introverted-mind's eye-patterns, individuals readily confirm that this is how their mind works. When I completed a study of the database from the Center for Creative Leadership, I randomly selected 150 of each of the sixteen types and analyzed all of the other data--observational, other tools, self-reports--that came with each group. The significant differences between the types could reasonably be explained by the type dynamic hypothesis. While this isn't full proof, it isn't unimportant.

The instruments were designed to help individuals learn about typical ways of perceiving and judging information; furthermore, the theory suggests you are likely to be consistent over time. Notice the words tendency, likely, and patterns rather than fixed, unchanged, or predictive as descriptors of use. As indicated above, this is an attack on the theory based on a superficial understanding of the model and how to use it. The instruments suggest and propose, while a careful interpretation uncovers and clarifies.

Objection 4: "Everybody has done it; there isn't anything new. Everyone's been there and done that." Millions have taken type tools and by many accounts have received pretty bad interpretations. Regrettably, those who've had a bad experience are unlikely to be open to reviewing the information in the light of a proper and correct interpretation. The main criteria associated with a bad interpretation is that the information shared was superficial, stereotypical, and a "fun and games" presentation. Chances are many individuals have rarely been given the opportunity to go deeper than preferences into the dynamic and psychological mindsets of the type he or she confirmed.

A good interpretation would include these frames or perspectives. The type assessments are designed to identify preferred approaches to taking in information and making decisions with a hope toward:

• Exploring how we might use our preferences more effectively.

• Discovering how non-preferred psychological resources can be developed to enrich our life choices.

• Considering aspects of how our patterns in perception and judgment affect career choice, learning strategy, values orientation, problem-solving, and general orientation toward daily life. In other words, link understanding of self based on the psychological type to whatever the goal of using it is. Increase greater awareness of the complexity of individuals and mutual and constructive understanding of differences.

All of the type assessment tools published by major publishers include various subscales or facets to show the depth of the preferences and how we may have developed aspects of our non-preferred processes. For example, those with an Introverted preference may have learned the importance of being expressive or those with an Extraverted preference may have learned the value of being more one-on-one in communication. These elements give a look at our preferences and various facets that reveal the personal variations within the type pattern. This rich data source provides insight into greater elements of complexity of how we adapt and grow.

The viability of any tool or model is directly related to its appropriate use. When you look at the questions that professionals are seeking to address in applying psychological type, the potential applications of the type and type related tools are numerous for individual development. These applications extend beyond the purpose of this article, though it is important to note that how the model and tools are used affect judgments of them. For example, when type tools are used for selection or promotion, none of which were designed for such purposes, the theory and tools get black eyes.

Objection #5: "Type is completely discredited. The five factor model is the accepted framework for looking at personality." The research psychologist in the field of personality would find this a strange statement in that the literature on personality is diverse and rich, and can hardly be said to be "settled" on the nature of or elements of personality. The five factor model is popular and four of the five factors highly correlate with type preferences. For example, studies show correlations of each five factor variables with type preferences as follows: Extroversion with E/I, Originality with S/N, Accommodation with T/F, and Conscientiousness with J/P. The fifth factor, neuroticism or emotional reactivity, is not measured by type related tools. These models begin with a very different set of assumptions from those of psychological type about personality.

Of course, I'm more interested in a dialog between users of various personality models than I am in trying to spend energy proving one over the other-there is lots of evidence to go around. I have no problem with the idea that we are all tapping into the same source of psychological reality and that our "takes" on that reality have different forms. Fundamentally, though, type offers two things the other models do not: (a) differences are neither good nor bad and (b) a proposition about a system of psychological energies that explains how our external and internal worlds are so dynamic. I have yet to find a single document from the other schools of personality outside of type that propose a equal value for the range of personality factors available to measure. In the five factor model, it is clearly considered more healthy to be Extraverted, Original, Accommodating, and Conscientious, and not neurotic. When this topic comes up I simply say, "OK there are different takes on the make-up of personality. Would any of the following apply to you?

• Reflect on the details of an experience and imagine how things might play out in a scenario

• Think through the logic of a situation and ponder how the course of action aligns with one's values

• Quickly summarize an observation and identify an idea or possibility

• Express the rationale behind a situation and the values to be celebrated

If so, then type is a part of your reality because we've just discussed introverted sensing and introverted intuiting, introverted thinking and introverted feeling, extraverted sensing and extraverted intuiting, along with extraverted thinking and extraverted feeling." Discredited? Only to those who don't understand the theory and how it works.

Summary
While type tools are frequently purchased for development uses, it is likely that these are also the most under-utilized tools as is the theory on which they are based. I am fond of suggesting that psychological type is a 600 horsepower engine of understanding that is usually driven about 15 miles per hour. Too many facilitators, who can purchase but have not sought out training on the tool they use, provide a "drive by" introduction to the basic concepts and never really tap into the results in a way that promotes individual development and understanding of group behavior. After ninety years (Jung first published in 1921) type continues to suggest that this reasonable way to understand differences enables us to both attribute appropriate intent of others' behavior and tap into our potential resources. It encourages us to ask questions about how we work with our talents and engage with others. In the hands of a knowledgeable and artful user the theory and instruments are like a Stradivarius. Unfortunately, and for far too many learners, they tend to be played like a dime store violin.

We need to respond to the critics unapologetically that type theory continues to provide useful guidance for encouraging individual growth. We need to feel comfortable with the idea that there are many "notions" of type that are unproven; yet, provide a useful heuristic. We need to stay in touch with the research so we can answer questions with precision. Keep in mind that some things have to be understood to be seen.

As to the assessment tools, point out that assessment tools published by reputable publishing houses are guided by the standards of educational and psychological tests applied to all assessments and type tools generally pass all the standards in flying colors. For example, the standard to show test-retest reliability is very strong for the MBTI®, Golden, and Majors, and these compare favorably with other assessment tools for skills or personality measurement. As such, we can only ask that the tools we use should be treated as fairly as other tools, recognizing their limitations and usefulness.

Psychological type scares some people because it proposes something quite radical: individual differences can be understood and embraced without judgment. We owe it to ourselves and to the next generation to stay the course in promoting research, asking questions, and responding to the foes of such inquiry wherever they emerge.

Thanks,
Roger
www.teamtelligent.com

Roger Pearman is the author of "I'm Not Crazy, I'm Just Not You: The Real Meaning of the Sixteen Personality Types" and numerous other books on using Myers-Briggs Personality Types to improve communications, teamwork, leadership, and relationships. Roger is also CEO of Leadership Performance Systems, a leading consulting and training organization focusing on leadership, teamwork, assessment, and organizational development.

What is My Myers-Briggs Personality Type? Take our free online self-scoring "Personality Test" and learn more about Personality Types

Step-By-Step Guide to Verifying your 4 Letter MBTI Personality Type

The Cognitive Style Inventory is NOT the (MBTI) Myers-Briggs Type Indicator. The exclusive publisher of the MBTI is CPP, Inc., a publishing conglomerate who authorizes and certifies professionals in the use of this instrument. The MBTI is not a Personality Test; it is an assessment instrument.

^® MBTI, Myers-Briggs, Meyers Briggs, and Myers-Briggs Type Indicator are registered trademarks or trademarks of the Myers-Briggs Type Indicator Trust in the United States and other countries (aka meyer briggs or myers briggs).

* While commonly referred to as the Briggs Myers personality test, Myers Briggs Test or the MBTI test, the MBTI ^® is not a personality test but a personality inventory or instrument in which there are no right or wrong answers.

Return to MBTI & Myers Briggs Personality Types Home Page

© Published by Ross Reinhold & Reinhold Development 1997 - 2023
Privacy Policy About Us