Ability Model of Emotional Intelligence Mayer-Salovey-Caruso Emotional Intelligence Test
About EI MSCEIT Resources Training Research FAQ's About Us
EI Tests MSCEIT /EI Workshop MSCEIT Research Use Take MSCEIT

News

Contact Us
     

Emotionaliq.org

 

Article - Reply

 

Emotional Intelligence As a Standard Intelligence
John D. Mayer
Peter Salovey
David R. Caruso
Gill Sitarenios

 Also see Measuring Emotional Intelligence With the MSCEIT V 2.0

 

 

   
 

ABOUT THIS ARTICLE

This article should be cited as: Mayer, J. D., Salovey, P., Caruso, D. R., & Sitarenios, G. (2001).  Emotional intelligence as a standard intelligence.  Emotion, 1, 232-242. 

ABOUT PUBLISHING THIS MANUSCRIPT ON THE WEB: A copyedited version of this manuscript appears in the journal Emotion.  © Copyright 2001 is by the  American Psychological Association.  According to APA guidelines on internet publishing, the article can only be posted on the author's web site; "the posted article must carry an APA copyright notice and include a link to the APA journal home page; APA does not permit archiving with any other non-APA repositories; APA does not provide electronic copies of the APA published version for this purpose; and, authors are not permitted to scan in the APA published version."  Please help us by abiding by these guidelines and not posting the article elsewhere. Thank you. 

Abstract

We have claimed that emotional intelligence (EI) meets traditional standards for an intelligence . Roberts et al. question whether that claim was warranted. The central issue raised by Roberts et al. concerning our work is whether there are correct answers to questions on tests purporting to measure emotional intelligence as a set of abilities. To address this issue (and others they raise), we briefly restate our view of intelligence, of emotion, and of emotional intelligence. We then present arguments for the reasonableness of measuring emotional intelligence as an ability and summarize recent data suggesting that such measures are, indeed, reliable and that scores based on various scoring criteria are substantially intercorrelated.
 

What Kind of an Intelligence Is
Emotional Intelligence?

In 1999, we published, "Emotional Intelligence Meets Traditional Standards for an Intelligence" in the journal Intelligence. In that article, we presented a new scale of emotional intelligence (EI): The Multifactor Emotional Intelligence Scale (MEIS) based on a decade of theoretical and empirical work. We argued, on the basis of the MEIS and findings with it, that EI was a lot like a traditional intelligence: First, it could be measured as an ability for which there were correct answers. Second, the domain of EI was sizable in that we could come up with 12 fairly diverse tasks to measure it, everything from recognizing emotion in faces to understanding how emotions might combine to form other emotional experiences.

Third, after administering the test to 503 adults and 229 adolescents, we found that performance on those 12 diverse tasks was correlated positively across samples. A factor analysis of those tasks indicated that they could be defined by one general factor, and that they also fell into three or four subgroups of skills roughly corresponding to our model of emotional intelligence . Finally, EI ability increased with age, at least across the age ranges that we explored in cross-sectional studies.

Roberts et al. have questioned what kind of an intelligence EI might be, if it is an intelligence at all. One should start with the fact that there is a great deal of agreement between their findings and our own. In their words (ms. p. 54):
 

Some features of the psychometric analyses support Mayer, Caruso et al.'s (1999) claim that emotional intelligence meets criteria for an 'intelligence'. We replicated the finding of a 'positive manifold' between subtests of the MEIS, and, generally, the pattern of correlations corresponded well to the Mayer, Caruso et al. (1999) findings. Exploratory and confirmatory factor analyses showed broad similarities with Mayer et al.'s factor solutions, although there were some differences in detail, and, in exploratory analyses, subscale communalities were often low. In fact, the confirmatory analyses tend to support Mayer et al.'s initial conception of four branches of EI, rather than the three-factor model that has subsequently been derived.

In fact, the MEIS represented a great step forward for us in relation to our earlier ability scales . It included many tasks that Roberts et al., and we, found intercorrelated well. The overall Cronbach's alpha of the factor-based scale representing the entire test was .96 . And, one of the great advances of the MEIS over our earlier, more limited ability measures, was the first attempt to introduce an "expert" criterion for deciding on a correct answer, although at the time, we only had two such experts. In earlier studies, we had relied on general consensus scoring: basically, the degree to which the individual agreed with the response of the general group was the index of correctness. (We also examined a Target form of scoring, in which, say, a person whose face was being examined regarding the emotions expressed on it, reported how she or he felt). In expert scoring, two of the authors provided their own estimation of the optimal answers to the test.

Still, in reviewing the psychometrics of the MEIS, Roberts et al. find much to be concerned about. We recapitulate some of these empirical concerns here because they form the jumping off point for their theoretical concerns. Again, in their words (ms. pp.54-55):
 

other aspects of the data render many of the EI concepts more problematic than is acceptable of ability measures. In particular, the reliability of subtests that form the highest branches of the model, and are thus probably the most important components of the MEIS for prediction of real-world social behaviors (e.g., Progressions, Managing Others), are among the poorest in this battery. In addition intercorrelations between subtests, while resulting in 'positive manifold', are notably lower than is common in research involving cognitive ability measures (compare for example data presented here with various data sets presented in Carroll 1993). Further still, various factor analyses indicate a structure that is relatively unstable, certainly when compared to similar analyses that have been conducted with intelligence and personality measures. 

Perhaps the most severe psychometric difficulty is the lack of convergence between expert- and consensus-scored dimensions. There are instances of agreement, especially for the Blends and Progressions tests, but in general, cross-correlations are too small to suggest convergence. The correlation between the general factors extracted from each of the two data sets was only 0.26.

Their findings led them to several conceptual points of importance, raised mostly in their discussion. These are (a) that because there is no agreeable criterion for correct and incorrect answers, EI may well fail to qualify as an intelligence, (b) lower order sensory processes (i.e., perceiving emotion) should score lower on any factor analysis, but it does not (ms. p. 56), and the highest-order factor, managing emotions, has the lowest correlation with the full scale.

Roberts et al. then conclude that, perhaps, at least, there are no objective answers to emotional intelligence tests and that it does not qualify as an intelligence. Perhaps, even, emotional intelligence measures some form of conformity rather than a real intelligence, especially when normative scoring systems based on consensus are used. Essentially, Roberts et al.'s concerns all relate to the general issue of "What sort of an Intelligence is EI?" We address such questions by briefly restating our view of emotional intelligence. Then, we address several questions in turn, including: (a) Are there really correct answers on tests of EI, (b) If, as we argue, consensus scoring is ideal, is emotional intelligence merely a measure of conventionality, and, (c) are the tests reliable, and if not, can they be made to be reliable? We continue to assert that EI is, indeed, a traditional intelligence. Some of our arguments are theoretical, others rely on further findings in studies to which we refer .

An Overview of the Concept of Emotional Intelligence

The Nature of Intelligence

Symposia on intelligence over the years repeatedly conclude that the first hallmark of intelligence is high-level mental ability such as abstract reasoning . That is, intelligence involves such capacities as seeing relationships such as similarities and differences among objects, being able to reason validly within (and across) content domains, and being able to analyze parts and see their relation to each other and to wholes. Abstract reasoning, although the core aspect, is assisted by several other classes of functions; three such adjunct areas are of chief relevance here: an input, a knowledge base, and meta-strategies . These are enumerated in Table 1.

Abstract reasoning cannot take place without an "input" function. Different intelligences are often defined according to what is input and processed. For example, verbal intelligence pertains to reasoning about language; spatial intelligence pertains to reasoning about the positioning and movement of objects in space. Whatever the area, something must get the information, be it verbal, spatial, or emotional, into the system. Second, abstract reasoning is assisted by a well-organized, related body of knowledge: the knowledge base. This was what Cattell originally referred to as crystallized intelligence ; note that Roberts et al. use the term in a somewhat different sense than we do here . Thirdly, there are meta-cognitions, basically, strategies for operating with an intelligence in the context of broader mental life. A meta-cognition might be that it helps, in analyzing a problem, to write down portions of the problem so that not everything needs to be kept in short-term memory.
 

The Nature of Emotion and Emotional Information

There is considerable diversity of opinion as to what emotion is, of course . A reasonably canonical definition, however, might be that an emotion is an organized mental response to an event, that includes physiological, experiential, and cognitive aspects, among others. Of particular importance to us, is that emotions typically occur in response to relationships . One is angry if blocked from attaining a goal, happy if loved by someone who one loves in return, afraid when threatened, and the like. These relationships may be entirely internal, as when one is afraid of oneself and what one might do, or external, as when one admires another person. If emotions often arise in response to relationships, then emotional information is information about certain forms of these relationships.

One critical aspect of emotional information, to us, is its regularity. Compelling research by Ekman supports Darwin's hypothesis that emotional expression had evolved across species . This strongly implies that emotional information, and the capacity to read it, would show some universals across human beings and even closely related mammalian species. Ekman argued that any apparent differences in human emotional expression from area to area could be attributed to the fact that different cultures taught different display rules about when it was appropriate to express one or another feelings. If any further proof of the regularity of emotional information was required, it could be found in the area of artificial intelligence, where cognitive scientists created expert systems that could understand emotions in rudimentary stories . We deal with the nature of emotional information in greater detail, below, as we discuss the issue of the "correct answer" to an emotional intelligence test item.

The Nature of Emotional Intelligence

Our model of emotional intelligence begins with the idea that emotions contain information about relationships. . When a person's relationship with another person or an object changes, so do their emotions toward that person or object. A person who is viewed as threatening is feared, an object that is expected is liked. Whether these relationships are actual, remembered, or even imagined, they are accompanied by the felt signals of relationship status or change that we call emotions. EI, in turn, refers to an ability to recognize the meanings of emotions and their relationships, and to reason and problem-solve on the basis of them. It further involves employing emotions to enhance cognitive activities .

Our own analysis of emotion-related abilities led us to divide EI into four areas of skills . We call these areas "branches" in reference to the diagrams in which they were first introduced. The four branch model which we now use divides EI into four areas: accuracy at (a) perceiving emotions, (b) using emotions to facilitate thought, (c) understanding emotions, and (d) managing emotions in a way that enhances personal growth and social relations. We view a distinction between the second branch (using emotions) and the other three. Whereas Branches 1, 3, and 4 involve reasoning about emotions, Branch 2 uniquely involves using emotions to enhance reasoning. Finally, we view the four branches as forming a hierarchy, with emotional perception at the "bottom" and "management" at the top. Note, however, that this is a hierarchy in terms of personality, not specifically in terms of underlying affective and cognitive processes. In fact, we view our third level as the most cognitively saturated. We view the top, management level, as involving a balance among many factors: motivational, emotional, and cognitive . This four branch model serves as a basis of our current reviews of the field . With this thumb-nail sketch of our model, let us proceed to Roberts et al.'s concerns.

Which Areas of EI should Correlate Highest with
Cognitive Intelligence?

In Roberts et al.'s estimation, our Emotion Management branch should have its highest correlation with general IQ, whereas our Branch 3 (Understanding) actually does. In fact, however, our model supposes that the third, Understanding, branch should have the highest relation to abstract reasoning. To explain this, consider the outline of our theory in Table 2. There, Understanding is most allied with cognitive processing and abstract reasoning. Management, although the "highest" branch, is considered highest by virtue of its position of creating a bridge or an interface more generally with the more global personality system.

Are There Correct Answers to Our EI Tests?

Roberts et al. identified as "the most severe psychometric difficulty," with our work to be, "the lack of convergence between expert- and consensus-scored dimensions." (ms. p. 55). Let us begin in earnest with this issue for two reasons: First, it is primary to whether there can be a correct answer to a test of EI, and hence, whether emotional intelligence is a standard intelligence. Second, it is, by their own description, their most important criticism. As their own concern began with the empirical finding that consensus and expert data correlated only r = .26 (p. 56) in their sample, let us start with the empirical issue. Roberts et al. note that "The discrepancies are sufficiently large that they imply that one or other scoring method should be discarded, in that it is hard to envisage modifications that would bring factors that are correlated at less than 0.50 into alignment (p. 61)."

Empirical Concerns

Roberts et al.'s findings suggest the unlikelihood of any eventual convergence between these scoring methods. At the same time, the MEIS was an experimental measure, a first attempt to operationalize our full model of EI, for which the addition of rudimentary expert scoring was intended as an exploration of the possibility of another criterion of correctness. The expert scoring system of the MEIS was not intended as a final expert criterion. We recognized that two authors answering a long test would be unlikely to create the most optimal version of the expert criterion possible. Indeed, Legree has pointed out that individual experts are typically unreliable. His own research indicated that as experts are aggregated they might be expected to approach the general consensus in this domain . At the time our first paper on the MEIS appeared, we argued that expert scoring and consensus scoring converged to some degree, and that because the general group consensus appeared more reliable, and yielded better test factor structure, it should be employed.

More recently, we have developed a new test of emotional intelligence, the Mayer-Salovey-Caruso Emotional Intelligence Test (MSCEIT) that attempts to improve on the psychometric qualities of the MEIS. Findings from this new scale are reported in an unpublished manuscript presently under review at this journal . That manuscript, which is currently available from the authors, reports two large-sample psychometric studies. The second study concerns the MSCEIT V2.0, a 141 item ability scale that uses tasks similar to those of the MEIS to measure the four branches of emotional intelligence. Like the MEIS, the MSCEIT can be scored according to a general consensus criterion. That is, if .56 of the sample says that there is a moderate amount of happiness in a face, and a participant agrees, his score is incremented by .56.

Also like the MEIS, we used expert scoring for the MSCEIT. Rather than use two authors as experts, however, we asked 21 members of the International Society of Research in Emotion (ISRE) to answer the MSCEIT questions. We then scored the MSCEIT according to an expert-consensus criterion, based on the proportion of experts from ISRE who answered each item in a particular way. As reported in the manuscript, when over 2,000 participants' scores on the MSCEIT were calculated by general- or expert-consensus scoring, the intercorrelation between the two sets of scores was r = .98. That figure is, obviously, well above the r = .26 figure Roberts et al. actually found with the MEIS, and well above even the r = .50 criterion they could imagine seeing in the future.

Theoretical Concerns

This finding does not, by itself, solve whether there are correct answers to questions assessing EI, but it does greatly simplify the issue to understand that both members of the general population, and emotions experts, converge to something quite close to the same answers as to the emotions in a face, or the meaning of an emotion word. The question can now be refocused on: "What does that consensus mean?" And, is this form of determining a correct answer much different than that used in cognitive intelligence tests?

It is worth noting at the outset, that cognitive IQ tests have items that are "objectively scored" freely intermixed with tests that are scored by a (presumably expert) consensus. An objectively scored test would be something like "digits forward" on the WAIS-III, for which participants hear a series of digits (3..5..1) and simply must repeat them. Other tests, however, require some discussion to arrive at the correct answer. As the WAIS-III manual puts it:
 

To refine the scoring criteria of those subtests for which many acceptable responses are possible (Vocabulary, Similarities, Information, and Comprehension on the WAIS-III), the development team conducted several scoring studies. Two team members independently coded each response, identified discrepancies between the code assignments, and resolved the differences so that each response had only one code. At this point, team members had to agree on the grouping of responses and the assignment of codes but not on what score value to assign a code. After the codes were assigned, the team evaluated the quality of the responses and assigned a score value (0, 1, or 2) to each code on the basis of the accuracy of the response."

The issue then, is not whether experts need to be used, but rather, the nature of emotional versus cognitive information, and the nature of emotional versus cognitive experts. Certainly, there are differences in the two. As we discussed in the section on emotion, we view emotional information as partly consistent across cultures, and as indicating aspects of relationships. But can more be said about the difference between emotional and cognitive information?

Similarities and Differences Between Emotional and Cognitive Information

When thinking about general and expert consensus in the two domains (of emotion and of cognition), there seem to be three issues that come into play: (a) domain of application, (b) general consensus, expert consensus convergence, and (c) systematization of knowledge.

Differences in domain of application. In regard to domain of application, emotional information pertains to the human world: the relations of people (and animals) to one another, and their relation to cultural institutions, ideas, artifacts, and socio-emotional contracts, including rules of behavior. Put another way, emotional information applies primarily to matters of how human beings and their evolutionary ancestors survive and interact with the immediately surrounding world. Human beings have likely come to a general consensus about many emotional meanings. This does not imply that there is only one way to feel, or interpret feelings, but rather, that it helps to know how an individual's reactions compare to how most people would respond emotionally to a situation. Such knowledge helps define the general meaning of emotions in regard to relationships: for example, that happiness arises in harmonious environments, fear in response to threat, and anger to goal blockage, and so on.

Cognitive information, by contrast, describes rules that have areas of application far beyond our immediate living world. Although the child's mathematical world may begin in part with counting fingers and toes, the world of mathematics refers to a sometimes imaginary but often useful numerical world of equations, arithmetical functions, and physically possible and impossible spaces, created both for their beauty and their application. Physical laws such as those describing gravity, acceleration, and the like, apply as much to rocks, stars, and other galaxies, as they do to human beings.

Differences in expertise. This difference in domain of application has implications for the type of expertise in each area. Whereas in the physical, general cognitive realm, objects are studied, in the emotional realm, the object of study is people. This gives rise to the second difference, what we refer to as the issue of (b) general-expert convergence. Given that emotional information is bio-social, i.e., biological and learned, the expert becomes the expert to some extent by studying the group consensus, and becoming, as it were, more accurate about the group consensus than other individuals or small groups. For example, already in the areas of emotions, experts can reliably distinguish sincere or real, from false, tense smiles . It is likely, however, that the general consensus can do this as well. The deciding contribution of expertise is probably more cleanly and expertly to identify and distinguish between the two sorts of smiles, and to elucidate how people do this naturally. That is, the general group will be "messier" in identifying the consensus than experts should be. General-expert convergence occurs in the domain of emotions because experts look for the correct answer by, in part, paying attention to the consensual information of the group.

It is easy to come up with instances, in teaching physics, for example, where the group consensus is simply wrong and the expert opinion is correct. In fact, physicists refer to "lay physics" to represent the sometimes incorrect but consensual notions that people hold about the physical qualities and motions of objects. A well-known example of this is the common misconception (at least among young children) that heavier objects fall faster than lighter ones. Here is a case where expert knowledge plainly trumps lay knowledge, as, since Galileo's famous experiments, it has been known that the two sorts of objects fall at the same rate. The difference here is that the expert in physics, say, conducts experimental research in areas (i.e., the behavior of objects, even invisible, sub-atomic objects) of which the general person has no innate or pragmatic experience.

It is likely possible to come up with parallel instances of emotional expertise as the "lay physics" example. Real expertise does exist in this domain, of course. Take a different example involving systematization. Suppose we ask:

Billy beat up Bobby. Billy was:
a. unhappy about himself
b. felt very good about himself
c. afraid

The lay answer is likely to be "a," based on early psychological theories about bullying. More recent evidence, however, has suggested that "b" may be the correct answer, as bullies tend to have high self-esteem . Making such a claim, however, troubles emotions researchers more so, we suspect, than it would physicists. This is part because discoveries in psychology are fraught with contention and have often been reversed as more knowledge is accumulated. This, of course, is also true of physics, after all, in the Ancient Greek period, the expert answer to the problem of what sort of objects fell faster, was that heavier objects fell faster. In addition, however, part of the problem relates to what we would call systematization.

Differences in systematization and institutionalization. The third difference between information (and hence, expertise) in the emotional and the cognitive domain is systematization and institutionalization of knowledge. By systematization, we refer to authoritative dictionaries, manuals, descriptions of operations, and other authoritative texts dealing from a consistent viewpoint with the subject matter. Emotional information certainly has been systematized to some degree, but there is less than universal agreement as to the systematizations. For example, one can trace various enumerations of the meanings of emotions through philosophy, psychology, and now, artificial intelligence programs that decipher emotions in stories. Still, these authoritative manuals have not yet gained widespread cultural currency, are not well known, and are only beginning to be taught in schools. In short, they are not entirely culturally sanctioned. Cultural reasons for this lag are described elsewhere.

There has been a higher level of systematization of certain areas of cognitive information than areas of emotional information. Western schools, colleges, and universities focus on areas such as language, literature, and mathematics, in ways that they simply do not in emotions. In part for that reason, more focus has been placed on creating canonical resource materials in those areas. With those canonical resources, these areas appear more fixed, certain, and objective than does emotional information. Imagine, for a moment, that investigators in the field of emotions were required to establish a high school curriculum for teaching about the emotions and their meaning . Committees would meet, commissions would be established, and, ultimately, an authoritative expert body of knowledge would be produced. Biologists, chemists, and physicists have been doing this for years, with the tacit understanding that the body of expert knowledge will change over the years, but that each iteration represents a further approximation of some, ultimate, truth. When this begins happening in emotions, it is likely that the divergence between experts and the general consensus will be easier to describe and detect.

Consensus and Conventionality

If emotional information turns out to be the general consensus, and is little different from the expert-consensus, then, have we, as Roberts et al. wonder, created a test of conformity? In their words:
 

A conformity construct is of real-world relevance, but it is highly misleading to label it as an intelligence, because it relates to person-environment fit, rather than to any characteristic of the individual. Indeed, in some instances it is the nonconformist who should be deemed emotionally intelligent: for example, a writer or artist who finds a new and original way of expressing an emotion. 


 

Let us begin with the point that conventionality of response is a criticism often leveled at intelligence tests more generally. For example, in reading comprehension, the correct answer is "getting the same point" as everybody else has (or as the established, conventional experts have). Indeed, Guilford referred to most existing intelligence tests as involving convergent thinking. In this sense, our test of EI is also convergent. As with other intelligences, however, it is convergent without being either simply or limited to, conventionality.

Our theory of EI begins with perceiving emotions accurately, as other people conventionally do. We do not see this as much different than saying that literary analysis begins with comprehending the basic content in stories, or that spatial relations begins with being able to name shapes. No one argues that such simple identification of basic linguistic meanings or basic shapes is conformity. EI continues with abstract reasoning about emotions. This includes analyzing linguistic terms relevant to emotion, and analyzing alterations in emotional sequences that are likely to occur (e.g., that delay turns frustration into anger). This is full fledged reasoning, different perhaps, but still arguably on a par conceptually, with, say, understanding the proper order of an argument. If the examples of such emotional reasoning are, perhaps, a bit more limited than that found in linguistic or spatial reasoning, it is probably in large part to the relative paucity of systematization in the emotions area. We expect more such systematization in the future, however, as people continue to come to grips with the importance of the area. Even with such systematization as presently exists, we have been able to come up with enough items to write two entirely different EI tests of hundreds of items, each of which works fairly well (i.e., the MEIS and MSCEIT series).

If we believe the test involves intelligence, then where does creativity enter in? Does it not depend on idiosyncratic reactions? As Roberts et al. asked, should the nonconformist -- a writer or artist who finds a new and original way of expressing an emotion -- be deemed emotionally intelligent? Absolutely, but note that discovering a new way of expressing an emotion in music, for example, doesn't necessarily involve inventing new emotional rules, or idiosyncratic emotional reactions, but rather, may involve arranging musical tones in a new way to elicit old or new emotions and their blends. In fact, it is the very capacity of the writer or artist to portray relations among people and to describe things so as to come up with new blends of feelings or transitions among emotions, that in part marks the creative process. A composer rarely exercises creativity in writing music by playing consistently off key; a writer rarely creates deep, new feelings in a reader by failing to understand how a reader would react emotionally in a similar situation to the character.

Consider Averill and Thompson-Knowles' triad task of emotional creativity. In that task, participants were asked to create a story in which there are relationships that represent particular triads of emotions. In response to the emotions "serene, bewildered, and impulsive," one participant, who was rated quite highly on creativity, wrote:
 

The clouds are few, the sky is clear. I'm at the top of the cliff. It's real peaceful up here. Suddenly, I want to jump. I don't know why, I just want to. Calmly, I look down at what would be my unquestioned doom. It looks peaceful; warm and friendly. But why, why do I want to dive into the hands of the grim reaper? What does this mean? I hesitate, then motion to jump, something strange pulls me back. It is the peacefulness of the cliff. I can't destroy the peacefulness. The wind feels like velvet against my skin as I slowly shake my head. Why? 

Whether or not you consider that to be great art, it was rated high in novelty, authenticity, and creativity. And yet what makes it work is that its anonymous author did understand the meanings of emotion in a "conventional" sense. What was novel was the creation of a new situation to elicit the feelings.

Issues of Reliability

The MEIS, and our subsequent tests, the MSCEIT RV1.0 and V 2.0 are all reliable tests at the full-scale level (where they all possess split-half reliabilities above r = .90). Our aforementioned manuscript , reports MSCEIT V. 2.0 reliabilities at the branch level ranging from r = .79 to .91 using consensus scoring and r = .77 to .90 using expert scoring. The progression of tests: from MEIS, studied by Roberts et al., to our newer tests the MSCEIT RV 1.1 to MSCEIT V 2.0 also showed a gradual rise in reliability at the lowest-level, reliabilities of individual tasks. Whereas using consensus scoring on the 12 tasks of the MEIS yielded individual task reliabilities ranging from alphas of .49 to .94 , similar scoring for the MSCEIT V2.0 yield individual task alphas from r = .65 to .88 .

Concerns about reliability were first raised about our earliest test, measuring one aspect of EI, by Davies, Stankov, and Roberts . That test provided an empirical demonstration of the possibility of EI rather than a fully operationalized test . Given our primary focus at that time, which was to demonstrate the existence of EI psychometrically, we were not too worried about the admittedly modest, alpha of .63, internal consistency of this rather constrained 1990 measure. To us, if EI existed, it is theoretically important, in part because it challenges the field's view of both emotion and intelligence. Whether or not a test was high in reliability was a secondary concern at that time. After all, almost any test's reliability can be enhanced simply by making it longer (Spearman-Brown). That said, we of course wanted tests to be used by others in the research and applied worlds to possess adequate reliability. We worked hard to ensure that the MEIS and MSCEIT all had full-scale reliabilities over .90, and succeeded.

Roberts and his colleagues were presumably satisfied with the MEIS full-scale reliability of r = .96 that we reported in the 1999 article. They also required, however, that all the subcomponents of the test, even at the level of individual tasks, to be of high reliability as well. It is important to note that this has little to do with whether or not EI exists. Rather, it appears to be, for them, an issue of utility. Their perspective, as it is clarified in their article in this issue, appears to be more applied. They wanted to be assured that when people are tested, the scores those individuals obtain (i.e., are told about) are legitimate and accurate reflections of their ability. This is an obviously legitimate concern on their part. We recognize it to be of growing importance as tests such as the MSCEIT are prepared for general use.

Reliability or Accessibility?

Given that test reliability can be improved simply by lengthening the test, why did we not heed Davies et al.'s criticisms early on and make a test longer than the MEIS? We could have taken the MEIS (or the MSCEIT tests) and added items to them to make them longer and more reliable. Instead, we chose to shorten our tests, and build up reliability at the task level through careful item selection. Investigators have begun to, and will need to, correlate the test with real-life criteria. A short, efficient test that provides one, two, and four reliable scores, like MSCEIT V2.0, can stimulate research better and faster than can a longer, more unwieldy and inefficient test that has optimized reliability for every individual task. Through careful item selection, we have actually improved reliability at the task level (this was accomplished in part by dropping four tasks). To adopt Roberts et al.'s perspective for a moment, it is worth comparing the present MSCEIT V2.0 with the original Wechsler Adult Intelligence Scale (WAIS), used until 1981. That scale was written after roughly 4 decades of intelligence testing, and itself replaced the earlier Wechsler-Bellevue Intelligence Test. The 11 WAIS subscale scores ranged in reliability from r = .60 to .96, not so different from the MSCEIT V2.0.

Ongoing Issues

There are a few issues we are not yet prepared to address in this commentary due to the fact that they are empirical questions that are as-of-yet unresolved. To many people, the most important of these issues would probably concern whether the general and expert consensus are uniform or cultural-bound in Western and non-Western societies. There are several additional issues that will chiefly be of interest to intelligence researchers. For example, why does emotional perception load most highly on factors of general EI? Here, our current work suggests that this finding may not hold with our newer tests and therefore we have not commented on it. Another item chiefly of psychometric interest: is the average interrelation among EI tasks lower than that for general cognitive IQ, and if so why? This is an interesting question for which we have no answer at this time.

Summary and Conclusions

In this commentary, we have restated our conceptual approach to intelligence, emotions, and emotional intelligence. Roberts et al. have raised some additional concerns about our theory and measurement of emotional intelligence. Those concerns centered, to a large degree, on the low correlation between two methods of scoring the MEIS (general consensus and expert). In particular, they raised the issue of whether there could be correct answers on a test of emotional intelligence. We are appreciative of the fact that Roberts and colleagues are engaged in this research and have raised these issues. They have prompted us to present new data, and to present a further consideration of the theoretical issues involved in scoring such tests. We have referred to important findings indicating that different scoring methods converge at the r = .98 level rather than the r = .26 level suggested by Roberts et al.'s analyses. In addition, we provided a plausible theoretical explanation of the basis on which correct answers to EI tests can be determined.

In addition, we considered some other concerns of Roberts et al., including test reliability. Although the reliability for the full MEIS is .96, it is lower at the level of the 12, individual tasks. We have argued that the reliability issue raised by Roberts et al. is a limited problem, and one that is addressed by our new scale, the MSCEIT V2.0, which is has been available to researchers for nearly a year.

Implications and Future Research

With such an assessment tool, it is now possible to ask not whether emotional intelligence exists, but whether it is important in various realms of our life. We urge caution in this endeavor, as we would expect emotional intelligence to be an important predictor of significant outcomes, but at levels that are typically found in psychological research. In spite of the claims of popular authors , we do not believe that emotional intelligence will prove to be twice as important as analytic intelligence in predicting "success". What research does exist, however, suggests that emotional intelligence is likely to take its place alongside other important psychological variables as an important predictor of performance at school, home, and work. For example, higher EI may predict psychological mindedness and reduced levels of problem behavior such as drug use and interpersonal violence.

The development and understanding of an intelligence requires a number of years of careful scrutiny and research. The most widely used cognitive scales of intelligence, the Wechsler Intelligence scales, are the product of 60 years of research. Moreover, that research itself was initiated only after 40 years of earlier work on the clinical assessment of intelligence. If the history of the study of intelligence is any guide, there is little question that there is much still to be learned about emotional intelligence, and we look forward to continued work on these critical issues. The first 10 years of emotional intelligence research have been both frustrating and rewarding. Both the pace and quality of research in the area reflect the activities of a healthy field.

References

 Ackerman, P. L. (1997). Personality, self-concept, interests, and intelligence: Which concept doesn't fit? Journal of Personality, 65, 171-204.
 Averill, J. R., & Thompson-Knowles. (1991). Emotional creativity. In K. T. Strongman (Ed.), International review of studies on emotion (Vol. 1, pp. 269-299). London: Wiley.
 Baumeister, R. F. (1997). Evil: Inside human violence and cruelty. New York: W. H. Freeman & Company.
 Brackett, M. (2001). Emotional intelligence and the life space. Unpublished Master's Thesis, University of New Hampshire, Durham, NH.
 Cattell, R. B. (1943). The measurement of adult intelligence. Psychological Bulletin, 40, 153-193.
 Cohen, J. (Ed.). (1997). Educating minds and hearts:  Social emotional learning and the passage into adolescence. New York: Teachers College Press.
 Cohen, J. (Ed.). (2001). Caring classrooms/intelligent schools: The social emotional education of young children. New York: Teachers College Press.
 Darwin, C. (1872/1965). Expression of the emotions in man and animals. New York: Philosophical Library.
 Davies, M., Stankov, L., & Roberts, R. D. (1998). Emotional intelligence: In search of an elusive construct. Journal of Personality and Social Psychology, 75, 989-1015.
 Dyer, M. G. (1983). The role of affect in narratives. Cognitive Science, 7, 211-242.
 Ekman, P. (1973). Darwin and facial expression: A century of research in review. New York: Academic Press.
 Ekman, P. (1985). Telling lies. New York: Norton.
 Elias, M. J., Zins, J. E., Weissberg, R. P., Frey, K. S., Greenberg, M. T., Haynes, N. M., Kessler, R., Schwab-Stone, M. E., & Shriver, T. P. (1997). Promoting social and emotional learning: Guidelines for educators. Alexandria, VA: Association for Supervision and Curriculum Development.
 Formica, S. (1998). Description of the socio-emotional life space: Life qualties and activities related to emotional intelligence. Unpublished Senior Honors Thesis, University of New Hampshire, Durham, NH.
 Frijda, N. H. (2000). The psychologist's point of view. In M. Lewis & J. M. Haviland-Jones (Eds.), Handbook of emotions (pp. 59-74). New York: Guilford Press.
 Goleman, D. (1995). Emotional intelligence. New York: Bantam Books.
 Goleman, D. (1998). Working with emotional intelligence. New York:: Bantam.
 Lazarus, R. (1991). Emotions and adaptation. New York: Oxford University Press.
 Legree, P. I. (1995). Evidence for an oblique social intelligence factor established with a Likert-based testing procedure. Intelligence, 21, 247-266.
 Matarazzo, J. D. (1972). Wechsler's measurement and appraisal of adult intelligence (5th ed.). New York: Oxford University Press.
 Mayer, J. D. (2001). A field guide for emotional intelligence. In J. Ciarrochi & J. P. Forgas & J. D. Mayer (Eds.), Emotional intelligence and everday life. (pp. 3-24). New York: Psychology Press.
 Mayer, J. D., Caruso, D. R., & Salovey, P. (1999). Emotional intelligence meets traditional standards for an intelligence. Intelligence, 27, 267-298.
 Mayer, J. D., DiPaolo, M. T., & Salovey, P. (1990). Perceiving affective content in ambiguous visual stimuli: A component of emotional intelligence. Journal of Personality Assessment, 54, 772-781.
 Mayer, J. D., & Geher, G. (1996). Emotional intelligence and the identification of emotion. Intelligence, 17, 89-113.
 Mayer, J. D., & Mitchell, D. C. (1998). Intelligence as a subsystem of personality: From Spearman's g to contemporary models of hot processing. In W. Tomic & J. Kingma (Eds.), Advances in cognition and educational practice (Vol. 5, pp. 43-75). Greenwich, CT: JAI Press.
 Mayer, J. D., Perkins, D., Caruso, D. R., & Salovey, P. (2001). Emotional intelligence and giftedness. Roeper Review, 23, 131-137.
 Mayer, J. D., & Salovey, P. (1995). Emotional intelligence and the construction and regulation of feelings. Applied and Preventive Psychology, 4, 197-208.
 Mayer, J. D., & Salovey, P. (1997). What is emotional intelligence? In P. Salovey & D. Sluyter (Eds.), Emotional development and emotional intelligence: Implications for educators (pp. 3-31). New York: Basic Books.
 Mayer, J. D., Salovey, P., & Caruso, D. R. (2000a). Emotional intelligence as zeitgeist, as personality, and as a standard intelligence. In R. Bar-On & J. D. A. Parker (Eds.), Handbook of emotional intelligence (pp. 92-117). New York: Jossey-Bass.
 Mayer, J. D., Salovey, P., & Caruso, D. R. (2000b). Models of emotional intelligence. In R. J. Sternberg (Ed.), Handbook of intelligence (pp. 396-420). Cambridge, England: Cambridge University Press.
 Mayer, J. D., Salovey, P., Caruso, D. R., & Sitaraneos, G. (under review). Emotional intelligence meets traditional standards for an intelligence again: Findings from the MSCEIT.
 Roberts, R. D., Zeidner, M., & Matthews, G. (this issue).
 Rubin, M. M. (1999). Emotional intelligence and its role in mitigating aggression: A correlational study of the relationship between emotional intelligence and aggression in urban adolescents. Unpublished Dissertation, Immaculata College, Immaculata, Pennsylvania.
 Salovey, P., Bedell, B., & Detweiler, J. B. (2000). Current directions in emotional intelligence research. In M. Lewis & Haviland-Jones (Eds.), Handbook of emotions (2nd ed., pp. 504-520). New York: Guildford Press.
 Salovey, P., & Mayer, J. D. (1990.). Emotional intelligence. Imagination, Cognition, and Personality, 9, 185-211.
 Salovey, P., Mayer, J. D., & Caruso, D. R. (in press). The positive psychology of emotional intelligence. In S. J. L. C. R. Snyder (Ed.), The handbook of positive psychology. New York: Oxford University Press.
 Salovey, P., Mayer, J. D., Caruso, D. R., & Lopez, P. N. (in press). Measuring emotional intelligence as a set of abilities with the MSCEIT. In S. J. Lopez & C. R. Snyder (Eds.), Handbook of positive psychology assessment. Washington, DC: American Psychological Association.
 Salovey, P., Woolery, A., & Mayer, J. D. (2001). Emotional intelligence: Conceptualization and measurement. In G. J. O. Fletcher & M. S. Clark (Eds.), Blackwell handbook of social psychology: Interpersonal processes (pp. 279-307). Malden, MA: Blackwell.
 Solomon, R. C. (2000). The philosophy of emotions. In M. Lewis & J. M. Haviland-Jones (Eds.), Handbook of emotions (pp. 3-15). New York: Guilford.
 Sternberg, R. J. (1997). The concept of intelligence and its role in lifelong learning and success. American Psychologist, 52, 1030-1045.
 The Psychological Corporation. (1997). WAIS-III, WMS-III Technical Manual. San Antonio, TX: Author.
 
 
 
 
Table 1: A Summary Overview of Parts of Intelligence (after Mayer & Mitchell, 1998, Table 1).    
  Verbal Intelligence Emotional Intelligence    
Adjunct Processing: 
Meta-Processing
Knowing that writing something down can help one remember it. Knowing that helping someone may make oneself feel better.    
Abstract Processing Being able to identify the protagonist of a story and compare the individual to other people. Being able to analyze an emotion and identify its parts and how they combine.    
Adjunct Processing: 
The Knowledge Base 
Having knowledge (and remembering analyses) of prior instances of stories. Having knowledge (and remembering analyses) of prior instances of feelings.    
Adjunct Processing: Inputting Information Being able to keep long sentences in memory. Being able to perceive emotions in faces.    


 
 
 

Table 2: Overview of the Four-Branch Model of Emotional Intelligence, with a Focus on Its Relation to Intelligence and Personality
Branches  Description of Measure Relation to Intelligence and Personality
4-Managing Emotion Ability to manage emotions and emotional relationships for personal and interpersonal growth Interface with personality and goals
3-Understanding Emotion Ability to comprehend emotional information about relationships, transitions from one emotion to another, linguistic information about emotions Central locus of abstract processing and reasoning about emotions and emotional information
2-Facilitating Thought with Emotion Ability to harness emotional information and directionality to enhance thinking Calibrates and adjusts thinking so that cognitive tasks make use of emotional information 
1-Perceiving Emotion Ability to identify emotions in faces, pictures  Inputs information to intelligence