Buradasınız

Anasayfa » Content

Olumsuz test ifadelerinin iç tutarlılığa ve faktör yapısına etkileri

Effects of negatively phrased test items on internal consistency and factor structure

Journal Name:

  • İstanbul Üniversitesi İşletme Fakültesi Dergisi

Publication Year:

  • 2013

Key Words:

Keywords (Original Language):

Author NameUniversity of AuthorFaculty of Author
Abstract (2. Language): 
The aim of this research is to investigate the systematic measurement errors caused by scales consisting negatively phrased items. Meyer, Allen and Smith’s organizational commitment scale is used in order to investigate this issue. The original version of this scale (consisting of both positively and negatively phrased items) and another version in which the negatively phrased items are transformed into positive phrasing, are tested on two samples that are equal to each other in terms of gender, age and education level. Samples are formed of participants working in service sector. Findings are in parallel with previous findings suggesting that negatively phrased items cause systematic measurement errors. Item-total correlation of the negatively phrased items are found to be very low. The item-total correlation of those negatively phrased items increased when they were transformed into positive phrasing. Factor analysis of the scale which consists of negatively phrased items show that those items form a seperate factor apart from the original factor. Whereas, when the negatively phrased items are transformed into positive phrasing, the original factor structure of the scale is supported.
Bookmark/Search this post with
Abstract (Original Language): 
Bu araştırma karma ifadeli ölçeklerin sebep olduğu sistematik ölçüm hatalarını incelemek amacıyla yapılmıştır. Bu amaçla Meyer, Allen ve Smith’in örgüte bağlılık ölçeği kullanılmıştır. Bu ölçeğin hem karma ifadeli (olumlu ve olumsuz ifadelerden oluşan) orijinal sürümü hem de olumsuz ifadelerin olumluya dönüştürüldüğü diğer bir sürümü, İstanbul’da hizmet sektöründe çalışanlardan oluşan; yaş, cinsiyet, eğitim seviyesi ve çalışma süresi gibi özellikleri bakımından birbirine denk iki örneklem üzerinde test edilmiştir. Elde edilen veriler olumsuz ifadelerin sistematik ölçüm hatalarına sebep olduğuna dair bulgularla örtüşmüştür. Olumsuz ifadelerin ifade-toplam korelasyonları oldukça düşük çıkmıştır. Olumsuz ifadeler olumlu forma dönüştürüldüğünde ifade-toplam korelasyonları önemli ölçüde yükselmiştir. Ayrıca, karma ifadeli ölçeğe uygulanan faktör analizinde olumsuz ifadelerin ait oldukları kavramdan koparak kendi aralarında ayrı bir faktör oluşturdukları gözlenmiştir. Oysa olumsuz ifadeler olumluya dönüştürüldüğünde faktör analizi kavramın öngörülen çok boyutlu yapısını desteklemiştir.
FULL TEXT (PDF): 
PDF icon arastirmax-olumsuz-test-ifadelerinin-ic-tutarliliga-faktor-yapisina-etkileri.pdf
  • 2
319
332
  • Turkish

REFERENCES

References: 

[1] R. Likert, The Method of Constructing an Attitude Scale, in M. Fishbein, (Ed) Readings in Attitude Theory and Measurement, New York, John Willey & Sons, 1967, 90-95.
[2] G. Marin, R. J. Gamba, B. V. Marin, Extreme Response Style and Acquiescence among Hispanics: The Role of Acculturation and Education. Journal of Cross-Cultural Psychology, 23, 498–509 (1992).
[3] F. Meloni, K. Gana, Wording Effects in the Italian Version of the Penn State Worry Questionnaire. Clinical Psychology and Psychotherapy, 8, 282–287 (2001).
[4] J-B. E. M. Steenkamp, S. Burgess, Optimum Stimulation Level and Exploratory Consumer Behavior in an Emerging Consumer Market. International Journal of Research in Marketing, 19, 131–150 (2002).
[5] N. Wong, A. Rindfleisch, J.E. Burroughs, Do Reverse-Worded Items Confound Measures in Cross-Cultural Consumer Research? The Case of the Material Values Scale. Journal of Consumer Research, 30, 72-91 (2003).
[6] A. Anastasi, Psychological Testing, 5th edition, New York: Macmillan, 1982.
[7] J. C. Nunnally, Psychometric Theory, New York: McGraw-Hill, 1978.
[8] P. M. Podsakoff, S. B. MacKenzie, J-Y. Lee, M. P. Podsakoff, Common Method Biases in Behavioral Research: A Critical Review of the Literature and Recommended Remedies. Journal of Applied Psychology, 88, 879-903 (2003).
[9] H. W. Marsh, Positive and Negative Global Self-Esteem: A Substantively Meaningful Distinction or Artifacts?. Journal of Personality and Social Psychology, 70, 810-819 (1996).
[10] J. Benson, D. Hocevar, The Impact of Item Phrasing on the Validity of Attitude Scales for Elementary School Children. Journal of Educational Measurement, 22, 231-240 (1985)
[11] Y-H. Chen, G. Rendina-Gobioff, R. F. Dedrick, Factorial Invariance of a Chinese Self-Esteem Scale for Third and Sixth Grade Students: Evaluating Method Effects Associated with Positively and Negatively Worded Items. The International Journal of Educational and Psychological Assessment, 6, 21-35 (2010).
[12] S-T. Cheng, P. N. Hamid, Dispositional Optimism in Chinese People: What Does the Life Orientation Test Measure?. International Journal of Psychology, 32, 15–22 (1997).
[13] N. Schmitt, D. Stults, Factors Defined by Negatively Keyed Items: The Result of Careless Respondents?. Applied Psychological Measurement, 4, 367-373 (1985).
[14] G. H. Weems, A. J. Onwuegbuzie, K. M. T. Collins, The Role of Reading Comprehension in Responses to Positively and Negatively Worded Items on Rating Scales. Evaluation and Research in Education, 19, 3-20 (2006).
[15] R. R. Holden, G. C. Fekken, Structured Psychopathological Test Item Characteristics and Validity. Psychological Assessment, 2, 35–40 (1990).
[16] A. M. Ibrahim, Differential Responding to Positive and Negative Items: The Case of a Negative Item in a Questionnaire for Course and Faculty Evaluation. Psychological Reports, 88, 497-500 (2001).
T. Turgut, N.S. Erden / İstanbul Üniversitesi İşletme Fakültesi Dergisi 42, 2, (2013) 319-332 © 2013
330
[17] W. J. Pilotte, R. K. Gable, The Impact of Positive and Negative Item Stems on the Validity of a Computer Anxiety Scale. Educational and Psychological Measurement, 50, 603-609 (1990).
[18] C. A. Schriesheim, R. J. Eisenbach, K. D. Hill, The Effect of Negation and Polar Opposite Item Reversals on Questionnaire Reliability and Validity: An Experimental Investigation. Educational and Psychological Measurement, 51, 67-78 (1991).
[19] S. A. Melnick ve R. K. Gable, The Use of Negative Item Stems: A Cautionary Note. Educational Research Quarterly, 14, 31-36 (1990).
[20] N. Iwata, C. R. Roberts, N. Kawakami, Japan-U.S. Comparison of Responses to Depression Scale Items among Adult Workers. Psychiatry Research, 58, 237-245 (1995).
[21] K. Nakano, Psychometric Evaluation of the Japanese Adaptation of the Aggression Questionnaire. Behaviour Research and Therapy, 39, 853–858 (2001).
[22] D. P. Schmitt, J. Allik, Simultaneous Administration of the Rosenberg Self-Esteem in 53 Nations: Exploring the Universal and Culture-Specific Features of Global Self-Esteem. Journal of Personality and Social Psychology, 89, 623-642 (2005).
[23] L. Chang, C. McBride-Chang, The Factor Structure of the Life Orientation Test. Educational and Psychological Measurement, 56, 325-329 (1996).
[24] J. C. L. Lai, X. Yue, Measuring Optimism in Hong Kong and Mainland Chinese with the Revised Life Orientation Test. Personality and Individual Differences, 28, 781–796 (2000).
[25] T. Suzuki, K. Tsukamoto, K. Abe, Characteristic Factor Structures of the Japanese Version of the State-Trait Anxiety Inventory: Coexistence of Positive-Negative and State-Trait Factor Structures. Journal of Personality Assessment, 74, 447–458 (2000).
[26] D. K. Mroczek, A. Spiro, C. M. Aldwin, D. J. Ozer, R. Bosse, Construct Validation of Optimism and Pessimism in Older Men: Findings from the Normative Aging Study. Health Psychology, 12, 406-409 (1993).
[27] M. F. Scheier, C. S. Carver, Optimism, Coping and Health: Assessment and Implications of Generalized Outcome Expectancies. Health Psychology, 4, 219-247 (1985).
[28] T. A. Brown, M. M. Antony, D. H. Barlow, Psychometric Properties of the Penn State Worry Questionnaire in a Clinical Anxiety Disorders Sample. Behaviour Research and Therapy, 30, 33–37 (1992).
[29] T. J. Meyer, M. L. Miller, R. L. Metzger, T. J. Borkovec, Development and Validation of the Penn State Worry Questionnaire. Behaviour Research and Therapy, 28, 487–495 (1990).
[30] R. Ladouceur, M. H. Freeston, J. Rheaume, H. Letarte, J. Dumont, Translation and Validation of a French Version of the Penn State Worry Questionnaire. Canadian Psychology, 33, 241 (1992).
[31] S. Pallesen, I. H. Nordhus, B. Carlstedt, J. F. Thayer, T. B. Johnsen, A Norwegian Adaptation of the Penn State Worry Questionnaire: Factor Structure, Reliability, Validity and Norms. Scandinavian Journal of Psychology, 47, 281-291 (2006).
[32] M. Boysan, S. Keskin, L. Beşiroğlu, Penn State Endişe Ölçeği Türkçe Formunun Hiyerarşik Faktör Yapısı, Geçerlik ve Güvenilirliği. Klinik Psikofarmakoloji Bülteni, 18, 174-182 (2008).
T. Turgut, N.S. Erden / İstanbul Üniversitesi İşletme Fakültesi Dergisi 42, 2, (2013) 319-332 © 2013
331
[33] S. Van Rijsoort, P. Emmelkamp, G. Vervaeke, The Penn State Worry Questionnaire and the Worry Domains Questionnaire: Structure, Reliability and Validity. Clinical Psychology and Psychotherapy, 6, 297–307 (1999).
[34] J. Stöber, Reliability and Validity of Two Widely-Used Worry Questionnaires: Self-report and Self-peer Convergence. Personality and Individual Differences, 24, 887–890 (1998).
[35] M. F. Schmitz, J. C. Baer, The Vicissitudes of Measurement: A Confirmatory Factor Analysis of the Emotional Autonomy Scale. Child Development, 72, 207-219 (2001).
[36] Ö. Akarsu, The Relationship between TQM Applications and Organizational Commitment Regarding the Effect of Organizational Culture. Yüksek Lisans Tezi, Marmara Üniversitesi Sosyal Bilimler Enstitüsü, 2006.
[37] Ü. Çolakoğlu, T. Ayyıldız, S. Cengiz, Çalışanların Demografik Özelliklerine Göre Örgütsel Bağlılık Boyutlarında Algılama Farklılıkları: Kuşadası’ndaki Beş Yıldızlı Konaklama İşletmeleri Örneği. Anatolia: Turizm Araştırmaları Dergisi, 20, 77-89 (2009).
[38] Ö. Uzun, E. Yiğit, Örgütsel Stres ve Örgütsel Bağlılık İlişkisi Üzerine Orta Kademe Otel Yöneticileri Üzerinde Yapılan Bir Araştırma. Eskişehir Osmangazi Üniversitesi İİBF Dergisi, 6, 181‐213 (2011).
[39] B. Candan, H. G. Çekmecelioğlu, İçsel Pazarlama Faaliyetlerinin Örgütsel Bağlılık Unsurları Açısından Değerlendirilmesi: Bir Araştırma. Yönetim, 20 (2009).
[40] A. Ceylan, G. Çöl, H. Gül, İşin Anlamlılığını Belirleyen Sosyal-Yapısal Özelliklerin Güçlendirmeye olan Etkileri ve Sonuçları Üzerine bir Araştırma. Doğuş Üniversitesi Dergisi, 6, 35-51 (2005).
[41] A. B. Güneşer, The Effect of Person-Organization Fit on Organizational Commitment and Work Engagement: The Role of Person Supervisor Fit. Doktora Tezi, Marmara Üniversitesi Sosyal Bilimler Enstitüsü, 2007.
[42] J. P. Meyer, N. J. Allen, C. A. Smith, Commitment to Organizations and Occupation: Extension and Test of Three-Component Conceptualization. Journal of Applied Psychology, 78, 538-551 (1993).
[43] R. L. Gorusch, Factor Analysis, 2nd ed, Hillsdale, N.J: Lawrence Erlbaum Associates, 1983.
[44] G. Ç. Gürkan, Örgütsel Bağlılık: Örgütsel İklimin Örgütsel Bağlılık Üzerindeki Etkisi ve Trakya Üniversitesinde Örgüt İklimi ile Örgütsel Bağlılık Arasındaki İlişkinin Araştırılması. Yüksek Lisans Tezi, Trakya Üniversitesi Sosyal Bilimler Enstitüsü, 2006.
[45] J. F. Hair, R. E. Anderson, R. L. Tatham, W. C. Black, Multivariate Data Analysis, Prentice Hall, New Jersey, 1998.
[46] G. Low, Intensifiers and Hedges in Questionnaire Items and the Lexical Invisibility Hypothesis. Applied Linguistics, 17, 1-37 (1996).
[47] C. M. Woods, Careless Responding to Reverse-worded items: Implications for Confirmatory Factor Analysis. Journal of Psychopathology and Behavioral Assessment, 28, 186–191 (2006).
[48] J. L. Cordery, P. P. Sevastos, Responses to the Original and Revised Job Diagnostic Survey: Is Education a Factor in Responses to Negatively worded items?. Journal of Applied Psychology, 78, 141–143 (1993).
T. Turgut, N.S. Erden / İstanbul Üniversitesi İşletme Fakültesi Dergisi 42, 2, (2013) 319-332 © 2013
332
[49] S. A. Williams, M. S. Swanson, The Effect of Reading Ability and Response Formats on Patients’ Abilities to Respond to a Patient Satisfaction Scale. The Journal of Continuing Education in Nursing, 32, 60-67 (2001).
[50] M. J. Roszkowski, M. Soven, Shifting Gears: Consequences of Including Two Negatively Worded Items in the Middle of a Positively Worded Questionnaire. Assessment and Evaluation in Higher Education, 35, 117–134 (2010).
[51] G. H. Weems, A. J. Onwuegbuzie, D. C. Lustig, Profiles of Respondents Who Respond Inconsistently to Positively- and Negatively-worded Items on Rating Scales. Evaluation and Research in Education, 17, 45-60 (2003).

Thank you for copying data from http://www.arastirmax.com