A Comparison of Two Scaling Methods: Pair Wise Comparison and Rank-Order Judgments Scaling
Journal Name:
- Eğitim Bilimleri Araştırmaları Dergisi (EBAD)
Keywords (Original Language):
Author Name | University of Author | Faculty of Author |
---|---|---|
Abstract (2. Language):
Scaling was initially used in psychophysics, which is a subfield of psychology.
Scaling can be considered as a process of developing a scaling tool and ranking the collected
data at equal intervals according to the decided scale. The scaling operation is conducted
according to the judgment and reaction rule. The judgment rule is a stimulus—oriented
approach that takes an expert’s opinions into consideration. For the reaction rule, the scaling
operation is done according to the reactions of the subjects.
In the stimulus—oriented rule approach, stimulants are scaled by an observer’s or
expert’s opinions. The paired comparison method, used within the judgment approach, was
developed by Louis Leon Thurstone, and it has been used in psychology research (especially
cognitive psychology) for 10 years. Simple paired comparison is a simple method. Within the
paired comparison approach, the stimulant sets or items are decided by the researcher.
Observers are provided with all of the possible pairs and required to compare these pairs
according to a better particular criterion. An advantage of this approach is its inclusion of
both simple and comparative judgments.
When applying the comparative judgment rule, five situations take place. Of these
situations, the most preferred ones are the third and fifth, which are simplified situations of
the comparative judgment rule. While in the fifth situation, equation discrimination
judgments are accepted as equal, in the third situation, equation discrimination judgments
are not accepted as equal, and the variances are found one by one, as well. The fifth
situation’s method is considered economical since it accepts the variances as equal (normally
the difference between the variances are large).
Scaling operation based on rank order judgments can be applied to all stimuli that
can provide a rank number. In this method, observers/judges are provided all of the stimuli.
Judges are required to compare each stimulus with others to ascertain a rank number. Thus,
all of the stimuli are converted into a unified standard against which they are compared.
Values obtained from the ranking judgments of the stimuli are compared with that unified
standard and scale values are acquired. This method can be applied to all stimuli that can be
assigned a rank number.
Although, studies have been conducted on multidimensional scaling, in both Turkey
and abroad, literature on scaling techniques is limited. Thus, this study focuses on paired
comparison and rank-order judgments scaling techniques and examines the consistency
between results gathered by using them. The purpose of this research is to determine the relationship between scaling values obtained from ranking judgment and pairwise
comparison.
Bookmark/Search this post with
Abstract (Original Language):
Çalışmanın amacı, yargıcı kararlarına dayalı ölçekleme yöntemlerinden ikili karşılaştırma ve
sıralama yargılarına dayalı ölçekleme yöntemlerinden elde edilen ölçek değerleri arasındaki
tutarlılığı belirlemektir. Bu amaç doğrultusunda, eğitim fakültesinde öğrenim görmekte olan
395 dördüncü sınıf öğrencilerinden ölçme ve değerlendirme dersini tekrar alma gibi bir
şansları olsaydı bu dersin ağırlıklı olarak hangi öğretim yöntemine göre yürütülmesi
gerektiğine ilişkin olarak görüşleri alınmıştır. İkili karşılaştırmaya dayalı ölçekleme
sonucunda öğrenciler tarafından ölçme ve değerlendirme dersinin ağırlıklı olarak
yürütülmesi gereken en önemli yöntem ‚Örnek Olay Yöntemi‛ ardından sırasıyla gösterip
yaptırma, problem çözme, tartışma ve bireysel çalışma ve son sırada anlatma yöntemi;
sıralama yargılarına dayalı olarak yapılan ölçekleme sonucunda ise benzer şekilde ilk sırada
‚Örnek Olay Yöntemi‛ ardından sırasıyla gösterip yaptırma, tartışma, problem çözme,
anlatma ve son sırada bireysel çalışma yöntemi yer almaktadır. Her iki yöntemle elde edilen
ölçek değerleri arasındaki tutarlılığı belirlemek amacıyla Spearman-Brown sıra farkları
korelâsyon katsayısı hesaplanmıştır. Elde edilen sonuca göre iki ölçekleme yöntemi benzer
sonuçlar üretmektedir.
FULL TEXT (PDF):
- 1
105-119