{"id":10406,"date":"2019-11-14T02:15:56","date_gmt":"2019-11-14T00:15:56","guid":{"rendered":"https:\/\/www.datanovia.com\/en\/?p=10406"},"modified":"2019-11-14T02:29:10","modified_gmt":"2019-11-14T00:29:10","slug":"kappa-coefficient-interpretation","status":"publish","type":"post","link":"https:\/\/www.datanovia.com\/en\/blog\/kappa-coefficient-interpretation\/","title":{"rendered":"Kappa Coefficient Interpretation"},"content":{"rendered":"
\n

This article describes how to interpret the kappa coefficient<\/strong>, which is used to assess the inter-rater reliability or agreement.<\/p>\n

In most applications, there is usually more interest in the magnitude of kappa than in the statistical significance of kappa. The following classifications has been suggested to interpret the strength of the agreement based on the Cohen\u2019s Kappa value (Altman 1999, Landis JR (1977)<\/span>)<\/span>.<\/p>\n\n\n\n\n\n\n\n\n\n\n
Value of k<\/th>\nStrength of agreement<\/th>\n<\/tr>\n<\/thead>\n
< 0<\/td>\nPoor<\/td>\n<\/tr>\n
0.01 - 0.20<\/td>\nSlight<\/td>\n<\/tr>\n
0.21-0.40<\/td>\nFair<\/td>\n<\/tr>\n
0.41-0.60<\/td>\nModerate<\/td>\n<\/tr>\n
0.61-0.80<\/td>\nSubstantial<\/td>\n<\/tr>\n
0.81 - 1.00<\/td>\nAlmost perfect<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

However, this interpretation allows for very little agreement among raters to be described as \u201csubstantial\u201d. According to the table 61% agreement is considered as good, but this can immediately be seen as problematic depending on the field. Almost 40% of the data in the dataset represent faulty data. In healthcare research, this could lead to recommendations for changing practice based on faulty evidence. For a clinical laboratory, having 40% of the sample evaluations being wrong would be an extremely serious quality problem (McHugh 2012)<\/span>.<\/p>\n

This is the reason that many texts recommend 80% agreement as the minimum acceptable inter-rater agreement. Any kappa below 0.60 indicates inadequate agreement among the raters and little confidence should be placed in the study results.<\/p>\n

\n

Fleiss et al. (2003) stated that for most purposes,<\/p>\n