{"id":10302,"date":"2019-11-07T02:20:29","date_gmt":"2019-11-07T00:20:29","guid":{"rendered":"https:\/\/www.datanovia.com\/en\/?post_type=dt_courses&#038;p=10302"},"modified":"2019-11-07T07:47:04","modified_gmt":"2019-11-07T05:47:04","slug":"inter-rater-reliability-measures-in-r","status":"publish","type":"dt_courses","link":"https:\/\/www.datanovia.com\/en\/courses\/inter-rater-reliability-measures-in-r\/","title":{"rendered":"Inter-Rater Reliability Measures in R"},"content":{"rendered":"<div id=\"rdoc\">\n<p>The <strong>inter-rater reliability<\/strong> consists of statistical measures for assessing the extent of agreement among two or more raters (i.e., \u201cjudges\u201d, \u201cobservers\u201d). Other synonyms are: <strong>inter-rater agreement<\/strong>, <strong>inter-observer agreement<\/strong> or <strong>inter-rater concordance<\/strong>.<\/p>\n<p>In this course, you will learn the basics and how to compute the different statistical measures for analyzing the inter-rater reliability. These include:<\/p>\n<ul>\n<li><strong><em>Cohen\u2019s Kappa<\/em><\/strong>: It can be used for either two nominal or two ordinal variables. It accounts for strict agreements between observers. It is most appropriate for two nominal variables.<\/li>\n<li><strong><em>Weighted Kappa<\/em><\/strong>: It should be considered for two ordinal variables only. It allows partial agreement.<\/li>\n<li><strong><em>Light\u2019s Kappa<\/em><\/strong>, which is the average of Cohen\u2019s Kappa if using more than two categorical variables.<\/li>\n<li><strong><em>Fleiss Kappa<\/em><\/strong>: for two or more categorical variables (nominal or ordinal)<\/li>\n<li><strong><em>Intraclass correlation coefficient<\/em><\/strong> (ICC) for continuous or ordinal data<\/li>\n<\/ul>\n<p>You will also learn how to <strong>visualize the agreement<\/strong> between raters. The course presents the basic principles of these tasks and provide examples in R.<\/p>\n<div>\n<div class='dt-sc-hr-invisible-medium  '><\/div>\n<div class='dt-sc-ico-content type1'><div class='custom-icon' ><a href='https:\/\/www.datanovia.com\/en\/product\/inter-rater-reliability-essentials-practical-guide-in-r\/' target='_blank'><span class='fa fa-book'><\/span><\/a><\/div><h4><a href='https:\/\/www.datanovia.com\/en\/product\/inter-rater-reliability-essentials-practical-guide-in-r\/' target='_blank'> Related Book <\/a><\/h4>Inter-Rater Reliability Essentials: Practical Guide in R<\/div>\n<div class='dt-sc-hr-invisible-medium  '><\/div>\n<\/div>\n<p>&nbsp;<\/p>\n<\/div>\n<p><!--end rdoc--><\/p>\n","protected":false},"excerpt":{"rendered":"<p>In this course, you will learn the basics and how to compute the different statistical measures for analyzing the inter-rater reliability.<\/p>\n","protected":false},"author":1,"featured_media":8925,"menu_order":0,"comment_status":"open","ping_status":"closed","template":"","class_list":["post-10302","dt_courses","type-dt_courses","status-publish","has-post-thumbnail","hentry","course_category-biostatistics","course_category-categorical-data-analysis"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v25.2 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Inter-Rater Reliability Measures in R : Best Reference - Datanovia<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.datanovia.com\/en\/courses\/inter-rater-reliability-measures-in-r\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Inter-Rater Reliability Measures in R : Best Reference - Datanovia\" \/>\n<meta property=\"og:description\" content=\"In this course, you will learn the basics and how to compute the different statistical measures for analyzing the inter-rater reliability.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.datanovia.com\/en\/courses\/inter-rater-reliability-measures-in-r\/\" \/>\n<meta property=\"og:site_name\" content=\"Datanovia\" \/>\n<meta property=\"article:modified_time\" content=\"2019-11-07T05:47:04+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.datanovia.com\/en\/wp-content\/uploads\/2019\/05\/X52020888_810138415992771_5731484962880749568_n.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1024\" \/>\n\t<meta property=\"og:image:height\" content=\"512\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.datanovia.com\/en\/courses\/inter-rater-reliability-measures-in-r\/\",\"url\":\"https:\/\/www.datanovia.com\/en\/courses\/inter-rater-reliability-measures-in-r\/\",\"name\":\"Inter-Rater Reliability Measures in R : Best Reference - Datanovia\",\"isPartOf\":{\"@id\":\"https:\/\/www.datanovia.com\/en\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.datanovia.com\/en\/courses\/inter-rater-reliability-measures-in-r\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.datanovia.com\/en\/courses\/inter-rater-reliability-measures-in-r\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.datanovia.com\/en\/wp-content\/uploads\/2019\/05\/X52020888_810138415992771_5731484962880749568_n.jpg\",\"datePublished\":\"2019-11-07T00:20:29+00:00\",\"dateModified\":\"2019-11-07T05:47:04+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/www.datanovia.com\/en\/courses\/inter-rater-reliability-measures-in-r\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.datanovia.com\/en\/courses\/inter-rater-reliability-measures-in-r\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.datanovia.com\/en\/courses\/inter-rater-reliability-measures-in-r\/#primaryimage\",\"url\":\"https:\/\/www.datanovia.com\/en\/wp-content\/uploads\/2019\/05\/X52020888_810138415992771_5731484962880749568_n.jpg\",\"contentUrl\":\"https:\/\/www.datanovia.com\/en\/wp-content\/uploads\/2019\/05\/X52020888_810138415992771_5731484962880749568_n.jpg\",\"width\":1024,\"height\":512},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.datanovia.com\/en\/courses\/inter-rater-reliability-measures-in-r\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.datanovia.com\/en\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Courses\",\"item\":\"https:\/\/www.datanovia.com\/en\/courses\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Inter-Rater Reliability Measures in R\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.datanovia.com\/en\/#website\",\"url\":\"https:\/\/www.datanovia.com\/en\/\",\"name\":\"Datanovia\",\"description\":\"Data Mining and Statistics for Decision Support\",\"publisher\":{\"@id\":\"https:\/\/www.datanovia.com\/en\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.datanovia.com\/en\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.datanovia.com\/en\/#organization\",\"name\":\"Datanovia\",\"url\":\"https:\/\/www.datanovia.com\/en\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.datanovia.com\/en\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.datanovia.com\/en\/wp-content\/uploads\/2018\/09\/datanovia-logo.png\",\"contentUrl\":\"https:\/\/www.datanovia.com\/en\/wp-content\/uploads\/2018\/09\/datanovia-logo.png\",\"width\":98,\"height\":99,\"caption\":\"Datanovia\"},\"image\":{\"@id\":\"https:\/\/www.datanovia.com\/en\/#\/schema\/logo\/image\/\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Inter-Rater Reliability Measures in R : Best Reference - Datanovia","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.datanovia.com\/en\/courses\/inter-rater-reliability-measures-in-r\/","og_locale":"en_US","og_type":"article","og_title":"Inter-Rater Reliability Measures in R : Best Reference - Datanovia","og_description":"In this course, you will learn the basics and how to compute the different statistical measures for analyzing the inter-rater reliability.","og_url":"https:\/\/www.datanovia.com\/en\/courses\/inter-rater-reliability-measures-in-r\/","og_site_name":"Datanovia","article_modified_time":"2019-11-07T05:47:04+00:00","og_image":[{"width":1024,"height":512,"url":"https:\/\/www.datanovia.com\/en\/wp-content\/uploads\/2019\/05\/X52020888_810138415992771_5731484962880749568_n.jpg","type":"image\/jpeg"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.datanovia.com\/en\/courses\/inter-rater-reliability-measures-in-r\/","url":"https:\/\/www.datanovia.com\/en\/courses\/inter-rater-reliability-measures-in-r\/","name":"Inter-Rater Reliability Measures in R : Best Reference - Datanovia","isPartOf":{"@id":"https:\/\/www.datanovia.com\/en\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.datanovia.com\/en\/courses\/inter-rater-reliability-measures-in-r\/#primaryimage"},"image":{"@id":"https:\/\/www.datanovia.com\/en\/courses\/inter-rater-reliability-measures-in-r\/#primaryimage"},"thumbnailUrl":"https:\/\/www.datanovia.com\/en\/wp-content\/uploads\/2019\/05\/X52020888_810138415992771_5731484962880749568_n.jpg","datePublished":"2019-11-07T00:20:29+00:00","dateModified":"2019-11-07T05:47:04+00:00","breadcrumb":{"@id":"https:\/\/www.datanovia.com\/en\/courses\/inter-rater-reliability-measures-in-r\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.datanovia.com\/en\/courses\/inter-rater-reliability-measures-in-r\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.datanovia.com\/en\/courses\/inter-rater-reliability-measures-in-r\/#primaryimage","url":"https:\/\/www.datanovia.com\/en\/wp-content\/uploads\/2019\/05\/X52020888_810138415992771_5731484962880749568_n.jpg","contentUrl":"https:\/\/www.datanovia.com\/en\/wp-content\/uploads\/2019\/05\/X52020888_810138415992771_5731484962880749568_n.jpg","width":1024,"height":512},{"@type":"BreadcrumbList","@id":"https:\/\/www.datanovia.com\/en\/courses\/inter-rater-reliability-measures-in-r\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.datanovia.com\/en\/"},{"@type":"ListItem","position":2,"name":"Courses","item":"https:\/\/www.datanovia.com\/en\/courses\/"},{"@type":"ListItem","position":3,"name":"Inter-Rater Reliability Measures in R"}]},{"@type":"WebSite","@id":"https:\/\/www.datanovia.com\/en\/#website","url":"https:\/\/www.datanovia.com\/en\/","name":"Datanovia","description":"Data Mining and Statistics for Decision Support","publisher":{"@id":"https:\/\/www.datanovia.com\/en\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.datanovia.com\/en\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.datanovia.com\/en\/#organization","name":"Datanovia","url":"https:\/\/www.datanovia.com\/en\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.datanovia.com\/en\/#\/schema\/logo\/image\/","url":"https:\/\/www.datanovia.com\/en\/wp-content\/uploads\/2018\/09\/datanovia-logo.png","contentUrl":"https:\/\/www.datanovia.com\/en\/wp-content\/uploads\/2018\/09\/datanovia-logo.png","width":98,"height":99,"caption":"Datanovia"},"image":{"@id":"https:\/\/www.datanovia.com\/en\/#\/schema\/logo\/image\/"}}]}},"multi-rating":{"mr_rating_results":[{"adjusted_star_result":5,"star_result":5,"total_max_option_value":5,"adjusted_score_result":5,"score_result":5,"percentage_result":100,"adjusted_percentage_result":100,"count":2,"post_id":10302}]},"_links":{"self":[{"href":"https:\/\/www.datanovia.com\/en\/wp-json\/wp\/v2\/dt_courses\/10302","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.datanovia.com\/en\/wp-json\/wp\/v2\/dt_courses"}],"about":[{"href":"https:\/\/www.datanovia.com\/en\/wp-json\/wp\/v2\/types\/dt_courses"}],"author":[{"embeddable":true,"href":"https:\/\/www.datanovia.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.datanovia.com\/en\/wp-json\/wp\/v2\/comments?post=10302"}],"version-history":[{"count":0,"href":"https:\/\/www.datanovia.com\/en\/wp-json\/wp\/v2\/dt_courses\/10302\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.datanovia.com\/en\/wp-json\/wp\/v2\/media\/8925"}],"wp:attachment":[{"href":"https:\/\/www.datanovia.com\/en\/wp-json\/wp\/v2\/media?parent=10302"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}