Interobserver Agreement Among Uveitis Experts on Uveitic Diagnoses: The Standardization of Uveitis Nomenclature Experience

Research output: Contribution to journalArticlepeer-review

Standard

Interobserver Agreement Among Uveitis Experts on Uveitic Diagnoses: The Standardization of Uveitis Nomenclature Experience. / Jabs, Douglas A.; Dick, Andrew; Doucette, John T.; Gupta, Amod; Lightman, Susan; McCluskey, Peter; Okada, Annabelle A.; Palestine, Alan G.; Rosenbaum, James T.; Saleem, Sophia M.; Thorne, Jennifer; Trusko, Brett; Murray, Philip; Standardization of Uveitis Nomenclature Working Group (SUN).

In: American Journal of Ophthalmology, Vol. 186, 01.02.2018, p. 19-24.

Research output: Contribution to journalArticlepeer-review

Harvard

Jabs, DA, Dick, A, Doucette, JT, Gupta, A, Lightman, S, McCluskey, P, Okada, AA, Palestine, AG, Rosenbaum, JT, Saleem, SM, Thorne, J, Trusko, B, Murray, P & Standardization of Uveitis Nomenclature Working Group (SUN) 2018, 'Interobserver Agreement Among Uveitis Experts on Uveitic Diagnoses: The Standardization of Uveitis Nomenclature Experience', American Journal of Ophthalmology, vol. 186, pp. 19-24. https://doi.org/10.1016/j.ajo.2017.10.028

APA

Jabs, D. A., Dick, A., Doucette, J. T., Gupta, A., Lightman, S., McCluskey, P., Okada, A. A., Palestine, A. G., Rosenbaum, J. T., Saleem, S. M., Thorne, J., Trusko, B., Murray, P., & Standardization of Uveitis Nomenclature Working Group (SUN) (2018). Interobserver Agreement Among Uveitis Experts on Uveitic Diagnoses: The Standardization of Uveitis Nomenclature Experience. American Journal of Ophthalmology, 186, 19-24. https://doi.org/10.1016/j.ajo.2017.10.028

Vancouver

Author

Jabs, Douglas A. ; Dick, Andrew ; Doucette, John T. ; Gupta, Amod ; Lightman, Susan ; McCluskey, Peter ; Okada, Annabelle A. ; Palestine, Alan G. ; Rosenbaum, James T. ; Saleem, Sophia M. ; Thorne, Jennifer ; Trusko, Brett ; Murray, Philip ; Standardization of Uveitis Nomenclature Working Group (SUN). / Interobserver Agreement Among Uveitis Experts on Uveitic Diagnoses: The Standardization of Uveitis Nomenclature Experience. In: American Journal of Ophthalmology. 2018 ; Vol. 186. pp. 19-24.

Bibtex

@article{9dccd149650947f398061db2ab387187,
title = "Interobserver Agreement Among Uveitis Experts on Uveitic Diagnoses:: The Standardization of Uveitis Nomenclature Experience",
abstract = "Purpose: To evaluate the interobserver agreement among uveitis experts on the diagnosis of the specific uveitic disease. Design: Interobserver agreement analysis. Methods: Five committees, each comprised of 9 individuals and working in parallel, reviewed cases from a preliminary database of 25 uveitic diseases, collected by disease, and voted independently online whether the case was the disease in question or not. The agreement statistic, κ, was calculated for the 36 pairwise comparisons for each disease, and a mean κ was calculated for each disease. After the independent online voting, committee consensus conference calls, using nominal group techniques, reviewed all cases not achieving supermajority agreement (>75%) on the diagnosis in the online voting to attempt to arrive at a supermajority agreement. Results: A total of 5766 cases for the 25 diseases were evaluated. The overall mean κ for the entire project was 0.39, with disease-specific variation ranging from 0.23 to 0.79. After the formalized consensus conference calls to address cases that did not achieve supermajority agreement in the online voting, supermajority agreement overall was reached on approximately 99% of cases, with disease-specific variation ranging from 96% to 100%. Conclusions: Agreement among uveitis experts on diagnosis is moderate at best but can be improved by discussion among them. These data suggest the need for validated and widely used classification criteria in the field of uveitis.",
author = "Jabs, {Douglas A.} and Andrew Dick and Doucette, {John T.} and Amod Gupta and Susan Lightman and Peter McCluskey and Okada, {Annabelle A.} and Palestine, {Alan G.} and Rosenbaum, {James T.} and Saleem, {Sophia M.} and Jennifer Thorne and Brett Trusko and Philip Murray and {Standardization of Uveitis Nomenclature Working Group (SUN)}",
year = "2018",
month = feb,
day = "1",
doi = "10.1016/j.ajo.2017.10.028",
language = "English",
volume = "186",
pages = "19--24",
journal = "American Journal of Ophthalmology",
issn = "0002-9394",
publisher = "Elsevier",

}

RIS

TY - JOUR

T1 - Interobserver Agreement Among Uveitis Experts on Uveitic Diagnoses:

T2 - The Standardization of Uveitis Nomenclature Experience

AU - Jabs, Douglas A.

AU - Dick, Andrew

AU - Doucette, John T.

AU - Gupta, Amod

AU - Lightman, Susan

AU - McCluskey, Peter

AU - Okada, Annabelle A.

AU - Palestine, Alan G.

AU - Rosenbaum, James T.

AU - Saleem, Sophia M.

AU - Thorne, Jennifer

AU - Trusko, Brett

AU - Murray, Philip

AU - Standardization of Uveitis Nomenclature Working Group (SUN)

PY - 2018/2/1

Y1 - 2018/2/1

N2 - Purpose: To evaluate the interobserver agreement among uveitis experts on the diagnosis of the specific uveitic disease. Design: Interobserver agreement analysis. Methods: Five committees, each comprised of 9 individuals and working in parallel, reviewed cases from a preliminary database of 25 uveitic diseases, collected by disease, and voted independently online whether the case was the disease in question or not. The agreement statistic, κ, was calculated for the 36 pairwise comparisons for each disease, and a mean κ was calculated for each disease. After the independent online voting, committee consensus conference calls, using nominal group techniques, reviewed all cases not achieving supermajority agreement (>75%) on the diagnosis in the online voting to attempt to arrive at a supermajority agreement. Results: A total of 5766 cases for the 25 diseases were evaluated. The overall mean κ for the entire project was 0.39, with disease-specific variation ranging from 0.23 to 0.79. After the formalized consensus conference calls to address cases that did not achieve supermajority agreement in the online voting, supermajority agreement overall was reached on approximately 99% of cases, with disease-specific variation ranging from 96% to 100%. Conclusions: Agreement among uveitis experts on diagnosis is moderate at best but can be improved by discussion among them. These data suggest the need for validated and widely used classification criteria in the field of uveitis.

AB - Purpose: To evaluate the interobserver agreement among uveitis experts on the diagnosis of the specific uveitic disease. Design: Interobserver agreement analysis. Methods: Five committees, each comprised of 9 individuals and working in parallel, reviewed cases from a preliminary database of 25 uveitic diseases, collected by disease, and voted independently online whether the case was the disease in question or not. The agreement statistic, κ, was calculated for the 36 pairwise comparisons for each disease, and a mean κ was calculated for each disease. After the independent online voting, committee consensus conference calls, using nominal group techniques, reviewed all cases not achieving supermajority agreement (>75%) on the diagnosis in the online voting to attempt to arrive at a supermajority agreement. Results: A total of 5766 cases for the 25 diseases were evaluated. The overall mean κ for the entire project was 0.39, with disease-specific variation ranging from 0.23 to 0.79. After the formalized consensus conference calls to address cases that did not achieve supermajority agreement in the online voting, supermajority agreement overall was reached on approximately 99% of cases, with disease-specific variation ranging from 96% to 100%. Conclusions: Agreement among uveitis experts on diagnosis is moderate at best but can be improved by discussion among them. These data suggest the need for validated and widely used classification criteria in the field of uveitis.

U2 - 10.1016/j.ajo.2017.10.028

DO - 10.1016/j.ajo.2017.10.028

M3 - Article

VL - 186

SP - 19

EP - 24

JO - American Journal of Ophthalmology

JF - American Journal of Ophthalmology

SN - 0002-9394

ER -