Research Article


DOI :10.26650/IUITFD.1037033   IUP :10.26650/IUITFD.1037033    Full Text (PDF)

INTER- AND INTRA-OBSERVER RELIABILITY OF THE MIRELS’ SCORING SYSTEM FOR THE DETERMINATION OF PATHOLOGICAL FRACTURE RISK IN METASTATIC BONE LESIONS AMONG ORTHOPEDIC SURGEONS WITH DIFFERENT LEVELS OF EXPERTISE

Emre KocazeybekEmre MeriçHasan Memet ChouseinAhmet Müçteba YıldırımYavuz SağlamAli ErşenAhmet Salduz

Objective: To assess inter- and intra-observer reliability of Mirels scoring for the determination of pathological fracture risk in metastatic bone lesions of 30 patients among six different levels of experienced orthopedic surgeons who were trained in the same university clinic. Material and Methods: Thirty patients were randomly selected from oncology unit consultations. Six observers were selected in accordance to their orthopedic experience. Mirels parameters except pain were evaluated by observers on two different times without the observers being aware of each other. Results: The Fleiss’ Kappa values were detected as κ=0.21, p<0.0001, and κ=0.15, p<0.0001 by inter-observers at the first and second observational points, respectively. The Kappa values were in perfect (κ=0.95), fair (κ=0.27) and fair (κ=0.10) agreements for the region, size and type of the metastatic involvement by inter-observers at the first observational point. The same parameters had similiar scores as κ=0.83, κ=0.13 and κ=0.28 for region, size and type for the second observation. Fair (κ=0.333), moderate (κ=0.413), fair (κ=0.225), slight (κ=0.035), fair (κ=0.369 and poor (κ=0.030) evidence of agreements were detected in the comparison of the first and second observations for total scores in seniority order. Conclusions: Kappa analysis showed perfect agreement for region, but slight to fair for size and type. There was a significant difference in overall scores across experience levels for the most and least experienced observers. A new rating system with revised parameters may be required to predict impending fractures.

DOI :10.26650/IUITFD.1037033   IUP :10.26650/IUITFD.1037033    Full Text (PDF)

METASTATİK KEMİK LEZYONLARINDA PATOLOJİK KIRIK RİSKİNİN BELİRLENMESİNDE KULLANILAN MİRELS SKORLAMASININ FARKLI KIDEMLERDEKİ ORTOPEDİK CERRAHLAR ARASINDAKİ GÜVENİLİRLİĞİ

Emre KocazeybekEmre MeriçHasan Memet ChouseinAhmet Müçteba YıldırımYavuz SağlamAli ErşenAhmet Salduz

Amaç: Bu çalışmanın amacı, metastatik kemik lezyonları nedeniyle oluşan patolojik kırık riskinin tespiti için geliştirilmiş Mirels skorlamasının, metastatik lezyon tanısı alan 30 hastada aynı üniversite kliniğinde eğitim almış altı farklı tecrübedeki ortopedist arasındaki güvenilirliğini değerlendirmekti. Gereç ve Yöntem: Şiddetli veya en az orta derecede ekstremite ağrısı nedeniyle onkoloji birimi tarafından konsülte edilen rastgele 30 hasta seçildi. Ağrı dışındaki parametreler gözlemciler tarafından bir ay arayla birbirlerinden habersiz olarak değerlendirildi. Bulgular: Gözlemciler arasındak Fleiss’ Kappa değerleri, sırasıyla birinci ve ikinci gözlem noktalarında κ=0,21, p<0,0001 ve κ=0,15, p<0,0001 olarak tespit edildi. İlk değerlendirmede gözlemciler arası metastatik tutulumun lokalizasyonu, boyutu ve tipi için Kappa değerleri sırasıyla mükemmel (κ=0,95), zayıf (κ=0,27) ve zayıf (κ=0,10) olarak bulundu. Aynı parametreler bir ay arayla ikinci kere değerlendirildiğinde ise lezyonun lokalizasyonu, boyutu ve tipi için κ=0.83, κ=0.13 ve κ=0.28 olarak benzer puanlara sahipti. Gözlemcilerin kendi içlerinde, iki farklı zaman diliminde ağrı olmadan diğer parametrelere verdikleri cevapların toplamdaki skorları kıdem sırasına göre zayıf (κ=0,333), orta (κ=0,413), zayıf (κ=0,225), önemsiz düzeyde (κ=0,035), zayıf (κ=0,369) ve kötü (κ= -0,030) olarak görüldü. Sonuç: Kappa analizine göre gözlemciler arasında lezyonun lokasyonu için mükemmel uyum görülürken, lezyonun tipi ve boyutu içinse önemsiz düzeyde ve zayıf bir uyum görülmüştür. Total skorlarda en deneyimli ve en az deneyimli gözlemciler arasında önemli bir fark tespit edilmiştir. Bu sebeple yaklaşan (impending) kırıkları öngörmek ve hastaların prognozunu dikkate almak için parametrelerinin revize edildiği yeni bir derecelendirme sistemi gereklidir.


PDF View

References

  • 1. Coleman RE. Skeletal complications of malignancy. Cancer 1997;80(8 Suppl):1588-94. [CrossRef] google scholar
  • 2. Cecchini MG, Wetterwald A, van der Pluijm G, Thalmann GN. Molecular and biological mechanisms of bone metastasis. EAU Update Series 2005;3(4):214-26. [CrossRef] google scholar
  • 3. Macedo F, Ladeira K, Pinho F, Saraiva N, Bonito N, Pinto L, et al. Bone Metastases: An Overview. Oncology reviews 2017;11(1):321. [CrossRef] google scholar
  • 4. Sharma H, Bhagat S, McCaul J, Macdonald D, Rana B, Naik M. Intramedullary nailing for pathological femoral fractures. J Orthop Surg (Hong Kong) 2007;15(3):291-4. [CrossRef] google scholar
  • 5. Coleman RE. Metastatic bone disease: clinical features, pathophysiology and treatment strategies. Cancer Treat Rev 2001;27(3):165-76. [CrossRef] google scholar
  • 6. Narazaki DK, De Neto Alverga CC, Baptista AM, Caiero MT, De Camargo OP. Prognostic factors in pathologic fractures secondary to metastatic tumors. Clinics (Sao Paulo) 2006;61(4):313-20. [CrossRef] google scholar
  • 7. Mirels H. Metastatic disease in long bones. A proposed scoring system for diagnosing impending pathologic fractures. Clinical orthopaedics and related research. 1989;(249):256-64. [CrossRef] google scholar
  • 8. Mac Niocaill RF, Quinlan JF, Stapleton RD, Hurson B, Dudeney S, O’Toole GC. Inter- and intra-observer variability associated with the use of the Mirels’ scoring system for metastatic bone lesions. Int Orthop 2011;35(1):83-6. [CrossRef] google scholar
  • 9. Howard EL, Shepherd KL, Cribb G, Cool P. The validity of the Mirels score for predicting impending pathological fractures of the lower limb. Bone Joint J 2018;100-B(8):1100-5. [CrossRef] google scholar
  • 10. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics 1977;33(1):159-74. [CrossRef] google scholar
  • 11. Anez-Bustillos L, Derikx LC, Verdonschot N, Calderon N, Zurakowski D, Snyder BD, et al. Finite element analysis and CT-based structural rigidity analysis to assess failure load in bones with simulated lytic defects. Bone 2014;58:160-7. [CrossRef] google scholar
  • 12. Damron TA, Morgan H, Prakash D, Grant W, Aronowitz J, Heiner J. Critical Evaluation of Mirels’ Rating System for Impending Pathologic Fractures. Clin Orthop Relat Res 2003;415(Suppl):S201-7. [CrossRef] google scholar
  • 13. Dawson R, Currow D, Stevens G, Morgan G, Barton MB. Radiotherapy for bone metastases: A critical appraisal of outcome measures. J Pain Symptom Manage 1999;17(3):208-18. [CrossRef] google scholar
  • 14. El-Husseiny M, Coleman N. Inter- and intra-observer variation in classification systems for impending fractures of bone metastases. Skeletal Radiol 2010;39(2):155-60. [CrossRef] google scholar
  • 15. Evans AR, Bottros J, Grant W, Chen BY, Damron TA. Mirels’ rating for humerus lesions is both reproducible and valid. Clin Orthop Relat Res 2008;466(6):1279-84. [CrossRef] google scholar
  • 16. Jawad MU, Scully SP. In brief: classifications in brief: Mirels’ classification: metastatic disease in long bones and impending pathologic fracture. Clin Orthop Relat Res 2010;468(10):2825-7. [CrossRef] google scholar
  • 17. Damron TA, Nazarian A, Entezari V, Brown C, Grant W, Calderon N, et al. CT-based Structural Rigidity Analysis Is More Accurate Than Mirels Scoring for Fracture Prediction in Metastatic Femoral Lesions. Clin Orthop Relat Res 2016;474(3):643-51. [CrossRef] google scholar

Citations

Copy and paste a formatted citation or use one of the options to export in your chosen format


EXPORT



APA

Kocazeybek, E., Meriç, E., Chousein, H.M., Yıldırım, A.M., Sağlam, Y., Erşen, A., & Salduz, A. (2022). INTER- AND INTRA-OBSERVER RELIABILITY OF THE MIRELS’ SCORING SYSTEM FOR THE DETERMINATION OF PATHOLOGICAL FRACTURE RISK IN METASTATIC BONE LESIONS AMONG ORTHOPEDIC SURGEONS WITH DIFFERENT LEVELS OF EXPERTISE. Journal of Istanbul Faculty of Medicine, 85(4), 510-516. https://doi.org/10.26650/IUITFD.1037033


AMA

Kocazeybek E, Meriç E, Chousein H M, Yıldırım A M, Sağlam Y, Erşen A, Salduz A. INTER- AND INTRA-OBSERVER RELIABILITY OF THE MIRELS’ SCORING SYSTEM FOR THE DETERMINATION OF PATHOLOGICAL FRACTURE RISK IN METASTATIC BONE LESIONS AMONG ORTHOPEDIC SURGEONS WITH DIFFERENT LEVELS OF EXPERTISE. Journal of Istanbul Faculty of Medicine. 2022;85(4):510-516. https://doi.org/10.26650/IUITFD.1037033


ABNT

Kocazeybek, E.; Meriç, E.; Chousein, H.M.; Yıldırım, A.M.; Sağlam, Y.; Erşen, A.; Salduz, A. INTER- AND INTRA-OBSERVER RELIABILITY OF THE MIRELS’ SCORING SYSTEM FOR THE DETERMINATION OF PATHOLOGICAL FRACTURE RISK IN METASTATIC BONE LESIONS AMONG ORTHOPEDIC SURGEONS WITH DIFFERENT LEVELS OF EXPERTISE. Journal of Istanbul Faculty of Medicine, [Publisher Location], v. 85, n. 4, p. 510-516, 2022.


Chicago: Author-Date Style

Kocazeybek, Emre, and Emre Meriç and Hasan Memet Chousein and Ahmet Müçteba Yıldırım and Yavuz Sağlam and Ali Erşen and Ahmet Salduz. 2022. “INTER- AND INTRA-OBSERVER RELIABILITY OF THE MIRELS’ SCORING SYSTEM FOR THE DETERMINATION OF PATHOLOGICAL FRACTURE RISK IN METASTATIC BONE LESIONS AMONG ORTHOPEDIC SURGEONS WITH DIFFERENT LEVELS OF EXPERTISE.” Journal of Istanbul Faculty of Medicine 85, no. 4: 510-516. https://doi.org/10.26650/IUITFD.1037033


Chicago: Humanities Style

Kocazeybek, Emre, and Emre Meriç and Hasan Memet Chousein and Ahmet Müçteba Yıldırım and Yavuz Sağlam and Ali Erşen and Ahmet Salduz. INTER- AND INTRA-OBSERVER RELIABILITY OF THE MIRELS’ SCORING SYSTEM FOR THE DETERMINATION OF PATHOLOGICAL FRACTURE RISK IN METASTATIC BONE LESIONS AMONG ORTHOPEDIC SURGEONS WITH DIFFERENT LEVELS OF EXPERTISE.” Journal of Istanbul Faculty of Medicine 85, no. 4 (Nov. 2024): 510-516. https://doi.org/10.26650/IUITFD.1037033


Harvard: Australian Style

Kocazeybek, E & Meriç, E & Chousein, HM & Yıldırım, AM & Sağlam, Y & Erşen, A & Salduz, A 2022, 'INTER- AND INTRA-OBSERVER RELIABILITY OF THE MIRELS’ SCORING SYSTEM FOR THE DETERMINATION OF PATHOLOGICAL FRACTURE RISK IN METASTATIC BONE LESIONS AMONG ORTHOPEDIC SURGEONS WITH DIFFERENT LEVELS OF EXPERTISE', Journal of Istanbul Faculty of Medicine, vol. 85, no. 4, pp. 510-516, viewed 18 Nov. 2024, https://doi.org/10.26650/IUITFD.1037033


Harvard: Author-Date Style

Kocazeybek, E. and Meriç, E. and Chousein, H.M. and Yıldırım, A.M. and Sağlam, Y. and Erşen, A. and Salduz, A. (2022) ‘INTER- AND INTRA-OBSERVER RELIABILITY OF THE MIRELS’ SCORING SYSTEM FOR THE DETERMINATION OF PATHOLOGICAL FRACTURE RISK IN METASTATIC BONE LESIONS AMONG ORTHOPEDIC SURGEONS WITH DIFFERENT LEVELS OF EXPERTISE’, Journal of Istanbul Faculty of Medicine, 85(4), pp. 510-516. https://doi.org/10.26650/IUITFD.1037033 (18 Nov. 2024).


MLA

Kocazeybek, Emre, and Emre Meriç and Hasan Memet Chousein and Ahmet Müçteba Yıldırım and Yavuz Sağlam and Ali Erşen and Ahmet Salduz. INTER- AND INTRA-OBSERVER RELIABILITY OF THE MIRELS’ SCORING SYSTEM FOR THE DETERMINATION OF PATHOLOGICAL FRACTURE RISK IN METASTATIC BONE LESIONS AMONG ORTHOPEDIC SURGEONS WITH DIFFERENT LEVELS OF EXPERTISE.” Journal of Istanbul Faculty of Medicine, vol. 85, no. 4, 2022, pp. 510-516. [Database Container], https://doi.org/10.26650/IUITFD.1037033


Vancouver

Kocazeybek E, Meriç E, Chousein HM, Yıldırım AM, Sağlam Y, Erşen A, Salduz A. INTER- AND INTRA-OBSERVER RELIABILITY OF THE MIRELS’ SCORING SYSTEM FOR THE DETERMINATION OF PATHOLOGICAL FRACTURE RISK IN METASTATIC BONE LESIONS AMONG ORTHOPEDIC SURGEONS WITH DIFFERENT LEVELS OF EXPERTISE. Journal of Istanbul Faculty of Medicine [Internet]. 18 Nov. 2024 [cited 18 Nov. 2024];85(4):510-516. Available from: https://doi.org/10.26650/IUITFD.1037033 doi: 10.26650/IUITFD.1037033


ISNAD

Kocazeybek, Emre - Meriç, Emre - Chousein, HasanMemet - Yıldırım, AhmetMüçteba - Sağlam, Yavuz - Erşen, Ali - Salduz, Ahmet. INTER- AND INTRA-OBSERVER RELIABILITY OF THE MIRELS’ SCORING SYSTEM FOR THE DETERMINATION OF PATHOLOGICAL FRACTURE RISK IN METASTATIC BONE LESIONS AMONG ORTHOPEDIC SURGEONS WITH DIFFERENT LEVELS OF EXPERTISE”. Journal of Istanbul Faculty of Medicine 85/4 (Nov. 2024): 510-516. https://doi.org/10.26650/IUITFD.1037033



TIMELINE


Submitted19.12.2021
Accepted13.07.2022
Published Online17.08.2022

LICENCE


Attribution-NonCommercial (CC BY-NC)

This license lets others remix, tweak, and build upon your work non-commercially, and although their new works must also acknowledge you and be non-commercial, they don’t have to license their derivative works on the same terms.


SHARE




Istanbul University Press aims to contribute to the dissemination of ever growing scientific knowledge through publication of high quality scientific journals and books in accordance with the international publishing standards and ethics. Istanbul University Press follows an open access, non-commercial, scholarly publishing.