The The Cohen Kappa of the Liverpool and the Naranjo Adverse Drug Reaction Causality Assessment Tool on Nervous System Drugs

Authors

  • Bangunawati Rahajeng Departement of Pharmacology ang Clinical Pharmacy, School of Pharmacy, Faculty of Medicine and Health Sciences, Universitas Muhammadiyah Yogyakarta https://orcid.org/0000-0001-8420-5182
  • Irma Risdiana Master of Health, Department of Pharmacy PKU Muhammadiyah Gamping Hospital, Yogyakarta Special Region https://orcid.org/0000-0001-8420-5182
  • Odilia Danti Nugrahaningtyas School of Pharmacy, Faculty of Medicine and Health Sciences, Universitas Muhammadiyah Yogyakarta

Keywords:

Naranjo algorithm, Liverpool algorithm, side-effect, Cohen Kappa, inter-reliability, nervous system drugs

Abstract

Objective: Monitoring of side effects is essential to prevent and overcome the occurrence of drug side effects. Drugs that act on the nervous system have many similar side effects. One method of identifying side effect causality is using the Naranjo algorithm. Currently, there is a Liverpool algorithm, a refinement of Naranjo. This study aims to compare the Naranjo algorithm and the Liverpool algorithm in identifying the causality of side effects of drugs that act on the nervous system.

Methods: This research is an observational study with a longitudinal method. Data collection was carried out prospectively in patients who were prescribed anticonvulsants, antidepressants, or antipsychotics. Four researchers will observe patients for three months. Adverse events were reported and tested using the Naranjo algorithm by two researchers and the Liverpool algorithm by two researchers. The measurement results of the two algorithms were tested with the Inter-Rater Reliability (IRR) by looking at the Cohen Kappa (K) agreement coefficient value.

Result: The study involved 133 patients. Of the 133 patients, 74 (55.64%) experienced side effects with probable and possible causality. The kappa value for Naranjo is 0.465 (“moderate” IRR). It is 0.352 (“fair” IRR) for Liverpool, indicating that the researchers’ agreement was better on the Naranjo algorithm than the Liverpool algorithm.

Conclusion: This study concludes that the Naranjo algorithm gives a higher kappa value than the Liverpool algorithm. Research using the Liverpool algorithm needs to be carried out by other researchers in Indonesia to find out the possibility of its use in clinical practice.

Downloads

Download data is not yet available.

References

Chawla S, Kumar S, Adverse Drug Reactions and their Impact on Quality of Life in Patients on Antipsychotic Therapy at a Tertiary Care Center in Delhi. Indian J Psychol Med. 2017;39(3):293–8. Doi: 10.4103/0253-7176.207332

Marasine NR, Sankhi S, Lamichhane R. Marasini NR, Dangi NB. Self-Reported Antidepressant Drug Side Effects. Medication Adherence and Its Associated Factors among Patients Diagnosed with Depression at the Psychiatric Hospital of Nepal. Depression Research and Treatment. 2020 ;2020:e7024275. Doi: 10.4103/0253-7176.207332

Wubeshet YS, Mohammed OS, Desse TA. Prevalence and management practice of first generation antipsychotics induced side effects among schizophrenic patients at Amanuel Mental Specialized Hospital. central Ethiopia: cross-sectional study. BMC Psychiatry. 2019;19(1):32. Doi: 10.1186/s12888-018-1999-x Wubeshet

Gallagher RM, Kirkham JJ, Mason JR, Bird KA, Williamson PR, Nunn AJ, et al. Development and Inter-Rater Reliability of the Liverpool Adverse Drug Reaction Causality Assessment Tool. Plos One. 2011;6(12):e28096. Doi: 10.1371/journal.pone.0028096

Patton K, Borshoff DC. Adverse drug reactions. Anaesthesia. 2018;73(S1):76–84. Doi: 10.1111/anae.14143

Zhou L, Rupa AP. Categorization and association analysis of risk factors for adverse drug events. Eur J Clin Pharmacol. 2018;74(4):389–404. Doi: 10.1007/s00228-017-2373-5

Chan V. Schizophrenia and Psychosis: Diagnosis. Current Research Trends. and Model Treatment Approaches with Implications for Transitional Age Youth. Child and Adolescent Psychiatric Clinics of North America. 2017;26(2):341–66. Doi: 10.1016/j.chc.2016.12.014

Ekhart C, Vries T de, Hunsel F van. Psychiatric adverse drug reactions in the paediatric population. Arch Dis Child. 2020;105(8):749–55. Doi: 10.1136/archdischild-2019-317933

Harichandran D, Viswanathan M, Gangadhar R. Adverse drug reactions among hospitalized patients in Psychiatry Department in a Tertiary Care Hospital. J Health Res Rev. 2016;3(2):77. Doi: 10.4103/2394-2010.184243

Gupta SK, Kumar KD. An assessment of reported adverse drug reactions in a Tertiary Care Hospital in South India: A retrospective cross-sectional study. Int J Pharm Investig. 2017;7(4):193–7. DOI: 10.4103/jphi.JPHI_81_17

Sunil Bellare P, Ashwin K, Prakash Pu S, Vinaykumar S, Kb R. A Retrospective Evaluation of Adverse Drug Reactions Due to Cancer Chemotherapy in a Tertiary Care Hospital in South India. JYP. 2016;8(3):251–4. Doi: 10.5530/jyp.2016.3.14

Belhekar MN, Taur SR, Munshi RP. A study of agreement between the Naranjo algorithm and WHO-UMC criteria for causality assessment of adverse drug reactions. Indian J Pharmacol. 2014;46(1):117–20. Doi: 10.4103/0253-7613.125192

Théophile H, André M, Miremont-Salamé G, Arimone Y, Bégaud B. Comparison of Three Methods (An Updated Logistic Probabilistic Method. the Naranjo and Liverpool Algorithms) for the Evaluation of Routine Pharmacovigilance Case Reports Using Consensual Expert Judgement as Reference. Drug Saf. 2013;36(10):1033–44. Doi: 10.1007/s40264-013-0083-1

Varallo FR, Planeta CS, Herdeiro MT. Mastroianni P de C. Imputation of adverse drug reactions: Causality assessment in hospitals. PLoS One. 2017;12(2):e0171470. Doi: 10.1371/journal.pone.0171470

Behera SK, Das S, Xavier AS, Velupula S, Sandhiya S. Comparison of different methods for causality assessment of adverse drug reactions. Int J Clin Pharm. 2018;40(4):903–10.

Khan LM, Al-Harthi SE, Osman AMM, Sattar MAAA, Ali AS. Dilemmas of the causality assessment tools in the diagnosis of adverse drug reactions. Saudi Pharm J. 2016;24(4):485–93. Doi: 10.1016/j.jsps.2015.01.010

Murphy RM, Klopotowska JE, de Keizer NF, Jager KJ, Leopold JH, Dongelmans DA. et al. Adverse drug event detection using natural language processing: A scoping review of supervised learning methods. PLoS One. 2023;18(1):e0279842. Doi: 10.1371/journal.pone.0279842

Downloads

Published

2024-12-20

How to Cite

1.
Rahajeng B, Risdiana I, Nugrahaningtyas OD. The The Cohen Kappa of the Liverpool and the Naranjo Adverse Drug Reaction Causality Assessment Tool on Nervous System Drugs. Ars Pharm [Internet]. 2024 Dec. 20 [cited 2024 Dec. 22];66(1):80-8. Available from: https://revistaseug.ugr.es/index.php/ars/article/view/31144

Issue

Vol. 66 No. 1 (2025)

Section

Original Articles

License

Copyright (c) 2024 Bangunawati Rahajeng

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.

The articles, which are published in this journal, are subject to the following terms in relation to the rights of patrimonial or exploitation:

  1. The authors will keep their copyright and guarantee to the journal the right of first publication of their work, which will be distributed with a Creative Commons BY-NC-SA 4.0 license that allows third parties to reuse the work whenever its author, quote the original source and do not make commercial use of it.

b. The authors may adopt other non-exclusive licensing agreements for the distribution of the published version of the work (e.g., deposit it in an institutional telematic file or publish it in a monographic volume) provided that the original source of its publication is indicated.

c. Authors are allowed and advised to disseminate their work through the Internet (e.g. in institutional repositories or on their website) before and during the submission process, which can produce interesting exchanges and increase citations of the published work. (See The effect of open access).