Skip to main content
SpringerLink
Log in

Adversarially regularized medication recommendation model with multi-hop memory network

  • Regular Paper
  • Published:
Knowledge and Information Systems Aims and scope Submit manuscript

Abstract

Medication recommendation is attracting enormous attention due to its promise in effectively prescribing medicines and improving the survival rate of patients. Among all challenges, drug–drug interactions (DDI) related to undesired duplication, antagonism, or alternation between drugs could lead to fatal side effects. Previous researches usually provide models with DDI knowledge to achieve DDI reduction. However, the mixed use of patients with different DDI rates places stringent requirements on the generalization performance of models. In pursuit of a more effective method, we propose the adversarially regularized model for medication recommendation (ARMR). Specifically, ARMR firstly models temporal information from medical records to obtain patient representations and builds a key-value memory network based on information from historical admissions. Then, ARMR carries out multi-hop reading on the memory network to recommend medications. Meanwhile, ARMR uses a GAN model to adversarially regulate the distribution of patient representations by matching the distribution to a desired Gaussian distribution to achieve DDI reduction. Comparative evaluations between ARMR and baselines show that ARMR outperforms all baselines in terms of medication recommendation, achieving DDI reduction regardless of numbers of DDI types being considered.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

Notes

  1. https://github.com/yanda-wang/ARMR.

References

  1. Awad AAR, Fgaier H, Mustafa I, Elkamel A, Elnashaie SSEH (2019) Pharmacokinetic/pharmacodynamic modeling and simulation of the effect of medications on \(\beta \)-amyloid aggregates and cholinergic neurocycle. Comput Chem Eng 126:231–240

    Article  Google Scholar 

  2. Choi E, Bahadori MT, Schuetz A, Stewart WF, Sun J (2016) Doctor AI: predicting clinical events via recurrent neural networks. In: Machine learning for healthcare conference, pp 301–318

  3. Choi E, Bahadori MT, Sun J, Kulas J, Schuetz A, Stewart WF (2016) RETAIN: an interpretable predictive model for healthcare using reverse time attention mechanism. In: Advances in neural information processing systems, vol 29, Annual conference on neural information processing systems 2016, December 5-10, 2016, Barcelona, Spain, pp 3504–3512

  4. Davazdahemami B, Delen D (2019) The confounding role of common diabetes medications in developing acute renal failure: a data mining approach with emphasis on drug-drug interactions. Expert Syst Appl 123:168–177

    Article  Google Scholar 

  5. Ghasemi S, Etminani K, Dehghan H, Eslami S, Hasibian M, Vakili HA, Saberi M, Aghabagheri M, Namayandeh S (2019) Design and evaluation of a smart medication recommendation system for the electronic prescription. Stud Health Technol Inform 260:128–135

    Google Scholar 

  6. Gómez-Bombarelli R, Wei JN, Duvenaud D, Hernández-Lobato JM, Sánchez-Lengeling B, Sheberla D, Aguilera-Iparraguirre J, Hirzel TD, Adams RP, Aspuru-Guzik A (2018) Automatic chemical design using a data-driven continuous representation of molecules. ACS Cent Sci 4(2):268–276

    Article  Google Scholar 

  7. Goodfellow IJ, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S,Courville AC, Bengio Y (2014) Generative adversarial nets. In: Advances in neural information processing systems, vol 27, Annual conference on neural information processing systems 2014, December 8-13 2014, Montreal, Quebec,Canada, pp 2672–2680

  8. Graves A, Wayne G, Reynolds M, Harley T, Danihelka I, Grabska-Barwińska A, Colmenarejo SG, Grefenstette E, Ramalho T, Agapiou J et al (2016) Hybrid computing using a neural network with dynamic external memory. Nature 538(7626):471

    Article  Google Scholar 

  9. Guimaraes GL, Sanchez-Lengeling B, Outeiral C, Farias PLC, Aspuru-Guzik A (2017) Objective-reinforced generative adversarial networks (organ) for sequence generation models. arXiv preprint arXiv:1705.10843

  10. Guo W, Ge W, Cui L, Li H, Kong L (2019) An interpretable disease onset predictive model using crossover attention mechanism from electronic health records. IEEE Access 7:134236–134244

    Article  Google Scholar 

  11. Johnson AE, Pollard TJ, Shen L, Li-wei HL, Feng M, Ghassemi M, Moody B, Szolovits P, Celi LA, Mark RG (2016) MIMIC-III, a freely accessible critical care database. Sci Data 3:160035

    Article  Google Scholar 

  12. Kadurin A, Nikolenko S, Khrabrov K, Aliper A, Zhavoronkov A (2017) Drugan: an advanced generative adversarial autoencoder model for de novo generation of new molecules with desired molecular properties in silico. Mol Pharmaceut 14(9):3098–3104

    Article  Google Scholar 

  13. Kumar A, Irsoy O, Ondruska P, Iyyer M, Bradbury J, Gulrajani I, Zhong V, Paulus R, Socher R (2016) Ask me anything: dynamic memory networks for natural language processing. In: International conference on machine learning, pp 1378–1387

  14. Le H, Tran T, Venkatesh S (2018) Dual memory neural computer for asynchronous two-view sequential learning. In: Proceedings of the 24th ACM SIGKDD international conference on knowledge discovery & data mining. ACM, pp 1637–1645

  15. Li Y, Chen W, Liu D, Zhang Z, Wu S, Liu C (2019) IFFLC: an integrated framework of feature learning and classification for multiple diagnosis codes assignment. IEEE Access 7:36810–36818

    Article  Google Scholar 

  16. Lipton ZC, Kale DC, Elkan C, Wetzel RC (2016) Learning to diagnose with LSTM recurrent neural networks. In: 4th international conference on learning representations, ICLR 2016, San Juan, Puerto Rico, May 2–4, 2016, conference track proceedings

  17. Ma T, Xiao C, Zhou J, Wang F (2018) Drug similarity integration through attentive multi-view graph auto-encoders. In: Proceedings of the twenty-seventh international joint conference on artificial intelligence, IJCAI 2018, July 13–19, 2018, Stockholm, Sweden, pp 3477–3483

  18. Makhzani A, Shlens J, Jaitly N, Goodfellow I, Frey B (2015) Adversarial autoencoders. arXiv preprint arXiv:1511.05644

  19. Malakouti S, Hauskrecht M (2019) Predicting patient’s diagnoses and diagnostic categories from clinical-events in EHR data. In: Artificial intelligence in medicine—17th conference on artificial intelligence in medicine, AIME 2019, Poznan, Poland, June 26–29, 2019, Proceedings, pp 125–130

  20. Mallya S, Overhage JM, Bodapati S, Srivastava N, Genc S (2019) SAVEHR: self attention vector representations for EHR based personalized chronic disease onset prediction and interpretability. arXiv preprint arXiv:1911.05370

  21. McAllister-Day TK, Madhyastha TM, Lee A, Zabetian CP, Montine TJ, Grabowski TJ (2019) Effect of dopaminergic medications on blood oxygen level-dependent variability and functional connectivity in parkinson’s disease and healthy aging. Brain Connect 9(7):554–565

    Article  Google Scholar 

  22. Miller AH, Fisch A, Dodge J, Karimi A, Bordes A, Weston J (2016) Key-value memory networks for directly reading documents. In: Proceedings of the 2016 conference on empirical methods in natural language processing, EMNLP 2016, Austin, Texas, USA, November 1–4, 2016, pp 1400–1409

  23. Nordon G, Koren G, Shalev V, Horvitz E, Radinsky K (2019) Separating wheat from chaff: Joining biomedical knowledge and patient data for repurposing medications. In: The thirty-third AAAI conference on artificial intelligence, AAAI 2019, pp 9565–9572

  24. Pan S, Hu R, Long G, Jiang J, Yao L, Zhang C (2018) Adversarially regularized graph autoencoder for graph embedding. In: Proceedings of the twenty-seventh international joint conference on artificial intelligence, IJCAI 2018, July 13–19, 2018, Stockholm, Sweden, pp 2609–2615

  25. Prakash A, Zhao S, Hasan S, Datla V, Lee K, Qadir A, Liu J, Farri O (2017) Condensed memory networks for clinical diagnostic inferencing. In: Thirty-first AAAI conference on artificial intelligence

  26. Salimans T, Goodfellow IJ, Zaremba W, Cheung V, Radford A, Chen X (2016) Improved techniques for training gans. In: Advances in neural information processing systems, vol 29, Annual conference on neural information processing systems 2016, December 5-10, 2016, Barcelona, Spain, pp 2226–2234

  27. Shang J, Ma T, Xiao C, Sun J (2019) Pre-training of graph augmented transformers for medication recommendation. In: Proceedings of the twenty-eighth international joint conference on artificial intelligence, IJCAI 2019, Macao, China, August 10–16, 2019, pp 5953–5959

  28. Shang J, Xiao C, Ma T, Li H, Sun J (2019) Gamenet: graph augmented memory networks for recommending medication combination. In: Proceedings of the AAAI conference on artificial intelligence vol 33, pp 1126–1133

  29. Siavelis JC, Bourdakou MM, Athanasiadis EI, Spyrou GM, Nikita KS (2016) Bioinformatics methods in drug repurposing for Alzheimer’s disease. Brief Bioinform 17(2):322

    Article  Google Scholar 

  30. Singh N, Halliday AC, Thomas JM, Kuznetsova OV, Baldwin R, Woon EC, Aley PK, Antoniadou I, Sharp T, Vasudevan SR et al (2013) A safe lithium mimetic for bipolar disorder. Nat Commun 4:1332

    Article  Google Scholar 

  31. Spangler WS, Wilkins AD, Bachman BJ, Nagarajan M, Dayaram T, Haas PJ, Regenbogen S, Pickering CR, Comer A, Myers JN (2014) Automated hypothesis generation based on mining scientific literature. In: The 20th ACM SIGKDD international conference on knowledge discovery and data mining, KDD ’14, New York, NY, USA, August 24–27, 2014, pp 1877–1886

  32. Sukhbaatar S, Szlam A, Weston J, Fergus R (2015) End-to-end memory networks. In: Advances in neural information processing systems, vol 28, Annual conference on neural information processing systems 2015, December 7-12,2015, Montreal, Quebec, Canada, pp 2440–2448

  33. Sun D, Ren X, Ari E, Korcsmaros T, Wu LY (2017) Discovering cooperative biomarkers for heterogeneous complex disease diagnoses. Brief Bioinform 20(1):1–13

    Google Scholar 

  34. Sybrandt J, Shtutman M, Safro I (2017) MOLIERE: automatic biomedical hypothesis generation system. In: Proceedings of the 23rd ACM SIGKDD international conference on knowledge discovery and data mining, Halifax, NS, Canada, August 13–17, 2017, pp 1633–1642

  35. Wang M, Liu M, Liu J, Wang S, Long G, Qian B (2017) Safe medicine recommendation via medical knowledge graph embedding. arXiv preprint arXiv:1710.05980

  36. Wang P, Long Z, Lv Z, Wang Z (2019) Fault detection for non-gaussian processes using multiple canonical correlation analysis models and box-cox transformation. IEEE Access 7:68707–68717

    Article  Google Scholar 

  37. Wang Y, Chen W, Li B, Boots R (2019) Learning fine-grained patient similarity with dynamic bayesian network embedded RNNs. In: Database systems for advanced applications—24th international conference, DASFAA 2019, Chiang Mai, Thailand, April 22–25, 2019, Proceedings, Part I, pp 587–603

  38. Wen D, Xi L, Yibo G, Lin C, Jianglong S, Di C, Kuo G, Yongshi J, Yiping Y, Jianxin C (2015) Matrix factorization-based prediction of novel drug indications by integrating genomic space. Comput Math Methods Med 2015:1–9

    Google Scholar 

  39. Weston J, Chopra S, Bordes A (2015) Memory networks. In: 3rd international conference on learning representations, ICLR 2015, San Diego, CA, USA, May 7–9, 2015, Conference track proceedings

  40. Zhang Y, Chen R, Tang J, Stewart WF, Sun J (2017) Leap: learning to prescribe effective and safe treatment combinations for multimorbidity. In: Proceedings of the 23rd ACM SIGKDD international conference on knowledge discovery and data mining. ACM, pp 1315–1324

Download references

Acknowledgements

We would like to thank Associate Professor Robert Boots at University of Queensland & Burns, Trauma and Critical Care Research Center for his valuable advice and meaningful discussion from the medical perspective. This research has been supported by General Program of National Natural Science Foundation of China under Grant No.61972384.

Author information

Authors and Affiliations

  1. Nanjing University of Aeronautics and Astronautics, Nanjing, China

    Yanda Wang & Dechang Pi

  2. The University of Queensland, Brisbane, Australia

    Weitong Chen

  3. Northeast Normal University, Changchun, China

    Lin Yue

Authors
  1. Yanda Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Weitong Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Dechang Pi
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Lin Yue
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Dechang Pi.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, Y., Chen, W., Pi, D. et al. Adversarially regularized medication recommendation model with multi-hop memory network. Knowl Inf Syst 63, 125–142 (2021). https://doi.org/10.1007/s10115-020-01513-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10115-020-01513-9

Keywords

Search

Navigation