DeepEpi: Deep Learning Model for Predicting Gene Expression Regulation Based on Epigenetic Histone Modifications


Cite item

Full Text

Abstract

Background:Histone modification is a vital element in gene expression regulation. The way in which these proteins bind to the DNA impacts whether or not a gene may be expressed. Although those factors cannot influence DNA construction, they can influence how it is transcribed.

Objective:Each spatial location in DNA has its function, so the spatial arrangement of chromatin modifications affects how the gene can express. Also, gene regulation is affected by the type of histone modification combinations that are present on the gene and depends on the spatial distributional pattern of these modifications and how long these modifications read on a gene region. So, this study aims to know how to model Long-range spatial genome data and model complex dependencies among Histone reads.

Methods:The Convolution Neural Network (CNN) is used to model all data features in this paper. It can detect patterns in histones signals and preserve the spatial information of these patterns. It also uses the concept of memory in long short-term memory (LSTM), using vanilla LSTM, Bi-Directional LSTM, or Stacked LSTM to preserve long-range histones signals. Additionally, it tries to combine these methods using ConvLSTM or uses them together with the aid of a self-attention.

Results:Based on the results, the combination of CNN, LSTM with the self-attention mechanism obtained an Area under the Curve (AUC) score of 88.87% over 56 cell types.

Conclusion:The result outperforms the present state-of-the-art model and provides insight into how combinatorial interactions between histone modification marks can control gene expression. The source code is available at https://github.com/RaniaHamdy/DeepEpi.

About the authors

Rania Hamdy

Department of Information System, College of Computing and Information Technology, Arab Academy for Science, Technology and Maritime Transport

Author for correspondence.
Email: info@benthamscience.net

Yasser Omar

Department of Computer Science, College of Computing and Information Technology, Arab Academy for Science, Technology and Maritime Transpor

Email: info@benthamscience.net

Fahima Maghraby

Department of Computer Science, College of Computing and Information Technology, Arab Academy for Science, Technology and Maritime Transport,

Email: info@benthamscience.net

References

  1. Reik W. Stability and flexibility of epigenetic gene regulation in mammalian development. Nature 2007; 447(7143): 425-32. doi: 10.1038/nature05918 PMID: 17522676
  2. Morgan HD, Santos F, Green K, Dean W, Reik W. Epigenetic reprogramming in mammals. Hum Mol Genet 2005; 14(1): 47-58. doi: 10.1093/hmg/ddi114
  3. Deans C, Maggert KA. What do you mean, "epigenetic"? Genetics 2015; 199(4): 887-96. doi: 10.1534/genetics.114.173492 PMID: 25855649
  4. Gene expression and regulation. Available from: https://www.nature.com/scitable/topic/gene-expression-and-regulation-15/ Accessed: 14-Nov-2022
  5. How is a Gene Expressed to Produce a Protein. Available from: https://pediaa.com/how-is-a-gene-expressed-to-produce-a-protein/ Accessed: 14-Nov-2022
  6. Bannister AJ, Kouzarides T. Regulation of chromatin by histone modifications. Cell Res 2011; 21(3): 381-95. doi: 10.1038/cr.2011.22 PMID: 21321607
  7. Epigenetics: Fundamentals," What is Epigenetics? Available from: https://www.whatisepigenetics.com/fundamentals/ Accessed: 14-Nov-2022
  8. Hendrich B, Bickmore W. Human diseases with underlying defects in chromatin structure and modification. Hum Mol Genet 2001; 10(20): 2233-42. doi: 10.1093/hmg/10.20.2233 PMID: 11673406
  9. Araki Y, Mimura T. The histone modification code in the pathogenesis of autoimmune diseases. Mediators Inflamm 2017; 2017: 1-12. doi: 10.1155/2017/2608605 PMID: 28127155
  10. Zhang W, Song M, Qu J, Liu GH. Epigenetic modifications in cardiovascular aging and diseases. Circ Res 2018; 123(7): 773-86. doi: 10.1161/CIRCRESAHA.118.312497 PMID: 30355081
  11. Johnson CA. Chromatin modification and disease. J Med Genet 2000; 37(12): 905-15. doi: 10.1136/jmg.37.12.905 PMID: 11106353
  12. Sadri-Vakili G, Cha JHJ. Mechanisms of Disease: histone modifications in Huntington’s disease. Nat Clin Pract Neurol 2006; 2(6): 330-8. doi: 10.1038/ncpneuro0199 PMID: 16932577
  13. Wen K, Miliç J, El-Khodor B, et al. The role of DNA methylation and histone modifications in neurodegenerative diseases: A systematic review. PLoS One 2016; 11(12): e0167201. doi: 10.1371/journal.pone.0167201 PMID: 27973581
  14. Atlante S, Mongelli A, Barbi V, Martelli F, Farsetti A, Gaetano C. The epigenetic implication in coronavirus infection and therapy. Clin Epigenetics 2020; 12(1): 156. doi: 10.1186/s13148-020-00946-x PMID: 33087172
  15. McCray A. Cancer treatment and epigenetics. Available from: https://www.webmd.com/cancer/cancer-treatment-epigenetics Accessed: 14-Nov-2022
  16. Wang X, Liu M, Zhang Y, et al. Deep fusion learning facilitates anatomical therapeutic chemical recognition in drug repurposing and discovery. Brief Bioinform 2021; 22(6): bbab289. doi: 10.1093/bib/bbab289 PMID: 34368838
  17. Jiménez-Luna J, Grisoni F, Schneider G. Drug discovery with explainable artificial intelligence. Nat Mach Intell 2020; 2(10): 573-84. doi: 10.1038/s42256-020-00236-4
  18. Gunasekaran H, Ramalakshmi K, Rex Macedo Arokiaraj A, Deepa Kanmani S, Venkatesan C, Suresh Gnana Dhas C. Analysis of DNA sequence classification using CNN and hybrid models. Comput Math Methods Med 2021; 2021: 1-12. doi: 10.1155/2021/1835056 PMID: 34306171
  19. Guo L, Jiang Q, Jin X, et al. A deep convolutional neural network to improve the prediction of protein secondary structure. Curr Bioinform 2020; 15(7): 767-77. doi: 10.2174/1574893615666200120103050
  20. Hamdy R, Maghraby FA, Omar YMK. ConvChrome: Predicting gene expression based on histone modifications using deep learning techniques. Curr Bioinform 2022; 17(3): 273-83. doi: 10.2174/1574893616666211214110625
  21. Sequeira AM, Lousa D, Rocha M. ProPythia: A Python package for protein classification based on machine and deep learning. Neurocomputing 2022; 484: 172-82. doi: 10.1016/j.neucom.2021.07.102
  22. Shi Z. Graph neural networks and attention-based CNN-LSTM for protein classification. arXiv:220409486 2022.
  23. Setlur Nagesh SV, Podgorsak A, Krebs JM, Bednarek D, Rudin S. Image processing using Convolutional Neural Network (CNN) for Region of Interest (ROI) fluoroscopy. In Medical Imaging 2020: Biomedical Applications in Molecular. Structural, and Functional Imaging. Washington: SPIE Publishers 2020; pp. 317-27.
  24. Islam MM, Karray F, Alhajj R, Zeng J. A review on deep learning techniques for the diagnosis of novel Coronavirus (COVID-19). IEEE Access 2021; 9: 30551-72. doi: 10.1109/ACCESS.2021.3058537 PMID: 34976571
  25. Lecun Y, Bengio Y. Convolutional networks for images, speech, and time-series The handbook of brain theory and neural networks. London, England: MIT Press 1995.
  26. Cai S, Shu Y, Chen G, Ooi BC, Wang W, Zhang M. Effective and efficient dropout for deep convolutional neural networks arXiv:190403392 2019.
  27. Yu D, Wang H, Chen P, Wei Z. Mixed pooling for convolutional neural networks Rough sets and knowledge technology. Cham: Springer International Publishing 2014; pp. 364-75. doi: 10.1007/978-3-319-11740-9_34
  28. Srivastava N, Hinton G, Krizhevsky A, Sutskever I, Salakhutdinov R. Dropout: A simple way to prevent neural networks from overfitting. J Mach Learn Res 2014; 15(56): 1929-58.
  29. Brownlee J. A gentle introduction to dropout for regularizing deep neural networks Available from: https://machinelearningmastery.com/dropout-for-regularizing-deep-neural-networks/ Accessed: 14-Nov-2022
  30. Vaswani A, et al. Attention is all you need. 31st Conference on Neural Information Processing Systems Long Beach, CA, USA 2017.
  31. Kana M. 5 secrets about LSTM and GRU everyone else knows. Available from: https://towardsdatascience.com/5-secrets-about-lstm-and-gru-everyone-else-know-97446d89e35b Accessed: 14-Nov-2022
  32. Cui Z, Ke R, Pu Z, Wang Y. Stacked bidirectional and unidirectional LSTM recurrent neural network for forecasting network-wide traffic state with missing values. Transp Res, Part C Emerg Technol 2020; 118(102674): 102674. doi: 10.1016/j.trc.2020.102674
  33. Srivastava P. Essentials of deep learning : Introduction to long short term memory. Available from: https://www.analyticsvidhya.com/blog/2017/12/fundamentals-of-deep-learning-introduction-to-lstm/ Accessed: 14-Nov-2022
  34. Shi X, Chen Z, Wang H, Yeung DY, Wong WK, Woo WC. Convolutional LSTM network: A machine learning approach for precipitation nowcasting. arXiv:150604214 2015.
  35. Essien A, Giannetti C. A deep learning model for smart manufacturing using convolutional LSTM neural network autoencoders. IEEE Trans Industr Inform 2020; 16(9): 6069-78. doi: 10.1109/TII.2020.2967556
  36. Cheng C, Yan KK, Yip KY, et al. A statistical framework for modeling gene expression using chromatin features and application to modENCODE datasets. Genome Biol 2011; 12(2): R15. doi: 10.1186/gb-2011-12-2-r15 PMID: 21324173
  37. Dong X, Greven MC, Kundaje A, et al. Modeling gene expression using chromatin features in various cellular contexts. Genome Biol 2012; 13(9): R53. doi: 10.1186/gb-2012-13-9-r53 PMID: 22950368
  38. Sun S, Sun X, Zheng Y. Higher-order partial least squares for predicting gene expression levels from chromatin states. BMC Bioinformatics 2018; 19(S5) (Suppl. 5): 113. doi: 10.1186/s12859-018-2100-y PMID: 29671394
  39. Singh R, Lanchantin J, Robins G, Qi Y. DeepChrome: deep-learning for predicting gene expression from histone modifications. Bioinformatics 2016; 32(17): i639-48. doi: 10.1093/bioinformatics/btw427 PMID: 27587684
  40. Singh R, Lanchantin J, Sekhon A, Qi Y. Attend and predict: Understanding gene regulation by selective attention on chromatin. Adv Neural Inf Process Syst. 2017; 30: pp. 6785-95. PMID: 30147283
  41. Zhu L, Kesseli J, Nykter M, Huttunen H. Predicting gene expression levels from histone modification signals with convolutional recurrent neural networks. EMBEC & NBC 2017: Joint Conference of the European Medical and Biological Engineering Conference (EMBEC) and the Nordic-Baltic Conference on Biomedical Engineering and Medical Physics (NBC); Tampere, Finland 555-8. doi: 10.1007/978-981-10-5122-7_139
  42. Chaubey V, Nair MS, Pillai GN. Gene expression prediction using a deep 1D convolution neural network. 2019 IEEE Symposium Series on Computational Intelligence (SSCI); Xiamen, China 2019; 1383-9. doi: 10.1109/SSCI44817.2019.9002669
  43. Kamal IM, Wahid NA, Bae H. Gene expression prediction using stacked temporal convolutional network. 2020 IEEE International Conference on Big Data and Smart Computing (BigComp); Busan, Korea (South) 2020; 402-5. doi: 10.1109/BigComp48618.2020.00-41
  44. Cheng W, Murtaza G, Wang A. SimpleChrome: Encoding of combinatorial effects for predicting gene expression. arXiv:201208671 2020.
  45. Symeonidi A, Nicolaou A, Johannes F, Christlein V. Recursive Convolutional Neural Networks for Epigenomics. 2020 25 th International Conference on Pattern Recognition (ICPR); Milan, Italy 2021; 2567-74. doi: 10.1109/ICPR48806.2021.9412272
  46. Kadavath S, Paradis S, Yeung J. DeepChrome 2.0: Investigating and improving architectures, visualizations, & experiments arXiv:220911923 2022.
  47. Kundaje A, Meuleman W, Ernst J, et al. Integrative analysis of 111 reference human epigenomes. Nature 2015; 518(7539): 317-30. doi: 10.1038/nature14248 PMID: 25693563
  48. Roadmap epigenomics. Available from: https: //egg2.wustl.edu/roadmap/web_portal/processed_data.html Accessed: 28-Dec-2022
  49. DeepEpi Available from: https://github.com/RaniaHamdy/DeepEpi Accessed: 16-Nov-2022
  50. CellInfo Pdf at master Available from: https: //github.com/QData/DeepChrome Accessed: 14-Nov-2022
  51. Encode project common cell types. Available from: https: //www.genome.gov/encode-project-common-cell-types Accessed 14-Nov-2022
  52. Zhang L, Xue G, Liu J, Li Q, Wang Y. Revealing transcription factor and histone modification co-localization and dynamics across cell lines by integrating ChIP-seq and RNA-seq data. BMC Genomic 2018; 19(S10): 914. doi: 10.1186/s12864-018-5278-5

Supplementary files

Supplementary Files
Action
1. JATS XML
Download

Copyright (c) 2024 Bentham Science Publishers