This paper is in the following e-collection/theme issue:

Wearable Devices and Sensors (1141) New Methods (1137) Imaging Informatics (305) Machine Learning (2083) Instruments and Questionnaires for Nutrition and Food Intake (212) Evaluation and Research Methodology for mHealth (242) mHealth for Wellness, Behavior Change and Prevention (3323)

Published on in Vol 9, No 1 (2021): January

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/21926, first published .
Deep Learning–Based Multimodal Data Fusion: Case Study in Food Intake Episodes Detection Using Wearable Sensors

Deep Learning–Based Multimodal Data Fusion: Case Study in Food Intake Episodes Detection Using Wearable Sensors

Deep Learning–Based Multimodal Data Fusion: Case Study in Food Intake Episodes Detection Using Wearable Sensors

Authors of this article:

Nooshin Bahador1 Author Orcid Image ;   Denzil Ferreira1 Author Orcid Image ;   Satu Tamminen1 Author Orcid Image ;   Jukka Kortelainen1 Author Orcid Image
Article Authors Cited by (22) Tweetations (2) Metrics

Journals

  1. Sempionatto J, Montiel V, Vargas E, Teymourian H, Wang J. Wearable and Mobile Sensors for Personalized Nutrition. ACS Sensors 2021;6(5):1745 View
  2. Dai L, Guan Y, Wang B, Wang L. Current role and future perspectives of chemometrics in spectroscopic and chromatographic analysis of traditional Chinese medicines. Materials Express 2022;12(2):202 View
  3. Bahador N, Kortelainen J. Deep learning-based classification of multichannel bio-signals using directedness transfer learning. Biomedical Signal Processing and Control 2022;72:103300 View
  4. Bahador N, Zhao G, Jokelainen J, Mustola S, Kortelainen J. Morphology-preserving reconstruction of times series with missing data for enhancing deep learning-based classification. Biomedical Signal Processing and Control 2021;70:103052 View
  5. Asgari S, Fabritius T. Graphene-based dual-functional chiral metamirror composed of complementary 90° rotated U-shaped resonator arrays and its equivalent circuit model. Scientific Reports 2021;11(1) View
  6. Neves P, Simões J, Costa R, Pimenta L, Gonçalves N, Albuquerque C, Cunha C, Zdravevski E, Lameski P, Garcia N, Pires I. Thought on Food: A Systematic Review of Current Approaches and Challenges for Food Intake Detection. Sensors 2022;22(17):6443 View
  7. Bahador N, Jokelainen J, Mustola S, Kortelainen J. Reconstruction of missing channel in electroencephalogram using spatiotemporal correlation-based averaging. Journal of Neural Engineering 2021;18(5):056045 View
  8. Shao W, Min W, Hou S, Luo M, Li T, Zheng Y, Jiang S. Vision-based food nutrition estimation via RGB-D fusion network. Food Chemistry 2023;424:136309 View
  9. Sükei E, de Leon-Martinez S, Olmos P, Artés A. Automatic patient functionality assessment from multimodal data using deep learning techniques – Development and feasibility evaluation. Internet Interventions 2023;33:100657 View
  10. Lamichhane B, Zhou J, Sano A. Psychotic Relapse Prediction in Schizophrenia Patients Using A Personalized Mobile Sensing-Based Supervised Deep Learning Model. IEEE Journal of Biomedical and Health Informatics 2023;27(7):3246 View
  11. Han Y, Cheng Q, Wu W, Huang Z. DPF-Nutrition: Food Nutrition Estimation via Depth Prediction and Fusion. Foods 2023;12(23):4293 View
  12. Saklani A, Tiwari S, Pannu H. Ameliorating multimodal food classification using state of the art deep learning techniques. Multimedia Tools and Applications 2024;83(21):60189 View
  13. Saklani A, Tiwari S, Pannu H. Deep attentive multimodal learning for food information enhancement via early-stage heterogeneous fusion. The Visual Computer 2025;41(4):2461 View
  14. Chakraborty K, Ebihara A. Pesticide Biosensors for Multiple Target Detection: Improvement Potential with Advanced Data-processing Methods. Reviews in Agricultural Science 2024;12(0):128 View
  15. Zhang H, Lin Y, Cao S, Cheng J, Zeng X. Artificial intelligence boosting multi-dimensional information fusion: Data collection, processing and modeling for food quality and safety assessment. Trends in Food Science & Technology 2025;163:105138 View
  16. Huang A, Zhang F, Song C. Multimodal Sentiment Analysis of Online Product Marketing Information Based on Artificial Intelligence Neural Networks and Text Mining. IEEE Transactions on Engineering Management 2025;72:3182 View
  17. Rad O, Brisan C. Control Algorithms in Robot-Assisted Rehabilitation: A Systematic Review. Applied Sciences 2025;15(16):9184 View

Conference Proceedings

  1. Khan M, Acharya B, Chaurasiya R. 2022 First International Conference on Electrical, Electronics, Information and Communication Technologies (ICEEICT). Hybrid BiLSTM-HMM based event detection and classification system for food intake recognition View
  2. Ghosh T, Sazonov E. 2022 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC). A Comparative Study of Deep Learning Algorithms for Detecting Food Intake View
  3. Tsakmaki P, Tasoulis S, Georgakopoulos S, Plagianakos V. 2024 IEEE Congress on Evolutionary Computation (CEC). Harnessing LSTMs for Enhanced Prediction of Psychotic Episodes in Schizophrenia Spectrum View
  4. Yousaf A, Sazonov E. 2024 Tenth International Conference on Communications and Electronics (ICCE). Food Intake Detection in the Face of Limited Sensor Signal Annotations View
  5. Wang C, Xue Z, Kumar T, Camps G, Hallez H, Vanrumste B. 2025 47th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). Skeleton-Based Intake Gesture Detection With Spatial-Temporal Graph Convolutional Networks View