Integrating Multimodal Deep Learning for Enhanced News Sentiment Analysis and Market Movement Forecasting

Abhinav Sudhakar Dubey; Pranav Singh Mahara1

1

Publication Date: 2024/06/29

Abstract: This paper presents a novel multimodal deep learning framework for analyzing news sentiments and forecasting market movements by leveraging natural language processing, deep learning, and auxiliary data sources. Traditional methods often rely solely on textual news data, limiting their predictive power due to the complexity and ambiguity of language. Our approach incorporates additional modalities such as stock prices, social media sentiment, and economic indicators to capture a more comprehensive view of market dynamics. We employ a hybrid deep learning architecture that combines convolutional neural networks (CNNs) for text feature extraction, long short-term memory (LSTM) networks for capturing sequential dependencies, and attention mechanisms to selectively focus on the most relevant features. To address data scarcity, we introduce advanced data augmentation techniques, generating synthetic news headlines based on historical stock price movements and sentiment patterns. The proposed system is evaluated on a comprehensive dataset spanning multiple years, including news headlines, stock prices, social media data, and economic indicators. Our method achieves an accuracy of 77.51%, significantly outperforming traditional methods and demonstrating improved robustness and predictive power. This study highlights the potential of integrating diverse data sources and sophisticated deep learning techniques to enhance news sentiment analysis and market movement forecasting.

Keywords: Multimodal Deep Learning, Natural Language Processing, Sentiment Analysis, Convolutional Neural Networks, Long Short-Term Memory, Attention Mechanisms, Data Augmentation, Auxiliary Data.

DOI: https://doi.org/10.38124/ijisrt/IJISRT24JUN1691

PDF: https://ijirst.demo4.arinfotech.co/assets/upload/files/IJISRT24JUN1691.pdf

REFERENCES

  1. Henrique, Bruno Miranda, Vinicius Amorim Sobreiro, and Herbert Kimura. "Literature review: Machine learning techniques applied to financial market prediction." Expert Systems with Applications 124 (2019): 226-251.
  2. Yu, Yong, Xiaosheng Si, Changhua Hu, and Jianxun Zhang. "A review of recurrent neural networks: LSTM cells and network architectures." Neural computation 31, no. 7 (2019): 1235-1270.
  3. Wu, Di, Ziyu Wang, and Weichao Zhao. "XLNet-CNN-GRU dual-channel aspect-level review text sentiment classification method." Multimedia Tools and Applications 83, no. 2 (2024): 5871-5892.
  4. Zhang, Xulang. "Disentangling syntactics, semantics, and pragmatics in natural language processing." (2024).
  5. Dahal, Keshab Raj, Nawa Raj Pokhrel, Santosh Gaire, Sharad Mahatara, Rajendra P. Joshi, Ankrit Gupta, Huta R. Banjade, and Jeorge Joshi. "A comparative study on effect of news sentiment on stock price prediction with deep learning architecture." Plos one 18, no. 4 (2023): e0284695.
  6. Mehta, Pooja, Sharnil Pandya, and Ketan Kotecha. "Harvesting social media sentiment analysis to enhance stock market prediction using deep learning." PeerJ Computer Science 7 (2021): e476.
  7. Nti, Isaac Kofi, Adebayo Felix Adekoya, and Benjamin Asubam Weyori. "Predicting stock market price movement using sentiment analysis: Evidence from Ghana." Applied Computer Systems 25, no. 1 (2020): 33-42.
  8. Shah, Dev, Haruna Isah, and Farhana Zulkernine. "Predicting the effects of news sentiments on the stock market." In 2018 IEEE International Conference on Big Data (Big Data), pp. 4705-4708. IEEE, 2018.
  9. Mishev, Kostadin, Ana Gjorgjevikj, Irena Vodenska, Lubomir T. Chitkushev, and Dimitar Trajanov. "Evaluation of sentiment analysis in finance: from lexicons to transformers." IEEE access 8 (2020): 131662-131682.
  10. Shahapur, S. S., A. Koralli, G. Chippalakatti, M. M. Balikai, D. Mudalagi, R. Dias, S. Devali, and K. Wajantari. "Discovering Untapped Potential in Finance Markets Using NLP-Driven Sentiment Analysis." Indian Journal of Science and Technology 17, no. 21 (2024): 2240-2249.
  11. Nemes, László, and Attila Kiss. "Prediction of stock values changes using sentiment analysis of stock news headlines." Journal of Information and Telecommunication 5, no. 3 (2021): 375-394.
  12. Vicari, Mattia, and Mauro Gaspari. "Analysis of news sentiments using natural language processing and deep learning." AI & society 36, no. 3 (2021): 931-937.
  13. Dhingra, Barkha, Shallu Batra, Vaibhav Aggarwal, Mahender Yadav, and Pankaj Kumar. "Stock market volatility: a systematic review." Journal of Modelling in Management 19, no. 3 (2024): 925-952.
  14. Rath, Swarnalata, Nilima R. Das, and Binod K. Pattanayak. "An Analytic Review on Stock Market Price Prediction using Machine Learning and Deep Learning Techniques." Recent Patents on Engineering 18, no. 2 (2024): 88-104.