Black and white crayon drawing of a research lab
Software and Tools

EmoMonitor – An Innovative Solution for Supporting Emotional Health

Marilena Ianculescu , Andreea-Maria Gușatu , Liudmila Valeanu , Corina Petean , Ana-Mihaela Vasilevschi , Ovidiu Bica , Dragoș-Nicolae Nicolau and Cristian Petrache

EmoMonitor is an innovative system designed to monitor and manage emotions based on Internet of Things (IoT) and Artificial Intelligence (AI) technologies. Its primary goal is to support individuals in improving their emotional well-being through real-time evaluations and personalized interventions tailored to their unique emotional patterns. By integrating data from multiple sources — including physiological parameters, facial expressions, and vocal characteristics — EmoMonitor system provides a comprehensive yet discreet analysis of emotional states, with a strong commitment to user privacy.

Beyond individual use, EmoMonitor system includes dedicated functionalities for mental health professionals and organizational stakeholders. Psychologists and HR specialists can access a secure space for recording professional observations, monitoring emotional trends, and supporting personalized development plans. This makes the system a sustainable tool not only for self-awareness and emotional self-regulation, but also for fostering emotional intelligence, resilience, and well-being in workplace environments. Whether in clinical settings or corporate contexts, EmoMonitor system is designed to promote healthier, more adaptive, and emotionally supportive ecosystems.

Core Technologies and System Components

  • AI

    • Python Libraries: Using libraries like TensorFlow, PyTorch, and scikit-learn to create and train models for facial recognition and voice analysis.

  • IoT

    • Withings Devices: Collect real-time physiological data (heart rate, blood pressure, and temperature) to correlate it with emotional states through specific processing and classify it into positive, neutral, or negative emotions.

  • Cognitive & Emotional Monitoring Tools

    • EEG Data: Electroencephalographic (EEG) data recorded with the Muse Band device during meditation provides insights into relaxation and emotional balance. This is complemented by targeted questionnaires, an emotional journal, and an emotional history where users log their perceived states. This combination supports a comprehensive analysis by integrating both objective signals and personal input.

  • Frontend Development

    • HTML, CSS, JavaScript: Used to build interactive, responsive user interfaces for the system.

  • Backend & Processing

    • Python (Django Framework): Core language for backend processing and data analysis, managing authentication, data storage, and AI model inference.

  • Server-Side Modules

    • Visual C++, C#, SQL: Used for developing robust processing modules and integrating with databases.

  • Database

    • MySQL/MariaDB: Serves as the database for storing emotional, physiological, and user interaction data.

  • Authentication and User Access

    • The system employs tailored role-based access control, providing customized experiences for Individual users, Specialist users, and Administrators.
    • The authentication system supports secure login, password hashing, and multi-role management with dedicated dashboards.

Applications and benefits

  1. Comprehensive Monitoring
  • Combines AI-based facial expression and speech feature analysis with physiological parameter analysis to provide a comprehensive emotional state assessment.
  • Benefit: Instant feedback that boosts emotional awareness.
  1. Personalized Feedback and Progress Tracking
  • Weekly reports, questionnaires, and an emotional journal help track progress and provide tailored recommendations.
  • Benefit: A customized approach to enhancing and maintaining emotional well-being.
  1. Expert Guidance and Educational Resources
  • Access to expert-written materials and professional insights.
  • Benefit: Reliable guidance and useful information to effectively manage emotions.

Future directions

EmoMonitor system will be further developed into a more advanced emotional and mental health digital solution by integrating modules for stress, anxiety, and depression detection and management. Through enhanced EEG, voice and facial analysis and processing, a larger range of physiological monitoring, and validated screening tools for specific cognitive dysfunctionalities, the system will be able to provide timely alert triggers and personalized healthcare and psychological support. Future developments may also include features such as real-time emotional coaching through conversational agents (AI-based chatbots), integration with wearable devices for sleep and activity tracking, and the implementation of gamified modules to support emotional learning and resilience building. The system could incorporate tools for collaborative stress and anxiety monitoring in team-based environments. These functionalities aim to expand EmoMonitor system’s capabilities beyond individual analysis, fostering a more holistic and interactive approach to emotional and cognitive health.

Go back