Multimodal remote sensing data classification can enhance the model’s ability to distinguish land features through multimodal data fusion. In this context, how to help models understand the relationship between multimodal data and target tasks is the focus of researchers. Inspired by human feedback learning mechanisms, causal reasoning mechanisms, and knowledge induction mechanisms, this paper integrates causal learning, reinforcement learning, and meta learning into a unified remote sensing data classification framework and proposed the causal meta-reinforcement learning (CMRL). First, based on feedback learning mechanisms, we have overcome the limitations of traditional implicit optimization of fusion features and customized a reinforcement learning environment for multimodal remote sensing data classification tasks. Through feedback interactive learning between agents and the environment, we help them understand the complex relationships between multimodal data and labels, thereby achieving full mining of multimodal complementary information. Second, based on the causal inference mechanism we designed causal distribution prediction action, classification reward, and causal intervention reward, capturing pure causal factors in multimodal data and cutting off false statistical associations between non-causal factors and class labels. Finally, based on the knowledge induction mechanism, we designed a bi-layer optimization mechanism based on meta-learning. By constructing a meta training task and meta validation task simulation model in the generalization scenario of unseen data, we helped the model induce cross-task shared knowledge, thereby improving its generalization ability for unseen multimodal data. The experimental results on multiple sets of multimodal datasets show that the proposed method achieved state-of-the-art performance in multimodal remote sensing data classification tasks.

The abstract should be a total of about 250 words and structured to contain the following headings: Background/Objectives, Methods, Results, Conclusions. Background/Objectives: Place the question addressed in a broad context and highlight the purpose of the study; Methods: Describe briefly the main methods or treatments applied. Include any relevant preregistration numbers, and species and strains of any animals used; Results: Summarize the article’s main findings; Conclusions: Indicate the main conclusions or interpretations. The abstract should be an objective representation of the article: it must not contain results which are not presented and substantiated in the main text and should not exaggerate the main conclusions. Clinical trial abstracts should include items that the CONSORT group has identified as essential.

The collaboration of multimodal transport documents is the foundation for conducting multimodal transport operations. Blockchain technology can effectively address trust issues and information sharing difficulties in current multimodal transport document collaboration. However, in current blockchain-based electronic document research, the bottleneck problem lies in the collaboration of multiparty in multimodal transport under the "one-bill coverage system". We design a blockchain platform architecture for multimodal transport, reshaping collaboration processes for different modes of transport based on the blockchain platform. It proposes a collaboration model for multimodal transport under the "one-bill coverage system" and performs model solving and case analysis. The obtained collaboration strategies are embedded into the platform's application layer. Finally, using Solidity language, it writes smart contracts related to multimodal transport under the "one-bill coverage system " and deploys and executes them on the Remix platform.

Ambulatory heart rate (HR) monitors that acquire electrocardiogram (ECG) or/and photoplethysmographm (PPG) signals from the torso, wrists, or ears are notably less accurate in tasks associated with high levels of movement compared to clinical measurements. However, reliable estimation of HR can be obtained through data fusion from different sensors. These methods are especially suitable for multimodal hearable devices, where heart rate can be tracked from different modalities, including electrical ECG, optical PPG, and sounds (heart tones). Combined information from different modalities can compensate for single source limitations. In this paper, we evaluate the possible application of data fusion methods in hearables. We assess data fusion for heart rate estimation from simultaneous in-ear ECG and in-ear PPG, recorded on eight subjects while performing 5-minute sitting and walking tasks. Our findings show that data fusion methods provide a similar level of mean absolute error as the best single-source heart rate estimation but with much lower intra-subject variability, especially during walking activities. We conclude that data fusion methods provide more robust HR estimation than a single cardiovascular signal. These methods can enhance the performance of wearable devices, especially multimodal hearables, in heart rate tracking during physical activity.

Multimodal emotion classification (MEC) involves analyzing and identifying human emotions by integrating data from multiple sources, such as audio, video, and text. This approach leverages the complementary strengths of each modality to enhance the accuracy and robustness of emotion recognition systems. However, one significant challenge is effectively integrating these diverse data sources, each with unique characteristics and levels of noise. Additionally, the scarcity of large, annotated multimodal datasets in Bangla limits the training and evaluation of models. In this work, we unveiled a pioneering multimodal Bangla dataset, MAViT-Bangla (Multimodal Audio Video Text Bangla dataset). This dataset, comprising 1002 samples across audio, video, and text modalities, is a unique resource for emotion recognition studies in the Bangla language. It features emotional categories such as anger, fear, joy, and sadness, providing a comprehensive platform for research. Additionally, we developed a framework for emotion recognition that employs a cross-modal attention mechanism among unimodal features. This mechanism fosters the interaction and fusion of features from different modalities, enhancing the model’s ability to capture nuanced emotional cues. The effectiveness of this approach was demonstrated by achieving an F1-score of 0.64, a significant improvement over unimodal methods.

Breast cancer remains a major public health concern, and early detection can result in more treatment options, which are crucial for improving survival rates. Metabolomics offers the potential to develop blood-based screening and diagnostics tools that are less invasive and more cost-effective. However, the inherent complexity of metabolomic datasets makes identifying the most diagnostically relevant biomarkers a difficult task, with multiple studies demonstrating lim-ited agreement on the specific metabolites and pathways involved. This study aims to identify a set of biomarkers for early diagnosis of breast cancer using metabolomics data. Plasma samples from 185 breast cancer patients and 53 controls (CHTN) were analyzed. We utilized univariate Naïve Bayes, L2-regularized Support Vector Machines, and Principal Component Analysis (PCA), along with feature engineering techniques, to select the most informative features. Multiple ma-chine learning models, including Support Vector Machines, Multidimensional Scaling, Logistic Regression, and Ensemble Learning were utilized for classification. The best-performing feature set comprised 4 biomarkers and 2 demographic variables, achieving an accuracy of 98%, demon-strating the potential for a robust, cost-effective, non-invasive breast cancer screening and diagnostic tool.

Pain diagnosis remains a challenging task due to its subjective nature, the variability in pain expression among individuals, and the difficult assessment of the underlying biopsychosocial factors. In this complex scenario, artificial intelligence (AI) can offer the potential to enhance diagnostic accuracy, predict treatment outcomes, and personalize pain management strategies. This review aims at dissecting the current literature on computer-aided diagnosis methods. It also discusses how AI-driven diagnostic methods can be integrated into multimodal models that combine various data sources, such as facial expression analysis, neuroimaging, and physiological signals, with advanced AI techniques. Despite the significant advancements in AI technology, its widespread adoption in clinical settings faces crucial challenges. Ethical considerations related to patient privacy, biases, and lack of reliability and generalizability are the main issues. Furthermore, there is a need for high-quality real-word validation as well as the development of standardized protocols and policy rules to guide the implementation of these technologies in diverse clinical settings.

Background/Objectives: Endometriosis represents substantial direct and indirect healthcare costs impacted by absent accurate, non-invasive uniformly diagnostic tools. We endeavored to demonstrate gastrointestinal myoelectrical activity (GIMA) biomarkers unique to endometriosis allow noninvasive, uniformly accurate diagnosis or exclusion of endometriosis. Methods: Prospective open-label comparative study of 154 patients, age >18, with or without diagnosed endometriosis. Population included 62 non-endometriosis controls (Cohort 1), 43 subjects with surgically histologically-confirmed endometriosis (Cohort 2), and 49 subjects with abdominal pain and negative imaging (Cohort 3). Electroviscerography (EVG) recorded GIMA biomarkers from three abdominal electrodes before and 30-minutes post water-load protocol. Cohort 2 had postoperative EVG and Cohort 3 had preoperative EVG. Calculated specificity, sensitivity, NPV, PPV and predictive probability or C-Statistic used univariate, multivariate, linear and logistical regression analyses of the area under the curve (AUC) at all frequency and time points, including age and pain covariants. Results: Non-endometriosis cohort differed significantly from endometriosis cohorts (p<0.001) for median (IQR), and AUC percent frequency distribution of power at baseline, 10-minute, 20-minute, and 30-minute post water-load at all frequency ranges 15-20cpm, 30-40cpm and 40-50cpm. Endometriosis cohorts were statistically similar (p>0.05). GIMA biomarker threshold scoring demonstrated 95%/91% sensitivity and PPV, 96%/95% specificity and NPV and C-statistic of >99%/98% respectively for age subsets. GIMA biomarkers in Cohort 3 predicted 47/49 subjects positive and 2/49 negative for endometriosis, confirmed surgically. Hormonal therapy, surgical stage, nor pain score affected diagnostic accuracy. Conclusions: Non-invasive electroviscerography with GIMA biomarker detection distinguished participants with and without endometriosis based upon endometriosis specific GIMA biomarkers threshold scoring.

Serotonin (5-hydroxytryptamine: 5-HT), a neurotransmitter that regulates mood in the brain and signaling in the gut, has receptors throughout the body that serve various functions. Selective serotonin reuptake inhibitors (SSRIs) are used to treat depression, but their efficacy is uncertain. Depression is often associated with early gastrointestinal symptoms. Gut disorders such as functional dyspepsia (FD), irritable bowel syndrome (IBS) and inflammatory bowel disease (IBD), including ulcerative colitis (UC) and Crohn's disease (CD), are linked to elevated serotonin levels. In this review, we would like to discuss the approach of using serotonin as a biomarker for gut-brain and body-wide organ communication may lead to the development of preventive and innovative treatments for gut-brain disorders, offering improved visibility and therapeutic monitoring. It could also be used to gauge stress intensity for self-care and mental health improvement.

With the development of human-computer interaction, the importance of emotion recognition is increasing. Emotion recognition technology provides practical benefits in various industries such as improving user experience, education, and organizational productivity. In education, emotion recognition can enable real-time understanding of students' emotional states and provide tailored feedback, and in the workplace, by monitoring employees' emotional states, it can improve work performance and job satisfaction. Therefore, multimodal-based research that combines text, speech, and video data for emotion recognition is being conducted in various industries. In this study, we propose an emotion recognition method that combines text and speech data, reflecting the characteristics of the Korean language. For text, KoELECTRA is used to perform embedding, and for speech, MFCC and pitch analysis are used to extract features. Finally, a multimodal transformer model is proposed that combines these two data types to perform emotion recognition. The multimodal transformer model processes text and speech data separately, and then learns the interaction between the two modalities through a Cross-Modal Attention mechanism. Through this, the complementary information from text and speech is effectively combined, improving emotion recognition performance. Experimental results show that the proposed model outperforms single-modality models, achieving a high accuracy of 73.13% and an F1-Score of 0.7344 in emotion classification. This study contributes to the advancement of emotion recognition technology by combining various language and modality data, and higher performance can be expected through the integration of additional modalities in the future.

Heart failure is a global major healthcare problem with millions of hospitalizations annually and with a very high mortality. There is an increased interest in finding new and reliable biomarkers for the diagnostication, prognostication and therapeutical guidance of patients hospitalized for acute heart failure. There is data to sustain the role of CA 125, a worldwide used marker of ovarian cancer, in patients with heart failure. Several studies have shown links between CA 125 levels and congestion seen in acute heart failure, high mortality and readmission rates at 6 months follow up after discharge from acute heart failure and also a role of CA 125 in the guidance of heart failure therapy. There are also clinical trials that showed that several particularities of CA 125 make it even better than NTpro BNP ( a classical and more utilised marker of heart failure) in several scenarios of acute heart failure.

Multimodal knowledge graph completion necessitates the integration of information from multiple modalities (such as images and text) into the structural representation of entities to improve link prediction. However, most existing studies have overlooked the interaction between different modalities. To address this issue, this paper proposed a Transformer-based knowledge graph link prediction model (MM-Transformer) that fuses multimodal features. Different modal encoders are employed to extract structural, visual and textual features, and hybrid key-value calculations are performed on features from different modalities based on the Transformer architecture. The similarities of textual tags to structural tags and visual tags are calculated and aggregated respectively, and multimodal entity representations are modeled and optimized to reduce the heterogeneity of the representations. Experimental results demonstrate that, compared to the current multimodal state-of-the-art methods, the proposed method achieves significant performance improvements in knowledge graph link prediction tasks. This proves that the proposed method effectively addresses the problem of multimodal feature fusion in knowledge graph link prediction tasks.

The human mind is multimodal. Yet most behavioral studies rely on century-old measures of behavior—task accuracy and latency (response time). Multimodal and multisensory analysis of human behavior creates a better understanding of how the mind works. The problem is that designing and implementing these experiments is technically complex and costly. This paper introduces versatile and economical means of developing multimodal-multisensory human experiments. We provide an experimental design framework that automatically integrates and synchronizes measures including electroencephalogram (EEG), galvanic skin response (GSR), eye-tracking, virtual reality (VR), body movement, mouse/cursor motion and response time. Unlike proprietary systems (e.g., iMotions), our system is free and open-source; it integrates PsychoPy, Unity and Lab Streaming Layer (LSL). The system embeds LSL inside PsychoPy/Unity for the synchronization of multiple sensory signals—gaze motion, electroencephalogram (EEG), galvanic skin response (GSR), mouse/cursor movement, and body motion—with low-cost consumer-grade devices in a simple behavioral task designed by PsychoPy and a virtual reality environment designed by Unity. This tutorial shows a step-by-step process by which a complex multimodal-multisensory experiment can be designed and implemented in a few hours. When conducting the experiment, all of the data synchronization and recoding of the data to disk will be done automatically.

Improper sitting positions are known as the primary reason for back pain and the emergence of musculoskeletal disorders (MSD) among individuals who spend prolonged time working with computer screens, keyboards, and mice. At the same time, it is well understood that automated technological tools can play an important role in the process of unhealthy habit alteration, so plenty of research efforts are focused on research and technology development (RTD) activities that aim to provide support to the prevention of back pain or the development of MSD. Here, we report on creating a new resource in support of RTD activities aiming at the automated detection of improper sitting positions. It consists of multimodal multisensory recordings of 100 persons made with a video recorder, camera, and wrist-attached sensors that capture physiological signals (PPG, EDA, Skin temperature), as well as motion sensors (three-axis accelerometer). Our multimodal multisensory dataset (MMD-MSD) opens new opportunities for modeling the body stance (sitting posture and movements), physiological state (stress level, attention, emotional arousal, valence), and performance (success rate on the Stroop test) of people working with a computer. Finally, we demonstrate two use cases: improper neck posture detection from pictures and cognitive load detection from physiological signals.

Introduction: Carcinoid heart disease is a rare cause of right-sided valvular dysfunction, an important complication in patients with carcinoid syndrome. Objectives: We aim to present our own experience regarding early myocardial dysfunction in patients with carcinoid syndrome. Methods: 64 patients (35-90 year old, 62,5% female, 37,5% male patients) with carcinoid syndrome were evaluated be-tween October 2017 and June 2021. All patients underwent two-dimensional echocardiography with additional tissue Doppler and speckle-tracking techniques. For all patients there were measured urinary level of 5- hydroxyindolacetic acid, serotonin and NT-proBNP values. Results: The following echocardiographic features: global longitudinal strain of both ventricles, mean systolic velocity of the left ventricle, systolic velocity of the free wall of right ventricle, correlated with high values of specific biomarkers: serotonin, and urinary 5-hydroxyindolacetic acid, and also with the presence of hepatic metastases and poorly differentiated tumors. Discussion: In this study we identified several patients with early myocardial dysfunction due to carcinoid syndrome, representing a predictive model of poor prognosis, requiring further investigations. Conclusion: Echocardiographic assessment based on the measurement of systolic velocities, as well as the global longitudinal strain of both ventricles, together with specific biomarkers may contribute to better recognition of carcinoid heart disease in clinical practice, but this needs validation through further studies enrolling larger number of patients.

In response to the issues of sensor noise and accumulated motion errors that lead to low positioning accuracy and insufficient robustness during large maneuvers or continuous flight of small unmanned aerial vehicles (UAVs) in complex environments, this paper proposes a multi-source and multimodal data fusion method. Initially, it employs a multimodal data fusion of various sensors including GPS (Global Positioning System), IMU (Inertial Measurement Unit), and visual sensors to complement the strengths and weaknesses of each hardware component, thereby eliminating motion errors to enhance accuracy. To mitigate the impact of sudden changes in sensor data, the method introduces a digital twin UAV data source. By utilizing the Extended Kalman Filter algorithm, it fuses data from both the real UAV and its digital twin, and the filtered positional information is fed back into the control system of the real UAV. This enables real-time correction of UAV positional deviations caused by sensor noise and environmental disturbances. The multi-source multimodal fusion Kalman filter method proposed in this paper significantly improves the positioning accuracy of UAVs in complex scenarios and the overall stability of the system. This method holds significant value in maintaining high-precision positioning in variable environments and has important practical implications for enhancing UAV navigation and application efficiency.

Non-invasive continuous health monitoring has become feasible with the advancement of biosensors. While monitoring certain biomarkers such as heart rate or skin temperature are now at certain maturity, monitoring molecular biomarkers is still challenging. Progress has been shown in sampling, measurement and interpretation of data towards non-invasive molecular sensors that can be integrated in daily wearable items. Towards this goal, this paper explores the potential of embroidered interdigitated transducer (IDT)-based sensors for non-invasive, continuous monitoring of human biomarkers, particularly glucose levels, in human sweat. The study employs innovative embroidery techniques to create flexible fabric-based sensors with gold-coated IDTs. In controlled experiments, we have shown the variation of glucose concentration in water can be wirelessly detected by tracking the resonant frequency of the embroidered sensors. The current sensors operate at 1.8GHz–2GHz and respond to the change of glucose concentration with a sensitivity of 0.17 MHz/(mg/dl). The embroidered IDT-based sensors with wireless sensing will be a new measurement modality for molecular wearable sensors. The establishment of a wireless sensing mechanism for embroidered IDT-based sensors will be followed by investigation of sweat for molecular detection. This will require adding functionalities for sampling and interpretation of acquired data. We envisage the embroidered IDT-based sensors offer a unique approach for seamless integration into clothing, paving the way for personalised, continuous health data capture.

Molecular analysis of growing teratoma syndrome has not been extensively studied. Here, we report a 14-year-old boy with a growing mass during treatment for a mixed germ cell tumor of the pineal region. Tumor markers were negative; thus, growing teratoma syndrome was suspected. A radical resection via the occipital transtentorial approach was performed, and histopathological examination revealed a teratoma with malignant features. Methylation classifier analysis confirmed the diagnosis of teratoma, and DMRT1 loss and 12p gain were identified by copy number variation analysis, potentially elucidating the cause of growth and malignant transformation of the teratoma. The patient remains in remission after intense chemoradiation treatment as a high-risk germ cell tumor.

Background: Critical states present scale-free dynamics, optimizing neuronal complexity. We explored electroencephalogram (EEG) criticality in amnesic Mild Cognitive Impairment (aMCI) patients with clinical improvement in working memory, verbal memory, verbal fluency and overall executive functions after the completion of a 6-month prospective memory training. (2) Methods: We compared “before” and “after” stationary resting-state EEG records of right-handed MCI patients (n = 17; 11 females), using the method of critical fluctuations and Haar wavelet analysis. (3) Results: Significant criticality enhancement was present in frontotemporal electrodes [mean dif: 0.10; Z = 7, p = .019] and isolated electrodes T6 [mean dif: 0.204; t (10) = - 2.3, p = .044] and F4 [mean dif: 0.0194; t (10) = - 2.82; p = .018]. (4) Conclusions: EEG criticality agreed with clinical improvement, consisting a possible monitoring biomarker in MCI and Alzheimer’s disease. Further evaluation is needed in patients under cognitive training or even drug-modifying therapies.

Microbial foodborne pathogens can cause major risks to public health and the food industry. Rapid and accurate detection of these pathogens is crucial to prevent outbreaks and ensure food safety. Traditional single-mode biosensing approaches have their limitations in terms of specificity, sensitivity, and speed. Over the years, there has been an increasing research interest in developing multimodal biosensing strategies that integrate multiple sensing techniques to achieve enhanced accuracy, efficacy, and precision in foodborne pathogen detection. This article review paper explores the current state of multimodal biosensing technologies and their promising applications in the food industry. We discuss various integrated biosensing platforms, including optical, electrochemical, and nanomaterial-based systems, among others. The advantages, challenges, and future prospects of multimodal biosensing for foodborne pathogens are thoroughly examined, highlighting the potential impact of these advanced technologies on food safety and public health.

Federated learning (FL) has become a burgeoning and attractive research area, which provides a collaborative training scheme for distributed data sources with privacy concerns. Most existing FL studies focus on taking unimodal data, such as images and text, as the model input and resolving the heterogeneity challenge, i.e., the non-identically distributed (non-IID) challenge caused by data distribution imbalance related to data labels and data amount. In real-world applications, data are usually described by multiple modalities. However, to the best of our knowledge, only a handful of studies have been proposed to improve the system performance by utilizing multimodal data. In this survey paper, we identify the significance of this emerging research topic – multimodal federated learning (MFL) and perform a literature review on the state-of-art MFL methods. Furthermore, we categorize multi-modal federated learning into congruent and incongruent multimodal federated learning based on whether all clients possess the same modal combinations. We investigate the feasible application tasks and related benchmarks for MFL. Lastly, we summarize the promising directions and fundamental challenges in this field for future research.

Sepsis still remains one of the most difficult conditions to diagnose as it presents unspecific clinical signs and symptoms, which makes early detection crucial. Our study aimed to enhance the accuracy of sepsis diagnosis by integrating multimodal monitoring technologies with traditional diagnostic methods. The research involved 121 newborns, comprising 39 cases of late-onset sepsis, 35 cases of early-onset sepsis, and 47 control subjects. Biosignals including pulse oximetry (PO), near-infrared spectroscopy (NIRS), and skin temperature (ST) were continuously monitored and an algorithm was developed using Python for identifying early signs of sepsis. The model demonstrated the ability to detect sepsis 6 to 48 hours in advance with an accuracy rate of 87.67% ± 7.42%. Sensitivity and specificity were recorded at 76% and 90%, respectively, with NIRS and ST having the most significant impact on predictive accuracy. Despite the promising results, limitations such as sample size, data variability, and potential biases were noted. The findings highlight the critical role of non-invasive biosensing methods in conjunction with traditional biomarkers and cultures, offering a robust framework for early sepsis detection and improved neonatal care. Further studies are recommended to validate these results across diverse clinical settings.

There have been multiple technological advancements that promise to gradually enable devices to measure and record signals with high resolution and accuracy in the domain of Brain Computer Interfaces (BCI). Multi-modal BCIs have been able to gain significant traction given the potential to enhance signal processing by integrating different recording modalities. In this review, we explore the integration of multiple neuroimaging and neurophysiological modalities including Electroencephalography (EEG), Magnetoencephalography (MEG), Functional Magnetic Resonance Imaging (fMRI), Electrocorticography (ECoG), and Single-Unit Activity (SUA). This multimodal approach leverages the high temporal resolution of EEG and MEG with the spatial precision of fMRI, the invasive yet precise nature of ECoG, and the single-neuron specificity provided by SUA. The paper highlights the advantages of integrating multiple modalities, such as increased accuracy and reliability, and discusses the challenges and limitations of multimodal integration. Furthermore, we explain the data acquisition approaches for each of these modalities. We also demonstrate various software programs that help in extracting, cleaning, and refining the data. We conclude this paper with discussion on the available literature highlighting recent advances, challenges, and future directions for each of these modalities.

Every year around 800 000 people commit suicide, this represents one death every 40 seconds. In the search for possible biological biomarkers associated with suicide and/or psychiatric disorders, serum cholesterol levels have been extensively explored. Several studies have indicated that cholesterol and associated proteins, especially apolipoproteins (Apos), may play an important role in the diagnosis, prognosis, and susceptibility of suicide. Here, we describe the current knowledge and findings in the relationship between apolipoproteins and suicide.

The analysis of social media content plays a crucial role in uncovering intricate user behaviors and trends across diverse digital platforms. Social media is inherently multimodal, incorporating texts, images, audios, and videos, each offering unique insights into user engagement and preferences. Traditional classification methods often focus narrowly on the most prominent modality, typically neglecting the synergistic potential of integrating multiple data types. To address this gap, we introduce the Unified Multimodal Classifier (UMC), a suite of streamlined models that adeptly harness and integrate these varied modalities. UMC leverages a novel architecture that combines a pooling layer with auxiliary learning tasks, facilitating the formation of a robust and shared feature space. This integration allows UMC to not only accommodate but also capitalize on the inherent diversity of social media data. The models are designed to be inherently flexible, adjusting to the availability of data modalities and maintaining high classification accuracy under varied conditions. In emotion classification scenarios, UMC has shown exceptional performance, significantly outperforming traditional methods by effectively synthesizing information across modalities. Its robustness is highlighted in its ability to deliver consistent results, even in the absence of one or more modalities. The simplicity and efficiency of UMC make it a potent tool for social media analytics, enabling it to achieve higher accuracies and maintain effectiveness even with limited data inputs. This adaptive capability ensures that UMC can be deployed in real-world applications where data incompleteness is common, thus broadening the scope of its applicability in various analytical contexts.

In today’s Web 2.0 era, online social media has become an integral part of our lives. In the course of the information revolution, the form of information has undergone a radical change, from simple text information to today’s integrated video, image, text and audio, and there has also been a great change in the way of dissemination and access, as people nowadays do not just rely on traditional media to passively receive information, but more actively and selectively obtain information from social media. Therefore, it has become a great challenge for us to effectively utilize these massive and integrated multi-modal media information to form an effective system of retrieval, browsing, analysis and usage. Unlike movies and traditional long-form video content, micro-videos are usually short in length, between a few seconds and tens of seconds, which allows users to quickly browse different contents and make full use of the fragmented time in their lives, while users can also share their micro-videos to their friends or the public, forming a unique social way. Video contains rich multimodal information, and fusing information from multiple modalities in a video recommendation task can improve the accuracy of the video recommendation task.According to the micro-video recommendation task, a new combinatorial network model is proposed to combine the discrete features of each modality into the overall features of various modalities through the network, and then fuse the various modal features to obtain the overall video features, which will be used for recommendation. In order to verify the effectiveness of the algorithm proposed in this paper, experiments are conducted in the public dataset, and it is shown the effectiveness of our model.

Global warming and the associated increasing frequency of heatwaves are on the rise leading to numerous health complications. Diabetic patients are more vulnerable to heat exposure than healthy individuals, owing to their impaired sweating ability, however, little is known about how heat exposure may impact the function of skin cells, commonly keratinocytes. Our recent report provided the first proof-of-concept revealing that the metabolic composition of sweat EVs is associated with metabolic changes in healthy individuals and type 2 diabetes patients. Given this and the shared cellular proprieties of eccrine sweat glands with keratinocytes, we questioned whether the metabolic changes in sweat EVs may mirror the responses of keratinocytes upon heat exposure. To this, we exposed HaCat, which were maintained in low (mimicking healthy condition) and high glucose (mimicking diabetes condition) to acute (90 min), chronic (48 h), and repetitive heat exposure at 40 ⁰C. Through conducting a set of experiments including a targeted metabolomics approach, Greiss assay, western blotting analysis, and electron microscopy studies. The data demonstrate that heat exposure results in substantial changes of metabolite levels belonging to amino acids, pyrimidine metabolism, and glycolysis pathways in high glucose maintained HaCat cells when compared to those noted in low glucose condition. Exploring the molecular mechanisms through which heat exposure may impact the metabolic composition in keratinocytes, our discoveries highlight nitric oxide (NO) as a novel biomarker that the level is correlated with heat duration and frequency. Furthermore, data reveal that the HSP-70 protein levels and mitochondrial morphology are consequently altered. This study provides evidence of shared metabolic alterations in keratinocytes and sweat EVs collected from clinical study and proposes, for the first time, NO as a novel biomarker for monitoring changes in health and diabetes upon heat exposure.

The incidence of diabetes mellitus (DM) continues to rise worldwide and one of the most serious microvascular complications is diabetic kidney disease (DKD), which is the leading cause of end-stage renal disease. Current bi-omarkers such as urinary albumin excretion rate have limitation for early detection of DKD. In our study we used ultra-high-performance liquid chromatography coupled with electrospray ionization-quadrupole-time of flight-mass spectrometry (UHPLC-QTOF-ESI+-MS) techniques to quantify previously analyzed metabolites, such as tryptophan, kynurenic acid, taurine, l-acetylcarnitine, glycine, and tiglylglycine. We performed the targeted analy-sis of metabolites from urine and serum samples, collected from 110 subjects. Of these, 90 patients with type 2 DM (T2DM) were divided according to the urinary albumin/creatinine ratio (UACR) into normoalbuminuria 300 mg/g groups, respectively, while 20 subjects were rep-resented by healthy controls. Through various validation methods, we identified several metabolites as potential biomarkers, such as kynurenic acid, glycine, and l-tryptophan in serum and l-acetylcarnitine, tiglylglycine, and tau-rine in urine.

Sign language recognition is essential in hearing-impaired people’s communication. Sign language recognition is an important concern in computer vision and has been developed with rapid progress in image recognition technology. However, sign language recognition using a general monocular camera has problems with occlusion and recognition accuracy in sign language recognition. In this research, we aim to improve accuracy by using a 2-axis bending sensor as an aid in addition to image recognition. We aim to achieve higher recognition accuracy by acquiring hand keypoint information of sign language actions captured by a monocular RGB camera and adding sensor assist. To improve sign language recognition, we need to propose new AI models. In addition, the amount of dataset is small because it uses the original data set of our laboratory. To learn using sensor data and image data, we used MediaPipe, CNN, and BiLSTM to perform sign language recognition. MediaPipe is a method for estimating the skeleton of the hand and face provided by Google. In addition, CNN is a method that can learn spatial information, and BiLSTM can learn time series data. Combining the CNN and BiLSTM methods yields higher recognition accuracy. We will use these techniques to learn hand skeletal information and sensor data. Additionally, the 2-axis Bending sensor glove data support training AI model. Using these methods, we aim to improve the recognition accuracy of sign language recognition by combining sensor data and hand skeleton data. Our method performed better than using skeletal information, achieving 96.5% accuracy in Top-1.

According to the World Health Organization (WHO), dementia is the seventh leading reason of death among all illnesses and one of the leading causes of disability among the world’s elderly people. Day by day the number of Alzheimer’s patients is raising. Considering the increasing rate and the dangers, Alzheimer’s disease should be diagnosed carefully. Machine learning is a potential technique for Alzheimer’s diagnosis but general users do not trust machine learning models due to the black-box nature. Even, some of those models do not provide the best performance because of using only neuroimaging data. To solve these issues, this paper proposes a novel explainable Alzheimer’s disease prediction model using a multimodal dataset. This approach performs a data-level fusion using clinical data, Freesurfer MRI segmentation data, and psychological data. For Alzheimer’s disease vs cognitively normal prediction, the random forest classifier provides 100% accuracy. Furthermore, Alzheimer’s disease and non-Alzheimer’s dementia should be classified properly because their symptoms are similar. To the best of our knowledge, we are the first to present a three-class classification on Alzheimer’s disease vs cognitively normal vs non-Alzheimer’s dementia and achieved 99.86% accuracy using an ensemble model. Besides, a novel Alzheimer’s patient management architecture is also proposed in this work..

BReast CAncer gene 1 (BRCA1) and BReast CAncer gene 2 (BRCA2) encode for tumor suppressor proteins which are critical regulators of the homologous recombination (HR) pathway, the most precise and important DNA damage response mechanism. Dysfunctional HR proteins cannot repair double-stranded DNA breaks in mammalian cells, a situation called HR deficiency. Since their identification, pathogenic variants and other alterations of BRCA1 and BRCA2 genes have been associated with an increased risk of developing mainly breast and ovarian cancer. Interestingly, HR deficiency is also detected in tumors not carrying BRCA1/2 mutations, a condition termed “BRCAness”. One of the main mechanisms causing the BRCAness phenotype is the methylation of the BRCA1/2 promoters and this epigenetic modification is associated with carcinogenesis and poor prognosis mainly among patients with breast and ovarian cancer. BRCA1 promoter methylation has been suggested as an emerging biomarker of great predictive significance, especially concerning Poly (ADP-ribose) Polymerase inhibitors (PARP inhibitor-PARPi) responsiveness, along with or beyond BRCA1/2 mutations. However, as its clinical exploitation is still insufficient, the impact of BRCA1/2 promoter methylation status needs to be further evaluated. The current review aims to gather the latest findings about the mechanisms that underline BRCA1/2 function as well as the molecular characteristics of tumors associated with BRCA1/2 defects, by focusing on DNA methylation. Furthermore, we critically analyze their translational meaning and the validity of BRCA methylation biomarkers in predicting treatment response and we suggest a diagnostic pipeline that could be implemented in liquid biopsy to aid precision pharmacotherapy in BRCA-associated tumors.

In an era where dietary habits significantly impact health, technological interventions can offer personalized and accessible food choices. This paper introduces Chef Dalle, a recipe recommen-dation system that leverages multimodal human-computer interaction (HCI) techniques to pro-vide personalized cooking guidance. The application integrates voice-to-text conversion via Whisper, ingredient image recognition through GPT-Vision, and employs TF-IDF vectorization alongside cosine similarity for personalized recipe recommendations. These methods enable users to interact with the system using voice, text, or images, accommodating various dietary re-strictions and preferences. Furthermore, the utilization of DALL-E 3 for generating recipe images enhances user engagement. User feedback mechanisms allow for the refinement of future rec-ommendations, demonstrating the system's adaptability. Chef Dalle showcases potential appli-cations ranging from home kitchens to grocery stores and restaurant menu customization, ad-dresses accessibility, promoting healthier eating habits. This paper underscores the significance of multimodal HCI in enhancing culinary experiences, setting a precedent for future developments in the field.

This study compares the performance of existing studies on multimodal emotion recognition, and proposes a model that fuses two modalities with the speaker's text and voice signals as input values and detects depression. Based on the DAIC-WOZ dataset, voice features were extracted using CNN, text features were extracted using Transformers, and two modalities were fused through a tensor fusion network. We also build a model to detect whether the speaker is depressed or not using LSTM in the final layer. This study suggests the possibility of increasing access to mental illness diagnosis by enabling patients to detect depression on their own in daily conversations. If the model proposed in this study is developed and the voice conversation system is connected, it will be easier for patients who cannot visit the hospital periodically or who are reluctant to visit the hospital to check their condition and seek recovery. Furthermore, it can be expanded to multi-label classification for various mental diseases and used as a simple self-mental disease diagnosis tool.

The BAFF-APRIL system is crucial for the pathogenesis of systemic lupus erythematosus (SLE) by promoting B cell survival, differentiation and the maintenance of humoral autoimmunity. Here, we investigated the relationship of BCMA expression on B cell subsets with its ligands BAFF and APRIL, together with soluble BCMA, and with clinical and serologic variables in a cohort of 100 SLE patients (86 under conventional and 14 under belimumab therapy) and 30 healthy controls (HC) using multicolor flow cytometry and ELISA. We found that BCMA expression in SLE patients was significantly increased on all B cell subsets compared to HCs, with all examined components of the BAFF-APRIL system being upregulated. BCMA expression was significantly increased on switched and unswitched memory B cells compared to naïve B cells, both in HCs and SLE. BCMA expression on B cells correlated with plasmablast frequencies, serum anti-dsDNA antibodies and complement consumption, while soluble BCMA correlated with plasmablast frequency, highlighting its potential as clinical biomarker. Belimumab treatment significantly reduced BCMA expression on most B cell subsets and soluble TACI, and contributes to the inhibition of almost the entire BAFF-APRIL system and restoration of B cell homeostasis. These results provide insights into the complex dysregulation of the BAFF-APRIL system in SLE and highlight the therapeutic potential of targeting its components, particularly BCMA, in addition to its use as biomarker for disease activity.

Adaptive hyperactivity, characterized by increased activity levels and novelty-seeking traits without mood disorders, is prevalent among older adults in Sardinia's "blue zone," an area with high longevity. This study aims to evaluate the adaptive nature of hyperac-tivity concerning quality of life, social rhythms, and mood symptoms in individuals from this region, particularly among older adults over 80. Methods: This observational cross-sectional study included adults and older adults over 80 years from Sardinia's blue zone, recruited from the dermatology clinic at the University Hospital of Cagliari. Partici-pants underwent psychiatric interviews and completed the Mood Disorder Questionnaire (MDQ), Patient Health Questionnaire (PHQ-9), SF-12, and Brief Social Rhythm Scale (BSRS). Data were compared with national and regional normative data. Results: Older adults in the blue zone demonstrated higher MDQ positivity (22.58%) compared to na-tional averages (0.87%), without corresponding increases in dysregulated rhythms, de-pressive symptoms, or reduced quality of life. Younger elders (65-79 years) showed in-creased rhythm dysregulation (BSRS score: 20.64±7.02) compared to adults (17.40±6.09, p=0.040), but this trend was not observed in older elders (80+ years). No significant differ-ences were found in CH3SH and (CH3)2S levels between groups. Conclusions: Hyperactiv-ity observed in older adults from Sardinia's blue zone appears adaptive, not linked to so-cial rhythm dysregulation, depressive symptoms, or diminished quality of life, suggesting resilience factors that may contribute to longevity. These findings support the potential classification of such hyperactivity as beneficial rather than pathological, warranting fur-ther research into biomarkers and psychoeducational interventions to prevent the onset of bipolar disorders in predisposed individuals.

Neurodegenerative diseases, such as Alzheimer’s disease and Parkinson’s disease, are caused by a combination of multiple events that damage neuronal function. A well-characterized biomarker of neurodegeneration is proteinaceous aggregates accumulation in the brain. However, the gradually worsening symptoms of neurodegenerative diseases are unlikely to be solely due to the result of a mutation in a single gene, but rather a multi-step process involving epigenetic changes. Multiple epigenetic studies have revealed that modification of histones accompanied by both the local and global remodeling of the chromatin structure and alternations in transcriptional patterns are closely associated with the pathogenesis of neurodegenerative diseases. Unlike DNA mutations, epigenetic alterations are reversible, and therefore raise the possibilities for therapeutic intervention including dietary modifications. Additionally, reactive oxygen species may contribute to the pathogenesis of Alzheimer’s disease and Parkinson’s disease. Given that the antioxidant properties of plant-derived phytochemicals are likely to exhibit pleiotropic effects against ROS-mediated epigenetic alternation, dietary intervention may be promising for the management of neurodegeneration in these diseases. In this review, the state-of-the-art applications using single-cell multi-modal omics approaches including genetics, and epigenetics, and dietary approaches for the identification of novel biomarkers and therapeutic approaches for the treatment of neurodegenerative diseases are discussed.

Multimodal user interfaces promise a natural and intuitive human machine interactions. But is the extra effort for the development of a complex multi-sensor system justified, or can users also be satisfied with one input modality already? This study investigates interactions in an industrial weld inspection workstation. Three unimodal interfaces, including spatial interaction with buttons augmented on a workpiece or a worktable, and speech commands, were tested individually and in a multimodal combination. Within the unimodal conditions, users preferred the augmented worktable, but overall, the interindividual usage of all input technologies in the multimodal condition was ranked best. Our findings indicate that the implementation and use of multiple input modalities is valuable, and that it is difficult to predict the usability of individual input modalities for complex systems.

Background and Objectives: Stroke is a main leading cause for mortality and morbidity worldwide. Treat-ment of this pathology is still under development and its risk factors remain the main target to be reached. Therefore, we aim to determine the role of interleukin 1 beta in atheromatosis, as risk factor for stroke and the reole of this biomarker in stroke prognosis. Materials and Methods: The study conducted enrolled 56 patients diagnosed with ischemic stroke in the anterior (AVT) and posterior vascular territory (PVT). All patients had venous blood collected at admission and 7 days after the onset of the cerebral ischemia in order to determine plasma concentration for interleukin 1 beta. At the same time an extracranial carotid ultrasound was performed. Results: Interleukin 1 beta collected at admission was positively correlated with NIHSS at admission (Pearson index 0,424) and both measurements were corelated with carotid stenosis (Spearmen correlation index 0,529, respectively 0,653). Conclusion: Interleukin 1 beta could be a reliable biomarker for stroke prognosis and carotid atheromatosis development.

The exponential growth of multimodal content across social media platforms, comprising text, images, audio, and video, has catalyzed substantial interest in artificial intelligence, particularly in multi-modal sentiment analysis (MSA). This study presents a comprehensive survey of 30 research papers published between 2020 and 2024 by eminent publishers such as Elsevier, ACM, IEEE, Springer, and others indexed in Google Scholar. Our analysis primarily focuses on exploring multimodal fusion techniques and features, with specific emphasis on the integration of text and image data. Additionally, the article offers an overview of the evolution, definition, and historical context of MSA. It delves into the current challenges and potential advantages of MSA, investigating recent datasets and sophisticated models. Furthermore, the study provides insights into prospective research directions. Notably, this review offers valuable recommendations for advancing research and developing more robust MSA models, thus serving as a valuable resource for both academic and industry researchers engaged in this burgeoning field.

The advent of the era of big data will bring more convenience to people and greater development to society. But at the same time, it will also bring people the problem of 'information overload', i.e., when people are faced with huge information data, there are many redundant and worthless data. The redundant and worthless data information seriously interferes with the accurate selection of information data. Even though people can use Internet search engines to access information data, they cannot meet the individual needs of specific users in specific contexts. The personalized needs of a particular user in a particular context. Therefore, how to find useful and valuable information quickly has become one of the key issues in the development of big data. With the advent of the era of big data, recommendation systems, as an important technology to alleviate information overload, have been widely used in the field of e-commerce. Recommender systems suffer from a key problem: data sparsity. The sparsity of user history rating data causes insufficient training of collaborative filtering recommendation models, which leads to a significant decrease in the accuracy of recommendations. In fact, traditional recommendation systems tend to focus on scoring information and ignore the contextual context in which users interact. There are various contextual modal information in people's real life, which also plays an important role in the recommendation process. In this paper we achieve data degradation and feature extraction, solving the problem of sparse data in the recommendation process. An interaction context-aware sub-model is constructed based on a tensor decomposition model with interaction context information to model the specific influence of interaction context in the recommendation process. Then an attribute context-aware sub-model is constructed based on the matrix decomposition model and using attribute context information to model the influence of user attribute contexts and item attribute contexts on recommendations. In the process of building the model, the method not only utilizes the explicit feedback rating information of users in the original dataset, but also utilizes the interaction context and attribute context information of the implicit feedback and the unlabeled rating data. We evaluate our model by extensive experiments. The results illustrate the effectiveness of our recommender model.

Hateful and abusive speech presents a major challenge for all online social media platforms. Recent advances in Natural Language Processing and Natural Language Understanding allow more accurate detection of hate speech in textual streams. This study presents a multimodal approach to hate speech detection by combining Computer Vision and Natural Language processing models for abusive context detection. Our study focuses on Twitter messages and, more specifically, on hateful, xenophobic and racist speech in Greek aimed at refugees and migrants. In our approach we combine transfer learning and fine-tuning of Bidirectional Encoder Representations from Transformers (BERT) and Residual Neural Networks (Resnet). Our contribution includes the development of a new dataset for hate speech classification, consisting of tweet ids, along with the code to obtain their visual appearance, as they would have been rendered in a web browser. We have also released a pre-trained Language Model trained on Greek tweets, which has been used in our experiments. We report a consistently high level of accuracy (accuracy score=0.970, f1-score=0.947 in our best model) in racist and xenophobic speech detection.

Globally, there is massive uptake and explosion of data and challenge is to address issues like scale, pace, velocity, variety, volume and complexity of this big data. Considering the recent epidemic in China, modeling of COVID-19 epidemic for cumulative number of infected cases using data available in early phase was big challenge. Being COVID-19 pandemic during very short time span, it is very important to analyze the trend of these spread and infected cases. This chapter presents medical perspective of COVID-19 towards epidemiological triad and the study of state-of-the-art. The main aim this chapter is to present different predictive analytics techniques available for trend analysis, different models and algorithms and their comparison. Finally, this chapter concludes with the prediction of COVID-19 using Prophet algorithm indicating more faster spread in short term. These predictions will be useful to government and healthcare communities to initiate appropriate measures to control this outbreak in time.

Affordances are an important concept in cognition, which can be applied to robots in order to perform a successful human-robot interaction (HRI). In this paper we explore and discuss the idea of emotional affordances and propose a viable model for implementation into HRI. We consider “2-ways” affordances: perceived object triggering an emotion, and perceived human emotion expression triggering an action. In order to make the implementation generic, the proposed model includes a library that can be customised depending on the specific robot and application’s scenario. We present the AAA (Affordance-Appraisal-Arousal) model, which incorporates Plutchik’s Wheel of Emotions, and show some examples of simulation and possible scenarios.

Serum albumin (ALB), one of the most important proteins in human physiology, has the main functions of maintaining plasma oncotic pressure and plasma volume, transporting hormones, vitamins, oligominerals and drugs, and exerting a powerful antioxidant-antiinflammatory role. Its prognostic value in liver and malabsorption syndromes is well known. In this narrative review, an analysis of the most important studies evaluating the prognostic significance of low serum ALB levels in hospitalized patients was performed. Specifically, the risk in emergency medicine, cardiovascular diseases, COVID-19 infection, nephrology, oncology and autoimmune rheumatic diseases has been examined to fully explore its clinical value. ALB is a negative acute-phase reactant and the reduction of its serum levels represents a threatening parameter for long-term survival in several clinical settings, and a strong poor prognostic biomarker in most diseases. Therefore, clinicians should consider serum ALB as a valuable tool to assess the efficacy of specific therapies, both in hospitalized patients and in chronic follow-up.

A previous report showed that the urine output of HPLBII-P in patients with diabetes mellitus and SARS-Cov-2 infection was increased as a sign of glomerular dysfunction. . The aim of this report was to investigate the relation of urine output of HPLBII-P to diabetes mellitus in two large community-based elderly populations i.e. the ULSAM and PIVUS cohorts. Methods HPLBII-P was measured by ELISA in the urine of a community-based cohort of 839 men (ULSAM) collected at 77 years of age and in urine of a community-based cohort of 75-year-old men, n=387, and women, n=401 (PIVUS). KIM-1, NGAL and Albumin were measured in urine and Cathepsin S and Cystatin C in serum. Results HPLBII-P was significantly raised among males with diabetes in the ULSAM (p

Ensuring precise segmentation of colorectal polyps holds critical importance in the early diagnosis and treatment of colorectal cancer. Nevertheless, existing deep learning-based segmentation methods are fully-supervised, requiring extensive precise manual pixel-level annotation data, which leads to high annotation costs. Additionally, it remains challenging to train large-scale segmentation models when confronted with limited colonoscopy data. To address these issues, we introduce the general segmentation foundation model—Segment Anything Model (SAM) into the field of medical image segmentation. Fine-tuning the foundation model is an effective approach to tackle sample scarcity. However, current SAM fine-tuning techniques still rely on precise annotations. To overcome this limitation, we propose WSPoly-SAM, a novel weakly-supervised approach for colonoscopy polyp segmentation. WSPoly-SAM utilizes weak annotations to guide SAM in generating segmentation masks, which are then treated as pseudo-labels to guide the fine-tuning of SAM, thereby reducing the dependence on precise annotations data. To improve the reliability and accuracy of pseudo-labels, we have designed a series of enhancement strategies to improve the quality of pseudo-labels and mitigate the negative impact of low-quality pseudo-labels. Experimental results on five medical image datasets demonstrate that WSPoly-SAM outperforms current fully-supervised mainstream polyp segmentation networks on the Kvasir-SEG, ColonDB, CVC-300, and ETIS datasets. Furthermore, by using different amounts of training data in weakly-supervised and fully-supervised experiments, it is found that weakly-supervised fine-tuning can save 70% to 73% of annotation time costs compared to fully-supervised fine-tuning. This study provides a new perspective on the combination of weakly-supervised learning and SAM models, significantly reducing annotation time and offering insights for further development in the field of colonoscopy polyp segmentation.

Understanding and preventing the “great obstetrical syndromes” has been the focus of pregnancy research for decades. The combined global impact from these syndromes on maternal and perinatal morbidity and mortality is compounded by increased long-term risk of adverse health effects following pregnancy. Accumulating evidence indicates that conditions such as pre-eclampsia, fetal growth restriction, spontaneous preterm labour, and stillbirth, are syndromes with etiologic heterogeneity that share common pathophysiologic pathways involving placental dysfunction. Recently, the importance of the interaction between fetal and maternal genomes has been extended to include the epigenetic impact of pre-existing maternal pathophysiology on placental development and highlights the importance of nutritional and environmental factors in altered placentation. Validated first-trimester screening algorithms for preeclampsia can identify high-risk women and prophylactic treatment with low-dose aspirin can be initiated. High-risk women can be monitored during the second trimester using clinical assessment, ultrasound, and biochemical markers, that are able to predict complications prior to the development of clinical signs and symptoms. The integration of lifestyle interventions, pregnancy screening, and medical management represents a conceptual advance in pregnancy care. This approach has the potential to significantly reduce pregnancy complications, maternal and perinatal morbidity and mortality, adverse health outcomes later in life, and health-care costs.

Emotion detection holds significant importance in facilitating human-computer interaction, enhancing the depth of engagement. By integrating this capability, we pave the way for forthcoming AI technologies to possess a blend of cognitive and emotional understanding, bridging the divide between machine functionality and human emotional complexity. This progress has the potential to reshape how machines perceive and respond to human emotions, ushering in an era of empathetic and intuitive artificial systems. This paper introduces a novel approach to multimodal emotion recognition, seamlessly integrating speech and text modalities to accurately infer emotional states. Employing CNNs, we meticulously analyze speech using Mel spectrograms, while a BERT-based model processes the textual component, leveraging its bidirectional layers for profound semantic comprehension. The outputs from both modalities are combined using an attention-based fusion mechanism that optimally weighs their contributions. The proposed method undergoes meticulous testing on two distinct datasets: Carnegie Mellon University’s Multimodal Opinion Sentiment and Emotion Intensity (CMU-MOSEI) dataset and the Multimodal Emotion Lines Dataset (MELD). The results demonstrate superior efficacy compared to existing frameworks, achieving an accuracy of 88.4% and an F1-score of 87.9% on the CMU-MOSEI dataset, and a notable weighted accuracy (WA) of 67.81% and a weighted F1 (WF1) score of 66.32% on the MELD dataset. This comprehensive system offers precise emotion detection and introduces several significant advancements in the field.

The study combines two critical aspects of climate research in Nigeria. The first segment focuses on improving predictive performance of global circulation models (GCMs) employing ensemble techniques. ANN ensemble displayed significant improvement in the accuracy of climate projections, particularly in high-altitude geographic areas where traditional models exhibit limitations. Performance evaluation metrics such as Mean Absolute Error (MAE), Root Mean Squared Error (RMSE), and Nash–Sutcliffe Efficiency (NSE) demonstrate the effectiveness of the ANN multimodal ensemble. Building on the improved climate modelling, the second segment delves into a spatial and temporal analysis of rainfall and mean temperature patterns under climate change in Nigeria. By considering two Representative Concentration Pathways (RCPs), namely RCP4.5 and RCP8.5, the study utilizes dynamically downscaled GCMs obtained from the Coupled Model Intercomparison Project phase 5 (CMIP5). The Mann-Kendall test reveals significant spatiotemporal variations in climate trends across the country. The warming trend is particularly pronounced in the northern regions, with RCP8.5 showing more severe impacts compared to RCP4.5. This integrated approach not only highlights the importance of multimodal ensembles in climate modelling but also provides valuable insights into the spatial and temporal patterns of climate change to inform effective adaptation and mitigation strategies for Nigeria.

We performed a comprehensive analysis of angiosarcoma (AS) genomic biomarkers and their associations with the site of origin. We aimed to describe the genomic landscape of AS in a cohort of 143 cases of AS profiled by Caris Life Sciences. Data of Next Generation Sequencing (NGS) with a 592 gene panel was available for the entire cohort. Fifty-three cases had data of Whole Exome Sequencing (WES) which we used to study the microenvironment phenotype. Immuno-therapy (IO) response biomarkers: Tumor Mutation Burden (TMB), Microsatellite Instability (MSI) and PD-L1 status were included. IO-response markers were present in 36.4% of the cohort and in 65% of head and neck AS (H/N-AS) (p<0.0001). H/N-AS cases had predominantly muta-tions in TP53 (50.0%, p=0.0004), POT1 (40.5%, p<0.0001) and ARID1A (33.3%, p=0.5875). In breast AS, leading alterations were MYC amplification (63.3%, p<0.0001), HRAS (16.1%, p=0.0377), and PI3KCA (16.1%, p=0.2352). A microenvironment with a high immune signature, associated with better response to IO, was present in 13% of the cases. This signature was evenly distributed among different primary sites. We found that the molecular biology for AS varies significantly according to the primary site. Our findings can facilitate the design and optimiza-tion of therapeutic strategies for AS to overcome resistance to IO and targeted therapies.

This study aims to enhance multimodal transportation systems by mitigating CO2 emissions and enhancing operational efficiency. It introduces a novel centralized cargo concentration approach tailored for regions facing geographical challenges. The method proposes for direct transportation of cargo from its loading origin to export ports, bypassing intermediate hubs. The mathematical model determines the most efficient means of transport for each route, factoring in variables like distance, volume, and cargo type. Research results indicate that, in scenarios with a high concentration of cargo, multiple hubs may not be necessary, which could streamline transportation and logistics operations. Modal preferences vary based on regional dynamics and cargo characteristics, with rail and sea transport emerging as preferable options under specific circumstances, surpassing the efficacy of road transport. The proposed model showcases reductions in both logistics costs and CO2 emissions compared to road-centric scenarios. It underscores the strategic integration of diverse transportation modes as pivotal for enhancing efficiency and sustainability. This study furnishes a framework adaptable to optimizing multimodal transportation systems in regions sharing similar geographical and logistical attributes.

The rapidly evolving domain of multimodal sentiment analysis is crucial for unraveling the intricate layers of emotional expression in social media content, customer service interactions, and personal vlogs. This research introduces a cutting-edge Advanced Cross-Modal Gating (ACMG) framework that significantly enhances the precision of sentiment analysis by refining the interplay among textual, auditory, and visual modalities. Our approach addresses three foundational aspects of sentiment analysis: (1) Advanced learning of cross-modal interactions, which focuses on extracting and synthesizing sentiment from varied modal inputs, thus providing a holistic view of expressed emotions; (2) Mastery over the temporal dynamics of multimodal data, enabling the model to maintain context and sentiment continuity over extended interactions; and (3) Deployment of a novel fusion strategy that not only integrates unimodal and cross-modal cues but also dynamically adjusts the influence of each modality based on its contextual relevance to the sentiment being expressed. The exploration of these dimensions reveals that the nuanced modeling of cross-modal interactions is crucial for enhancing model responsiveness and accuracy. By applying the ACMG model to two highly regarded datasets—CMU Multimodal Opinion Level Sentiment Intensity (CMU-MOSI) and CMU Multimodal Opinion Sentiment and Emotion Intensity (CMU-MOSEI)—we achieve groundbreaking accuracies of 83.9\% and 81.1\%, respectively. These results represent significant improvements of 1.6\% and 1.34\% over the current state-of-the-art, showcasing the superior performance and potential of our approach in navigating the complexities of multimodal sentiment analysis.

In cardiac surgery, post-sternotomy pain is a significant issue, peaking within 48 hours and requiring proper analgesia for both acute relief and to avoid chronicization. Opioids are commonly used for pain management post-surgery but pose risks like adverse effects and dependency. Post-cardiac surgery pain can stem from various sources - somatic, visceral, and neuropathic, making opioid reliance a concern. Multimodal analgesia, combining different medications and regional anesthesia techniques, is increasingly recommended to decrease opioid use and its related problems. Strategies include acetaminophen, gabapentinoids, NMDA antagonists, alpha-2 agonists, intravenous lidocaine, anti-inflammatory drugs, and regional anesthesia. Implementing these approaches can enhance pain control, lessen opioid reliance, and improve cardiac surgery outcomes. The ERAS® Cardiac Society strongly advocates for an opioid-sparing multimodal approach to benefit patient recovery by reducing complications and enhancing satisfaction. This review aims to consolidate current evidence to assist healthcare providers in customizing pain management for patients post-cardiac surgery, emphasizing reduced opioid use and optimizing the recovery process.

Syringomyelia can be associated with multiple etiologies. The treatment of the underlying causes is the first-line therapy, however, a direct approach to the syrinx is accepted as rescue treatment. Any direct intervention on the syrinx requires a myelotomy, posing a significant risk of iatrogenic spinal cord (SC) injury. Intraoperative neurophysiological monitoring (IONM) is crucial to detect and prevent surgically induced damage in neural SC pathways. We retrospectively reviewed the perioperative and intraoperative neurophysiological data and perioperative neurological examinations in ten cases of syringomyelia surgery. All monitored modalities remained stable throughout the surgery in six cases, correlating with no new postoperative neurological deficits. In two patients, significant transitory attenuation, or loss of motor evoked potentials (MEPs), were observed and recovered after a corrective surgical maneuver, with no new postoperative deficit. In two cases, a significant MEP decrement was noted, which lasted until the end of the surgery and was associated with postoperative weakness. A transitory train of neurotonic electromyography (EMG) discharges was reported in one case, the surgical plan was adjusted and the patient showed no postoperative deficit. The dorsal nerve roots were stimulated and identified in the seven cases where the myelotomy was performed via the dorsal root entry zone. Dorsal column mapping guided the myelotomy entry zone in four cases. In conclusion, multimodal IONM is feasible and reliable and may help prevent iatrogenic SC injury during syringomyelia surgery.

Document classification is one of the most critical steps in the document analysis pipeline. There are two types of approaches for document classification, known as image-based and multimodal approaches. The image-based document classification approaches are solely based on the inherent visual cues of the document images. In contrast, the multimodal approach co-learns the visual and textual features, and it has proved to be more effective. Nonetheless, these approaches require a huge amount of data. This paper presents a novel approach for document classification that works with a small amount of data and outperforms other approaches. The proposed approach incorporates a hierarchical attention network(HAN) for the textual stream and the EfficientNet-B0 for the image stream. The hierarchical attention network in the textual stream uses the dynamic word embedding through fine-tuned BERT. HAN incorporates both the word level and sentence level features. While the earlier approaches rely on training on a large corpus (RVL-CDIP), we show that our approach works with a small amount of data (Tobacco-3482). To this end, we trained the neural network at Tobacco-3428 from scratch. Thereby, we outperform state-of-the-art by obtaining an accuracy of 90.3%. This results in a relative error reduction rate of 7.9%.

This paper is an interdisciplinary study of novel applications of techniques and tools of an area of brain science, known as Synesthesia (involving associations and/or confusion between distinct senses), to area of Computer Science known as Immersive Virtual Reality (VR), that makes the subject’s awareness of physical self be diminished by being surrounded in an engrossing artificial environment. Natural Synesthesia has for the last decade been an important emerging area in brain science but is present in only a small proportion of the population. For example a person with Natural Synesthesia, when viewing a grapheme, may perceive a color additionally to be associated to the grapheme. In contrast, Artificial synesthesia (also known as virtual synesthesia or synthetic synesthesia) has been defined as the sensory joining due a cross-modal mapping device, where information of one sense is accompanied by an induced perception in another sense. In particular, we propose use of a multimodal manner of displaying information in VR to increase and concentrate attention. Artificial Synesthesia to synthetically create induced associations between senses, allowing Artificial Synesthesia to be experienced by anyone using a VR system. The paper describes the enhancement of immersive VR by use of Artificial Synesthesia to improve the system’s performance at steering and directing the attention of the user. We describe techniques for an enhanced immersive VR that displays associations between a variety of senses: between colors and characters, also between colors and sounds, and between sounds and the position of tactile sensations. The sense association provided by Artificial Synesthesia allows the system to better capture the user’s attention and better direct that attention. A major application of our work in VR-induced Artificial Synesthesia is to provide an enhanced methodology for controlling the attention of the subject, and to improve the direction of attention of subjects undergoing guided imagery therapies for pain relief. Other potential high-impact applications include improved immersive VR, more programmable human/computer interfaces and other medical therapies.

Pulmonary fibrosis is a chronic, progressive, and irreversible lung disease characterized by fibrotic scarring in the lung parenchyma. This condition involves the excessive accumulation of extracellular matrix (EM) due to a persistently activated wound-repair response. The aberrant activation of myofibroblasts in the alveolar environment by Transforming Growth Factor beta (TGF-β) and other signaling molecules is considered a key event in the development and progression of fibrosis. A primary target of TGF-β signaling in fibrosis is Collagen Triple Helix Repeat Containing 1 (CTHRC1), a secreted glycoprotein that plays a pivotal role in extracellular matrix deposition. CTHRC1 is transcriptionally regulated by TGF-β and inhibits both TGF-β and canonical Wnt signaling pathways. This dual function suggests that CTHRC1 is vital in regulating tissue remodeling during wound repair. In this review, we will highlight recent studies suggesting that CTHRC1 can serve as a diagnostic and prognostic biomarker for fibrosis in idiopathic pulmonary fibrosis, rheumatoid arthritis-interstitial lung disease, systemic sclerosis, and post-COVID lung fibrosis. Notably, the expression of CTHRC1 is responsive to antifibrotic drugs such as pirfenidone indicating its potential as a therapeutic target. Collectively, these findings suggest that CTHRC1 may present new opportunities for the diagnosis, stratification, and treatment of patients with lung fibrosis.

This study was performed to synthesize multimodal radiopharmaceutical designed for the diagnosis and treatment of prostate cancer. To achieve this goal, Super Paramagnetic Iron Oxide (SPIO) nanoparticles were used as a platform for targeting molecule (PSMA-617) and for complexation of two scandium radionuclides, 44Sc for PET imaging and 47Sc for radionuclide therapy. TEM and XPS images showed that the Fe3O4 NPs have a uniform cubic shape and a diameter from 38 to 50 nm. The Fe3O4 core are surrounded by SiO2 and an organic layer. The saturation magnetization of the SPION core was 60 emu/g. However, coating the SPIONs with silica and polyglycerol reduces the magnetization significantly. The obtained bioconjugates were labeled with 44Sc and 47Sc, with a yield higher than 97%. The radiobioconjugate exhibited high affinity and cytotoxicity towards the human prostate cancer LNCaP (PSMA+) cell line, much higher than for PC-3 (PSMA-) cells. High cytotoxicity of the radiobioconjugate was confirmed by radiotoxicity studies on LNCaP 3D-spheroids. In addition, the magnetic properties of the radiobioconjugate should allow for its use in guide drug delivery driven by magnetic field gradient.

Oral cancer represents a significant global public health challenge, contributing substantially to cancer incidence and mortality. Despite established risk factors such as tobacco use and alcohol consumption, early detection remains crucial for effective treatment. This study introduces a novel approach using a transistor-based biosensor system for detecting the P90 (CIP2A) protein. We have tested the presence of CIP2A in human leukoplakia samples that can rise into oral squamous cell carcinoma. The method employs commercially available glucose test strips functionalized with P90 antibodies, providing high sensitivity and a low limit of detection, which is five orders lower than commercial ELISA kits. A specially designed printed circuit board (PCB) facilitates accurate measurements, and the device's performance is optimized through characteristic tests. Human sample testing validates the biosensor's effectiveness in distinguishing samples after cell lysis. This study contributes to advancing accurate and cost-effective diagnostic approaches for oral pre-cancer and cancer tissues.

Mass spectrometry (MS) has revolutionized clinical chemistry, offering unparalleled capabilities for biomolecule analysis. This review explores the growing significance of MS, particularly when coupled with liquid chromatography (LC-MS), in identifying disease biomarkers and quantifying biomolecules for diagnostic and prognostic purposes. The unique advantages of MS in accurately identifying and quantifying diverse molecules have positioned it as a cornerstone in personalized medicine advancement. MS-based technologies have transformed precision medicine, enabling comprehensive understanding of disease mechanisms and patient-specific treatment responses. LC-MS has shown exceptional utility in analyzing complex biological matrices, while high-resolution MS has expanded analytical capabilities, allowing detection of low-abundance molecules and elucidation of complex biological pathways. The integration of MS with other techniques, such as ion mobility spectrometry, has opened new avenues for biomarker discovery and validation. As we progress towards precision medicine, MS-based technologies will be crucial in addressing the challenges of individualized patient care, driving innovations in disease diagnosis, prognosis, and treatment strategies.

Assessment of drugs toxicity and associated biomarker genes is one of the most important tasks in the pre-clinical phase of drug development pipeline as well as in the toxicogenomic studies. There are few statistical methods for the assessment of doses of drugs (DDs) toxicity and their associated biomarker genes. However, these methods consume more time for computation of the model parameters using the EM (Expectation-Maximization) based iterative approaches. To overcome this problem, in this paper, an attempt is made to propose an alternative approach based on hierarchical clustering (HC) for the same purpose. There are several types of HC approaches whose performance depends on different similarity/distance measures. Therefore, we explored suitable combinations of distance measures and HC methods based on Japanese Toxicogenomics Project (TGP) datasets for better clustering/co-clustering between DDs and genes as well as to detect toxic DDs and their associated biomarker genes. We observed that Word’s HC method with each of Euclidean, Manhattan and Minkowski distance measures produces better clustering/co-clustering results. For an example, in case of glutathione metabolism pathway (GMP) dataset LOC100359539/Rrm2, Gpx6, RGD1562107, Gstm4, Gstm3, G6pd, Gsta5, Gclc, Mgst2, Gsr, Gpx2, Gclm, Gstp1, LOC100912604/Srm, Gstm4, Odc1, Gsr, Gss are the biomarker genes and Acetaminophen_Middle, Acetaminophen_High, Methapyrilene_High, Nitrofurazone_High, Nitrofurazone_Middle, Isoniazid_Middle, Isoniazid_High are their regulatory (associated) DDs explored by our proposed co-clustering algorithm based on the distance and HC method combination Euclidean: Word. Similarly, for the PPAR signaling pathway (PPAR-SP) dataset Cpt1a, Cyp8b1, Cyp4a3, Ehhadh, Plin5, Plin2, Fabp3, Me1, Fabp5, LOC100910385, Cpt2, Acaa1a, Cyp4a1, LOC100365047, Cpt1a, LOC100365047, Angptl4, Aqp7, Cpt1c, Cpt1b, Me1 are the biomarker genes and Aspirin_Low, Aspirin_Middle, Aspirin_High, Benzbromarone_Middle, Benzbromarone_High, Clofibrate_Middle, Clofibrate_High, WY14643_Low, WY14643_High, WY14643_Middle, Gemfibrozil_Middle, Gemfibrozil_High are their regulatory DDs. These results are validated by the available literature and functional annotation.

In this work, we introduce the TriFusion Network, an innovative deep learning framework designed for the simultaneous analysis of auditory, visual, and textual data to accurately assess emotional states. The architecture of the TriFusion Network is uniquely structured, featuring both independent processing pathways for each modality and integrated layers that harness the combined strengths of these modalities to enhance emotion recognition capabilities. Our approach addresses the complexities inherent in multimodal data integration, with a focus on optimizing the interplay between modality-specific features and their joint representation. Extensive experimental evaluations on the challenging AVEC Sentiment Analysis in the Wild dataset highlight the TriFusion Network's robust performance. It significantly outperforms traditional models that rely on simple feature-level concatenation or complex score-level fusion techniques. Notably, the TriFusion Network achieves Concordance Correlation Coefficients (CCC) of 0.606, 0.534, and 0.170 for the arousal, valence, and liking dimensions respectively, demonstrating substantial improvements over existing methods. These results not only confirm the effectiveness of the TriFusion Network in capturing and interpreting complex emotional cues but also underscore its potential as a versatile tool in real-world applications where accurate emotion recognition is critical.

Along with the popularity of the Internet, people are exposed to more and more ways of micro-videos, and a huge amount of micro-video data has emerged. micro-videos have gradually become the Internet content preferred by the public, and a large number of micro-video apps have also emerged, such as Tiktok and Kwai. Intelligent classification and mining of micro-videos can greatly enhance user experience, improve business operation efficiency and enhance user experience. Through deep intelligent analysis and mining of micro-videos, important information in micro-videos can be extracted to provide an important basis for beautifying videos, content appreciation, video recommendation, content search, etc. In the past, content understanding for short videos often used human work annotation, but in recent years, with the great success of deep convolutional neural networks in image recognition, short video content understanding based on this method has gradually developed. Nowadays, most recognition algorithms extract the feature representation of each frame independently and then fuse them. However, while extracting the feature representation, some low-level semantic features are lost, which makes the algorithm unable to accurately distinguish the category of the video. At present, the algorithm of micro-video recognition based on deep learning has surpassed the iDT algorithm, making these traditional methods fade out of people’s view. In this paper according to the micro-video classification task, a new network model is proposed to concatenate features of each modality into the overall features of various modalities through the network, and then fuse the various modal features with the attention mechanism to obtain the whole micro-video features, which will be used for classification. In order to verify the effectiveness of the algorithm proposed in this paper, experiments are conducted in the public dataset, and it is shown the effectiveness of our model.

With the advent of modern technologies, the healthcare industry is moving towards a more Personalised smart care model. The enablers of such care models are the Internet of Things (IoT) and Artificial Intelligence. These technologies collect and analyse data from persons in care to alert relevant parties if any anomaly is detected in a patient’s regular pattern. However, such reliance on IoT devices to capture continuous data extends the attack surfaces and demands high-security measures. Both patients and devices need to be authenticated to mitigate a large number of attack vectors. The biometric authentication method has been seen as a promising technique in these scenarios. To this end, this paper proposes an AI-based multimodal biometric authentication model for single and group-based users’ device-level authentication that increases protection against the traditional single modal approach. To test the efficacy of the proposed model, a series of AI models are trained and tested using physiological biometric features such as ECG (Electrocardiogram) and PPG (Photoplethysmography) signals from five publicly available datasets from Physionet and Mendeley data repositories. The multimodal fusion authentication model shows promising results with 99.8% accuracy and an Equal Error Rate (EER) of 0.16.

Circulating tumor DNA (ctDNA) in fluids has gained attention because ctDNA seems to identify tumor-specific abnormalities, which could be used for diagnosis, follow-up of treatment, and prognosis: the so-called liquid biopsy. Liquid biopsy is a minimally invasive approach and presents the sum of ctDNA from primary and secondary tumor sites. It has been possible not only to quantify the amount of ctDNA but also to identify (epi)genetic changes. Specific mutations in genes have been identified in the plasma of patients with several types of cancer, which highlights ctDNA as a possible cancer biomarker. However, achieving detectable concentrations of ctDNA in body fluids is not an easy task. ctDNA fragments present a short half-life, and there are no cut-off values to discriminate high and low ctDNA concentrations. Here, we discuss the use of ctDNA as a cancer biomarker, the main methodologies, the inherent difficulties, and the clinical predictive value of ctDNA.

Metabolomic analysis of biological fluids and tissues has become an increasingly routine tool in the biological toolbox. However, challenges remain to be overcome, including developing strategies to maximise coverage of the metabolome without requiring large sample volumes. Here we describe a multimodal strategy that combines data using both LC-MS and GC-MS from a unique vial with a sample of plasma (20µl) or a sample of brain tissue (3mg). Using a split phase extraction the non-aqueous phase was analyzed by reversed phase (RP) LC-MS, whilst the aqueous phase was analyzed using hydrophilic liquid interaction chromatography (HILIC)LC-MS, with both phases also analysed using GC-MS after derivatization of the extract. Analytical performance was assessed in 7 rat cerebellum samples and a pilot study of 40 plasma samples (20 vs. 20: AD vs. healthy controls). The method, which uses four hours of instrument time, measured 20,707 metabolite features in brain samples and 17,266 in plasma samples, from those 44.1% features displayed CV’s below 15% and 75.2% below 30%. The method has potential to resolve subtle biological differences and to correlate metabolite composition directly to clinical outcomes including MMSE, age and ADCS-ADL. This method can acquire in the order of 20K metabolic features when low volumes are available.

Gold nanoclusters (AuNCs) with fluorescence in the Near Infrared (NIR) by both one- and two-photon electronic excitation were incorporated in mesoporous silica nanoparticles (MSNs) using a novel one-pot synthesis procedure where the condensation polymerization of alkoxysilane monomers in the presence of the AuNCs and a surfactant produce hybrid MSNs of 49 nm diameter. This method was further developed to prepare 30 nm diameter nanocomposite particles with simultaneous NIR fluorescence and superparamagnetic properties, with a core composed of superparamagnetic manganese ferrite nanoparticles (MnFe2O4) coated with a thin silica layer, and a shell of mesoporous silica decorated with AuNCs. The nanocomposite particles feature NIR-photoluminescence with 0.6% quantum yield and large Stokes shift (290 nm), and superparamagnetic response at 300 K, with a saturation magnetization of 13.4 emu g-1. The conjugation of NIR photoluminescence and superparamagnetic properties in the biocompatible nanocomposite has high potential for application in multimodal bioimaging.

Acute low back pain (LBP) stands as a leading cause of activity limitation and work absenteeism, and its associated healthcare expenditures are expected to become substantial when acute LBP develops into a chronic and even refractory condition. Therefore, early intervention is crucial to prevent progression to chronic pain whose management is particularly challenging and for which the most effective pharmacological therapy is still controversial. Current guideline treatment recommendations vary and are mostly driven by expertise with opinion differing across different interventions. Thus, it is difficult to formulate evidence-based guidance when relatively few randomized clinical trials did explore the diagnosis and management of LBP while employing different selection criteria, statistical analyses, and outcome measurements. This narrative review aims to provide a critical appraisal of current acute LBP management by discussing the unmet needs and areas of improvement from bench-to-bedside and proposes multimodal analgesia as the way forward to attain an effective and prolonged pain relief and functional recovery in patients with acute LBP.

Epigenetics, the study of heritable changes in gene expression that do not involve alterations to the DNA sequence, is revolutionizing our understanding of psychiatric disorders. This article provides a comprehensive overview of the role of epigenetics in psychiatry, discussing its implications for genomics, evolution, inheritance patterns, and the development of biomarkers. Epigenetic mechanisms, including DNA methylation, histone modifications, and non-coding RNAs, are explored in the context of psychiatric conditions such as depression, schizophrenia, and post-traumatic stress disorder (PTSD). The discussion highlights how epigenetic modifications can influence brain dynamics, as measured by electroencephalography (EEG), and how artificial intelligence (AI) can accelerate the development of treatment options. The potential for epigenetic biomarkers to improve diagnosis, prognosis, and treatment is emphasized, along with the role of behavioral interventions in inducing beneficial epigenetic modifications. Future directions in epigenetic research, including the development of epigenetic therapies and the elucidation of molecular mechanisms underlying epigenetic inheritance, are also discussed. This article underscores the transformative potential of epigenetics in advancing our understanding of mental health and disease, paving the way for novel therapeutic interventions.

The microbiome is pivotal in maintaining health and influencing disease by modulating essential inflammatory and immune responses. Hepatocellular carcinoma (HCC), ranking as the third most common cause of cancer-related fatalities globally, is influenced by the gut microbiome through bidirectional interactions between the gut and liver, as evidenced in both mouse models and human studies. Consequently, biomarkers based on gut microbiota represent promising non-invasive tools for the early detection of HCC. There is a growing body of evidence suggesting that the composition of the gut microbiota may play a role in the efficacy of immunotherapy in different types of cancer, thus it could be used as a predictive biomarker. In this review, we will dissect the gut microbiome's role as a potential predictive and diagnostic marker in HCC and evaluate the latest progress in leveraging the gut microbiome as a novel therapeutic avenue for HCC patients, with a special emphasis on immunotherapy.

This study investigates the expression and prognostic value of TRIM6 in gliomas, the most prevalent primary brain and spinal cord tumors. Our results show that TRIM6 is predominantly overexpressed in glioma tissues and is associated with reduced overall survival, disease-specific survival, and progression-free interval. Furthermore, TRIM6 expression is correlated with WHO grade and primary treatment outcomes. Functional analysis indicates that interactions between cytokines and their receptors play a critical role in the prognosis of glioma patients. A protein-protein interaction network reveals 10 hub genes closely linked to cytokine-cytokine receptor interaction. In vitro experiments demonstrate that silencing TRIM6 impairs the proliferation, invasion, and migration of glioma cells, while overexpressing TRIM6 enhances these abilities. Additionally, TRIM6 expression is positively associated with the abundance of innate immune cells and negatively associated with the abundance of adaptive immune cells. In summary, TRIM6 is significantly upregulated in gliomas and linked to poor prognosis, making it a potential diagnostic and prognostic biomarker. TRIM6 plays a crucial role in promoting cell viability, clonogenic potential, migration, and invasion in glioma cells. It may regulate glioma progression by modulating cytokine-cytokine receptor interaction, leading to an inflammatory response and an imbalance in immunomodulation, thereby representing a potential therapeutic target.

We hypothesized possibility that inline registered reticulorumen pH can be as biomarker of cows reproduction and health status. Aim of this study was to evaluate the relationship of reticulorumen pH with biomarkers from automatic milking system (AMS) and some blood parameters and determinate reticulorumen pH as biomarker of cows reproduction and health status. According to cows reproductive status the cows were classified as belonging to the following four groups: 15-30 d. postpartum; 1-34 d. after insemination; 35 d. after insemination (non-pregnant); 35 d. after insemination (pregnant). According reticulorumen pH assay experimental animals were divided into four classes: 1) pH<6.22 (5.3% of cows), 2) pH - 6.22-6.42 (42.1% of cows), 3) pH - 6.42-6.62 (21.1% of cows), 4) pH >6.62 (10.5% of cows). Rumination time, body weight, milk yield, milk fat – protein ratio, milk lactose, milk somatic cell count (SCC), milk electrical conductivity of all quarters of udder were registered with the help of Lely Astronaut® A3 milking robots. The pH, temperature of the contents of cow reticulorumens and cow activity were measured using specific smaX-tec boluses. Blood gas parameters were analyzed using a blood gas analyzer (EPOC, Canada). We found that pregnant cows has higher reticulorumen pH during insemination time, comparing with non-pregnant. Cows with lower reticulorumen pH has lowest milk fat – protein ratio, and lactose concentration, and highest SCC. Cows with lowest reticulorumen pH has lowest blood pH. With increase reticulorumen pH, increases blood potasium and hematocrit, decreases CO2, saturation and sodium.

Myeloperoxidase (MPO) belong to the family of heme containing peroxidases, produced mostly from polymorphonuclear neutrophils. The active enzyme (150 kD) is the product of MPO gene located on long arm of chromosome 17. The primary gene product undergoes several modifications like removal of introns and signal peptide and leads to the formation of enzymatically inactive glycosylated apoproMPO which complexes with chaperons, producing active proMPO by the insertion of heme moiety. The active enzyme is a homodimer of heavy and light chain protomers. This enzyme is released into extracellular fluid after oxidative stress and different inflammatory responses. MPO is the only type of peroxidase using H2O2 to oxidize several halides and pseudohalides to form different hypohalous acids. So the antibacterial activities of MPO involve the production of reactive oxygen and reactive nitrogen species. Controlled MPO release at the site of infection is of prime importance for its efficient activities. Any uncontrolled degranulation exaggerates the inflammation that can also lead to tissue damage even in absence of inflammation. Several types of tissue injuries and pathogenesis of several other major chronic diseases like rheumatoid arthritis, cardiovascular diseases, liver diseases, diabetes and cancer have been reported to be linked with myeloperoxidase derived oxidants. So the enhanced level of MPO activity is one of the best diagnostic tool of inflammatory and oxidative stress biomarkers among these commonly occurring diseases.

Ovarian torsion (OT) is a rare gynaecological emergency that requires a prompt diagnosis for optimal patient management. To determine whether there were any biomarkers suitable for the non-invasive detection of OT, two independent reviewers performed systematic searches of five literature databases following Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) guidelines. Full-texts of 24 selected articles were assessed for risk of bias and quality assurance using a modified Newcastle-Ottawa Scale (NOS).  15 articles described studies on animals and all described serum biomarkers comparing results between OT versus a sham operation, a control group or readings before and after OT. Ischaemia modified albumin (IMA), serum D-dimer (s-DD), heat shock protein-70 (hsp-70), Pentraxin-3 (PTX-3) and c-reactive protein (CRP) showed the most promise, each with p-values for the difference between groups achieving ≤0.001. In studies of humans, the biomarkers ranged from 16.4-92.3% sensitivity and 77-100% specificity. The most promising biomarkers for the early prediction of OT in patients included s-DD, interleukin-6 (IL-6), IMA and tumour necrosis factor-alpha (TNF-. IL-6 had the highest sensitivity of any biomarker identified in this review and was raised in all 13 patients with proven OT, with values of ≥10.2pg/ml, indicative of a 16 times higher risk of having OT. Signal peptide, CUB domain and EGF like domain containing 1 (SCUBE1) had a high specificity at 93.3%, second only to s-DD and a positive likelihood ratio (LR)&gt;10. IMA was the only other biomarker that also had a positive LR&gt;10, making it a promising diagnostic biomarker. The studies identified by this systematic literature review each analysed small patient groups but IMA, DD and SCUBE1 nevertheless showed promise as serum biomarkers with a pooled LR&gt;10. However, further well-designed studies are needed to identify and evaluate individual markers, or diagnostic panels to help clinicians manage this important, organ-threatening condition.

As the use of AI in medical imaging has increased, so has the need to explain a model’s results. Segmentation models are one technique used to produce explainable results. Due to larger size and sophistication, segmentation models which operate on 2D data can often produce better results than models operating on 3D data. In the real world, imaging is combined with clinical factors for diagnosis. To replicate this, multimodal models are used which combine image and text modalities. I propose a multimodal arrangement that converts 3D scans to 2D and uses a 2D segmentation model (DeepLabV3) to analyze the images. This is combined with clinical biomarkers to achieve a complete confidence score. Using the Medical Segmentation Decathlon Lung (MSDL) dataset and the LUng CAncer Screening dataset (LUCAS), I achieved a testing Dice coefficient of 0.91 on segmentation with a receiver operating characteristic (ROC), average precision (AP), and F-Score of 0.89, 0.91, and 0.85 respectively on the final multimodal results. This approach raises the F-score from the previously achieved value of 0.508 to 0.85, creating a new baseline of what is achievable with multimodal lung cancer diagnostics and possible methods to achieve these accuracies.

(1) Background: With the global population aging, the demand for effective rehabilitation products for the elderly is increasing. Traditional products often fail to meet the comprehensive needs of elderly users, who require solutions addressing physical, psychological, and social aspects; (2) Methods: Using the Analytic Hierarchy Process, Quality Function Deployment, Axiomatic Design, and the System Usability Scale to identify and prioritize user needs, market research and user interviews were conducted to understand the preferences of the elderly and obtain design specifications. The focus was on multimodal sensory feedback, which was validated through the study; (3) Results: Elderly users have a strong preference for rehabilitation products that are durable, easy to use and have comprehensive sensory feedback. Intelligent rehabilitation bed as the carrier, strengthened structure, high strength material, ergonomic adjustment, integrated health monitoring system. Using digital technology for real-time health monitoring and personalized feedback to provide a comprehensive recovery experience, high user satisfaction was reported in the evaluation; (4) Conclusion: It is important to emphasize user-centered design and integrate multi-modal sensory feedback to meet the comprehensive rehabilitation needs of elderly users. Future studies should expand user samples and expert opinions to refine and validate the design and improve its effectiveness and usability.

The incessant evolution of online platforms has ushered in a multitude of shopping modalities. Within the food industry, however, assessing the delectability of meals can only be tentatively determined based on consumer feedback encompassing aspects such as taste, pricing, packaging, service quality, delivery timeliness, hygiene standards, and environmental considerations. Traditional text data mining techniques primarily focus on consumers' emotional traits, disregarding pertinent information pertaining to the online products themselves. In light of these aforementioned issues in current research methodologies, this paper introduces the Bert BiGRU Softmax model combined with multimodal features to enhance the efficacy of sentiment classification in data analysis. Comparative experiments conducted using existing data demonstrate that the accuracy rate of the model employed in this study reaches 90.9%. In comparison to single models or combinations of three models with the highest accuracy rate of 7.7%, the proposed model exhibits superior accuracy and proves highly applicable to online reviews.

Previous studies to recognize negative emotions (e.g. disgust, fear, sadness) for mental health care have used heavy equipment directly attaching electroencephalogram (EEG) electrodes to the head, making it difficult to use in daily life, and they have proposed binary classification methods to determine whether negative emotion or not. To tackle this problem, we propose a negative emotion recognition system to collect multimodal biosignal data such as five EEG signals in an EEG headset and heart rate, galvanic skin response, and skin temperature in a smart band for classifying multiple negative emotions. It consists of android Internet of Things (IoT) application, an oneM2M-compliant IoT server, and a machine learning server. The android IoT application upload the biosignal data to the IoT server. By using the biosignal data stored in the IoT server, the machine learning server recognizes the negative emotions of disgust, fear, and sadness using a multi-class support vector machine (SVM) model with a radial basis function kernel (RBF). The experimental results showed that the multi-class SVM model achieved 93% accuracy when considering all the multimodal biosignal data. Moreover, when considering only data in the smart band, it could achieve 98% accuracy by optimizing the hyper-parameter of the RBF kernel.

This paper proposes a multimodal fusion 3D target detection algorithm based on the attention mechanism to improve the performance of 3D target detection. The algorithm utilizes point cloud data and information from camera. For image feature extraction, the ResNet50+FPN architecture extracts features at four levels. Point cloud feature extraction employs the voxel method and FCN to extract point and voxel features. The fusion of image and point cloud features is achieved through regional point fusion and regional voxel fusion methods. After information fusion, the Coordinate attention mechanism and SimAM attention mechanism extract fusion features at a deep level. The algorithm's performance is evaluated using the DAIR-V2X dataset. The results show that compared to the Part-A2 algorithm, the proposed algorithm improves the mAP value by 7.9% in BEV view and 7.8% in 3D view at IOU=0.5 (cars) and IOU=0.25 (pedestrians and cyclist). At IOU=0.7 (cars) and IOU=0.5 (pedestrians and cyclist), the mAP value of the SECOND algorithm is improved by 5.4% in the BEV view and 4.3% in the 3D view, compared to other comparison algorithms.

Autonomous driving vehicles rely on sensors for the robust perception of surroundings. Such vehicles are equipped with multiple perceptive sensors with a high level of redundancy to ensure safety and reliability in any driving condition. However, multi-sensor, such as camera, LiDAR and radar, systems bring up the requirements related to sensor calibration and synchronization, which are the fundamental blocks of any autonomous system. On the other hand, sensor fusion and integration have become important aspects of autonomous driving research and directly determine the efficiency and accuracy of advanced functions such as object detection and path planning. Classical model-based estimation and data-driven models are two mainstream approaches to achieving such integration. Most recent research is shifting to the latter, showing high robustness in real-world applications but requiring large quantities of data to be collected, synchronized, and properly categorized. To generalize the implementation of the multi-sensor perceptive system, we introduce an end-to-end generic sensor dataset collection framework that includes both hardware deploying solutions and sensor fusion algorithms. The framework prototype integrates a diverse set of sensors, such as cameras, LiDAR, and radar. Furthermore, we present a universal toolbox to calibrate and synchronize three types of sensors based on their characteristics. The framework also includes the fusion algorithms, which utilize the merits of three sensors , namely, camera, LiDAR and radar, and fuse their sensory information in a manner that is helpful for object detection and tracking research. The generality of this framework makes it applicable in any robotic or autonomous applications, also suitable for quick and large-scale practical deployment.

Improved oil recovery from tight carbonate formations may provide the world with a major source of lower-rate power over several decades. Here we provide an overview of the Arab D formation in the largest oil field on earth, the Ghawar. We investigate the occurrence of microporosity of different origins and sizes using scanning electron microscopy (SEM) and pore casting techniques. Then, we present a robust calculation of the probability of invasion and oil saturation distribution in the nested micropores using mercury injection capillary pressure data available in the literature. We show that large portions of the micropores in Arab D formation would have been bypassed during primary drainage unless the invading crude oil ganglia were sufficiently long. Considering the asphaltenic nature of oil in the Ghawar, we expect the invaded portions of the pores to turn mixed-wet, thus becoming inaccessible to waterflooding until further measures are taken to modify the system’s chemistry.

Many engineered approaches have been proposed over the years for solving the hard problem of performing indoor localisation using smartphone sensors. However, specialising these solutions for difficult edge cases remains challenging. Here we propose an end-to-end hybrid multimodal deep neural network localisation system, MM-Loc, relying on zero hand-engineered features, learning them automatically from data instead. This is achieved by using modality-specific neural networks to extract preliminary features from each sensing modality, which are then combined by cross-modality neural structures. We show that our choice of modality-specific neural architectures is capable of estimating the location with good accuracy independently. But for better accuracy, a multimodal neural network fusing the features of early modality-specific representations is a better proposition. Our proposed MM-Loc solution is tested on cross-modality samples characterised by different sampling rates and data representation (inertial sensors, magnetic and WiFi signals), outperforming traditional approaches for location estimation. MM-Loc elegantly trains directly from data unlike conventional indoor positioning systems, which rely on human intuition.

Automatic ice charting can not be achieved using only SAR modalities. It is fundamental to combine information from other remote sensors with different characteristics for more reliable sea ice characterization. In this paper, we employ principal feature analysis (PFA) to select significant information from multimodal remote sensing data. PFA is a simple yet very effective approach that can be applied to several types of data without loss of physical interpretability. Considering that different homogeneous regions require different types of information, we perform the selection patch-wise. Accordingly, by exploiting the spatial information, we increase the robustness and accuracy of PFA.

Multimodal traveling is expected to enhance mobility for users, reduce inequalities of car ownership and reduce emissions. In the same context, ride-sharing aims to minimize negative impacts related to emissions, reduce travelling costs and congestion, and increase passenger vehicle occupancy, and public transit ridership when planned for first/last mile trips. The goal of this study is to present the planning of a multimodal pilot demonstration and the challenges that emerged during and after its implementation in Athens, Greece. The demo aims to enhance the connection of low-density Attica Region areas to public transport (PT) modes, and specifically to the metro, through the provision of demand responsive ride-sharing services. During the demo period two different applications were utilized: the “Travel Companion” app and the “Driver Companion” app, which refer to passengers and drivers of the ride-sharing service. Identification of demo participants is performed through a Stated Preference (SP) experiment. Results of the demo implementation, as well as challenges that were faced show that although participants are willing to try new mobility solutions, the readiness and reliability of the new service are essential attributes towards maintaining existing users and engaging new ones.

Basophils are initiators of the Th2 response related to the progression of canine visceral leishmaniasis (CanL). Miltefosine has been presented as an alternative in treatment due to its leishmanicide and immunomodulatory effects. Many blood cells have been used as predictive biomarkers, but none of them focused on the immunomodulatory action of miltefosine in the different stages of the disease. Identifying the predictive hematological biomarkers in dogs with visceral leishmaniasis treated with miltefosine. The animals were divided into three groups: sick dogs; infected dogs, dogs exposed. The animals were submitted to differential blood cell count and CanL diagnosis, through DPP, ELISA and qPCR. The groups were monitored from the time zero (T0) before treatment, and the times twenty (T20) and thirty (T30) days after the beginning of treatment using miltefosine at a dose of 1mL/10kg per day for 28 days. Basophils showed an exponential increase in the infected and sick group with an increase of IgG, suggesting a Th2 response. In the exposed group there was reduction of basophils with increase in monocytes and IgG reduction, suggesting a Th1 response. We suggest basophils as a predictive biomarker of immunomodulation in the treatment of CanL with miltefosine.

The macular pigment optical density (MPOD) signifies a vital component of macular well-being and high-resolution visual acuity. MPOD can serve as a reliable biomarker for assessing the retinal defense mechanisms against oxidative stress and the deleterious effects of excessive light exposure. Elevated MPOD levels offer robust protection against the onset and progression of age-related macular degeneration (AMD) a prevalent cause of vision impairment among the elderly population. MPOD's implications in diverse ocular conditions, including diabetic retinopathy and glaucoma, have been explored and indicate a real need for clinical measurement of MPOD. This review looks at the potential of MPOD as a modifiable biomarker influencing the progression and onset of these conditions, particularly in the context of oxidative stress and retinal ischemia. The integration of MPOD measurement into routine eye examinations presents an unparalleled opportunity for early disease detection, precise treatment planning, and longitudinal disease monitoring. Emerging technologies and longitudinal investigations promise to elucidate the dynamic nuances of MPOD in the context of age-related ocular diseases.

Blood-based biomarkers for early detection of recurrence have a significant clinical impact on the improved management of breast cancer patients, as cancer recurrence results in poor prognosis. This study aimed to investigate if the measurement of blood endocan in breast cancer patients with high ESM1 expression could be an effective tool to detect postoperative recurrence compared with existing tumor markers. Blood was collected before and after the tumor resection from the mouse models of breast cancer, and endocan levels were measured while visualizing metastatic recurrence with noninvasive luminescence imaging. In clinical settings, blood was withdrawn from 16 breast cancer patients before and after the tumor resection, and the effect of lumpectomy on blood endocan level was evaluated. Additionally, the blood endocan from 20 patients diagnosed with postoperative recurrence was measured, and their positivity rate for endocan was compared with that for serum carcinoembryonic antigen (CEA) or cancer antigen 15-3 (CA15-3). Our preclinical and clinical experiments revealed that blood endocan levels reflected tumor burden. Furthermore, over 60% of patients suffering from postoperative recurrence who tested negative for CEA or CA15-3 were positive for endocan. Our results support the clinical significance of endocan in breast cancer patients for detecting breast cancer recurrence.

Buffalo are silent breeders, therefore detecting estrus is a serious challenge. There is a rising need for sensitive and precise biomarkers in this scenario. Recent research on miRNA has demon-strated the importance of these molecules as biomarkers. Though there have been miRNA studies in saliva during the estrous cycle, there have been few miRNA research in blood samples. The current study was designed to look at blood miRNAs during the oestrous cycle in heifers (n=5) to address the issue of silent estrus. On the day of estrus and diestrus, blood samples from 60 heifers were obtained and pooled into (n=5) separate samples. Ultrasonography and progesterone assay was performed to confirm estrus. Then, employing particular miRNA adapters, small RNA se-quencing of miRNA was performed using the Illumina Miseq 2500. The UEA sRNA bioinfor-matics workbench identified 94 substantially differently expressed miRNAs (p>0.05) from these data. In estrus, 63 miRNA were upregulated and 31 miRNA were downregulated. When fold change was increased to (log2foldchange >1; q value less than 0.05), 25 miRNAs were elevated during estrus. miR-497, miR-582, miR-10174, miR-23, miR-223, miR-1296 were upregulated, whereas miR-10167, 671, 1246,122 were downregulated. miR-497 is unusually elevated (log2 foldchange>5) when compared to another miRNA (log2 foldchange >5) miRNet 2.0, Cytoscape, and MIENTURNET network software found that miR-497 has more degree centrality, above 60; it is associated with more than 60 nodes, followed by miR-93

Background: Ongoing molecular profiling studies enabled by advances in biomedical technologies are producing vast amounts of ‘omic’ data for early detection, monitoring, and prognosis of diverse diseases. A major common limitation is the scarcity of biological samples, necessitating integrative modeling frameworks that can make optimal use of available data for disease classification tasks. Related data sets are often available from different studies, but may have been generated using different technology platforms. Thus, there is a critical need for flexible modeling methods that can handle data from diverse sources to facilitate the discovery of robust biomarkers that underlie disease regulatory processes. Results: In this paper, we introduce a novel framework called Knowledge Augmented Rule Learning (KARL), which incorporates two sources of knowledge, domain, and data, for pattern discovery from small and high-dimensional datasets, such as transcriptomic data. We propose KARL as a transfer rule learning framework in which knowledge of the domain is transferred to the learning process on data in order to 1) improve the reliability of the discovered patterns, and 2) study the knowledge of the domain when used along with data for modeling. In this work, we generated KARL models on gene expression datasets for five types of cancer, including brain, breast, colon, lung, and prostate. As our knowledge of the domain, we used the Ingenuity Knowledge Base (IKB) to extract genes related to hallmarks of cancer and annotated these prior relationships before learning classifiers from these datasets. Conclusions: Our results show that KARL produces, on average, rule models that are more robust classifiers than the baseline without such background knowledge, for our tasks of cancer prediction using 25 publicly available gene expression datasets. Moreover, KARL helped us learn insights about previously known relationships in these gene expression datasets, along with new relationships not input as known, to enable informed biomarker discovery for cancer prediction tasks. KARL can be applied to modeling similar data from any other domain and classification task. Future work would involve extensions to KARL to handle hierarchical knowledge to derive more general hypotheses to drive biomedicine.

Biomarkers have the potential to aid in the study of Alzheimer’s disease (AD); unfortunately, AD biomarker values often have a high degree of overlap between healthy and AD individuals. This study investigates the potential utility of a series of novel AD biomarkers, the sixty second ¹²⁹Xe retention time, and the xenon washout parameter, based on the washout of hyperpolarized ¹²⁹Xe from the brain of AD participants following inhalation. The xenon washout parameter is influenced by cerebral perfusion, T1 relaxation of xenon, and the xenon partition coefficient, all factors influenced by AD. Participants with Alzheimer’s disease (n=4) and healthy volunteers (n=4) were imaged using hyperpolarized ¹²⁹Xe magnetic resonance imaging (MRI) and magnetic resonance spectroscopy (MRS) to determine the amount of retain xenon in the brain. At 60 sec post breath hold, AD patients retained significantly higher amounts of ¹²⁹Xe compared to healthy controls. Data was fit to a pharmacokinetic model and the xenon washout parameter was extracted. Xenon washout in white and grey matter occurs at a slower rate in Alzheimer’s participants (¹²⁹Xe half-life time of 42s and 43s, respectively) relative to controls (20s and 16s, respectively). Following larger scale clinical trials for validation, the xenon washout parameter has the potential to become a useful biomarker for the support of an AD diagnosis.

Currently the bimatoprost implant (DURYSTA) is approved for a single administration secondary to concern for progressive corneal endothelial cell (CEC) loss with intracameral administration. In order to better understand the cause of CEC loss and other adverse events (AEs) with intracameral administration, multimodal imaging of the implant utilizing optical coherence topography (OCT), robotic ultrasound and bio microscopy video recording was utilized. Inherently the anterior chamber is a non-confined space. In certain examples the implant assumed a round and spotted structure as it picked up iris pigment as it migrated around the anterior chamber. Accordingly, we explored delivery of the implant in the middle segment behind the iris and in front of the pseudophakic lens. We then evaluated the suitability of various imaging modalities to assess the implant in this location. For middle segment administration, the ArcScan Insight 100 robotic ultrasound provided resolution and repeatability sufficient to monitor the implant behind the iris. This preliminary study hypothesizes that DURYSTA migration in the anterior chamber is the main source of AEs. Through use of a confined location, the middle segment, the implant is unlikely to migrate and cause CEC loss while also delivering drug closer to its site of action, the ciliary body. Further efforts are underway to understand the suitability of the middle segment for serial DURYSTA administration to maximize intraocular pressure lowering while minimizing AEs.

Collaborative robots (cobots) have largely replaced conventional industrial robots in today’s workplaces, particularly in manufacturing setups due to their improved performance and intelligent design. In the framework of Industry 5.0, humans are working alongside cobots to accomplish the required level of automation. However, human-robot interaction has brought up concerns regarding human factors (HF) and ergonomics. A human worker may experience cognitive stress as a result of cobots' irresponsive nature in unpredictably occurring situations, which adversely affects productivity. Therefore, there is a necessity to measure stress to enhance a human worker’s performance in a human-robot collaborative environment. In this study, factory workers’ mental workload has been assessed using physiological, behavioural, and subjective measures. Electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) signals have been collected to acquire brain signals and track hemodynamic activity, respectively. The effect of task complexity, cobot’s movement speed, and cobot’s payload capacity on the mental stress of a human worker have been observed, for a task designed in the context of a smart factory. Task complexity and cobot’s speed have proved to be more impactful. As physiological measures are unbiased and more authentic means to estimate stress, eventually, they may replace the other conventional measures if they prove to correlate with the results of traditional ones. Here, regression and artificial neural networks (ANN) have been utilised to determine the correlation between physiological data and subjective and behavioural measures. Regression has performed better for most of the targets and the best correlation (rsq-adj = 0.654146) has been achieved for predicting missed beeps, behavioural measure, using a combination of multiple EEG and fNIRS predictors. The k-nearest neighbours (KNN) algorithm has been used to evaluate the accuracy of correlation between traditional measures and physiological variables, with highest accuracy of 77.8% achieved for missed beeps as the target. Results show that physiological measures can be more insightful and have the tendency to replace other biased parameters.

The Na+/K+ ATPase is a protein involved in the active transport of ions across the cellular membrane. Ouabain is a cardiotonic glycoside that, by inhibiting the Na+/K+ pump, interferes with cell processes mediated directly by the pump, but also indirectly influences other cellular processes, such as cellular cycle and proliferation, growth, cell differentiation, angiogenesis, migration, adhesion and invasion. We used the SK-BR-3 breast cancer cell line, mesenchymal stem cells (MSCs), and tumor-associated fibroblasts (TAFs) in vitro for determining the changes induced by Ouabain in concentration of 10-5 M, 10-6 M, 10-8 M, 10-9 M on these cellular types, employing specific methods: SEM for morphological evaluation; immunocytochemistry, flowcytometry to assess immunophenotypical markers expression, cell cycle and Annexin V/PI assay for cellular proliferation and viability testing; flowchamber assay to evaluate functional adhesion behavior; RT-PCR for Na+/K+ ATPase subunits molecular expression. Being indicative of the pro-apoptotic and inhibitory effect of Ouabain on tumor invasion and metastasis, the results support the addition of Ouabain to the oncological therapeutic arsenal, trailing the “repurposing drugs” approach.

The present study illustrates a brain-computer interface designed and developed to be wearable, portable, and user-friendly. Eight dry electroencephalographic sensors were adopted to acquire the brain activity associated with motor imagery. Multimodal feedback in extended reality was exploited to improve the detection of neurological phenomena. Twenty-seven healthy subjects used the proposed system in five sessions to investigate the effects of feedback on motor imagery. The sample was divided into two equal-sized groups: the "neurofeedback" group, which performed motor imagery while receiving feedback, and the "control" group, which performed motor imagery with no feedback. Several questionnaires were administrated to participants aiming to investigate the usability of the proposed system and individual’s ability to imagine movements. The highest mean classification accuracy across subjects of control group was about 62 % with 3 % associated type A uncertainty, and 69 % with 3 % uncertainty for neurofeedback group. Moreover, in some cases the results were significantly higher for the neurofeedback group. The perceived usability by all participants was high. Overall, the study highlights the advantages and the pitfalls of using a wearable brain-computer interface with dry sensors. Notably, the results and the perceived usability pave the way for the employment of the proposed system in tele-rehabilitation.

In this paper, we present a multimodal dataset for the analysis of classroom atmosphere, based on the behavior and voice of teachers in teaching scenarios. we propose four visual models, three audio models, and one visual-audio dual-modality model to be tested on our dataset. The results indicate that the CH-CC dataset is feasible and reliable and that the visual modality plays a major role in the analysis of this dataset.

Accurate crop diseases classification is crucial for ensuring food security and enhancing agricultural productivity. However, existing crop disease classification algorithms primarily focus on a single image modality and typically require a large number of samples. Our research counters these issues by using pre-trained Vision-Language Models (VLMs), which enhances multimodal synergy for better crop disease classification than traditional unimodal approaches. Firstly, we apply the multimodal model Qwen-VL to generate meticulous textual descriptions for representative disease images selected through clustering from the training set, which will serve as prompt text for generating classifier weights. Compared to using solely the language model for prompt text generation, this approach better captures and conveys fine-grained and image-specific information, thereby enhancing prompt quality. Secondly, we integrate the cross-attention and the SE (Squeeze-and-Excitation) attention into the training-free mode VLCD (Vision-Language model for Crop Diseases classification) and the training-required mode VLCD-T (VLCD-Training) respectively for prompt text processing, enhancing classifier weights by emphasizing key text features. Experimental outcomes conclusively prove our method’s heightened classification effectiveness in few-shot crop disease scenarios, tackling data limitations and intricate disease recognition issues. It offers a pragmatic tool for agricultural pathology and reinforces the smart farming surveillance infrastructure.

MicroRNAs (miRNAs) are small endogenous RNAs that regulate gene expression post-transcriptionally by targeting either the 3′ untranslated or coding regions of genes. They have been reported to play key roles in a wide range of biological processes. The recent remarkable developments of transcriptomics technologies, especially next-generation sequencing technologies and advanced bioinformatics tools, allow more in-depth exploration of messenger RNAs (mRNAs) and non-coding RNAs (ncRNAs) including miRNAs. These technologies have offered great opportunities for a deeper exploration of miRNA involvement in farm animal diseases, as well as livestock productivity and welfare. In this review, we provide an overview of the current knowledge of miRNA roles in farm animal diseases with a particular focus on diseases of economic importance. In addition, we discuss the steps and future perspectives of using miRNAs as biomarkers and molecular therapy for livestock disease management as well as the challenges and opportunities for understanding the regulatory mechanisms of miRNAs related to disease pathogenesis.

Lung cancer is one of the most important health risks worldwide for human. Non-small cell lung cancer (NSCLC) is the most common cause of premature death from malignant disease. This study provides in-depth insights from systems biology analyses to identify molecular to inform systemic drug targeting in NSCLC. Gene expression profiles from non small cell lung cancer were analyzed with genome-scale biomolecular networks (I,e., protein-protein interaction, transcriptional and post transcriptional regulatory networks). The aim of the study was to determine the pathways and expression profile of the genes to discover molecular signature at RNA and protein levels which could serve as potential drug targets for therapeutics innovation and the identification of novel targets. Eight proteins, six TFs and seven miRNAs came into prominence as potential drug targets. The differential expression profiles of these reporter biomolecules were cross-validated by independent RNA-Seq and miRNA-Seq. Risk discrimination performance of the reporter biomolecules NPR3, JUN, PPARG, TP53, CKMT1A, SP3 and TFAP2A were also evaluated. Total 213 drugs and 7 proteins were found for non small cell lung cancer through dgidb. Among these identified drugs seven drugs such as- Gemcitabine, Carboplatin, paclitaxel, Docetaxel, Crizotinib, Bevacizumab and Gemcitabine is used for NSCLC which is approved by National Cancer Institute. The molecular signatures and repurposed drugs presented here permit further attention for experimental studies which are offer significant potential as biomarkers and candidate therapeutics for precision medicine approaches to clinical management of NSCLC.

The study of paraneoplastic syndromes in humans has a long history, whereas for domestic animals – only since the beginning of the 21^th century. There are various forms of paraneoplastic syndromes; many classifications based on pathogenetic, organ-system principles are described. In accordance with the modern classification, paraneoplastic syndromes are divided into endocrinopathies, hematological paraneoplastic syndromes, gastrointestinal, renal, dermatological, neurological, ophthalmological. The purpose of this study was to develop a scientifically based algorithm for diagnosing ophthalmopathies against the background of paraneoplastic syndrome in dogs, including a multifactorial system of “hormonal-drug treatment” of paraneoplastic ophthalmopathies. The work used a comprehensive methodological approach, including the collection of anamnestic data, clinical examination of the animal, examination of the area of the pathological process, hematological studies, cytomorphological studies, visual diagnostic methods with complete oncological and ophthalmological examinations using the necessary equipment. Treatment for cancer included surgical removal of the tumor, chemotherapy and radiotherapy. The choice of treatment protocol depended on the location of the disease, tumor phenotype (if present) and stage of the malignancy. The only chemotherapy was applied using complex protocols in the treatment of dog lymphomas. Treatment of melanoma in dogs was carried out using an integrated approach which combined methods of surgery, chemotherapy, and radiotherapy. The obtained results can be recommended for use in the diagnosis and treatment of paraneoplastic ophthalmopathies in dogs.

Enhancing traffic safety is one of the fundamental objectives of Intelligent Transport Systems (ITS), and it aligns closely with the principles of sustainable transport. Due to specific differences in infrastructure, vehicles, and users’ behaviour, places where different modes of traffic intersect are recognized as critical points of the traffic system, making them crucial aspects of Sustainable Urban Mobility Plans (SUMPs) implementation. The SUMPs aim to create urban mobility that is not only environmentally friendly and efficient but also safe for all users. The continuous development and widespread adoption of innovative ITS technologies have paved the way for a system that could provide drivers with real-time information about both immediate and potential dangers at these critical points. This paper provides an overview of previous research in the field, investigating the impact of information systems on drivers’ behaviour, various detection and communication solutions that can be effectively integrated into such a system, as well as a brief overview of models and solutions that have been developed to warn drivers in a similar context. The reviewed literature offered valuable insights on which a novel driver information system architecture framework is proposed. This framework can contribute to the ongoing safety improvement in multimodal transport networks within the context of sustainable transport.