Multimodal remote sensing data classification can enhance the model’s ability to distinguish land features through multimodal data fusion. In this context, how to help models understand the relationship between multimodal data and target tasks is the focus of researchers. Inspired by human feedback learning mechanisms, causal reasoning mechanisms, and knowledge induction mechanisms, this paper integrates causal learning, reinforcement learning, and meta learning into a unified remote sensing data classification framework and proposed the causal meta-reinforcement learning (CMRL). First, based on feedback learning mechanisms, we have overcome the limitations of traditional implicit optimization of fusion features and customized a reinforcement learning environment for multimodal remote sensing data classification tasks. Through feedback interactive learning between agents and the environment, we help them understand the complex relationships between multimodal data and labels, thereby achieving full mining of multimodal complementary information. Second, based on the causal inference mechanism we designed causal distribution prediction action, classification reward, and causal intervention reward, capturing pure causal factors in multimodal data and cutting off false statistical associations between non-causal factors and class labels. Finally, based on the knowledge induction mechanism, we designed a bi-layer optimization mechanism based on meta-learning. By constructing a meta training task and meta validation task simulation model in the generalization scenario of unseen data, we helped the model induce cross-task shared knowledge, thereby improving its generalization ability for unseen multimodal data. The experimental results on multiple sets of multimodal datasets show that the proposed method achieved state-of-the-art performance in multimodal remote sensing data classification tasks.

Ambulatory heart rate (HR) monitors that acquire electrocardiogram (ECG) or/and photoplethysmographm (PPG) signals from the torso, wrists, or ears are notably less accurate in tasks associated with high levels of movement compared to clinical measurements. However, reliable estimation of HR can be obtained through data fusion from different sensors. These methods are especially suitable for multimodal hearable devices, where heart rate can be tracked from different modalities, including electrical ECG, optical PPG, and sounds (heart tones). Combined information from different modalities can compensate for single source limitations. In this paper, we evaluate the possible application of data fusion methods in hearables. We assess data fusion for heart rate estimation from simultaneous in-ear ECG and in-ear PPG, recorded on eight subjects while performing 5-minute sitting and walking tasks. Our findings show that data fusion methods provide a similar level of mean absolute error as the best single-source heart rate estimation but with much lower intra-subject variability, especially during walking activities. We conclude that data fusion methods provide more robust HR estimation than a single cardiovascular signal. These methods can enhance the performance of wearable devices, especially multimodal hearables, in heart rate tracking during physical activity.

Improper sitting positions are known as the primary reason for back pain and the emergence of musculoskeletal disorders (MSD) among individuals who spend prolonged time working with computer screens, keyboards, and mice. At the same time, it is well understood that automated technological tools can play an important role in the process of unhealthy habit alteration, so plenty of research efforts are focused on research and technology development (RTD) activities that aim to provide support to the prevention of back pain or the development of MSD. Here, we report on creating a new resource in support of RTD activities aiming at the automated detection of improper sitting positions. It consists of multimodal multisensory recordings of 100 persons made with a video recorder, camera, and wrist-attached sensors that capture physiological signals (PPG, EDA, Skin temperature), as well as motion sensors (three-axis accelerometer). Our multimodal multisensory dataset (MMD-MSD) opens new opportunities for modeling the body stance (sitting posture and movements), physiological state (stress level, attention, emotional arousal, valence), and performance (success rate on the Stroop test) of people working with a computer. Finally, we demonstrate two use cases: improper neck posture detection from pictures and cognitive load detection from physiological signals.

The human mind is multimodal. Yet most behavioral studies rely on century-old measures of behavior—task accuracy and latency (response time). Multimodal and multisensory analysis of human behavior creates a better understanding of how the mind works. The problem is that designing and implementing these experiments is technically complex and costly. This paper introduces versatile and economical means of developing multimodal-multisensory human experiments. We provide an experimental design framework that automatically integrates and synchronizes measures including electroencephalogram (EEG), galvanic skin response (GSR), eye-tracking, virtual reality (VR), body movement, mouse/cursor motion and response time. Unlike proprietary systems (e.g., iMotions), our system is free and open-source; it integrates PsychoPy, Unity and Lab Streaming Layer (LSL). The system embeds LSL inside PsychoPy/Unity for the synchronization of multiple sensory signals—gaze motion, electroencephalogram (EEG), galvanic skin response (GSR), mouse/cursor movement, and body motion—with low-cost consumer-grade devices in a simple behavioral task designed by PsychoPy and a virtual reality environment designed by Unity. This tutorial shows a step-by-step process by which a complex multimodal-multisensory experiment can be designed and implemented in a few hours. When conducting the experiment, all of the data synchronization and recoding of the data to disk will be done automatically.

Molecular analysis of growing teratoma syndrome has not been extensively studied. Here, we report a 14-year-old boy with a growing mass during treatment for a mixed germ cell tumor of the pineal region. Tumor markers were negative; thus, growing teratoma syndrome was suspected. A radical resection via the occipital transtentorial approach was performed, and histopathological examination revealed a teratoma with malignant features. Methylation classifier analysis confirmed the diagnosis of teratoma, and DMRT1 loss and 12p gain were identified by copy number variation analysis, potentially elucidating the cause of growth and malignant transformation of the teratoma. The patient remains in remission after intense chemoradiation treatment as a high-risk germ cell tumor.

Microbial foodborne pathogens can cause major risks to public health and the food industry. Rapid and accurate detection of these pathogens is crucial to prevent outbreaks and ensure food safety. Traditional single-mode biosensing approaches have their limitations in terms of specificity, sensitivity, and speed. Over the years, there has been an increasing research interest in developing multimodal biosensing strategies that integrate multiple sensing techniques to achieve enhanced accuracy, efficacy, and precision in foodborne pathogen detection. This article review paper explores the current state of multimodal biosensing technologies and their promising applications in the food industry. We discuss various integrated biosensing platforms, including optical, electrochemical, and nanomaterial-based systems, among others. The advantages, challenges, and future prospects of multimodal biosensing for foodborne pathogens are thoroughly examined, highlighting the potential impact of these advanced technologies on food safety and public health.

Federated learning (FL) has become a burgeoning and attractive research area, which provides a collaborative training scheme for distributed data sources with privacy concerns. Most existing FL studies focus on taking unimodal data, such as images and text, as the model input and resolving the heterogeneity challenge, i.e., the non-identically distributed (non-IID) challenge caused by data distribution imbalance related to data labels and data amount. In real-world applications, data are usually described by multiple modalities. However, to the best of our knowledge, only a handful of studies have been proposed to improve the system performance by utilizing multimodal data. In this survey paper, we identify the significance of this emerging research topic – multimodal federated learning (MFL) and perform a literature review on the state-of-art MFL methods. Furthermore, we categorize multi-modal federated learning into congruent and incongruent multimodal federated learning based on whether all clients possess the same modal combinations. We investigate the feasible application tasks and related benchmarks for MFL. Lastly, we summarize the promising directions and fundamental challenges in this field for future research.

In today’s Web 2.0 era, online social media has become an integral part of our lives. In the course of the information revolution, the form of information has undergone a radical change, from simple text information to today’s integrated video, image, text and audio, and there has also been a great change in the way of dissemination and access, as people nowadays do not just rely on traditional media to passively receive information, but more actively and selectively obtain information from social media. Therefore, it has become a great challenge for us to effectively utilize these massive and integrated multi-modal media information to form an effective system of retrieval, browsing, analysis and usage. Unlike movies and traditional long-form video content, micro-videos are usually short in length, between a few seconds and tens of seconds, which allows users to quickly browse different contents and make full use of the fragmented time in their lives, while users can also share their micro-videos to their friends or the public, forming a unique social way. Video contains rich multimodal information, and fusing information from multiple modalities in a video recommendation task can improve the accuracy of the video recommendation task.According to the micro-video recommendation task, a new combinatorial network model is proposed to combine the discrete features of each modality into the overall features of various modalities through the network, and then fuse the various modal features to obtain the overall video features, which will be used for recommendation. In order to verify the effectiveness of the algorithm proposed in this paper, experiments are conducted in the public dataset, and it is shown the effectiveness of our model.

Sign language recognition is essential in hearing-impaired people’s communication. Sign language recognition is an important concern in computer vision and has been developed with rapid progress in image recognition technology. However, sign language recognition using a general monocular camera has problems with occlusion and recognition accuracy in sign language recognition. In this research, we aim to improve accuracy by using a 2-axis bending sensor as an aid in addition to image recognition. We aim to achieve higher recognition accuracy by acquiring hand keypoint information of sign language actions captured by a monocular RGB camera and adding sensor assist. To improve sign language recognition, we need to propose new AI models. In addition, the amount of dataset is small because it uses the original data set of our laboratory. To learn using sensor data and image data, we used MediaPipe, CNN, and BiLSTM to perform sign language recognition. MediaPipe is a method for estimating the skeleton of the hand and face provided by Google. In addition, CNN is a method that can learn spatial information, and BiLSTM can learn time series data. Combining the CNN and BiLSTM methods yields higher recognition accuracy. We will use these techniques to learn hand skeletal information and sensor data. Additionally, the 2-axis Bending sensor glove data support training AI model. Using these methods, we aim to improve the recognition accuracy of sign language recognition by combining sensor data and hand skeleton data. Our method performed better than using skeletal information, achieving 96.5% accuracy in Top-1.

According to the World Health Organization (WHO), dementia is the seventh leading reason of death among all illnesses and one of the leading causes of disability among the world’s elderly people. Day by day the number of Alzheimer’s patients is raising. Considering the increasing rate and the dangers, Alzheimer’s disease should be diagnosed carefully. Machine learning is a potential technique for Alzheimer’s diagnosis but general users do not trust machine learning models due to the black-box nature. Even, some of those models do not provide the best performance because of using only neuroimaging data. To solve these issues, this paper proposes a novel explainable Alzheimer’s disease prediction model using a multimodal dataset. This approach performs a data-level fusion using clinical data, Freesurfer MRI segmentation data, and psychological data. For Alzheimer’s disease vs cognitively normal prediction, the random forest classifier provides 100% accuracy. Furthermore, Alzheimer’s disease and non-Alzheimer’s dementia should be classified properly because their symptoms are similar. To the best of our knowledge, we are the first to present a three-class classification on Alzheimer’s disease vs cognitively normal vs non-Alzheimer’s dementia and achieved 99.86% accuracy using an ensemble model. Besides, a novel Alzheimer’s patient management architecture is also proposed in this work..

In an era where dietary habits significantly impact health, technological interventions can offer personalized and accessible food choices. This paper introduces Chef Dalle, a recipe recommen-dation system that leverages multimodal human-computer interaction (HCI) techniques to pro-vide personalized cooking guidance. The application integrates voice-to-text conversion via Whisper, ingredient image recognition through GPT-Vision, and employs TF-IDF vectorization alongside cosine similarity for personalized recipe recommendations. These methods enable users to interact with the system using voice, text, or images, accommodating various dietary re-strictions and preferences. Furthermore, the utilization of DALL-E 3 for generating recipe images enhances user engagement. User feedback mechanisms allow for the refinement of future rec-ommendations, demonstrating the system's adaptability. Chef Dalle showcases potential appli-cations ranging from home kitchens to grocery stores and restaurant menu customization, ad-dresses accessibility, promoting healthier eating habits. This paper underscores the significance of multimodal HCI in enhancing culinary experiences, setting a precedent for future developments in the field.

This study compares the performance of existing studies on multimodal emotion recognition, and proposes a model that fuses two modalities with the speaker's text and voice signals as input values and detects depression. Based on the DAIC-WOZ dataset, voice features were extracted using CNN, text features were extracted using Transformers, and two modalities were fused through a tensor fusion network. We also build a model to detect whether the speaker is depressed or not using LSTM in the final layer. This study suggests the possibility of increasing access to mental illness diagnosis by enabling patients to detect depression on their own in daily conversations. If the model proposed in this study is developed and the voice conversation system is connected, it will be easier for patients who cannot visit the hospital periodically or who are reluctant to visit the hospital to check their condition and seek recovery. Furthermore, it can be expanded to multi-label classification for various mental diseases and used as a simple self-mental disease diagnosis tool.

Neurodegenerative diseases, such as Alzheimer’s disease and Parkinson’s disease, are caused by a combination of multiple events that damage neuronal function. A well-characterized biomarker of neurodegeneration is proteinaceous aggregates accumulation in the brain. However, the gradually worsening symptoms of neurodegenerative diseases are unlikely to be solely due to the result of a mutation in a single gene, but rather a multi-step process involving epigenetic changes. Multiple epigenetic studies have revealed that modification of histones accompanied by both the local and global remodeling of the chromatin structure and alternations in transcriptional patterns are closely associated with the pathogenesis of neurodegenerative diseases. Unlike DNA mutations, epigenetic alterations are reversible, and therefore raise the possibilities for therapeutic intervention including dietary modifications. Additionally, reactive oxygen species may contribute to the pathogenesis of Alzheimer’s disease and Parkinson’s disease. Given that the antioxidant properties of plant-derived phytochemicals are likely to exhibit pleiotropic effects against ROS-mediated epigenetic alternation, dietary intervention may be promising for the management of neurodegeneration in these diseases. In this review, the state-of-the-art applications using single-cell multi-modal omics approaches including genetics, and epigenetics, and dietary approaches for the identification of novel biomarkers and therapeutic approaches for the treatment of neurodegenerative diseases are discussed.

Multimodal user interfaces promise a natural and intuitive human machine interactions. But is the extra effort for the development of a complex multi-sensor system justified, or can users also be satisfied with one input modality already? This study investigates interactions in an industrial weld inspection workstation. Three unimodal interfaces, including spatial interaction with buttons augmented on a workpiece or a worktable, and speech commands, were tested individually and in a multimodal combination. Within the unimodal conditions, users preferred the augmented worktable, but overall, the interindividual usage of all input technologies in the multimodal condition was ranked best. Our findings indicate that the implementation and use of multiple input modalities is valuable, and that it is difficult to predict the usability of individual input modalities for complex systems.

This study aims to enhance multimodal transportation systems by mitigating CO2 emissions and enhancing operational efficiency. It introduces a novel centralized cargo concentration approach tailored for regions facing geographical challenges. The method proposes for direct transportation of cargo from its loading origin to export ports, bypassing intermediate hubs. The mathematical model determines the most efficient means of transport for each route, factoring in variables like distance, volume, and cargo type. Research results indicate that, in scenarios with a high concentration of cargo, multiple hubs may not be necessary, which could streamline transportation and logistics operations. Modal preferences vary based on regional dynamics and cargo characteristics, with rail and sea transport emerging as preferable options under specific circumstances, surpassing the efficacy of road transport. The proposed model showcases reductions in both logistics costs and CO2 emissions compared to road-centric scenarios. It underscores the strategic integration of diverse transportation modes as pivotal for enhancing efficiency and sustainability. This study furnishes a framework adaptable to optimizing multimodal transportation systems in regions sharing similar geographical and logistical attributes.

The advent of the era of big data will bring more convenience to people and greater development to society. But at the same time, it will also bring people the problem of 'information overload', i.e., when people are faced with huge information data, there are many redundant and worthless data. The redundant and worthless data information seriously interferes with the accurate selection of information data. Even though people can use Internet search engines to access information data, they cannot meet the individual needs of specific users in specific contexts. The personalized needs of a particular user in a particular context. Therefore, how to find useful and valuable information quickly has become one of the key issues in the development of big data. With the advent of the era of big data, recommendation systems, as an important technology to alleviate information overload, have been widely used in the field of e-commerce. Recommender systems suffer from a key problem: data sparsity. The sparsity of user history rating data causes insufficient training of collaborative filtering recommendation models, which leads to a significant decrease in the accuracy of recommendations. In fact, traditional recommendation systems tend to focus on scoring information and ignore the contextual context in which users interact. There are various contextual modal information in people's real life, which also plays an important role in the recommendation process. In this paper we achieve data degradation and feature extraction, solving the problem of sparse data in the recommendation process. An interaction context-aware sub-model is constructed based on a tensor decomposition model with interaction context information to model the specific influence of interaction context in the recommendation process. Then an attribute context-aware sub-model is constructed based on the matrix decomposition model and using attribute context information to model the influence of user attribute contexts and item attribute contexts on recommendations. In the process of building the model, the method not only utilizes the explicit feedback rating information of users in the original dataset, but also utilizes the interaction context and attribute context information of the implicit feedback and the unlabeled rating data. We evaluate our model by extensive experiments. The results illustrate the effectiveness of our recommender model.

Hateful and abusive speech presents a major challenge for all online social media platforms. Recent advances in Natural Language Processing and Natural Language Understanding allow more accurate detection of hate speech in textual streams. This study presents a multimodal approach to hate speech detection by combining Computer Vision and Natural Language processing models for abusive context detection. Our study focuses on Twitter messages and, more specifically, on hateful, xenophobic and racist speech in Greek aimed at refugees and migrants. In our approach we combine transfer learning and fine-tuning of Bidirectional Encoder Representations from Transformers (BERT) and Residual Neural Networks (Resnet). Our contribution includes the development of a new dataset for hate speech classification, consisting of tweet ids, along with the code to obtain their visual appearance, as they would have been rendered in a web browser. We have also released a pre-trained Language Model trained on Greek tweets, which has been used in our experiments. We report a consistently high level of accuracy (accuracy score=0.970, f1-score=0.947 in our best model) in racist and xenophobic speech detection.

Globally, there is massive uptake and explosion of data and challenge is to address issues like scale, pace, velocity, variety, volume and complexity of this big data. Considering the recent epidemic in China, modeling of COVID-19 epidemic for cumulative number of infected cases using data available in early phase was big challenge. Being COVID-19 pandemic during very short time span, it is very important to analyze the trend of these spread and infected cases. This chapter presents medical perspective of COVID-19 towards epidemiological triad and the study of state-of-the-art. The main aim this chapter is to present different predictive analytics techniques available for trend analysis, different models and algorithms and their comparison. Finally, this chapter concludes with the prediction of COVID-19 using Prophet algorithm indicating more faster spread in short term. These predictions will be useful to government and healthcare communities to initiate appropriate measures to control this outbreak in time.

Affordances are an important concept in cognition, which can be applied to robots in order to perform a successful human-robot interaction (HRI). In this paper we explore and discuss the idea of emotional affordances and propose a viable model for implementation into HRI. We consider “2-ways” affordances: perceived object triggering an emotion, and perceived human emotion expression triggering an action. In order to make the implementation generic, the proposed model includes a library that can be customised depending on the specific robot and application’s scenario. We present the AAA (Affordance-Appraisal-Arousal) model, which incorporates Plutchik’s Wheel of Emotions, and show some examples of simulation and possible scenarios.

Emotion detection holds significant importance in facilitating human-computer interaction, enhancing the depth of engagement. By integrating this capability, we pave the way for forthcoming AI technologies to possess a blend of cognitive and emotional understanding, bridging the divide between machine functionality and human emotional complexity. This progress has the potential to reshape how machines perceive and respond to human emotions, ushering in an era of empathetic and intuitive artificial systems. This paper introduces a novel approach to multimodal emotion recognition, seamlessly integrating speech and text modalities to accurately infer emotional states. Employing CNNs, we meticulously analyze speech using Mel spectrograms, while a BERT-based model processes the textual component, leveraging its bidirectional layers for profound semantic comprehension. The outputs from both modalities are combined using an attention-based fusion mechanism that optimally weighs their contributions. The proposed method undergoes meticulous testing on two distinct datasets: Carnegie Mellon University’s Multimodal Opinion Sentiment and Emotion Intensity (CMU-MOSEI) dataset and the Multimodal Emotion Lines Dataset (MELD). The results demonstrate superior efficacy compared to existing frameworks, achieving an accuracy of 88.4% and an F1-score of 87.9% on the CMU-MOSEI dataset, and a notable weighted accuracy (WA) of 67.81% and a weighted F1 (WF1) score of 66.32% on the MELD dataset. This comprehensive system offers precise emotion detection and introduces several significant advancements in the field.

The study combines two critical aspects of climate research in Nigeria. The first segment focuses on improving predictive performance of global circulation models (GCMs) employing ensemble techniques. ANN ensemble displayed significant improvement in the accuracy of climate projections, particularly in high-altitude geographic areas where traditional models exhibit limitations. Performance evaluation metrics such as Mean Absolute Error (MAE), Root Mean Squared Error (RMSE), and Nash–Sutcliffe Efficiency (NSE) demonstrate the effectiveness of the ANN multimodal ensemble. Building on the improved climate modelling, the second segment delves into a spatial and temporal analysis of rainfall and mean temperature patterns under climate change in Nigeria. By considering two Representative Concentration Pathways (RCPs), namely RCP4.5 and RCP8.5, the study utilizes dynamically downscaled GCMs obtained from the Coupled Model Intercomparison Project phase 5 (CMIP5). The Mann-Kendall test reveals significant spatiotemporal variations in climate trends across the country. The warming trend is particularly pronounced in the northern regions, with RCP8.5 showing more severe impacts compared to RCP4.5. This integrated approach not only highlights the importance of multimodal ensembles in climate modelling but also provides valuable insights into the spatial and temporal patterns of climate change to inform effective adaptation and mitigation strategies for Nigeria.

The collaboration of multimodal transport documents is the foundation for conducting multimodal transport operations. Blockchain technology can effectively address trust issues and information sharing difficulties in current multimodal transport document collaboration. However, in current blockchain-based electronic document research, the bottleneck problem lies in the collaboration of multiparty in multimodal transport under the "one-bill coverage system". We design a blockchain platform architecture for multimodal transport, reshaping collaboration processes for different modes of transport based on the blockchain platform. It proposes a collaboration model for multimodal transport under the "one-bill coverage system" and performs model solving and case analysis. The obtained collaboration strategies are embedded into the platform's application layer. Finally, using Solidity language, it writes smart contracts related to multimodal transport under the "one-bill coverage system " and deploys and executes them on the Remix platform.

Syringomyelia can be associated with multiple etiologies. The treatment of the underlying causes is the first-line therapy, however, a direct approach to the syrinx is accepted as rescue treatment. Any direct intervention on the syrinx requires a myelotomy, posing a significant risk of iatrogenic spinal cord (SC) injury. Intraoperative neurophysiological monitoring (IONM) is crucial to detect and prevent surgically induced damage in neural SC pathways. We retrospectively reviewed the perioperative and intraoperative neurophysiological data and perioperative neurological examinations in ten cases of syringomyelia surgery. All monitored modalities remained stable throughout the surgery in six cases, correlating with no new postoperative neurological deficits. In two patients, significant transitory attenuation, or loss of motor evoked potentials (MEPs), were observed and recovered after a corrective surgical maneuver, with no new postoperative deficit. In two cases, a significant MEP decrement was noted, which lasted until the end of the surgery and was associated with postoperative weakness. A transitory train of neurotonic electromyography (EMG) discharges was reported in one case, the surgical plan was adjusted and the patient showed no postoperative deficit. The dorsal nerve roots were stimulated and identified in the seven cases where the myelotomy was performed via the dorsal root entry zone. Dorsal column mapping guided the myelotomy entry zone in four cases. In conclusion, multimodal IONM is feasible and reliable and may help prevent iatrogenic SC injury during syringomyelia surgery.

Document classification is one of the most critical steps in the document analysis pipeline. There are two types of approaches for document classification, known as image-based and multimodal approaches. The image-based document classification approaches are solely based on the inherent visual cues of the document images. In contrast, the multimodal approach co-learns the visual and textual features, and it has proved to be more effective. Nonetheless, these approaches require a huge amount of data. This paper presents a novel approach for document classification that works with a small amount of data and outperforms other approaches. The proposed approach incorporates a hierarchical attention network(HAN) for the textual stream and the EfficientNet-B0 for the image stream. The hierarchical attention network in the textual stream uses the dynamic word embedding through fine-tuned BERT. HAN incorporates both the word level and sentence level features. While the earlier approaches rely on training on a large corpus (RVL-CDIP), we show that our approach works with a small amount of data (Tobacco-3482). To this end, we trained the neural network at Tobacco-3428 from scratch. Thereby, we outperform state-of-the-art by obtaining an accuracy of 90.3%. This results in a relative error reduction rate of 7.9%.

This paper is an interdisciplinary study of novel applications of techniques and tools of an area of brain science, known as Synesthesia (involving associations and/or confusion between distinct senses), to area of Computer Science known as Immersive Virtual Reality (VR), that makes the subject’s awareness of physical self be diminished by being surrounded in an engrossing artificial environment. Natural Synesthesia has for the last decade been an important emerging area in brain science but is present in only a small proportion of the population. For example a person with Natural Synesthesia, when viewing a grapheme, may perceive a color additionally to be associated to the grapheme. In contrast, Artificial synesthesia (also known as virtual synesthesia or synthetic synesthesia) has been defined as the sensory joining due a cross-modal mapping device, where information of one sense is accompanied by an induced perception in another sense. In particular, we propose use of a multimodal manner of displaying information in VR to increase and concentrate attention. Artificial Synesthesia to synthetically create induced associations between senses, allowing Artificial Synesthesia to be experienced by anyone using a VR system. The paper describes the enhancement of immersive VR by use of Artificial Synesthesia to improve the system’s performance at steering and directing the attention of the user. We describe techniques for an enhanced immersive VR that displays associations between a variety of senses: between colors and characters, also between colors and sounds, and between sounds and the position of tactile sensations. The sense association provided by Artificial Synesthesia allows the system to better capture the user’s attention and better direct that attention. A major application of our work in VR-induced Artificial Synesthesia is to provide an enhanced methodology for controlling the attention of the subject, and to improve the direction of attention of subjects undergoing guided imagery therapies for pain relief. Other potential high-impact applications include improved immersive VR, more programmable human/computer interfaces and other medical therapies.

This study was performed to synthesize multimodal radiopharmaceutical designed for the diagnosis and treatment of prostate cancer. To achieve this goal, Super Paramagnetic Iron Oxide (SPIO) nanoparticles were used as a platform for targeting molecule (PSMA-617) and for complexation of two scandium radionuclides, 44Sc for PET imaging and 47Sc for radionuclide therapy. TEM and XPS images showed that the Fe3O4 NPs have a uniform cubic shape and a diameter from 38 to 50 nm. The Fe3O4 core are surrounded by SiO2 and an organic layer. The saturation magnetization of the SPION core was 60 emu/g. However, coating the SPIONs with silica and polyglycerol reduces the magnetization significantly. The obtained bioconjugates were labeled with 44Sc and 47Sc, with a yield higher than 97%. The radiobioconjugate exhibited high affinity and cytotoxicity towards the human prostate cancer LNCaP (PSMA+) cell line, much higher than for PC-3 (PSMA-) cells. High cytotoxicity of the radiobioconjugate was confirmed by radiotoxicity studies on LNCaP 3D-spheroids. In addition, the magnetic properties of the radiobioconjugate should allow for its use in guide drug delivery driven by magnetic field gradient.

There have been multiple technological advancements that promise to gradually enable devices to measure and record signals with high resolution and accuracy in the domain of Brain Computer Interfaces (BCI). This review paper provides a comprehensive overview of fNIRS, EEG, and fMRI, including their principles, advantages, limitations, and integration with other modalities for advanced BCIs. The paper highlights the advantages of integrating multiple modalities, such as increased accuracy and reliability, and discusses the challenges and limitations of multimodal integration. Applications of advanced BCIs in clinical, assistive, gaming, and entertainment domains are also discussed. Furthermore, we explain the data acquisition approaches for each of these modalities. We also demonstrate various software programs that help in extracting, cleaning, and refining the data. We conclude this paper with discussion on the available literature on data acquisition approaches and a comparison of the ease of use for each of the modalities.

Along with the popularity of the Internet, people are exposed to more and more ways of micro-videos, and a huge amount of micro-video data has emerged. micro-videos have gradually become the Internet content preferred by the public, and a large number of micro-video apps have also emerged, such as Tiktok and Kwai. Intelligent classification and mining of micro-videos can greatly enhance user experience, improve business operation efficiency and enhance user experience. Through deep intelligent analysis and mining of micro-videos, important information in micro-videos can be extracted to provide an important basis for beautifying videos, content appreciation, video recommendation, content search, etc. In the past, content understanding for short videos often used human work annotation, but in recent years, with the great success of deep convolutional neural networks in image recognition, short video content understanding based on this method has gradually developed. Nowadays, most recognition algorithms extract the feature representation of each frame independently and then fuse them. However, while extracting the feature representation, some low-level semantic features are lost, which makes the algorithm unable to accurately distinguish the category of the video. At present, the algorithm of micro-video recognition based on deep learning has surpassed the iDT algorithm, making these traditional methods fade out of people’s view. In this paper according to the micro-video classification task, a new network model is proposed to concatenate features of each modality into the overall features of various modalities through the network, and then fuse the various modal features with the attention mechanism to obtain the whole micro-video features, which will be used for classification. In order to verify the effectiveness of the algorithm proposed in this paper, experiments are conducted in the public dataset, and it is shown the effectiveness of our model.

With the advent of modern technologies, the healthcare industry is moving towards a more Personalised smart care model. The enablers of such care models are the Internet of Things (IoT) and Artificial Intelligence. These technologies collect and analyse data from persons in care to alert relevant parties if any anomaly is detected in a patient’s regular pattern. However, such reliance on IoT devices to capture continuous data extends the attack surfaces and demands high-security measures. Both patients and devices need to be authenticated to mitigate a large number of attack vectors. The biometric authentication method has been seen as a promising technique in these scenarios. To this end, this paper proposes an AI-based multimodal biometric authentication model for single and group-based users’ device-level authentication that increases protection against the traditional single modal approach. To test the efficacy of the proposed model, a series of AI models are trained and tested using physiological biometric features such as ECG (Electrocardiogram) and PPG (Photoplethysmography) signals from five publicly available datasets from Physionet and Mendeley data repositories. The multimodal fusion authentication model shows promising results with 99.8% accuracy and an Equal Error Rate (EER) of 0.16.

Metabolomic analysis of biological fluids and tissues has become an increasingly routine tool in the biological toolbox. However, challenges remain to be overcome, including developing strategies to maximise coverage of the metabolome without requiring large sample volumes. Here we describe a multimodal strategy that combines data using both LC-MS and GC-MS from a unique vial with a sample of plasma (20µl) or a sample of brain tissue (3mg). Using a split phase extraction the non-aqueous phase was analyzed by reversed phase (RP) LC-MS, whilst the aqueous phase was analyzed using hydrophilic liquid interaction chromatography (HILIC)LC-MS, with both phases also analysed using GC-MS after derivatization of the extract. Analytical performance was assessed in 7 rat cerebellum samples and a pilot study of 40 plasma samples (20 vs. 20: AD vs. healthy controls). The method, which uses four hours of instrument time, measured 20,707 metabolite features in brain samples and 17,266 in plasma samples, from those 44.1% features displayed CV’s below 15% and 75.2% below 30%. The method has potential to resolve subtle biological differences and to correlate metabolite composition directly to clinical outcomes including MMSE, age and ADCS-ADL. This method can acquire in the order of 20K metabolic features when low volumes are available.

Gold nanoclusters (AuNCs) with fluorescence in the Near Infrared (NIR) by both one- and two-photon electronic excitation were incorporated in mesoporous silica nanoparticles (MSNs) using a novel one-pot synthesis procedure where the condensation polymerization of alkoxysilane monomers in the presence of the AuNCs and a surfactant produce hybrid MSNs of 49 nm diameter. This method was further developed to prepare 30 nm diameter nanocomposite particles with simultaneous NIR fluorescence and superparamagnetic properties, with a core composed of superparamagnetic manganese ferrite nanoparticles (MnFe2O4) coated with a thin silica layer, and a shell of mesoporous silica decorated with AuNCs. The nanocomposite particles feature NIR-photoluminescence with 0.6% quantum yield and large Stokes shift (290 nm), and superparamagnetic response at 300 K, with a saturation magnetization of 13.4 emu g-1. The conjugation of NIR photoluminescence and superparamagnetic properties in the biocompatible nanocomposite has high potential for application in multimodal bioimaging.

Acute low back pain (LBP) stands as a leading cause of activity limitation and work absenteeism, and its associated healthcare expenditures are expected to become substantial when acute LBP develops into a chronic and even refractory condition. Therefore, early intervention is crucial to prevent progression to chronic pain whose management is particularly challenging and for which the most effective pharmacological therapy is still controversial. Current guideline treatment recommendations vary and are mostly driven by expertise with opinion differing across different interventions. Thus, it is difficult to formulate evidence-based guidance when relatively few randomized clinical trials did explore the diagnosis and management of LBP while employing different selection criteria, statistical analyses, and outcome measurements. This narrative review aims to provide a critical appraisal of current acute LBP management by discussing the unmet needs and areas of improvement from bench-to-bedside and proposes multimodal analgesia as the way forward to attain an effective and prolonged pain relief and functional recovery in patients with acute LBP.

The incessant evolution of online platforms has ushered in a multitude of shopping modalities. Within the food industry, however, assessing the delectability of meals can only be tentatively determined based on consumer feedback encompassing aspects such as taste, pricing, packaging, service quality, delivery timeliness, hygiene standards, and environmental considerations. Traditional text data mining techniques primarily focus on consumers' emotional traits, disregarding pertinent information pertaining to the online products themselves. In light of these aforementioned issues in current research methodologies, this paper introduces the Bert BiGRU Softmax model combined with multimodal features to enhance the efficacy of sentiment classification in data analysis. Comparative experiments conducted using existing data demonstrate that the accuracy rate of the model employed in this study reaches 90.9%. In comparison to single models or combinations of three models with the highest accuracy rate of 7.7%, the proposed model exhibits superior accuracy and proves highly applicable to online reviews.

Previous studies to recognize negative emotions (e.g. disgust, fear, sadness) for mental health care have used heavy equipment directly attaching electroencephalogram (EEG) electrodes to the head, making it difficult to use in daily life, and they have proposed binary classification methods to determine whether negative emotion or not. To tackle this problem, we propose a negative emotion recognition system to collect multimodal biosignal data such as five EEG signals in an EEG headset and heart rate, galvanic skin response, and skin temperature in a smart band for classifying multiple negative emotions. It consists of android Internet of Things (IoT) application, an oneM2M-compliant IoT server, and a machine learning server. The android IoT application upload the biosignal data to the IoT server. By using the biosignal data stored in the IoT server, the machine learning server recognizes the negative emotions of disgust, fear, and sadness using a multi-class support vector machine (SVM) model with a radial basis function kernel (RBF). The experimental results showed that the multi-class SVM model achieved 93% accuracy when considering all the multimodal biosignal data. Moreover, when considering only data in the smart band, it could achieve 98% accuracy by optimizing the hyper-parameter of the RBF kernel.

This paper proposes a multimodal fusion 3D target detection algorithm based on the attention mechanism to improve the performance of 3D target detection. The algorithm utilizes point cloud data and information from camera. For image feature extraction, the ResNet50+FPN architecture extracts features at four levels. Point cloud feature extraction employs the voxel method and FCN to extract point and voxel features. The fusion of image and point cloud features is achieved through regional point fusion and regional voxel fusion methods. After information fusion, the Coordinate attention mechanism and SimAM attention mechanism extract fusion features at a deep level. The algorithm's performance is evaluated using the DAIR-V2X dataset. The results show that compared to the Part-A2 algorithm, the proposed algorithm improves the mAP value by 7.9% in BEV view and 7.8% in 3D view at IOU=0.5 (cars) and IOU=0.25 (pedestrians and cyclist). At IOU=0.7 (cars) and IOU=0.5 (pedestrians and cyclist), the mAP value of the SECOND algorithm is improved by 5.4% in the BEV view and 4.3% in the 3D view, compared to other comparison algorithms.

Autonomous driving vehicles rely on sensors for the robust perception of surroundings. Such vehicles are equipped with multiple perceptive sensors with a high level of redundancy to ensure safety and reliability in any driving condition. However, multi-sensor, such as camera, LiDAR and radar, systems bring up the requirements related to sensor calibration and synchronization, which are the fundamental blocks of any autonomous system. On the other hand, sensor fusion and integration have become important aspects of autonomous driving research and directly determine the efficiency and accuracy of advanced functions such as object detection and path planning. Classical model-based estimation and data-driven models are two mainstream approaches to achieving such integration. Most recent research is shifting to the latter, showing high robustness in real-world applications but requiring large quantities of data to be collected, synchronized, and properly categorized. To generalize the implementation of the multi-sensor perceptive system, we introduce an end-to-end generic sensor dataset collection framework that includes both hardware deploying solutions and sensor fusion algorithms. The framework prototype integrates a diverse set of sensors, such as cameras, LiDAR, and radar. Furthermore, we present a universal toolbox to calibrate and synchronize three types of sensors based on their characteristics. The framework also includes the fusion algorithms, which utilize the merits of three sensors , namely, camera, LiDAR and radar, and fuse their sensory information in a manner that is helpful for object detection and tracking research. The generality of this framework makes it applicable in any robotic or autonomous applications, also suitable for quick and large-scale practical deployment.

Improved oil recovery from tight carbonate formations may provide the world with a major source of lower-rate power over several decades. Here we provide an overview of the Arab D formation in the largest oil field on earth, the Ghawar. We investigate the occurrence of microporosity of different origins and sizes using scanning electron microscopy (SEM) and pore casting techniques. Then, we present a robust calculation of the probability of invasion and oil saturation distribution in the nested micropores using mercury injection capillary pressure data available in the literature. We show that large portions of the micropores in Arab D formation would have been bypassed during primary drainage unless the invading crude oil ganglia were sufficiently long. Considering the asphaltenic nature of oil in the Ghawar, we expect the invaded portions of the pores to turn mixed-wet, thus becoming inaccessible to waterflooding until further measures are taken to modify the system’s chemistry.

Many engineered approaches have been proposed over the years for solving the hard problem of performing indoor localisation using smartphone sensors. However, specialising these solutions for difficult edge cases remains challenging. Here we propose an end-to-end hybrid multimodal deep neural network localisation system, MM-Loc, relying on zero hand-engineered features, learning them automatically from data instead. This is achieved by using modality-specific neural networks to extract preliminary features from each sensing modality, which are then combined by cross-modality neural structures. We show that our choice of modality-specific neural architectures is capable of estimating the location with good accuracy independently. But for better accuracy, a multimodal neural network fusing the features of early modality-specific representations is a better proposition. Our proposed MM-Loc solution is tested on cross-modality samples characterised by different sampling rates and data representation (inertial sensors, magnetic and WiFi signals), outperforming traditional approaches for location estimation. MM-Loc elegantly trains directly from data unlike conventional indoor positioning systems, which rely on human intuition.

Automatic ice charting can not be achieved using only SAR modalities. It is fundamental to combine information from other remote sensors with different characteristics for more reliable sea ice characterization. In this paper, we employ principal feature analysis (PFA) to select significant information from multimodal remote sensing data. PFA is a simple yet very effective approach that can be applied to several types of data without loss of physical interpretability. Considering that different homogeneous regions require different types of information, we perform the selection patch-wise. Accordingly, by exploiting the spatial information, we increase the robustness and accuracy of PFA.

Multimodal traveling is expected to enhance mobility for users, reduce inequalities of car ownership and reduce emissions. In the same context, ride-sharing aims to minimize negative impacts related to emissions, reduce travelling costs and congestion, and increase passenger vehicle occupancy, and public transit ridership when planned for first/last mile trips. The goal of this study is to present the planning of a multimodal pilot demonstration and the challenges that emerged during and after its implementation in Athens, Greece. The demo aims to enhance the connection of low-density Attica Region areas to public transport (PT) modes, and specifically to the metro, through the provision of demand responsive ride-sharing services. During the demo period two different applications were utilized: the “Travel Companion” app and the “Driver Companion” app, which refer to passengers and drivers of the ride-sharing service. Identification of demo participants is performed through a Stated Preference (SP) experiment. Results of the demo implementation, as well as challenges that were faced show that although participants are willing to try new mobility solutions, the readiness and reliability of the new service are essential attributes towards maintaining existing users and engaging new ones.

Currently the bimatoprost implant (DURYSTA) is approved for a single administration secondary to concern for progressive corneal endothelial cell (CEC) loss with intracameral administration. In order to better understand the cause of CEC loss and other adverse events (AEs) with intracameral administration, multimodal imaging of the implant utilizing optical coherence topography (OCT), robotic ultrasound and bio microscopy video recording was utilized. Inherently the anterior chamber is a non-confined space. In certain examples the implant assumed a round and spotted structure as it picked up iris pigment as it migrated around the anterior chamber. Accordingly, we explored delivery of the implant in the middle segment behind the iris and in front of the pseudophakic lens. We then evaluated the suitability of various imaging modalities to assess the implant in this location. For middle segment administration, the ArcScan Insight 100 robotic ultrasound provided resolution and repeatability sufficient to monitor the implant behind the iris. This preliminary study hypothesizes that DURYSTA migration in the anterior chamber is the main source of AEs. Through use of a confined location, the middle segment, the implant is unlikely to migrate and cause CEC loss while also delivering drug closer to its site of action, the ciliary body. Further efforts are underway to understand the suitability of the middle segment for serial DURYSTA administration to maximize intraocular pressure lowering while minimizing AEs.

Collaborative robots (cobots) have largely replaced conventional industrial robots in today’s workplaces, particularly in manufacturing setups due to their improved performance and intelligent design. In the framework of Industry 5.0, humans are working alongside cobots to accomplish the required level of automation. However, human-robot interaction has brought up concerns regarding human factors (HF) and ergonomics. A human worker may experience cognitive stress as a result of cobots' irresponsive nature in unpredictably occurring situations, which adversely affects productivity. Therefore, there is a necessity to measure stress to enhance a human worker’s performance in a human-robot collaborative environment. In this study, factory workers’ mental workload has been assessed using physiological, behavioural, and subjective measures. Electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) signals have been collected to acquire brain signals and track hemodynamic activity, respectively. The effect of task complexity, cobot’s movement speed, and cobot’s payload capacity on the mental stress of a human worker have been observed, for a task designed in the context of a smart factory. Task complexity and cobot’s speed have proved to be more impactful. As physiological measures are unbiased and more authentic means to estimate stress, eventually, they may replace the other conventional measures if they prove to correlate with the results of traditional ones. Here, regression and artificial neural networks (ANN) have been utilised to determine the correlation between physiological data and subjective and behavioural measures. Regression has performed better for most of the targets and the best correlation (rsq-adj = 0.654146) has been achieved for predicting missed beeps, behavioural measure, using a combination of multiple EEG and fNIRS predictors. The k-nearest neighbours (KNN) algorithm has been used to evaluate the accuracy of correlation between traditional measures and physiological variables, with highest accuracy of 77.8% achieved for missed beeps as the target. Results show that physiological measures can be more insightful and have the tendency to replace other biased parameters.

The Na+/K+ ATPase is a protein involved in the active transport of ions across the cellular membrane. Ouabain is a cardiotonic glycoside that, by inhibiting the Na+/K+ pump, interferes with cell processes mediated directly by the pump, but also indirectly influences other cellular processes, such as cellular cycle and proliferation, growth, cell differentiation, angiogenesis, migration, adhesion and invasion. We used the SK-BR-3 breast cancer cell line, mesenchymal stem cells (MSCs), and tumor-associated fibroblasts (TAFs) in vitro for determining the changes induced by Ouabain in concentration of 10-5 M, 10-6 M, 10-8 M, 10-9 M on these cellular types, employing specific methods: SEM for morphological evaluation; immunocytochemistry, flowcytometry to assess immunophenotypical markers expression, cell cycle and Annexin V/PI assay for cellular proliferation and viability testing; flowchamber assay to evaluate functional adhesion behavior; RT-PCR for Na+/K+ ATPase subunits molecular expression. Being indicative of the pro-apoptotic and inhibitory effect of Ouabain on tumor invasion and metastasis, the results support the addition of Ouabain to the oncological therapeutic arsenal, trailing the “repurposing drugs” approach.

The present study illustrates a brain-computer interface designed and developed to be wearable, portable, and user-friendly. Eight dry electroencephalographic sensors were adopted to acquire the brain activity associated with motor imagery. Multimodal feedback in extended reality was exploited to improve the detection of neurological phenomena. Twenty-seven healthy subjects used the proposed system in five sessions to investigate the effects of feedback on motor imagery. The sample was divided into two equal-sized groups: the "neurofeedback" group, which performed motor imagery while receiving feedback, and the "control" group, which performed motor imagery with no feedback. Several questionnaires were administrated to participants aiming to investigate the usability of the proposed system and individual’s ability to imagine movements. The highest mean classification accuracy across subjects of control group was about 62 % with 3 % associated type A uncertainty, and 69 % with 3 % uncertainty for neurofeedback group. Moreover, in some cases the results were significantly higher for the neurofeedback group. The perceived usability by all participants was high. Overall, the study highlights the advantages and the pitfalls of using a wearable brain-computer interface with dry sensors. Notably, the results and the perceived usability pave the way for the employment of the proposed system in tele-rehabilitation.

In this paper, we present a multimodal dataset for the analysis of classroom atmosphere, based on the behavior and voice of teachers in teaching scenarios. we propose four visual models, three audio models, and one visual-audio dual-modality model to be tested on our dataset. The results indicate that the CH-CC dataset is feasible and reliable and that the visual modality plays a major role in the analysis of this dataset.

The study of paraneoplastic syndromes in humans has a long history, whereas for domestic animals – only since the beginning of the 21^th century. There are various forms of paraneoplastic syndromes; many classifications based on pathogenetic, organ-system principles are described. In accordance with the modern classification, paraneoplastic syndromes are divided into endocrinopathies, hematological paraneoplastic syndromes, gastrointestinal, renal, dermatological, neurological, ophthalmological. The purpose of this study was to develop a scientifically based algorithm for diagnosing ophthalmopathies against the background of paraneoplastic syndrome in dogs, including a multifactorial system of “hormonal-drug treatment” of paraneoplastic ophthalmopathies. The work used a comprehensive methodological approach, including the collection of anamnestic data, clinical examination of the animal, examination of the area of the pathological process, hematological studies, cytomorphological studies, visual diagnostic methods with complete oncological and ophthalmological examinations using the necessary equipment. Treatment for cancer included surgical removal of the tumor, chemotherapy and radiotherapy. The choice of treatment protocol depended on the location of the disease, tumor phenotype (if present) and stage of the malignancy. The only chemotherapy was applied using complex protocols in the treatment of dog lymphomas. Treatment of melanoma in dogs was carried out using an integrated approach which combined methods of surgery, chemotherapy, and radiotherapy. The obtained results can be recommended for use in the diagnosis and treatment of paraneoplastic ophthalmopathies in dogs.

Enhancing traffic safety is one of the fundamental objectives of Intelligent Transport Systems (ITS), and it aligns closely with the principles of sustainable transport. Due to specific differences in infrastructure, vehicles, and users’ behaviour, places where different modes of traffic intersect are recognized as critical points of the traffic system, making them crucial aspects of Sustainable Urban Mobility Plans (SUMPs) implementation. The SUMPs aim to create urban mobility that is not only environmentally friendly and efficient but also safe for all users. The continuous development and widespread adoption of innovative ITS technologies have paved the way for a system that could provide drivers with real-time information about both immediate and potential dangers at these critical points. This paper provides an overview of previous research in the field, investigating the impact of information systems on drivers’ behaviour, various detection and communication solutions that can be effectively integrated into such a system, as well as a brief overview of models and solutions that have been developed to warn drivers in a similar context. The reviewed literature offered valuable insights on which a novel driver information system architecture framework is proposed. This framework can contribute to the ongoing safety improvement in multimodal transport networks within the context of sustainable transport.

The accessibility of public transportation is also known as the last mile problem, and it is one of the main obstacles that affect travelers to choose public transport. Although autonomous vehicles (AVs) have made much progress, they have not been officially put into commercial use. This paper adopts stated preference experiments to explore the impact of shared AVs on train trips’ last-mile travel behavior and takes Wuhan as an example for case analysis. First of all, this paper establishes a structural equation model (SEM) based on the theory of planned behavior to explore the latent psychological variables, including travelers’ attitudes (ATTs), subjective norms (SNs), perceived behavior control (PBC), and behavioral intention to use (BIU) toward AVs. These latent psychological variables are incorporated into the latent class (LC) logit model to establish a hybrid model to study the factors and degree of influence on the travel mode choice for the last mile of train trips. The results show that travelers have preference heterogeneity for the travel mode choice of the last mile of train trips. Through the analysis of LCs, education, career, and income significantly impact the classification of LCs. The latent psychological variables towards AVs have a significant impact on the travel behavior of respondents, but the impacts vary among different segments. Elastic analysis results illustrate that a 1% increase in the travel cost for shared AV in segment 1 leads to a 7.598% decrease in the choice probability of shared AV. Respondents from different segments vary significantly in their willingness to pay, and the value of travel time for high-income groups is relatively higher.

At the end of 2018, a high school student asked a question in Zhihu community, claiming that he had proved Goldbach's conjecture. The problem caused an explosive reaction and a large number of users participated in the discussion. And has caused the widespread influence. On January 1, 2019, the questioner issued his "proof". His proof was soon proved wrong. The heated discussion caused by the incident contains a lot of information of social science analysis value. Therefore, we follow up the event in the first time and build a time series dataset for the event. Taking the questioner's "proof" as the dividing line, all the answers, comments, sub comments and user information of writing these texts before and after two days were recorded. This series of temporal information can reflect the dynamic features of the interaction between user opinions, and the impact of exogenous shocks (proof release) on community opinions. The dataset can be used not only for the demonstration of various social network analysis algorithms, but also for a series of natural language processing tasks such as fine-grained sentiment analysis for long texts, as well as multimodal tasks combining natural language processing and social network analysis. This paper introduces the characteristics and structure of the dataset, shows the visualization effect of social network, and uses the dataset train the benchmark model of emotion analysis.

Introduction: Despite the introduction of increasingly multifaceted diagnostic techniques and the general progress of emergency abdominal and vascular surgery, the outcome of treatment of patients with acute impaired intestinal circulation remains unsatisfactory. The non-invasive and high-resolution technique of optical coherence tomography (OCT) can be used intraoperatively to assess intestine viability and associated conditions that frequently emerge under conditions of impaired blood circulation. This study aims to demonstrate the effectiveness of multimodal (MM) OCT for intraoperative diagnostics of both the microstructure (cross-polarization OCT mode) and microcirculation (OCT angiography mode) of the small intestine wall in patients with acute mesenteric ischemia (AMI). Methods and Participants: A total of 18 patients were enrolled in the study. Nine of them suffered from AMI in segments II-III of the superior mesenteric artery (AMI group), where the ischemic segments of the intestine were examined. Nine others were operated for adenocarcinoma of the colon (control group), thus allowing areas of their normal small intestine to be examined for comparison. Data on the microstructure and microcirculation in the walls of the small intestine were obtained intraoperatively from the side of the serous membrane using the MM OCT system (IAP RAS, Russia) before bowel resection. The MM OCT data were compared with the results of histological examination. Results: The study finds that MM OCT visualized the damage to serosa, muscularis externa, and blood vessels localized in these layers in 100% of AMI cases. It also visualized the submucosa in 33.3% of AMI cases. The MM OCT image of non-ischemic (control group), viable ischemic and necrotic small intestines (AMI group) differed significantly across stratification of the distinguishable layers, the severity of intermuscular fluid accumulations and the type and density of the vasculature. Conclusion: The MM OCT diagnostic procedure optimally meets the requirements of emergency surgery. Data on the microstructure and microcirculation of the intestinal wall can be obtained simultaneously in real time without requiring contrast agent injections. The depth of visualization of the intestinal wall from the side of the serous membrane is sufficient to assess the volume of the affected tissues. However, the methodology for obtaining MM OCT data needs to be improved to minimize the motion artefacts generated in actual clinical conditions.

In response to the issues of sensor noise and accumulated motion errors that lead to low positioning accuracy and insufficient robustness during large maneuvers or continuous flight of small unmanned aerial vehicles (UAVs) in complex environments, this paper proposes a multi-source and multimodal data fusion method. Initially, it employs a multimodal data fusion of various sensors including GPS (Global Positioning System), IMU (Inertial Measurement Unit), and visual sensors to complement the strengths and weaknesses of each hardware component, thereby eliminating motion errors to enhance accuracy. To mitigate the impact of sudden changes in sensor data, the method introduces a digital twin UAV data source. By utilizing the Extended Kalman Filter algorithm, it fuses data from both the real UAV and its digital twin, and the filtered positional information is fed back into the control system of the real UAV. This enables real-time correction of UAV positional deviations caused by sensor noise and environmental disturbances. The multi-source multimodal fusion Kalman filter method proposed in this paper significantly improves the positioning accuracy of UAVs in complex scenarios and the overall stability of the system. This method holds significant value in maintaining high-precision positioning in variable environments and has important practical implications for enhancing UAV navigation and application efficiency.

This conceptual paper explores the potential of integrating Electromagnetic Fields (EMF) with traditional physiological signals to enhance emotional contagion in Human-Robot Interaction (HRI). A focused literature review identifies gaps in current HRI models that rely solely on visual, auditory, and known physiological cues for emotional exchange. A novel framework is proposed, incorporating EMF as a complementary modality, aiming to deepen emotional synchronization between humans and robots. The paper lays groundwork for future research to consider EMF detection as a complementary modality alongside traditional cues. It also addresses technological requirements and discusses potential limitations. By extending the modalities used in emotional contagion, this work seeks to advance the development of more intuitive and empathetic robotic systems.

Background: The use of wearable devices has burgeoned over the past decade, including wearables for infants and young children. Typically, such devices assess a single modality, and few have undergone scientific validation. To address this gap, we developed an infant wearable platform, LittleBeats™, that integrates electrocardiogram (ECG), motion, and audio sensors on a single printed circuit board to permit daylong remote assessments of infants and caregivers in home environments. Objective: Complementing our prior reports focused on LittleBeats™ data collected among infants and children in the home context, our main objective here is to present a technical validation of each sensor modality against established laboratory protocols and gold-standard equipment. Materials and Methods: We conducted five studies, including assessments of (a) interbeat interval (IBI) data obtained from the LittleBeats™ ECG sensor versus the gold-standard BIOPAC among adults (Study 1, N=16) and infants (Study 2, N=5), (b) performance of automated activity recognition (upright vs. walk vs. glide vs. squat ) among adults using accelerometer data obtained from LittleBeats™ versus Google Pixel 1 smartphone (Study 3, N=12), and (c) performance of speech emotion recognition (SER; Study 4, N=8) and automatic speech recognition (ASR; Study 5, N =12) algorithms among adult samples using audio data from LittleBeats™ versus smartphone. Results: Results for IBI data obtained from the LittleBeats™ ECG sensor indicate acceptable mean absolute percent error (MAPE) rates for both the adults (MAPE = 5.29% to 5.97%; Study 1) and infants (MAPE =0.96% to 1.66%; Study 2) across low- and high-challenge sessions, as well as expected patterns of change in respiratory sinus arrythmia (RSA) across sessions. For activity recognition (Study 3), LittleBeats™ data showed good to excellent performance (Accuracy = 89%, F1-score=88%; Cohen’s kappa =.79), although the smartphone outperformed LittleBeats™ by less than 4%. Finally, performance on the SER applied to LittleBeats™ versus smartphone audio data (Study 4) indicated comparable performance, with a matched-pairs test indicating no significant difference in error rates (p=.26). On the ASR task (Study 5), the best performing algorithm yielded relatively low word error rates, although LittleBeats™ (4.16%) versus smartphone (2.73%) error rates are somewhat higher. Discussion: Taken together, results from these controlled laboratory studies conducted predominantly with adults indicate that the LittleBeats™ sensors yield data quality that is largely comparable to those obtained from gold-standard devices and protocols that have been used extensively in prior research. The advantages of the LittleBeats™ platform is the (a) integration of multiple sensors into one platform that was (b) designed specifically for use with infants and young children. Leveraging data from the multiple modalities and fine-tuning postprocessing steps to further increase data quality, combined with assessing data quality among infants and young children in their natural environments, will be key next steps in this research program.

Humans’ performance varies due to the mental resources that are available to successfully pursue a task. To monitor users’ current cognitive resources in naturalistic scenarios, it is essential to not only measure demands induced by the task itself but also consider situational and environmental influences. We conducted a multimodal study with 18 participants (nine female, M = 25.9 with SD = 3.8 years). In this study, we recorded, respiratory, ocular, cardiac, and brain activity using functional near-infrared spectroscopy (fNIRS) while participants performed an adapted version of the warship commander task with concurrent emotional speech distraction. We tested the feasibility of decoding the experienced mental effort with a multimodal machine learning architecture. The architecture comprised feature engineering, model optimisation, and model selection to combine multimodal measurements in a cross-subject classification. Our approach reduces possible overfitting and reliably distinguishes two different levels of mental effort. These findings contribute to the prediction of different states of mental effort and pave the way toward generalised state monitoring across individuals in realistic applications.

Physicians often label anatomical structure sets in Digital Imaging and Communications in Medicine (DICOM) images with nonstandard names. As these names vary widely, the standardization of the nonstandard names in the Organs at Risk (OARs), Planning Target Volumes (PTVs), and 'Other' organs inside the area of interest is a vital problem. Prior works considered traditional machine learning approaches on structure sets with moderate success. This paper presents integrated deep learning methods applied to structure sets by integrating the multimodal data compiled from the radiotherapy centers administered by the US Veterans Health Administration (VHA) and the Department of Radiation Oncology at Virginia Commonwealth University (VCU). The de-identified radiation oncology data collected from VHA and VCU radiotherapy centers have 16,290 prostate structures. Our method integrates the heterogeneous (textual and imaging) multimodal data with Convolutional Neural Network (CNN)-based deep learning approaches like CNN, Visual Geometry Group (VGG) network, and Residual Network (ResNet). Our model presents improved results in prostate (RT) structure name standardization. Evaluation of our methods with macro-averaged F1 Score shows that our deep learning model with single-modal textual data usually performs better than the previous studies. We also experimented with various combinations of multimodal data (masked images, masked dose) besides textual data. The models perform well on the textual data alone, while the addition of imaging data shows that deep neural networks can achieve improved performance using information present in the other modalities. Additionally, using masked images and masked doses along with text leads to an overall performance improvement with the various CNN-based architectures than using all the modalities together. Undersampling the majority class leads to further performance enhancement. The VGG network on the masked image-dose data combined with CNNs on the text data performs the best and establishes the state-of-the-art in this domain.

Abstract: In this comprehensive review, we delve into the significance of the mul-timodal imaging in diagnosing and managing of complications of congenital optic nerve anomalies.. While the Fundus examination is the gold standard tool in diagnosisc of these pathologies, SD OCT and OCTA could shed a light in the pathogenesis, and treatment. Moreover , this review seeks to offer a comprehensive insight into a multimodal approach of these rare congenital pathologies. In conclusion, congenital anomalies of the optic nerve represent a major challenge for ophthalmologists Further research could be clarify the pathophysiology of these diseases and define a correct and specific treatment approach. Keywords: keyword 1; ODC, ODP, MGS, OCT; OCTA, Multimodal imaging.

Estimating Visual Quality of Street Space (VQoSS) is pivotal for urban design, environmental sustainability, civic engagement, etc. Recent advancements, notably in deep learning, have enabled large-scale analysis. However, traditional deep learning approaches are hampered by extensive data annotation requirements and limited adaptability across diverse VQoSS tasks. Multimodal Large Language Models (MLLMs) have recently demonstrated proficiency in various computer vision tasks, positioning them as promising tools for automated VQoSS assessment. In this paper, we pioneer the application of MLLMs to VQoSS change estimation, with our empirical findings affirming their effectiveness. In addition, we introduce Street Quality GPT (SQ-GPT), a model that distills knowledge from the current most powerful but inaccessible (not free) GPT-4, requiring no human efforts. SQ-GPT approaches GPT-4’s performance and is viable for large-scale VQoSS change estimation. In a case study of Nanjin, we showcase the practicality of SQ-GPT and knowledge distillation pipeline. Our work promises to be a valuable asset for future urban studies research.

Currently, skin cancer is the most commonly diagnosed form of cancer in humans and is one of the leading causes of death in patients with cancer. Biopsy methods are an invasive research method and are not always available for primary diagnosis. Imaging methods have low accuracy and depend on the experience of the dermatologist. Artificial intelligence technologies can match and surpass visual analysis methods in accuracy, but they have the risk of a false negative response when a malignant pigmented lesion can be recognized as benign. One possible way to improve accuracy and reduce the risk of false negatives is to analyze heterogeneous data, combine different preprocessing methods, and use modified loss functions to eliminate the negative impact of unbalanced dermatological data. The paper proposes a multimodal neural network system with a modified cross-entropy loss function that is sensitive to unbalanced heterogeneous dermatological data. The accuracy of recognition in 10 diagnostically significant categories for the proposed system was 85.19%. The novelty of the proposed system lies in the use of cross-entropy loss when training the modified function with the help of weight coefficients. The introduction of weighting factors has reduced the number of false negative forecasts, as well as improved accuracy by 1.02-4.03 percentage points compared to the original multimodal systems. The introduction of the proposed multimodal system as an auxiliary diagnostic tool can reduce the consumption of financial and labor resources involved in the medical industry, as well as increase the chance of early detection of skin cancer.

Smart, reliable, and connected multi-modal mobility has been a long-standing goal of transit services. This paper focuses on the smart, seamless, and multi-modal mobility service in the context of “Mobility as a Service” (MaaS). Intelligent mobility is the smarter, greener, and more efficient movement of passengers around the world. Increasingly, mobility is approached as a service. This study first conducts an extensive literature review on mobility behavior and demand pattern of MaaS end-users. It then extends the mechanism of supply chain, MaaS, synergy (i.e., vertical cooperation synergy, horizontal competition synergy), and coopetition to develop the multi-tier closed-loop intelligent mobility service supply chain network. This paper explains the intelligent mobility service supply chain network from following perspectives: (i) mobility service taxonomy of MaaS; (ii) aims of intelligent mobility service supply chain network; (iii) urban rail transit (URT)-centered alternatives for integrated multimodal journey planning, i.e. access + URT + egress, and both access and egress can be served by Mobility-On-Demand (MOD) transport; (iv) node member imperatives. From a synthesis of insights from the ‘during’ journey, this study puts forward the synergetic design of intelligent mobility service supply chain network, including: (i) multi-tier closed-loop structure; (ii) key nodes identification for the physical multimodal transport network in the supply chain; (iii) hybrid synergy mechanisms among the partners, i.e., synergy principle, temporal splitting approach for coopetition synergy; (iv) index systems and evaluation methods for synergy measurement. This study also contributes to the integrated multimodal journey planning. In concluding, the paper highlights the important implications of the proposed intelligent mobility service supply chain network for MaaS bundle design and adverse effects reduction, resulting from 1 + 1 > 2 synergy effects.

The combination of non-steroidal anti-inflammatory drugs (NSAIDs) with non-opioid analgesics is common in clinical practice for the treatment of acute pain conditions like post-operative and post-traumatic pain. Besides that, and despite the very satisfactory results achieved by oral analgesics, parenteral analgesia is a key tool in the treatment of painful conditions when the enteral routes are not convenient. The parenteral ready-to-use fixed-dose combinations of NSAIDs with non-opioid analgesics like paracetamol or metamizole could play a central role in the treatment of painful conditions since they are able to gather into only one formulation the advantages of multimodal and parenteral analgesia. Surprisingly, only very recently a parenteral ready-to-use fixed-dose combination of Ibuprofen/Paracetamol was launched to the market. This review aims to review the current availability of NSAID-based Parenteral Fixed-dose combinations with paracetamol and metamizole in the European and American markets, and how the combination of such drugs could play a central role in a multimodal analgesia strategy. Also, it is explored how the parenteral formulations of NSAIDs, paracetamol, and metamizole could serve as starting elements for the development of new parenteral ready-to-use fixed-dose combinations. With this review, we concluded that, despite the well-recognized utility of combining NSAIDs with non-opioid analgesics, there are in the literature several randomized clinical trial studies unable to demonstrate clear advantages concerning their efficacy and safety. In the future, it is deemed necessary to perform clinical trials specifically designed to assess the efficacy and safety of these fixed-dose formulations to generate solid evidence of their clinical advantages.

Emotional dysfunction, including flat affect and emotional perception deficits, is a specific symptom of schizophrenia disorder. We used a modified multimodal odd-ball paradigm with fearful facial expressions accompanied by congruent and non-congruent sounds to investigate the impairment of emotional perception and reaction to other people's emotions. We analyzed subjective assessments and ERP data for emotionally charging congruent and non-congruent stimuli in patients with schizophrenia and healthy peers. The results showed the deficit of multimodal perception of fearful stimuli in patients with schizophrenia compared to healthy controls. The amplitude of N50 was significantly higher in subjects of the control group for non-congruent stimuli than congruent and did not differ in patients with schizophrenia. The dynamics of P100 and N200 components confirmed the impaired sensory gating in patients with schizophrenia. The lower amplitude of P3a could be associated with deficits in verbal memory and attention, less emotional arousal, or incorrect interpretation of emotional valence as specific features of patients. The difficulties in identifying the incoherence of facial and audial components of emotional expression could be significant in understanding the psychopathology of schizophrenia.

Taste signaling is a complex process that is linked to obesity and its associated metabolic syndromes. The sweet taste is mediated through a heterodimeric G protein coupled receptor (GPRC) in a species-specific manner and at multi-tissue specific levels. The sweet receptor recognizes a large number of ligands with structural and functional diversities to modulate different amplitudes of downstream signaling pathway(s). The human sweet-taste receptor has been extremely difficult to study by biophysical methods due to inadequate methods for producing large homogeneous quantities of the taste-receptor protein and a lack of reliable in vitro assays to precisely measure productive ligand binding modes leading to activity upon their interactions with the receptor protein. We report a multimodal high throughput assays to monitor ligand binding, receptor stability and conformational changes to model the molecular interactions between ligand-receptor. We applied saturation transfer difference nuclear magnetic resonance spectroscopy (STD-NMR) complemented by differential scanning calorimetry (DSC), circular dichroism (CD) spectroscopy, and intrinsic fluorescence spectroscopy (IF) to characterize binding interactions. Our method using complementary NMR and biophysical analysis is advantageous to study the mechanism of ligand binding and signaling processes in other GPCRs.

With the development of the Internet, The content people share contains types of text, images, and videos, and utilizing these multimodal data for sentiment analysis has become an important area of research. Multimodal sentiment analysis aims to understand and perceive emotions or sentiments in different types of data. Currently, the realm of multimodal sentiment analysis faces various challenges, with a major emphasis on addressing two key issues: 1) Inefficiency when modeling the intra-modality and inter-modality dynamics and 2) Inability to effectively fuse multimodal features. In this paper, we proposed the CCDA(Cross-Correlation in Dual-Attention) model, a novel method to explore dynamics between different modalities and fuse multimodal features efficiently. We capture dynamics at intra- and inter-modal levels by using two types of attention mechanisms simultaneously. Meanwhile, the cross-correlation loss is introduced to capture the correlation between attention mechanisms. Moreover, the relevant coefficient is proposed to integrate multimodal features effectively. Extensive experiments were conducted on three publicly available datasets, CMU-MOSI, CMU-MOSEI, and CH-SIMS. The experimental results fully confirm the effectiveness of our proposed method, and compared with the current optimal method (SOTA), our model shows obvious advantages in most of the key metrics, proving its better performance in multimodal sentiment analysis.

BACKGROUND: Head and Neck Sarcomas (HNSs) are rare malignant tumors derived from mesenchymal cells characterized by rapid growth, local aggressive behavior, and multiple re-lapses. The Rhabdomyosarcoma (RMS) and the Osteosarcoma (OS) are the more frequent HNS. The present study aims to evaluate the clinical impact of multimodal treatment in patients diagnosed with HNS. METHODS: A retrospective analysis of medical records from patients diagnosed with HNS multimodal treated, four groups were formed: a) surgery and chemotherapy (CTX); b) surgery, CTX, and RT; c) surgery and RT; d) CTX and RT exclusively. The overall survival (OSS), disease-free survival (DFS) and progression-free survival (PFS) rates were calculated using the Kaplan-Meier test. RESULTS: Among 39 patients, 23.1% were diagnosed with RMS , 66.7% with OS and 10.3% with other subtypes of HNS. Moreover, 59% showed initial clinical staging (T1/T2) and of those 35.9% were T1. Surgery was performed in 87.2% patients, RT in 35.9% and CTX in 84.7%. RT performed showed not statistically significant clinical role regarding OSS (p=0.74), DFS (p=0.09) and PFS (p=0.90) rates independent of histological subtype. Finally, OSS (p=0.89), DFS (p=0.13) and PFS (p=0.50) rates were not statistically different for patients treated with monotherapy or multimodal therapy. CONCLUSION: RT has not showed a clinically important role referred to improve OSS, DFS and PFS rates in patients with HNS, regardless of the histological subtype of the primary tumor. Multimodal treatment could influence in survival rates and locoregional control of the disease; however, longitudinal studies such as randomized clinical trials must be conducted.

Preliminary clinical data suggest pain reduction through fasting in different diagnoses. This uncontrolled observational clinical study examined the effects of prolonged modified fasting on pain and functional parameters in hip and knee osteoarthritis. Patients admitted to the inpatient department of Internal Medicine and Nature-based Therapies of the Immanuel Hospital Berlin between February 2018 and March 2020, answered questionnaires at the beginning and end of inpatient treatment, as well as 3, 6 and 12 months after discharge. Additionally, selected blood and anthropometric parameters were routinely assessed during the inpatient stay. Fasting was performed as part of a multimodal integrative treatment program, with daily caloric intake of <600 kcal for 7.7 ± 1.7 days. N=125 consecutive patients were included. Results revealed an amelioration of overall symptomatology (WOMAC Index score: -14.8±13.31; p<0.001; d=0.78), and pain alleviation (NRS Pain: -2.7±1.98, p<0.001, d=1.48). Pain medication was reduced, stopped, or replaced by herbal remedies in 36% of patients. Improvements were also observed in secondary outcome parameters, including increased quality of life (WHO-5: +4.5±4.94, p<0.001, d=0.94), reduced anxiety (HADS-A: -2.1±2.91, p<0001, d=0.55) and depression (HADS-D: -2.3±3.01, p<0.001, d=0.65), decreases in body weight (-3.6 kg ± 1.65, p< 0.001, d=0.21), and blood pressure (systolic: -6.2±15.93, p<0.001, d= 0.43; diastolic: -3.7±10.55, p<0.001, d=0.43). Results suggest that patients with osteoarthritis of the lower extremities may profit from a prolonged fast embedded in a multimodal integrative treatment regarding quality of life, pain, and disease-specific functional parameters. Confirmatory RCTs are warranted to further investigate these hypotheses.

With the proliferation and development of social media platforms, social media data has become an important source for acquiring spatio-temporal information on various urban events. Providing accurate spatio-temporal information for events contributes to enhancing the capabilities of urban management and emergency response. However, existing research on mining spatio-temporal information of events often focuses solely on textual content, neglecting data from other modalities such as images and videos. Therefore, this study proposes an innovative spatio-temporal information extraction method for multi-modal social media data (MIST-SMMD), which extracts the spatio-temporal information of events from multi-modal data on Weibo at coarse and fine-grained hierarchical levels, serving as a beneficial supplement to existing urban event monitoring methods. This paper takes the "July 20th Zhengzhou Heavy Rainfall" incident as an example, to evaluate and analyze the effectiveness of the proposed method. The results indicate that in the coarse-grained spatial information extraction using only textual data, our method achieves a Spatial Precision of 87.54% within a 60m range, and reaches 100% Spatial Precision for ranges beyond 200m. For fine-grained spatial information extraction, the introduction of other modal data such as images and videos results in a significant improvement in Spatial Error. These results demonstrate the ability of the MIST-SMMD method to extract spatio-temporal information from urban events at both coarse and fine levels, and confirms the significant advantages of multi-modal data in enhancing the precision of spatial information extraction.

Hypoxic-ischemic encephalopathy (HIE) secondary to perinatal asphyxia occurs when the brain does not receive enough oxygen and blood. A surrogate marker for ‘intact survival’ is necessary for the successful management of HIE. The severity of HIE can be classified based on clinical presentation, including presence of seizures, using a clinical classification scale called Sarnat staging; however, Sarnat staging is subjective and the score changes over time. Furthermore, seizures are difficult to detect clinically and are associated with a poor prognosis. Therefore, a tool for continuous monitoring on the cot side is necessary, for example, electroencephalogram (EEG) that non-invasively measures the electrical activity of the brain from the scalp. Then, multimodal brain imaging, when combined with functional near-infrared spectroscopy (fNIRS), can capture the neurovascular coupling (NVC) status. In this study, we first tested the feasibility of a low-cost EEG-fNIRS imaging system to differentiate between normal, hypoxic, and ictal states in a perinatal ovine hypoxia model. Here, the objective was to evaluate a portable cot side device and autoregressive (ARX) modelling to capture the perinatal ovine brain states during a simulated HIE injury. So, ARX parameters were tested with a linear classifier using a single differential channel EEG, with varying states of tissue oxygenation detected using fNIRS, to label simulated HIE states in a perinatal ovine hypoxia model. Then, we showed the technical feasibility of the low-cost EEG-fNIRS device and ARX modeling with support vector machine classification for a human HIE case series with and without sepsis. The classifier trained with the ovine hypoxia data labelled ten severe HIE human cases (with and without sepsis) as “hypoxia” group and the four moderate HIE human cases as the “control” group. Furthermore, we showed the feasibility of experimental modal analysis (EMA) based on the ARX model to investigate the NVC dynamics using EEG-fNIRS joint-imaging data that differentiated six severe HIE human cases without sepsis from four severe HIE human cases with sepsis. In conclusion, our study showed the technical feasibility of EEG-fNIRS imaging, ARX modeling of NVC for HIE classification, and EMA that may provide a biomarker to detect sepsis effects on the NVC in HIE.

Sepsis still remains one of the most difficult conditions to diagnose as it presents unspecific clinical signs and symptoms, which makes early detection crucial. Our study aimed to enhance the accuracy of sepsis diagnosis by integrating multimodal monitoring technologies with traditional diagnostic methods. The research involved 121 newborns, comprising 39 cases of late-onset sepsis, 35 cases of early-onset sepsis, and 47 control subjects. Biosignals including pulse oximetry (PO), near-infrared spectroscopy (NIRS), and skin temperature (ST) were continuously monitored and an algorithm was developed using Python for identifying early signs of sepsis. The model demonstrated the ability to detect sepsis 6 to 48 hours in advance with an accuracy rate of 87.67% ± 7.42%. Sensitivity and specificity were recorded at 76% and 90%, respectively, with NIRS and ST having the most significant impact on predictive accuracy. Despite the promising results, limitations such as sample size, data variability, and potential biases were noted. The findings highlight the critical role of non-invasive biosensing methods in conjunction with traditional biomarkers and cultures, offering a robust framework for early sepsis detection and improved neonatal care. Further studies are recommended to validate these results across diverse clinical settings.

Selective mutism (SM) is an “Anxiety Disorder” characterized by a child’s “persistent inability” to communicate verbally in some (or all) contexts of social life that is associated with other cognitive-affective disorders. Cognitive-behavioural assessment and psychological intervention may be complex to be performed due to both the difficulty to administered standardized neuropsychological batteries (e.g., language-mediated tests) and the difficulty to involve family and teachers in the intervention program, respectively. Here, a single-case study is described in which a female Filipina child with SM underwent a comprehensive neuropsychological assessment and multimodal therapeutical intervention between the ages of 7 to 11 years. More specifically, the psychological intervention included cognitive-behavioral psychotherapy to both improve social-cognitive skills and learning abilities and to reduce anxiety, and speech therapy. Moreover, the parents and teachers were actively involved in the therapeutic process and they were also administered a psycho-education program. After this specific treatment, at the age of 11 years the girl began to verbalize in both therapy and school contexts, although she still was used to adopt non-verbal strategies. A parallel and gradual improvement in communicative-linguistic skills and school learning was also observed. In conclusion, the present report highlights the importance to apply an "integrated and multimodal intervention" to treat SM in children that includes also psycho-education intervention for both parents and teachers.

The synchronization of laser and X-ray sources is essential for time-resolved measurements in the study of ultrafast processes, including photo-induced piezo-effect, shock wave generation, and phase transition. On the one hand, the optical diagnostics (by synchronization of two laser sources) provides information about change in vibration frequencies, shock waves dynamics, linear and nonlinear refractive index behavior. On the other hand, the optical pump – X-ray probe diagnostics give opportunity to directly reveal the lattice dynamics. To integrate two approaches into a unified whole one need to create a robust method for synchronization of two systems with different repetition rate up to MHz range. In this paper, we propose a universal approach utilizing a field-programmable gate array (FPGA) to achieve precise synchronization between different MHz sources such as various lasers and synchrotron X-ray sources. This synchronization method offers numerous advantages, such as high flexibility, fast response, and low jitter. Experimental results demonstrate successful synchronization of two different MHz systems with a temporal resolution of 250 ps for these systems. This enables ultrafast measurements with sub-nanosecond resolution, facilitating the uncovering of complex dynamics in ultrafast processes.

Pedagogic Conversational Agents (PCAs) are interactive systems that engage the student in a dialogue to teach some domain. They can have the role of teacher, student, or companion, and adopt several shapes. In our previous work, a significant increase of students’ performance when learning programming was found when using PCAs in the teacher role. However, it is not common to find PCAs used in the classrooms. In this paper, it is explored whether teachers would accept PCAs to teach programming better if co-designed with them. An experiment with 35 pre-service Primary Education teachers was carried out during the 2021/2022 academic year to co-design a robotic PCA to teach programming. The experience validates the idea that involving the teachers in the design of the PCA facilitates that they integrate this technology in their classrooms. 97% of the pre-service teachers answered in a survey that they believed that the robot PCA could help children to learn programming and 80% answered that they would like to use them in their classrooms.

Introduction Early prediction of long term outcomes in patients resuscitated after cardiac arrest (CA) is still challenging. Guidelines suggested a multimodal approach combining multiple predictors. We evaluated whether the combination of the electroencephalography (EEG) reactivity, somatosensory evoked potentials (SSEPs) cortical complex and Gray to White matter ratio (GWR) on brain computed tomography (CT) at different temperatures could predict survival and good outcome at hospital discharge and after six months. Methods We performed a retrospective cohort study including consecutive adult, non-traumatic patients resuscitated from out-of-hospital CA who remained comatose on admission to our intensive care unit from 2013 to 2017. We acquired SSEPs and EEGs during the treatment at 36°C and after rewarming at 37°C, Gray to white matter ratio (GWR) was calculated on the brain computed tomography scan performed within six hours of the hospital admission. We primarily hypothesized that SSEP was associated with favorable functional outcome at distance and secondarily that SSEP provides independent information from EEG and CT. Outcomes were evaluated using the Cerebral Performance Category (CPC) scale at six months from discharge. Results Of 171 resuscitated patients, 75 were excluded due to missing of data or uninterpretable neurophysiological findings. EEG reactivity at 37 °C has been shown the best single predictor of good outcome (AUC 0.803) while N20P25 was the best single predictor for survival at each time point. (AUC 0.775 at discharge and AUC 0.747 at six months follow up) Predictive value of a model including EEG reactivity, average GWR, and SSEP N20P25 amplitude was superior (AUC 0.841 for survival and 0.920 for good outcome) to any combination of two tests or any single test. Conclusion Our study, in which life-sustaining treatments were never suspended, suggests SSEP cortical complex N20P25, after normothermia ad off sedation, is a reliable predictor for survival at any time. When SSEP cortical complex N20P25 is added into a model with GWR average and EEG reactivity, the predictivity for good outcome and survival at distance is superior than each single test alone.

The paper focuses on the application of a multilevel, integrative and territorial approach to the protection of cultural heritage through planning instruments in Serbia. It points out the problems of the sectoral approach and discusses international recommendations that can be integrated into the planning methodology. The case study is the area of Djerdap National Park, which has an already established international and national importance. The research suggests that the cultural heritage in the area, with the exception of the Roman limes, is still recognized at the level of individual localities. The study emphasizes the importance of aligning all levels of governance to safeguard the whole spatial entity rather than focusing solely on its particular areas. The interna-tional and national importance of the planning area contributes to the strengthening of awareness of heritage and its institutional protection. However, the vitality of the area, which is key to its sustainable development, comes from the local level. Planning documents contribute to the inte-gration of local values and local communities into development programs and projects.

Glycosidic linkage analysis was conducted on the unfractionated polysaccharides in the alcohol-insoluble residues (AIRs) prepared from six red seaweeds (Gracilariopsis sp., Prionitis sp., Mastocarpus papillatus, Callophyllis sp., Mazzaella splendens, and Palmaria palmata) using GC-MS/FID analysis of partially methylated alditol acetates (PMAAs). The cell walls of P. palmata primarily contained mixed-linkage xylans and small amounts of sulfated galactans and cellulose. In contrast, the unfractionated polysaccharides of the other five species were rich in galactans displaying diverse 3,6-anhydro-galactose and galactose linkages with varied sulfation patterns. Different levels of cellulose were also observed. This glycosidic linkage method offers advantages for cellulose analysis over traditional monosaccharide analysis that is known for underrepresenting glucose in crystalline cellulose. Relative linkage compositions calculated from GC-MS and GC-FID measurements showed that anhydro sugar linkages generated more response in the latter detection method. This improved linkage workflow presents a useful tool for studying polysaccharide structural variations across red seaweed species. Furthermore, for the first time, relative linkage compositions from GC-MS and GC-FID measurements, along with normalized FID and total ion current (TIC) chromatograms without peak assignments, were analyzed using principal component analysis (PCA) as a proof-of-concept demonstration of the technique's potential to differentiate various red seaweed species.

Background: Educating college students about the importance of good sleep habits could lead to the adoption of healthier sleep routines, including sufficient sleep duration and sleep quality. The current pre-post study examines the impact of completing a sleep education program called “Sleep 101” on (1) sleep hygiene practices, (2) sleep quality, and (3) weekday and weekend sleep behaviors among college students. “Sleep 101” is an interactive online course developed to educate college students about the importance of sleep by addressing basic sleep physiology, the impact of sleep on mood, academic and physical performance, the interactions between sleep and various substances, and common sleep disorders. Methods: 338 college students were recruited from a midsized public university in the US and invited to participate in “Sleep 101”, of which 25 participants completed the baseline and post-intervention questionnaire. The Sleep Hygiene Index (SHI) was utilized to evaluate sleep hygiene practices, while standard questions were employed to assess weekday and weekend sleep behaviors and overall sleep quality. Results: Those who completed the study demonstrated a significant increase in weekday sleep duration and were less likely to engage in negative prior bedtime activities. In addition, 40% of those who completed baseline and post-intervention assessments noticed improvements in their sleep quality. Conclusion: These findings suggest that a brief online program is beneficial in improving sleep behaviors among college and could be a scalable approach to addressing current sleep issues and preventing future sleep problems in college students.

The profile of secondary metabolites occurring in apple cuticular layer is not only characteristic for particular apple cultivar, but also dynamically reflects various external factors in growing environment. In this study, the possibility to authenticate apple samples based on analysis of their cuticular layer extracts was investigated. Ultra-high-performance liquid chromatography coupled to high resolution tandem mass spectrometry (UHPLC-HRMS/MS) was employed for obtaining metabolomic fingerprints. In total, 274 authentic apple samples, four cultivars harvested within the seasons 2020 to 2022 in the Czech Republic and Poland were analysed. The generated complex data processed by univariate and multivariate statistical methods enabled to build classification models for discrimination of apple cultivars as well as their geographical origin. The models showed very good performance in differentiation of Czech and Polish samples for three of four cultivars: ‘Gala’, ‘Golden Delicious’ and ‘Idared’, moreover, the validity of the models was verified over harvest seasons. The diagnostic markers, besides metabolites of triterpene biosynthetic pathway, mainly represented wax esters. ‘Jonagold’, which is known to be susceptible to mutations, was the only cultivar for which the unambiguous classification of geographical origin was not possible.

Strawberry root rot caused by Neopestalotiopsis clavispora is one of the main diseases of strawberry and significantly impacts the yield and quality of strawberry fruit. There are now no effective control techniques available except for fungicide sprays, which may directly impact consumers. Biological control is becoming an alternative method for the control of plant diseases to replace or decrease the application of traditional synthetic chemical fungicides. Trichoderma is widely used as a biological agent for controlling strawberry root rot. In order to provide resources for screening the highly effective biocontrol fungus for controlling strawberry root rot caused by Neopestalotiopsis clavispora, the biocontrol mechanism,the control effects of Trichoderma asperellum CMT10 against strawberry root rot and growth-promoting effects on strawberry seedlings were investigated by plate culture, microscopy observation and root drenching methods.The results showed that CMT10 had obvious competitive, antibiotic and hyperparasitism effects on Neopestalotiopsis clavispora CMGF3. The CMT10 could quickly occupy nutritional space, and the inhibition rates of CMT10 against CMGF3 in confrontation culture on 7 d was 65.49%. The inhibition rates of volatile metabolite and fermentation metabolite produced by CMT10 against CMGF3 were 79.67% and 69.84%, respectively. The mycelium of strain CMT10 can act as hyperparasites by making contacting, winding and penetrating hyphae of CMGF3. Pot experiment showed that the biocontrol efficacy of CMT10 on strawberry root rot caused by Neopestalotiopsis clavispora was 63.00%. CMT10 had obvious promotion effect on strawberry growth, the plant height, root length, total fresh weight, root fresh weight, stem fresh weight and root dry weight, with the promotion rates were 20.09%, 22.39%, 87.11%, 101.58%, 79.82% and 72.33%, respectively. Overall, this study showed the ability of Trichoderma asperellum CMT10 to control strawberry root rot and their potential to develop as novel biocontrol agents to replace chemical fungicides for eco-friendly, sustainable agriculture.

Apis mellifera, especially weak ones, are highly vulnerable to Carpoglyphus lactis mites, which can rapidly infest and consume stored pollen, leading to weakened colonies and potentially colony collapse. This study aimed to ascertain and investigate the prevalence of this mite in honeybee colonies across 9 provinces in the Republic of Korea (ROK). A total of 615 honeybee colonies were collected, from 66 apiaries during the spring and 58 apiaries during the summer of 2023. A 1,242 bp segment of the the Cytochrome c oxidase subunit 1 (COI) gene was amplified using the polymerase chain reaction method. The detection levels of C. lactis in the honeybees were compared between winter and summer. Based on the COI sequence analysis, the nucleotide sequence similarity of C. lactis mites isolated in the ROK with those from China (NC048990.1) was found to be 99.5%, and with those from the United Kingdom (KY922482.1) was 99.3%. This study is the first report of C. lactis in Korean apiaries. The findings in this study demonstrate a significantly higher detection rate in winter, which is 4.1 times greater than that in summer (p &lt; 0.001). Furthermore, the results underscore the usefulness of molecular diagnostic techniques for detecting C. lactis mites.

COX II containing a dual core CuA active site is one of the three core subunits of mitochondrial Cco, which plays a significant role in the physiological process. In this report, the full-length cDNA of COXⅡ gene was cloned from Sitophilus zeamais, which had an ORF of 684 bp encoding 227 amino acids residues. The predicted COXⅡ protein had a molecular mass of 26.2 kDa with pI value of 6.37, and multiple sequence alignment and phylogenetic analysis indicated that Sitophilus zeamais COXⅡ had high sequence identity 78.51% with the COXⅡ of other insect species, especially similarity to sitophilus oryzae. This gene was subcloned into the prokaryotic expression vector pET-32a, and induced by IPTG in E.coli Transetta (DE3) expression system. Finally the COXⅡ with 6-His tag was purified using affinity chromatography with Ni²⁺-NTA agarose. WB showed the recombinant COXⅡ was about 44 kD, and the concentration of fusion protein was 50μg/mL. UV-spectrophotometer and infrared spectrometer analysis showed that recombinant COXⅡ could catalyze the oxidation of substrate Cytc, and influenced by AITC. It was found that AITC could form a hydrophobic region with COXⅡ protein via molecular docking, besides, a sulfur atom of AITC structure could form a length of 2.9 Å hydrogen bond with Leu-31. These results will provide valuable information for elucidating the role of COXⅡ in Sitophilus zeamais responses to AITC, meanwhile, it will helpful to carry out a point mutation in AITC binding sites for the future research.

The properties of the annual, semiannual and triennial oscillations (AO, SAO and TO) in the middle atmosphere have been investigated using the TIMED/SABER temperature data. The Lomb-Scargle and wavelet spectra were used to determine the dominant oscillations in the background temperature field. The AO is prominent at the mid-latitudes. The AO amplitudes present an asymmetry between the two Hemispheres, being larger in the mesosphere than in the stratosphere. The SAO dominates the tropical regions, with three amplitude maxima at altitudes of 45, 75, and 85 km. The SAOs in the upper mesosphere (75 km) are out of phase with those in the mesopause (85 km) in the tropical regions, which can generate an enhancement of 11 K at each equinox, contributing to the lower mesospheric inversion layer. The TO is significant in the tropical region, with amplitude being maximum at 35, 45 and 85 km. Result shows that there may be potential interaction by the TO with SAO at 85km at the equator. The relation between ENSO and TO has also been discussed. The ENSO signal may modulate the amplitude of the TO, mainly in the lower stratosphere. The real origin of the TO may lie in the wave-mean-flow interaction.

This paper is focused on typical rural settlements in the Stara Planina Mountain area in Serbia. They are distinguished by their authenticity, identity and character, and they have still not been destroyed by inappropriate development as is the case in some other mountain areas in Serbia, where the effects of urbanization, globalization and homogenization are obvious. Consequently, there is a need to prevent these effects in mountain areas where there is a threat of disbalance between development and the inherited natural and cultural values. The paper starts from several important concepts that relate contemporary approaches to cultural heritage preservation, place morphology and planning future development. The concept definitions from recent documents from related fields are used. These concepts are then applied to the area of Stara Planina Mountain and its rural settlements. The necessity for an integrative approach to planning this area with significant natural and anthropogenic potential is pointed out, including its integration into international programs of sustainable development.

The research reported on this paper was aimed at improving the overall efficiency of a PDO certified artisanal cheese production process. Being a PDO certified foodstuff by the EU, it is considered to have properties and qualities determined by the geographical environment in which is made, with its production taking place in a specific and determined geographical location, in this case the Serra da Estrela region. In that sense, the authors conducted a mapping according to a systemic perspective of the processes involved in the context of manufacturing and distribution of certified Serra da Estrela cheese. Numerous methods were used throughout the process, such as a systemic design analysis, and techniques derived from ethnographic methods, which led to the collection of data in the field and consequently provided the immersion of the researcher in genuine work situations. Critical points were identified and emphasized in the systemic map with the purpose of encouraging initiatives to address and overcome the gaps and inefficiencies detected. The systemic design analysis triggered the development of design work. Observations following an ethnographic approach identified ergonomic risks in cheese making during the process of cutting excess chips, fostering the emergence of musculoskeletal disorders at the wrist. A tool that fits best to the task at hand was developed. A prototype of the new tool enabled collecting feedback from use in the work context, in order to inform product development. The domains of agricultural production and microbiology, considering the specific microorganisms developed trough the ripening process of the cheese, turned out to be aspects of high importance for the issue under focus, contributing to a broader understanding of the ripening process and its risks, simultaneously improving the efficiency and success of cheese production. If it were not for the systemic analysis, which served as a link between the boundaries of distinct domains such as the risk of microorganism contamination, ergonomics, energy efficiency, legislation and regulation policies, transportation challenges and economic viability, approached throughout the research. Simultaneously creating bridges between them, the various problems might not have been detected in the first place, as they are usually addressed in specialized disciplines, predetermined by the restrictions of each specific area of knowledge. As a consequence of the development of this research, which was based on an analysis that sought to establish possible connections between various disciplines and tried to constantly maintain a holistic perspective, making new connections and observing the issues from a new angle, apart from the already established methodologies. All this allowed to lay out the seeds for the development of a plan to tackle the critical points identified by the systemic analysis reported in this paper.

Promoting green development has become an important way to optimize the ecological and economic structure and promote sustainable development. The Yangtze River Economic Belt is an important economic corridor in China, and it remains to be examined whether the implementation of environmental regulations has enhanced the green total factor productivity (GTFP) of cities. This paper calculates the green total factor productivity of 107 cities within the Yangtze River Economic Belt by using the super-efficient SBM model and the GML index with Chinese city panel data from 2007-2019 and measures the intensity of environmental regulations through textual analysis. The bidirectional fixed-effects model constructed in this paper suggests an inverted U-shaped relationship between environmental regulation and GTFP, which is confirmed by a series of robustness tests. Green technology innovation and advanced industrial structure play a mechanism role in this. In regions with lower levels of green technology and industrial structure, the inverted U-shaped relationship between environmental regulation and green total factor productivity is more significant. In addition, the phenomenon of GTFP rising and then falling because of environmental regulation is more obvious in cities in the middle and upper reaches of the Yangtze River and outside the urban agglomerations. Therefore, when formulating environmental regulation policies, it is necessary to balance the relationship between economic development and environmental protection and harmonize the environment and economic development of the entire Yangtze River Basin.

The wetlands in northeastern Bangladesh are home to some of the most prolific and valuable ecosystems on the planet, offering a wide range of benefits to both the local and wider communities. A limited number of research on this topic have been carried out in various wetlands in coastal hilsa, but none have been located in the northeastern region of Bangladesh. Thus, the goal of this study was to better understand the most commercially relevant species (anadromous hilsa) in northeastern Bangladesh as well as to assess the wetland ecosystem services more thoroughly with the contribution of their fish genetic resources. In addition to laboratory studies, fieldwork was done in the fishing settlements along the Surma River, Hakaluki Haor, and Tanguar Haor. The study classified 77 fish species into 21 subcategories of ecosystem services, of which 56% were not threatened, 17% were vulnerable, and 10% were highly endangered. The species Hilsa was found to be the most economically significant, accounting for 1% of the GDP overall. The study determined if the hilsa stock of the examined wetlands maintains a single or several subpopulations in comparison to other parts of the country when they migrate from saline water to northeastern Bangladesh (freshwater). But when compared to other groups, the FST score was between 0.000 to 0.017, indicating that the populations are identical and that there is genetic material sharing between them. Additionally, these statistics imply that the Sylhet haor and adjacent river systems contain a single stock of Hilsa fish. Nevertheless, a number of stresses and risks, including overexploitation, illicit and destructive fishing, siltation, and natural disasters like flash floods, have been linked to changes in the supply of hilsa and other ecosystem services. This study also emphasizes the necessity of policy attention and research to address the concerns.

In this paper, we introduce a specialized, fully automated experimental arrangement designed for assessing the effectiveness of augmented and virtual reality technologies in healthcare setting and explore its design principles focusing on depth sensor characterization. The main goal of this project is to establish a robust benchtop platform for the quantitative evaluation of extended reality technologies in a controlled environment, emphasizing the practical assessment of augmented reality head-mounted devices. We outline a design concept and considerations for an experimental configuration aimed at creating a realistic testing environment. This apparatus comprises an observation platform mounted on a three-degree-of-freedom motorized system and a test phantom stage. Focusing on real-case scenarios, we utilized a range of sensors, including readily available range-sensing cameras and commercial augmented reality headsets, such as the Intel RealSense L515 LiDAR camera, mounted on the motion control system. The setup enabled automated data collection and facilitates controlled assessments and validation of various facets of augmented reality technologies, including object, hand, and head tracking, as well as static and dynamic image registration. This paper describes the system architecture, the process of automated data collection, and presents several evaluation studies conducted with this setup, providing insights into the quality and temporal noise associated with static or moving objects or observers in augmented reality applications.

To conduct high-precision and high-resolution numerical simulation of complex flow structures in turbomachinery, a high-order finite volume weighted essentially non-oscillatory (WENO) scheme for the large eddy simulation (LES) is improved and embedded into the three-dimensional viscous unsteady CFD solver NUAA-Turbo. Firstly, the spectral characteristics and unsteady convergence of the improved WENO scheme are studied. Compared with the classical WENO scheme, the improved WENO scheme has better dissipation and dispersion characteristics and faster convergence speed. Then, the coefficient CW of the Wall-Adapting Local Eddy-viscosity (WALE) model is calibrated by decaying homogeneous isotropic turbulence (DHIT) test case. Finally, the scheme is applied to conduct high-precision LES calculations of turbulent boundary layer flow, supersonic compression corner flow, and low-pressure turbine cascade separation flow. The numerical simulation results show that this WENO scheme has excellent shock wave capture ability and turbulence resolution and can capture more flow field details with less mesh size, greatly reducing the computational cost and laying a foundation for large-scale engineering application of LES.

To secure logic circuits against the illegal copying the insertion of the so-called key bit inputs using XOR/XNOR gates has been proposed in . The inserted gates modify (lock) the behavior of the original circuit and only the correct choice of the secret key bits guarantees the equivalent behaviour of the locked circuit to the original circuit. To break this kind of security, i.e. to find the secret key bits, there was a SAT solver based attack proposed in . The aim of this work is to experimentally verify this attack on several locked circuits with various number of primary inputs and outputs and with various number of gates. Except for the random placement of the key gates we evaluate also the positioning with chaining elimination. The obtained and presented results show that we were able to unlock 10 of 11 circuits within few minutes on a common PC.

Intermetallic compounds are increasingly being expected to utilize in tribological environments, but to date the works are hindered by insufficient ductility at low and medium temperature. This paper presents a novel multiphase intermetallic alloy with the chemical composition of Mo-40Ni-13Si (at.%). Microstructure characterization reveals that a certain amount of ductile Mo phases formed during the solidification process of ternary Mo-Ni-Si alloy melt, which is undoubtedly beneficial to the ductility improvement of intermetallic alloy. Tribological properties of the designed alloy, including wear resistance, friction coefficient and metallic tribological compatibility, were evaluated under dry sliding wear test conditions at room temperature. Results suggested that the multiphase alloy possesses an excellent property for room-temperature wear applications, which is attributed to the unique microstructural features and thereby good combination in hardness and ductility. The corresponding wear mechanism is also reported by observing the worn surface, subsurface and wear debris of alloy, which to be found is soft abrasive wear.

With the integrated development of the Internet, wireless sensor technology, cloud computing, and mobile Internet, there has been a lot of attention given to research about and applications of the Internet of Things. A Wireless Sensor Network (WSN) is one of the important information technologies in the Internet of Things; it integrates multi-technology to detect and gather information in a network environment by mutual cooperation, using a variety of methods to process and analyze data, implement awareness, and perform tests. This paper mainly researches the localization algorithm of sensor nodes in a wireless sensor network. Firstly, a multi-granularity region partition is proposed to divide the location region. In the range-based method, the RSSI (Received Signal Strength indicator, RSSI) is used to estimate distance. The optimal RSSI value is computed by the Gaussian fitting method. Furthermore, a Voronoi diagram is characterized by the use of dividing region. Rach anchor node is regarded as the center of each region; the whole position region is divided into several regions and the sub-region of neighboring nodes is combined into triangles while the unknown node is locked in the ultimate area. Secondly, the multi-granularity regional division and Lagrange multiplier method are used to calculate the final coordinates. Because nodes are influenced by many factors in the practical application, two kinds of positioning methods are designed: the unknown node is in the positioning unit or not. When the unknown node is on the side of the positioning unit, we use the method of vector similarity. Moreover, we use the centroid algorithm to calculate the ultimate coordinates of unknown node. When the unknown node is not on the side of the positioning unit, we establish a Lagrange equation containing the constraint condition to calculate the first coordinates. Furthermore, we use the Taylor expansion formula to correct the coordinates of the unknown node. In addition, this localization method has been validated by establishing the real environment.

The electroencephalogram (EEG) is a record of brain activity. Brain Computer Interface (BCI) technology formed by the EEG signal has become one of the hotspots at present. How to extract the feature signal of EEG is the most basic research of BCI technology. In this paper, A new method of recognizing fatigue, conscious, concentrated state of human brain is proposed by the combination of discrete wavelet transform and the neural network based on EEG signal. First of all, the law signal is preprocessed by the wavelet denoising method because the law EEG signal contains a large number of high frequency noise, which is decomposed into multi-layer high frequency signal and low frequency signal. thus, δ wave, θ wave, α wave, β wave are obtained by the wavelet transform. And then, frequency band energy of the different wave is regards as the feature signal of EEG. In the experiment, the feature signal is classified by radial basic function (RBF) and annealed chaotic competitive learning network (ACCLN). RBF and ACCLN networks are trained with 500 sets of sample data and are tested by 100 sets of samples in different mental states. The experimental results show that the average accuracy of RBF network under three conditions are 88.75%, 88.25%, 88.5%, respectively, and the correct rate of ACCLN network is 97%, 98%, 98%, respectively.

Early discharge after childbirth has led to a rise in neonatal readmission, becoming a major concern in recent decades. Our research aimed to identify the risk factors and incidence of neonatal readmission, as well as explore preventive measures. Our study at the Clinical Hospital of Pediatrics in Ploiești, Romania included 108 neonates admitted during the neonatal period. This accounted for 2.06% of all admissions (5226). The most prevalent cases were malnutrition (25%), fever (20.3%) and bronchiolitis (17.5%). Diarrhea and infectious gastroenteritis were also observed (14.8%), along with acute rhinoconjunctivitis (9.2%) and late onset sepsis (3.7%). No deaths were recorded. The most significant characteristics identified were number of children (p&lt;0.001) and age at maternity discharge (p&lt;0.001). By following the prevention rules, malnutrition, feeding errors, and infections can be avoided. This includes practicing proper hand hygiene for both mothers and medical staff, as well as educating and demonstrating to mothers the benefits of breastfeeding. In addition, all newborns discharged from the maternity ward should benefit from follow-up at 7-10 days of life. Our results confirm the effectiveness of a multidisciplinary team and endorse promoting breastfeeding. Implementing quality control measures and regularly evaluating the surveillance program will help improve its effectiveness.

Wearable technology has been proposed as a potential tool to change the way of human life, such as the smart bracelet and the Google Glass. In the wearable technology, the inertial sensor has great significance in tracking the object movements. The paper focused on detecting the movements of user’s finger based on the inertial sensor to give the control signals. Firstly, the attitude matrix, which represented the transformation relation of carrier coordinate system and the navigation coordinate system, was obtained. Secondly, the attitude matrix was expressed based on the quaternions. Thirdly, the finger gesture was processed by the attitude matrix to get the attitude angle. Finally, the robot was controlled by attitude angle to make the moving action. The experimental results showed the detection of the finger movement is effective.

Two interesting compounds such as quaternary ammonium lignin(QAL) and 2-ethylhexyl phosphoric acid mono-2-ethylhexyl ester (P507) were synthesized as ionic liquids(QP-ILs) for the extraction of metal ions. The extraction behavior of Co(II) and Ni(II) from chloride solution was compared between QP-ILs and P507. The results showed that the extraction rates of Co(II) and Ni(II) in the two solutions varied with the extraction conditions, but QP-ILs has stronger extractability for cobalt than P507, while Ni is on the contrary. Under the same conditions, the Co/Ni separation performance(βCo/Ni) in QP-ILs is superior to that in p507. At pH4.0, 55℃, concentration of 20%, extraction time of 10 minutes, the βCo/Ni of QP-ILs reached to 2703, while that of P507 was only 164. In conclusion, QP-ILs was more efficient than P507 for separating Co from mixed solutions.

Brain aging causes a wide variety of changes at molecular and cellular levels, leading to the decline of cognitive functions and increased vulnerability to neurodegenerative disorders. The research aimed at understanding the aging of the brain has made much progress in recent decades. Technological innovations such as single-cell RNA-sequencing (scRNA-seq), proteomic analyses, and spatial transcriptomic analyses have facilitated the research on the dynamic changes occurring within neurons, glia, and other cells along with their impacts on intercellular communication during aging. In this review, we introduce recent trends of how neurons and glia change during aging and discuss the impact of the brain microenvironment such as the blood-brain barrier (BBB).

In this paper, we study the semilinear pseudo-parabolic equations $\displaystyle u_{t} - \triangle_{\mathbb{B}}u - \triangle_{\mathbb{B}}u_{t} = \left|u\right|^{p-1}u$ on a manifold with conical singularity, where $\triangle _{\mathbb{B}}$ is Fuchsian type Laplace operator investigated with totally characteristic degeneracy on the boundary $x_{1} = 0$. Firstly, we discuss the invariant sets and the vacuum isolating behavior of solutions with the help of a family of potential wells. Then, we derive a threshold result of existence and nonexistence of global weak solution: for the low initial energy $J(u_{0})<d$, the solution is global in time with $I(u_{0}) >0$ or $\displaystyle\Vert \nabla_{\mathbb{B}}u_{0}\Vert_{L_{2}^{\frac{n}{2}}(\mathbb{B})} = 0$ and blows up in finite time with $I(u_{0}) < 0$; for the critical initial energy $J(u_{0}) = d$, the solution is global in time with $I(u_{0}) \geq0$ and blows up in finite time with $I(u_{0}) < 0$. The decay estimate of the energy functional for the global solution and the estimates of the lifespan of local solution are also given.

Moso bamboo is famous for fast growing and biomass accumulation, as well as high annual output for timber and bamboo shoots. These high outputs require high nutrient inputs to maintain and improve stand productivity. Soil nitrogen (N), phosphorus (P) and potassium (K) are important micronutrients for plant growth and productivity. Due to high variability of soils, analysing spatial patterns of soil N, P and K stocks is necessary for scientific nutrient management in Moso bamboo forests. In this study, soils were sampled from 138 locations across Yong’an City and ordinary kriging was applied for spatial interpolation of soil N, P and K stocks. Soil N stock showed a strong spatial dependence while soil N and P stocks presented a moderate spatial dependence, indicating soil N was mainly controlled by intrinsic factors while soil N and P stocks were controlled by both intrinsic and extrinsic factors. Different spatial patterns were observed for soil N, P and K stocks across the whole study area, indicating that fertilizations with different ratios of N:P:K should be applied for different sites to maintain and improve stand productivity. The total soil N, P and K stocks within 0-60 cm were 0.624, 0.020 and 0.583 Tg, respectively.

With the increasing concern of environment, the energy-efficiency scheduling of manufacturing industry is becoming urgent and popular. In turning processes, both spindle speed and processing time can affect the final energy consumption and thus the spindle speed and scheduling scheme need to be optimized simultaneously. Since the turning workshop can be regarded as the flexible flow shop, this paper formulates a mixed integer linear programming model for energy-efficient scheduling of flexible flow shop. Accordingly, a new decoding method is developed by considering of the optimization of spindle speed and scheduling scheme simultaneously, and an estimation of distribution algorithm adopting the new decoding method is proposed to solve large-size problems. The parameters of this algorithm are determined by statistical technique with a simplified practical case. In order to validate the proposed method, a case from practical factories is studied, in which the makespan can be shortened by 25.22%, and the consumed energy can be saved by 5.48%. These results demonstrate the effectiveness of the proposed mathematical model and algorithm.

Multigranulation is a new approach to the Rough Set Theory, where several separability relationships are used to obtain different granulations of the universe. The Multigranulation starts from the existence of different contexts or subsets of features to characterize the objects of the universe. In this paper, a method for the generation of contexts from the construction of similarity relations is proposed.The proposed solution was evaluated in an international database using the KNN classifier. It was also applied in the solution of a real problem in Civil Engineering specifically in Traffic Engineering, the contexts generated from the proposal used to determine the features of higher incidence in the service level of the road. The results achieved both in the international database and in the proposed application demonstrate the applicability of the proposed method.

Lignocellulosic biomass, an abundant and renewable resource, serves as a crucial raw material for the production of biofuels, biochemicals, and various value-added products. This paper aims to develop and optimize a mild alkaline treatment of sawdust assisted by ultrasound, along with enzymatic hydrolysis of the pretreated material. The sonochemical pretreatment with alkali emerged as the optimal approach to enhance the susceptibility of cellulose to subsequent enzymatic hydrolysis, thereby increasing the yield of reducing sugars. A comparative study was performed using various ultrasonic applicators (horn and bath) and conventional assisted alkaline pretreatment. The ultrasonic assisted pretreatment revealed a higher delignification as 68% (horn) and 57% (bath) comparing with conventional pretreatment. Processes were optimized using a statistical analysis based on a 23 factorial design. The ratio between sawdust and alkanine solution (RSL = 0.5–1.5 g/100 mL), US amplitude (A = 20–60%), and working temperature (t = 30–50 °C) were selected as process factors. The optimal operating conditions to maximize the reducing sugar yield (138.15 mg GE /gsubstrate) were found as following: solid/liquid ratio RSL,opt = 1.25 g/100 mL, US amplitude Aopt = 60%, and and pretreatment temperature topt = 50 °C. The overall outcomes clearly confirmed the intensification of delignification by ultrasound assisted alkaline pretreatment

At 12:28 UTC (8:28 PM, local time) on 15 January 2023, a shallow, moderate earthquake with a magnitude (Mw) of 4.7 and a depth of one (1) kilometer shook the northern part of Leyte Island in the central part of the Philippines. The ground shaking was felt at PHIVOLCS Earthquake Intensity Scale (PEIS) VI, (very strong) equivalent to Modified Mercalli Intensity (MMI) VI in areas along the strike of the Leyte segment of the Philippine Fault. Even though this earthquake is classified as moderate in size, significant geologic, structural, and socio-economic impacts were documented. Most of the earthquake impacts that include surface rupture, liquefaction, and mass movements are limited near the epicentral area. The earthquake produced an 8-km-long surface rupture, the first documented rupture generated by a magnitude &lt;6 along the Philippine Fault, and is unusual in other surface rupturing earthquakes worldwide. It injured 18 persons and damaged 434 residential buildings and 26 public infrastructures which amounts to about 500 thousand US dollars. Structural damages were caused by surface rupture and/or poor engineering construction practices. Analysis of the seismic waveform and recorded peak ground acceleration (PGA) suggests that the subsurface geology influenced the ground motion amplification in an area near the epicenter. Based on the hypocenter, focal mechanism solution, aftershock distribution, and actual field observation, the causative fault for this event is the northern end of the Philippine Fault – Leyte segment. Moderate in size, this earthquake emphasizes the need and importance of documenting moderate-sized earthquakes as a tool and guide for medium and long-term earthquake risk assessment and resiliency.