Multimodal remote sensing data classification can enhance the model’s ability to distinguish land features through multimodal data fusion. In this context, how to help models understand the relationship between multimodal data and target tasks is the focus of researchers. Inspired by human feedback learning mechanisms, causal reasoning mechanisms, and knowledge induction mechanisms, this paper integrates causal learning, reinforcement learning, and meta learning into a unified remote sensing data classification framework and proposed the causal meta-reinforcement learning (CMRL). First, based on feedback learning mechanisms, we have overcome the limitations of traditional implicit optimization of fusion features and customized a reinforcement learning environment for multimodal remote sensing data classification tasks. Through feedback interactive learning between agents and the environment, we help them understand the complex relationships between multimodal data and labels, thereby achieving full mining of multimodal complementary information. Second, based on the causal inference mechanism we designed causal distribution prediction action, classification reward, and causal intervention reward, capturing pure causal factors in multimodal data and cutting off false statistical associations between non-causal factors and class labels. Finally, based on the knowledge induction mechanism, we designed a bi-layer optimization mechanism based on meta-learning. By constructing a meta training task and meta validation task simulation model in the generalization scenario of unseen data, we helped the model induce cross-task shared knowledge, thereby improving its generalization ability for unseen multimodal data. The experimental results on multiple sets of multimodal datasets show that the proposed method achieved state-of-the-art performance in multimodal remote sensing data classification tasks.

The objectives of the study were to determine the spatial rate of CO₂ flux (Net Ecosystem Exchange) and soil moisture in a wetland ecosystem applying Sentinel-1 IW (Interferometric Wide) data of VH (Vertical Transmit/Horizontal Receive—cross polarization) and VV (Vertical Transmit/Vertical Receive—like polarization) polarization. In-situ measurements of carbon flux, soil moisture, and LAI (Leaf Area Index) were carried out over the Biebrza Wetland in north-eastern Poland. The impact of soil moisture and LAI on backscattering coefficient (σ°) calculated from Sentinel-1 data showed that LAI dominates the influence on σ° when soil moisture is low. The models for soil moisture have been derived for wetland vegetation habitat types applying VH polarization (R² = 0.70 to 0.76). The vegetation habitats: reeds, sedge-moss, sedges, grass-herbs, and grass were classified using combined one Landsat 8 OLI (Operational Land Imager) and three TerraSAR-X (TSX) ScanSAR VV data. The model for the assessment of Net Ecosystem Exchange (NEE) has been developed based on the assumption that soil moisture and biomass represented by LAI have an influence on it. The σ° VH and σ° VV describe soil moisture and LAI, and have been the input to the NEE model. The model, created for classified habitats, is as follows: NEE = f (σ° Sentinel-1 VH, σ° Sentinel-1 VV). Reasonably good predictions of NEE have been achieved for classified habitats (R² = 0.51 to 0.58). The developed model has been used for mapping spatial and temporal distribution of NEE over Biebrza wetland habitat types. Eventually, emissions of CO₂ to the atmosphere (NEE positive) has been noted when soil moisture (SM) and biomass were low. This study demonstrates the importance of the capability of Sentinel-1 microwave data to calculate soil moisture and estimate NEE with all-weather acquisition conditions, offering an important advantage for frequent wetlands monitoring.

Plant leaf area index (LAI) is a key characteristic affecting field canopy microclimate. In addition to traditional professional measuring instruments, smartphone camera sensors have been used to measure plant LAI. However, when smartphone methods were used to measure conifer forest LAI, very different performances were obtained depending on whether the smartphone was held at the zenith angle or at a 57.5° angle. To validate further the potential of smartphone sensors for measuring conifer LAI and to find the limits of this method, this paper reports the results of a comparison of two smartphone methods with an LAI-2000 instrument. It is shown that both methods can be used to reveal the conifer leaf-growing trajectory. However, the method with the phone oriented vertically upwards always produced better consistency in magnitude with LAI-2000. The bias of the LAI between the smartphone method and the LAI-2000 instrument was explained with regard to four aspects that can affect LAI: gap fraction, leaf projection ratio, sensor field of view (FOV), and viewing zenith angle (VZA). It was concluded that large FOV and large VZA cause the 57.5° method to overestimate the gap fraction and hence underestimate conifer LAI, especially when tree height is greater than 2.0 m. For the vertically upward method, the bias caused by the overestimated gap fraction is compensated for by an underestimated leaf projection ratio.

Dynamic optical structural color is always desired in various display applications and usually involves active materials. Full-color generation, especially bi-directional full-color generation in both reflective and transmissive modes, without any active materials included has been rarely investigated. Herein, we demonstrate a scheme of bi-directional full-color generation based on a plasmonic metasurface modulated by rotation of the polarization angle of the incident light without varying the geometry and the optical properties of the materials and the environment where the metasurface resides. The metasurface unit cell consists of plasmonic modules aligning in three directions and is patterned in a square array. The metasurface structural color device generates full colors in both reflection and transmission. Based on the proposed polarization-dependent structural color, information encoding of three multiplexed animal images and quick-responsive (QR) codes is demonstrated to verify the efficient information encoding and decoding of the proposed scheme. The animals can be seen under different polarization incidence and the QR codes can be successfully decoded by the polarization rotation in transmission. The proposed bi-directional full-color generation metasurface has great potential in applications such as kaleidoscope generation, anti-counterfeiting, dynamic color display, and optical information encoding.

Image stitching is a crucial aspect of image processing. However, factors like perspective and environment often lead to irregular shapes in stitched images. Cropping or completion methods typically result in substantial loss of information. This paper proposes a method for rectifying irregularly images into rectangles using deformable meshes and residual networks. The method utilizes a convolutional neural network to quantify rigid structures of images. Choosing the most suitable mesh structure based on the extraction results, offering options such as triangular, rectangular, and hexagonal. Subsequently, the irregularly image, predefined mesh structure, and predicted mesh structure are input into a wide residual neural network for regression. The loss function comprises local and global, aimed at minimizing the loss of image information within the mesh and global target. This method not only significantly reduces information loss during rectification but also adapting to different images with various rigid structures. Validation on the DIR-D dataset shows this method outperforms state-of-the-art methods in image rectification.

Surface water distribution extracted from remote sensing data has been used in water resource assessment, coastal management, and environmental change studies. Traditional manual methods for extracting water bodies cannot satisfy the requirements for mass processing of remote sensing data; therefore, accurate automated extraction of such water bodies has remained a challenge. The histogram bimodal method (HBM) is a frequently used objective tool for threshold selection in image segmentation. The threshold is determined by seeking twin peaks, and the valley values between them; however, automatically calculating the threshold is difficult because complex surfaces and image noise which lead to not perfect twin peaks (single or multiple peaks). We developed an operational automated water extraction method, the modified histogram bimodal method (MHBM). The MHBM defines the threshold range of water extraction through mass static data; therefore, it does not require the identification of twin histogram peaks. It then seeks the minimum values in the threshold range to achieve automated threshold. We calibrated the MHBM for many lakes in China using Landsat 8 Operational Land Imager (OLI) images, for which the relative error (RE) and squared correlation coefficient (R2) for threshold accuracy were found to be 2.1% and 0.96, respectively. The RE and root-mean-square error (RMSE) for the area accuracy of MHBM were 0.59% and 7.4 km2. The results show that the MHBM could easily be applied to mass time-series remote sensing data to calculate water thresholds within water index images and successfully extract the spatial distribution of large water bodies automatically.

As a vital component of the terrestrial ecosystem, grassland accounts for one-third of the global vegetation system. Grassland degradation has been exacerbated due to extreme overgrazing in China's Inner Mongolia Autonomous Region (IMAR). While conservation was carried out as the Ecological Subsidy and Award Program (ESAP) to mitigate grassland degradation, little is known about its effectiveness in improving the biophysical conditions of grassland. This paper integrates the conceptual frameworks of total socio-environmental systems to assess how ecological systems respond to ESAP, investigate spatial heterogeneity of ESAP, and explore the meddling effects of socio-environmental interactions on ESAP. We integrate ecological, climate, and socioeconomic data and developed several hierarchical linear mixed models (HLMM) to investigate how these factors interact with ESAP in IMAR. Our findings prove that the above-ground biomass between 2011 and 2015 responds significantly to variations in socioeconomic conditions and ecological communities. Available land resources, hospital and medical facilities, and net farmer and herdsman income are the most critical factors contributing to grassland productivity. Primary industries like mining, total consumer retail value, farming, forestry, animal husbandry, fishery productions, and GDP are the most damaging factors affecting biomass. Our study recommends a regionally or locally tailored ecological recovery policy, instead of a generalized one, in the future effort to conserve grassland.

Automatic ice charting can not be achieved using only SAR modalities. It is fundamental to combine information from other remote sensors with different characteristics for more reliable sea ice characterization. In this paper, we employ principal feature analysis (PFA) to select significant information from multimodal remote sensing data. PFA is a simple yet very effective approach that can be applied to several types of data without loss of physical interpretability. Considering that different homogeneous regions require different types of information, we perform the selection patch-wise. Accordingly, by exploiting the spatial information, we increase the robustness and accuracy of PFA.

Timely and accurate acquisition of information on distribution of the crop planting structure in Loess Plateau of eastern Gansu Province, one of the most important agricultural areas in western China, is crucial for promoting fine management of agriculture and ensuring food security. In this study, the Object-Based Image Classification (OBIC), the Random Forest (RF) and Convolutional Neural Network (CNN) models were employed to classify the crop planting structure of four representative test areas in Qingyang City in a precise manner. Firstly, different optimal segmentation scales for various crops were selected using the Estimation of Scale Parameter 2 (ESP2) tool and the Ratio of Mean Difference to Neighbors(ABS) to Standard Deviation (RMAS)model. The images were then segmented through multiresolution segmentation combined with the Canny Edge Detection algorithm. Secondly, the L1 regularized logistic regression model was utilized to select and optimize 39 spatial feature factors including spectral, textural, geometric, and index features, in conjunction with phenological factors. Lastly, under the multi-level classification framework, the Random Forest (RF) classifier and Convolutional Neural Network (CNN) model, combined with object-based multiresolution segmentation, was used to classify the crop planting structure. The findings show that: Thanks to the Canny Edge Detection algorithm, we can obtain a more complete boundary of the segmented objects and improve the separability. The optimal segmentation scales for corn, vegetables, and buckwheat were found to be 55, 70, and 35, respectively, while wheat and apple had optimal segmentation scales of 65. In addition to phenological characteristics, the number of selected spatial features for corn, vegetables, buckwheat, wheat, and apple were 9, 7, 16, 12, and 10, respectively. The CNN model demonstrated high consistency with the RF model in the classification results, but the accuracy of RF model is higher than that of CNN model on the whole. The overall accuracy of classification using RF model in four test areas registered 91.93%, 94.92%, 89.37% and 90.68%, respectively. This paper introduced crop phenological factors, effectively improving the extraction precision of shattered agricultural planting structure in the Loess Plateau of eastern Gansu Province. Its findings have important application value in crop monitoring, management, food security and other related fields.

For multi-sensor integrated systems, such as a mobile mapping system (MMS), data fusion at sensor-level, i.e., the 2D-3D registration between optical camera and LiDAR, is a prerequisite for higher level fusion and further applications. This paper proposes a line-based registration method for panoramic images and LiDAR point cloud collected by a MMS. We first introduce the system configuration and specification, including the coordinate systems of the MMS, the 3D LiDAR scanners, and the two panoramic camera models. We then establish the line-based transformation model for panoramic camera. Finally, the proposed registration method is evaluated for two types of camera models by visual inspection and quantitative comparison. The results demonstrate that the line-based registration method can significantly improve the alignment of the panoramic image and LiDAR datasets under either the ideal spherical or the rigorous panoramic camera model, though the latter is more reliable.

Spatial and temporal variation of the free electron concentration in the ionosphere affects SAR interferograms, in particular at low radar frequencies. In this work the identification, estimation and compensation of ionospheric path delay phases in PALSAR-3 and NISAR-L interferograms is discussed. Both these L-band sensors acquire simultaneously SAR data in a main spectral band and in an additional, spectrally separated, narrower second band to support the mitigation of ionospheric path delays. The methods presented permit separating the dispersive and the non-dispersive phase terms based on the double-difference interferogram between the two available spectral bands and the differential interferogram of the main band. The applicability of the proposed methods is demonstrated using PALSAR-3-like data that was simulated based on PALSAR-2 SM1 mode data.

：Non-Euclidean data, such as social networks, and citation relationships between documents, has node information and structural information. Graph Convolutional Network(GCN) can automatically learn node features and association information between nodes. The core ideology of the graph convolutional network is to aggregate node information by using edge information, thereby generating a new node feature. In the process of updating node features, there are two core influencing factors. One is the number of neighboring nodes of the central node, the other is the contribution of the neighboring nodes to the central node. Due to the previous GCN methods not simultaneously considering the numbers and different contributions of neighboring nodes to the central node, we design the Adaptive Attention Mechanism(AAM). To further enhance the representational capability of the model, we utilize Multi-Head Graph Convolution(MHGC). Finally, we adopt cross-entropy(CE) loss function to describe the difference between the predicted results of node categories and the ground truth (GT). Combined with backpropagation, this ultimately achieves accurate node classification. Based on AAM, MHGC and CE, we contrive the novel Graph Adaptive Attention Network (GAAN). Experiments show that the classification accuracy has achieved outstanding performances on Cora, Citeseer and Pubmed datasets.

The existing segmentation-based scene text detection methods mostly need complicated post-processing, and the post-processing operation is separated from the training process, which greatly reduces the detection performance. The previous method, DBNet successfully simplified post-processing and integrated the post-processing into a segmentation network. However, the training process of the model took a long time for 1200 epochs and the sensitivity to texts of various scales was lacking, leading to some text instances being missed. Considering the above two problems, we design the text detection Network with Binarization of Hyperbolic Tangent(HTBNet). First of all, we propose Binarization of Hyperbolic Tangent (HTB), optimized along with which, the segmentation network can expedite the initial convergent speed by reducing the amount of epochs from 1200 to 600. Because features of different channels in the same scale feature map focus on the information of different regions in the image, to better represent the important features of all objects in the image, we devise the Multi-Scale Channel Attention(MSCA). Meanwhile considering that multi-scale objects in the image cannot be simultaneously detected, we propose a novel module named Fused Module with Channel and Spatial(FMCS), which can fuse the multi-scale feature maps from channel and spatial dimension. Finally we adopt cross entropy as the loss function, which measures the difference between predicted values and ground truths. The experimental results show that HTBNet compared with lightweight models has achieved competitive performance and speed on Total-Text(F-measure:86.0%, FPS:30) and MSRA-TD500 (F-measure:87.5%, FPS:30).

The experiences gathered during the past 30 years support the operational use of irrigation scheduling based on frequent multi-spectral image data. Currently, the operational use of dense time series of multispectral imagery at high spatial resolution makes monitoring of crop biophysical parameters feasible, capturing crop water use across the growing season, with suitable temporal and spatial resolutions. These achievements, and the availability of accurate forecasting of meteorological data, allow for precise predictions of crop water requirements with unprecedented spatial resolution. This information is greatly appreciated by the end users, i.e. professional farmers or decision-makers, and can be provided in an easy-to-use manner and in near-real-time by using the improvements achieved in web-GIS methodologies. This paper reviews the most operational and explored methods based on optical remote sensing for the assessment of crop water requirements, identifying strengths and weaknesses and proposing alternatives to advance towards full operational application of this methodology. In addition, we provide a general overview of the tools which facilitates co-creation and collaboration with stakeholders, paying special attention to these approaches based on web-GIS tools.

Background: The use of wearable devices has burgeoned over the past decade, including wearables for infants and young children. Typically, such devices assess a single modality, and few have undergone scientific validation. To address this gap, we developed an infant wearable platform, LittleBeats™, that integrates electrocardiogram (ECG), motion, and audio sensors on a single printed circuit board to permit daylong remote assessments of infants and caregivers in home environments. Objective: Complementing our prior reports focused on LittleBeats™ data collected among infants and children in the home context, our main objective here is to present a technical validation of each sensor modality against established laboratory protocols and gold-standard equipment. Materials and Methods: We conducted five studies, including assessments of (a) interbeat interval (IBI) data obtained from the LittleBeats™ ECG sensor versus the gold-standard BIOPAC among adults (Study 1, N=16) and infants (Study 2, N=5), (b) performance of automated activity recognition (upright vs. walk vs. glide vs. squat ) among adults using accelerometer data obtained from LittleBeats™ versus Google Pixel 1 smartphone (Study 3, N=12), and (c) performance of speech emotion recognition (SER; Study 4, N=8) and automatic speech recognition (ASR; Study 5, N =12) algorithms among adult samples using audio data from LittleBeats™ versus smartphone. Results: Results for IBI data obtained from the LittleBeats™ ECG sensor indicate acceptable mean absolute percent error (MAPE) rates for both the adults (MAPE = 5.29% to 5.97%; Study 1) and infants (MAPE =0.96% to 1.66%; Study 2) across low- and high-challenge sessions, as well as expected patterns of change in respiratory sinus arrythmia (RSA) across sessions. For activity recognition (Study 3), LittleBeats™ data showed good to excellent performance (Accuracy = 89%, F1-score=88%; Cohen’s kappa =.79), although the smartphone outperformed LittleBeats™ by less than 4%. Finally, performance on the SER applied to LittleBeats™ versus smartphone audio data (Study 4) indicated comparable performance, with a matched-pairs test indicating no significant difference in error rates (p=.26). On the ASR task (Study 5), the best performing algorithm yielded relatively low word error rates, although LittleBeats™ (4.16%) versus smartphone (2.73%) error rates are somewhat higher. Discussion: Taken together, results from these controlled laboratory studies conducted predominantly with adults indicate that the LittleBeats™ sensors yield data quality that is largely comparable to those obtained from gold-standard devices and protocols that have been used extensively in prior research. The advantages of the LittleBeats™ platform is the (a) integration of multiple sensors into one platform that was (b) designed specifically for use with infants and young children. Leveraging data from the multiple modalities and fine-tuning postprocessing steps to further increase data quality, combined with assessing data quality among infants and young children in their natural environments, will be key next steps in this research program.

The abstract should be a total of about 250 words and structured to contain the following headings: Background/Objectives, Methods, Results, Conclusions. Background/Objectives: Place the question addressed in a broad context and highlight the purpose of the study; Methods: Describe briefly the main methods or treatments applied. Include any relevant preregistration numbers, and species and strains of any animals used; Results: Summarize the article’s main findings; Conclusions: Indicate the main conclusions or interpretations. The abstract should be an objective representation of the article: it must not contain results which are not presented and substantiated in the main text and should not exaggerate the main conclusions. Clinical trial abstracts should include items that the CONSORT group has identified as essential.

The collaboration of multimodal transport documents is the foundation for conducting multimodal transport operations. Blockchain technology can effectively address trust issues and information sharing difficulties in current multimodal transport document collaboration. However, in current blockchain-based electronic document research, the bottleneck problem lies in the collaboration of multiparty in multimodal transport under the "one-bill coverage system". We design a blockchain platform architecture for multimodal transport, reshaping collaboration processes for different modes of transport based on the blockchain platform. It proposes a collaboration model for multimodal transport under the "one-bill coverage system" and performs model solving and case analysis. The obtained collaboration strategies are embedded into the platform's application layer. Finally, using Solidity language, it writes smart contracts related to multimodal transport under the "one-bill coverage system " and deploys and executes them on the Remix platform.

The atmospheric lightning is one of the natural disasters which need to be considered in the sustainable development. The National Remote Sensing Centre (NRSC) has installed 46 lightning detection sensors (LDS) across the country. These sensors work in radio frequencies having their detection range up to 1000 km with more than 98% detection efficiency within 300 km range. The network is put in a way that sensors have about 50% sensor-to-sensor overlap in their detection ranges to enable high geolocation accuracy and maintain redundancy. The NRSC-LDS network (LDSN) estimates the current associated with each cloud to ground (CG) lightning flash which can be utilized for the risk assessment. The current estimates from one network to the other need to be inter-calibrated and harmonized. Present study compares the LDSN current estimates with Lightning Location Network (LLN) estimates and results are discussed with their impact on the estimation of vulnerable zones. A case study of lightning-induced fire event is presented to showcase the importance of the currents associated with lightning for future planning.

Smallsats are becoming the predominant electro-optical Earth observation (EO) imaging platforms. While atmospheric correction of smallsat data enhances its utility, an established pathway to do so may constrain accuracy and utility. The alternative, Closed-form Method for Atmospheric Correction (CMAC), developed for smallsat application provides surface reflectance derived solely from scene statistics. In a prior paper, CMAC closely agreed with Land Surface Reflectance Code (LaSRC) software for correction of the four VNIR bands of Landsat-8/9 images for conditions of low to moderate atmospheric effect over quasi-invariant warehouse-industrial targets. Those results were accepted as surrogate surface reflectance to support analysis of CMAC and LaSRC reliability for surface reflectance retrieval in two contrasting environments: shortgrass prairie and barren desert. Reliability was defined and tested through a null hypothesis: the same top-of-atmosphere reflectance under the same atmospheric condition will provide the same estimate of surface reflectance. Evaluated against the prior surrogate surface reflectance, the results found decreasing error with increasing wavelength for both methods. From 58 comparisons across the four bands, LaSRC average absolute error ranged from 0.59% (NIR) to 50.30% (blue). CMAC error was well constrained from 0.01% (NIR) to 0.98% (blue) sustaining the null hypothesis for reliability.

With the growing demand for positioning services, angle-of-arrival (AoA) estimation or direction-finding (DF) has been widely investigated for applications in fifth-generation (5G) technologies. Many existing AoA estimation algorithms only require the measurement of the direction of the incident wave at the transmitter to obtain correct results. However, for most of the cellular systems such as Bluetooth indoor positioning system due to multipath and non-line-of-sight (NLOS) propagation, the indoor positioning accuracy is severely affected. In this paper a comprehensive algorithm is investigated that combines radio measurements from Bluetooth AoA local navigation systems with indoor position estimates obtained using particle filtering, which allows us to explore new optimised methods to reduce estimation errors in indoor positioning. First, particle filtering is used to predict the rough position of a moving target. Then, an algorithm with robust beam weighting is used to estimate the AoA of the multipath components. Based on this, a system of pseudo-linear equations for target positioning based on the probabilistic framework of PF and AoA measurement is derived. Theoretical analysis and simulation results show that the algorithm can improve the positioning accuracy by about 25.7% on average.

Ambulatory heart rate (HR) monitors that acquire electrocardiogram (ECG) or/and photoplethysmographm (PPG) signals from the torso, wrists, or ears are notably less accurate in tasks associated with high levels of movement compared to clinical measurements. However, reliable estimation of HR can be obtained through data fusion from different sensors. These methods are especially suitable for multimodal hearable devices, where heart rate can be tracked from different modalities, including electrical ECG, optical PPG, and sounds (heart tones). Combined information from different modalities can compensate for single source limitations. In this paper, we evaluate the possible application of data fusion methods in hearables. We assess data fusion for heart rate estimation from simultaneous in-ear ECG and in-ear PPG, recorded on eight subjects while performing 5-minute sitting and walking tasks. Our findings show that data fusion methods provide a similar level of mean absolute error as the best single-source heart rate estimation but with much lower intra-subject variability, especially during walking activities. We conclude that data fusion methods provide more robust HR estimation than a single cardiovascular signal. These methods can enhance the performance of wearable devices, especially multimodal hearables, in heart rate tracking during physical activity.

Multimodal emotion classification (MEC) involves analyzing and identifying human emotions by integrating data from multiple sources, such as audio, video, and text. This approach leverages the complementary strengths of each modality to enhance the accuracy and robustness of emotion recognition systems. However, one significant challenge is effectively integrating these diverse data sources, each with unique characteristics and levels of noise. Additionally, the scarcity of large, annotated multimodal datasets in Bangla limits the training and evaluation of models. In this work, we unveiled a pioneering multimodal Bangla dataset, MAViT-Bangla (Multimodal Audio Video Text Bangla dataset). This dataset, comprising 1002 samples across audio, video, and text modalities, is a unique resource for emotion recognition studies in the Bangla language. It features emotional categories such as anger, fear, joy, and sadness, providing a comprehensive platform for research. Additionally, we developed a framework for emotion recognition that employs a cross-modal attention mechanism among unimodal features. This mechanism fosters the interaction and fusion of features from different modalities, enhancing the model’s ability to capture nuanced emotional cues. The effectiveness of this approach was demonstrated by achieving an F1-score of 0.64, a significant improvement over unimodal methods.

This paper is aimed at studying the temporal evolution of the surface displacements occurred over the past few years in the ocean-reclaimed platforms of the Shanghai megacity (China), which are mainly ascribable to consolidation processes of large dredger fills and alluvial deposits. With respect to previous analyses carried out over the same area, this work provides a joint multi-platform differential interferometry synthetic aperture radar (DInSAR) analysis, based on the application of the advanced Small BAseline Subset (SBAS) algorithm. This led us to retrieve long-term deformation time-series that are helpful for a better understanding of the on-going deformation phenomena. To this aim, we have exploited two sequences of SAR data collected by the ASAR/ENVISAT and by the COSMO-SkyMed (CSK) sensors, respectively, spanning the whole time period from 2007 to 2016. Unfortunately, the large time gap (of about three years) existing between the available ASAR/ENVISAT and CSK datasets gave rise to additional difficulties for their combination. Nevertheless, this problem has been faced by benefiting from the knowledge of a time-dependent model describing the temporal evolution of the expected deformations affecting the Shanghai ocean-reclaimed platforms.

Remote sensing (RS) is a compulsory component in studying and monitoring ecosystems suffering from the disruption of natural balance, productivity, and degradation. Current study attempted to assess the feasibility of multisource RS for assessing and monitoring mountainous natural grasslands in Armenia. Series of the different spatial resolution RS data (Landsat 8, Sentinel 2, Planet Scope, and multispectral UAV data) were used to obtain various vegetation spectral indices: NDVI, NDWI, GNDVI, GLI, EVI, DVI, SAVI, MSAVI, and GSAVI, and the relationship among the indices were assessed via Spearman correlation method, which shows a significant positive correlation for all cases (p < 0.01). A comparison of all indices shows a significant high correlation between UAV and the PlanetScope imagery. The comparison of UAV, Sentinel and Landsat data show moderate and low significant correlation (p < 0.01) correspondingly. Also, trend analysis was performed to explore their spatial-temporal changes using Mann-Kendall statistical tests (MK, MKKH, MKKY, PW, TFPW), which indicated no significant trend. However, Sen’s slope as second estimator shows decreasing trend. Though the best result received for PlanetScope and Sentinel 2, Sentinel-2 data seem to have better alignment making it a reliable tool for an accurate monitoring of small mountainous grasslands in Armenia.

Outliers seriously affect the accuracy in geometric model fitting. Previous works in coping with outliers involve threshold selection and scale estimation. However most scale estimators suppose the inlier distribution as a Gaussian model, which usually poorly meets the cases in geometric model fitting. Outliers, considered as the points with big residuals to all the true models, share common items with big values in quantized residual preferences, thus making the outliers gather away from the inliers in quantized residual preference space. In this paper we make use of this outlier consensus in quantized residual preference space by extending the usage of energy minimization to combine the model error and the spatial smoothness in quantized residual preference space for outlier detection. The energy minimization based outlier detection process follows an alternate sampling and labeling framework. After the outlier detection, an ordinary energy minimization method is employed to optimize the inlier labels, which also follows the framework of alternate sampling and labeling. The experimental results in this study show that the energy minimization based outlier detection method can detect most of the outliers in the data. Furthermore, the proposed energy minimization based inlier segmentation process segments the inliers into different models quite accurately. Overall, the performance of the proposed method is better than most of the state-of-the-art methods.

Pain diagnosis remains a challenging task due to its subjective nature, the variability in pain expression among individuals, and the difficult assessment of the underlying biopsychosocial factors. In this complex scenario, artificial intelligence (AI) can offer the potential to enhance diagnostic accuracy, predict treatment outcomes, and personalize pain management strategies. This review aims at dissecting the current literature on computer-aided diagnosis methods. It also discusses how AI-driven diagnostic methods can be integrated into multimodal models that combine various data sources, such as facial expression analysis, neuroimaging, and physiological signals, with advanced AI techniques. Despite the significant advancements in AI technology, its widespread adoption in clinical settings faces crucial challenges. Ethical considerations related to patient privacy, biases, and lack of reliability and generalizability are the main issues. Furthermore, there is a need for high-quality real-word validation as well as the development of standardized protocols and policy rules to guide the implementation of these technologies in diverse clinical settings.

Traffic anomaly detection is crucial for urban management, yet current research is often confined to small-scale endeavors. This study collected nine months of real-time Wuhan traffic monitoring data from Amap. We proposed Traffic-ConvLSTM, a multi-scale spatial-temporal technique based on long and short-term memory networks (LSTM) and convolutional neural networks (CNN) to effectively achieve long-term anomaly detection at the city level. First, we convert the traffic flow data into image representation, which enables the capture of the spatial correlation between traffic flow and roads and the correlation between traffic flow and roads, as well as the surrounding environment. Second, The model utilizes convolution kernels of different sizes to extract spatial features at road-level, regional-level, and city-level scales, while incorporating temporal features of different time steps to capture hourly, daily, and weekly dynamics. Additionally, varying weights are assigned to the convolution kernels and temporal features of varying spatio-temporal scales to capture the heterogeneous strengths of spatio-temporal correlations within patterns of traffic anomalies. The proposed Traffic-ConvLSTM model exhibits improved performance over existing techniques in the task of identifying long-term and large-scale traffic anomaly occurrences. Furthermore, the analysis reveals significant traffic anomalies during holidays and urban sporting events. The diverse travel patterns observed in response to various activities offer insights for large-scale urban traffic anomaly management, providing recommendations for city-level traffic control strategies.

This study explores the potential of digital technologies for preserving cultural heritage through the case study of the Raya Gopura, an incomplete monument in Melukote, India. Employing a combination of terrestrial photogrammetry, drone-based photogrammetry and terrestrial laser scanning, the research team captured highly detailed 3D models of the structure. This non-destructive approach offers a comprehensive digital record for future research and preservation. Furthermore, for the conjecture for the Raya Gopura two possible purposes: an entrance to a planned fort or a gateway to the temple are perceived through the collective intelligence (CI) approach. These insights inform a conjectural architectural drawing of the potentially completed monument. The 3D models hold significant potential for various applications, including tourism, education, and architectural research, with the potential for immersive experiences through VR and AR technologies. The study demonstrated the effectiveness of digital tools in heritage preservation, not only safeguarding the Raya Gopura but also offering valuable in-sights for future research and public engagements.

This study explores the potential of digital technologies for preserving cultural heritage through the case study of the Raya Gopura, an incomplete monument in Melukote, India. Employing a combination of photogrammetry (terrestrial and drone-based) and terrestrial laser scanning, the research team captured highly detailed 3D models of the structure. This non-destructive approach offers a comprehensive digital record for future research and preservation. Furthermore, consultations with experts yielded two possible purposes for the Raya Gopura: an entrance to a planned fort or a gateway to a temple. These insights inform a conjectural architectural drawing of the potentially completed monument. The 3D models hold significant potential for various applications, including tourism, education, and architectural research, with the potential for immersive experiences through VR and AR technologies. In conclusion, this study demonstrates the effectiveness of digital tools in heritage preservation, not only safeguarding the Raya Gopura but also offering valuable insights for future research and public engagement.

The Microwave Humidity and Temperature sounder (MWHTS) on board the Fengyun (FY)-3C satellite measure the outgoing radiance form the Earth surface and atmospheric constituents. MWHTS makes measurements in the isolated oxygen absorption line near 118 GHz and the vicinity of strong water vapor line around 183 GHz, can provide fine vertical distribution structure of both atmospheric humidity and temperature. However, in order to obtain the accurate soundings of humidity and temperature by the physical retrieval method, bias between the observed radiance and those simulated by radiative transfer model from the background or first guess profiles must be correct. In this study, two bias correction methods are developed through the correlation analysis between MWHTS measurements and air mass identified by the first guess profiles of the physical inversion, one is the linear regression correction (LRC) and the other is neural networks correction (NNC), representing the linear and nonlinear nature between MWHTS measurements and air mass, respectively. Both correction methods have been applied to MWHTS observed brightness temperatures over the geographic area (180° W-180° E, 60° S-60° N). The corrected results are evaluated by the probability density function of the difference between corrected observations and simulated values and the root mean square error (RMSE) with respect to simulated observations. The numerical results show that the NNC method perform better, especially in MWHTS channels 1 and 7-9 whose peak weight function heights are close to the surface. In order to assess the effects of bias correction methods proposed in this study on the retrieval accuracy, a one-dimensional variational system was built and applied to the MWHTS uncorrected and corrected brightness temperatures to estimated atmospheric temperature and humidity profiles, The retrieval results show that the NNC has better performance which is to be expected. An indication of the stability and robustness of NNC method is given which suggests that the NNC method has promising application perspectives in the physical retrieval.

This article describes the history of research and development of surface-penetrating radar, starting from the 60s in the USSR, and ending today in Russia and neighboring states formed after the collapse of the USSR. The outstanding role played in the initial period of this technology development by Prof. M.I. Finkelstein and his colleagues is highlighted. Their research had a significant impact on subsequent developments in modern Russia and the neighboring countries.

The increasing frequency and intensity of wildfires necessitate innovative solutions to enhance firefighting capabilities. This review provides a comprehensive evaluation of vehicles specifically designed for direct forest fire suppression, focusing on their speed of fire response, and encompasses both ground and aerial units. The study explores the functionality and speed capacity of various fire suppression vehicles, including fire trucks, firefighting aircrafts and helicopters, robotic firefighting vehicles and uncrewed aerial vehicles (UAVs). Key features such as mobility, water capacity, and advanced technologies including Artificial Intelligence (AI)-driven navigation and remote sensing capabilities are evaluated. The review also addresses the operational challenges these vehicles face in wildland environments. Additionally, it identifies emerging trends and innovations in fire suppression vehicle technology, offering insights into future developments that aim to enhance the effectiveness and safety of firefighting operations in forest fires. This overview aims to serve as a valuable resource for researchers, fire departments, and emergency response planners focused on advancing fire suppression strategies in forest.

The mineralogical indices, e.g., Quartz Index (QI), Carbonate Index (CI), Mafic Index (MI) for ASTER multispectral thermal infrared (TIR) data have been applied to various geological materials. The indices are proved to be robust in extracting geological information at the local scale. Considering the relatively narrow spatial coverage of each ASTER scene compared to LANDSAT, many scenes are needed when mosaicking the images to be mapped at regional scales. We develop a system to search ASTER data for a target area given the vast and expanding ASTER data archive. The data is then conditioned, prioritized, and the indices are calculated before finally mosaicking the imagery. The maps of the indices covering the very wide region of the central Tibetan Plateau are produced with this system. The characteristic features of the indices relating to their geology in the study area are analyzed and discussed. Many interesting lithological and structural information that are not currently well understood in the central Tibetan Plateau, the highest and most extensive plateau in the world, with an average elevation of over 4,500 meters above sea level, for example, distributions of the mafic-ultramafic rocks along the suture zones, the quarzitic and marine sedimentology accreted to the Eurasian continent and sulfate layers related to the Tethys and neo-Tethys geological setting can be retrieved from the processed ASTER images.

This research investigates precision enhancement in regional quasi-geoid refinement through ADS80 tri-linear array scanning stereoscopic imagery for aerial triangulation, coupled with GNSS gravity-potential modeling. Acquiring stereoscopic imagery and analyzing triangulation accuracy with the ADS80 camera, we performed this study over the Qinghai-Tibet Plateau's elevated, desolate terrain, collecting 593 GNSS points following high-precision stereoscopic imagery model. Utilizing 12 gravity satellite models, we computed geoid heights and China 1985 Yellow Sea elevations for 28 benchmarks and GNSS points, thereby refining the Qinghai Province Quasi-Geoid Model (QPQM) using geometric techniques. The findings reveal that POS-assisted ADS80 stereoscopic imagery yields high-precision triangulation with maximal horizontal and elevation accuracies of 0.083/0.116 cm and 0.053/0.09 cm, respectively, across five control point arrangements. The RMSE of normal heights for 1985, processed via these GNSS points, achieved decimeter precision. By applying error corrections from benchmarks to the 1985 elevation data from gravity satellites and performing weighted averaging, the precision of EGM2008, SGG-UGM-2, and SGG-UGM-1 models improved to 8.61 cm, 9.09 cm, and 9.38 cm, respectively, surpassing the QPQM by 9.22 cm to 9.99 cm. This research demonstrates that the proposed methods can significantly enhance the precision of regional quasi-geoid surfaces. Additionally, these methods offer a novel approach for rapidly establishing regional quasi-geoid models in the uninhabited areas of the Qinghai-Tibet Plateau.

With the development of human-computer interaction, the importance of emotion recognition is increasing. Emotion recognition technology provides practical benefits in various industries such as improving user experience, education, and organizational productivity. In education, emotion recognition can enable real-time understanding of students' emotional states and provide tailored feedback, and in the workplace, by monitoring employees' emotional states, it can improve work performance and job satisfaction. Therefore, multimodal-based research that combines text, speech, and video data for emotion recognition is being conducted in various industries. In this study, we propose an emotion recognition method that combines text and speech data, reflecting the characteristics of the Korean language. For text, KoELECTRA is used to perform embedding, and for speech, MFCC and pitch analysis are used to extract features. Finally, a multimodal transformer model is proposed that combines these two data types to perform emotion recognition. The multimodal transformer model processes text and speech data separately, and then learns the interaction between the two modalities through a Cross-Modal Attention mechanism. Through this, the complementary information from text and speech is effectively combined, improving emotion recognition performance. Experimental results show that the proposed model outperforms single-modality models, achieving a high accuracy of 73.13% and an F1-Score of 0.7344 in emotion classification. This study contributes to the advancement of emotion recognition technology by combining various language and modality data, and higher performance can be expected through the integration of additional modalities in the future.

Daily maximum surface air temperature (Tamax) is a crucial factor for understanding complex land surface processes under rapid climate change. Remote detection of Tamax has widely relied on the empirical relationship between air temperature and land surface temperature (LST), a product derived from remote sensing. However, little is known about how such a relationship is affected by the high heterogeneity in landscapes and dynamics in seasonality. This study aims to advance our understanding of the roles of land cover and seasonal variation in the estimation of Tamax using the MODIS (Moderate Resolution Imaging Spectroradiometer) LST product. We developed statistical models to link Tamax and LST in the middle and lower reaches of the Yangtze River in China for five major land-cover types (i.e., forest, shrub, water, impervious surface, cropland, and grassland) and two seasons (i.e., growing season and non-growing season). Results show that the performance of modeling the Tamax-LST relationship was highly dependent on land cover and seasonal variation. Estimating Tamax over grasslands and water bodies achieved superior performance; while uncertainties were high over forested lands that contained extensive heterogeneity in species types, plant structure, and topography. We further found that all the land-cover specific models developed for the plant non-growing season outperformed the corresponding models developed for the growing season. Discrepancies in model performance mainly occurred in the vegetated areas (forest, cropland, and shrub), suggesting an important role of plant phenology in defining the statistical relationship between Tamax and LST. For impervious surfaces, the challenge of capturing the high spatial heterogeneity in urban settings using the low-resolution MODIS data made Tamax estimation a difficult task, which was especially true in the growing season.

Multimodal knowledge graph completion necessitates the integration of information from multiple modalities (such as images and text) into the structural representation of entities to improve link prediction. However, most existing studies have overlooked the interaction between different modalities. To address this issue, this paper proposed a Transformer-based knowledge graph link prediction model (MM-Transformer) that fuses multimodal features. Different modal encoders are employed to extract structural, visual and textual features, and hybrid key-value calculations are performed on features from different modalities based on the Transformer architecture. The similarities of textual tags to structural tags and visual tags are calculated and aggregated respectively, and multimodal entity representations are modeled and optimized to reduce the heterogeneity of the representations. Experimental results demonstrate that, compared to the current multimodal state-of-the-art methods, the proposed method achieves significant performance improvements in knowledge graph link prediction tasks. This proves that the proposed method effectively addresses the problem of multimodal feature fusion in knowledge graph link prediction tasks.

The human mind is multimodal. Yet most behavioral studies rely on century-old measures of behavior—task accuracy and latency (response time). Multimodal and multisensory analysis of human behavior creates a better understanding of how the mind works. The problem is that designing and implementing these experiments is technically complex and costly. This paper introduces versatile and economical means of developing multimodal-multisensory human experiments. We provide an experimental design framework that automatically integrates and synchronizes measures including electroencephalogram (EEG), galvanic skin response (GSR), eye-tracking, virtual reality (VR), body movement, mouse/cursor motion and response time. Unlike proprietary systems (e.g., iMotions), our system is free and open-source; it integrates PsychoPy, Unity and Lab Streaming Layer (LSL). The system embeds LSL inside PsychoPy/Unity for the synchronization of multiple sensory signals—gaze motion, electroencephalogram (EEG), galvanic skin response (GSR), mouse/cursor movement, and body motion—with low-cost consumer-grade devices in a simple behavioral task designed by PsychoPy and a virtual reality environment designed by Unity. This tutorial shows a step-by-step process by which a complex multimodal-multisensory experiment can be designed and implemented in a few hours. When conducting the experiment, all of the data synchronization and recoding of the data to disk will be done automatically.

Improper sitting positions are known as the primary reason for back pain and the emergence of musculoskeletal disorders (MSD) among individuals who spend prolonged time working with computer screens, keyboards, and mice. At the same time, it is well understood that automated technological tools can play an important role in the process of unhealthy habit alteration, so plenty of research efforts are focused on research and technology development (RTD) activities that aim to provide support to the prevention of back pain or the development of MSD. Here, we report on creating a new resource in support of RTD activities aiming at the automated detection of improper sitting positions. It consists of multimodal multisensory recordings of 100 persons made with a video recorder, camera, and wrist-attached sensors that capture physiological signals (PPG, EDA, Skin temperature), as well as motion sensors (three-axis accelerometer). Our multimodal multisensory dataset (MMD-MSD) opens new opportunities for modeling the body stance (sitting posture and movements), physiological state (stress level, attention, emotional arousal, valence), and performance (success rate on the Stroop test) of people working with a computer. Finally, we demonstrate two use cases: improper neck posture detection from pictures and cognitive load detection from physiological signals.

Urban rail transit hub platform is the most important area for passenger flow distribution. In order to calculate passenger flow volume in platform and evaluate platform service level during rush hours, this paper presents a method for modeling and simulation of passenger flow distribution in platform. Passenger flow distribution model (PFDM) is proposed based on the basic analysis and the superposition principle of passenger flow. Simulation design for PFDM is proposed by Anylogic, which contains simulation process and simulation model. Experiment results show that PFDM and simulation design are effective and accordant with the reality scenario, and the simulation precision is comparatively ideal. This research could provide a beneficial reference for train scheduling and operation management under the viewpoint of traffic safety and service level.

In this study, we present comprehensive climatologies of effective ultraviolet (UV) quantities and photosynthetically active radiation (PAR) over Cyprus for the period 2004 to 2023, leveraging the synergy of earth observation (EO) data and radiative transfer model simulations. The EO dataset, encompassing satellite and re-analysis data for aerosols, total ozone column, and water vapor, alongside cloud modification factors, to capture the nuanced dynamics of Cyprus's atmospheric conditions. With a temporal resolution of 15 minutes and a spatial of 0.05°x0.05°, these climatologies undergo rigorous validation against established satellite datasets and are further evaluated through comparisons with ground-based global horizontal irradiance measurements provided by the Meteorological Office of Cyprus. This dual-method validation approach not only underscores the models' accuracy but also highlights their proficiency in capturing intra-daily cloud coverage variations. Our analysis extends to investigating the long-term trends of these solar radiation quantities, examining their interplay with changes in cloud attenuation, aerosol optical depth (AOD), and total ozone column (TOC). Significant decreasing trends in the noon ultraviolet index (UVI), of -2 to -4% per decade have been found in Autumn, especially marked on the island’s Northeastern part, mainly originating from the (significant) positive trends in TOC. The significant decreasing trends in TOC, of -2 to -3% per decade that were found in Spring do not result in correspondingly significant positive trends in the noon UVI since variations in cloudiness and aerosols also have a strong impact on the UVI in this season. The seasonal trends in the Daylight Integral (DLI) were generally not significant. These insights provide a valuable foundation for further studies aimed at developing public health strategies and enhancing agricultural productivity, highlighting the critical importance of accurate and high-resolution climatological data.

In response to the issues of sensor noise and accumulated motion errors that lead to low positioning accuracy and insufficient robustness during large maneuvers or continuous flight of small unmanned aerial vehicles (UAVs) in complex environments, this paper proposes a multi-source and multimodal data fusion method. Initially, it employs a multimodal data fusion of various sensors including GPS (Global Positioning System), IMU (Inertial Measurement Unit), and visual sensors to complement the strengths and weaknesses of each hardware component, thereby eliminating motion errors to enhance accuracy. To mitigate the impact of sudden changes in sensor data, the method introduces a digital twin UAV data source. By utilizing the Extended Kalman Filter algorithm, it fuses data from both the real UAV and its digital twin, and the filtered positional information is fed back into the control system of the real UAV. This enables real-time correction of UAV positional deviations caused by sensor noise and environmental disturbances. The multi-source multimodal fusion Kalman filter method proposed in this paper significantly improves the positioning accuracy of UAVs in complex scenarios and the overall stability of the system. This method holds significant value in maintaining high-precision positioning in variable environments and has important practical implications for enhancing UAV navigation and application efficiency.

Aerial image classification has become popular and has attracted extensive research efforts in recent decades. The main challenge lies in its very high spatial resolution but relatively insufficient spectral information. To this end, spatial-spectral feature extraction is a popular strategy for classification. However, parameter determination for that feature extraction is usually time-consuming and depends excessively on experience. In this paper, an automatic spatial feature extraction approach based on image raster and segmental vector data cross-analysis is proposed for the classification of very high spatial resolution (VHSR) aerial imagery. First, multi-resolution segmentation is used to generate strongly homogeneous image objects and extract corresponding vectors. Then, to automatically explore the region of a ground target, two rules, which are derived from Tobler’s First Law of Geography (TFL) and a topological relationship of vector data, are integrated to constrain the extension of a region around a central object. Third, the shape and size of the extended region are described. A final classification map is achieved through a supervised classifier using shape, size, and spectral features. Experiments on three real aerial images of VHSR (0.1 to 0.32 m) are done to evaluate effectiveness and robustness of the proposed approach. Comparisons to state-of-the-art methods demonstrate the superiority of the proposed method in VHSR image classification.

The necessity for precise and current data concerning the dynamics of land cover change in Indonesia is crucial for efforts to reduce natural vegetation cover due to agricultural expansion. The functionality of monitoring systems that incorporate Terra-MODIS is currently compromised by the limited availability of data for the immediate future. This study seeks to assess the potential of VIIRS satellite imagery in developing an early warning system for monitoring vegetation cover change in Indonesia. The Normalized Differential Open Area Index (NDOAI) computed from the 8-day’ VIIRS data was employed to detect changes in vegetation cover based on pixel-by-pixel subtraction in the NDOAI data time series. Evaluating the pixel-level accuracy of change detection is complicated due to the fact that we evaluate a change map at a coarser resolution than the Landsat-based reference map. The results revealed that increasing the threshold percentage is associated with improved accuracy. In change detection, there is often a trade-off between accuracy and sensitivity. A threshold that is too low may result in false positives, while a threshold that is too high may lead to missed changes. This study demonstrates that when a threshold value of less than 20% is applied, Landsat can identify vegetation cover changes at an earlier stage. Conversely, when a threshold value greater than 20% is employed, VIIRS will detect the change 4.5 days earlier than Landsat. Additionally, VIIRS is capable of detecting changes 25.4 days and 54.8 days faster than Landsat, respectively, when using thresholds of 40% and 75%.

Recent advancements in deep learning have spurred the development of numerous novel semantic segmentation models for land cover mapping, showcasing exceptional performance in delineating precise boundaries and producing highly accurate land cover maps. However, to date, no systematic literature review has comprehensively examined semantic segmentation models in the context of land cover mapping. This paper addresses this gap by synthesizing recent advancements in semantic segmentation models for land cover mapping from 2017 to 2023, drawing insights on trends, data sources, model structures, and performance metrics based on a review of 106 extracted articles. Our analysis identifies top journals in the field, including MDPI Remote Sensing, IEEE Journal of Selected Topics in Earth Science, and IEEE Transactions on Geoscience and Remote Sensing, IEEE Geoscience and Remote Sensing Letters, ISPRS Journal Of Photogrammetry And Remote Sensing as the leading journals. We find that research predominantly focuses on land cover, urban areas, precision agriculture, environment, coastal areas, and forests. Geographically, 35.29% of the study areas are located in China, followed by USA (11.76%), France (5.88 %), Spain (4%) and others. Sentinel-2, Sentinel-1, and Landsat satellites emerge as the most commonly used data sources. Benchmark datasets such as ISPRS Vaihingen & Potsdam, LandCover.ai, DeepGlobe, and GID datasets are frequently employed. Model architectures predominantly utilize encoder-decoder, and hybrid convolutional neural network-based structures because of their impressive performances, with limited adoption of transformer-based architectures due to its computational complexity issue, and slow convergence speed. Lastly, this paper highlights existing key research gaps in the field to guide future research directions.

Global warming leads in general to a reduction in precipitations and non-rainfall water contributions such as dew. The present study, carried out in Gujarat (India) for 17 years between 2005 and 2021, shows however a rare increase of the rain falls and dew condensation, the latter related to an increase in relative humidity and a decrease in wind amplitudes. Rain was obtained from meteo stations. Dew was calculated from an energy model and meteo data from 15 meteo stations (14 in India and 1 in Pakistan) and compared to early and dedicated measurements in 13 sites. Maps of dew, rain and their relative contributions during the period are provided. They show that, while rain mainly occurs during the monsoon (June to September), dew forms during the dry season (October to April). This water resource was mapped over the Gujarat state of India by using a kriging process. According to the site, the dew/rain ratios can represent between 4.6% (Ahmedabad) to 37.2% (Jamnagar) on the whole period of 17 years. This positive evolution, which is observed since 2015-2017, is likely to continue in the future.

Molecular analysis of growing teratoma syndrome has not been extensively studied. Here, we report a 14-year-old boy with a growing mass during treatment for a mixed germ cell tumor of the pineal region. Tumor markers were negative; thus, growing teratoma syndrome was suspected. A radical resection via the occipital transtentorial approach was performed, and histopathological examination revealed a teratoma with malignant features. Methylation classifier analysis confirmed the diagnosis of teratoma, and DMRT1 loss and 12p gain were identified by copy number variation analysis, potentially elucidating the cause of growth and malignant transformation of the teratoma. The patient remains in remission after intense chemoradiation treatment as a high-risk germ cell tumor.

Floods are among the most serious natural disasters worldwide; they cause enormous crop losses every year and threaten world food security. There are many studies focused on flood impact assessments for administrative districts but fewer on postdisaster impact assessments for specific crops. Therefore, this study used remote sensing data, including the normalized difference vegetation index (NDVI), elevation data, slope data, and rainfall data, combined with crop growing season data to construct a crop flood damage assessment index (CFAI). First, an analytic hierarchy process (AHP) was used to assign weights to the impact factors; then, the weighted composite score method was used to calculate the CFAI; and finally, the impact was classified as slight, moderate, or severe based on the magnitude of the CFAI . This method was used for the Missouri River floods of 2019 in the U.S. Due to the lack of measured data, the disaster vegetation damage index (DVDI) was used to validate the results. The combined approach achieved a high degree of consistency in spatial distribution. The CFAI can respond well to the degree of crop impact after flooding, providing new ideas and reference standards for agriculture-related departments.

High-precision displacement sensing has been widely used across from both scientific researches and industrial applications. The recent interests in developing micro-opto-electro-mechanical systems (MOEMS) have given rise to an excellent platform for miniaturized displacement sensors. Advancement in this field during past years is now yielding integrated high-precision sensors which show great potential in applications ranging from photoacoustic spectroscopy to high-precision positioning and automation. In this review, we briefly summarize different techniques for high-precision displacement sensing based on MOEMS, and discuss the challenges for future improvement.

Microbial foodborne pathogens can cause major risks to public health and the food industry. Rapid and accurate detection of these pathogens is crucial to prevent outbreaks and ensure food safety. Traditional single-mode biosensing approaches have their limitations in terms of specificity, sensitivity, and speed. Over the years, there has been an increasing research interest in developing multimodal biosensing strategies that integrate multiple sensing techniques to achieve enhanced accuracy, efficacy, and precision in foodborne pathogen detection. This article review paper explores the current state of multimodal biosensing technologies and their promising applications in the food industry. We discuss various integrated biosensing platforms, including optical, electrochemical, and nanomaterial-based systems, among others. The advantages, challenges, and future prospects of multimodal biosensing for foodborne pathogens are thoroughly examined, highlighting the potential impact of these advanced technologies on food safety and public health.

Federated learning (FL) has become a burgeoning and attractive research area, which provides a collaborative training scheme for distributed data sources with privacy concerns. Most existing FL studies focus on taking unimodal data, such as images and text, as the model input and resolving the heterogeneity challenge, i.e., the non-identically distributed (non-IID) challenge caused by data distribution imbalance related to data labels and data amount. In real-world applications, data are usually described by multiple modalities. However, to the best of our knowledge, only a handful of studies have been proposed to improve the system performance by utilizing multimodal data. In this survey paper, we identify the significance of this emerging research topic – multimodal federated learning (MFL) and perform a literature review on the state-of-art MFL methods. Furthermore, we categorize multi-modal federated learning into congruent and incongruent multimodal federated learning based on whether all clients possess the same modal combinations. We investigate the feasible application tasks and related benchmarks for MFL. Lastly, we summarize the promising directions and fundamental challenges in this field for future research.

In the context of global climate change, the frequency of sudden natural disasters is increasing. Assessing traffic road damage post-disaster is crucial for emergency decision-making and disaster management. Traditional ground observation methods for evaluating traffic road damage are limited by the timeliness and coverage of data updates. Relying solely on these methods does not adequately support rapid assessment and emergency management during extreme natural disasters. Social media, a major source of big data, can effectively address these limitations by providing more timely and comprehensive disaster information. Motivated by this, we utilized multi-source heterogeneous data to assess the damage to traffic roads under extreme conditions and established a new framework for evaluating traffic roads in cities prone to flood disasters caused by rainstorms. The approach involves several steps: First, extracting the surface area affected by precipitation using a threshold method constrained by confidence intervals derived from microwave remote sensing images; Second, collecting disaster information from the Sina Weibo platform, where social media information is screened and cleaned. A quantification table for road traffic loss assessment was defined, and a social media disaster information classification model combining text convolutional neural networks and attention mechanisms was proposed (TextCNN-Attention Disaster Classification); Finally, matching traffic road information on social media with basic geographic data, visualizing the classification of traffic road disaster risk levels, and completing the assessment of traffic road disaster levels based on multi-source heterogeneous data. Using the "7.20" rainstorm event in Henan Province as an example, this study categorizes the disaster impact on traffic roads into five levels: particularly severe, severe, moderate, mild, and affected, as interpreted from remote sensing images. The evaluation framework for flood disaster traffic roads based on multi-source heterogeneous data provides important data support and methodological support for enhancing disaster management capabilities and systems.

Sepsis still remains one of the most difficult conditions to diagnose as it presents unspecific clinical signs and symptoms, which makes early detection crucial. Our study aimed to enhance the accuracy of sepsis diagnosis by integrating multimodal monitoring technologies with traditional diagnostic methods. The research involved 121 newborns, comprising 39 cases of late-onset sepsis, 35 cases of early-onset sepsis, and 47 control subjects. Biosignals including pulse oximetry (PO), near-infrared spectroscopy (NIRS), and skin temperature (ST) were continuously monitored and an algorithm was developed using Python for identifying early signs of sepsis. The model demonstrated the ability to detect sepsis 6 to 48 hours in advance with an accuracy rate of 87.67% ± 7.42%. Sensitivity and specificity were recorded at 76% and 90%, respectively, with NIRS and ST having the most significant impact on predictive accuracy. Despite the promising results, limitations such as sample size, data variability, and potential biases were noted. The findings highlight the critical role of non-invasive biosensing methods in conjunction with traditional biomarkers and cultures, offering a robust framework for early sepsis detection and improved neonatal care. Further studies are recommended to validate these results across diverse clinical settings.

Evapotranspiration is a critical component of the hydrological cycle, and it has a decisive impact on the ecosystem balance in arid and semi-arid regions. The Yinchuan Plain, located in the Gobi of Northwest China, has a strong surface ET. In order to assess the ET pattern in this region, we obtained the ETa of Yinchuan Plain between 1987 and 2020 using the GEE platform. We employed the Surface Energy Balance Model (SEBAL), specifically geeSEBAL, to analyze the change pattern of ET over different seasons, years, and land types. The results show that: ① In spring, the daily ETa of the Yinchuan Plain is highest in the central lake wetland area, with a maximum value of 4.32 mm day-1. In summer, it is concentrated around the croplands and water bodies, with a maximum value of 6.90 mm day-1; In Autumn and winter, it is mainly concentrated around the water bodies and impervious areas, with maximum values of 3.93 and 1.56 mm day-1, respectively. ② From 1987 to 2020, the ET of the Yinchuan Plain showed an obvious upward and downward trend in some areas with significant land use changes, but the overall ET of the region remained relatively stable without dramatic fluctuations. ③ The evapotranspiration of different underlying land use types in the Yinchuan Plain region is as follows: water body>cultivated land>impervious>grassland>bare land. Our results showed that geeSEBAL is highly applicable in the Yinchuan Plain area. It allows for the accurate and detailed inversion of ET in the study area, which facilitates the study of regional hydrological cycle and water governance.

Volcanic activity essentially consists of the transfer of heat from the Earth’ interior to the surface. The precise signature of this heat transfer relates directly to the processes underway at and within a particular volcano and this can be observed, at a safe distance, remotely, using infrared sensors that are present on Earth-orbiting satellites. For over 50 years, scientists have perfected this art using sensors intended for other purposes, and they are now in a position to determine the particular sort of activity that characterizes different volcanoes. This review will describe the theoretical basis of the discipline and then discuss the sensors available for the task and the history of their use. Challenges and opportunities for future development in the discipline are then discussed.

YOLOv8, as an efficient object detection method, can swiftly and precisely identify objects within images. However, traditional algorithms encounter difficulties when detecting small targets in remote sensing images, such as missing information, background noise, and interactions among multiple objects in complex scenes, which may affect performance. To tackle these challenges, we propose an enhanced algorithm optimized for detecting small objects in remote sensing images, named HP-YOLOv8. Firstly, we design the C2f-D-Mixer (C2f-DM) module as a replacement for the original C2f module. This module integrates both local and global information, significantly improving the ability to detect features of small objects. Secondly, we introduce a feature fusion technique based on attention mechanisms, named Bi-Level Routing Attention in Gated Feature Pyramid Network (BGFPN). This technique utilizes an efficient feature aggregation network and reparameterization technology to optimize information interaction between different scale feature maps, and through the Bi-level Routing Attention (BRA) mechanism, it effectively captures critical feature information of small target objects. Finally, we propose the Smooth Mean Perpendicular Distance Intersection over Union (SMPDIoU) loss function. The method comprehensively considers the shape and size of detection boxes, enhances the model's focus on the attributes of detection boxes and provides a more accurate bounding box regression loss calculation method. To demonstrate our approach's efficacy, we conduct comprehensive experiments across the RSOD, NWPU VHR-10, and VisDrone2019 datasets. The experimental results show that the HP-YOLOv8 achieves 95.11%, 93.05%, and 53.49% in the [email protected] metric, and 72.03%, 65.37%, and 38.91% in the more stringent [email protected]:0.95 metric, respectively.

In GNSS/IMU integrated navigation systems, factors such as satellite occlusion and non-line-of-sight conditions can lead to degradation of satellite positioning results, Subsequently affecting the overall accuracy of the integrated navigation system. To address this issue and ef-fectively utilize historical pseudorange information from satellites, this paper proposes a graph optimization-based GNSS/IMU model with virtual constraints. These virtual constraints are con-structed using satellite ‘s position from previous time step, the rate of change of pseudoranges, and ephemeris data. This virtual constraint can serve as an alternative solution for individual satellites in case of signal anomalies, ensuring the integrity and continuity of the graph optimi-zation model. Additionally, this paper conducts an analysis of the graph optimization model constructed using these virtual constraints, comparing it with traditional integrated navigation graph optimization model, and analyzes and reconstructs the marginalization process based on these virtual constraints. The experimental results, compared with tightly coupled Kalman fil-tering and the original graph optimization method on a set of real-world data, demonstrate that the introduction of virtual pseudoranges maintains high positioning accuracy. The RMSE error between it and the original graph optimization remains within 5%, affirming the high feasibility of this approach.

Within environmental perception, automatic navigation and object detection, computer vision is a crucial and demanding field with many applications in modern industries, such as multi-target long-term visual tracking in automated production, defect detection, and driverless robotic vehicles with sensing ability. The performance of computer vision has greatly improved recently thanks to developments in deep learning algorithms and hardware computing capabilities, which has spawned the creation of a large number of related applications. This paper presents the results of a detailed review of over 50 papers published over the course of two decades (1999–2024), with a primary focus on the technical advancement of computer vision. To elucidate the foundational principles, an examination of typical visual algorithms based on traditional correlation filtering was initially conducted. Subsequently, a comprehensive overview of the most recent advancements in deep learning-based computer vision techniques was compiled. Furthermore, a comparative analysis between conventional and novel algorithms was undertaken to discuss the future trends and directions of computer vision. Lastly, the feasibility of employing visual SLAM (Simultaneous Localization and Mapping) algorithms in the context of autonomous vehicles with sensing capability was explored. Furthermore, we explored a thorough and efficient architecture for utilizing these techniques in autonomous robotic vehicles into unmanned green and low-carbon smart factories, underlining novel advances as well as potential prospects for future research.

There have been multiple technological advancements that promise to gradually enable devices to measure and record signals with high resolution and accuracy in the domain of Brain Computer Interfaces (BCI). Multi-modal BCIs have been able to gain significant traction given the potential to enhance signal processing by integrating different recording modalities. In this review, we explore the integration of multiple neuroimaging and neurophysiological modalities including Electroencephalography (EEG), Magnetoencephalography (MEG), Functional Magnetic Resonance Imaging (fMRI), Electrocorticography (ECoG), and Single-Unit Activity (SUA). This multimodal approach leverages the high temporal resolution of EEG and MEG with the spatial precision of fMRI, the invasive yet precise nature of ECoG, and the single-neuron specificity provided by SUA. The paper highlights the advantages of integrating multiple modalities, such as increased accuracy and reliability, and discusses the challenges and limitations of multimodal integration. Furthermore, we explain the data acquisition approaches for each of these modalities. We also demonstrate various software programs that help in extracting, cleaning, and refining the data. We conclude this paper with discussion on the available literature highlighting recent advances, challenges, and future directions for each of these modalities.

The analysis of social media content plays a crucial role in uncovering intricate user behaviors and trends across diverse digital platforms. Social media is inherently multimodal, incorporating texts, images, audios, and videos, each offering unique insights into user engagement and preferences. Traditional classification methods often focus narrowly on the most prominent modality, typically neglecting the synergistic potential of integrating multiple data types. To address this gap, we introduce the Unified Multimodal Classifier (UMC), a suite of streamlined models that adeptly harness and integrate these varied modalities. UMC leverages a novel architecture that combines a pooling layer with auxiliary learning tasks, facilitating the formation of a robust and shared feature space. This integration allows UMC to not only accommodate but also capitalize on the inherent diversity of social media data. The models are designed to be inherently flexible, adjusting to the availability of data modalities and maintaining high classification accuracy under varied conditions. In emotion classification scenarios, UMC has shown exceptional performance, significantly outperforming traditional methods by effectively synthesizing information across modalities. Its robustness is highlighted in its ability to deliver consistent results, even in the absence of one or more modalities. The simplicity and efficiency of UMC make it a potent tool for social media analytics, enabling it to achieve higher accuracies and maintain effectiveness even with limited data inputs. This adaptive capability ensures that UMC can be deployed in real-world applications where data incompleteness is common, thus broadening the scope of its applicability in various analytical contexts.

In today’s Web 2.0 era, online social media has become an integral part of our lives. In the course of the information revolution, the form of information has undergone a radical change, from simple text information to today’s integrated video, image, text and audio, and there has also been a great change in the way of dissemination and access, as people nowadays do not just rely on traditional media to passively receive information, but more actively and selectively obtain information from social media. Therefore, it has become a great challenge for us to effectively utilize these massive and integrated multi-modal media information to form an effective system of retrieval, browsing, analysis and usage. Unlike movies and traditional long-form video content, micro-videos are usually short in length, between a few seconds and tens of seconds, which allows users to quickly browse different contents and make full use of the fragmented time in their lives, while users can also share their micro-videos to their friends or the public, forming a unique social way. Video contains rich multimodal information, and fusing information from multiple modalities in a video recommendation task can improve the accuracy of the video recommendation task.According to the micro-video recommendation task, a new combinatorial network model is proposed to combine the discrete features of each modality into the overall features of various modalities through the network, and then fuse the various modal features to obtain the overall video features, which will be used for recommendation. In order to verify the effectiveness of the algorithm proposed in this paper, experiments are conducted in the public dataset, and it is shown the effectiveness of our model.

Cascading landslides represent a dynamic and hazardous geological phenomenon, char-15 acterized by a sequential chain of slope failures triggered by various factors such as heavy rainfall, 16 seismic activity, or anthropogenic activities. These events can amplify the damage caused by the 17 initial trigger and propagate instability along a slope, often resulting in significant environmental 18 and societal impacts. The Morino-Rendinara cascading landslide, situated in the Ernici mountains 19 along the border of Abruzzo and Lazio region (Italy), serves as a notable example of the complexities 20 and devastating consequences associated with such events. In March 2021, a substantial debris flow 21 event in Morino obstructed the Liri River, marking the latest step in a series of landslide events 22 characterized by a complexity far beyond initial expectations. This study employs a multidiscipli-23 nary approach, combining conventional techniques and advanced technologies, to understand the 24 complexities of the Morino-Rendinara landslide. Field activities, UAV image acquisition, SAR inter-25 ferometry based on SENTINEL-1 images and pixel offset analysis based on high-resolution Google 26 Earth images, offer insights into the geological and hydrogeological setting of the unstable slope, 27 landslide geometry, mechanism and kinematics. To supplement the analysis a specific FEM slope 28 stability analyses is used to reconstruct the deep geometry of the system emphasizing the modula-29 tion action of groundwater flow to the slope stability

Determining precise boundaries and protective zones for historical and cultural objects enables their effective preservation. This is particularly crucial in the face of increasing tourism, urbanization, and natural disasters. Accurately defining boundaries and protective zones can aid in the planning of scientific research, archaeological excavations, and other studies aimed at exploring the history and cultural significance of these objects. The article presents the framework for establishing protective zones around historical and cultural heritage sites existing in Ukraine, using the example of the Citadel defensive complex located in Lviv (Ukraine). It proposes general and detailed conceptual models for the combined application of remote and non-invasive methods for investigating historical and cultural heritage sites. This conceptual article introduces the theory of integrating radar satellite imaging with ground-based georadar imaging. Additionally, it presents a software module that has been developed to analyze collected data on two-dimensional historical and cultural heritage objects, refine their boundaries, and establish protective zones around them.

Rapid and accurate detection of road cracks is of great significance for road health monitoring, but currently this work is mainly completed through manual site surveys. Low-altitude UAV remote sensing can obtain images with centimeter or even subcentimeter ground resolution, which provides a new efficient and economical approach for rapid crack detection. Nevertheless, crack detection networks face challenges such as edge blurring and misidentification due to the heterogeneity of road cracks and the complexity of the background. To address these issues, we propose a real-time edge reconstruction crack detection network (ERNet) which adopts multi-level information aggregation to reconstruct crack edges and improve the accuracy of segmentation between the target and background. To capture global dependencies across spatial and channel levels, we propose an efficient bilateral decomposed convolutional attention module (BDAM) that combines depth separable convolution and dilated convolution to capture global dependencies across spatial and channel levels. To enhance the accuracy of crack detection, we use a coordinate-based fusion module that integrates spatial, semantic, and edge reconstruction information. In addition, we propose an automatic measurement of crack information for extracting the crack trunk and its corresponding length and width. Experimental results demonstrate that our network achieves the best balance between accuracy and inference speed.

The study put forward a data fusion approach for urban remote sensing that combines SAR (Synthetic Aperture Radar) and optical satellite data. By integrating datasets from different sensors and spatial-temporal scales, the technique aims to extract more accurate information. The fusion approach utilizes two methods: feature-based fusion, where relevant features are extracted and fused, and simple layer stacking (SLS), where the original datasets are directly stacked as multiple layers. This study extracted features using SAR textures (using Sentinel-1) and modified indices (using Landsat-8), and then classified these features using an XGBoost algorithm implemented in Python and Google Earth Engine. Researchers examined five cities, each representing a distinct climatic zone and urban dynamic: Cape Town, Guangzhou, Los Angeles, Mumbai, and Osaka. An accuracy assessment was conducted using random validation points, achieving an overall accuracy of 89.5% using the proposed MSFI method. A comparison was also performed with three well-known global products. The proposed approach, outperformed all three global products achived 89% accuracy while ESA (84%), ESRI (81%) and Dynamic World (82%). Additionally, Land surface temperature analysis was accomplished to investigate the relationship between extracted UIS and Land Surface Temperature (LST) across selected cities to show the practical use of proposed MSFI method. Los Angeles, a warm temperate city, showed the highest LST among all five cities. The datasets, along with the GEE and Python codes, are available at https://github.com/mnasarahmad/sls.

As the fast growth of information technology (IT), the safety of image transmission and the storing of images are increasingly concerned. Traditional image encryption algorithms have certain limitations in transmission and security, so there is an urgent need for a secure and reliable image encryption algorithm. A universal compression sensing (CS) image encryption (IE) algorithm based on DNA-triploid mutation (DTM) is presented in this paper. Firstly, by using CS algorithm an image is compressed while obtaining a range of chaotic sequences by iteration of chaotic map. Then DNA sequences are generated by encoding the image, and based on the DTM, new mutant DNA sequences are generated according to specific rules. Next, the chaotic sequences are operated at the DNA level to do confusion and diffusion operations on the image to ensure the security of the data. At last, DNA decoding is carried out to obtain the compressed-encrypted image. Both simulation experiments and performance tests fully show that a high level of security and reliability of the proposed algorithm in protecting image privacy is achieved.

Statistical denoising techniques have been well studied, however many challenges still remain. This 9 article focuses on determining the least necessary number of significant samples in a statistical pop-10 ulation sampling, while minimizing the impact on the statistical detection of the fiber Bragg grating 11 (FBG) power spectra. This is achieved by using Bayesian decision making, small population statis-12 tics while excluding false detection. First, we investigate the impact of two-sided sliding window 13 technique applied near the cell under the test. The window size varies from 8 to 60 samples. The 14 considered maximum size of population sampling is connected with the number of wavelength 15 samples within the bandwidth of the symmetrical FBG power spectra peaks. Regarding the sym-16 metry of FBG power spectra peaks and the possible reduction of computational demands, we inves-17 tigate the impact of a one-sided sliding window. This enables to achieve less processing latency for 18 real time applications thus brings benefits to FBG-based fiber optical sensing. Both, two- and one-19 sided small population sampling techniques are then experimentally verified. Detection results are 20 analyzed in depth via calculating detection thresholds by using the small size window sliding along-21 side the waveband. From results achieved, it was found that the normality three-sigma rule does 22 not need to be followed while using the small population sampling. Experimental demonstrations 23 and analyses showed that the proposed concept of denoising and statistical threshold detection 24 based on the sliding window does not depend on the prior knowledge of probability distribution 25 functions of the FBG power spectra peaks level and background noise. We have also found that the 26 thresholds’ adaptability mainly depends on the statistical numerical characteristics of the above ad-27 ditive mixture of the FBG power spectra peaks signals and background noise.

The next-generation communication systems demand integration of sensing, communication, and power transfer (PT) capabilities, requiring high spectral efficiency, energy efficiency, and low cost, while also necessitating robustness in high-speed scenarios. Integrated sensing and communication systems (ISACS) exhibit the ability to simultaneously perform communication and sensing tasks using a single RF signal, while simultaneous wireless information and power transfer (SWIPT) systems can handle simultaneous information and energy transmission, and orthogonal time frequency space (OTFS) signals are adept at handling high Doppler scenarios. Combining the advantages of these three technologies, a novel cyclic prefix (CP) OTFS based integrated simultaneous wireless sensing, communication, and power transfer system (ISWSCPTS) framework is proposed in this work. Within the ISWSCPTS, the CP-OTFS matched filter (MF) based target detection and parameters estimation (MF-TDaPE) algorithm is proposed to endow the system with sensing capabilities. To enhance the system’s sensing capability, a waveform design algorithm based on CP-OTFS ambiguity function shaping (AFS) is proposed, which is solved by iteratively method. Furthermore, to maximize the system’s sensing performance under communication and PT Quality of Service (QoS) constraints, a semidefinite relaxation (SDR) beamforming design (SDR-BD) algorithm is proposed, solved using through SDR technique. Simulation results demonstrate that the ISWSCPTS exhibits stronger parameter estimation performance in high-speed scenarios compared to orthogonal frequency division multiplexing (OFDM), waveform designed by CP-OTFS AFS demonstrates superior interference resilience, and beamforming designed by SDR-BD strikes a balance in the overall performance of the ISWSCPTS.

The shift towards autonomous excavators in construction and mining is a significant leap towards enhancing operational efficiency and ensuring worker safety. However, it presents challenges such as the need for sophisticated decision-making and environmental perception due to complex terrains and diverse conditions. Our study introduces the E-GTN framework, a novel approach tailored for autonomous excavation that leverages advanced multisensor fusion and a custom-designed convolutional neural network to address these challenges. Results demonstrate that GridNet effectively processes grid data, enabling the reinforcement learning algorithm to make informed decisions, thereby ensuring efficient and intelligent autonomous excavator performance. The study concludes that the E-GTN framework offers a robust solution for the challenges in unmanned excavator operations, providing a valuable platform for future advancements in the field.

This paper presents the design and analysis of a novel 3-degree-of-freedom (3-DOF) parallel ma-nipulator equipped with self-sensing Ni-Ti (Nitinol) actuators. The manipulator's architecture and mechanical design are elucidated, emphasizing the integration of Nitinol actuators. The self-sensing technique implemented in a previous work was extended to a 20 mm actuator length, and the actuator was used to design the 3 DOF manipulator. Kinematic analyses were conducted to eval-uate the manipulator's performance under various operating conditions. A dynamic model was implemented for the dynamic dimensioning of the actuators, which work synergistically with a bias spring. The manipulator was realized, and a control strategy was implemented. Experimental tests, although documenting some positioning accuracy issues, show the efficacy and potential applica-tions of the proposed manipulator in robotics and automation systems, highlighting the advantages of self-sensing Nitinol actuators in small parallel manipulator designs.

Incorrect sitting posture, characterized by asymmetrical or uneven positioning of the body, often leads to spinal misalignment and muscle tone imbalance. Prolonged maintenance of such postures can adversely impact well-being and contribute to the development of spinal deformities and musculoskeletal disorders. In response, smart-sensing chairs equipped with cutting-edge sensor technologies have been introduced as a viable solution for real-time detection, classification, and monitoring of sitting postures, aiming to mitigate the risk of musculoskeletal disorders and promote overall health. This comprehensive literature review evaluates the current body of research on smart-sensing chairs, with a specific focus on the strategies used for posture detection and classification, as well as the effectiveness of different sensor technologies. A meticulous search across MDPI, IEEE, and Google Scholar databases yielded 34 pertinent studies that utilize non-invasive methods for posture monitoring. The analysis reveals that Force Sensing Resistors (FSR) are the predominant sensors utilized for posture detection, whereas Convolutional Neural Networks (CNN) and Artificial Neural Networks (ANN) are the leading machine learning models for posture classification. However, it was observed that CNNs and ANNs do not outperform traditional statistical models in terms of classification accuracy, due to constrained size and lack of diversity within training datasets. These datasets often fail to comprehensively represent the array of human body shapes and musculoskeletal configurations. Moreover, this review identifies a significant gap in the evaluation of user feedback mechanisms, essential for alerting users to their sitting posture and facilitating corrective adjustments.

Detecting and monitoring changes in soil salinity through remote sensing provides an opportunity for field assessment in regions where on-site measurements are limited. This investigation, carried out in Siwa Oasis, Egypt, aimed to assess the efficacy of several soil salinity indices derived from Landsat 5 and 7 satellite images. To achieve this, 56 on-site ground measurements were utilized for evaluation purposes. The study aimed to improve the correlation between EC and index values and explore the relationship between salinity and changes in land cover. Eleven spectral indices were calculated for nine scenes captured in different months from August to December. The first approach involved stacking the data to identify the index with the strongest correlation with ground EC values, without the need for complex analysis or EC value ranging. In the second approach, the ground EC measurements were classified into seven different salinity categories, and the correlation coefficient was calculated between each index and each salinity category. The third approach analyzed the data temporally, considering different salinity levels. Lastly, a spatial correlation analysis was conducted between EC and index values in the fourth scenario. The initial approach revealed a weak correlation due to substantial variation in EC values. However, the SI index demonstrated the highest correlation coefficient of 0.38. In the second scenario, the S2 index exhibited the highest correlation of 0.96 for moderate salinity samples. The third scenario showed that the S1 index achieved the highest correlation value of 0.99 for moderately saline areas. In the fourth scenario, the SI index exhibited the strongest correlation among all four ponds with correlation coefficients of 0.23, 0.23, 0.18, and 0.61. Notably, the correlations observed in the second and third scenarios demonstrated higher correlation coefficients compared to both the first and fourth scenarios. The study highlighted significant variations in EC levels related to land cover types and pond elevation. Additionally, remote sensing methods detected a 48% increase in total vegetated area over 17 years, showing the potential of remote sensing techniques in salinity monitoring for expanding agriculture and improving land management.

Forest fires can occur suddenly and have significant environmental, economic, and social consequences. Timely and accurate evaluation and prediction of their progression, particularly the spread speed in difficult-to-access areas, are essential for emergency management departments to proactively implement prevention strategies and scientifically extinguish fires. This paper provides a comprehensive analysis of advanced technologies for predicting forest fire spread in China and globally. Incorporating remote sensing (RS) technology and forest fire science as the theoretical foundation, and utilizing the Wang Zhengfei forest fire spread model as the technical framework, this study constructs a forest fire spread model based on remote sensing interpretation. The model optimizes the method for acquiring parameters and enhances algorithm accuracy. By considering regional landforms (ridge lines, valley lines, slopes) and vegetation coverage, this paper establishes visual interpretation markers for identifying hotspots within the spread model. Utilizing statistical data from pixels within the fire line zone transforms the methodology for predicting forest fire spread speed, resulting in greater accuracy compared to conventional fixed-point predictions. Finally, the model was applied to the case of a forest fire in Mianning County, Sichuan Province, China and verified using high-time resolution mid-infrared image data and previous research findings. The results demonstrate that the predicted fire spread area from this RS-enabled model is consistent with both high-time resolution geostationary satellite data and previous research outcomes, indicating high reliability. This model can provide crucial fire spread information to relevant emergency departments, enabling effective preemptive measures and scientific firefighting strategies.

Ecosystem physical structure, defined by the quantity and spatial distribution of biomass, influences a range of ecosystem functions. Remote sensing tools permit the non-destructive characterization of canopy and root features, potentially providing opportunities to link above- and belowground structure at fine spatial resolution in functionally meaningful ways. To test this possibility, we employed ground-based portable canopy lidar (PCL) and ground penetrating radar (GPR) along co-located transects in forested sites spanning multiple stages of ecosystem development and, consequently, of structural complexity. We examined canopy and root structural data for coherence at multiple spatial scales ≤ 10 m within each site using wavelet analysis. Forest sites varied substantially in vertical canopy and root structure, with leaf area index and root mass more evenly distributed by height and depth, respectively, as forests aged. In all sites, above- and belowground structure, characterized as mean maximum canopy height and root mass, exhibited significant coherence at a scale of 3.5-4 meters, and results suggest that the scale of coherence may increase with stand age. Our findings demonstrate that canopy and root structure are linked at characteristic spatial scales, which provides the basis to optimize scales of observation. Our study highlights the potential, and limitations, for fusing lidar and radar technologies to quantitatively couple above- and belowground ecosystem structure.

Sign language recognition is essential in hearing-impaired people’s communication. Sign language recognition is an important concern in computer vision and has been developed with rapid progress in image recognition technology. However, sign language recognition using a general monocular camera has problems with occlusion and recognition accuracy in sign language recognition. In this research, we aim to improve accuracy by using a 2-axis bending sensor as an aid in addition to image recognition. We aim to achieve higher recognition accuracy by acquiring hand keypoint information of sign language actions captured by a monocular RGB camera and adding sensor assist. To improve sign language recognition, we need to propose new AI models. In addition, the amount of dataset is small because it uses the original data set of our laboratory. To learn using sensor data and image data, we used MediaPipe, CNN, and BiLSTM to perform sign language recognition. MediaPipe is a method for estimating the skeleton of the hand and face provided by Google. In addition, CNN is a method that can learn spatial information, and BiLSTM can learn time series data. Combining the CNN and BiLSTM methods yields higher recognition accuracy. We will use these techniques to learn hand skeletal information and sensor data. Additionally, the 2-axis Bending sensor glove data support training AI model. Using these methods, we aim to improve the recognition accuracy of sign language recognition by combining sensor data and hand skeleton data. Our method performed better than using skeletal information, achieving 96.5% accuracy in Top-1.

According to the World Health Organization (WHO), dementia is the seventh leading reason of death among all illnesses and one of the leading causes of disability among the world’s elderly people. Day by day the number of Alzheimer’s patients is raising. Considering the increasing rate and the dangers, Alzheimer’s disease should be diagnosed carefully. Machine learning is a potential technique for Alzheimer’s diagnosis but general users do not trust machine learning models due to the black-box nature. Even, some of those models do not provide the best performance because of using only neuroimaging data. To solve these issues, this paper proposes a novel explainable Alzheimer’s disease prediction model using a multimodal dataset. This approach performs a data-level fusion using clinical data, Freesurfer MRI segmentation data, and psychological data. For Alzheimer’s disease vs cognitively normal prediction, the random forest classifier provides 100% accuracy. Furthermore, Alzheimer’s disease and non-Alzheimer’s dementia should be classified properly because their symptoms are similar. To the best of our knowledge, we are the first to present a three-class classification on Alzheimer’s disease vs cognitively normal vs non-Alzheimer’s dementia and achieved 99.86% accuracy using an ensemble model. Besides, a novel Alzheimer’s patient management architecture is also proposed in this work..

Pseudomonas aeruginosa is an opportunistic Gram-negative bacterium that remains a prevalent clinical and environmental challenge. Quorum sensing (QS) molecules are effective biomarkers in pinpointing the presence of P. aeruginosa. This study aimed to develop a convenient-to-use whole-cell biosensor using P. aeruginosa reporters individually encapsulated within alginate-poly-L-lysine (alginate-PLL) microbeads to specifically detect the presence of bacterial autoinducers. The PLL-reinforced microbeads were prepared using a two-step method involving ionic crosslinking and subsequent coating with thin layers of PLL. The alginate-PLL beads showed good stability in the presence of a known cation scavenger (sodium citrate), which typically limits the widespread applications of calcium alginate. In media containing synthetic autoinducers, such as N-(3-oxo dodecanoyl) homoserine lactone (3-oxo-C12-HSL) and N-butanoyl-L-homoserine lactone (C4-HSL) or cell-free supernatants of planktonic or flow cell biofilm effluent of wild P. aeruginosa (PAO1), the encapsulated bacteria enabled a dose-dependent detection of the presence of these QS molecules. The prepared bioreporter beads remained stable during prolonged storage at 4 and -80 °C and were ready for on-the-spot sensing without the need for recovery. This whole-cell biosensor demonstrates the practicality of the encapsulated bioreporter for bacterial detection based on specific QS molecules.

In an era where dietary habits significantly impact health, technological interventions can offer personalized and accessible food choices. This paper introduces Chef Dalle, a recipe recommen-dation system that leverages multimodal human-computer interaction (HCI) techniques to pro-vide personalized cooking guidance. The application integrates voice-to-text conversion via Whisper, ingredient image recognition through GPT-Vision, and employs TF-IDF vectorization alongside cosine similarity for personalized recipe recommendations. These methods enable users to interact with the system using voice, text, or images, accommodating various dietary re-strictions and preferences. Furthermore, the utilization of DALL-E 3 for generating recipe images enhances user engagement. User feedback mechanisms allow for the refinement of future rec-ommendations, demonstrating the system's adaptability. Chef Dalle showcases potential appli-cations ranging from home kitchens to grocery stores and restaurant menu customization, ad-dresses accessibility, promoting healthier eating habits. This paper underscores the significance of multimodal HCI in enhancing culinary experiences, setting a precedent for future developments in the field.

This study compares the performance of existing studies on multimodal emotion recognition, and proposes a model that fuses two modalities with the speaker's text and voice signals as input values and detects depression. Based on the DAIC-WOZ dataset, voice features were extracted using CNN, text features were extracted using Transformers, and two modalities were fused through a tensor fusion network. We also build a model to detect whether the speaker is depressed or not using LSTM in the final layer. This study suggests the possibility of increasing access to mental illness diagnosis by enabling patients to detect depression on their own in daily conversations. If the model proposed in this study is developed and the voice conversation system is connected, it will be easier for patients who cannot visit the hospital periodically or who are reluctant to visit the hospital to check their condition and seek recovery. Furthermore, it can be expanded to multi-label classification for various mental diseases and used as a simple self-mental disease diagnosis tool.

Chlorophyll-a (Chl-a), a proxy for phytoplankton biomass, is one of the few biological water quality indices detectable using satellite observations. However, models for estimating Chl-a from satellite signals are currently unavailable for many lakes. The application of Chl-a prediction algorithms may be affected by the variance in optical complexity within lakes. Using Lake Winnipeg in Canada as a case study, we demonstrated that separating models by the lake’s basins [north basin (NB) and south basin (SB)] can improve Chl-a predictions. By calibrating more than 40 commonly used Chl-a estimation models using Landsat data for Lake Winnipeg, we achieved higher correlations between in situ and predicted Chl-a when building models with separate Landsat-to-in-situ matchups from NB and SB (R² = 0.85 and 0.76, respectively; p < 0.05), compared to using matchups from the entire lake (R² = 0.38, p < 0.05). In the deeper, clearer waters of the NB, a green-to-blue band ratio provided better Chl-a predictions, while in the shallower, highly turbid SB, a red-to-green band ratio was more effective. Our approach can be used for rapid Chl-a modeling in large lakes using cloud-based platforms like Google Earth Engine with any available satellite or time series length.

Optical wireless video transmission technology combines the advantages of high data rates, enhanced security, large bandwidth capacity, and strong anti-interference capabilities inherent in optical communication, establishing it as a pivotal technology in contemporary data transmission networks. However, video data comprises a large volume of image information, resulting in substantial data flow with significant redundant bits. To address this, we propose an adaptive block sampling compressive sensing algorithm that overcomes the limitations of sampling inflexibility in traditional compressive sensing, which often leads to either redundant or insufficient local sampling. This method significantly reduces the presence of redundant bits in video images. First, the sampling mechanism of the block-based compressive sensing algorithm was optimized. Subsequently, a wireless optical video transmission experimental system was developed using a Field-Programmable Gate Array chip. Finally, experiments were conducted to evaluate the transmission of video optical signals. The results demonstrate that the proposed algorithm improves the Peak Signal-to-Noise Ratio by over 3 dB compared to other algorithms, with an enhancement exceeding 1.5 dB even in field tests, thereby significantly optimizing video transmission quality. This research contributes essential technical insights for the enhancement of wireless optical video transmission performance.

The objective of image super-resolution is to reconstruct a high-resolution (HR) image with the prior knowledge from one or several low-resolution (LR) images. However, in the real world, due to the limited complementary information, the performance of both single-frame and multi-frame super-resolution reconstruction degrades rapidly as the magnification increases. In this paper, we propose a novel two-step image super resolution method concatenating multi-frame super-resolution (MFSR) with single-frame super-resolution (SFSR), to progressively upsample images to the desired resolution. The proposed method consisting of an L0-norm constrained reconstruction scheme and an enhanced residual back-projection network, integrating the flexibility of the variational model-based method and the feature learning capacity of the deep learning-based method. To verify the effectiveness of the proposed algorithm, extensive experiments with both simulated and real world sequences were implemented. The experimental results show that the proposed method yields superior performance in both objective and perceptual quality measurements, compared to the baseline super-resolution algorithms in the cascade model. In addition, the experiment indicates that this cascade model can be robustly applied to different SFSR and MFSR methods.

Recent advances in signal processing and AI-based inference enable the exploitation of communication signals to collect information on devices, people, actions and the environment in general, i.e., to perform Integrated Sensing And Communication (ISAC). This possibility opens new and exciting opportunities for IoT systems, but at the same time poses unprecedented threats to security and privacy of data, devices, and systems. In fact, ISAC operates at the PHY and Medium Access Control (MAC) layers, where it is impossible to protect the information with standard encryption techniques, or with any other purely digital methodologies. The work we present analyzes, within the framework of IoT and distributed, pervasive communication systems, the threats to security and privacy posed by ISAC and how they do intertwine at the PHY layer. Next, possible countermeasures are presented and discussed, with proper architectural choices and tradeoffs to implement them, as well as solutions and protocols to preserve the potential benefits of ISAC while ensuring data protection and users’ privacy.

Purpose: National Institute for Health and Care Excellence (NICE) has recently published quality standards for assessment of fall risk and preventing further falls. According to the standards, multifactorial fall risk assessments should include: identification of falls history; analysis of gait, balance, mobility and muscle strength, among other factors. Despite being based on subjective analysis or simple timing and not being multifactorial, physiotherapists and physicians quite often use these tests as reference scales to differentiate between lower and higher risk of falling. Instrumented TUG has been recently reported to provide important additional information to the overall score. Objective: To explore a case-based approach of fall risk assessment to identify the most relevant and informative risk factors that in combination could better define a person risk profile. Materials and Methods: A multifactorial assessment of fall risk through questionnaires, standard functional tests, tests instrumented with inertial sensors, and force platforms has been studied within a group aged 55-80 years old. Different fall risk factors and fall risk assessment methods were analyzed in a case-based descriptive study. Results & Discussion: Subjects at higher risk of falling were identified based on their detailed profiles. A set of features were obtained from the instrumented standard tests differing significantly between subjects presenting higher or lower fall risk. Therefore, instrumenting conventional tests with wearables containing inertial sensors and force platforms gives more detailed and quantitative insights. This information can be used to better define and tailor fall prevention exercises and to improve the follow-up of the evolution of the subject.

With the rapid developments that have been made in computer vision and computer technology, semantic segmentation of high-resolution images has emerged as a mainstream and challenging task. The, segmentation of water areas remains a complex task due to the similar features between water areas or between water areas and other land objects. Meanwhile, since coastlines and riverbanks are typically presented in irregular shapes, it is difficult to obtain the categories of pixels at boundaries. This paper proposed the use of a Water-Land Boundary Attention Network (WLBANet) to improve the accuracy of pixels at boundaries between water and land. This network also reinforced the performance of contextual information extraction into distinguishing between water areas and other land objects. To prove the validity of this proposed network, WLBANet was performed on the Water Land Dataset (WLD), which is also by this paper, and which contains water areas and other land objects categories. The results demonstrates that the proposed method has significant effectiveness.

Iron is an essential nutrient and necessary for biological functions from DNA replication and repair to transcriptional regulation, mitochondrial respiration, electron transfer, oxygen transport, photosynthesis, enzymatic catalysis, and nitrogen fixation. However, due to iron’s propensity to generate toxic radicals which can cause damage to DNA, proteins, and lipids, multiple processes regulate uptake and distribution of iron in living systems. Understanding how intracellular iron metabolism is optimized and how iron is utilized to regulate other intracellular processes is important to our overall understanding of a multitude of biological processes. One of the tools that the cell utilizes to regulate a multitude of functions is ligation of the iron-sulfur (Fe-S) cluster cofactor. Fe-S clusters comprised of iron and inorganic sulfur are ancient components of living matter on earth that are integral for physiological function in all domains of life. Here we will explore the ways in which the cell utilizes Fe-S clusters to sense the intracellular environment and respond to maintain equilibrium.

The relentless advancement and integration of mechanization and intelligence within the coal mining industry, combined with the increasing depths of mining operations, necessitate significantly higher safety standards. This necessity arises due to the increasingly complex geological and coal seam conditions encountered as mining operations delve deeper into the earth. Traditionally, 3D seismic exploration technology has been fundamental in ensuring both operational efficiency and safety in the coal mining sector. However, despite its critical role, this technology still has limitations in detecting and characterizing small-scale geological structures which can pose substantial risks if not accurately identified and mitigated. To address these challenges, this paper introduces a sparsity-constrained adaptive hard thresholding algorithm designed to tackle the spectral inversion optimization problem with an norm constraint for the enhanced retrieval of reflection coefficients, thereby establishing a comprehensive workflow for enhancing seismic data resolution through compressed sensing spectral inversion. Real data validation has demonstrated that this method significantly enhances the resolution of seismic data while maintaining the amplitude integrity and fidelity of the original signals. This improvement allows for a more detailed and accurate characterization of small-scale geological features, which are critical in identifying and mitigating potential hazards within coal mining operations, thus offering robust support for the implementation of more effective safety protocols and disaster prevention strategies in coal mines.

We report the relative humidity (R.H.) sensing response of a resistive sensor, employing sensing layers based on a ternary nanohybrid comprising holey carbon nanohorns (CNHox), potassium chloride (KCl), and polyvinylpyrrolidone (PVP) at mass ratios 7/1/2, 6.5/1.5/2, and 6/2/2 (w/w/w/w). The sensing structure comprises a silicon substrate, a SiO2 layer, and interdigitated transducer (IDT) electrodes. The sensing film is deposited on the sensing structure via the drop-casting method. The sensing layers' morphology and composition are investigated through Scanning Electron Microscopy (S.E.M.) and RAMAN spectroscopy. The ternary hybrid-based thin film resistance increases when the sensors are exposed to R.H., ranging from 0% to 100%. The manufactured devices show a room temperature response comparable to a commercial capacitive R.H. sensor and are characterized by excellent linearity, rapid response time, and good sensitivity. The presented sensors exhibit superior performance in terms of sensitivity compared to other similarly manufactured and tested sensors that employ a CNHox-based sensing layer. We explain the sensing role of each constituent of the ternary hybrid nanocomposites based on their chemical and physical properties, electronic properties, and affinity for water molecules. Different alternative sensing mechanisms are considered and discussed, such as the decreasing number of holes in the holey CNHox at the interaction with water molecules, proton conduction, and PVP swelling.

Although, promotion of urbanization culture in recent decades has made inevitable development of cities in the world, however, the development can be guided in a direction that leave, to the extent possible, minimum socioeconomic and environmental impacts. For this, it is required to first forecast auto-spreading orientation of cities and suburbs in rural areas over time and then avoid shapeless growth of cities. This paper is an attempt to develop a dynamic hybrid model based on logistic regression (LR), Markov chain (MC), and cellular automata (CA) for prediction of future urban sprawl in fast-growing cities. The model was developed using 12 widely-used urban development criteria, whose significant coefficient was determined by logistic regression, and validated by relative operating characteristic (ROC) analysis. The validated model was run in Guilan, a tourist province in northern Iran with a very high rate of urban development. For this, changes in the area of urban land use were detected over the period of 1989 to 2013 and then, future sprawl of the province was forecasted by the years 2025 and 2037. The analysis results revealed that the area of urban land use was increased by more than 1.7 % from 36012.5 ha in 1989 to 59754.8 ha in 2013, and the area of Caspian Hyrcanian forestland was reduced by 31628 ha. The results also predicted an alarming increase in the rate of urban development in the province by the years 2025 and 2037, during which urban land use is predicted to develop 0.9 % and 1.38 %, respectively. The development pattern is expected to be uneven and scattered, without following any particular direction. The development will occur close to the existing or newly-formed urban basements as well as around major roads and commercial areas. This development, if not controlled, will lead to the loss of 13863 ha of Hyrcanian forests and if the trend continues, 21013 ha of Hyrcanian forests and 20208 ha of Barren/open lands are expected to be destroyed by the year 2037. In general, the proposed model is an efficient tool for the support of urban planning decisions and facilitates the process of sustainable development of cities by providing decision-makers with an overview on future development of cities where the growth rate is very fast.

This manuscript offers a concise overview of paper microfluidics, emphasizing its sustainable sensing applications in healthcare, environmental monitoring, and food safety. Researchers have developed innovative sensing platforms for detecting pathogens, pollutants, and contaminants by leveraging the paper’s unique properties, such as biodegradability and affordability. These portable, low-cost sensors facilitate rapid diagnostics and on-site analysis, making them invaluable tools for resource-limited settings. The review discusses fabrication techniques, principles, and applications of paper microfluidics, showcasing its potential to address pressing challenges and enhance human health and environmental sustainability.

Due to the rapid development of unmanned aerial vehicles (UAVs) communication technology, UAVs are gradually competing with primary users (PUs) for spectrum resources. Cognitive radio (CR) is a promising solution to meet the needs. Cooperative spectrum sensing (CSS) is considered as an effective method to detect the PU signal and identify available spectrum resources for UAVs in a cognitive UAV network (CUAVN). However, the cooperative mode among multiple UAVs may incur a high overhead, resulting in performance degradation. Therefore, we introduce a differential sequential 1 (DS1), which incorporates a differential mechanism and leverages the sequential idea based on the classical voting rule to enhance cooperative performance and efficiency. In view of this, we formulate three scenarios to characterize the PU activity and introduce a multi-slot cooperative mode within a single UAV to realize cooperative gain. Further, only the information change about the PU status is sequentially calculated in DS1, and combined with a sequential idea, the efficiency of the voting rule is greatly improved. Moreover, the application of support vector machines (SVM) in dynamic selection enables the selection of the most suitable voting rule based on diverse sensing parameters. This dynamic selection process ensures optimal performance and efficiency by adapting the voting rule to the specific characteristics of the given scenario. Finally, simulation results demonstrate that the superiority of our proposal with respect to the detection performance, sample size and the energy efficiency is evident, which proves the high performance of the proposed policy.

Neurodegenerative diseases, such as Alzheimer’s disease and Parkinson’s disease, are caused by a combination of multiple events that damage neuronal function. A well-characterized biomarker of neurodegeneration is proteinaceous aggregates accumulation in the brain. However, the gradually worsening symptoms of neurodegenerative diseases are unlikely to be solely due to the result of a mutation in a single gene, but rather a multi-step process involving epigenetic changes. Multiple epigenetic studies have revealed that modification of histones accompanied by both the local and global remodeling of the chromatin structure and alternations in transcriptional patterns are closely associated with the pathogenesis of neurodegenerative diseases. Unlike DNA mutations, epigenetic alterations are reversible, and therefore raise the possibilities for therapeutic intervention including dietary modifications. Additionally, reactive oxygen species may contribute to the pathogenesis of Alzheimer’s disease and Parkinson’s disease. Given that the antioxidant properties of plant-derived phytochemicals are likely to exhibit pleiotropic effects against ROS-mediated epigenetic alternation, dietary intervention may be promising for the management of neurodegeneration in these diseases. In this review, the state-of-the-art applications using single-cell multi-modal omics approaches including genetics, and epigenetics, and dietary approaches for the identification of novel biomarkers and therapeutic approaches for the treatment of neurodegenerative diseases are discussed.

Multimodal user interfaces promise a natural and intuitive human machine interactions. But is the extra effort for the development of a complex multi-sensor system justified, or can users also be satisfied with one input modality already? This study investigates interactions in an industrial weld inspection workstation. Three unimodal interfaces, including spatial interaction with buttons augmented on a workpiece or a worktable, and speech commands, were tested individually and in a multimodal combination. Within the unimodal conditions, users preferred the augmented worktable, but overall, the interindividual usage of all input technologies in the multimodal condition was ranked best. Our findings indicate that the implementation and use of multiple input modalities is valuable, and that it is difficult to predict the usability of individual input modalities for complex systems.

The exponential growth of multimodal content across social media platforms, comprising text, images, audio, and video, has catalyzed substantial interest in artificial intelligence, particularly in multi-modal sentiment analysis (MSA). This study presents a comprehensive survey of 30 research papers published between 2020 and 2024 by eminent publishers such as Elsevier, ACM, IEEE, Springer, and others indexed in Google Scholar. Our analysis primarily focuses on exploring multimodal fusion techniques and features, with specific emphasis on the integration of text and image data. Additionally, the article offers an overview of the evolution, definition, and historical context of MSA. It delves into the current challenges and potential advantages of MSA, investigating recent datasets and sophisticated models. Furthermore, the study provides insights into prospective research directions. Notably, this review offers valuable recommendations for advancing research and developing more robust MSA models, thus serving as a valuable resource for both academic and industry researchers engaged in this burgeoning field.

The advent of the era of big data will bring more convenience to people and greater development to society. But at the same time, it will also bring people the problem of 'information overload', i.e., when people are faced with huge information data, there are many redundant and worthless data. The redundant and worthless data information seriously interferes with the accurate selection of information data. Even though people can use Internet search engines to access information data, they cannot meet the individual needs of specific users in specific contexts. The personalized needs of a particular user in a particular context. Therefore, how to find useful and valuable information quickly has become one of the key issues in the development of big data. With the advent of the era of big data, recommendation systems, as an important technology to alleviate information overload, have been widely used in the field of e-commerce. Recommender systems suffer from a key problem: data sparsity. The sparsity of user history rating data causes insufficient training of collaborative filtering recommendation models, which leads to a significant decrease in the accuracy of recommendations. In fact, traditional recommendation systems tend to focus on scoring information and ignore the contextual context in which users interact. There are various contextual modal information in people's real life, which also plays an important role in the recommendation process. In this paper we achieve data degradation and feature extraction, solving the problem of sparse data in the recommendation process. An interaction context-aware sub-model is constructed based on a tensor decomposition model with interaction context information to model the specific influence of interaction context in the recommendation process. Then an attribute context-aware sub-model is constructed based on the matrix decomposition model and using attribute context information to model the influence of user attribute contexts and item attribute contexts on recommendations. In the process of building the model, the method not only utilizes the explicit feedback rating information of users in the original dataset, but also utilizes the interaction context and attribute context information of the implicit feedback and the unlabeled rating data. We evaluate our model by extensive experiments. The results illustrate the effectiveness of our recommender model.

Hateful and abusive speech presents a major challenge for all online social media platforms. Recent advances in Natural Language Processing and Natural Language Understanding allow more accurate detection of hate speech in textual streams. This study presents a multimodal approach to hate speech detection by combining Computer Vision and Natural Language processing models for abusive context detection. Our study focuses on Twitter messages and, more specifically, on hateful, xenophobic and racist speech in Greek aimed at refugees and migrants. In our approach we combine transfer learning and fine-tuning of Bidirectional Encoder Representations from Transformers (BERT) and Residual Neural Networks (Resnet). Our contribution includes the development of a new dataset for hate speech classification, consisting of tweet ids, along with the code to obtain their visual appearance, as they would have been rendered in a web browser. We have also released a pre-trained Language Model trained on Greek tweets, which has been used in our experiments. We report a consistently high level of accuracy (accuracy score=0.970, f1-score=0.947 in our best model) in racist and xenophobic speech detection.

Globally, there is massive uptake and explosion of data and challenge is to address issues like scale, pace, velocity, variety, volume and complexity of this big data. Considering the recent epidemic in China, modeling of COVID-19 epidemic for cumulative number of infected cases using data available in early phase was big challenge. Being COVID-19 pandemic during very short time span, it is very important to analyze the trend of these spread and infected cases. This chapter presents medical perspective of COVID-19 towards epidemiological triad and the study of state-of-the-art. The main aim this chapter is to present different predictive analytics techniques available for trend analysis, different models and algorithms and their comparison. Finally, this chapter concludes with the prediction of COVID-19 using Prophet algorithm indicating more faster spread in short term. These predictions will be useful to government and healthcare communities to initiate appropriate measures to control this outbreak in time.

Affordances are an important concept in cognition, which can be applied to robots in order to perform a successful human-robot interaction (HRI). In this paper we explore and discuss the idea of emotional affordances and propose a viable model for implementation into HRI. We consider “2-ways” affordances: perceived object triggering an emotion, and perceived human emotion expression triggering an action. In order to make the implementation generic, the proposed model includes a library that can be customised depending on the specific robot and application’s scenario. We present the AAA (Affordance-Appraisal-Arousal) model, which incorporates Plutchik’s Wheel of Emotions, and show some examples of simulation and possible scenarios.

The radar sensor described realizes healthcare monitoring capable of detecting subject chest-wall movement caused by cardiopulmonary activities, and wirelessly estimating the respiration and heartbeat rates of the subject without attaching any devices to the body. Conventional single-tone Doppler radar can only capture Doppler signatures because of a lack of bandwidth information with noncontact sensors. In contrast, we take full advantage of impulse radio ultra-wideband (IR-UWB) radar to achieve low power consumption and convenient portability, with a flexible detection range and desirable accuracy. A noise reduction method based on improved ensemble empirical mode decomposition (EEMD) and a vital sign separation method based on the continuous-wavelet transform (CWT) are proposed jointly to improve the signal-to-noise ratio (SNR) in order to acquire accurate respiration and heartbeat rates. Experimental results illustrate that respiration and heartbeat signals can be extracted accurately under different conditions. This noncontact healthcare sensor system proves the commercial feasibility and considerable accessibility of using compact IR-UWB radar for emerging biomedical applications.

The rapid advancements in satellite technology have led to a significant increase in high-resolution remote sensing (RS) images, necessitating advanced processing methods. Additionally, a patent analysis revealed a significant increase in deep learning and machine learning applications in remote sensing, highlighting the growing importance of these technologies. Therefore, this paper introduces the Kolmogorov-Arnold Network (KAN) model to remote sensing, aiming to enhance efficiency and performance in RS applications. We conducted several experiments to validate KAN's applicability, starting with the EuroSAT dataset, where we combined the KAN layer with multiple pretrained CNN models. The optimal performance was achieved with ConvNeXt, leading to the development of the KonvNeXt model. KonvNeXt was evaluated on the Optimal-31, AID, and Merced datasets for validation, and it achieved accuracies of 90.59%, 94.1%, and 98.1%, respectively. The model also showed fast processing speed, with the Optimal-31 and Merced datasets completed in 107.63 seconds each, while the bigger and more complicated AID dataset took 545.91 seconds. This result is meaningful since it achieved faster speeds and comparable accuracy compared to the existing study which utilized VIT and proved KonvNeXt's applicability for remote sensing classification tasks. Furthermore, we investigated the model's interpretability by utilizing Occlusion Sensitivity and by displaying the influential regions, it validated its potential use in a variety of domains including medical imaging and weather forecasting. This paper is meaningful in that it is the first use of KAN in remote sensing classification, proving its adaptability and efficiency.