Estimating the Remaining Useful Life (RUL) of aircraft engines holds a pivotal role in enhancing safety, optimizing operations, and promoting sustainability, thus being a crucial component of modern aviation management. Precise RUL predictions offer valuable insights into an engine’s condition, enabling informed decisions regarding maintenance and crew scheduling. In this context, we propose a novel RUL prediction approach in this paper, harnessing the power of Bi-directional LSTM and Transformer architectures, known for their success in sequence modeling, such as natural languages. We adopt the encoder part of the full Transformer as the backbone of our framework, integrating it with a self-supervised denoising autoencoder that utilizes Bidirectional LSTM for improved feature extraction. Within our framework, a sequence of multivariate time series sensor measurements serves as the input, initially processed by the Bidirectional LSTM autoencoder to extract essential features. Subsequently, these feature values are fed into our Transformer encoder backbone for RUL prediction. Notably, our approach simultaneously trains the autoencoder and Transformer encoder, different from the naive sequential training method. Through a series of numerical experiments carried out on the C-MAPSS datasets, we demonstrate that the efficacy of our proposed models either surpasses or stands on par with that of other existing methods.

In industrial settings, gears play a crucial role by assisting various machinery functions such as speed control, torque manipulation, and altering motion direction.The malfunction or failure of these gear components can have serious repercussions, resulting in production halts and financial losses. As a result, there is an increasing requirement to monitor the state of these components in order to avoid such issues from occurring. To address this need, research efforts have focused on early defect detection in gears in order to reduce the impact of possible failures. This study focused on analyzing vibration and thermal datasets from two extruder machine gearboxes using an autoencoder Long Short-Term Memory (LSTM) model. The major goal is to implement an outlier detection approach to detect and classify defects. The results of this study highlighted the extraordinary performance of the Autoencoder LSTM model, which achieved an impressive accuracy rate of 94.42% in recognizing malfunctioning gearboxes within the extruder machine system. Furthermore, the study used a thorough global metrics evaluation methodology to further test the model’s dependability and efficacy, consequently substantiating the proposed approach’s validity.

Radiator reliability is crucial in environments characterized by high temperatures and friction, where prompt interventions are often required to prevent system failures. This study introduces a proactive approach to radiator fault diagnosis, leveraging the integration of Gaussian Mixture Model (GMM) and Long-Short Term Memory (LSTM) autoencoders. Vibration signals from radiators were systematically collected through randomized durability vibration bench tests, resulting in four operating states—two normal, one unknown, and one faulty. Time-domain statistical features of these signals were extracted and subjected to Principal Component Analysis (PCA) to facilitate efficient data interpretation. Subsequently, this study discusses the comparative effectiveness of GMM and LSTM in fault detection. GMMs are deployed for initial fault classification, leveraging their clustering capabilities, while LSTM autoencoders excel in capturing time-dependent sequences, facilitating advanced anomaly detection for previously unencountered faults. This alignment offers a potent and adaptable solution for radiator fault diagnosis, particularly in challenging high-temperature or high-friction environments. Consequently, the proposed methodology not only provides a robust framework for early-stage fault diagnosis but also effectively balances diagnostic capabilities during operation. Additionally, this study presents the foundation for advancing reliability life assessment in accelerated life testing, achieved through dynamic threshold adjustments using both the absolute log-likelihood distribution of the GMM and the reconstruction error distribution of the LSTM autoencoder model.

The CAN protocol is widely adopted for in-vehicle networks due to its cost efficiency and reliable transmission. However, despite its popularity, the protocol lacks built-in security mechanisms, making it vulnerable to various attacks such as flooding, fuzzing, and DoS. These attacks can exploit vulnerabilities and disrupt the normal behavior of the in-vehicle network. One of the main reasons for these security concerns is that the protocol relies on broadcast frames for communication between ECUs within the network. To tackle this issue, this paper presents an intrusion detection system that leverages multiple LSTM-Autoencoders. The proposed system utilizes diverse features, including transmission interval and payload value changes, to capture various characteristics of normal network behavior. By analyzing different types of features separately using the LSTM-Autoencoder model, the system effectively detects anomalies. In our evaluation, we conducted experiments using real vehicle network traffic, and the results demonstrated the system's high precision with a 99% detection rate in identifying anomalies.

Anomaly occurrences in hydraulic machinery may lead to massive systems shut down, jeopardizing the safety of the machinery and its surrounding human operator(s) and environment, and the severe economic implications succeeding the faults and their associated damage. Hydraulics are mostly placed in ruthless environments, where they are consistently vulnerable to many faults. Hence, not only the machines and their components are prone to anomalies, but also the sensors attached to them, which monitor and report their health and behavioral changes. In this work, a comprehensive applicational analysis of anomalies in hydraulic systems extracted from a hydraulic test rig is thoroughly achieved. Firstly, we provided a combination of a new architecture of LSTM autoencoders and supervised machine and deep learning methodologies to perform two separate stages of fault detection and diagnosis. The two phases are condensed by: the detection phase using the LSTM autoencoder. Followed by the fault diagnosis phase represented by the classification schema. The previously mentioned framework is applied to both component and sensor faults in hydraulic systems, deployed in the form of two in-depth applicational experiments. Moreover, a thorough literature review of the past decade related work for the two stages separately is successfully conducted in this paper.

Lamb wave-based structural health monitoring is widely acknowledged as a reliable 11 method for damage identification, classification, localization and quantification. However, due to 12 the complexity of Lamb wave signals, especially after interacting with structural components and 13 defects, interpreting these waves and extracting useful information about the structure's health is 14 still a major challenge. However, deep learning-based strategy offers a great opportunity to address 15 such challenges as the algorithm can operate directly on raw discrete time-domain signals. Unlike 16 traditional methods, which often require careful feature engineering and preprocessing, deep learn-17 ing can automatically extract relevant features from the raw data. This paper proposes an autoen-18 coder based on a bidirectional long short-term memory network with maximal overlap discrete 19 wavelet transform layer to detect the signal anomaly and determine the location of the damage in 20 the composite structure. This approach has the potential to greatly enhance our ability to detect and 21 locate structural damage in composite structures, thereby increasing safety and efficiency.

We present a Deep Learning generative model specialized to work with graphs with a regular geometry. It is build on a Variational Autoencoder framework and employs Graph convolutional layers in both encoding and decoding phases. We also introduce a pooling technique (ReNN-Pool), used in the encoder, that allows to downsample graph nodes in a spatially uniform and highly interpretable way. In the decoder, a symmetrical un-pooling technique is used to retrieve the original dimensionality of graphs. Performance of the model are tested on the standard Sprite benchmark dataset, a set of 2D images of video game characters, adequately transforming images data into graphs, and on the more realistic use-case of a dataset of cylindrical-shaped graph data that describe the distributions of the energy deposited by a particle beam in a medium.

We present a method to improve the reconstruction and generation performance of variational autoencoder (VAE) by injecting an adversarial learning. On the other hand, instead of comparing the reconstructed with the original data to calculate the reconstruction loss, we use a consistency principle for deep features. The training process of the VAE is then divided into two steps, training the encoder and then training the decoder. By using this two-step learning process, our method can be more widely used in applications other than image processing. While training the encoder, the label information is integrated to better structure the latent space in a supervised way. The adversarial constraints allow the decoder to generate data with better authenticity and more realistic than the conventional VAE. We present experimental results to show that our method gives better performance than the original VAE.

Anomaly detection and segmentation aim at distinguishing abnormal images from normal images and further localizing the anomalous regions. Feature reconstruction based method has become one of the mainstream methods for this task. This kind of method has two assumptions: (1) The features extracted by neural network is a good representation of the image. (2) The autoencoder solely trained on the features of normal images cannot reconstruct the features of anomalous regions well. But these two assumptions are hard to meet. In this paper, we propose a new anomaly segmentation method based on feature reconstruction. Our approach mainly consists of two parts: (1) We use a pretrained vision transformer (ViT) to extract the features of the input image. (2) We design a self-attention autoencoder to reconstruct the features. We regard that the self-attention operation which has a global receptive field is beneficial to the methods based on feature reconstruction both in feature extraction and reconstruction. The experiments show that our method outperforms the state-of-the-art approaches for anomaly segmentation on the MVTec dataset. It is both effective and time-efficient.

Accurate classification of objects in 3D point clouds is a significant problem in several applications, such as autonomous navigation and augmented/virtual reality scenarios, which has become a research hot spot. In this paper, we presented a deep learning strategy for 3D object classification in augmented reality. The proposed approach is a combination of the GRU and LSTM. LSTM networks learn longer dependencies well, but due to the number of gates, it takes longer to train; on the other hand, GRU networks have a weaker performance than LSTM, but their training speed is much higher than GRU, which is The speed is due to its fewer gates. The proposed approach used the combination of speed and accuracy of these two networks. The proposed approach achieved an accuracy of 0.99 in the 4,499,0641 points dataset, which includes eight classes (unlabeled, man-made terrain, natural terrain, high vegetation, low vegetation, buildings, hardscape, scanning artifacts, cars). Meanwhile, the traditional machine learning approaches could achieve a maximum accuracy of 0.9489 in the best case.

The Dst index is the geomagnetic storm index used to measure the energy level of geomagnetic storms, and the prediction of this index is of great significance for the geomagnetic storm study and the solar activity. In contrast to traditional numerical modelling techniques, machine learning, which has emerged in decades ago based on rapidly developing computer hardware and software and artificial intelligence methods, has been unprecedentedly developed in geophysics, especially solar-terrestrial space physics. This study chooses two machine learning models, the LSTM (Long-Short Time Memory, LSTM) and EMD-LSTM model (Empirical Mode Decomposition, EMD), to model and predict the Dst index. By building the Dst index data series from 2018-2023, two models were built to fit and predict the data. Firstly, we evaluated the influences of the learning rate and the amount of training data on the prediction accuracy of the LSTM model, and finally, 10-3 was thought as the optimal learning rate; secondly, the two models were used to predict the Dst index in the solar active and quiet periods, respectively, and the RMSE (Root Mean Square Error) of the LSTM model in the active period is 7.34 nT, the CC (correlation coefficient) is 0.96, those of the quiet period are 2.64nT and 0.97; the RMSE and r of EMD-LSTM model are 8.87nT and 0.93 in active time and 3.29nT and 0.95 in the quiet time. Finally, the prediction accuracy of the LSTM model in short time period is slightly better than the EMD-LSTM model. However, there will be a problem of prediction lag, which the EMD-LSTM model can then solve, and can better predict the geomagnetic storm.

This paper introduces an innovative approach to lipreading, leveraging a web application designed to generate subtitles for videos where the speaker's mouth is visible and a comprehensive literature review that precedes the discussion, encompassing a thorough examination of various lipreading methods employed over the past decade. Our method employs a powerful deep learning model, featuring a 3D-convolution network and bidirectional LSTM, enabling accurate sentence-level predictions based solely on visual lip movements. With an impressive accuracy of 97%, our model is trained using pre-segmented lips regions, transformed into animated GIFs for effective pre-training. This work stands as a significant contribution to the evolving landscape of lipreading research, offering a practical and accurate solution for real-world applications.

The term "code smell" refers to an indication of a problem with the quality of source code. Numerous studies have been conducted to identify problematic features in source code. Initially, the focus was on utilizing metric-based and heuristic-based approaches. In recent years, however, there has been a shift towards using machine learning and deep learning (DL) techniques for smell detection. Nevertheless, the current algorithms are still considered to be in the early stages of development. Recognizing the challenges associated with identifying smells using DL methods, both academics and software developers have made efforts to address these obstacles. This work involves constructing and evaluating new DL models for code smell detection. Two models are built upon stacked autoencoders, employing a hybrid architecture that combines bidirectional long short-term memory and convolutional neural network components.

Self-supervised learning is a method that learns general representation from unlabeled data. Masked image modeling (MIM), one of the generative self-supervised learning methods, has drawn attention showing state-of-the-art performance on various downstream tasks, though showing poor linear separability resulting from the token-level approach. In this paper, we propose a contrastive learning-based multi-view masked autoencoder for MIM, exploiting an image-level approach by learning common features from two different augmented views. We strengthen MIM by learning long-range global patterns from contrastive loss. Our framework adopts simple encoder-decoder architecture, learning rich and general representation by following a simple process: 1) two different views are generated from an input image with random masking and by contrastive loss, we can learn semantic distance of the representations generated by an encoder. By applying a high mask ratio, 80%, it works as strong augmentation and alleviates the representation collapse problem. 2) With reconstruction loss, decoder learns to reconstruct an original image from the masked image. We assess our framework by several experiments on benchmark datasets of image classification, object detection, and semantic segmentation. We achieve 84.3% fine-tuning accuracy on ImageNet-1K classification and 76.7% in linear probing, exceeding previous studies and show promising results on other downstream tasks. Experimental results demonstrate that our work can learn rich and general image representation by applying contrastive loss to masked image modeling.

We proposed a deep learning based chemometric data analysis technique. We trained L2 regularized sparse autoencoder end-to-end for reducing the size of the feature vector to handle the classic problem of curse of dimensionality in chemometric data analysis. We introduce a novel technique of automatic selection of nodes inside hidden layer of an autoencoder through pareto optimization. Moreover, linear regression, ϵ-SVR , and Gaussian process regressor are applied on the reduced size feature vector for the regression. We evaluated our technique on orange juice and wine dataset and results are compared against state-of-the-art methods. Quantitative results are shown on Normalized Mean Square Error (NMSE) and the results show considerable improvement in the state-of- the-art.

Responsible, efficient, and environmentally conscious energy consumption practices are increasingly essential for ensuring the reliability of the modern electricity grid. This study focuses on leveraging time series analysis to improve forecasting accuracy, crucial for various application domains where real-world time series data often exhibit complex, non-linear patterns. Our approach advocates for utilizing Long Short Term Memory (LSTM) and Bidirectional LSTM (BiLSTM) models for precise time series forecasting. To ensure a fair evaluation, we compare the performance of our proposed approach with traditional neural networks, time-series forecasting methods, and conventional decline curves. Additionally, individual models based on LSTM, Bi-LSTM, and other machine learning methods are implemented for a comprehensive assessment. Experimental results consistently demonstrate that our proposed model outperforms all benchmarking methods in terms of mean absolute error (MAE) across most datasets. Addressing the imbalance between activations by consumer and prosumer groups, our predictions show superior performance compared to several traditional forecasting methods, such as the Autoregressive Integrated Moving Average model (ARIMA) and Seasonal Autoregressive Integrated Moving Average model (SARIMA). Specifically, the root mean square error (RMSE) of Bi-LSTM is 5.35%, 46.08%, and 50.6% lower than LSTM, ARIMA, and SARIMA, respectively, on the May test data.

Water distribution networks are often susceptible to pipeline leaks caused by mechanical damages, natural hazards, corrosion, and other factors. This paper focuses on the detection of leaks in water distribution networks (WDN) using a data-driven approach based on machine learning. A hybrid Autoencoder neural network (AE) is developed, which utilizes unsupervised learning to address the issue of unbalanced data (as anomalies are rare events). The AE consists of a 3DCNN encoder, a ConvLSTM decoder, and a ConvLSTM future predictor, making the anomaly detection robust. Additionally, spatial, and temporal attention mechanisms are employed to enhance leak localization. The AE first learns the expected behavior and subsequently detects leaks by identifying deviations from this expected behavior. To evaluate the performance of the proposed method, the Water Network Tool for Resilience (WNTR) Simulator is utilized to generate water pressure and flow rate data in a water supply network. Various conditions such as fluctuating water demands, data noise, and the presence of leaks are considered using the pressure-driven demand (PDD) method. Datasets with and without pipe leaks are obtained, where the AE is trained using the dataset without leaks and tested using the dataset with simulated pipe leaks. The results, based on a benchmark WDN and a confusion matrix analysis, demonstrate that the proposed method successfully identifies leaks in 96% of cases and a false positive rate of 4% compared to a random forest model baseline based on supervised learning with a false positive rate of 15% due to unbalanced data. Furthermore, a real case study demonstrates the applicability of the developed model for leak detection in operational conditions of water supply networks using inline sensor data.

Cognitive neuroscience is the study of how the human brain functions on tasks like decision making, language, perception and reasoning. Deep learning is a class of machine learning algorithms that use neural networks. They are designed to model the responses of neurons in the human brain. Learning can be supervised or unsupervised. Ngram token models are used extensively in language prediction. Ngrams are probabilistic models that are used in predicting the next word or token. They are a statistical model of word sequences or tokens and are called Language Models or Lms. Ngrams are essential in creating language prediction models. We are exploring a broader sandbox ecosystems enabling for AI. Specifically, around Deep learning applications on unstructured content form on the web.

The accurate forecasting of solar power output is essential for ensuring the stable and efficient operation of grid-connected photovoltaic (PV) systems, especially when faced with variable weather patterns. This research focuses on the integration of Machine Learning (ML) methodologies and climatic parameters to predict solar panel energy generation, with a specific emphasis on addressing consumption-production imbalances. Leveraging a dataset sourced from the Kaggle platform, the study is conducted in the context of Estonia, aiming to optimize solar energy utilization in this geographic region. The dataset, obtained from Kaggle, encompasses comprehensive information on climatic variables, including sunlight intensity, temperature, and humidity, alongside corresponding solar panel energy output. Leveraging machine learning algorithms, including XGBoost regression and neural networks, our model aims to identify complex patterns and relationships within the datasets. By tailoring the model to Estonia's climatic nuances, we seek to enhance the accuracy of energy production forecasts and, consequently, better manage the challenges associated with consumption-production imbalances. Furthermore, the research investigates the adaptability of the proposed model to diverse climatic conditions, ensuring its applicability for similar endeavors in other geographical locations. The performance of the forecasting model will be evaluated using error metrics like mean absolute error (MAE) and root mean squared error (RMSE). This study leverages a comprehensive dataset from Kaggle and utilizes advanced machine learning techniques to generate valuable insights. These insights can inform the development of sustainable energy policies and practices, ultimately leading to a more efficient and reliable renewable energy infrastructure.

Vibration signal analysis is regarded as a fundamental approach in diagnosing faults in rolling bearings, and recent advancements have shown notable progress in this domain. However, the presence of substantial background noise often results in the masking of these fault signals, posing a significant challenge for researchers. In response, an Adaptive Denoising Autoencoder (ADAE) approach is proposed in this paper. The data representations are learned by the encoder through convolutional layers, while the data reconstruction is performed by the decoder using deconvolutional layers. Both the encoder and decoder incorporate adaptive shrinkage units to simulate denoising functions, effectively removing interfering information while preserving sensitive fault features. Additionally, dropout regularization is applied to sparsify the network and prevent overfitting, thereby enhancing the overall expressive power of the model. To further enhance ADAE's noise resistance, shortcut connections are added. Evaluation using publicly available datasets under scenarios with known and unknown noise demonstrates that ADAE effectively enhances the signal-to-noise ratio in strongly noisy backgrounds, facilitating accurate diagnosis of faults in rolling bearings.

Human action recognition (HAR) based on skeleton data is a challenging yet important technique because of its wide range of applications in many fields, including patient monitoring, security surveillance, and observing human-machine interactions. Many algorithms that attempt to distinguish between many types of activities have been proposed. However, most practical applications require highly accurate detection of specific types of activities. In this study, a novel and highly accurate spatiotemporal graph autoencoder network for HAR based on skeleton data is proposed. Furthermore, an extensive study was conducted using different modalities. For this purpose, a spatiotemporal graph autoencoder that automatically learns spatial as well as temporal patterns from human skeleton datasets was built. The powerful graph convolutional network named GA-GCN, developed in this study, notably outperforms most of the existing state-of-the-art methods based on two common datasets, namely NTU RGB+D and NTU RGB+D 120 . On the first dataset, we achieved an accuracy of 92.3% and 96.7% based on the cross-subject and cross-view evaluations, respectively. On the other more challenging dataset (i.e. NTU RGB+D 120), GA-GCN achieved 88.8% and 90.4% based on the cross-subject and cross-set evaluation, respectively.

In recent decades, the Variational AutoEncoder (VAE) model has shown good potential and capabilities in image generation and dimensionality reduction. The combination of VAE and various machine learning frameworks has also worked effectively in different daily life applications, however its possibility and effectiveness in modern game design has seldom been explored nor assessed. The use of its feature extractor for data clustering was minimally discussed in literature neither. This paper first attempts to explore different mathematical properties of the VAE model, in particular, the theoretical framework of the encoding and decoding processes, the possible achievable lower bound and loss functions of different applications; then applies the established VAE model into generating new game levels within two well-known game settings; as well as validating the effectiveness of its data clustering mechanism with the aid of the Modified National Institute of Standards and Technology (MNIST) database. Respective statistical metrics and assessments were also utilized for evaluating the performance of the proposed VAE model in aforementioned case studies. Based on the statistical and spatial results, several potential drawbacks and future enhancement of the established model were outlined, with the aim of maximizing the strengths and advantages of VAE for future game design tasks and relevant industrial missions.

This article presents the implementation of a model to estimate the future price of commodities in the Brazilian market from time series of short-term technical evaluation. For this, data from two databases were used, one referring to the foreign market (opening values, maximum, minimum, closing, closing adjustment and volume) and the other, from the Brazilian market (the price of the day), considering commodities, sugar, cotton, corn, soybean and wheat. Subsequently, the technical indicators were calculated from the TA-Lib technical analysis library. Pearson’s correlation coefficient was applied, records with low correlation were removed, and then the database was consolidated. From the pre-processed data, Long Short-Term Memory (LSTM) recurrent neural networks were used to perform data prediction at the one and three day interval. These models were evaluated using the mean square error (MSE), obtaining results between 0.00010 and 0.00037 on test data one day ahead, and from 0.00017 to 0.00042 three days ahead. However, based on the results obtained, it was observed that the developed model obtained a promising forecasting performance for all the commodities evaluated. As a main contribution, there is the consolidation of databases that can be used in future scientific research. Furthermore, based on its interpretation, it can assist in decision making regarding the buying and selling of commodities to increase financial gains.

Sign language recognition technology can help people with hearing impairments to communicate with those who are hearing impaired. At present, with the rapid development of society, deep learning technology also provided certain technical support for sign language recognition work. In sign language recognition tasks, the use of traditional convolutional neural networks to extract spatio-temporal features from sign language videos suffers from insufficient feature extraction, resulting in low recognition rates. Nevertheless, video-based sign language datasets are very large and require a lot of computational resources for training and generalisation must be ensured, which poses a challenge for recognition. In this paper, we have presented a video-based sign language recognition method based on resnet and lstm. As the number of network layers increases, the ResNet network can effectively solve the granularity explosion problem and obtain better time series features. We use the Resnet convolutional network as the backbone model. At the initialisation stage, we obtain sign language features using ResNet; then, the learned feature space is used as the input of LSTM network to obtain long sequence features. The experimental results show that the accuracy of the above model is better than the mainstream model, and it can effectively extract the spatio-temporal features in sign language videos and improve the recognition rate of sign language actions.

We investigate the power of time series analysis based on a variety of information-theoretic approaches from statistics (AIC, BIC) and machine learning (Minimum Message Length) - and we then compare their efficacy with traditional time series model and with hybrids involving deep learning. More specifically, we develop AIC, BIC and Minimum Message Length (MML) ARMA (autoregressive moving average) time series models - with this Bayesian information-theoretic MML ARMA modelling already being new work. We then study deep learning based algorithms in time series forecasting, using Long Short Term Memory (LSTM), and we then combine this with the ARMA modelling to produce a hybrid ARMA-LSTM prediction. Part of the purpose of the use of LSTM is to seek capture any hidden information in the residuals left from the traditional ARMA model. We show that MML not only outperforms earlier statistical approaches to ARMA modelling, but we further show that the hybrid MML ARMA-LSTM models outperform both ARMA models and LSTM models.

Estimating the remaining useful life (RUL) of components is a crucial task to enhance the reliability, safety, productivity, and to reduce maintenance cost. In general, predicting the RUL of a component includes constructing a health indicator ( ) to infer the current condition of the component, and modelling the degradation process, to estimate the future behavior. Although many signal processing and data-driven based methods were proposed to construct the , most of the existing methods are based on manual feature extraction techniques, and need the prior knowledge of experts, or rely on a large amount of failure data. Therefore, in this study, a new data-driven method based on the convolutional autoencoder (CAE) is presented to construct the . For this purpose, the continuous wavelet transform (CWT) technique is used to convert the raw acquired vibrational signals into a two-dimensional image; then, the CAE model is trained by the healthy operation dataset. Finally, the Mahalanobis Distance (MD) between the healthy and failure stages is measured as the . The proposed method is tested on a benchmark bearing dataset and compared with several other traditional construction models. Experimental results indicate that the constructed exhibits a monotonically increasing degradation trend and has a good performance to detect incipient faults.

In the ambitiously evolving construction industry of Kuwait, characterized by its vision 2035 and rapid technological integration, there exists a pressing need for advanced analytical frameworks. This research paper introduces a groundbreaking deep learning approach utilising an autoencoder neural network to analyse the complexities of the Kuwait Construction Market and identify data irregularities. The construction sector’s significant investment influx and project expansion make it an ideal candidate for deploying sophisticated analytical techniques to detect anomalous patterns indicating inefficiencies or unveiling potential opportunities. Our approach leverages the capabilities of autoencoder architectures to delve into and understand the prevalent patterns in market behaviours. This meticulous analysis allows for the detection of deviations that may lead to operational or financial consequences. We elucidate the mathematical foundations of autoencoders, highlighting their proficiency in managing the complex, multidimensional data typical of the construction industry. Through training on an extensive dataset—comprising variables like market sizes, investment distributions, and project completions—our model demonstrates its ability to pinpoint subtle yet significant anomalies. The outcomes of this study enhance our understanding of deep learning’s pivotal role in construction and building management. Additionally, our findings proactively sketch the future market trajectory and facilitate anomaly detection, thereby contributing substantially to the academic discussion on integrating machine learning into construction management. This research offers valuable insights for professionals within Kuwait, aiming to harness deep learning techniques to boost operational efficiency and strategic foresight in the construction sector.

"Finding fresh water in the ocean of data." is a challenge that all deep learning domains struggle with, especially in the area of hyperspectral image analysis. As hyperspectral remote sensing technology advances by leaps and bounds, there are increasing amounts of hyperspectral images(HSIs) can be available. Whereas in fact, these unlabeled HSIs are powerless to be used as material to driven a supervised learning task due to the extremely expensive labeling costs and some unknown regions. Although learning-based methods have achieved remarkable performance due to their superior ability to represent features, at the cost, these methods are complex, inflexible and tough to carry out transfer learning. In this paper, we propose the "Instructional Mask AutoEncoder"(IMAE), which is a simple and powerful self-supervised learner for HSI classification that uses a transformer-based mask autoencoder to extract the general features of HSIs through a self-reconstructing agent task. Moreover, we utilize the metric learning to perform an instructor which can direct the model focus on the human interested region of the input so that we can alleviate the defects of transformer-based model such as local attention distraction, lack of inductive bias and tremendous training data requirement. In downstream forward propagation, instead of global average pooling, we employ a learnable aggregation to put the tokens into fullplay. The obtained results illustrate that our method effectively accelerates the convergence rate and promotes the performance in downstream task.

The demand for precise indoor localization services is steadily increasing. Among various methods, fingerprint-based indoor localization has become a popular choice due to its exceptional accuracy, cost-effectiveness, and ease of implementation. However, its performance degrades significantly as a result of multipath signal attenuation and environmental changes. In this paper, we propose an indoor localization method based on fingerprints using self-attention and long short-term memory (LSTM). By integrating a self-attention mechanism and LSTM network, the proposed method exhibits outstanding positioning accuracy and robustness in diverse experimental environments. The performance of the proposed method is evaluated under two different experimental scenarios, which involve 2D and 3D moving trajectories, respectively. The experimental results demonstrate that our approach achieves an average localization error of 1.76 m and 2.83 m in the respective scenarios, outperforming the existing state-of-the-art methods by 42.67% and 31.64%.

Breast Cancer diagnosis is one of the most studied problems in the medical domain. In the medical domain, cancer diagnosis has been studied extensively which instantiates the need of early prediction of cancer disease. For obtaining advance prediction, health records are exploited and given as input to an automated system. This paper focuses on constructing an automated system by employing deep learning based recurrent neural network models. A stacked GRU-LSTM-BRNN is proposed in this paper that accepts health records of a patient for determining possibility of being affected by breast cancer. Proposed model is compared against other baseline classifiers such as stacked Simple-RNN model, stacked LSTM-RNN model, stacked GRU-RNN model. Comparative results obtained in this study indicate that stacked GRU-LSTM-BRNN yield better classification performance for predictions related to breast cancer disease.

With an explosion of data in the nearly every domain, from physical and environmental sciences to econometrics and even social science, we have entered a golden era of time-domain data science. In addition to ever increasing data volumes and varieties of time-series, there's a plethora of techniques available to analyses them. Unsurprisingly, machine learning approaches are very popular. In environmental sciences (ranging from climate studies to space weather/solar physics), machine learning (ML )and deep learning (DL) approaches complement the traditional data assimilation approaches. In solar and astrophysics, multiwavelength time-series or lightcurves along with observations of other messengers like gravitational waves provide a treasure trove of time-domain data for ML/DL approaches for modeling and forecasting. In this regard, deep learning algorithms such as recurrent neural networks (RNNs) should prove extremely powerful for forecasting as it has in several other domains. Such methods agnostic of the physics can only predict transient flares that are represented in the original distribution trained on (eg. coloured noise fluctuations) and not special, isolated episodes (eg. a one-off outburst like a major coronal mass ejection) potentially distinguishing them. Therefore it is vital to test robustness of these techniques ; here we attempt to make a small contribution to this by exploring sensitivity of RNNs with some rudimentary experiments. We test the performance of a very successful class of RNNs, the Long Short Term Memory (LSTM) algorithms with simulated lightcurves. As an example, we focus on univariate forecasting of time-series (or lightcurves) characteristic certain variable astrophysical objects (eg. active galactic nuclei or AGN). Specifically, we explore the sensitivity of training and test losses to key parameters of the LSTM network and data characteristics namely gaps and complexity measured in terms of number of Fourier components. We find that typically, the performances of LSTMs are better for pink or flicker noise type sources. The key parameters on which performance is dependent are batch size for LSTM and the gap percentage of the lightcurves. While a batch size of $10-30$ seems optimal, the most optimal test and train losses are under $10 \%$ of missing data for both periodic and random gaps in pink noise. The performance is far worse for red noise. This compromises detectability of transients. Thus, we show that generative models (time-series simulations) are excellent guides for use of RNN-LSTMs in building forecasting systems

In this paper, we introduce the Prognostics and Health Management of gear bearing system using autoencoder neural networks. Bearings and gears are the most common mechanical components in rotating machines, and their health conditions are of great concern in practice. This study presents an outlier modeling method for forecasting the gear bearing system failure using the health indicators constructed from mechanical signal processing and modeling. Outlier modeling aims to find patterns in data that are significantly different from what is defined as normal. In the unsupervised outlier modeling setting, prior labels about the anomalousness of data points are not available. In such cases, the most common techniques for scoring data points for outlyingness include distance-based methods density-based methods, and linear methods. The conventional outlier modeling methods have been used for a long time to detect anomalous observations in data. However, this paper shows that autoencoders are a very competitive technique compared to other existing methods. The developed method is demonstrated using the IMS bearing data from NASA Acoustics and Vibration Database.

This work addresses the intricate task of predicting the prices of diverse financial assets, including stocks, indices, and cryptocurrencies, each exhibiting distinct characteristics and behaviors under varied market conditions. To tackle the challenge effectively, a novel hybridized architecture, AE-GRU, integrating the encoder-decoder principle with GRU is designed. The experimentation involves multiple activation functions and hyperparameter tuning. With extensive experimentation and enhancements applied to AE-LSTM, the proposed AE-GRU architecture still demonstrates significant superiority in forecasting the annual prices of volatile financial assets from multiple sectors mentioned above. Thus, the novel AE-GRU architecture emerges as a superior choice for price prediction across diverse sectors and fluctuating market scenarios by extracting important non-linear features of financial data and retaining the long-term context from past observations.

Caring for dolphins is a delicate process that requires experienced caretakers to pay close attention to their behavioral characteristics. However, caretakers may sometimes lack experience or not be able to give their full attention, which can lead to misjudgment or oversight. To address these issues, a dolphin behavior analysis system has been designed to assist caretakers in making accurate assessments. The study utilized image preprocessing techniques to reduce sunlight reflection in the pool and enhance the outline of dolphins, making it easier to analyze their movements. The dolphins were divided into 11 keypoints using an open-source tool called DeepLabCut, which helped accurately mark various body parts for skeletal detection. The AquaAI Dolphin Decoder (ADD) was then used to analyze six dolphin behaviors. To improve behavior recognition accuracy, the Long Short-Term Memory (LSTM) neural network was introduced. The ADD and LSTM models were integrated to form the ADD-LSTM system. Several classification models, including unidirectional and bidirectional LSTM, GRU, and SVM, were compared. The results showed that the ADD module combined with a double-layer bidirectional LSTM method achieved high accuracy in dolphin behavior analysis. The accuracy rates for each behavior were over 90%.

Predicting the prices of cryptocurrency owing to its volatility, instability, and other factors has been challenging; investors and traders especially in Nigeria have been on a constant look for a more reliable way of knowing market trends and prices and while there has been so many research conducted using deep learning, the results for which has fall short of what investors could called a strong predictor. This research reviewed the results of many works that had been done and proposed two types of recurrent neural network (RNNs) namely Long Short-Term Memory and Gated Recurrent Unit (GRU) for predicting the future prices of two of the most common crypto assets namely Bitcoin (BTC) and Ethereum (ETH), these two were selected based on their popularity, the volume traded and their market capitalization. The experiment was conducted in a GPU Jupyter Notebook environment and the performance of our experiment was evaluated on a test set using root mean square error (RMSE) and based on its values, the LSTM presented a better performance with rsme scores of 654.66, and 80.30 respectively for BTC and ETH as compared to GRU. The paper proceeds further to compare the results of this experiment with other related works and we discovered that its performance is a great improvement.

Coastal wave modeling and forecasting are essential in oceanography, sustainable marine energy, and ocean engineering. Precise forecasting of wave speed and direction are crucial for offshore operations, marine energy, risk management, environmental management, coastal and sustainable maritime management. The coastline of Brunei Darussalam can generate between 15 and 126 Giga Watt of wave energy. In this experimental research, we used two numerical approaches, the finite difference, and spectral element methods, to model and simulate wave speed and direction. We calculated the mean error between numerical and analytical solutions. We proposed a novel, promising, univariate time series forecasting model by combining the Long Short-Term (LSTM) with KerasTuner hyperparameters tuning and optimization techniques. This method helps us to improve the accuracy and efficiency of time-series forecasting.. The experimental data was computed from high-precision Acoustic Doppler Current Profiler (ADCP) sensor data. This research is part of the preliminary feasibility analysis of wave energy production in Brunei Darussalam and net zero commitment for a sustainable environment. Seven independent forecast experiments were performed for wave speed and direction in degree and radian units for 1, 3, 6, 8, 10, 12, and 24 hours. Mean squared error (MSE) was adopted as a metric for both training and testing. The experimental results reveal that the wave speed forecast has the lowest MSE compared to direction, regardless of the unit of measure, but has a longer duration. In addition, the direction forecast in the degree unit has the lowest errors compared to the unit of radians; the latter has a longer running time than the former. The model has delivered optimal results throughout the experiments with minor training and test errors. We conducted a thorough evaluations on two benchmark time series datasets, which include the study dataset and air quality index dataset, to validate the performance of the proposed model with other models. The proposed model outperforms cutting-edge forecasting models, such as the conventional LSTM, ARIMA, and Prophet. The model has the slightest forecast error compared to the existing literature’s result.

The choice of holiday destinations is highly depended on climate considerations. Nowadays, since the effects of climate crisis are being increasingly felt, the need of accurate weather and climate services for hotels is crucial. Such a service could be beneficial for both the future planning of tourists’ activities and destinations and for hotel managers as it could help in decision making about the planning and expansion of the touristic season, due to a prediction of higher temperatures for a longer time span, thus causing increased revenue for companies in the local touristic sector. The aim of this work is to calculate predictions on climatic variables using statistical techniques as well as Artificial Intelligence (AI) for a specific area of interest utilising data from in situ meteorological station, and produce valuable and reliable localised predictions with the most cost-effective method possible. This investigation will answer the question of the most suitable prediction method for time series data from a single meteorological station that is deployed in a specific location. As a result, an accurate representation of the microclimate in a specific are is achieved. To achieve this high accuracy in situ measurements and prediction techniques are used. As prediction techniques, Seasonal Auto Regressive Integrated Moving Average (SARIMA), AI techniques like the Long-Short-Term-Memory (LSTM) Neural Network and hybrid combinations of the two are used. Variables of interest are divided in the easier to predict temperature and humidity that are more periodic and less chaotic, and the wind speed as an example of a more stochastic variable with no known seasonality and patterns. Our results show that the examined Hybrid methodology performs the best at temperature and wind speed forecasts, closely followed by the SARIMA whereas LSTM perform better overall at the humidity forecast, even after the correction of the Hybrid to the SARIMA model.

In this paper, a special recurrent neural network (RNN) called \emph{Long Short-Term Memory (LSTM)} is used to design a virtual load sensor that estimates the mass of heavy vehicles. The estimation algorithm consists of a two-layer LSTM network, with the two layers based on sequence-to-sequence and sequence-to-one logic, respectively. The network estimates the vehicle mass based on the vehicle speed, longitudinal acceleration, engine speed, engine torque, and the accelerator pedal position. The network is trained and tested with a data set collected in a high-fidelity simulation environment called Truckmaker. Training data is generated in acceleration maneuvers in a range of speeds whereas test data is obtained by simulating the vehicle in a Worldwide harmonized light vehicles test cycle (WLTC). Preliminary results show that, with the proposed approach, the heavy-vehicle mass can be estimated as accurately as commercial load sensors in a range of load mass as wide as four tons.

Fluctuating stock prices make it difficult for investors to see investment opportunities. One tool that can help investors overcome this is forecasting techniques. Long Short-Term Memory (LSTM) is one of deep learning methods used in forecasting time series. The training and success of deep learning is strongly influenced by the selection of hyperparameters. This research uses a hybrid method between the Genetic Algorithm (GA) and LSTM to find a suitable model for predicting stock prices. GA is used in optimizing the architecture such as the number of epochs, window size, and the number of LSTM units in the hidden layer. Tuning optimizer is also carried out using several optimizers to achieve the best value. From method that has been applied, it shows that the method has a good level of accuracy with MAPE values below 10% in every optimizer used. The error rate generated is quite low, in case-1 with a minimum RMSE value of 93.03 and 94.40, & in case-2 with an RMSE value of 104.99 and 150.06 during training and testing. A fairly stable and small value is generated by setting it using the Adam Optimizer.

Performing predictive maintenance (PdM) is challenging for many reasons. Dealing with large datasets which may not contain run-to-failure data (R2F) complicates PdM even more. When no R2F data are available, identifying condition indicators (CIs), estimating the health index (HI), and thereafter, calculating a degradation model for predicting the remaining useful lifetime (RUL) are merely impossible using supervised learning. In this paper, a 3 dof delta robot used for pick and place task is studied. In the proposed method, autoencoders (AEs) are used to predict when maintenance is required based on the signal sequence distribution and anomaly detection, which is vital when no R2F data is available. Due to the sequential nature of the data, non-linearity of the system, and correlations between parameter time series, convolutional layers are used for feature extraction. Thereafter, a sigmoid function is used to predict the probability of having an anomaly given CIs acquired from AEs. This function can be manually tuned given the sensitivity of the system or optimized by solving a minimax problem. Moreover, the proposed architecture can be used for fault localization for the specified system. Additionally, the proposed method is capable of calculating RUL using Gaussian process (GP), as a degradation model, given HI values as its input.

Fire outbreaks continue to cause damage despite the improvements in fire-detection tools and algorithms. It is still challenging to implement a well performing and optimized approach, which is sufficiently accurate, and has tractable complexity and low false alarming rate. Small amount of fire and identification of fire from a long distance is also a challenge in previously proposed techniques. In this study, we propose a novel hybrid model based on Convolutional Neural Networks (CNN) to detect and analyze fire intensity. 21 convolutional layers, 24 Rectified Linear Unit (ReLU) layers, 6 pooling layers, 3 fully connected layers, 2 dropout layers, and a softmax layer are included in the proposed 57-layer CNN model. Our proposed model performs instance segmentation in order to distinguish between fire and non-fire events. To reduce the intricacy of the proposed model, we also propose a key-frame extraction algorithm. The proposed model uses Internet of Things (IoT) devices to alert the relevant person by calculating the severity of fire. Our proposed model is tested on a publicly available dataset having fire and normal videos. The achievement of 95.25 % classification accuracy, 0.09% False Positive Rate (FPR), 0.65 percent False Negative Rate (FNR), and a prediction time of 0.08 seconds validates the proposed system.

This research investigates the application of deep learning in sentiment analysis of Canadian maritime case law. It offers a framework for improving maritime law and legal analytics policy-making procedures. The automation of legal document extraction takes center stage, underscoring the vital role sentiment analysis plays at the document level. Therefore, this study introduces a novel strategy for sentiment analysis in Canadian maritime case law, combining sentiment case law approaches with state-of-the-art deep learning techniques. The overarching goal is to systematically unearth hidden biases within case law and investigate their impact on legal outcomes. Employing Convolutional Neural Network (CNN) and Long Short-Term Memory (LSTM) based models, this research achieves a remarkable accuracy of 98.05% for categorizing instances. In contrast, Conventional Machine Learning techniques such as Support Vector Machines (SVM) yield an accuracy rate of 52.57%, Naive Bayes at 57.44 %, and Logistic Regression at 61.86%. The superior accuracy of the CNN and STM model combination underscores its usefulness in legal sentiment analysis, offering promising future applications in diverse fields like legal analytics and policy design. These findings mark a significant choice for AI-powered legal tools, presenting more sophisticated and sentiment-aware options for the legal profession.

: Innovative solutions are now being researched to manage the ever-increasing amount of data required to optimize the performance of internal combustion engines. Machine Learning ap-proaches have shown to be a valuable tool for signal prediction due to their real-time and cost-effective deployment. Among them, the architecture consisting of Long Short-Term Memory (LSTM) and one-dimensional Convolutional Neural Networks (1DCNN) has emerged as a highly promising and effective option for replacing the role of physical sensors. The architecture com-bines the capacity of LSTM to detect patterns and relationships in smaller segments of the signal with the ability of 1DCNN to detect patterns and relationships in larger segments of the signal. The purpose of this work is to assess the feasibility of substituting a physical device dedicated to calculating the torque supplied by a spark-ignition engine. The suggested architecture was trained and tested using signals from the field during a test campaign conducted under transient operating conditions. The results reveal that LSTM+1DCNN is particularly well suited for signal prediction with considerable variability. It constantly outperforms other architectures used for comparison, with average error percentages of less than 2%, proving the architecture's ability to replace physical sensors.

Texture is essential information for image representation, capturing patterns, and structures. Consequently, texture plays a crucial role in the manufacturing industry and has been extensively studied in the fields of computer vision and pattern recognition. However, real-world textures are susceptible to defects, which can degrade the image quality and cause various issues. Therefore, there is a need for accurate and effective methods to detect texture defects. In this study, a simple autoencoder and Fourier transform were employed for texture defect detection. The proposed method combines Fourier transform analysis with the reconstructed template obtained from the simple autoencoder. Fourier transform is a powerful tool for analyzing the frequency domain of images and signals. Moreover, analyzing the frequency domain enables effective defect detection because texture defects often exhibit characteristic changes in specific frequency ranges. The proposed method demonstrates effectiveness and accuracy in detecting texture defects. Experimental results are presented to evaluate its performance and compare it with those of existing approaches.

SQL injection attacks are one of the most common types of attacks on web applications. These attacks exploit vulnerabilities in the application’s database access mechanisms, allowing attackers to execute unauthorized SQL queries. In this study, we propose an architecture for detecting SQL injection attacks using a recurrent neural network (RNN) autoencoder. The proposed architecture was trained on a publicly available dataset of SQL injection attacks. Then compared with several other machine learning models, including ANN, CNN, Decision Tree, Naïve Bayes, SVM, Random Forest, and Logistic Regression. The experimental result showed that the proposed approach achieved an accuracy of 94% and an F1 score of 92%, which demonstrate its effectiveness in detecting QL injection attacks with high accuracy in comparison with other models covered in the study.

The rising number of unknown-type attacks on the Internet emphasizes the significance of developing efficient intrusion detection systems, even if machine learning-based techniques can detect unknown types of attacks. The necessity for innovative techniques is highlighted by the possibility that traditional machine learning techniques will not be sufficient for identifying these unknown types of attacks. In this research, we address this difficulty by proposing a deep learning-based solution: the log-cosh variational autoencoder (LVAE). When it comes to understanding intricate data distributions and creating freshly reconstructed data, LVAE inherits the strong modeling skills of the variational autoencoder (VAE). To better imitate discrete features of actual attacks and generate unknown types of attacks, this study develops an effective reconstruction loss term employing the logarithmic hyperbolic cosine (log-cosh) function in the log-cosh variational autoencoder (LVAE). When compared to conventional VAEs, LVAE exhibits promising potential for effectively generating data that closely resembles an unknown attack, a crucial capability for increasing the unknown attack detection rate. To categorize the generated unknown-type data, eight feature extraction and classification techniques were used. Using the most recent CICIDS2017 dataset, numerous experiments were carried out, training under varying amounts of real and unknown-type attacks. Our optimal experimental results outperformed several state-of-the-art techniques with accuracy and average F1 scores of 99.89% and 99.83%, respectively. Outstanding results were also shown by the suggested LVAE strategy for producing unknown attack data. In general, our work sets a strong basis for the accurate and efficient identification of unknown types of attacks and contributes to the development of intrusion detection techniques.

The escalating reliance on revolutionary online web services has introduced heightened security risks, with persistent challenges posed by phishing despite extensive security measures. Traditional phishing systems, reliant on machine learning and manual features, struggle with evolving tactics. Recent advances in deep learning offer promising avenues for tackling novel phishing challenges and malicious URLs. This paper introduces a two-phase stack generalized model named AntiPhishStack, designed to detect phishing sites. The model leverages the learning of URLs and character-level TF-IDF features symmetrically, enhancing its ability to combat emerging phishing threats. In Phase I, features are trained on a base machine learning classifier, employing K-fold cross-validation for robust mean prediction. Phase II employs a two-layered stacked-based LSTM network with five adaptive optimizers for dynamic compilation, ensuring premier prediction on these features. Additionally, the symmetrical predictions from both phases are optimized and integrated to train a meta-XGBoost classifier, contributing to a final robust prediction. This work's significance lies in advancing phishing detection with AntiPhishStack, operating without prior phishing-specific feature knowledge. Experimental validation on two benchmark datasets, comprising benign and phishing or malicious URLs, demonstrates the model's exceptional performance, achieving a notable 96.04% accuracy. This research adds value to the ongoing discourse on symmetry and asymmetry in information security and provides a forward-thinking solution for enhancing network security in the face of evolving cyber threats.

Cultural Tourism (CT), which enhances the economic development of a region, aids a country in reinforcing its identities, enhancing cross-cultural understanding, and preserving the heritage culture of an area. Designing a proper tourism model assists the tourists in understanding the point of interest without the help of a local guide. However, owing to the need for the analysis of different factors, designing such a model is a complex process. Therefore, this article proposes a CT model for Riyadh for peak visitor time. Primarily, the map data and cultural event dataset are processed for location, such as grouping with Kriging Interpolation-based Chameleon (KIC), tree forming, and feature extraction. After that, the event dataset’s attributes are processed with word embedding. Meanwhile, the Social Network Sites (SNS) data like reviews and news are extracted with an external Application Programming Interface (API). The review data is processed with keyword extraction and word embedding, whereas the news data is processed with score value estimation. Lastly, the data are fused corresponding to a historical site and given to the Multi-Quadratic-Long Short Term Memory (MQ-LSTM) Recommendation System (RS); also, the recommended result with the map is stored in a database. Lastly, the database security is maintained with Locality Sensitive Hashing (LSH); moreover, by attaining higher performance values, the proposed model is experimentally verified.

This paper introduces a multi-class hand gesture recognition model developed to identify a set of defined hand gesture sequences in two-dimensional RGB video recordings. The work presents an action detection classifier that looks at both appearance and spatiotemporal parameters of consecutive frames. The classifier utilizes a convolutional-based network combined with a long-short-term memory unit. To leverage the need for a large-scale dataset, the model uses an available dataset to then adopt a technique known as transfer learning to fine-tune the model on the hand gestures of relevance. Validation curves performed over a batch size of 64 indicate an accuracy of 93.95% (± 0.37) with a mean Jaccard index of 0.812 (± 0.105) for 22 participants. The presented model illustrates the possibility of training a model with a small set of data (113,410 fully labelled frames). The proposed pipeline embraces a small-sized architecture that could facilitate its adoption.

Speech emotion recognition remains a heavy lifting in natural language processing. It has strict requirements to the effectiveness of feature extraction and that of acoustic model. With that in mind, a Heterogeneous Parallel Convolution Bi-LSTM model is proposed to address these challenges. It consists of two heterogeneous branches: the left one contains two dense layers and a Bi-LSTM layer, while the right one contains a dense layer, a convolution layer, and a Bi-LSTM layer. It can exploit the spatiotemporal information more effectively, and achieves 84.65%, 79.67%, and 56.50% unweighted average recall on the benchmark databases EMODB, CASIA, and SAVEE, respectively. Compared with the previous research results, the proposed model achieves better performance stably.

Speech/music classification that facilitates optimized signal processing from classification results has been extensively adapted as an essential part of various electronics applications, such as multi-rate audio codecs, automatic speech recognition, and multimedia document indexing. In this paper, a new technique to improve the robustness of speech/music classifier for 3GPP enhanced voice service (EVS) using long short-term memory (LSTM) is proposed. For effective speech/music classification, feature vectors implemented with the LSTM are chosen from the features of the EVS. Experiments show that LSTM-based speech/music classification produces better results than conventional EVS under a variety of conditions and types of speech/music data.

The development and application of marine current energy are attracting more and more attention around the world. Due to the hardness of its working environment, it is important and difficult to study the fault diagnosis of a marine current generation system. In this paper, an underwater image is chosen as the fault-diagnosing signal, after different sensors are compared. This paper proposes a diagnosis method based on the sparse autoencoder (SA) and softmax regression (SR). The SA is used to extract the features and SR is used to classify them. Images are used to monitor whether the blade is attached by benthos and to determine its corresponding degree of attachment. Compared with other methods, the experiment results show that the proposed method can diagnose the blade attachment with higher accuracy.

This paper proposed emotion recognition methods for consecutive facial images, and implements the inference of neural network model on a field-programmable gate array (FPGA). The proposed emotion recognition methods are based on a neural network model architecture that combines convolution neural networks (CNNs), long short-term memory (LSTM), and fully connected neural networks (FCNNs), called CLDNN or ConvLSTM-FCN. This type of neural network mod-el can analyze the local feature sequences obtained through convolution of data, making it suita-ble for processing time-series data such as consecutive facial images. In this paper, sequences of facial images are sampled from videos corresponding to various emotional state of subjects. The sampled images are then pre-processed with the processes includes facial detection, greyscale conversion, resize, and data augmentation if necessary. The 2-D CNN in ConvLSTM-FCN is used for feature extraction for these pre-processed facial images. These sequences of facial im-age features are time sequences with dependent properties between the elements within them. The LSTM is then used to model these time sequences followed by fully connected neural net-works (FCNNs) for classification. The proposed consecutive facial emotion recognition method achieves an average recognition rate of 99.51% on RAVDESS dataset, 87.80% on BAUM-1s dataset and 96.82% on eNTERFACE’05 data set, using 10-fold cross-validation on the PC. Some com-parisons of recognition accuracies between the proposed method and the other existing related works are conducted in this paper. According to the comparisons, the proposed emotion recog-nition methods outperform the existing related researches. The proposed emotion recognition methods are then implemented on an FPGA chip using the neural network model inference algo-rithms in this paper, and the accuracies of the experiments conducted on the FPGA chip are iden-tical to those obtained on the PC. This verifies that the proposed neural network model imple-mented on the FPGA chip performs well.

Epilepsy is a prevalent neurological disorder with considerable risks, including physical impairment and irreversible brain damage from seizures. Given these challenges, the urgency for prompt and accurate seizure detection cannot be overstated. Traditionally, experts have relied on manual EEG signal analyses for seizure detection, which is labor-intensive and prone to hu-man error. Recognizing this limitation, the rise of deep learning methods has been heralded as a promising avenue, offering more refined diagnostic precision. On the other hand, the prevailing challenge in many models is their constrained emphasis on specific domains, potentially diminishing their robustness and precision in complex real-world environments. This paper presents a novel model that seamlessly integrates the salient features from the time-frequency domain alongside pivotal statistical attributes derived from EEG signals. This fusion process involves the integration of essential statistics, including the mean, median, and variance, combined with the rich data from compressed time-frequency (CWT) images processed using auto-encoders. This multidimensional feature set provides a robust foundation for subsequent analytic steps. A long short-term memory (LSTM) network, meticulously optimized for the renowned Bonn Epilepsy dataset, was used to enhance the capability of the proposed model. Preliminary evaluations underscore the prowess of the proposed model: remarkable 100% accuracy in most of the binary classifications, impressive performance exceeding 95% for three-class and four-class challenges, and a commendable rate exceeding 93.5% for the five-class classification.

Photovoltaic(PV) power generation is highly nonlinear and stochastic. Accurate prediction of PV power generation plays a crucial role in grid connection as well as the operation and scheduling of power plants. To predict the PV power combination model, this paper suggests a method based on Empirical Mode Decomposition (EMD), Ensemble Empirical Mode Decomposition (EEMD), Complete Ensemble Empirical Mode Decomposition with Adaptive Noise (CEEMDAN), Nonlinear Auto-Regressive Neural Networks with Exogenous Input (NARXNN), Long Short Term Memory (LSTM) Neural Network, and Light Gradient Boosting Machine (LightGBM) algorithms. To attempt to reduce the non-smoothness of PV power, the weather variable features with the greatest effect on PV power are first identified by correlation analysis. Following this, the PV power modal decomposition is split and reorganized into a new feature matrix. Finally， a NARX is used to obtain preliminary PV power components and residual vector features， and the PV power is predicted by combining three models of LightGBM， LSTM, and NARX and then the final prediction results are obtained by combining the PV power prediction results using error inverse method weighted optimization. The prediction results demonstrate that the model put forth in this paper outperforms those of other models and validate the model's validity by utilizing real measurement data from Andre Agassi College in the United States.

Deep neural networks (DNNs) have made a huge impact in the field of machine learning by providing unbeatable humanlike performance to solve real-world problems such as image processing and natural language processing (NLP). Convolutional neural network (CNN) and recurrent neural network (RNN) are two typical architectures that are widely used to solve such problems. Time sequence-dependent problems are generally very challenging, and RNN architectures have made an enormous improvement in a wide range of machine learning problems with sequential input involved. In this paper, different types of RNN architectures are compared. Special focus is put on two well-known gated-RNN’s Long Term Short Memory (LSTM) and Gated Recurrent Unit (GRU). We evaluated these models on the task of force estimation system in pouring. In this study, four different models including multi-layers LSTM, multi-layers GRU, single-layer LSTM and single-layer GRU) were created and trained. The result suggests that multi-layer GRU outperformed other three models.

Autonomous mobile robots are essential to the industry, and human-robot interactions are becoming more common nowadays. These interactions require that the robots navigate scenarios with static and dynamic obstacles in a safely manner, avoiding collisions. This paper presents a physical implementation of a method for dynamic obstacle avoidance using a Long Short-Term Memory (LSTM) neural network that obtains information from the mobile robot’s LiDAR for it to be capable of navigating through scenarios with static and dynamic obstacles while avoiding collisions and reaching its goal. The model is implemented using a TurtleBot3 mobile robot within an OptiTrack Motion Capture (MoCap) system for obtaining its position at any given time. The user operates the robot through these scenarios, recording its LiDAR readings, target point, position inside the MoCap system, and its linear and angular velocities, all of which serve as the input for the LSTM network. The model is trained on data from multiple user-operated trajectories across five different scenarios, outputting the linear and angular velocities for the mobile robot. Physical experiments prove that the model is successful in allowing the mobile robot to reach the target point in each scenario while avoiding the dynamic obstacle, with a validation accuracy of 98.02%.

This paper investigates nonverbal communication in human interactions, with a specific focus on facial expressions. Employing a Long Short-Term Memory (LSTM) architecture and a custom-ized facial expression framework, our approach aims to improve virtual agent interactions by incorporating subtle nonverbal cues. The paper contributes to the emerging field of facial expres-sion generation, addressing gaps in current research and presenting a novel framework within Unreal Engine 5. The model's architecture, trained on the CANDOR corpus, captures temporal dynamics, and refines hyperparameters for optimal performance. During testing, the trained model showed a cosine similarity of -0.95. This enables the algorithm to accurately respond to non-verbal cues and interact with humans in a way that is comparable to human-human interac-tion. Unlike other approaches in the field of facial expression generation, the presented method is more comprehensive and enables the integration of a multi-modal approach for generating facial expressions. Future work involves integrating blendshape generation, real-world testing, and the inclusion of additional modalities to create a comprehensive framework for seamless hu-man-agent interactions beyond facial expressions.

Raindrop size distribution (RSD) is an index for reflecting precipitation characteristics. Analyzing the differences of RSD plays an important role in understanding the precipitation microphysical processes and improving quantitative precipitation prediction of radar. In this paper, the RSD data of Dafang (57708) station, Majang (57828) station, and Luodian (57916) station (with an altitude of 1722.7m, 985.0m, and 441.5m, respectively) in Guizhou are analyzed according to the precipitation microphysical characteristics. First,Particles with particle size less than 1mm contributes the highest value to the density of particle number , and decrease with the descending altitude. Second, the GAMMA distribution fit shows a better fit compare to M-P distribution fit, and GAMMA distribution fit increases with the ascending altitude. Third, the mass-weighted average diameter is not sensitive enough to the change of precipitation intensity with correlation coefficients of 54.84%, but there is a obvious relationship between the average volume diameter and the precipitation intensity with correlation coefficients of 69.15%. Then, the precipitation prediction model is established using LSTM neural network after fusing the representative microphysical characteristics of RSD with radar and rain gauge data. The precipitation prediction model is applied to the Dafang (57708) site to predict precipitation for time range of 0-180 minutes, and it is found that for the prediction of convective cloud and stratiform cloud precipitation, the 60-minute prediction results are the most consistent with the actual precipitation, where the correlation coefficients are 92.87% and 92.57%, respectively. Conclusively, the results demonstrate that combining with the RSD base data could improve the reliability of precipitation forecasting.

Activated sludge process is a well known method to treat municipal and industrial waste water. In this complex process, the oxygen concentration in the reactors plays a critical role in the plant efficiency. This paper proposes the use of a Long Short-Term Memory (LSTM) network to identify an input-output model suitable for the design of an oxygen concentration controller. The model is identified from easy-accessible measures collected from a real plant. This dataset covers almost a month. The performances achieved with the proposed LSTM model are compared with the ones obtained with a standard AutoRegressive model with eXogenous input (ARX). Both models catch the oscillation and the overall behaviour (ARX ρ=0.833 , LSTM ρ=0.921), but, while the ARX model fails in reaching the correct amplitude (FIT=41.20%), the LSTM presents satisfactory performance (FIT=60.56%).

This paper realizes early bearing fault warning through bearing fault time series prediction, and proposes a bearing fault time series prediction model based on optimized maximum correlation kurtosis deconvolution (MCKD) and long short-term memory (LSTM) recurrent neural network to ensure bearings operation reliability. The model is based on lifecycle vibration signal of the bearing, to begin, the cuckoo search (CS) is utilized to optimize the parameter filter length L and deconvolution period T of MCKD, taking into account the influence and periodicity of the bearing time series, the fault impact component of the optimized MCKD deconvolution time series is improved. Then select the LSTM learning rate α depending on deconvolution time series. Finally, the dataset obtained through various preprocessing approaches are used to train and predict the LSTM model. The average prediction accuracy of the optimized MCKD-LSTM model is 26 percent higher than that of the original time series, proving the efficiency of this method, and the prediction results track the real fault data well, according to the XI'AN JIAOTONG University XJTU-SY bearing dataset.

In cognitive radio systems, identifying spectrum opportunities is fundamental to efficiently use the spectrum. Spectrum occupancy prediction is a convenient way of revealing opportunities based on previous occupancies. Studies have demonstrated that usage of the spectrum has a high correlation over multidimensions which includes time, frequency, and space. Accordingly, recent literature uses tensor-based methods to exploit the multidimensional spectrum correlation. However, these methods share two main drawbacks. First, they are computationally complex. Second, they need to re-train the overall model when no information is received from any base station for any reason. Different than the existing works, this paper proposes a method for dividing the multidimensional correlation exploitation problem into a set of smaller sub-problems. This division is achieved through composite two-dimensional (2D)-long short-term memory (LSTM) models. Extensive experimental results reveal a high detection performance with more robustness and less complexity attained by the proposed method. The real-world measurements provided by one of the leading mobile network operators in Turkey validate these results.

Several researchers have contemplated deep learning-based post-filters to increase the quality of statistical parametric speech synthesis, which perform a mapping of the synthetic speech to the natural speech, considering the different parameters separately and trying to reduce the gap between them. The Long Short-term Memory (LSTM) Neural Networks have been applied successfully in this purpose, but there are still many aspects to improve in the results and in the process itself. In this paper, we introduce a new pre-training approach for the LSTM, with the objective of enhancing the quality of the synthesized speech, particularly in the spectrum, in a more efficient manner. Our approach begins with an auto-associative training of one LSTM network, which is used as an initialization for the post-filters. We show the advantages of this initialization for the enhancing of the Mel-Frequency Cepstral parameters of synthetic speech. Results show that the initialization succeeds in achieving better results in enhancing the statistical parametric speech spectrum in most cases when compared to the common random initialization approach of the networks.

This study develops a 7-layer Long Short-Term Memory (LSTM) model to enhance early diabetes detection in Oman, aligning with the theme of 'Artificial Intelligence in Healthcare'. The model focuses on addressing the increasing prevalence of Type 2 diabetes, projected to impact 23.8% of Oman's population by 2050. It employs LSTM neural networks to manage factors contributing to this rise, including obesity and genetic predispositions, and aims to bridge the gap in public health awareness and prevention. The model's performance is evaluated through various metrics. It achieves an accuracy of 99.40%, specificity and sensitivity of 100% for positive cases, a recall of 99.34% for negative cases, an F1 score of 96.24%, and an AUC score of 94.51%. These metrics indicate the model's capability in diabetes detection. The implementation of this LSTM model in Oman's healthcare system is proposed to enhance early detection and prevention of diabetes. This approach reflects an application of AI in addressing a significant health concern, with potential implications for similar healthcare challenges globally.st diagnostic capabilities, representing a significant leap forward in healthcare technology in Oman.

Peanut leaf spot is a worldwide disease whose prevalence poses a major threat to peanut yield and quality, and accurate prediction models are urgently needed for timely disease management. In this study, we proposed a novel peanut leaf spot prediction method based on an improved long short-term memory (LSTM) model and multi-year meteorological data combined with disease survey records. Our method employed a combination of convolutional neural network (CNN) and LSTM to capture spatial-temporal patterns from the data and improve the model ability to recognize dynamic features of the disease. In addition, we introduced an attention mechanism module to enhance model performance by focusing on key features. Through several hyper-parameter optimization adjustments, we identified a peanut leaf spot disease condition index prediction model with a learning rate of 0.001, a number of cycles (Epochs) of 800, and an optimizer of Adma. The results showed that the integrated model demonstrated excellent prediction ability, obtaining an RMSE of 0.063 and an R2 of 0.951, which reduced the RMSE by 0.253 and 0.204, and raised the R2 by 0.155 and 0.122, respectively, compared to the single CNN and LSTM. Predicting the incidence and severity of peanut leaf spot disease based on the meteorological conditions and neural networks is feasible and valuable to help growers made accurate management decisions and reduced disease impacts through optimal fungicide application timing.

The performance of bearings plays a pivotal role in determining the dependability and security of rotating machinery. In intricate systems demanding exceptional reliability and safety, the ability to accurately forecast fault occurrences during operation holds profound significance. Such predictions serve as invaluable guides for crafting well-considered reliability strategies and executing maintenance practices aimed at enhancing reliability. In order to ensure the reliability of bearing operation, this article investigates the application of three advanced techniques—Maximum Correlation Kurtosis Deconvolution (MCKD), Multi-Scale Permutation Entropy (MPE), and Long Short-Term Memory (LSTM) recurrent neural networks—for the prediction of the remaining useful life (RUL) of rolling bearings. Each technique's principles, methodologies, and applications are comprehensively reviewed, offering insights into their respective strengths and limitations. Case studies and experimental evaluations are presented to assess their performance in RUL prediction. Findings reveal that MCKD enhances fault signatures, MPE captures complexity, and LSTM excels in modeling temporal patterns. The root mean square error of the prediction results is 0.007. The fusion of these techniques offers a comprehensive approach to RUL prediction, leveraging their unique attributes for more accurate and reliable predictions.

Cardiovascular disease is the leading cause of death worldwide. A key factor in assessing the risk of cardiovascular disease is left ventricular functional evaluation. Left ventricular (LV) systolic function is evaluated by measuring the left ventricular ejection fraction (LVEF) using echocardiography data. Therefore, quick and accurate left ventricle segmentation is important for estimating the LVEF. However, it is difficult to accurately segment the left ventricle due to changes in the shape and area of the left ventricle during cardiac cycles. In this study, we proposed a framework that considers changes in the shape and area of the left ventricle during the cardiac cycle by applying the convolutional long short-term memory (CLSTM) approach. In addition, we evaluated the left ventricular segmentation and multidimensional quantification of the proposed system in comparison to manual and automated segmentation methods. In addition, to assess the validity of CLSTM, the values of multi-dimensional quantification metrics were compared and analyzed using graphs and Bland–Altman plots on a frame-by-frame basis. We demonstrated that the CLSTM method effectively segments the left ventricle by considering the LV activity. In conclusion, we demonstrated that LV segmentation based on our framework may be utilized to accurately estimate LVEF values.

An adaptive deep neural network is used in an inverse system identification setting to approximate the inverse of a nonlinear plant with the aim of constituting the plant controller by copying to the latter the weights and architecture of the converging deep neural network. This deep learning (DL) approach to the adaptive inverse control (AIC) problem is shown to outperform adaptive filtering techniques and algorithms normally used in adaptive control, especially when the plant is nonlinear. The deeper the controller the better the inverse function approximation, provided that the nonlinear plant have an inverse and that this inverse can be approximated. Simulation results prove the feasibility of this DL-based adaptive inverse control scheme. The DL-based AIC system is robust to parameter change of the nonlinear plant in that, under such change, the plant output reassumes the value of the reference signal considerably faster than with the adaptive filter counterpart of the deep neural network. Settling times and rise times of the step response are shown to improve in the DL-based AIC system.

With the recent advances in Machine Learning (ML), several models have been successfully applied to financial and accounting data to predict the likelihood of companies’ bankruptcy. However, time series have received little attention in literature with a lack of studies on the application of Deep Learning sequence models as Recurrent Neural Networks (RNN) and the recent Attention-based models in general. In this research work, we investigated the application of Long Short Term Memory (LSTM) networks to exploit time series of accounting data for bankruptcy prediction. The main contributions of our work are the following: a) we have proposed a Multi-head LSTM that models each financial variable in a time window independently and compared it with a single-input LSTM and other traditional ML models. The Multi-head LSTM outperforms all the other models; b) We identify the optimal time series length for bankruptcy prediction to be equal to 4 years of accounting data; c) We made public the dataset we used for the experiments that include data from 8262 different public companies in the American stock market generated in the period between 1999-2018. Furthermore, we prove the efficacy of the Multi-head LSTM models in terms of lower false positives and better division of the two classes.

Soil moisture is an important factor affecting the plant growth. For a long time, the convenience, timeliness and accuracy of soil moisture monitoring have been limited due to the backward of observation methods and equipment. Therefore, the quantitative prediction of soil moisture has become a difficult problem. Aiming at the problems of high erection cost, easily damaged sensors and low measurement accuracy of the existing fixed sensor soil moisture monitoring system, a soil moisture prediction model based on the long short term memory neural network (LSTM) integrating the particle swarm optimization (PSO) (PSO-LSTM) is designed and implemented. The hyperparameters of the LSTM network can be obtained based on the excellent global search ability of the PSO algorithm. According to the meteorological data and soil moisture data of Haidian Park in 2019, the long short term memory(LSTM) neural network based prediction model is constructed with input vectors of surface temperature, average temperature, evaporation, sunshine hours, precipitation and average wind speed, and the output vector of soil relative humidity. The results show that compared with the back propagation(BP) neural network, the Elman neural network and the LSTM neural network, the proposed PSO-LSTM model has higher prediction performance.

Nowadays, technological advancement has transformed traditional vehicles into Au-tonomous Vehicles (A.V.s). In addition, in our daily lives, A.V.s play an important role since they are considered an essential component of smart cities. A.V. is an intelligent vehicle capable of main-taining safe driving by avoiding crashes caused by drivers. Unlike traditional vehicles, which are fully controlled and operated by humans, A.V.s collect information about the outside environment using sensors to ensure safe navigation. Furthermore, A.V.s reduce environmental impact because they usually use electricity to operate instead of fossil fuel, thus decreasing the greenhouse gasses. However, A.V.s could be threatened by cyberattacks, posing risks to human life. For example, re-searchers reported that Wi-Fi technology could be vulnerable to cyberattacks through Tesla and BMW AVs. Therefore, more research is needed to detect cyberattacks targeting the components of A.V.s to mitigate their negative consequences. This research will contribute to the security of A.V.s by detecting cyberattacks at the early stages. First, we inject False Data Injection (FDI) attacks into an A.V. simulation-based system developed by MathWorks. Inc. Second, we collect the dataset generated from the simulation model after integrating the cyberattack. Third, we implement an intelligent symmetrical anomaly detection method to identify FDI attacks targeting the control system of the A.V. through a compromised sensor. We use long short-term memory (LSTM) deep networks to detect FDI attacks in the early stage to ensure the stability of the operation of A.V.s. Our method classifies the collected dataset into two classifications: normal and anomaly data. The ex-perimental result shows that our proposed model's accuracy is 99.95%. To this end, the proposed model outperforms other state-of-the-art models in the same study area.

Advancements in deep learning and availability of medical imaging data have led to use of CNN based architectures in disease diagnostic assisted systems. In spite of the abundant use of reverse transcription-polymerase chain reaction (RT-PCR) based tests in COVID-19 diagnosis, CT images offer an applicable supplement with its high sensitivity rates. Here, we study classification of COVID-19 pneumonia (CP) and non-COVID-19 pneumonia (NCP) in chest CT scans using efficient deep learning methods to be readily implemented by any hospital. We report our deep network framework design that encompasses Convolutional Neural Networks (CNNs) and bidirectional Long Short Term Memory (biLSTM) architectures. Our study achieved high specificity (CP: 98.3%, NCP: 96.2% Healthy: 89.3%) and high sensitivity (CP: 84.0%, NCP: 93.9% Healthy: 94.9%) in classifying COVID-19 pneumonia, non-COVID-19 pneumonia and healthy patients. Next, we provide visual explanations for the CNN predictions with gradient-weighted class activation mapping (Grad-CAM). The results provided a model explainability by showing that Ground Glass Opacities (GGO), indicators of COVID-19 pneumonia disease, were captured by our CNN network. Finally, we have implemented our approach in three hospitals proving its compatibility and efficiency.

The dynamic evolution and variation of electrical loads is now a priority for optimum management and, above all, forecasting. Indeed, these dynamic load variations require computer tools able to implement optimal load forecasting models. Scientific research into automated models for forecasting electrical loads therefore represents a challenge for scientific researchers. Several research studies have therefore been carried out. These include machine learning approaches such as: LSTM (Long Short-Term Memory), Support Vector Machine (SVM) and others. This article proposes a comparison study between a hybrid model based on the wavelet transform coupled with the adaboost method, and LSTM, for forecasting electricity consumption loads. Python 3.10 was used for the studies. The first results obtained consisted in the study of electricity load forecasts over four (04) data sets of the year (January, April, August and December). These results are very satisfactory, showing a good correlation between the real results of the electrical load consumption data, and the results of the implemented model. The electrical load consumption data are collected from a renewable energy production source: photovoltaic solar energy. The model test results (R2) obtained range from 0.919 to 0.958. These results are representative of real data and reflect the model's performance. The second set of results concerns a comparative study between the methods used by Y. Xie et al (CNN, MLP, LSTM-AM and LSTM-AM-MLP), and our approach. The prediction results obtained between the approaches show a prediction gap ranging from 0.15 to 0.78 for RMSE and 0.83 for MAPE. These results show significant differences between the methods. The minimization of errors by our model, therefore, reflects the model's performance in terms of accuracy, which is necessary for the optimal management of consumer electricity load forecasts in order to ensure balance between supply and demand.

Advancements in technology, policies, and cost reductions have led to rapid growth in wind power production. One of the major challenges in wind energy production is the instability of wind power generation due to weather changes. Efficient power grid management requires accurate power output forecasting. New wind energy forecasting methods based on deep learning are better than traditional methods, like numerical weather prediction, statistical models, and machine learning models. This is more true for short-term prediction. Since there is a relationship between methods, climates, and forecasting complexity, forecasting methods do not always perform the same depending on the climate and terrain of the data source. This paper proposes a novel model that combines the variational mode decomposition method with a long short-term memory model, developed for next-hour wind speed prediction in a hot desert climate, such as the climate in Saudi Arabia. We compared the proposed model performance to two other hybrid models, six deep learning models, and four machine learning models using different feature sets. Also, we tested the proposed model on data from different climates, Caracas and Toronto. The proposed model showed a forecast skill between 61% to 74% based on mean absolute error, 64% to 72% based on root mean square error, and 59% to 68% based on mean absolute percentage error for locations in Saudi Arabia.

Industrial process control systems commonly exhibit features of time-varying, strong coupling, and strong nonlinearity. Obtaining accurate mathematical models of these nonlinear systems and achieving satisfactory control performance is still a challenging task. In this paper, data-driven modeling techniques and deep learning methods are used to accurately capture a category of smooth nonlinear system’s spatiotemporal features. The operating point of these systems may change over time, and their nonlinear characteristics can be locally linearized. We established the LSTM-CNN-ARX model by utilizing a fusion of long short-term memory (LSTM) network and convolutional neural network (CNN) to fit the coefficients of the state-dependent exogenous variable autoregressive (SD-ARX) model. Compared to other models, the hybrid LSTM-CNN-ARX model is more effective in capturing the nonlinear system’s spatiotemporal characteristics due to its incorporating the strengths of LSTM for learning temporal characteristics and CNN for capturing spatial characteristics. The model-based predictive control (MPC) strategy, namely LSTM-CNN-ARX-MPC, is developed by utilizing the model's local linear and global nonlinear features. The control comparison experiments conducted on a water tank system (WTS) show the effectiveness of the developed models and MPC methods.

The problem of health status prediction of insulated-gate bipolar transistors (IGBTs) gains a lot of attention in the field of health management of power electronic equipment. The performance degradation of IGBT gate oxide layer is one of the important failure modes. In view of failure mechanism analysis and easy implementation of monitoring circuit, this paper selects the gate leakage current of IGBT as the precursor parameter of gate oxide degradation, and uses time domain characteristic analysis, gray correlation degree, Mahalanobis distance, Kalman filter and other methods to carry out feature selection and fusion, and finally obtains a health indicator characterizing the degradation of IGBT gate oxide. Based on the Convolutional Neural Network and Long Short-Term Memory (CNN-LSTM) network, this paper constructs an IGBT gate oxide degradation prediction model, and performs experimental analysis on the dataset released by NASA-Ames Laboratory, and the average absolute error of performance degradation prediction is as low as 0.0216. Compared with Long Short-Term Memory (LSTM), Convolutional Neural Network (CNN), Support Vector Regression (SVR) and CNN-LSTM models, CNN-LSTM network has the highest prediction accuracy. These results show the feasibility of gate leakage current as a precursor parameter of IGBT gate oxide layer failure, as well as the accuracy and reliability of the CNN-LSTM prediction model.

The automatic recognition of scanned Medieval manuscripts still represents a challenge due to degradation, non standard layouts, or notations. This paper focuses on the Medieval square notation developed around the 11th century which is composed of staff lines, clefs, accidentals, and neumes which are basically connected single notes. We present a novel approach to tackle the automatic transcription by applying CNN/LSTM networks that are trained using the segmentation-free CTC-loss-function which considerably facilitates the GT-production. For evaluation, we use three different manuscripts and achieve a dSAR of 86.0% on the most difficult book and 92.2% on the cleanest one. To further improve the results, we apply a neume dictionary during decoding which yields a relative improvement of about 5%.

Changes in sea level exhibit nonlinearity, nonstationarity, and multivariable characteristics, making traditional time series forecasting methods less effective in producing satisfactory results. To enhance the accuracy of the predictions of changes in sea level, this study introduced an improved VMD–EEMD–LSTM hybrid model. This model decomposes satellite altimetry data from near the Dutch coast using VMD, resulting in components of the Intrinsic Mode Function (IMF) with various frequencies and a residual sequence. EEMD further dissects the residual sequence obtained from VMD into second-order components. These IMFs decomposed by VMD and EEMD are utilized as features in the LSTM model for making predictions, culminating in the final forecasted results. The experimental results demonstrated significant improvements in the predictive performance compared with the VMD–LSTM model. The RMSE (root mean square error) decreased by an average of 58.68%, the MAE (mean absolute error) reduced by an average of 59.96%, and the R2 (coefficient of determination) increased by an average of 49.85% compared with the VMD–LSTM model. In comparison with the EEMD–LSTM model, the RMSE decreased by an average of 26.95%, the MAE decreased by an average of 28.00%, and the R2 increased by an average of 6.53%. The VMD–EEMD–LSTM model exhibited significantly improved predictive performance.

With the advancement of urbanization in China, effective control of pollutant emissions and air quality have become important goals in current environmental management. Nitrogen dioxide (NO2), as a precursor of tropospheric ozone and fine particulate matter, plays a significant role in atmospheric chemistry research and air pollution control. However, the uneven ground monitoring stations and low temporal resolution of polar-orbiting satellites set challenges for accurately assessing near-surface NO2. To address this issue, a spatiotemporal refined NO2 retrieval model was established for China using the geostationary satellite Himawari-8. The spatiotemporal characteristics of NO2 were analyzed and its contribution factors were explored. Firstly, seven Himawari-8 channels sensitive to NO2 were selected by using the forward feature selection based on information entropy. Subsequently, a 2DCNN-LSTM network model was constructed, incorporating the selected channels and meteorological variables as retrieval factors to estimate hourly NO2 in China from March 2018 to February 2020 (with a resolution of 0.05°, per hour). The performance evaluation demonstrated that the full-channel 2DCNN-LSTM model had good fitting capability and robustness (R2=0.74, RMSE=10.93), and further improvements were achieved after channel selection (R2=0.87, RMSE=6.84). The 10-fold cross-validation results indicated that the R2 between retrieval and measured values was above 0.85, the MAE was within 5.60, and the RMSE was within 7.90. R2 varied between 0.85 and 0.90, showing better validation at mid-day (R2=0.89) and in spring and fall transition seasons (R2 =0.88 and R2 =0.90). To investigate the cooperative effect of meteorological factors and other air pollutants on NO2, statistical methods (Beta coefficients) were used to test the factor interpretability. Meteorological factors as well as other pollutants were analyzed. From a statistical perspective, PM2.5, Boundary Layer Height, and O3 were found to have the largest impacts on near-surface NO2, with each standard deviation change in these factors leading to 0.28, 0.24, and 0.23 in standard deviations of near-surface NO2, respectively. Findings of the study contribute to a comprehensive understanding of the spatiotemporal distribution of NO2 and provide a scientific basis for formulating targeted air pollution policies.

The deployment of a Static Synchronous Compensator within a microgrid can facilitate voltage and reactive power regulation, leading to enhanced stability and reliability. Within a microgrid setting, a STATCOM can effectively balance power supply and demand, and mitigate voltage fluctuations caused by the intermittent nature of renewable energy sources. To ensure the successful integration of a STATCOM within a microgrid, coordinating the control system with other Distributed Energy Resources, especially when multiple control strategies are employed, can be a challenging task. Therefore, a meticulously designed control system is indispensable to guarantee the microgrid’s efficient and effective operation. The use of GA in LSTM tuning can accelerate the process of finding optimal hyperparameters for a specific task, obviating the necessity for time-consuming and computationally expensive grid search or manual tuning. This method can be particularly advantageous when handling large data sets and complex models. In this paper, an attempt has been made to model the STATCOM to communicate with the microgrid tuned using LSTM-GA for effective calculation of real and reactive power support during grid disturbances.

Urban rail transit offers advantages like high safety, energy efficiency, and environmental friendliness. With cities rapidly expanding, travelers are increasingly using rail systems, heightening demands for passenger capacity and efficiency while also pressuring these networks. Passenger flow forecasting is an essential part of transportation systems. Short-term passenger flow forecasting for rail transit can estimate future station volumes, providing valuable data to guide operations management and mitigate congestion. This paper investigates short-term forecasting for Suzhou's Shantang Street station. Shantang Street's high commercial presence and distinct weekday versus weekend ridership patterns make it an interesting test case. Wavelet denoising and LSTM modeling were combined to predict short-term flows, comparing the results to standalone LSTM and SVR approaches. This study illustrates that the adopted algorithms exhibit good performance for passenger prediction. The LSTM model with wavelet denoising proved most accurate, demonstrating applicability for short-term rail transit forecasting and practical significance.

Parkinson’s Disease (PD) is a neurodegenerative disorder characterized by motor and non-motor impairment with various implications on patients’ quality of life. Since currently available therapies are only symptomatic, identifying individuals with prodromal, preclinical or early-stage PD is crucial, as they would be ideal candidates for future disease-modifying therapies. Our analysis aims to develop a robust model for accurate PD detection using accelerometer data collected from PD and non-PD individuals with mild or no tremor during phone conversations. An open-access dataset comprising accelerometer recordings from 22 PD patients and 11 healthy controls (HC) was utilized. The data were pre-processed to extract relevant time, frequency and energy-related features, and a Bidirectional Long Short-Term Memory (Bi-LSTM) model with attention mechanism was employed for classification. The performance of the model was evaluated using 5-fold cross-validation, and metrics of accuracy, precision, recall, specificity, and f1-score were computed. The proposed model demonstrated high accuracy (98%), precision (99%), recall (98%), specificity (96%), and f1-score (98%) in accurately distinguishing PD patients from HC. Our findings indicate that the proposed model outperforms existing approaches and holds promise for detection of PD with subtle symptoms, like tremor, in the wild. Such symptoms can present in the early or even prodromal stage of the disease, and appropriate mobile-based applications may be a practical tool in real-life settings to alert individuals at risk to seek medical assistance or give patients feedback in monitoring their symptoms.

Grain yield prediction affects policy making in various aspects such as agricultural production planning, food security assurance, and adjustment of foreign trade. Accurately predicting grain yield is of great significance in ensuring global food security. This paper is based on the MODIS remote sensing image data products from 2010 to 2020, and adds band information such as vegetation index and temperature to form composite remote sensing data as a data set. Aiming at the lack of models for large-scale forecasting and the need for human intervention in traditional models, this paper proposes a grain production estimation model based on deep learning. First, image cropping and yield mapping techniques are used to process the data to generate training samples. Then the channel and spatial attention mechanism (Convolutional Block Attention Module, CBAM) is added for extracting spatial information in different remote sensing bands to improve the efficiency of the model. Long Short-Term Memory (LSTM) neural networks is also added to obtain feature information in the time dimension. Finally, a national-scale grain yield prediction model is constructed. The proposed model was tested on data from 2018 to 2020 showing an average R2 of 0.940 and an average RMSE of 80,020 tons, indicating that it can predict Chinese grain yield better. The model proposed in this paper extracts grain yield information directly from the composite remote sensing data, and solves the problem of small-scale research and imprecise yield prediction in an end-to-end manner.

The deformation monitoring information of concrete dams contains some high-frequency com-ponents, and the high-frequency components are strongly nonlinear, which reduces the accuracy of dam deformation prediction. In order to solve such problems, this paper proposes a concrete dam deformation monitoring model based on empirical mode decomposition (EMD) combined with wavelet threshold noise reduction and sparrow search algorithm (SSA) optimization of long short-term memory network (LSTM). The model uses EMD combined with wavelet threshold to decompose and denoise the measured deformation data. On this basis, the LSTM model based on SSA optimization is used to mine the nonlinear function relationship between the reconstructed monitoring data and various influencing factors. The example analysis shows that the model has good calculation speed, fitting and prediction accuracy and it can effectively mine the date char-acteristics inherent in the measured deformation, and reduce the influence of noise components on the modeling accuracy.

GNSS time series prediction plays a significant role in monitoring crustal plate motion, landslide detection, and maintenance of the global coordinate framework. Long Short-Term Memory (LSTM), a deep learning model has been widely applied in the field of high-precision time series prediction especially when combined with Variational Mode Decomposition (VMD) to form the VMD-LSTM hybrid model. To further improve the prediction accuracy of the VMD-LSTM model, this paper proposes a dual variational modal decomposition long short-term memory (DVMD-LSTM) model to effectively handle the noise in GNSS time series prediction. This model extracts fluctuation features from the residual terms obtained after VMD decomposition to reduce the prediction errors associated with residual terms in the VMD-LSTM model. Daily E, N, and U coordinate data recorded at multiple GNSS stations between 2000 and 2022 are used to validate the performance of the proposed DVMD-LSTM model. The experimental results demonstrate that compared to the VMD-LSTM model, the DVMD-LSTM model achieves significant improvements in prediction performance across all measurement stations. The average RMSE is reduced by 9.86%, and the average MAE is reduced by 9.44%. Furthermore, the average accuracy of the optimal noise model for the predicted results is improved by 36.50%, and the average speed accuracy of the predicted results is enhanced by 33.02%. These findings collectively attest to the superior predictive capabilities of the DVMD-LSTM model, thereby enhancing the reliability of the predicted results.

To enhance the safety of power grid operations, this study proposes a high-precision short-term photovoltaic power prediction method that integrates information from surrounding pho-tovoltaic stations and the Conv-LSTM-ATT model. In the deep learning prediction model, not only is numerical weather prediction (NWP) data from the target photovoltaic station used as input features, but also highly correlated features from nearby photovoltaic stations are incor-porated. The research begins by analyzing the correlation between irradiance and power se-quences, along with distance factors, to calculate a composite similarity index between the target and other regional photovoltaic stations. Stations with high similarity indices are then selected as data sources. Subsequently, Bayesian optimization techniques are employed to find the optimal data fusion ratios. Ultimately, using the selected data, power prediction mod-eling is conducted via the Conv-LSTM-ATT deep neural network. Experimental results con-firm the superiority of the proposed model, which demonstrates higher predictive accuracy compared to three other classical models. The data fusion strategy determined by Bayesian optimization significantly enhances prediction accuracy, reducing the root mean square error (RMSE) of the test set by 20.04%, 28.24%, and 30.94% for three weather types, respectively.

Although commercially-available low-cost air quality sensors have low accuracy, the sensor system are being used to collect the data for the regulation of PM2.5 emission caused by industrial activities or to estimate the personal exposure for PM2.5. In this work, to solve the accuracy problem of low-cost PM sensor, we developed a new PM2.5 calibration model by combining the deep neural network (DNN) optimized in calibration problem and a LSTM optimized in time-dependent characteristics. First, two datasets were generated to test the accuracy performance and generalization performance of the PM2.5 calibration machine learning (ML) model. The PM2.5 concentrations, temperature and humidity by low-cost sensor and gravimetric-based PM2.5 measuring instrument were sampled for a sufficiently long time. The proposed model was compared with benchmark (multiple linear regression model) and low-cost sensor results. For root mean square error (RMSE) for PM2.5 concentrations, the proposed model reduced 41-60% of error compared to the raw data of low-cost sensor, and reduced 30-51% of error compared to the benchmark model. R2 of ML model, MLR and raw data were 93, 80 and 59 %. Also, the developed model still showed consistent calibration performance when calibrated with new sensors in different locations. Low-cost sensors combined with ML model not only can improve the calibration performance of benchmark, but also can be applied to the sensor monitoring systems for various epidemiologic investigations and regulatory decisions.

Ultrasonic-guided lamb wave approach is an effective non-destructive testing (NDT) method used for detecting localized mechanical damage, corrosion, and welding defects experienced in metallic pipelines. Signal processing of the guided waves is often challenged due to the complexity of operational conditions and environments in the pipelines. Machine learning approaches in recent years, including convolutional neural networks (CNN) and long short-term memory (LSTM), have exhibited their advantages to overcome these challenges for signal process and data classification of complex systems, thus great potential for damage detection of critical oil/gas pipeline structures. In this study, a CNN-LSTM hybrid model is utilized for decoding ultrasonic guided waves for damage detection of metallic pipelines, and twenty-nine features are extracted as input to classify different types of defects from metallic pipes. The prediction capacity of the CNN-LSTM model is assessed by comparing it to the CNN and LSTM. The results demonstrate that the CNN-LSTM hybrid model exhibits much higher accuracy, with 94.8%, as compared to those of CNN and LSTM. Interestingly, the results also reveal that predetermined features, including time-, frequency-, and time-frequency domains, could significantly improve the robustness of the deep learning approaches, even though the deep learning approaches are often believed they include automated feature extraction, without the hand-crafted steps as the shallow learning do. Furthermore, the CNN-LSTM model displays higher performance when the noise level is relatively low (e.g., SNR=9 or higher), as compared to the other two models, but its prediction drops gradually with the increase of the noise.

Speech emotion recognition (SER) is a technology that can be applied in distance education to analyze speech patterns and evaluate speakers’ emotional states in real-time. It provides valuable insights and can be used to enhance the learning experience by enabling the assessment of instructors’ emotional stability, a factor that significantly impacts information delivery effectiveness. Students demonstrate different engagement levels during learning activities, and assessing this engagement is an important aspect of controlling the learning process and improving e-learning systems. An important aspect that may influence student engagement is the emotional states of their instructors. Accordingly, this research uses deep learning techniques to create an automated system for recognizing instructors’ emotions in their speech when delivering distance learning. This methodology entails integrating Transformer, convolutional neural network, and long short-term memory architectures into an ensemble to enhance SER. Feature extraction from audio data used Mel-frequency cepstral coefficients, chroma, Mel spectrogram, zero crossing rate, spectral contrast, centroid, bandwidth, roll-off, and root-mean square, with subsequent optimization processes adding noise to, conducting time stretching, and shifting the audio data. Notably, several Transformer blocks were incorporated, and a multi-head self-attention mechanism was employed to identify the relationships between the input sequence segments. The pre-processing and data augmentation methodologies significantly enhanced the precision of the results in that the model achieved accuracy rates of 96.3%, 99.86%, 96.5%, and 85.3% on the Ryerson Audio-Visual Database of Emotional Speech and Song, Berlin Database of Emotional Speech, Surrey Audio-Visual Expressed Emotion, and Interactive Emotional Dyadic Motion Capture datasets. Furthermore, it achieved 83% accuracy on another dataset created for this research—the Saudi Higher Education Instructor Emotions dataset. The results demonstrate this model’s considerable accuracy in detecting emotions in speech data across different languages and datasets.

River flow prediction is a pivotal task in the field of water resource management during the era of rapid climate change. The highly dynamic and evolving nature of the climatic variables e.g., precipitation has a significant impact on the temporal distribution of the river discharge in recent days making the discharge forecasting even more complicated for diversified water-related issues e.g., flood prediction and irrigation planning. To predict the discharge, various physics-based numerical models are used using numerous hydrologic parameters. Extensive lab-based investigation and calibration are required to reduce the uncertainty involved in those parameters. However, in the age of data-driven predictions, several deep learning algorithms showed satisfactory performance in dealing with sequential data. In this research, Long Short-term Memory (LSTM) neural network regression model is trained using over 80 years of daily data to forecast the discharge time series up to 3 days ahead of time. The performance of the model is found satisfactory through the comparison of the predicted data with the observed data, visualization of the distribution of the errors and Root Mean Squared Error (RMSE) value of 0.09. Higher performance is achieved through the increase in the number of epochs and hyper parameter tuning. This model can be transferred to other locations with proper feature engineering and optimization to perform univariate predictive analysis and potentially be used to perform real-time river discharge prediction.

The paper focuses on the application of a multilevel, integrative and territorial approach to the protection of cultural heritage through planning instruments in Serbia. It points out the problems of the sectoral approach and discusses international recommendations that can be integrated into the planning methodology. The case study is the area of Djerdap National Park, which has an already established international and national importance. The research suggests that the cultural heritage in the area, with the exception of the Roman limes, is still recognized at the level of individual localities. The study emphasizes the importance of aligning all levels of governance to safeguard the whole spatial entity rather than focusing solely on its particular areas. The interna-tional and national importance of the planning area contributes to the strengthening of awareness of heritage and its institutional protection. However, the vitality of the area, which is key to its sustainable development, comes from the local level. Planning documents contribute to the inte-gration of local values and local communities into development programs and projects.

Glycosidic linkage analysis was conducted on the unfractionated polysaccharides in the alcohol-insoluble residues (AIRs) prepared from six red seaweeds (Gracilariopsis sp., Prionitis sp., Mastocarpus papillatus, Callophyllis sp., Mazzaella splendens, and Palmaria palmata) using GC-MS/FID analysis of partially methylated alditol acetates (PMAAs). The cell walls of P. palmata primarily contained mixed-linkage xylans and small amounts of sulfated galactans and cellulose. In contrast, the unfractionated polysaccharides of the other five species were rich in galactans displaying diverse 3,6-anhydro-galactose and galactose linkages with varied sulfation patterns. Different levels of cellulose were also observed. This glycosidic linkage method offers advantages for cellulose analysis over traditional monosaccharide analysis that is known for underrepresenting glucose in crystalline cellulose. Relative linkage compositions calculated from GC-MS and GC-FID measurements showed that anhydro sugar linkages generated more response in the latter detection method. This improved linkage workflow presents a useful tool for studying polysaccharide structural variations across red seaweed species. Furthermore, for the first time, relative linkage compositions from GC-MS and GC-FID measurements, along with normalized FID and total ion current (TIC) chromatograms without peak assignments, were analyzed using principal component analysis (PCA) as a proof-of-concept demonstration of the technique's potential to differentiate various red seaweed species.

Background: Educating college students about the importance of good sleep habits could lead to the adoption of healthier sleep routines, including sufficient sleep duration and sleep quality. The current pre-post study examines the impact of completing a sleep education program called “Sleep 101” on (1) sleep hygiene practices, (2) sleep quality, and (3) weekday and weekend sleep behaviors among college students. “Sleep 101” is an interactive online course developed to educate college students about the importance of sleep by addressing basic sleep physiology, the impact of sleep on mood, academic and physical performance, the interactions between sleep and various substances, and common sleep disorders. Methods: 338 college students were recruited from a midsized public university in the US and invited to participate in “Sleep 101”, of which 25 participants completed the baseline and post-intervention questionnaire. The Sleep Hygiene Index (SHI) was utilized to evaluate sleep hygiene practices, while standard questions were employed to assess weekday and weekend sleep behaviors and overall sleep quality. Results: Those who completed the study demonstrated a significant increase in weekday sleep duration and were less likely to engage in negative prior bedtime activities. In addition, 40% of those who completed baseline and post-intervention assessments noticed improvements in their sleep quality. Conclusion: These findings suggest that a brief online program is beneficial in improving sleep behaviors among college and could be a scalable approach to addressing current sleep issues and preventing future sleep problems in college students.

The profile of secondary metabolites occurring in apple cuticular layer is not only characteristic for particular apple cultivar, but also dynamically reflects various external factors in growing environment. In this study, the possibility to authenticate apple samples based on analysis of their cuticular layer extracts was investigated. Ultra-high-performance liquid chromatography coupled to high resolution tandem mass spectrometry (UHPLC-HRMS/MS) was employed for obtaining metabolomic fingerprints. In total, 274 authentic apple samples, four cultivars harvested within the seasons 2020 to 2022 in the Czech Republic and Poland were analysed. The generated complex data processed by univariate and multivariate statistical methods enabled to build classification models for discrimination of apple cultivars as well as their geographical origin. The models showed very good performance in differentiation of Czech and Polish samples for three of four cultivars: ‘Gala’, ‘Golden Delicious’ and ‘Idared’, moreover, the validity of the models was verified over harvest seasons. The diagnostic markers, besides metabolites of triterpene biosynthetic pathway, mainly represented wax esters. ‘Jonagold’, which is known to be susceptible to mutations, was the only cultivar for which the unambiguous classification of geographical origin was not possible.

Strawberry root rot caused by Neopestalotiopsis clavispora is one of the main diseases of strawberry and significantly impacts the yield and quality of strawberry fruit. There are now no effective control techniques available except for fungicide sprays, which may directly impact consumers. Biological control is becoming an alternative method for the control of plant diseases to replace or decrease the application of traditional synthetic chemical fungicides. Trichoderma is widely used as a biological agent for controlling strawberry root rot. In order to provide resources for screening the highly effective biocontrol fungus for controlling strawberry root rot caused by Neopestalotiopsis clavispora, the biocontrol mechanism,the control effects of Trichoderma asperellum CMT10 against strawberry root rot and growth-promoting effects on strawberry seedlings were investigated by plate culture, microscopy observation and root drenching methods.The results showed that CMT10 had obvious competitive, antibiotic and hyperparasitism effects on Neopestalotiopsis clavispora CMGF3. The CMT10 could quickly occupy nutritional space, and the inhibition rates of CMT10 against CMGF3 in confrontation culture on 7 d was 65.49%. The inhibition rates of volatile metabolite and fermentation metabolite produced by CMT10 against CMGF3 were 79.67% and 69.84%, respectively. The mycelium of strain CMT10 can act as hyperparasites by making contacting, winding and penetrating hyphae of CMGF3. Pot experiment showed that the biocontrol efficacy of CMT10 on strawberry root rot caused by Neopestalotiopsis clavispora was 63.00%. CMT10 had obvious promotion effect on strawberry growth, the plant height, root length, total fresh weight, root fresh weight, stem fresh weight and root dry weight, with the promotion rates were 20.09%, 22.39%, 87.11%, 101.58%, 79.82% and 72.33%, respectively. Overall, this study showed the ability of Trichoderma asperellum CMT10 to control strawberry root rot and their potential to develop as novel biocontrol agents to replace chemical fungicides for eco-friendly, sustainable agriculture.

Apis mellifera, especially weak ones, are highly vulnerable to Carpoglyphus lactis mites, which can rapidly infest and consume stored pollen, leading to weakened colonies and potentially colony collapse. This study aimed to ascertain and investigate the prevalence of this mite in honeybee colonies across 9 provinces in the Republic of Korea (ROK). A total of 615 honeybee colonies were collected, from 66 apiaries during the spring and 58 apiaries during the summer of 2023. A 1,242 bp segment of the the Cytochrome c oxidase subunit 1 (COI) gene was amplified using the polymerase chain reaction method. The detection levels of C. lactis in the honeybees were compared between winter and summer. Based on the COI sequence analysis, the nucleotide sequence similarity of C. lactis mites isolated in the ROK with those from China (NC048990.1) was found to be 99.5%, and with those from the United Kingdom (KY922482.1) was 99.3%. This study is the first report of C. lactis in Korean apiaries. The findings in this study demonstrate a significantly higher detection rate in winter, which is 4.1 times greater than that in summer (p < 0.001). Furthermore, the results underscore the usefulness of molecular diagnostic techniques for detecting C. lactis mites.

COX II containing a dual core CuA active site is one of the three core subunits of mitochondrial Cco, which plays a significant role in the physiological process. In this report, the full-length cDNA of COXⅡ gene was cloned from Sitophilus zeamais, which had an ORF of 684 bp encoding 227 amino acids residues. The predicted COXⅡ protein had a molecular mass of 26.2 kDa with pI value of 6.37, and multiple sequence alignment and phylogenetic analysis indicated that Sitophilus zeamais COXⅡ had high sequence identity 78.51% with the COXⅡ of other insect species, especially similarity to sitophilus oryzae. This gene was subcloned into the prokaryotic expression vector pET-32a, and induced by IPTG in E.coli Transetta (DE3) expression system. Finally the COXⅡ with 6-His tag was purified using affinity chromatography with Ni²⁺-NTA agarose. WB showed the recombinant COXⅡ was about 44 kD, and the concentration of fusion protein was 50μg/mL. UV-spectrophotometer and infrared spectrometer analysis showed that recombinant COXⅡ could catalyze the oxidation of substrate Cytc, and influenced by AITC. It was found that AITC could form a hydrophobic region with COXⅡ protein via molecular docking, besides, a sulfur atom of AITC structure could form a length of 2.9 Å hydrogen bond with Leu-31. These results will provide valuable information for elucidating the role of COXⅡ in Sitophilus zeamais responses to AITC, meanwhile, it will helpful to carry out a point mutation in AITC binding sites for the future research.

The properties of the annual, semiannual and triennial oscillations (AO, SAO and TO) in the middle atmosphere have been investigated using the TIMED/SABER temperature data. The Lomb-Scargle and wavelet spectra were used to determine the dominant oscillations in the background temperature field. The AO is prominent at the mid-latitudes. The AO amplitudes present an asymmetry between the two Hemispheres, being larger in the mesosphere than in the stratosphere. The SAO dominates the tropical regions, with three amplitude maxima at altitudes of 45, 75, and 85 km. The SAOs in the upper mesosphere (75 km) are out of phase with those in the mesopause (85 km) in the tropical regions, which can generate an enhancement of 11 K at each equinox, contributing to the lower mesospheric inversion layer. The TO is significant in the tropical region, with amplitude being maximum at 35, 45 and 85 km. Result shows that there may be potential interaction by the TO with SAO at 85km at the equator. The relation between ENSO and TO has also been discussed. The ENSO signal may modulate the amplitude of the TO, mainly in the lower stratosphere. The real origin of the TO may lie in the wave-mean-flow interaction.

This paper is focused on typical rural settlements in the Stara Planina Mountain area in Serbia. They are distinguished by their authenticity, identity and character, and they have still not been destroyed by inappropriate development as is the case in some other mountain areas in Serbia, where the effects of urbanization, globalization and homogenization are obvious. Consequently, there is a need to prevent these effects in mountain areas where there is a threat of disbalance between development and the inherited natural and cultural values. The paper starts from several important concepts that relate contemporary approaches to cultural heritage preservation, place morphology and planning future development. The concept definitions from recent documents from related fields are used. These concepts are then applied to the area of Stara Planina Mountain and its rural settlements. The necessity for an integrative approach to planning this area with significant natural and anthropogenic potential is pointed out, including its integration into international programs of sustainable development.

The research reported on this paper was aimed at improving the overall efficiency of a PDO certified artisanal cheese production process. Being a PDO certified foodstuff by the EU, it is considered to have properties and qualities determined by the geographical environment in which is made, with its production taking place in a specific and determined geographical location, in this case the Serra da Estrela region. In that sense, the authors conducted a mapping according to a systemic perspective of the processes involved in the context of manufacturing and distribution of certified Serra da Estrela cheese. Numerous methods were used throughout the process, such as a systemic design analysis, and techniques derived from ethnographic methods, which led to the collection of data in the field and consequently provided the immersion of the researcher in genuine work situations. Critical points were identified and emphasized in the systemic map with the purpose of encouraging initiatives to address and overcome the gaps and inefficiencies detected. The systemic design analysis triggered the development of design work. Observations following an ethnographic approach identified ergonomic risks in cheese making during the process of cutting excess chips, fostering the emergence of musculoskeletal disorders at the wrist. A tool that fits best to the task at hand was developed. A prototype of the new tool enabled collecting feedback from use in the work context, in order to inform product development. The domains of agricultural production and microbiology, considering the specific microorganisms developed trough the ripening process of the cheese, turned out to be aspects of high importance for the issue under focus, contributing to a broader understanding of the ripening process and its risks, simultaneously improving the efficiency and success of cheese production. If it were not for the systemic analysis, which served as a link between the boundaries of distinct domains such as the risk of microorganism contamination, ergonomics, energy efficiency, legislation and regulation policies, transportation challenges and economic viability, approached throughout the research. Simultaneously creating bridges between them, the various problems might not have been detected in the first place, as they are usually addressed in specialized disciplines, predetermined by the restrictions of each specific area of knowledge. As a consequence of the development of this research, which was based on an analysis that sought to establish possible connections between various disciplines and tried to constantly maintain a holistic perspective, making new connections and observing the issues from a new angle, apart from the already established methodologies. All this allowed to lay out the seeds for the development of a plan to tackle the critical points identified by the systemic analysis reported in this paper.