This work addresses the intricate task of predicting the prices of diverse financial assets, including stocks, indices, and cryptocurrencies, each exhibiting distinct characteristics and behaviors under varied market conditions. To tackle the challenge effectively, a novel hybridized architecture, AE-GRU, integrating the encoder-decoder principle with GRU is designed. The experimentation involves multiple activation functions and hyperparameter tuning. With extensive experimentation and enhancements applied to AE-LSTM, the proposed AE-GRU architecture still demonstrates significant superiority in forecasting the annual prices of volatile financial assets from multiple sectors mentioned above. Thus, the novel AE-GRU architecture emerges as a superior choice for price prediction across diverse sectors and fluctuating market scenarios by extracting important non-linear features of financial data and retaining the long-term context from past observations.

Although working memory (WM) is crucial for intellectual abilities, not much is known about its brain underpinnings, especially the structural connectivity. We used diffusion tensor imaging (DTI) to look across the whole brain for the white matter integrity correlates of the individual differences in the reading span (verbal WM capacity during reading) in healthy adults. Right-handed healthy native Russian speakers (N = 67) underwent DTI on a 3T Philips Ingenia scanner. Verbal WM was assessed with the Daneman-Carpenter reading span test (Russian version). Fractional anisotropy maps from each participant were entered into the group tract-based spatial statistics analysis with the reading span as a covariate; the results were TFCE-corrected. After taking into account effects of age, sex, education and handedness, reading span positively correlated with the white matter integrity in multiple sites: the body, the genu and the splenium of corpus callosum; bilateral corona radiata (anterior, posterior, and superior); bilateral superior longitudinal fasciculus; several tracts in the right hemisphere only, including the internal and external capsule; bilateral superior parietal and frontal white matter. Although the left hemisphere is central for verbal processing, we revealed the important role of the right hemisphere white matter for the verbal WM capacity. Our finding indicates that larger verbal working memory span may originate from additional processing resources of the right hemisphere.

Breast Cancer diagnosis is one of the most studied problems in the medical domain. In the medical domain, cancer diagnosis has been studied extensively which instantiates the need of early prediction of cancer disease. For obtaining advance prediction, health records are exploited and given as input to an automated system. This paper focuses on constructing an automated system by employing deep learning based recurrent neural network models. A stacked GRU-LSTM-BRNN is proposed in this paper that accepts health records of a patient for determining possibility of being affected by breast cancer. Proposed model is compared against other baseline classifiers such as stacked Simple-RNN model, stacked LSTM-RNN model, stacked GRU-RNN model. Comparative results obtained in this study indicate that stacked GRU-LSTM-BRNN yield better classification performance for predictions related to breast cancer disease.

The purpose of the study was to provide support in the decision-making process for architects and engineers regarding large-spans structures for the presentation of archaeological sites in situ - construction of roofs, shelters, and bridges. We examined existing practice and analyzed their engineering classifications looking for a pattern in their application regarding sustainability and relation between type of cultural heritage site and type of applied large span structure. Contemporary engineering structures at built heritage sites create a sharp contrast between old and new. A presentation of cultural heritage in situ requires an understanding of heritage theory and internationally accepted doctrine which exceeds common engineering education. Nevertheless, application of large-span structures, which often take advantages of state-of-art construction-technologies nowadays, is also an aesthetical statement that affects the appearance of the site. Therefore, we gave an overview of the theoretical background of aesthetical issues and the overall ethics of the decision-making process in such sensitive cases. Within the framework of heritage-presentation, engineering and architectural issues, and selected case studies, we concluded in favor of the application of large-span structures under certain conditions.

The master molecular regulators and mechanisms determining longevity and health span include nitric oxide (NO) and superoxide anion radicals (SOR). L-arginine, the NO synthase (NOS) substrate, can restore a healthy ratio between the dangerous SOR and the protective NO radical to promote healthy aging. Antioxidant supplementation orchestrates protection against oxidative stress and damage—L-arginine and antioxidants such as vitamin C increase NO production and bioavailability. Uncoupling of NO generation with the appearance of SOR can be induced by asymmetric dimethylarginine (ADMA). L-arginine can displace ADMA from the site of NO formation if sufficient amounts of the amino acid are available. Antioxidants such as ascorbic acids can scavenge SOR and increase the bioavailability of NO. The topics of this review are the complex interactions of antioxidant agents with L-arginine, which determine NO bioactivity and protection against age-related degeneration.

The master molecular regulators and mechanisms determining longevity and health span include nitric oxide (NO) and superoxide anion radicals (SOR). L-arginine, the NO synthase (NOS) substrate, can restore a healthy ratio between the dangerous SOR and the protective NO radical to promote healthy aging. Antioxidant supplementation orchestrates protection against oxidative stress and damage—L-arginine and antioxidants such as vitamin C increase NO production and bioavailability. Uncoupling of NO generation with the appearance of SOR can be induced by asymmetric dimethylarginine (ADMA). L-arginine can displace ADMA from the site of NO formation if sufficient amounts of the amino acid are available. Antioxidants such as ascorbic acids can scavenge SOR and increase the bioavailability of NO. The topics of this review are the complex interactions of antioxidant agents with L-arginine, which determine NO bioactivity and protection against age-related degeneration.

The recently defined and yet rather new topic of Healthy aging is gathering more attention on the global stage. With world’s population getting older - it is rapidly becoming very important to develop and maintain functional abilities in older age and develop mechanisms to protect senior population from chronic diseases. One of the most effective components, as well as, one may call - process involved in, and strongly associated with aging is recently discovered and Nobel prize awarded - nitric oxide as a signaling molecule, which followed by later discoveries showed to have a positive metabolic, immune and anti-inflammatory effects. One of the most debated topics of the last decade in the scientific community is nitrates, one of the pathways involved in nitric oxide production. Thus, the objective of this study was to evaluate effect of different potassium nitrate concentrate supplementation on Drosophila melanogaster longevity. 0,5-3% potassium nitrate medium was analyzed on the life span and motor function in different groups consisting of 100 females fruit flies each. In this assay, female fly species supplemented with potassium nitrate diet showed life span increase by 18.6% and 5.1% with 1% and 2% KNO3- respectively with a positive impact on locomotor function. In conclusion, we found that low concentration of potassium nitrate medium increased lifespan and locomotor function in Drosophila melanogaster.

Due to the extraordinary mechanical properties of ultra-high-performance concrete (UHPC), the shear stirrups in UHPC beams could potentially be removed. The aim of this study is to determine the effect of beam height and steel fiber volume content on the shear behavior of non-stirrup UHPC beams under a larger shear span-depth ratio (up to 2.8). Eight beams were designed and fabricated, including six non-stirrup UHPC beams and two comparing stirrup-reinforced normal concrete (NC) beams. The experimental results demonstrated that the volume content of steel fiber could be a crucial factor affecting the ductility, cracking strength, and shear strength of non-stirrup UHPC beams and altering their failure modes. Additionally, the height of the beam had a considerable effect on its shear resistance. This study revealed that the French standard formulae were more accurate for the UHPC beams with larger shear span-depth ratios and PCI-2021 formulae greatly overestimate the shear capacity of UHPC beams with larger shear span-depth ratios. Xu’s formulae were more accurate for the steel fiber-reinforced UHPC beams with larger shear span-depth ratios.

Predicting the prices of cryptocurrency owing to its volatility, instability, and other factors has been challenging; investors and traders especially in Nigeria have been on a constant look for a more reliable way of knowing market trends and prices and while there has been so many research conducted using deep learning, the results for which has fall short of what investors could called a strong predictor. This research reviewed the results of many works that had been done and proposed two types of recurrent neural network (RNNs) namely Long Short-Term Memory and Gated Recurrent Unit (GRU) for predicting the future prices of two of the most common crypto assets namely Bitcoin (BTC) and Ethereum (ETH), these two were selected based on their popularity, the volume traded and their market capitalization. The experiment was conducted in a GPU Jupyter Notebook environment and the performance of our experiment was evaluated on a test set using root mean square error (RMSE) and based on its values, the LSTM presented a better performance with rsme scores of 654.66, and 80.30 respectively for BTC and ETH as compared to GRU. The paper proceeds further to compare the results of this experiment with other related works and we discovered that its performance is a great improvement.

The BP neural network and PSO algorithm are applied into analyzing the reliability of long-span Concrete Filled Steel Tubular (CFST) arch bridges. Firstly, using BP neural network to fit the structural performance function. And then the PSO method was used to calculate the reliability index. A long-span Concrete Filled Steel Tubular arch bridges reliability indices were calculated whether considering the geometric nonlinearity or not. The calculation and analysis results showed that the BP neural network and PSO algorithm compensated the deficiency of the traditional reliability analysis methods, improved the calculation accuracy, provided a new thought and means for the research on the reliability of long-span bridge structure, and well applied to the reliability analysis of long-span Concrete Filled Steel Tubular arch bridges. Additionally, the reliability analysis of long-span Concrete Filled Steel Tubular arch bridges on service limit state must consider the geometric nonlinearity effect, or the results will tend to be unsafe.

Accurate classification of objects in 3D point clouds is a significant problem in several applications, such as autonomous navigation and augmented/virtual reality scenarios, which has become a research hot spot. In this paper, we presented a deep learning strategy for 3D object classification in augmented reality. The proposed approach is a combination of the GRU and LSTM. LSTM networks learn longer dependencies well, but due to the number of gates, it takes longer to train; on the other hand, GRU networks have a weaker performance than LSTM, but their training speed is much higher than GRU, which is The speed is due to its fewer gates. The proposed approach used the combination of speed and accuracy of these two networks. The proposed approach achieved an accuracy of 0.99 in the 4,499,0641 points dataset, which includes eight classes (unlabeled, man-made terrain, natural terrain, high vegetation, low vegetation, buildings, hardscape, scanning artifacts, cars). Meanwhile, the traditional machine learning approaches could achieve a maximum accuracy of 0.9489 in the best case.

Large-span post-tensioned (PT) beams play a crucial role in maximizing the benefits of post-tensioning techniques. Bonded and unbonded systems are prevalent, with the latter being more widespread in the United States. While bonded systems are advantageous for creating long spans when multiple tendons are grouped in ducts, limited literature exists on their demolition. In a case study, this paper addresses the unique challenge of demolishing large-span bonded post-tensioned beams due to a building's functional change. Emphasizing insights for engineers, it explores the use of cutting and dismantling methods, considering the presence of prestressed cables. The demolition process is distinctive due to the presence of numerous pre-stressed cables along the beams, necessitating a specialized and cautious cutting approach. This is accomplished through the use of a drilling technique that selectively distresses the tendons, ensuring they are not all affected simultaneously. An intriguing observation discussed in this paper pertains to the occurrence of horizontal cracks accompanied by loud sounds following the drilling process, offering insights from the design perspective of PT systems. The paper details an innovative method for safely demolishing large-span bonded PT beams, using ground-penetrating radar and computer models to navigate structural complexities and ensure nearby structures' safety.

Improper lifting measures of long-span spatial steel structures during construction process may delay the construction period and even cause safety accidents. Few studies on long-span spatial steel structures considered time-varying mechanical characteristic during construction process. In order to achieve safe and efficient installation in a long-span spatial steel structure, this research presents a time-varying mechanical analysis of the synchronous and asynchronous integral lifting and a single and interlaced point’s asynchronous integral lifting analysis method of a long-span spatial steel structure. The results showed that in the case of asynchronous lifting of single point, the displacement influence on other members is related to the distance. The closer the distance from the lifting point, the greater the influence. In asynchronous integral lifting, the lifting point with large lifting force is first installed to the specified position, and the lifting point with small lifting force is installed to the specified position.

The determination of the non-loading condition of the rail cable shifting (RCS) system, which consists of main cables, hangers and rail cables, is the premise of the girder erection for the long-span suspension bridges. An analytical form-finding analysis model of shifting system is established according to the basic assumptions of flexible cable structures. Herein, the rail cable is discretized into segmental linear cable elements and the main cable is discretized into segmental catenary elements. Moreover, the calculation and analysis equation of each member and their iterative solutions are derived by taking the elastic elongation of the sling into account. In addition, by taking the girder construction of Aizhai suspension bridge as engineering background, a global scale model of the RCS system is designed and manufactured; also the test system and working conditions are established. The comparison between the test results and analytical results shows the presented analytical method is correct and effective. The process is simplified in the analytical method, and the computational results and precision can satisfy the practical engineering requirements. In addition, the proposed method is suitable to apply to the computation analysis of similar structures.

In view of the limitations of the existing optimization method of suspender cable force, in order to improve the stress of suspender under completion state and avoid frequent adjustment of cable force and grid beam elevation during construction, a new method of cable force optimization is proposed. The article takes the longest large span arch bridge in the world, Pingnan Third Bridge, a Concrete-filled steel tube (CFST) arch bridge with a span of 575m as the engineering background combined with the finite element analysis and multi-objective optimization method. One cable force optimization method that suspender “Real-time correction during construction, in the process variable optimal and results reliable” during panel girder lifting of long span CFST arch bridges is clarified. Taking the panel girder weight and displacement during the construction as parameter variables, the displacement and unevenness of the panel girder under completion state as constraint conditions, the displacement and cable force during the hoisting construction as the objective equation, through the optimization of the objective equation, the suspender cable force and dis-placement of each hoisting section are calculated. The results show that it is feasible to introduce the optimization theory into the cable force optimization when lifting the panel girder. the segment displacement variation is minimized to meet the destination. The cable force distributed evenly under completion state of the bridge that further making sure the completion state satisfies the requirements. No repeating iteration is needed, thus avoiding cumberso me calculation, getting cable force once. With higher optimization efficiency and better effects, the method provides high value for the cable force calculation of same type bridge suspender construction and for guiding construction.

Noise model selection criteria has a significant impact on identifying the stochastic noise proper-ties of any GNSS daily coordinate time series. The low-frequency random walk noise existing in these time series could lead to overestimation of the tectonic rate, so it is of great significance to accurately detect the random walk component. This study focuses on noise model estimation cri-terion (BIC_tp) derived from the AIC and the BIC by introducing 2π factors. It is more sensitive to abnormal steps (random jumps). Using observation data from 72 GNSS stations from 1992 to 2022 and simulated data, four combined noise models are used to explore the impacts of time se-ries lengths (ranging from2 to 24 years) and data loss (between 2% and 30%) on noise models and velocity estimation. The results show that as the time length increased, the selected optimal noise model, and the estimated uncertainty of the tectonic trend with different data gap, gradually con-verge. When the time length is short (less than 8 years), it could lead to the FNRWWN, FNWN, and PLWN models being mistakenly estimated as GGMWN models, thereby affecting the accura-cy of determining the station velocity parameters. When the time length is 12 years, the RW noise component is more probably detected, As the time length increases, the impact of RW on velocity uncertainty is weakened. Finally, we conclude that for a time series with a minimum time length of 12 years, both the selection of the optimal stochastic noise model and the estimation of the ve-locity parameters are reliable.

Long span cable-stayed bridge is the main bridge type with a span of more than 400 meters. It is generally designed as a double tower long-span structure with good spanning capacity and economic performance. Wind resistance safety performance is the main index to control the long-span cable-stayed bridge structure. During the operation of long-span cable-stayed bridge structure, because the service life of the cable is far less than the design life of the structure, the wind resistance performance of the structure will inevitably deteriorate significantly, which will seriously affect the structural service performance of symmetric cable-stayed bridge. Based on symmetric reliability theory, this paper takes flutter and static wind stability of long-span cable-stayed bridge structure as the main design control index, uses positive reliability theory to calculate the reliability index of symmetric cable-stayed bridge structure, uses inverse reliability theory to calculate the safety factor of symmetric cable-stayed bridge structure, and evaluates the wind resistant time-varying performance of long-span cable-stayed bridge structure by comprehensively considering the reliability index and safety factor. Taking a practical project of a long-span cable-stayed bridge as a specific case, the wind resistant time-varying reliability of the bridge during its operation for more than 30 years is analyzed, and the parameter sensitivity is analyzed. The results show that the wind resistance performance of the cable-stayed bridge structure is obviously affected by the cable, and the degradation of the cable performance will have an important impact on the wind resistance time-varying performance of the structure, especially the critical wind speed of the structure has obvious time-varying characteristics. The safety factor and reliability index can objectively evaluate the wind resistance time-varying performance of the long-span cable-stayed bridge structure.

Deep neural networks (DNNs) have made a huge impact in the field of machine learning by providing unbeatable humanlike performance to solve real-world problems such as image processing and natural language processing (NLP). Convolutional neural network (CNN) and recurrent neural network (RNN) are two typical architectures that are widely used to solve such problems. Time sequence-dependent problems are generally very challenging, and RNN architectures have made an enormous improvement in a wide range of machine learning problems with sequential input involved. In this paper, different types of RNN architectures are compared. Special focus is put on two well-known gated-RNN’s Long Term Short Memory (LSTM) and Gated Recurrent Unit (GRU). We evaluated these models on the task of force estimation system in pouring. In this study, four different models including multi-layers LSTM, multi-layers GRU, single-layer LSTM and single-layer GRU) were created and trained. The result suggests that multi-layer GRU outperformed other three models.

This article comprehensively explores multiple aspects of cryptocurrencies and their price forecasting. Firstly, the article introduces the definition of cryptocurrency and its development process on a global scale, especially focusing on the launch of Facebook Libra and China's central bank digital currency, highlighting the importance and influence of digital currency in the global financial market. Subsequently, the article analyzes the advantages of digital currencies over traditional currencies, including improving economic transaction efficiency, reducing transaction costs and enhancing transaction transparency. Meanwhile, the article also explores the challenges and risks potentially brought by the development of digital currencies, such as regulatory uncertainty and market volatility. In this context, the article raises the importance of cryptocurrency price forecasting and introduces the forecasting models and techniques commonly used today. Finally, through specific experimental analysis, the effectiveness of using the deep learning model CNN-LSTM to predict the price of Bitcoin is demonstrated, and the directions of future research and optimization strategy are proposed. In summary, this paper comprehensively presents the research status and prospects of cryptocurrency and its price prediction field through systematic introduction and analysis.

Ballastless track has high smoothness, but the laying requirements are strict. Therefore, the maximum span of cable-stayed bridges laying ballastless tracks is 392m. For laying ballastless track structures over larger spans, the deformation characteristics of long-span cable-stayed Bridges under complex loads are incomplete, and the interaction between long-span bridge-track structures is unclear. The influence of wavelength of cosine wave on the track- bridge mapping of different orbital structures was explored. The wavelength characteristics of vertical deformation under complex loads were investigated. The track-bridge integrated model for the cable-stayed bridge was establish to analyze the mapping relationship between rail and bridge and wavelength characteristics of deformation. Based on mapping relationships and wavelength characteristics of deformation, the Train-Track-Bridge dynamic simulation model was simplified. The results show that when the minimum wavelength of bridge deformation surpasses 6 m, 10 m, and 16 m, the rail deformation in the ballasted track, the longitudinal-connected track, and the unit slab-type ballastless track accurately mirrors the deformation of the bridge. For the span of bridge ranging from 200 m to 600 m, the wavelength of vertical deformation ranges from 21 to 1270 m under complex loads. During local loads, the vertical deformation below the 200 m wavelength constitutes a significant proportion near the pie. Considering the influence of the deformation on train vibration response, the Train-Bridge dynamic coupling model can be employed to treat the track structure as a load to reduce complexity of model and enhance the calculation efficiency.

As Chronic Non-Communicable Diseases (CNCD) increase, preventive approaches become more crucial. In this review, Calorie Restriction (CR) effects on human beings were evaluated, comparing benefits and risks of different CR diets: classic CR vs ketosis-inducing diets, including Intermittent Fasting (IF), Classic Ketogenic Diet (CKD), Fasting Mimicking Diet (FMD), Very-Low-Calorie Ketogenic Diet (VLCKD) and Spanish Ketogenic Mediterranean Diet (SKMD). Special emphasis on Insulin Resistance (IR) was placed, as it mediates Metabolic Syndrome (MS), a risk factor for CNCD, and predicts MS diagnosis. CR is the most robust intervention known to increase lifespan and health span, with high evidence and known biochemical mechanisms. CR improves cardiometabolic risk parameters, boosts exercise insulin sensitivity response, and there may be benefits of implementing moderate CR on healthy young and middle-aged individuals. However, there is insufficient evidence to support long-term CR. CKD is effective for weight and MS management, and may have additional benefits such as prevention of muscle loss and appetite control. SKMD has extreme significance benefits for all the metabolic parameters studied. Studies show inconsistent benefits of IF compared to classic CR. More studies are required to study biochemical parameters, reinforce evidence, identify risks, and seek effective and safe nutritional CR approaches.

One of the non-linear phenomena that affect high bandwidth and long reach communication systems is the non-linear phenomenon called four-wave mixing (FWM). Unfortunately, the simulation of such systems aiming to obtain their design parameter limitations require more time as the number of channels increases. In this paper, we propose a new high-performance computational model to obtain optimal design parameters in a multi san Dense Wavelength Division Multiplexing (DWDM) system, limited by FWM and the intrinsic Amplified Spontaneous Emission (ASE) noise of optical amplifiers employed in each segment. The simulation in this work provides a complete optical design characterization and compares the efficiency and speed improvement of the proposed parallelization model versus a previous sequential model. Additionally, an analysis of the computational complexity of parallel model is presented, where two parallel implementations are used. First, Open Multi−Processing (OpenMP), based on the use of a central, multi-core processing unit is used and secondly the Compute Unified Device Arquitecture (CUDA), which is based on the use of graphics processing unit. Results show that parallelism improves to up to 40 times the performance of the simulation when nested parallelization with CUDA is used, over de sequential method and up to 6 times compared with the implementation with OpenMP using 12 processors. Within our parallel implementation, it is possible to simulate with an increased number of channels, that was unpractical in the sequential simulation.

Epoxy asphalt (EA) concrete is widely used in constructing long-span steel bridge pavements (SBDPs). This study aims to derive a fatigue damage evolution law, conducting an experimental investigation of SBDP. First, a general theoretical form of the fatigue damage evolution law of materials is established based on the thermal motion of atoms. Then, fatigue experiments demonstrate that this evolution law well represents the known damage–life relationships of SBDP. Taking into account the experimental relationships between damage and fatigue life under symmetrical cyclic loadings with different overload amplitudes and temperature variations, a detailed damage evolution law is deduced. Finally, the role of damage accumulation is discussed on the basis of the proposed damage evolution law for the extreme situation of heavy overload and severe environments. The results show that both heavy loading and falling temperatures increase the fatigue damage of SBDP considerably; therefore, SBDP should avoid heavy loading combined with winter temperatures. EA shows a fatigue life two to three times longer than that of modified matrix asphalt (SMA) or guss asphalt (GA). For the same thickness, EA pavement is demonstrated to be more suitable for an anti-fatigue design of large-span SBDP under high traffic flows and low temperatures.

The prediction of stock prices holds significant implications for researchers and investors in evaluating stock value and risk. In recent years, researchers have increasingly replaced traditional machine learning methods with deep learning approaches in this domain. However, the application of deep learning in forecasting stock prices is confronted with the challenge of overfitting. To address the issue of overfitting and enhance predictive accuracy, this study proposes a stock prediction model based on GRU (Gated Recurrent Unit) with reconstructed datasets. This model integrates data from other stocks within the same industry, thereby enriching the extracted features and mitigating the risk of overfitting. Additionally, an auxiliary module is employed to augment the volume of data through dataset reconstruction, thereby enhancing the model’s training comprehensiveness and generalization capabilities. Experimental results demonstrate a substantial improvement in prediction accuracy across various industries.

Bridge load testing is crucial in evaluating bridge load-carrying capacity and construction quality. However, conventional techniques have many limitations such as the need for direct contact and low acquisition frequency. This study provides a comprehensive examination of the static and dynamic load tests of a multi-span cable-stayed bridge utilizing a ground-based radar inter-ferometer (GB-radar). The case study was conducted at the Fifth Nanjing Yangtze River Bridge (FNYRB), which is recognized as the world's first lightweight steel-concrete composite cable-stayed bridge, with two spans measuring 600 m. To enhance measurement accuracy, a method was proposed to detect and recover radar phase jumps caused by vehicle motion. Furthermore, precise geometry projection was employed to acquire vertical displacements from GB-radar which were taken along the line-of-sight (LOS) direction. Moreover, during the static load test, a continuous deformation was observed with a maximum pace of 0.31 mm/min, indicating a post-construction settlement caused by soft soil consolidation. This case study highlights the high sampling frequency, high measurement accuracy, and exceptional weatherproof ability of GB-radar, thereby demonstrating its potential to be an alternative to the structural health monitoring (SHM) system.

Estimating the Remaining Useful Life (RUL) of aircraft engines holds a pivotal role in enhancing safety, optimizing operations, and promoting sustainability, thus being a crucial component of modern aviation management. Precise RUL predictions offer valuable insights into an engine’s condition, enabling informed decisions regarding maintenance and crew scheduling. In this context, we propose a novel RUL prediction approach in this paper, harnessing the power of Bi-directional LSTM and Transformer architectures, known for their success in sequence modeling, such as natural languages. We adopt the encoder part of the full Transformer as the backbone of our framework, integrating it with a self-supervised denoising autoencoder that utilizes Bidirectional LSTM for improved feature extraction. Within our framework, a sequence of multivariate time series sensor measurements serves as the input, initially processed by the Bidirectional LSTM autoencoder to extract essential features. Subsequently, these feature values are fed into our Transformer encoder backbone for RUL prediction. Notably, our approach simultaneously trains the autoencoder and Transformer encoder, different from the naive sequential training method. Through a series of numerical experiments carried out on the C-MAPSS datasets, we demonstrate that the efficacy of our proposed models either surpasses or stands on par with that of other existing methods.

Accurate and consistent rainfall observations are vital for climatological studies in support of better planning and decision making. However, estimation of accurate spatial rainfall is limited by sparse rain gauge distributions. Satellite rainfall products can thus potentially play a role in spatial rainfall estimation but their skill and uncertainties need to be under-stood across spatial-time scales. This study aimed at assessing the temporal and spatial performance of seven satellite products (TARCAT (Tropical Applications of Meteorology using SATellite and ground-based observations (TAMSAT) African Rainfall Climatology And Time series), Climate Hazards Group InfraRed Precipitation with Station data (CHIRPS), Tropical Rainfall Measuring Mission (TRMM-3B43), Climate Prediction Center (CPC) Morphing (CMORPH), the Precipitation Estimation from Remotely Sensed Information using Artificial Neural Networks- Climate Data Record (PERSIANN-CDR), CPC Merged Analysis of Precipitation (CMAP) and Global Precipitation Climatology Project (GPCP) using gridded (0.05o) rainfall data over East Africa for 15 years(1998-2012). The products’ error distributions were qualitatively compared with large scale horizontal winds (850 mb) and elevation patterns with respect to corresponding rain gauge data for each month during the ‘long’ (March-May) and ‘short’ (October-December) rainfall seasons. For validation only rainfall means extracted from 284 rain gauge stations were used, from which qualitative analysis using continuous statistics of Root Mean Squared Difference, Standard deviations, Correlations, coefficient of determinations (from scatter plots) were used to evaluate the products’ performance. Results revealed rainfall variability dependence on wind flows and modulated by topographic influences. The products’ errors showed seasonality and dependent on rainfall intensity and topography. Single sensor and coarse resolution products showed lowest performance on high ground areas. All the products showed low skills in retrieving rainfall during ‘short’ rainfall season when orographic processes were dominant. CHIRPS, CMORPH and TRMM performed well, with TRMM showing the best performance in both seasons. There is need to reduce products’ errors before applications.

Fluctuating stock prices make it difficult for investors to see investment opportunities. One tool that can help investors overcome this is forecasting techniques. Long Short-Term Memory (LSTM) is one of deep learning methods used in forecasting time series. The training and success of deep learning is strongly influenced by the selection of hyperparameters. This research uses a hybrid method between the Genetic Algorithm (GA) and LSTM to find a suitable model for predicting stock prices. GA is used in optimizing the architecture such as the number of epochs, window size, and the number of LSTM units in the hidden layer. Tuning optimizer is also carried out using several optimizers to achieve the best value. From method that has been applied, it shows that the method has a good level of accuracy with MAPE values below 10% in every optimizer used. The error rate generated is quite low, in case-1 with a minimum RMSE value of 93.03 and 94.40, & in case-2 with an RMSE value of 104.99 and 150.06 during training and testing. A fairly stable and small value is generated by setting it using the Adam Optimizer.

The Dst index is the geomagnetic storm index used to measure the energy level of geomagnetic storms, and the prediction of this index is of great significance for the geomagnetic storm study and the solar activity. In contrast to traditional numerical modelling techniques, machine learning, which has emerged in decades ago based on rapidly developing computer hardware and software and artificial intelligence methods, has been unprecedentedly developed in geophysics, especially solar-terrestrial space physics. This study chooses two machine learning models, the LSTM (Long-Short Time Memory, LSTM) and EMD-LSTM model (Empirical Mode Decomposition, EMD), to model and predict the Dst index. By building the Dst index data series from 2018-2023, two models were built to fit and predict the data. Firstly, we evaluated the influences of the learning rate and the amount of training data on the prediction accuracy of the LSTM model, and finally, 10-3 was thought as the optimal learning rate; secondly, the two models were used to predict the Dst index in the solar active and quiet periods, respectively, and the RMSE (Root Mean Square Error) of the LSTM model in the active period is 7.34 nT, the CC (correlation coefficient) is 0.96, those of the quiet period are 2.64nT and 0.97; the RMSE and r of EMD-LSTM model are 8.87nT and 0.93 in active time and 3.29nT and 0.95 in the quiet time. Finally, the prediction accuracy of the LSTM model in short time period is slightly better than the EMD-LSTM model. However, there will be a problem of prediction lag, which the EMD-LSTM model can then solve, and can better predict the geomagnetic storm.

In industrial settings, gears play a crucial role by assisting various machinery functions such as speed control, torque manipulation, and altering motion direction.The malfunction or failure of these gear components can have serious repercussions, resulting in production halts and financial losses. As a result, there is an increasing requirement to monitor the state of these components in order to avoid such issues from occurring. To address this need, research efforts have focused on early defect detection in gears in order to reduce the impact of possible failures. This study focused on analyzing vibration and thermal datasets from two extruder machine gearboxes using an autoencoder Long Short-Term Memory (LSTM) model. The major goal is to implement an outlier detection approach to detect and classify defects. The results of this study highlighted the extraordinary performance of the Autoencoder LSTM model, which achieved an impressive accuracy rate of 94.42% in recognizing malfunctioning gearboxes within the extruder machine system. Furthermore, the study used a thorough global metrics evaluation methodology to further test the model’s dependability and efficacy, consequently substantiating the proposed approach’s validity.

Radiator reliability is crucial in environments characterized by high temperatures and friction, where prompt interventions are often required to prevent system failures. This study introduces a proactive approach to radiator fault diagnosis, leveraging the integration of Gaussian Mixture Model (GMM) and Long-Short Term Memory (LSTM) autoencoders. Vibration signals from radiators were systematically collected through randomized durability vibration bench tests, resulting in four operating states—two normal, one unknown, and one faulty. Time-domain statistical features of these signals were extracted and subjected to Principal Component Analysis (PCA) to facilitate efficient data interpretation. Subsequently, this study discusses the comparative effectiveness of GMM and LSTM in fault detection. GMMs are deployed for initial fault classification, leveraging their clustering capabilities, while LSTM autoencoders excel in capturing time-dependent sequences, facilitating advanced anomaly detection for previously unencountered faults. This alignment offers a potent and adaptable solution for radiator fault diagnosis, particularly in challenging high-temperature or high-friction environments. Consequently, the proposed methodology not only provides a robust framework for early-stage fault diagnosis but also effectively balances diagnostic capabilities during operation. Additionally, this study presents the foundation for advancing reliability life assessment in accelerated life testing, achieved through dynamic threshold adjustments using both the absolute log-likelihood distribution of the GMM and the reconstruction error distribution of the LSTM autoencoder model.

The CAN protocol is widely adopted for in-vehicle networks due to its cost efficiency and reliable transmission. However, despite its popularity, the protocol lacks built-in security mechanisms, making it vulnerable to various attacks such as flooding, fuzzing, and DoS. These attacks can exploit vulnerabilities and disrupt the normal behavior of the in-vehicle network. One of the main reasons for these security concerns is that the protocol relies on broadcast frames for communication between ECUs within the network. To tackle this issue, this paper presents an intrusion detection system that leverages multiple LSTM-Autoencoders. The proposed system utilizes diverse features, including transmission interval and payload value changes, to capture various characteristics of normal network behavior. By analyzing different types of features separately using the LSTM-Autoencoder model, the system effectively detects anomalies. In our evaluation, we conducted experiments using real vehicle network traffic, and the results demonstrated the system's high precision with a 99% detection rate in identifying anomalies.

Banks are normally offered two kinds of deposit accounts. It consists of deposits like current/saving account and term deposits like fixed or recurring deposits. For enhancing the maximized profit from bank as well as customer perspective, term deposit can accelerate uplifting of finance fields. This paper focuses on likelihood of term deposit subscription taken by the customers. Bank campaign efforts and customer detail analysis can influence term deposit subscription chances. An automated system is approached in this paper that works towards prediction of term deposit investment possibilities in advance. This paper proposes deep learning based hybrid model that stacks Convolutional layers and Recurrent Neural Network (RNN) layers as predictive model. For RNN, Gated Recurrent Unit (GRU) is employed. The proposed predictive model is later compared with other benchmark classifiers such as k-Nearest Neighbor (k-NN), Decision tree classifier (DT), and Multi-layer perceptron classifier (MLP). Experimental study concludes that proposed model attains an accuracy of 89.59% and MSE of 0.1041 which outperform well other baseline models.

Anomaly occurrences in hydraulic machinery may lead to massive systems shut down, jeopardizing the safety of the machinery and its surrounding human operator(s) and environment, and the severe economic implications succeeding the faults and their associated damage. Hydraulics are mostly placed in ruthless environments, where they are consistently vulnerable to many faults. Hence, not only the machines and their components are prone to anomalies, but also the sensors attached to them, which monitor and report their health and behavioral changes. In this work, a comprehensive applicational analysis of anomalies in hydraulic systems extracted from a hydraulic test rig is thoroughly achieved. Firstly, we provided a combination of a new architecture of LSTM autoencoders and supervised machine and deep learning methodologies to perform two separate stages of fault detection and diagnosis. The two phases are condensed by: the detection phase using the LSTM autoencoder. Followed by the fault diagnosis phase represented by the classification schema. The previously mentioned framework is applied to both component and sensor faults in hydraulic systems, deployed in the form of two in-depth applicational experiments. Moreover, a thorough literature review of the past decade related work for the two stages separately is successfully conducted in this paper.

The accurate forecasting of solar power output is essential for ensuring the stable and efficient operation of grid-connected photovoltaic (PV) systems, especially when faced with variable weather patterns. This research focuses on the integration of Machine Learning (ML) methodologies and climatic parameters to predict solar panel energy generation, with a specific emphasis on addressing consumption-production imbalances. Leveraging a dataset sourced from the Kaggle platform, the study is conducted in the context of Estonia, aiming to optimize solar energy utilization in this geographic region. The dataset, obtained from Kaggle, encompasses comprehensive information on climatic variables, including sunlight intensity, temperature, and humidity, alongside corresponding solar panel energy output. Leveraging machine learning algorithms, including XGBoost regression and neural networks, our model aims to identify complex patterns and relationships within the datasets. By tailoring the model to Estonia's climatic nuances, we seek to enhance the accuracy of energy production forecasts and, consequently, better manage the challenges associated with consumption-production imbalances. Furthermore, the research investigates the adaptability of the proposed model to diverse climatic conditions, ensuring its applicability for similar endeavors in other geographical locations. The performance of the forecasting model will be evaluated using error metrics like mean absolute error (MAE) and root mean squared error (RMSE). This study leverages a comprehensive dataset from Kaggle and utilizes advanced machine learning techniques to generate valuable insights. These insights can inform the development of sustainable energy policies and practices, ultimately leading to a more efficient and reliable renewable energy infrastructure.

In today’s rapidly evolving digital landscape, the significance of password guessing techniques in both offensive and defensive strategies is paramount. Passwords serve as a crucial line of defense for both individuals and corporations, safeguarding their sensitive systems and data. Therefore, assessing the effectiveness of these access credentials is a critical task. However, existing research in this field often encounters limitations, such as a lack of sufficient training data and extended model training times. Current methods often struggle with limited training data and lengthy training times. This paper introduces BBPE-AE, a novel Auto Encoder Network (AE) designed for password guessing. BBPE-AE utilizes Byte-level Byte Pair Encoding (BBPE) to extract frequent tokens from password datasets without length restrictions, employing a dynamic window technique to capture complex patterns. Experimental results on Hotmail and Myspace datasets demonstrate exceptional performance, achieving high similarity rates (BLEU-Unigram: 0.90, BLEU-Bigram: 0.82 for Hotmail; BLEU-Unigram: 0.90, BLEU-Bigram: 0.81 for Myspace). BBPE-AE generates realistic passwords that meet HIBP (Have I Been Pwned) standards, minimizing duplication. These findings highlight the effectiveness of BBPE-AE in enhancing security by generating realistic passwords, ultimately safeguarding sensitive systems and data.

Responsible, efficient, and environmentally conscious energy consumption practices are increasingly essential for ensuring the reliability of the modern electricity grid. This study focuses on leveraging time series analysis to improve forecasting accuracy, crucial for various application domains where real-world time series data often exhibit complex, non-linear patterns. Our approach advocates for utilizing Long Short Term Memory (LSTM) and Bidirectional LSTM (BiLSTM) models for precise time series forecasting. To ensure a fair evaluation, we compare the performance of our proposed approach with traditional neural networks, time-series forecasting methods, and conventional decline curves. Additionally, individual models based on LSTM, Bi-LSTM, and other machine learning methods are implemented for a comprehensive assessment. Experimental results consistently demonstrate that our proposed model outperforms all benchmarking methods in terms of mean absolute error (MAE) across most datasets. Addressing the imbalance between activations by consumer and prosumer groups, our predictions show superior performance compared to several traditional forecasting methods, such as the Autoregressive Integrated Moving Average model (ARIMA) and Seasonal Autoregressive Integrated Moving Average model (SARIMA). Specifically, the root mean square error (RMSE) of Bi-LSTM is 5.35%, 46.08%, and 50.6% lower than LSTM, ARIMA, and SARIMA, respectively, on the May test data.

This study proposes a short- and medium-term electricity consumption prediction algorithm by combining the GRU model suitable for long-term forecasting and the Prophet model suitable for seasonality and event handling. (1) Manufacturing Company B's Electricity consumption data and meteorological data in Naju, Jeollanam-do, South Korea are collected and preprocessed. (2) The preprocessed data proposes the Prophet model in the first step for seasonality and event handling prediction. (3) In the second step, seven multivariate data are experimented with GRU. Specifically, the seven multivariate data consist of six meteorological data and the residuals between the predicted data from the proposed Prophet model in Step 1 and the observed data. These are utilized to predict electricity consumption at 15-minute intervals. (4) Electricity consumption is predicted for short-term (2 days and 7 days) and medium-term (15 days and 30 days) scenarios. The experimental results demonstrate that the proposed method outperforms the conventional Prophet model by more than 23 times and the modified GRU model by more than 2 times in terms of MAPE.

Lamb wave-based structural health monitoring is widely acknowledged as a reliable 11 method for damage identification, classification, localization and quantification. However, due to 12 the complexity of Lamb wave signals, especially after interacting with structural components and 13 defects, interpreting these waves and extracting useful information about the structure's health is 14 still a major challenge. However, deep learning-based strategy offers a great opportunity to address 15 such challenges as the algorithm can operate directly on raw discrete time-domain signals. Unlike 16 traditional methods, which often require careful feature engineering and preprocessing, deep learn-17 ing can automatically extract relevant features from the raw data. This paper proposes an autoen-18 coder based on a bidirectional long short-term memory network with maximal overlap discrete 19 wavelet transform layer to detect the signal anomaly and determine the location of the damage in 20 the composite structure. This approach has the potential to greatly enhance our ability to detect and 21 locate structural damage in composite structures, thereby increasing safety and efficiency.

Revolutionizing Lng Plant Construction and its Comprehensive Comparative Analysis And Evaluation Of Modular Design Development Versus Stick-Built Approach For Enhanced Efficiency And Cost-Effectiveness,.Although the utilization of modularization concepts in the LNG industry remains limited, this study focuses on exploring their potential. It is worth noting that modular units typically incur higher costs compared to field erected units due to the additional requirements of structural steel and robustness for transportation purposes.Nevertheless, the increased cost of modularization can often be balanced by conducting the work at the fabrication site instead of on-field construction. This approach reduces the overall project cost by minimizing field construction expenses and shortening the construction schedule. The objective of this paper is to assess and compare LNG modularization options for a newly established LNG facility in comparison to a conventional stick-built plant used as the base case.:The paper delves into various topics related to LNG plant construction, such as the development of modular units, a comprehensive comparison of different options, evaluation of construction schedules and manpower requirements, logistics considerations, and a recommended approach for design and construction. The cost estimates and engineering, procurement, and construction (EPC) schedules are meticulously compared for each option. Additionally, an inshore/near shore gravity base structure (GBS) option is included for further comparison. It is crucial to emphasize that establishing general costs is not possible as each project is distinct and requires individual study and analysis.:Each project has unique characteristics, resulting in varying shapes of cost curves and break-even points. The outcomes of the feasibility evaluation play a crucial role in determining the extent to which the modular approach to construction is advantageous for the specific project at hand. The evaluation takes into consideration multiple factors to determine the potential benefits of adopting a modular construction approach, allowing decision-makers to make informed choices regarding the project's construction methodology

Post-training quantization is pivotal in deploying convolutional neural networks for mobile applications. Block-wise reconstruction with adaptive rounding, as employed in prior works like BrecQ and Qdrop, facilitates acceptable 4-bit quantization accuracy. However, adaptive rounding is time-intensive, and its constraint on weight optimization space curtails the potential for quantization performance. The optimality of block-wise reconstruction hinges on the quantization status of subsequent network blocks. In this investigation, we delve into the theoretical underpinnings of the limitations inherent in adaptive rounding and block-wise reconstruction. Our exploration leads to the development of a post-training quantization methodology, designated as AE-Qdrop. This algorithm operates in two distinct phases: block-wise reconstruction and global fine-tuning. The block-wise reconstruction phase introduces a progressive optimization strategy, superseding adaptive rounding, which not only augments quantization precision but also significantly improves quantization efficiency. To mitigate the risk of overfitting, we introduce a random weighted quantized activation mechanism. During the global fine-tuning phase, we account for interdependencies among quantized network blocks. The weight of each network block will be corrected with logit matching and feature matching. Extensive experiments validate that AE-Qdrop achieves high-precision and efficient quantization. For instance, in the case of 2-bit MobileNetV2, AE-Qdrop outperforms Qdrop by achieving a 6.26% enhancement in quantization accuracy and quintupling the quantization efficiency.

In manufacturing chatter is an unwanted phenomenon that can lead to product quality reduction and tool wear. Real time chatter detection is key to preventing these issues and improving overall machining efficiency. In this paper we propose an unsupervised chatter detection method using autoencoders (AE) and Density-Based Spatial Clustering of Applications with Noise (DBSCAN) clustering algorithm that uses internal signals of Computer Numerical Control (CNC) machines. The proposed method starts by using an AE to extract features from raw internal signals collected from CNC machines. This step reduces the dimensionality of the data and captures the underlying patterns of chatter. Then the extracted features are fed into DBSCAN clustering algorithm which is a density based algorithm that groups similar data points and identifies outliers. We tested the proposed method with real world data collected from various CNC machines. The results show that our unsupervised chatter detection method has high accuracy, precision and recall, can detect chatter and distinguish it from normal machining. Also the method is robust to noise and can adapt to dynamic machining conditions. In summary our work presents an unsupervised chatter detection method using AE and DBSCAN clustering that uses internal signals of CNC machines. This method is a reliable and efficient solution for real time chatter detection so manufacturers can improve product quality, optimize machining process and reduce tool wear during machining.

As the demand for fossil fuels continues to rise and their availability becomes increasingly limited, it is crucial to explore innovative approaches to optimize fuel combustion in existing systems. Among various engines, diesel engines are heavily reliant on fluid motion within the engine cylinder, which plays a critical role in fuel-air mixing. This abstract focuses on the potential of dynamic mathematical model simulation for multi-compartment rotor compressed combustion engines, aiming to revolutionize power generation by enhancing fuel burning efficiency. By leveraging advanced simulation techniques, this research seeks to unlock new insights into fluid dynamics and optimize fuel-air mixing, leading to more efficient and sustainable energy utilization. Through this exploration, we aim to pave the way for groundbreaking advancements in the field of combustion engines, ultimately contributing to a greener and more sustainable future. In the realm of internal combustion engines, the fluid dynamics within the engine cylinder greatly influence the combustion processes and heat transfer. For compression ignition (C.I) engines, both the bulk gas motion and turbulence characteristics play vital roles in engine performance. This study focuses on enhancing the combustibility of the fuel-air mixture in C.I engines by modifying the engine design to induce turbulence through squish and tumble flows. The modification involves creating multiple compartments on the rotor crown, comprising three small chambers spaced 120º apart. By implementing this design, the aim is to optimize the fuel-air mixing and improve the overall combustion efficiency. Through comprehensive analysis and experimentation, we seek to revolutionize C.I engine technology and pave the way for more efficient and environmentally-friendly power generation. In this study, the performance of a compression ignition (C.I) engine with a multiple compartment rotor has been analyzed under motoring conditions using computational fluid dynamics (CFD) simulations with FLUENT software. The obtained results have been compared with those of a base C.I engine. The analysis focused on the effects of the modified engine design on the tumble ratio and squish velocity, which are important parameters for fuel-air mixing and combustion efficiency. The results indicated a significant improvement with the modified engine, with a 35% increase in tumble ratio and a 31% increase in squish velocity compared to the base engine. These findings suggest that the modified engine design has the potential to enhance fuel-air mixing and combustion performance, leading to improved overall engine efficiency. This research presents promising insights into the optimization of C.I engine design and contributes to the development of more efficient and environmentally-friendly power generation technologies..

Early detection of wildfires has been limited using the sun-synchronous orbit satellites due to their low temporal resolution and wildfires’ fast spread in the early stage. NOAA’s geostationary weather satellites GOES-R can acquire images every 15 minutes at 2km spatial resolution, and have been used for early fire detection. However, advanced processing algorithms are needed to provide timely and reliable detection of wildfires. In this research, a deep learning framework, based on Gated Recurrent Units (GRU), is proposed to detect wildfires at early stage using GOES-R dense time series data. GRU model maintains good performance on temporal modelling while keep a simple architecture, makes it suitable to efficiently process time-series data. 36 different wildfires in North and South America under the coverage of GOES-R satellites are selected to assess the effectiveness of the GRU method. The detection times based on GOES-R are compared with VIIRS active fire products at 375m resolution in NASA’s Fire Information for Resource Management System (FIRMS). The results show that GRU-based GOES-R detections of the wildfires are earlier than that of the VIIRS active fire products in most of the study areas. Also, results from proposed method offer more precise location on the active fire at early stage than GOES-R Active Fire Product in mid-latitude and low-latitude regions.

In Cameroon, Aedes mosquitoes transmit various arboviruses, posing significant health risks. We aimed to characterize the Aedes virome in southwestern Cameroon and identify potential core viruses which might be associated with vector competence. A total of 398 Aedes mosquitoes were collected from four locations (Bafoussam, Buea, Edea and Yaounde). Aedes albopictus dominated all sites except for Bafoussam where Aedes africanus prevailed. Metagenomic analyses of mosquitoes grouped per species into 54 pools revealed notable differences in eukaryotic viromes between Ae. africanus and Ae. albopictus, with the former exhibiting greater richness and diversity. Thirty-seven eukaryotic virus species from 16 families were identified, including six novel viruses with near complete genome sequences. Seven viruses were further quantified in individual mosquitoes via qRT-PCR. Although none of them could be identified as core viruses, Guangzhou sobemo-like virus and Bafoussam mosquito solemovirus virus were highly prevalent regionally in Ae. albopictus and Ae. africanus, respectively. This study highlights the diverse eukaryotic virome of Aedes species in southwestern Cameroon. Despite their shared Genus, Aedes species exhibit limited viral sharing, with varying viral abundance and prevalence across locations. Ae. africanus, an understudied vector, harbors a rich and diverse virome, suggesting potential implications for arbovirus vector competence.

This paper introduces an innovative approach to lipreading, leveraging a web application designed to generate subtitles for videos where the speaker's mouth is visible and a comprehensive literature review that precedes the discussion, encompassing a thorough examination of various lipreading methods employed over the past decade. Our method employs a powerful deep learning model, featuring a 3D-convolution network and bidirectional LSTM, enabling accurate sentence-level predictions based solely on visual lip movements. With an impressive accuracy of 97%, our model is trained using pre-segmented lips regions, transformed into animated GIFs for effective pre-training. This work stands as a significant contribution to the evolving landscape of lipreading research, offering a practical and accurate solution for real-world applications.

We report an agent-based model to compare the effectiveness of simple and complex mobile dating application interfaces in generating matches for virtual users. We define the relative complexity of dating applications as the number of available features and dub this variable, the multiplicity. We replicate some of the most popular mobile dating applications through the generation of a synthetic population endowed with attributes, preferences, and behaviors drawn from literature. We treat our data as a network dataset and use a robust statistical procedure (MRQAP) to issue a valid and reliable comparison between simulated applications. We show how the quadratic assignment procedure can be used to compare network simulations rigorously. As a result, we observe a direct relationship between multiplicity and agent-level experiences and expectations in match generation. We also observe the emergence of divergent matching systems with minor rule changes as well as several expected properties of online dating systems. This work serves as a proof-of-concept in the integration of classical social network analysis methods with agent-based modeling to compare virtual designs and to enhance the policy-generation process of online social networks.

Cognitive neuroscience is the study of how the human brain functions on tasks like decision making, language, perception and reasoning. Deep learning is a class of machine learning algorithms that use neural networks. They are designed to model the responses of neurons in the human brain. Learning can be supervised or unsupervised. Ngram token models are used extensively in language prediction. Ngrams are probabilistic models that are used in predicting the next word or token. They are a statistical model of word sequences or tokens and are called Language Models or Lms. Ngrams are essential in creating language prediction models. We are exploring a broader sandbox ecosystems enabling for AI. Specifically, around Deep learning applications on unstructured content form on the web.

This study introduces session-aware recommendation models, leveraging GRU (Gated Recurrent Unit) and attention mechanisms for advanced latent interaction data integration. A primary ad-vancement is enhancing latent context, a critical factor for boosting recommendation accuracy. We address existing models' rigidity by dynamically blending short-term (most recent) and long-term (historical) preferences, moving beyond static period definitions. Our approaches, pre-combination (LCII-Pre) and post-combination (LCII-Post) with fixed (Fix) and flexible learning (LP) weight configurations, are thoroughly evaluated. We conducted extensive experiments to as-sess our models' performance on public datasets such as Amazon and MovieLens 1M. Notably, on the MovieLens 1M dataset, LCII-PreFix achieved a 1.85% and 2.54% higher Recall@20 than II-RNN and BERT4Rec+st+TSA, respectively. On the Steam dataset, LCII-PostLP outperformed these models by 18.66% and 5.5%. Furthermore, on the Amazon dataset, LCII showed a 2.59% and 1.89% improvement in Recall@20 over II-RNN and CAII. These results affirm the significant enhancement our models bring to session-aware recommendation systems, showcasing their po-tential for both academic and practical applications in the field.

Autoantibodies against specific lung cancer-associated antigens have been suggested for lung cancer diagnosis. This study aimed to evaluate the diagnostic performance of anti-gen-autoantibody immune complex (AIC) against its free antigens for CYFRA21-1, ProGRP, NGAL, and NSE in non-small cell lung cancer (NSCLC). In total, 85 patients with NSCLC and 120 healthy controls (HCs) were examined using a 9G DNA chip method. The ratios of AICs to their antigens and combinations of ratios consisting of two to four markers were calculated. The levels of AICs for CYFRA21-1, ProGRP, NGAL, and NSE were higher than their free antigens in all participants. The levels of each free antigen distinguished patients with NSCLC from HCs. The ratios of AIC to its antigen and seven combinations consisting of two to four ratios were significantly higher in patients with NSCLC than those in HCs. Excellent diagnostic performance was observed for all combination ratios (C4-1), with 85.9% sensitivity and 86.7% specificity at cutoff 3.51. Higher sensitivity was observed in the very early stages (0–I) and adenocarcinoma than in stages II–IV and other pathological types. The combination of all ratios of AICs and their antigens for all four markers is useful in the diagnosis of NSCLC.

To enhance system reliability and mitigate vulnerabilities of the Global Navigation Satellite Systems (GNSS), it is common to fuse the Inertial Measurement Unit (IMU) and visual sensors with the GNSS receiver in the navigation system design, effectively enabling compensations with absolute position and reducing data gaps. To address shortcomings of traditional Kalman Filter (KF) such as sensor error, imperfect nonlinear system model, and KF estimation error, a GRU-aided ESKF architecture is proposed to enhance positioning performance. This study conducts Failure Mode and Effect Analysis (FMEA) to priories and identify the potential faults in the urban environment facilitating the design of improved fault-tolerant system architecture. The identified primary fault events are data association error and navigation environment error during fault conditions of feature mismatch, especially in the presence of multiple failure modes. A hybrid federated navigation system architecture is employed using a Gated Recurrent Unit (GRU) to predict state increments for updating the state vector in the Error Estate Kalman Filter (ESKF) measurement step. The proposed algorithm’s performance is evaluated in a simulation environment in MATLAB under multiple visually degraded conditions. Comparative results provide evidence that the GRU-aided ESKF outperforms standard ESKF and state-of-the-art solutions like VINS-Mono, End-to-End VIO, and Self-Supervised VIO, exhibiting higher efficiency in complex environments.

Smartphones are prone to SMS phishing due to the rapid growth in the availability of smart mobile technologies driven by Internet connections. Also, detecting phishing SMS is a challenging task due to the unstructured nature of SMS text data with non-linear complex correlations. In this concern, considering the recent advancements in the domain of cybersecurity, we have proposed a hybrid deep learning framework that extracts robust features from SMS texts followed by an automatic detection of Phishing SMS. Due to combining the potential capability of individual models into one hybrid framework, it has outperformed various other individual machine learning and deep learning models. The proposed Phishing Detection framework is an effective hybrid combination of pretrained transformer model, MPNet (Masked and Permuted Language Modeling), with supervised ConvNets (CNN) and Bi-directional Gated Recurrent Units (GRU). It is intended to successfully detect unstructured short phishing text messages that contain complex patterns.

Antibiotics’ effect on Mycoplasma pneumoniae (MP) infection still remains controversial. A prospective study of 257 children with MP pneumonia during a recent epidemic (2015-2016) was conducted. All MP pneumonia patients were treated with corticosteroids within 24-36 h after admission. Initially, oral prednisolone (1 mg/kg) or intravenous methylprednisolone (IVMP) (1-2 mg/kg) was administered for mild pneumonia patients, and IVMP (5 -10 mg/kg/day) for severe pneumonia patients. If patients showed persistent fever for 36-48 hours or disease progression, additive IVMP (5 mg/kg or 10 mg/kg) was given. Eighty-five patients received only a broad-spectrum antibiotic without macrolide. The mean age and the male:female ratio were 5.6 ± 3.1 years, respectively. Seventy-four percent of patients (190/257) showed immediate defervescence within 24 h, and 95.7% (246/257) of patients showed defervescence within 72 h with improvements in clinical symptoms. Eight patients who received additive IVMP also showed clinical improvement within 48 h without adverse reactions. There were no clinical or laboratory differences between patients treated with a macrolide (n = 172) and without (n = 85). Early corticosteroid therapy might reduce disease morbidity and prevent disease progression in MP pneumonia patients without side effects, and antibiotics may have limited effects on MP infection.

This article presents the implementation of a model to estimate the future price of commodities in the Brazilian market from time series of short-term technical evaluation. For this, data from two databases were used, one referring to the foreign market (opening values, maximum, minimum, closing, closing adjustment and volume) and the other, from the Brazilian market (the price of the day), considering commodities, sugar, cotton, corn, soybean and wheat. Subsequently, the technical indicators were calculated from the TA-Lib technical analysis library. Pearson’s correlation coefficient was applied, records with low correlation were removed, and then the database was consolidated. From the pre-processed data, Long Short-Term Memory (LSTM) recurrent neural networks were used to perform data prediction at the one and three day interval. These models were evaluated using the mean square error (MSE), obtaining results between 0.00010 and 0.00037 on test data one day ahead, and from 0.00017 to 0.00042 three days ahead. However, based on the results obtained, it was observed that the developed model obtained a promising forecasting performance for all the commodities evaluated. As a main contribution, there is the consolidation of databases that can be used in future scientific research. Furthermore, based on its interpretation, it can assist in decision making regarding the buying and selling of commodities to increase financial gains.

To ensure the safety in aircraft flying, we aim use of the deep learning methods of nondestructive examination with multiple defect detection paradigms for X-ray image detection posed. The use of the Fast Region-based Convolutional Neural Networks (Fast R-CNN) driven model seeks to augment and improve existing automated Non-Destructive Testing (NDT) diagnosis. Within the context of X-ray screening, limited numbers insufficient types of X-ray aeronautics engine defect data samples can thus pose another problem in training model tackling multiple detections perform accuracy. To overcome this issue, we employ a deep learning paradigm of transfer learning tackling both single and multiple detection. Overall the achieve result get more then 90% accuracy based on the AE-RTISNet retrained with 8 types of defect detection. Caffe structure software to make networks tracking detection over multiples Fast R-CNN. We consider the AE-RTISNet provide best results to the more traditional multiple Fast R-CNN approaches simpler translate to C++ code and installed in the Jetson™ TX2 embedded computer. With the use of LMDB format, all images using input images of size 640 × 480 pixel. The results scope achieves 0.9 mean average precision (mAP) on 8 types of material defect classifiers problem and requires approximately 100 microseconds.

As human activities of the countries in the East Asia have been remarkably expanding over recent decades, various problems in relation to ships, such as oil spill and many other coastal marine pollution, are continuously occurring in the coastal region. In order to conserve marine resources and prepare for possible ship accidents in advance, the need for efficient ship management is increasing over time. Multi-satellite, multi-sensor, multi-wavelength or multi-frequency observations make it possible to monitor a variety of vessels in the coastal region. This study presents the results of ship detection methodology applied to multi-spectral satellite images in the seas around Korean Peninsula based on optical, hyperspectral, and microwave remote sensing. To detect ships from hyperspectral images with a few hundreds of spectral channels, spectral matching algorithms are used to investigate similarity between the spectra and in-situ measurements. In the case of SAR (Synthetic Aperture Radar) images, the Constant False Alarm Rate (CFAR) algorithm is used to discriminate the vessels from backscattering coefficients of Sentinel-1 SAR and ALOS-2 PALSAR2 images. The present ship detection methods can be extensively utilized for optical, hyperspectral, and SAR images for comprehensive coastal management purposes toward perpetual sustainability in the future.

With an explosion of data in the nearly every domain, from physical and environmental sciences to econometrics and even social science, we have entered a golden era of time-domain data science. In addition to ever increasing data volumes and varieties of time-series, there's a plethora of techniques available to analyses them. Unsurprisingly, machine learning approaches are very popular. In environmental sciences (ranging from climate studies to space weather/solar physics), machine learning (ML )and deep learning (DL) approaches complement the traditional data assimilation approaches. In solar and astrophysics, multiwavelength time-series or lightcurves along with observations of other messengers like gravitational waves provide a treasure trove of time-domain data for ML/DL approaches for modeling and forecasting. In this regard, deep learning algorithms such as recurrent neural networks (RNNs) should prove extremely powerful for forecasting as it has in several other domains. Such methods agnostic of the physics can only predict transient flares that are represented in the original distribution trained on (eg. coloured noise fluctuations) and not special, isolated episodes (eg. a one-off outburst like a major coronal mass ejection) potentially distinguishing them. Therefore it is vital to test robustness of these techniques ; here we attempt to make a small contribution to this by exploring sensitivity of RNNs with some rudimentary experiments. We test the performance of a very successful class of RNNs, the Long Short Term Memory (LSTM) algorithms with simulated lightcurves. As an example, we focus on univariate forecasting of time-series (or lightcurves) characteristic certain variable astrophysical objects (eg. active galactic nuclei or AGN). Specifically, we explore the sensitivity of training and test losses to key parameters of the LSTM network and data characteristics namely gaps and complexity measured in terms of number of Fourier components. We find that typically, the performances of LSTMs are better for pink or flicker noise type sources. The key parameters on which performance is dependent are batch size for LSTM and the gap percentage of the lightcurves. While a batch size of $10-30$ seems optimal, the most optimal test and train losses are under $10 \%$ of missing data for both periodic and random gaps in pink noise. The performance is far worse for red noise. This compromises detectability of transients. Thus, we show that generative models (time-series simulations) are excellent guides for use of RNN-LSTMs in building forecasting systems

Health management in industrial systems is more critical in maintenance management and it plays an important role in productivity, fault diagnosis, safety, efficiency, and economy in manufacturing industries. Early detection of faults in machinery may increase the effectiveness of maintenance actions and will avoid unwanted consequences in process operations and maintenance. Existing fault diagnosis methods have limitations such as insufficient accuracy, slow detection rate, and handling large and complex data sets. In this digital age, Industry 4.0 techniques have been applied across all fields, including the condition monitoring of machines. This research addresses the gaps in traditional fault diagnosis by using deep learning, a modern AI technique effective for diagnosing faults in various machines. Deep learning algorithms Multilayer Perceptron (MLP), Coevolutionary Neural Network (CNN), and Recurrent Neural Network (RNN) with Long Short-Term Memory (LSTM) are tested for fault diagnosis using vibration datasets collected from Spectra Quest Machinery Fault Simulator (SQMFS). In this research work, NI-DAQ (National Instruments- Data Acquisition) system, accelerometer, and LabVIEW software are used to collect vibration signals. Preprocessing of the signals has been done using a sampling strategy, shuffling, standardization, and reshaping data augmentation. The result shows that MLP accuracy in the prediction of fault is 0.9, CNN reached 0.95, and RNN and LSTM with 0.57 and 0.45 respectively. The high performance of CNN is due to its ability to effectively capture spatial patterns in vibration data which is crucial for fault diagnosis in rotating machinery followed by MLP due to its faster convergence during training. However, when scaling the data, MLP outperformed CNN, demonstrating superior adaptability to increased data complexity and volume. Due to the need for larger datasets and temporal patterns in the vibration data, which RNN and LSTM are designed to handle, they resulted in a lower accuracy. This study shows that CNN has given better results than other deep learning algorithms MLP, RNN, and LSTM in fault diagnosis of rotating machinery. Future research could explore the application of these techniques to different types of machinery and fault conditions.

This paper proposed emotion recognition methods for consecutive facial images, and implements the inference of neural network model on a field-programmable gate array (FPGA). The proposed emotion recognition methods are based on a neural network model architecture that combines convolution neural networks (CNNs), long short-term memory (LSTM), and fully connected neural networks (FCNNs), called CLDNN or ConvLSTM-FCN. This type of neural network mod-el can analyze the local feature sequences obtained through convolution of data, making it suita-ble for processing time-series data such as consecutive facial images. In this paper, sequences of facial images are sampled from videos corresponding to various emotional state of subjects. The sampled images are then pre-processed with the processes includes facial detection, greyscale conversion, resize, and data augmentation if necessary. The 2-D CNN in ConvLSTM-FCN is used for feature extraction for these pre-processed facial images. These sequences of facial im-age features are time sequences with dependent properties between the elements within them. The LSTM is then used to model these time sequences followed by fully connected neural net-works (FCNNs) for classification. The proposed consecutive facial emotion recognition method achieves an average recognition rate of 99.51% on RAVDESS dataset, 87.80% on BAUM-1s dataset and 96.82% on eNTERFACE’05 data set, using 10-fold cross-validation on the PC. Some com-parisons of recognition accuracies between the proposed method and the other existing related works are conducted in this paper. According to the comparisons, the proposed emotion recog-nition methods outperform the existing related researches. The proposed emotion recognition methods are then implemented on an FPGA chip using the neural network model inference algo-rithms in this paper, and the accuracies of the experiments conducted on the FPGA chip are iden-tical to those obtained on the PC. This verifies that the proposed neural network model imple-mented on the FPGA chip performs well.

Erectile dysfunction (ED) is a common and feared complication of radical prostatectomy (RP) for prostate cancer. Recently, tissue engineering is being attempted for post-prostatectomy ED, with controlled interactions between cells, growth factors, and extracellular matrix (ECM) being important for nerve regeneration's structural integrity. In this study, we evaluated the effects of biomechanical ECM patch on human bone marrow-derived mesenchymal stem cells (hBMSCs) morphology and behavior in bilateral cavernous nerve injury (BCNI) rat model. The ECM patch, made of decellularized human fibroblast-derived ECM (hFDM) and a biocompatible polyvinyl alcohol (PVA) hydrogel, was tested with human bone marrow-derived mesenchymal stem cells (hBMSCs) on a bilateral cavernous nerve injury (BCNI) rat model. In vitro analysis showed that the hFDM/PVA + hBMSCs patches significantly increased neural development markers. In vivo experiments demonstrated that the rats treated with the hFDM/PVA patch had higher ICP/MAP ratio, a higher ratio of smooth muscle to collagen, increased content of nNOS, higher levels of eNOS protein expression, and a higher cGMP level compared to the BCNI group. These results indicate that the hFDM/PVA patch is effective in promoting angiogenesis, smooth muscle regeneration, and nitrergic nerve regeneration, which could contribute to improved erectile function in post-prostatectomy ED.

Sign language recognition technology can help people with hearing impairments to communicate with those who are hearing impaired. At present, with the rapid development of society, deep learning technology also provided certain technical support for sign language recognition work. In sign language recognition tasks, the use of traditional convolutional neural networks to extract spatio-temporal features from sign language videos suffers from insufficient feature extraction, resulting in low recognition rates. Nevertheless, video-based sign language datasets are very large and require a lot of computational resources for training and generalisation must be ensured, which poses a challenge for recognition. In this paper, we have presented a video-based sign language recognition method based on resnet and lstm. As the number of network layers increases, the ResNet network can effectively solve the granularity explosion problem and obtain better time series features. We use the Resnet convolutional network as the backbone model. At the initialisation stage, we obtain sign language features using ResNet; then, the learned feature space is used as the input of LSTM network to obtain long sequence features. The experimental results show that the accuracy of the above model is better than the mainstream model, and it can effectively extract the spatio-temporal features in sign language videos and improve the recognition rate of sign language actions.

We investigate the power of time series analysis based on a variety of information-theoretic approaches from statistics (AIC, BIC) and machine learning (Minimum Message Length) - and we then compare their efficacy with traditional time series model and with hybrids involving deep learning. More specifically, we develop AIC, BIC and Minimum Message Length (MML) ARMA (autoregressive moving average) time series models - with this Bayesian information-theoretic MML ARMA modelling already being new work. We then study deep learning based algorithms in time series forecasting, using Long Short Term Memory (LSTM), and we then combine this with the ARMA modelling to produce a hybrid ARMA-LSTM prediction. Part of the purpose of the use of LSTM is to seek capture any hidden information in the residuals left from the traditional ARMA model. We show that MML not only outperforms earlier statistical approaches to ARMA modelling, but we further show that the hybrid MML ARMA-LSTM models outperform both ARMA models and LSTM models.

To enhance the safety of power grid operations, this study proposes a high-precision short-term photovoltaic power prediction method that integrates information from surrounding pho-tovoltaic stations and the Conv-LSTM-ATT model. In the deep learning prediction model, not only is numerical weather prediction (NWP) data from the target photovoltaic station used as input features, but also highly correlated features from nearby photovoltaic stations are incor-porated. The research begins by analyzing the correlation between irradiance and power se-quences, along with distance factors, to calculate a composite similarity index between the target and other regional photovoltaic stations. Stations with high similarity indices are then selected as data sources. Subsequently, Bayesian optimization techniques are employed to find the optimal data fusion ratios. Ultimately, using the selected data, power prediction mod-eling is conducted via the Conv-LSTM-ATT deep neural network. Experimental results con-firm the superiority of the proposed model, which demonstrates higher predictive accuracy compared to three other classical models. The data fusion strategy determined by Bayesian optimization significantly enhances prediction accuracy, reducing the root mean square error (RMSE) of the test set by 20.04%, 28.24%, and 30.94% for three weather types, respectively.

In this paper, a special recurrent neural network (RNN) called \emph{Long Short-Term Memory (LSTM)} is used to design a virtual load sensor that estimates the mass of heavy vehicles. The estimation algorithm consists of a two-layer LSTM network, with the two layers based on sequence-to-sequence and sequence-to-one logic, respectively. The network estimates the vehicle mass based on the vehicle speed, longitudinal acceleration, engine speed, engine torque, and the accelerator pedal position. The network is trained and tested with a data set collected in a high-fidelity simulation environment called Truckmaker. Training data is generated in acceleration maneuvers in a range of speeds whereas test data is obtained by simulating the vehicle in a Worldwide harmonized light vehicles test cycle (WLTC). Preliminary results show that, with the proposed approach, the heavy-vehicle mass can be estimated as accurately as commercial load sensors in a range of load mass as wide as four tons.

This study introduces a novel method for early prediction of Kimchi cabbage (Brassica rapa subsp. pekinensis (Lour.) Hanelt) height, utilizing drone imagery and a long short-term memory (LSTM) model. The research was conducted on a testbed at the National Institute of Agricultural Sciences (NAS) in South Korea, encompassing two distinct soil types (loam and sandy loam) to investigate their impact on growth. High-resolution drone images were captured throughout the growing season to generate a canopy height model (CHM) for estimating plant height at various stages. Missing height data were interpolated using a logistic growth curve, and an LSTM model was trained on this data to predict the final height of Kimchi cabbage at harvest. Three LSTM models were developed using time-series data collected at 29, 36, and 44 days after planting (DAP). The model trained on data from DAP 44 demonstrated the highest accuracy with a coefficient of determination (R²) of 0.83, a mean absolute error (MAE) of 2.48 cm, and a root mean square error (RMSE) of 3.26 cm, outperforming models trained on earlier data. Color-coded maps were generated to visualize the spatial distribution of predicted Kimchi cabbage heights, revealing variations in growth patterns across the testbed and confirming the model's potential for site-specific management. Considering the trade-off between accuracy and prediction timing, the model trained on DAP 36 data (MAE = 2.77 cm) was deemed optimal for informing cultivation management decisions. This research demonstrates the feasibility and effectiveness of integrating drone imagery, logistic growth curves, and LSTM models for early and accurate prediction of Kimchi cabbage height. The proposed technology enables data-driven decision-making for farmers, facilitating timely interventions based on predicted growth patterns. This could lead to improved crop yields, resource optimization, and a more sustainable agricultural future. Future research will focus on refining the model's accuracy and exploring its applicability to other crops, further expanding the potential of precision agriculture technologies.

The demand for precise indoor localization services is steadily increasing. Among various methods, fingerprint-based indoor localization has become a popular choice due to its exceptional accuracy, cost-effectiveness, and ease of implementation. However, its performance degrades significantly as a result of multipath signal attenuation and environmental changes. In this paper, we propose an indoor localization method based on fingerprints using self-attention and long short-term memory (LSTM). By integrating a self-attention mechanism and LSTM network, the proposed method exhibits outstanding positioning accuracy and robustness in diverse experimental environments. The performance of the proposed method is evaluated under two different experimental scenarios, which involve 2D and 3D moving trajectories, respectively. The experimental results demonstrate that our approach achieves an average localization error of 1.76 m and 2.83 m in the respective scenarios, outperforming the existing state-of-the-art methods by 42.67% and 31.64%.

This research investigates the application of deep learning in sentiment analysis of Canadian maritime case law. It offers a framework for improving maritime law and legal analytics policy-making procedures. The automation of legal document extraction takes center stage, underscoring the vital role sentiment analysis plays at the document level. Therefore, this study introduces a novel strategy for sentiment analysis in Canadian maritime case law, combining sentiment case law approaches with state-of-the-art deep learning techniques. The overarching goal is to systematically unearth hidden biases within case law and investigate their impact on legal outcomes. Employing Convolutional Neural Network (CNN) and Long Short-Term Memory (LSTM) based models, this research achieves a remarkable accuracy of 98.05% for categorizing instances. In contrast, Conventional Machine Learning techniques such as Support Vector Machines (SVM) yield an accuracy rate of 52.57%, Naive Bayes at 57.44 %, and Logistic Regression at 61.86%. The superior accuracy of the CNN and STM model combination underscores its usefulness in legal sentiment analysis, offering promising future applications in diverse fields like legal analytics and policy design. These findings mark a significant choice for AI-powered legal tools, presenting more sophisticated and sentiment-aware options for the legal profession.

: Innovative solutions are now being researched to manage the ever-increasing amount of data required to optimize the performance of internal combustion engines. Machine Learning ap-proaches have shown to be a valuable tool for signal prediction due to their real-time and cost-effective deployment. Among them, the architecture consisting of Long Short-Term Memory (LSTM) and one-dimensional Convolutional Neural Networks (1DCNN) has emerged as a highly promising and effective option for replacing the role of physical sensors. The architecture com-bines the capacity of LSTM to detect patterns and relationships in smaller segments of the signal with the ability of 1DCNN to detect patterns and relationships in larger segments of the signal. The purpose of this work is to assess the feasibility of substituting a physical device dedicated to calculating the torque supplied by a spark-ignition engine. The suggested architecture was trained and tested using signals from the field during a test campaign conducted under transient operating conditions. The results reveal that LSTM+1DCNN is particularly well suited for signal prediction with considerable variability. It constantly outperforms other architectures used for comparison, with average error percentages of less than 2%, proving the architecture's ability to replace physical sensors.

Caring for dolphins is a delicate process that requires experienced caretakers to pay close attention to their behavioral characteristics. However, caretakers may sometimes lack experience or not be able to give their full attention, which can lead to misjudgment or oversight. To address these issues, a dolphin behavior analysis system has been designed to assist caretakers in making accurate assessments. The study utilized image preprocessing techniques to reduce sunlight reflection in the pool and enhance the outline of dolphins, making it easier to analyze their movements. The dolphins were divided into 11 keypoints using an open-source tool called DeepLabCut, which helped accurately mark various body parts for skeletal detection. The AquaAI Dolphin Decoder (ADD) was then used to analyze six dolphin behaviors. To improve behavior recognition accuracy, the Long Short-Term Memory (LSTM) neural network was introduced. The ADD and LSTM models were integrated to form the ADD-LSTM system. Several classification models, including unidirectional and bidirectional LSTM, GRU, and SVM, were compared. The results showed that the ADD module combined with a double-layer bidirectional LSTM method achieved high accuracy in dolphin behavior analysis. The accuracy rates for each behavior were over 90%.

Coastal wave modeling and forecasting are essential in oceanography, sustainable marine energy, and ocean engineering. Precise forecasting of wave speed and direction are crucial for offshore operations, marine energy, risk management, environmental management, coastal and sustainable maritime management. The coastline of Brunei Darussalam can generate between 15 and 126 Giga Watt of wave energy. In this experimental research, we used two numerical approaches, the finite difference, and spectral element methods, to model and simulate wave speed and direction. We calculated the mean error between numerical and analytical solutions. We proposed a novel, promising, univariate time series forecasting model by combining the Long Short-Term (LSTM) with KerasTuner hyperparameters tuning and optimization techniques. This method helps us to improve the accuracy and efficiency of time-series forecasting.. The experimental data was computed from high-precision Acoustic Doppler Current Profiler (ADCP) sensor data. This research is part of the preliminary feasibility analysis of wave energy production in Brunei Darussalam and net zero commitment for a sustainable environment. Seven independent forecast experiments were performed for wave speed and direction in degree and radian units for 1, 3, 6, 8, 10, 12, and 24 hours. Mean squared error (MSE) was adopted as a metric for both training and testing. The experimental results reveal that the wave speed forecast has the lowest MSE compared to direction, regardless of the unit of measure, but has a longer duration. In addition, the direction forecast in the degree unit has the lowest errors compared to the unit of radians; the latter has a longer running time than the former. The model has delivered optimal results throughout the experiments with minor training and test errors. We conducted a thorough evaluations on two benchmark time series datasets, which include the study dataset and air quality index dataset, to validate the performance of the proposed model with other models. The proposed model outperforms cutting-edge forecasting models, such as the conventional LSTM, ARIMA, and Prophet. The model has the slightest forecast error compared to the existing literature’s result.

The choice of holiday destinations is highly depended on climate considerations. Nowadays, since the effects of climate crisis are being increasingly felt, the need of accurate weather and climate services for hotels is crucial. Such a service could be beneficial for both the future planning of tourists’ activities and destinations and for hotel managers as it could help in decision making about the planning and expansion of the touristic season, due to a prediction of higher temperatures for a longer time span, thus causing increased revenue for companies in the local touristic sector. The aim of this work is to calculate predictions on climatic variables using statistical techniques as well as Artificial Intelligence (AI) for a specific area of interest utilising data from in situ meteorological station, and produce valuable and reliable localised predictions with the most cost-effective method possible. This investigation will answer the question of the most suitable prediction method for time series data from a single meteorological station that is deployed in a specific location. As a result, an accurate representation of the microclimate in a specific are is achieved. To achieve this high accuracy in situ measurements and prediction techniques are used. As prediction techniques, Seasonal Auto Regressive Integrated Moving Average (SARIMA), AI techniques like the Long-Short-Term-Memory (LSTM) Neural Network and hybrid combinations of the two are used. Variables of interest are divided in the easier to predict temperature and humidity that are more periodic and less chaotic, and the wind speed as an example of a more stochastic variable with no known seasonality and patterns. Our results show that the examined Hybrid methodology performs the best at temperature and wind speed forecasts, closely followed by the SARIMA whereas LSTM perform better overall at the humidity forecast, even after the correction of the Hybrid to the SARIMA model.

Hydrogen energy is regarded as an auspicious future substitute to replace fossil fuels, because of its environmentally friendly characteristics and high energy density. In the pursuit of clean hydrogen production, there has been a significant focus on the advancement of effective electrocatalysts for the process of water splitting. Although noble metals like Pt, Ru, Pd and Ir are superb electrocatalysts for the hydrogen evolution reaction (HER), they have limitations for large-scale applications, mainly high cost and low abundance. As a result, non-precious transition metals have emerged as promising candidates to replace their more expensive counterparts in various applications. This review focuses on recently developed transition metal phosphides (TMPs) electrocatalysts for the HER in alkaline media due to the cooperative effect between the phosphorus and transition metals. Finally, we discuss the challenges of TMPs for HER.

This study aimed to elucidate the antibacterial efficacy and unique chemical compositions generated from plasma-activated water (PAW) when utilized a novel vaginal cleansing device. We conducted an analysis of antibacterial activity against probiotics and several chemical compositions including ions under various operational parameters of PAW, including electrical power (12 and 24 V), treatment duration (1, 10, and 20 min), and stay duration (immediate, 30 and 60 min). Our findings revealed that as treatment duration increased, hypochlorous acid (HOCl), Ca2+, and Mg2+ concentrations increased and Cl−concentrations decreased. Higher electrical power and longer treatment duration resulted in increased HOCl levels, which acts to prevent the growth of general microorganisms. Notably, PAW exhibited no antibacterial effects against a type of probiotic, Lactobacillus reuteri that produces lactic acid for vaginal health. This result demonstrated the ability of the vaginal cleaning device to generate ions, primarily HOCl and some cations (Ca2+ and Mg2+), thereby providing vaginal mucosa protecting and cleansing effects with the vaginal environment.

Proton Exchange Membrane Fuel Cell (PEMFC) is a fast-developing battery technology, and the key to its reliability and lifespan improvement lies in the accurate assessment of durability. However, the degradation mechanism of PEMFC is hard to determine and its internal parameters are highly coupled. Thus, the development of the more accurate life prediction model that meets the actual scenarios is urgent to investigate. To solve this problem, a multi-feature fusion life prediction method based on Temporal Convolutional Network-Gated Recurrent Unit (TCN-GRU) is proposed. A TCN algorithm is used as the prediction base model, and two GRU modules are included to the model to strengthen the model expression ability and improve its predictive accuracy. Two widely recognized datasets and two operating conditions are utilized for model training and prediction, respectively. Comparisons are made with single-feature parameter models in terms of Root Mean Square Error (RMSE) and Determination Coefficient (R2). The results show that the prediction accuracy of the TCN-GRU multi-feature fusion model is higher than that of the single-feature models in terms of stability and anti-interference under both operating conditions. Furthermore, with the increase of input feature parameters, the TCN-GRU model is closer to the real value, which proves once again that the proposed model can meet the accuracy requirements of the life prediction of PEMFC.

The escalating reliance on revolutionary online web services has introduced heightened security risks, with persistent challenges posed by phishing despite extensive security measures. Traditional phishing systems, reliant on machine learning and manual features, struggle with evolving tactics. Recent advances in deep learning offer promising avenues for tackling novel phishing challenges and malicious URLs. This paper introduces a two-phase stack generalized model named AntiPhishStack, designed to detect phishing sites. The model leverages the learning of URLs and character-level TF-IDF features symmetrically, enhancing its ability to combat emerging phishing threats. In Phase I, features are trained on a base machine learning classifier, employing K-fold cross-validation for robust mean prediction. Phase II employs a two-layered stacked-based LSTM network with five adaptive optimizers for dynamic compilation, ensuring premier prediction on these features. Additionally, the symmetrical predictions from both phases are optimized and integrated to train a meta-XGBoost classifier, contributing to a final robust prediction. This work's significance lies in advancing phishing detection with AntiPhishStack, operating without prior phishing-specific feature knowledge. Experimental validation on two benchmark datasets, comprising benign and phishing or malicious URLs, demonstrates the model's exceptional performance, achieving a notable 96.04% accuracy. This research adds value to the ongoing discourse on symmetry and asymmetry in information security and provides a forward-thinking solution for enhancing network security in the face of evolving cyber threats.

Cultural Tourism (CT), which enhances the economic development of a region, aids a country in reinforcing its identities, enhancing cross-cultural understanding, and preserving the heritage culture of an area. Designing a proper tourism model assists the tourists in understanding the point of interest without the help of a local guide. However, owing to the need for the analysis of different factors, designing such a model is a complex process. Therefore, this article proposes a CT model for Riyadh for peak visitor time. Primarily, the map data and cultural event dataset are processed for location, such as grouping with Kriging Interpolation-based Chameleon (KIC), tree forming, and feature extraction. After that, the event dataset’s attributes are processed with word embedding. Meanwhile, the Social Network Sites (SNS) data like reviews and news are extracted with an external Application Programming Interface (API). The review data is processed with keyword extraction and word embedding, whereas the news data is processed with score value estimation. Lastly, the data are fused corresponding to a historical site and given to the Multi-Quadratic-Long Short Term Memory (MQ-LSTM) Recommendation System (RS); also, the recommended result with the map is stored in a database. Lastly, the database security is maintained with Locality Sensitive Hashing (LSH); moreover, by attaining higher performance values, the proposed model is experimentally verified.

This paper introduces a multi-class hand gesture recognition model developed to identify a set of defined hand gesture sequences in two-dimensional RGB video recordings. The work presents an action detection classifier that looks at both appearance and spatiotemporal parameters of consecutive frames. The classifier utilizes a convolutional-based network combined with a long-short-term memory unit. To leverage the need for a large-scale dataset, the model uses an available dataset to then adopt a technique known as transfer learning to fine-tune the model on the hand gestures of relevance. Validation curves performed over a batch size of 64 indicate an accuracy of 93.95% (± 0.37) with a mean Jaccard index of 0.812 (± 0.105) for 22 participants. The presented model illustrates the possibility of training a model with a small set of data (113,410 fully labelled frames). The proposed pipeline embraces a small-sized architecture that could facilitate its adoption.

Speech emotion recognition remains a heavy lifting in natural language processing. It has strict requirements to the effectiveness of feature extraction and that of acoustic model. With that in mind, a Heterogeneous Parallel Convolution Bi-LSTM model is proposed to address these challenges. It consists of two heterogeneous branches: the left one contains two dense layers and a Bi-LSTM layer, while the right one contains a dense layer, a convolution layer, and a Bi-LSTM layer. It can exploit the spatiotemporal information more effectively, and achieves 84.65%, 79.67%, and 56.50% unweighted average recall on the benchmark databases EMODB, CASIA, and SAVEE, respectively. Compared with the previous research results, the proposed model achieves better performance stably.

Speech/music classification that facilitates optimized signal processing from classification results has been extensively adapted as an essential part of various electronics applications, such as multi-rate audio codecs, automatic speech recognition, and multimedia document indexing. In this paper, a new technique to improve the robustness of speech/music classifier for 3GPP enhanced voice service (EVS) using long short-term memory (LSTM) is proposed. For effective speech/music classification, feature vectors implemented with the LSTM are chosen from the features of the EVS. Experiments show that LSTM-based speech/music classification produces better results than conventional EVS under a variety of conditions and types of speech/music data.

Background: Accurate sales forecasting in the mobile phone industry is critical to informed decision making by both the government and corporations. This study seeks to enhance mobile phone sales predictions by incorporating brand exposure as a predictive factor, hence addressing the gap left by the existing forecasting models that do not consider the impact of brand awareness. Method: This study thereby indicates a quantification method for brand exposure that merges word-of-mouth reviews with online search data. Word2Vec is used to extract initial keywords from a word-of-mouth corpus, whereas time-lag correlation analysis refines the core keywords. Later, PCA synthesizes brand exposure. The attention-LSTM framework hereby develops a forecasting model of mobile phone sales, effectively combining long short-term memory networks with the ability to capture time series dependencies and an attention mechanism to reduce data redundancy. Results: By considering brand exposure, the experiments demonstrate that the attention-LSTM model decreases the RMSE and MAPE indicators by 2.02% and 0.96%, respectively. In addition, compared with the ARIMA, SVR, BP neural network, and LSTM models, the attention-LSTM model decreases the average percentage errors by 6.52%, 3.42%, 2.56%, and 0.81%, respectively. Conclusion: Attention-LSTM captures dynamic sales trends very well and holds great significance over traditional models. Overall, including brand exposure, this model is very strong for the interpretation of mobile phone sales predictions, which has important implications in terms of policy as well as corporate strategies.

Fire outbreaks continue to cause damage despite the improvements in fire-detection tools and algorithms. It is still challenging to implement a well performing and optimized approach, which is sufficiently accurate, and has tractable complexity and low false alarming rate. Small amount of fire and identification of fire from a long distance is also a challenge in previously proposed techniques. In this study, we propose a novel hybrid model based on Convolutional Neural Networks (CNN) to detect and analyze fire intensity. 21 convolutional layers, 24 Rectified Linear Unit (ReLU) layers, 6 pooling layers, 3 fully connected layers, 2 dropout layers, and a softmax layer are included in the proposed 57-layer CNN model. Our proposed model performs instance segmentation in order to distinguish between fire and non-fire events. To reduce the intricacy of the proposed model, we also propose a key-frame extraction algorithm. The proposed model uses Internet of Things (IoT) devices to alert the relevant person by calculating the severity of fire. Our proposed model is tested on a publicly available dataset having fire and normal videos. The achievement of 95.25 % classification accuracy, 0.09% False Positive Rate (FPR), 0.65 percent False Negative Rate (FNR), and a prediction time of 0.08 seconds validates the proposed system.

In detecting DDoS, deep learning faces challenges and difficulties such as high computational demands, long training times, and complex model interpretation. This research focuses on overcoming these challenges by proposing an effective strategy for detecting DDoS attacks in unbalanced network environments. This research uses SMOTE to increase the class distribution of the data set by allowing models using LSTM to learn time anomalies effectively when DDoS attacks occur. The experiments carried out have shown significant improvement in the performance of the LSTM model when integrated with SMOTE. These include validation loss results of 0.048 for LSTM SMOTE and 0.1943 for LSTM without SMOTE, accuracy of 99.50 and 97.50. Apart from that, there was an increase in the f1 score from 93.4% to 98.3%. In this research, it is proven that SMOTE can be used as an effective strategy to improve model performance in detecting DDoS attacks on heterogeneous networks, as well as increasing model robustness and reliability.

Autonomous mobile robots are essential to the industry, and human-robot interactions are becoming more common nowadays. These interactions require that the robots navigate scenarios with static and dynamic obstacles in a safely manner, avoiding collisions. This paper presents a physical implementation of a method for dynamic obstacle avoidance using a Long Short-Term Memory (LSTM) neural network that obtains information from the mobile robot’s LiDAR for it to be capable of navigating through scenarios with static and dynamic obstacles while avoiding collisions and reaching its goal. The model is implemented using a TurtleBot3 mobile robot within an OptiTrack Motion Capture (MoCap) system for obtaining its position at any given time. The user operates the robot through these scenarios, recording its LiDAR readings, target point, position inside the MoCap system, and its linear and angular velocities, all of which serve as the input for the LSTM network. The model is trained on data from multiple user-operated trajectories across five different scenarios, outputting the linear and angular velocities for the mobile robot. Physical experiments prove that the model is successful in allowing the mobile robot to reach the target point in each scenario while avoiding the dynamic obstacle, with a validation accuracy of 98.02%.

This paper investigates nonverbal communication in human interactions, with a specific focus on facial expressions. Employing a Long Short-Term Memory (LSTM) architecture and a custom-ized facial expression framework, our approach aims to improve virtual agent interactions by incorporating subtle nonverbal cues. The paper contributes to the emerging field of facial expres-sion generation, addressing gaps in current research and presenting a novel framework within Unreal Engine 5. The model's architecture, trained on the CANDOR corpus, captures temporal dynamics, and refines hyperparameters for optimal performance. During testing, the trained model showed a cosine similarity of -0.95. This enables the algorithm to accurately respond to non-verbal cues and interact with humans in a way that is comparable to human-human interac-tion. Unlike other approaches in the field of facial expression generation, the presented method is more comprehensive and enables the integration of a multi-modal approach for generating facial expressions. Future work involves integrating blendshape generation, real-world testing, and the inclusion of additional modalities to create a comprehensive framework for seamless hu-man-agent interactions beyond facial expressions.

Raindrop size distribution (RSD) is an index for reflecting precipitation characteristics. Analyzing the differences of RSD plays an important role in understanding the precipitation microphysical processes and improving quantitative precipitation prediction of radar. In this paper, the RSD data of Dafang (57708) station, Majang (57828) station, and Luodian (57916) station (with an altitude of 1722.7m, 985.0m, and 441.5m, respectively) in Guizhou are analyzed according to the precipitation microphysical characteristics. First,Particles with particle size less than 1mm contributes the highest value to the density of particle number , and decrease with the descending altitude. Second, the GAMMA distribution fit shows a better fit compare to M-P distribution fit, and GAMMA distribution fit increases with the ascending altitude. Third, the mass-weighted average diameter is not sensitive enough to the change of precipitation intensity with correlation coefficients of 54.84%, but there is a obvious relationship between the average volume diameter and the precipitation intensity with correlation coefficients of 69.15%. Then, the precipitation prediction model is established using LSTM neural network after fusing the representative microphysical characteristics of RSD with radar and rain gauge data. The precipitation prediction model is applied to the Dafang (57708) site to predict precipitation for time range of 0-180 minutes, and it is found that for the prediction of convective cloud and stratiform cloud precipitation, the 60-minute prediction results are the most consistent with the actual precipitation, where the correlation coefficients are 92.87% and 92.57%, respectively. Conclusively, the results demonstrate that combining with the RSD base data could improve the reliability of precipitation forecasting.

Activated sludge process is a well known method to treat municipal and industrial waste water. In this complex process, the oxygen concentration in the reactors plays a critical role in the plant efficiency. This paper proposes the use of a Long Short-Term Memory (LSTM) network to identify an input-output model suitable for the design of an oxygen concentration controller. The model is identified from easy-accessible measures collected from a real plant. This dataset covers almost a month. The performances achieved with the proposed LSTM model are compared with the ones obtained with a standard AutoRegressive model with eXogenous input (ARX). Both models catch the oscillation and the overall behaviour (ARX ρ=0.833 , LSTM ρ=0.921), but, while the ARX model fails in reaching the correct amplitude (FIT=41.20%), the LSTM presents satisfactory performance (FIT=60.56%).

This paper realizes early bearing fault warning through bearing fault time series prediction, and proposes a bearing fault time series prediction model based on optimized maximum correlation kurtosis deconvolution (MCKD) and long short-term memory (LSTM) recurrent neural network to ensure bearings operation reliability. The model is based on lifecycle vibration signal of the bearing, to begin, the cuckoo search (CS) is utilized to optimize the parameter filter length L and deconvolution period T of MCKD, taking into account the influence and periodicity of the bearing time series, the fault impact component of the optimized MCKD deconvolution time series is improved. Then select the LSTM learning rate α depending on deconvolution time series. Finally, the dataset obtained through various preprocessing approaches are used to train and predict the LSTM model. The average prediction accuracy of the optimized MCKD-LSTM model is 26 percent higher than that of the original time series, proving the efficiency of this method, and the prediction results track the real fault data well, according to the XI'AN JIAOTONG University XJTU-SY bearing dataset.

In cognitive radio systems, identifying spectrum opportunities is fundamental to efficiently use the spectrum. Spectrum occupancy prediction is a convenient way of revealing opportunities based on previous occupancies. Studies have demonstrated that usage of the spectrum has a high correlation over multidimensions which includes time, frequency, and space. Accordingly, recent literature uses tensor-based methods to exploit the multidimensional spectrum correlation. However, these methods share two main drawbacks. First, they are computationally complex. Second, they need to re-train the overall model when no information is received from any base station for any reason. Different than the existing works, this paper proposes a method for dividing the multidimensional correlation exploitation problem into a set of smaller sub-problems. This division is achieved through composite two-dimensional (2D)-long short-term memory (LSTM) models. Extensive experimental results reveal a high detection performance with more robustness and less complexity attained by the proposed method. The real-world measurements provided by one of the leading mobile network operators in Turkey validate these results.

Several researchers have contemplated deep learning-based post-filters to increase the quality of statistical parametric speech synthesis, which perform a mapping of the synthetic speech to the natural speech, considering the different parameters separately and trying to reduce the gap between them. The Long Short-term Memory (LSTM) Neural Networks have been applied successfully in this purpose, but there are still many aspects to improve in the results and in the process itself. In this paper, we introduce a new pre-training approach for the LSTM, with the objective of enhancing the quality of the synthesized speech, particularly in the spectrum, in a more efficient manner. Our approach begins with an auto-associative training of one LSTM network, which is used as an initialization for the post-filters. We show the advantages of this initialization for the enhancing of the Mel-Frequency Cepstral parameters of synthetic speech. Results show that the initialization succeeds in achieving better results in enhancing the statistical parametric speech spectrum in most cases when compared to the common random initialization approach of the networks.

The Ylistrum japonicum is a commercially valuable scallop known for its long-distance swimming abilities. Despite its economic importance, genetic and genomic research on this species is limited. This study presents the first complete mitochondrial genome of Y. japonicum. The mitochondrial genome is 19,475 bp long and encompasses 13 protein-coding genes, 3 ribosomal RNA genes, and 23 transfer RNA genes. By selecting 15 Pectinidae species and additional outgroup taxa, we have constructed phylogenetic trees to elucidate the evolutionary placement of Ylistrum within the family Pectinidae. Our analysis reveals that Ylistrum is a basal lineage to the Pectininae clade, distinct from its previously assigned tribe, Amusiini. This study offers critical insights into the genetic makeup and evolutionary history of Y. japonicum, enhancing our knowledge of this economically vital species.

The tricellular tight junction protein angulin-1/lipolysis-stimulated lipoprotein receptor (LSR) is associated with numerous signal transduction pathways that regulate gene expression, epithelial cell function, and morphogenesis. The impacts of particulate matter on LSR and asthma are not known. Therefore, the aim of the present study was to assess the impacts of particulate matter as one of air pollution on LSR expression in asthma. To this end, we investigated the involvement of LSR in the pathogenesis of bronchial asthma in an ovalbumin (OVA) mouse model of asthma exposed to titanium dioxide (TiO2), and examined plasma LSR levels and their relationship with clinical variables in asthma patients and healthy controls. Plasma LSR levels were lower in asthma patients than in healthy controls. Although plasma levels of receptor for advanced glycation end-products (RAGE) were lower in asthma patients than in healthy controls, high mobility group box protein 1 (HMGB1) levels did not differ between these groups. In asthma patients, LSR levels were correlated with the forced vital capacity percentage, ratio of forced expiration (first second)-to-forced vital capacity, white blood cell count, and blood lymphocyte proportion. In mice, LSR expression was significantly decreased in OVA mice compared with control mice, and changed in OVA mice exposed to TiO2. Transforming growth factor beta levels were increased in OVA mice compared with control mice, and changed in OVA mice exposed to TiO2. Overall, plasma LSR levels were decreased in asthma patients, and were influenced by exposure to air pollution. These findings suggest the involvement of LSR in the pathogenesis of asthma.

With the recent advances in Machine Learning (ML), several models have been successfully applied to financial and accounting data to predict the likelihood of companies’ bankruptcy. However, time series have received little attention in literature with a lack of studies on the application of Deep Learning sequence models as Recurrent Neural Networks (RNN) and the recent Attention-based models in general. In this research work, we investigated the application of Long Short Term Memory (LSTM) networks to exploit time series of accounting data for bankruptcy prediction. The main contributions of our work are the following: a) we have proposed a Multi-head LSTM that models each financial variable in a time window independently and compared it with a single-input LSTM and other traditional ML models. The Multi-head LSTM outperforms all the other models; b) We identify the optimal time series length for bankruptcy prediction to be equal to 4 years of accounting data; c) We made public the dataset we used for the experiments that include data from 8262 different public companies in the American stock market generated in the period between 1999-2018. Furthermore, we prove the efficacy of the Multi-head LSTM models in terms of lower false positives and better division of the two classes.

Soil moisture is an important factor affecting the plant growth. For a long time, the convenience, timeliness and accuracy of soil moisture monitoring have been limited due to the backward of observation methods and equipment. Therefore, the quantitative prediction of soil moisture has become a difficult problem. Aiming at the problems of high erection cost, easily damaged sensors and low measurement accuracy of the existing fixed sensor soil moisture monitoring system, a soil moisture prediction model based on the long short term memory neural network (LSTM) integrating the particle swarm optimization (PSO) (PSO-LSTM) is designed and implemented. The hyperparameters of the LSTM network can be obtained based on the excellent global search ability of the PSO algorithm. According to the meteorological data and soil moisture data of Haidian Park in 2019, the long short term memory(LSTM) neural network based prediction model is constructed with input vectors of surface temperature, average temperature, evaporation, sunshine hours, precipitation and average wind speed, and the output vector of soil relative humidity. The results show that compared with the back propagation(BP) neural network, the Elman neural network and the LSTM neural network, the proposed PSO-LSTM model has higher prediction performance.

Nowadays, technological advancement has transformed traditional vehicles into Au-tonomous Vehicles (A.V.s). In addition, in our daily lives, A.V.s play an important role since they are considered an essential component of smart cities. A.V. is an intelligent vehicle capable of main-taining safe driving by avoiding crashes caused by drivers. Unlike traditional vehicles, which are fully controlled and operated by humans, A.V.s collect information about the outside environment using sensors to ensure safe navigation. Furthermore, A.V.s reduce environmental impact because they usually use electricity to operate instead of fossil fuel, thus decreasing the greenhouse gasses. However, A.V.s could be threatened by cyberattacks, posing risks to human life. For example, re-searchers reported that Wi-Fi technology could be vulnerable to cyberattacks through Tesla and BMW AVs. Therefore, more research is needed to detect cyberattacks targeting the components of A.V.s to mitigate their negative consequences. This research will contribute to the security of A.V.s by detecting cyberattacks at the early stages. First, we inject False Data Injection (FDI) attacks into an A.V. simulation-based system developed by MathWorks. Inc. Second, we collect the dataset generated from the simulation model after integrating the cyberattack. Third, we implement an intelligent symmetrical anomaly detection method to identify FDI attacks targeting the control system of the A.V. through a compromised sensor. We use long short-term memory (LSTM) deep networks to detect FDI attacks in the early stage to ensure the stability of the operation of A.V.s. Our method classifies the collected dataset into two classifications: normal and anomaly data. The ex-perimental result shows that our proposed model's accuracy is 99.95%. To this end, the proposed model outperforms other state-of-the-art models in the same study area.

Advancements in deep learning and availability of medical imaging data have led to use of CNN based architectures in disease diagnostic assisted systems. In spite of the abundant use of reverse transcription-polymerase chain reaction (RT-PCR) based tests in COVID-19 diagnosis, CT images offer an applicable supplement with its high sensitivity rates. Here, we study classification of COVID-19 pneumonia (CP) and non-COVID-19 pneumonia (NCP) in chest CT scans using efficient deep learning methods to be readily implemented by any hospital. We report our deep network framework design that encompasses Convolutional Neural Networks (CNNs) and bidirectional Long Short Term Memory (biLSTM) architectures. Our study achieved high specificity (CP: 98.3%, NCP: 96.2% Healthy: 89.3%) and high sensitivity (CP: 84.0%, NCP: 93.9% Healthy: 94.9%) in classifying COVID-19 pneumonia, non-COVID-19 pneumonia and healthy patients. Next, we provide visual explanations for the CNN predictions with gradient-weighted class activation mapping (Grad-CAM). The results provided a model explainability by showing that Ground Glass Opacities (GGO), indicators of COVID-19 pneumonia disease, were captured by our CNN network. Finally, we have implemented our approach in three hospitals proving its compatibility and efficiency.

Epilepsy is a prevalent neurological disorder with considerable risks, including physical impairment and irreversible brain damage from seizures. Given these challenges, the urgency for prompt and accurate seizure detection cannot be overstated. Traditionally, experts have relied on manual EEG signal analyses for seizure detection, which is labor-intensive and prone to hu-man error. Recognizing this limitation, the rise of deep learning methods has been heralded as a promising avenue, offering more refined diagnostic precision. On the other hand, the prevailing challenge in many models is their constrained emphasis on specific domains, potentially diminishing their robustness and precision in complex real-world environments. This paper presents a novel model that seamlessly integrates the salient features from the time-frequency domain alongside pivotal statistical attributes derived from EEG signals. This fusion process involves the integration of essential statistics, including the mean, median, and variance, combined with the rich data from compressed time-frequency (CWT) images processed using auto-encoders. This multidimensional feature set provides a robust foundation for subsequent analytic steps. A long short-term memory (LSTM) network, meticulously optimized for the renowned Bonn Epilepsy dataset, was used to enhance the capability of the proposed model. Preliminary evaluations underscore the prowess of the proposed model: remarkable 100% accuracy in most of the binary classifications, impressive performance exceeding 95% for three-class and four-class challenges, and a commendable rate exceeding 93.5% for the five-class classification.

Photovoltaic(PV) power generation is highly nonlinear and stochastic. Accurate prediction of PV power generation plays a crucial role in grid connection as well as the operation and scheduling of power plants. To predict the PV power combination model, this paper suggests a method based on Empirical Mode Decomposition (EMD), Ensemble Empirical Mode Decomposition (EEMD), Complete Ensemble Empirical Mode Decomposition with Adaptive Noise (CEEMDAN), Nonlinear Auto-Regressive Neural Networks with Exogenous Input (NARXNN), Long Short Term Memory (LSTM) Neural Network, and Light Gradient Boosting Machine (LightGBM) algorithms. To attempt to reduce the non-smoothness of PV power, the weather variable features with the greatest effect on PV power are first identified by correlation analysis. Following this, the PV power modal decomposition is split and reorganized into a new feature matrix. Finally， a NARX is used to obtain preliminary PV power components and residual vector features， and the PV power is predicted by combining three models of LightGBM， LSTM, and NARX and then the final prediction results are obtained by combining the PV power prediction results using error inverse method weighted optimization. The prediction results demonstrate that the model put forth in this paper outperforms those of other models and validate the model's validity by utilizing real measurement data from Andre Agassi College in the United States.

White spot lesions (WSLs), a side effect of orthodontic treatment, can result in reversible and unaesthetic results. Graphene oxide (GO) with a bioactive glass (BAG) mixture(BAG@GO) was added to Low Viscosity Transbond XT(LV) in a ratio of 1, 3, 5%. The composite’s characterization and its physical and biological properties were verified with scanning electron microscopy(SEM) and X-ray diffraction(XRD); its microhardness, shear bond stress (SBS), cell viability, and adhesive remnant index (ARI) were also assessed. Efficiency in reducing WSL was evaluated using antibacterial activity of S. mutans. Anti-demineralization was analyzed using a cycle of the acid-base solution. Adhesives with 3 or 5 wt.% of BAG@GO showed significant increase in microhardness compared with LV. The sample and LV groups showed no significant differences in SBS or ARI. The cell viability test confirmed that none of the sample groups showed higher toxicity compared to the LV group. Antibacterial activity was higher in the 48-hour group than in the 24-hour group; the 48-hour test showed that BAG@GO had a high antibacterial effect, which was more pronounced in 5 wt.% of BAG@GO. Anti-demineralization effect was higher in the BAG@GO-group than in the LV-group; the higher the BAG@GO concentration, the higher the anti-demineralization effect.

Changes in sea level exhibit nonlinearity, nonstationarity, and multivariable characteristics, making traditional time series forecasting methods less effective in producing satisfactory results. To enhance the accuracy of the predictions of changes in sea level, this study introduced an improved VMD–EEMD–LSTM hybrid model. This model decomposes satellite altimetry data from near the Dutch coast using VMD, resulting in components of the Intrinsic Mode Function (IMF) with various frequencies and a residual sequence. EEMD further dissects the residual sequence obtained from VMD into second-order components. These IMFs decomposed by VMD and EEMD are utilized as features in the LSTM model for making predictions, culminating in the final forecasted results. The experimental results demonstrated significant improvements in the predictive performance compared with the VMD–LSTM model. The RMSE (root mean square error) decreased by an average of 58.68%, the MAE (mean absolute error) reduced by an average of 59.96%, and the R2 (coefficient of determination) increased by an average of 49.85% compared with the VMD–LSTM model. In comparison with the EEMD–LSTM model, the RMSE decreased by an average of 26.95%, the MAE decreased by an average of 28.00%, and the R2 increased by an average of 6.53%. The VMD–EEMD–LSTM model exhibited significantly improved predictive performance.

This study develops a 7-layer Long Short-Term Memory (LSTM) model to enhance early diabetes detection in Oman, aligning with the theme of 'Artificial Intelligence in Healthcare'. The model focuses on addressing the increasing prevalence of Type 2 diabetes, projected to impact 23.8% of Oman's population by 2050. It employs LSTM neural networks to manage factors contributing to this rise, including obesity and genetic predispositions, and aims to bridge the gap in public health awareness and prevention. The model's performance is evaluated through various metrics. It achieves an accuracy of 99.40%, specificity and sensitivity of 100% for positive cases, a recall of 99.34% for negative cases, an F1 score of 96.24%, and an AUC score of 94.51%. These metrics indicate the model's capability in diabetes detection. The implementation of this LSTM model in Oman's healthcare system is proposed to enhance early detection and prevention of diabetes. This approach reflects an application of AI in addressing a significant health concern, with potential implications for similar healthcare challenges globally.st diagnostic capabilities, representing a significant leap forward in healthcare technology in Oman.