Safe, high-quality and economical electric energy transportation is the basic requirements of modern power system operation. Transformer, as one of the core equipment of power system and national grid system, has the characteristics of diverse types, variable models and wide deployment. It is the basic equipment for power system to realize voltage change and electric energy distribution. Because the power system transformer needs to operate with load for a long time, the probability of failure is usually higher than that of other power equipment in general. This paper starts from the transformer fault and fault diagnosis. Firstly, the transformer fault types, traditional transformer fault diagnosis techniques and the advantages of machine learning in transformer fault diagnosis are reviewed. Secondly, the application of information system theory and information entropy in transformer fault diagnosis is introduced. Then it introduces machine learning technology, feature selection and extraction technology in transformer fault diagnosis, and machine learning algorithms such as support vector machine and extreme learning machine for transformer fault diagnosis. Finally, the potential development trend of information system theory, information entropy and machine learning in transformer fault diagnosis is forecasted. The combination of transformer fault prediction and machine learning algorithm is helpful for power system maintenance personnel to accurately predict the running state of power equipment, and also provides a new method and technology for the safe and reliable operation and regular maintenance of power system.

To enhance the overall reliability of the power system, engineers have redirected their focus toward health monitoring and early detection of faults in transformers. Among these faults, transformer core defects demand particular attention. While fault simulation using software has traditionally been the preferred approach, these methods suffer from data inaccuracies in real-world conditions. Consequently, conducting actual experimental setups with induced faults is imperative to investigate core issues. This study uses Hilbert Transform (HT) as a signal processing technique to extract crucial data characteristics, thereby enhancing the performance of the classifier model. The research involves analyzing electric current signals from a single-phase 1kVA transformer. A comparative assessment of our proposed model was conducted using raw data and Fast Fourier Transform (FFT), evaluating accuracy, precision, recall, F1-score, and computational time. The results demonstrate a significant improvement in all metrics for the classifier models, particularly the k-nearest neighbor (KNN) algorithm, which exhibited values of 83.89%, 84.39%, 83.89%, 83.79%, and 0.0156 seconds, respectively. Future work aims to extend this analysis under different loading conditions.

The operation of transformers suffers from natural or man-made disasters, subjecting the equipment to prolonged exposure to temperature, lightning strikes, transient over-voltages, and over-current, gradually producing insulation aging phenomenon, which results in partial discharges within the transformer. Without dealing with it beforehand properly, it may lead to insulation breakdown. Nowadays, with the mature development of microchip control technology and wireless communication technology, which is helpful for realizing the research for online real-time and long-term monitoring capabilities for power equipment. A transformer operating condition monitoring and diagnostic system that can rapidly and effectively prevent the breakdown of transformer insulation, which can impact the overall power supply system is developed in this paper. The system is divided into two parts based on its function. The first part is the operating condition monitoring and real-time alert unit for the transformer, primarily composed of an embedded computing module, a sensor module, and a transmission module. Its work content is to capture real-time online partial discharge ultrasonic signals and high frequency current comparator pulse signals, and analyze and determine the condition of the internal insulation and operational status whether it is fault or not. The second part is the central control unit, consisting mainly of an industrial computer and a transmission module. Its work content is to store the ultrasonic and high frequency current comparator pulse signals from the transformer operation monitoring and real-time alert unit. It uses the software to eliminate signal noise and interference, and then utilizes artificial neural networks to identify the type of fault. In this paper, the research for the phenomenon of insulation degradation in transformer equipment aims to establish aging trend profiles through the dual malfunctioning alert and aging process analysis, as well as the long-term measurement of ultrasonic signals from partial discharges and high-frequency current comparator pulse signals. This approach provides crucial reference data and a foundation for disposable on-site measurement, assessing the phenomenon of insulation aging stages, defects and damage of the transformers effectively. It allows for timely replacement or maintenance in advance, achieving the prevention of malfunctioning and predictive diagnosis of aging.

This study aimed to learn disturbance information to effectively control multiple small unmanned surface vehicles (USVs) for marine research purposes at sea. The learned disturbance information was used to investigate the control of multiple USV swarms based on the leading–following formation technique. Numerous studies have already been conducted on swarm control using drones in the air; however, there has been a paucity of studies on swarm control in the sea. Contrary to swarm control in aviation, the fluid density of the sea is high, and the environment is constantly changing; thus, a robot system would be significantly affected by disturbances. This ultimately influences the maintenance of swarm formations and the accomplishment of missions [1,2]. Therefore, it is difficult to control numerous moving objects while maintaining a formation at sea by using the existing aerial drone swarm control technology. To solve this problem, we learned a long short-term memory (LSTM) model with time-series marine environmental data to predict maritime disturbances. Thereafter, the model was applied to a mission-based position control algorithm of each USV constituting the swarm to design a marine unmanned floating vessel swarm control system that can be applied to various marine environments. Specifically, to effectively control numerous small USVs for marine research purposes, ocean currents are learned using the LSTM algorithm, and the predicted ocean currents are used to generate a swarm USV control system for USV formations. In this study, a control system model of several small USVs equipped with two rear thrusters and a front lateral thruster was designed. The LSTM algorithm was learned using the previous ocean current data, and the velocity of the following ocean currents was predicted. The predictions were then used as a system disturbance to determine the thrust of the controller. To measure ocean currents in the sea when each USV moves, the velocity, azimuth, and position (latitude, longitude) data from the GPS mounted on the USV were used to measure the velocity and direction of the hull's movement. Further, the flow rate was measured using a flow rate sensor on a small USV. The USV movement and position were controlled using an artificial neural network-PID (ANN-PID) controller. This study entailed a comparative analysis of the designed USV model results and those generated by the simulator, including the behavior control rule of the USV swarm and the path of the actual USV swarm at sea. It was verified that the effectiveness of the USV mathematical model and behavior control rules. By comparing the movement path of the swarm USV with and without the disturbance learning algorithm and ANN-PID control algorithm applied to the designed simulator, the position error and maintenance performance of the swarm formation were analyzed, and the application results were compared.

Preventing the occurrence of secondary caries serves as one of the significant issues in dental clinic, thus make it indispensable to improving the properties of conventional composite resin (CR) by developing a novel CR. In present study, two groups of experimental CRs loaded with different contents of fluoride-doped nano-zirconia fillers (25 wt% and 50 wt%) were fabricated. The surface topography, mechanical performance, fluoride release, antibacterial effect, aging property and cytotoxicity of the experimental CRs were evaluated subsequently. A uniform distribution of the F-zirconia fillers over the whole surface of resin matrix could be observed. The experimental CRs showed continuous fluoride release within 28 days, which was positively correlated with the content of F-zirconia fillers. Moreover, the amount of fluoride release increased in the acidic buffer. Addition of F-zirconia fillers could improve the color stability, wear resistance and microhardness of the experimental CRs, without reducing the flexure strength. Furtherly, the fluoride ions released continuously from the experimental CRs resulted in effective contact and antibacterial properties, while they showed no cytotoxicity. As a consequence, considerations can be made to employ this new kind of composite resin loaded with fluoride-doped nano-zirconia fillers to meet clinical requirements when the antimicrobial benefits are desired.

Properties of time domain parameters of the vibration signal have been extensively studied for the fault diagnosis of rolling element bearings (REB). Parameters like kurtosis and Envelope Harmonic-to-Noise Ratio are most widely applied in this field and some important progress has been made. However, since only one-sided information is contained in these parameters respectively, problems still exist in practice when the signals collected are of complicated structure and/or contaminated by strong background noises. A new parameter, named Shock pulse index (SPI), is proposed in this paper. It integrates the mutual advantage of both parameters above and can help effectively identify fault related impulse components under the interference of strong background noises, unrelated harmonic components and random impulses. The SPI optimizes the parameters of Maximum Correlated Kurtosis Deconvolution (MCKD), which is used to filter the signals under consideration. Finally, the interested transient information contained in the filtered signal can be highlighted through demodulation with Teager Energy Operator (TEO). Fault related impulse components can therefore be extracted accurately. Simulations and experiment analyses verify the effectiveness and correctness of the SPI.

incipient fault diagnosis is particularly important in process industrial systems, as its early detection helps to prevent major accidents. Against this background, this study proposes a combined method of Mixed Kernel Principal Components Analysis and Dynamic Canonical Correlation Analysis (MK-DCCA). The robust generalization performance of this approach is demonstrated through experimental validation on a randomly generated dataset. Furthermore, Comparative experiments were conducted on a CSTR Simulink model, comparing the MK-DCCA method with DCCA and DCVA methods, demonstrating its excellent detection performance for incipient fault in nonlinear and dynamic system. Meanwhile, fault identification experiments were conducted, validating the high accuracy of fault identification method based on contribution. The experimental findings demonstrate that the method possesses a certain industrial significance and academic relevance.

Intelligent fault diagnosis techniques have replaced the time-consuming and unreliable human analysis, increasing the efficiency of fault diagnosis. Deep learning model can improve the accuracy of intelligent fault diagnosis with the help of its multilayer nonlinear mapping ability. This paper has proposed a novel method named Deep Convolutional Neural Networks with Wide First-layer Kernels (WDCNN). The proposed method uses raw vibration signals as input (data augmentation is used to generate more inputs), and uses the wide kernels in first convolutional layer for extracting feature and suppressing high frequency noise. Small convolutional kernels in the preceding layers are used for multilayer nonlinear mapping. AdaBN is implemented to improve the domain adaptation ability of the model. The proposed model addresses the problem that currently, the accuracy of CNN applied to fault diagnosis is not very high. WDCNN can not only achieve 100% classification accuracy on normal signals, but also outperform state of the art DNN model which is based on frequency features under different working load and noisy environment.

The fault diagnosis of safety critical systems such as wind turbine installations includes extremely challenging aspects that motivate the research issues considered in this paper. In fact, the prompt detection and the reliable diagnosis of faults in their earlier occurrence represent the key point especially for offshore installations. For these plants, operation and maintenance procedures in harsh environments would inevitably increase the cost of the energy production. Therefore, this work investigates fault diagnosis solutions that are considered in a viable way and used as advanced techniques for condition monitoring of dynamic processes. To this end, the work proposes the design of fault diagnosis strategies that exploit the estimation of the fault by means of data--driven approaches. This solution leads to the development of effective methods allowing the management of partially unknown information of the system dynamics, while coping with measurement errors, the model--reality mismatch and other disturbance effects. In mode detail, the proposed data--driven methodologies exploit fuzzy systems and neural networks in order to estimate the nonlinear dynamic relations between the input and output measurements of the considered process and the faults. To this end, the fuzzy and neural network structures are integrated with auto--regressive with exogenous input descriptions, thus making them able to approximate unknown nonlinear dynamic functions with arbitrary degree of accuracy. Once these models are estimated from the input and output data measurement acquired from the considered dynamic process, the capabilities of their fault diagnosis capabilities are validated by using a high--fidelity benchmark that simulates the healthy and the faulty behaviour of a wind turbine system. Moreover, at this stage the benchmark is also useful to analyse the robustness and the reliability characteristics of the developed tools in the presence of model--reality mismatch and modelling error effects featured by the wind turbine simulator. On the other hand, a hardware--in--the--loop tool is finally implemented for testing and comparing the performance of the developed fault diagnosis strategies in a more realistic environment and with respect to different fault diagnosis approaches.

The service conditions of underground coal mine equipment are poor, and it is difficult to accurately extract the fault characteristics of rolling bearings. In order to better improve the accuracy of fault identification of rolling bearings, a fault detection method based on multiscale permutation entropy and SOA-SVM is proposed. First, the whale optimization algorithm is used to select the modal analysis number K and the penalty factor α of the variational mode decomposition algorithm. Then, the vibration signal of rolling bearings is dissolved according to the optimized variational mode decomposition algorithm, and the multi-scale permutation entropy of the main intrinsic mode function is calculated. Finally, the feature values of the matrix are entered into the SVM algorithm optimized by the seagull optimization algorithm to obtain the classification result. The experimental results based on the published rolling bearing datasets of Western Reserve University show that the identification success rate of the proposed method can reach 98.75%. The fault detection of the rolling bearings can be completed accurately and efficiently.

To realize the diagnosis of compound faults in gearboxes at different speeds, an "end-to-end" intelligent diagnosis method based on a deep neural network is proposed, named efficiency channel attention-capsule network (ECA-CN). First, the process uses a deep convolutional neural network to extract fault features from the collected raw vibration signals, then embeds the efficient channel attention module to filter important fault features, then uses the capsule network to vectorize the feature space information, and finally calculates the correlation between different levels of capsules by the dynamic routing algorithm to achieve accurate gearbox compound fault diagnosis. The effectiveness of the proposed ECA-CN fault diagnosis method was verified by the composite fault dataset of the 2009 PHM Challenge gearbox, with an average accuracy of 99.63% and a standard deviation of 0.22%. In the comparison experiments with the traditional fault diagnosis method, the average accuracy of the ECA-CN method was improved by 4.62%, and the standard deviation was reduced by 0.58%. The experimental results show that ECA-CN has a more competitive diagnostic performance.

In the past years, various intelligent machine learning and deep learning algorithms have been developed and widely applied for gearbox fault detection and diagnosis. However, the real-time application of these intelligent algorithms has been limited, mainly due to the fact that the model developed using data from one machine or one operating condition has serious diagnosis performance degradation when applied to another machine or the same machine with a different operating condition. The reason for poor model generalization is the distribution discrepancy between the training and testing data. This paper proposes to address this issue using a deep learning based cross domain adaptation approach for gearbox fault diagnosis. Labelled data from training dataset and unlabeled data from testing dataset is used to achieve the cross-domain adaptation task. A deep convolutional neural network (CNN) is used as the main architecture. Maximum mean discrepancy is used as a measure to minimize the distribution distance between the labelled training data and unlabeled testing data. The study proposes to reduce the discrepancy between the two domains in multiple layers of the designed CNN to adapt the learned representations from the training data to be applied in the testing data. The proposed approach is evaluated using experimental data from a gearbox under significant speed variation and multiple health conditions. An appropriate benchmarking with both traditional machine learning methods and other domain adaptation methods demonstrates the superiority of the proposed method.

Primary importance is devoted to Fault Detection and Diagnosis (FDI) of electrical machine and drive systems in modern industrial automation. The widespread use of Machine Learning techniques has made it possible to replace traditional motor fault detection techniques with more efficient solutions that are capable of early fault recognition by using large amounts of sensory data. However, the detection of concurrent failures is still a challenge in the presence of disturbing noises or when the multiple faults cause overlapping features. The contribution of this work is to propose a novel methodology using multi-label classification method for simultaneously diagnosing multiple faults and evaluating the fault severity under noisy conditions. Performance of various multi-label classification models are compared. Current and vibration signals are acquired under normal and fault conditions. The applicability of the proposed method is experimentally validated under diverse fault conditions such as unbalance and misalignment.

Machine fault diagnosis systems need to collect and transmit dynamic monitoring signals, like vibration and current signals, at high-speed. However, industrial wireless sensor networks (IWSNs) and Industrial Internet of Things (IIoT) are generally based on low-speed wireless protocols, such as ZigBee and IEEE802.15.4. To address this tension when implementing machine fault diagnosis applications in IIoT, this paper proposes a novel IWSN with on-sensor data processing. On-sensor wavelet transforms using four popular mother wavelets are explored for fault feature extraction, while an on-sensor support vector machine classifier is investigated for fault diagnosis. The effectiveness of the presented approach is evaluated by a set of experiments using motor bearing vibration data. The experimental results show that compared with raw data transmission, the proposed on-sensor fault diagnosis method can reduce the payload transmission data by 99.95%, and reduce the node energy consumption by about 10%, while the fault diagnosis accuracy of the proposed approach reaches 98%.

The fault diagnosis of wind farms has been proven to be a challenging task and motivates the research activities carried out through this work. Therefore, this paper deals with the fault diagnosis of a wind park benchmark model, and it considers viable solutions to the problem of earlier fault detection and isolation. The design of the fault indicator involves data-driven approaches, as they can represent effective tools for coping with poor analytical knowledge of the system dynamics, noise, uncertainty and disturbances. In particular, the proposed data-driven solutions rely on fuzzy models and neural networks that are used to describe the strongly nonlinear relationships between measurement and faults. The chosen architectures rely on nonlinear autoregressive with exogenous input models, as they can represent the dynamic evolution of the system along time. The developed fault diagnosis schemes are tested by means of a high-fidelity benchmark model, that simulates the normal and the faulty behaviour of a wind farm installation. The achieved performances are also compared with those of a model-based approach relying on nonlinear differential geometry tools. Finally, a Monte-Carlo analysis validates the robustness and the reliability of the proposed solutions against typical parameter uncertainties and disturbances.

Contrapose the highly integrated, multiple types of faults and complex working conditions of aircraft Electro Hydrostatic Actuator (EHA), to effectively identify its typical faults, we propose a fault diagnosis method based on the fusion convolutional neural networks (FCNN). First, the aircraft EHA fault data is encoded by GADF to obtain the fault feature images. Then we build an FCNN model that integrates the 1DCNN and 2DCNN, where the original 1D fault data is the input of the 1DCNN model, and the feature images obtained by GADF transformation are used as the input of 2DCNN. Multiple convolution and pooling operations are performed on each of these inputs to extract the features, next these feature vectors are spliced in the convergence layer, and the fully connected layers and the Softmax layers are finally used to attain the classification of aircraft EHA faults. Furthermore, the multi-strategy hybrid particle swarm optimization (MSPSO) algorithm is applied to optimize the FCNN to obtain a better combination of FCNN hyperparameters; MSPSO incorporates various strategies, including an initialization strategy based on homogenization and randomization, and an adaptive inertia weighting strategy, etc. The experimental result indicates that the FCNN model optimized by MSPSO achieves an accuracy of 96.86% for identifying typical faults of the aircraft EHA, respectively higher than the 1DCNN and the 2DCNN about 16.5% and 5.7%. Additionally, the FCNN model improved by MSPSO has a higher accuracy rate when compared to PSO.

Mechanical equipment is composed of several parts, the interaction between the parts exists throughout whole life cycle leads to the widespread phenomenon of fault coupling and the diagnosis of independent faults cannot meet the requirements of the health management of mechanical equipment under actual working conditions. In this paper, the topological structure of graph neural network is used to describe the correlation of coupling faults and multiple fault types are regarded as network nodes respectively. The fault features are fused and extracted by graph convolution to achieve the classification of coupling faults. In this paper, dynamic vertexes are defined in data topology and the parameters of DIGNN classification model are optimized by changing the fault type of dynamic vertexes during training stage. The data is loaded into dynamic vertexes for classification and analysis during testing stage. The one-dimensional vibration data is converted into two-dimensional time-frequency domain data by wavelet transform making the input features of the model interpretable to reduce the uncertainty of model training. The data topology is then fed into DIGNN for fault classification, and GCN's node aggregation gives interpretability to each layer of network data processing. The method proposed in this paper can realize accurate diagnosis of independent faults on the data set, and can effectively judge the coupling mode of coupling faults, which is suitable for coupling fault analysis of mechanical equipment.

Power grid fault diagnosis technology has been widely used at home and abroad. With the access of distributed power sources and diversified loads, the distribution network has changed from a passive network to an active network, and the current has changed from "one-way" to "two-way". The structure of distribution network, equipment environment and operating conditions are becoming more and more complex, and the fault diagnosis and localization of active distribution network is becoming more and more difficult. With the rapid development of artificial intelligence, power grid fault diagnosis based on intelligence is unprecedented. This paper introduces the research status of distributed photovoltaic grid-connected fault diagnosis technology, and expounds the history of fault diagnosis technology, which mainly includes expert system, artificial neural network, Bayesian network, fuzzy set theory, rough set theory, Petri net analytical model and multi-source information fusion, etc. The applicability and characteristics of these diagnoses are described, and the existing defects and the overall direction of improvement are briefly described Finally, the key technical problems and future directions in the field of power system fault diagnosis are pointed out by combining theory with practice, so as to promote the further development of this field.

The diagnosis of a rolling bearing for monitoring its status is critical for maintaining industrial equipment using rolling bearings. The traditional method of diagnosing faults of the rolling bearing has low identification accuracy, which needs artificial feature extraction to enhance the accuracy. 1D-CNN method not only can diagnose bearing faults accurately but also overcome shortcomings of the traditional methods. Different from machine learning and other deep learning models, the 1D-CNN method does not need pre-processing one-dimensional data of rolling bearing’s vibration. Thus, it enhances the processing speed and improves the network structure to have a reasonable design for small sample data sets. This study proposes and tests a 1D-CNN method for diagnosing rolling bearings. By introducing the dropout operation, the method obtains high accuracy and improves the generalizing ability. The experimental results show 99.52% of the average accuracy under a single load and 98.26% under different loads.

In the recent years, intelligent data-driven faultdiagnosis methods on gearboxes have been successfully developedand popularly applied in the industries. Currently, most ofthe machine learning techniques require that the training andtesting data are from the same distribution. However, thisassumption is difficult to be met in the real industries, sincethe gearbox operating conditions usually change in practice,which results in significant data distribution gap and diagnosticperformance deteriorations in applying the learned knowledgeon the new conditions. This paper proposes a deep learning-based domain adaptation method to address this issue. Theraw current signals are directly used as the model inputs fordiagnostics, which are easy to collect in the real industries andfacilitate practical applications. The maximum mean discrepancymetric is introduced to the deep neural network, the optimizationof which guarantees the extraction of generalized machineryhealth condition features across different operating conditions.The experiments on a real-world gearbox condition monitoringdataset validate the effectiveness of the proposed method, whichoffers a promising tool for cross-domain diagnosis in the realindustries.

The fault diagnosis of wind turbine systems represent a challenging issue, especially for offshore installations, thus justifying the research topics developed in this work. Therefore, this paper addresses the problem of the fault diagnosis of wind turbines, and it present viable solutions of fault detection and isolation techniques. The design of the so--called fault indicator consists of its estimate, which involves data--driven methods, as they result effective tools for managing partial analytical knowledge of the system dynamics, together with noise and disturbance effects. In particular, the suggested data--driven strategies exploit fuzzy systems and neural networks that are employed to determine nonlinear links between measurements and faults. The selected architectures are based on nonlinear autoregressive with exogenous input prototypes, as they approximate the dynamic evolution of the system along time. The designed fault diagnosis schemes are verified via a high--fidelity simulator, which describes the normal and the faulty behaviour of an offshore wind turbine plant. Finally, by taking into account the presence of uncertainty and disturbance implemented in the wind turbine simulator, the robustness and the reliability features of the proposed methods are also assessed. This aspect is fundamental when the proposed fault diagnosis methods have to be applied to offshore installations.

One of the most crucial elements in deeply understanding humans on a psychological level is manifested through facial expressions. The analysis of a human behavior can be informed by their facial expressions, making it essential to employ indicators such as expression (Expr), valence-arousal (VA), and action units (AU). In this paper, we introduce the method proposed in the Challenge of the 6th Workshop and Competition on Affective Behavior Analysis in-the-wild (ABAW) at CVPR 2024. Our proposed method utilizes the multi-modal Aff-wild2 dataset, which is splitted into spatial and audio modalities. For the spatial data, we extract features using a SimMiM model that was pre-trained on a diverse set of facial expression data. For the audio data, we extract features using a WAV2VEC model. To fusion the extracted spatial and audio features, we employed the cascaded cross-attention mechanism of a transformer.

The purpose of feature selection is to find important features from the original high-dimensional space. As atypical feature selection algorithm, Locally linear embedding(LLE)-based feature selection algorithm, which applies the idea of LLE to the graph-preserving feature selection framework, has been received wide attention. However, LLE-based feature selection framework is sensitive to noise and K-nearest neighbors. To address these problems, an improved LLE-based feature selection algorithm, robust LLE (RLLE) vote, is proposed. In this algorithm, $l_1$ and $l_2$ regularization are introduced into the high-dimensional reconstruction model of LLE. Furthermore, RLLE vote also proposes a criterion to measure the difference between the reconstruction features and the original features, and then the importance features can be selected by this criteria. Extensive experiments are carried out on a benchmark fault data set and the bearing data set collected from our own laboratory, and the experimental results demonstrate that RLLE vote achieves the most significant performance compared existing state-of-art methods.

The vibration feature of weak gear fault is often covered in strong background noise, which makes it necessary to establish weak feature enhancement methods. Among the enhancement methods, stochastic resonance (SR) has the unique advantage of transferring noise energy to weak signals and has a great application prospection in weak signal extraction. But the traditional SR potential model cannot form a richer potential structure and may lead to system instability when the noise is too great. To overcome these shortcomings, the article presents a periodic potential underdamping stochastic resonance (PPUSR) method after investigating the potential function and system signal-to-noise ratio (SNR). In addition, system parameters are further optimized by using ant colony algorithm. Through simulation and gear experiments, the effectiveness of the proposed method was verified. We concluded that compared with the traditional underdamped stochastic resonance (TUSR) method, the PPUSR method had a higher recognition degree and better frequency response capability.

For planetary gear has the characteristics of small volume, light weight and large transmission ratio, it is widely used in high speed and high power mechanical system. Poor working conditions result in frequent failures of planetary gear. A method is proposed for diagnosing faults in planetary gear based on permutation entropy of Complete Ensemble Empirical Mode Decomposition with Adaptive Noise (CEEMDAN) Adaptive Neuro-fuzzy Inference System (ANFIS) in this paper. The original signal is decomposed into 6 intrinsic mode functions (IMF) and residual components by CEEMDAN. Since the IMF contains the main characteristic information of planetary gear faults, time complexity of IMFs are reflected by permutation entropies to quantify the fault features. The permutation entropies of each IMF component are defined as the input of ANFIS, and its parameters and membership functions are adaptively adjusted according to training samples. Finally, the fuzzy inference rules are determined, and the optimal ANFIS is obtained. The overall recognition rate of the test sample used for ANFIS is 90.75%, and the recognition rate of gear with one missing tooth is relatively high. The recognition rates of different fault gears based on the method can also achieve better results. Therefore, the proposed method can be applied to planetary gear fault diagnosis effectively.

Fault diagnosis of the gearbox is a decisive part of the modern industry to find the many gearbox defects like gear tooth crack, chipped or broken, etc. But sometimes, the nonstationary properties of vibration signal and low energy of minimal faults make this procedure very challenging. Previously, many types of techniques have been developed for gearbox condition monitoring. But most of the methods are dealing with conventional techniques of the gearbox condition monitoring, such as time-domain analysis or frequency domain analysis. Most of the conventional methods are not suitable for the nonstationary vibration signal. Thus, this paper presents a novel gearbox fault diagnosis technique using conditional temporal moments and an optimizable support vector machine (SVM). This work also presents an integrated features extraction technique based on the standard features, i.e., statistical and spectral features with the combinations of moment features. The impact of the four conditional temporal moments of each gearbox condition is also presented. This work shows that the proposed method successfully classifies and categorizes the gearbox faults at an early stage.

Induction machines drive many industrial processes, and their unexpected failure can cause heavy production losses. The analysis of the current spectrum can identify online the characteristic fault signatures at an early stage, avoiding unexpected breakdowns. Nevertheless, frequency domain analysis requires stable working conditions, which is not the case for wind generators, motors driving varying loads, etc. In these cases an analysis in the time-frequency domain -such as a spectrogram- is required for detecting faults signatures. The spectrogram is built using the short frequency Fourier transform, but its resolution depends critically on the time window used to generate it: short windows provide good time resolution, but poor frequency resolution, just the opposite than long windows. Therefore, the window must be adapted at each time to the shape of the expected fault harmonics, by highly skilled maintenance personnel. In this paper, this problem is solved with the design of a new multi-band window, which generates simultaneously many different narrow-band current spectrograms, and combines them into a single, high resolution one, without the need of manual adjustments. The proposed method is validated with the diagnosis of bar breakages during the start-up of a commercial induction motor.

Radiator reliability is crucial in environments characterized by high temperatures and friction, where prompt interventions are often required to prevent system failures. This study introduces a proactive approach to radiator fault diagnosis, leveraging the integration of Gaussian Mixture Model (GMM) and Long-Short Term Memory (LSTM) autoencoders. Vibration signals from radiators were systematically collected through randomized durability vibration bench tests, resulting in four operating states—two normal, one unknown, and one faulty. Time-domain statistical features of these signals were extracted and subjected to Principal Component Analysis (PCA) to facilitate efficient data interpretation. Subsequently, this study discusses the comparative effectiveness of GMM and LSTM in fault detection. GMMs are deployed for initial fault classification, leveraging their clustering capabilities, while LSTM autoencoders excel in capturing time-dependent sequences, facilitating advanced anomaly detection for previously unencountered faults. This alignment offers a potent and adaptable solution for radiator fault diagnosis, particularly in challenging high-temperature or high-friction environments. Consequently, the proposed methodology not only provides a robust framework for early-stage fault diagnosis but also effectively balances diagnostic capabilities during operation. Additionally, this study presents the foundation for advancing reliability life assessment in accelerated life testing, achieved through dynamic threshold adjustments using both the absolute log-likelihood distribution of the GMM and the reconstruction error distribution of the LSTM autoencoder model.

In a complex working environment, the fault signal of the gearbox is greatly affected by the outside world, and fault feature recognition is difficult, so the fault diagnosis accuracy is difficult to meet the expected requirements. To solve this problem, this paper proposes a gearbox fault diagnosis method based on an optimized stacked denoising auto encoder (SDAE) and kernel extreme learning machine (KELM). Firstly, the Particle Swarm Optimization algorithm in Adaptive Weight (SAPSO) was adopted to optimize the SDAE network structure, and the number of hidden layer nodes, learning rate, noise addition ratio and iteration times were adaptively obtained to make SDAE obtain the best network structure. Then, the best SDAE network structure was used to extract the deep feature information of weak faults in the original signal. Finally, the extracted fault features are fed into KELM for fault classification. Experimental results show that, compared with existing commonly used methods of fault diagnosis, the fault diagnosis model proposed in this paper can reduce the influence of noise in the original signal can better learn the deep-level features in the original signal and has higher diagnosis accuracy, faster diagnosis speed and good generalization in fault diagnosis.

Diesel engines, as power equipment, are widely used in the fields of automobile industry, ship and power equipment. Due to wear or faulty adjustment, the valve train clearance abnormal fault is a typical failure of diesel engines, which may result in the performance degradation, even valve fracture and cylinder hit fault. However, the failure mechanism features mainly in time domain and angular domain, on which the current diagnosis methods based, are easily affected by working conditions or hard to extract accurate enough, as the diesel engine keeps running in transient and non-stationary process. This work arms at diagnosing this fault mainly based on frequency band features which would change when the valve clearance fault occurs. For the purpose of extracting a series of frequency band features adaptively，a decomposition technique based on improved variational mode decomposition is investigated in this work. As the connection between the features and the fault is fuzzy, the random forest algorithm is used to analyze the correspondence between features and faults. In addition, the feature dimension is reduced to improve the operation efficiency according to importance score. The experimental results under variable speed condition show that the method based on variational mode decomposition and random forest is capable to detect valve clearance fault effectively.

In recent years, intelligent fault diagnosis algorithms using deep learning method have achieved much success. However, the signals collected by sensors contain a lot of noise, which will have a great impact on the accuracy of the diagnostic model. To address this problem, we propose a one-dimensional convolutional neural network with multi-scale kernels (MSK-1DCNN) and apply this method to bearing fault diagnosis. We use a multi-scale convolution structure to extract different fault features in the original signal, and use the ELU activation function instead of the ReLU function in the multi-scale convolution structure to improve the anti-noise ability of MSK-1DCNN; then we use the training set with pepper noise to train the network to suppress overfitting. We use the Western Reserve University bearing data to verify the effectiveness of the algorithm and compare it with other fault diagnosis algorithms. Experimental results show that the improvements we proposed have effectively improved the diagnosis performers of MSK-1DCNN under strong noise and the diagnosis accuracy is higher than other comparison algorithms.

Anomaly occurrences in hydraulic machinery may lead to massive systems shut down, jeopardizing the safety of the machinery and its surrounding human operator(s) and environment, and the severe economic implications succeeding the faults and their associated damage. Hydraulics are mostly placed in ruthless environments, where they are consistently vulnerable to many faults. Hence, not only the machines and their components are prone to anomalies, but also the sensors attached to them, which monitor and report their health and behavioral changes. In this work, a comprehensive applicational analysis of anomalies in hydraulic systems extracted from a hydraulic test rig is thoroughly achieved. Firstly, we provided a combination of a new architecture of LSTM autoencoders and supervised machine and deep learning methodologies to perform two separate stages of fault detection and diagnosis. The two phases are condensed by: the detection phase using the LSTM autoencoder. Followed by the fault diagnosis phase represented by the classification schema. The previously mentioned framework is applied to both component and sensor faults in hydraulic systems, deployed in the form of two in-depth applicational experiments. Moreover, a thorough literature review of the past decade related work for the two stages separately is successfully conducted in this paper.

The stator winding insulation system is the most critical and weak part of the EMU's (electric multiple unit) traction motor. The effective diagnosis for stator ITSC (inter-turn short-circuit) faults can prevent the fault from expanding into phase-to-phase or ground short-circuits. The TCU(traction control unit) controls the traction inverter to output SPWM (sine pulse width modulation) excitation voltage when the traction motor is stationary. Three ITSC fault diagnostic conditions are based on different IGBTs control logic. The Goertzel algorithm is used to calculate the fundamental current amplitude difference Δi and phase angle difference Δθ of equivalent parallel windings under the three diagnostic conditions. The six parameters under the three diagnostic conditions are used as features to establish an ITSC fault diagnostic model based on random forest. The proposed method was validated using a simulation experimental platform for ITSC fault diagnosis of EMU traction motors. The experimental results indicate that the current amplitude features Δi and phase angle features Δθ change obviously with the increase of ITSC fault extent if the ITSC fault occurs at the equivalent parallel windings. The accuracy of the ITSC fault diagnosis model based on the random forest for ITSC fault detection and location both in train and test samples are 100%.

: Microplastics and nanoplastics (MNPs) are becoming an increasingly severe global problem due to their widespread distribution and complex impact on living organisms. Apart from their environmental impact, the effects of MNPs on living organisms have also continued to attract attention. The harmful impact of MNPs has been extensively documented in marine invertebrates and larger marine vertebrates like fish. However, the research on the toxicity of these particles on mammals is still limited, and their possible effects on humans are poorly understood. Considering that MNPs are commonly found in food or food packaging, humans are primarily exposed to them through ingestion. It would be valuable to investigate the potential harmful effects of these particles on gut health. This review focuses on recent research exploring the toxicological impacts of micro- and nanoplastics on the gut, as observed in human cell lines and mammalian models. Available data from various studies indicate that the accumulation of MNPs in mammalian models and human cells may result in adverse consequences, in terms of epithelial toxicity, immune toxicity, and disruption of gut microbiota. The paper also discusses the current research limitations and prospects in this field, aiming to provide a scientific basis and reference for further studies on the toxic mechanisms of micro- and nanoplastics.

Few-shot object detection (FSOD) aims to address the challenge of requiring a substantial amount of annotations for training in conventional object detection, which is very labor-intensive. However, existing few-shot methods achieve high precision with the sacrifice of time-consuming for exhaustive fine-tuning, or take poor performance in novel-class adaptation. We presume the major reason is that the valuable correlation feature among different categories is insufficiently exploited, hindering the generalization of knowledge from base to novel categories for object detection. In this paper, we propose Few-Shot object detection via Correlation-RPN and Transformer Encoder-Decoder (CRTED), a novel training network to learn object-relevant features of inter-class correlation and intra-class compactness while suppressing object-agnostic features in the background with limited annotated samples. And we also introduce a 4-way tuple-contrast training strategy to positively activate the training progress of our object detector. Experiments over two few-shot benchmarks (Pascal VOC, MS-COCO) demonstrate that, our proposed CRTED without further fine-tuning can achieve comparable performance with current state-of-the-art fine-tuned works. The codes and pre-trained models will be released.

In order to solve the problem of fault diagnosis for CNC machine feed system under the condition of variable speed conditions, an intelligent fault diagnosis method based on multi-domain feature extraction and ensemble learning model is proposed. First, various monitoring signals including vibration signal, noise signal and current signal are collected. Then, the monitoring signals are preprocessed and the time-domain, frequency-domain and time-frequency domain feature indexes are extracted to construct a multi-dimensional mixed domain feature set. Finally, the feature set is putting into the constructed DoubleEnsemble-LightGBM model to realize the fault diagnosis of the feed system. The experimental results show that the model can achieve good diagnosis results under different working conditions for both the public data set and the feed system test bench data set, and the average overall accuracy is 91.07% and 98.06% respectively. Compared with XGBoost and other advanced ensemble learning models, the method has better accuracy. It provides technical support for the stable operation and intelligent of CNC machine tools..

The vibration signal of heavy gearbox presents non-stationary and nonlinear characteristics, which increases the difficulty to extract the fault feature. When the gear has a subtle fault, it may cause a perceptible change of local fluctuation rather than the large scale fluctuation. Therefore, the feature parameters extracted from local fluctuation can effectively improve the recognition performance of the gear fault. In this paper, a novel signal processing method based on variational mode decomposition (VMD) and detrended fluctuation analysis (DFA) is proposed to identify the gear fault of heavy gearbox. Firstly, the raw vibration signal is decomposed several mode components by VMD, which is an adaptive and non-recursive signal decomposition method. Next, the sensitive mode component is selected by a maximal indicator, which is composed of kurtosis and correlation coefficient of relative higher frequency mode components corresponding to local fluctuation of raw vibration signal. Finally, the characteristics of the double-scales feature parameters of selected sensitive mode are extracted by DFA. In addition, the position of turning point of double scales is estimated by sliding windowing algorithm. The proposed method is evaluated through its application to gear fault classification using vibration signal. The results demonstrates that the recognization rate of gear faults condition have marked improvement by proposed method than the DFA of Small Time Scale (STS-DFA) method.

Classifying network flow subsequences in an Industrial IoT gateway is an effective method for identifying Industrial IoT faults. This paper proposes a subsequence classification algorithm SSGBUL-IKNN based on unsupervised learning encoding to address the problem of low classification accuracy. Firstly, we built a network module based on unsupervised learning to encode the flow sequence of the Industrial IoT gateway. In the encoding module, a subsequence calibration algorithm controls the increasing error during the coding process. Then, the specific fault type is obtained through an improved KNN classification algorithm based on the indication distance source from the integrated coding sequences converted by multi-dimensional network flow sequences. The test result on three Industrial IoT datasets of a sewage treatment plant shows that the accuracy of SSGBUL-IKNN in this paper exceeds 92%, significantly higher than the algorithm DTW and TSF. It reaches the classification requirements of Industrial IoT fault diagnosis.

Due to the complex underground environment, pumping machines are prone to produce numerous failures. The indicator diagrams of faults are similar in a certain degree, which produces indistinguishable samples. As the samples increases, manual diagnosis becomes difficult, which decreases the accuracy of fault diagnosis. For accurately and quickly judging the fault type, we propose an improved adaptive activation function and apply it to five types of neural networks. The adaptive activation function improves the negative semi-axis slope of the ReLU activation function by combining the gated channel conversion unit to improve the performance of the deep learning model. The proposed adaptive activation function is compared with the traditional activation function through the fault diagnosis data set and the public data set. The results show that the activation function has better nonlinearity, can improve the generalization performance of deep learning model, the accuracy of fault diagnosis. In addition, the proposed adaptive activation function can also be well embedded in other neural networks.

To address the problem of limited fault diagnosis accuracy in oil-immersed on-load tap changers (OLTC), this paper introduces a novel fault diagnosis method that combines the analysis of mechanical vibration signals and high-frequency current signals. The proposed approach aims to enhance the accuracy of fault diagnosis. To begin, an experimental platform is constructed to simulate the OLTC contact. Mechanical vibration signals and high-frequency current signals are collected from the testing platform under various operating states. These signals are then subjected to wavelet packet transform for denoising, followed by correlation analysis to capture the relationship between signals in different states. Based on these preliminary steps, the features of the signals are extracted and analyzed using ensemble empirical mode decomposition and the Hilbert-Huang transform. Subsequently, a support vector machine (SVM) is employed to analyze both the mechanical vibration signal and high-frequency current signal, enabling the classification of the OLTC contact state. The results demonstrate that the combination of characteristic analysis of mechanical vibration signals and high-frequency current signals provides a more comprehensive reflection of the actual OLTC contact state under different conditions. Through the SVM classification, the error between the predicted values and real values of the two types of signals remains below 10%, validating the efficiency and feasibility of the proposed method for fault diagnosis of OLTC contacts. These research findings serve as a reliable foundation for the diagnosis of operational states of on-site oil-immersed on-load tap changers, offering valuable insights for practical applications.

In this study we used a non-autonomous Chua’s Circuit, and the fractional Lorenz chaos system together with a detection method from Extension theory to analyze the voltage signals. The measured bearing signals by acceleration sensor were introduced into the master and slave systems through a Chua’s Circuit. In a chaotic system minor differences can cause significant changes that generate dynamic errors, and extension matter-element models can be used to judge the bearing conditions. Extension theory can be used to establish classical and sectional domains using the dynamic errors of the fault conditions. The results obtained were compared with those from Discrete Fourier Transform analysis, Wavelet analysis and an integer order chaos system. The diagnostic ratio showed the fractional order master and slave chaos system calculations. The results show that the method presented in this paper is very suitable for monitoring the operational state of ball bearing system to be superior to the other methods. The diagnosis ratio was better and there were other significant advantages such as low cost and few.

The aim of this paper is to introduce a new methodology for the fault diagnosis of induction machines working in transient regime, when time-frequency analysis tools are used. The proposed method relies on the use of the optimized Slepian window for performing the short time Fourier transform (STFT) of the stator current signal. It is shown that for a given sequence length of finite duration the Slepian window has the maximum concentration of energy, greater than can be reached with a gated Gaussian window, which is usually used as analysis window. In this paper the use and optimization of the Slepian window for fault diagnosis of induction machines is theoretically introduced and experimentally validated through the test of a 3.15 MW induction motor with broken bars during the start-up transient. The theoretical analysis and the experimental results show that the use of the Slepian window can highlight the fault components in the current's spectrogram with a significant reduction of the required computational resources.

Bearings are widely used in various types of electrical machinery and equipment. As their core components, failures will often cause serious consequences . At present, most methods of parameter adjustment are still manual adjustment of parameters. This adjustment method is susceptible to prior knowledge and easy to fall into the local optimal solution, failing to obtain the global optimal solution and requires a lot of resources.Therefore, this paper proposes a new method of bearing fault diagnosis based on wavelet packet transform and convolutional neural network optimized by simulated annealing algorithm.The experimental results show that the method proposed in this paper has a more accurate effect in feature extraction and fault classification compared with traditional bearing fault diagnosis methods. At the same time, compared with the traditional artificial neural network parameter adjustment, this paper introduces the simulated annealing algorithm to automatically adjust the parameters of the neural network, thereby obtaining an adaptive bearing fault diagnosis method. To verify the effectiveness of the method, the Case Western Reserve University bearing database was used for testing, and the traditional intelligent bearing fault diagnosis method was compared. The results show that the method proposed in this paper has good results in bearing fault diagnosis. Provides a new way of thinking in the field of bearing fault diagnosis in parameter adjustment and fault classification algorithms

The power converter is the significant device in a wind power system. Wind turbine will be shut down and off grid immediately with the occurrence of the IGBT module open-circuit fault of power converter, which will seriously impact the stability of grid and even threaten personal safety. However, in the existing diagnosis strategies of power converter, there are few single and double IGBT modules open-circuit fault diagnosis methods producing negative results including erroneous judgment, omissive judgment and low accuracy. In this paper, a novel method to diagnose the single and double IGBT modules open-circuit faults of the permanent magnet synchronous generator (PMSG) wind turbine grid-side converter (GSC) is proposed. Above all, collecting the three-phase current varying with wind speed of 22 failure states including a normal state of PMSG wind turbine GSC as the original signal data. Afterward, the original signal data are decomposed by using variational mode decomposition (VMD) to obtain the mode coefficient series, which are analyzed by the proposed method base on fault trend feature for extracting the trend feature vectors. Finally, the trend feature vectors are used as the input of deep belief network (DBN) for decision-making and obtaining the classification results. The simulation and experimental results show that the proposed method can diagnose the single and double IGBT modules open-circuit faults of GSC, and the accuracy is higher than the benchmark models.

Abstract: The EMU(electric multiple units) traction motors are powered by converters. The PWM(pulse width modulation) voltage increases the voltage stress borne by the motor insulation system, making the ITSC(inter-turn short-circuit) fault more prominent. An index based on short-circuit thermal power was proposed in the article to evaluate the non-metallic ITSC faults degree. The apFFT(all phase FFT) time-shift phase difference correction with double Hanning-windows is used to calculate the fundamental frequency of the traction motor's ZSVC（zero se-quence voltage component）, the fundamental amplitudes of ZSVC and three-phase current. The five parameters are used as fault features to train the SVM (support vector machine)fault diagnosis model. The SVM hyper-parameters C and g are optimized by K-CV (K fold cross-validation) and grid search methods. The experimental verification was carried out by the EMU electric traction simulation experimental platform. According to the non-metallic degree index proposed in this article, the experimental samples were divided into three categories, normal, incipient and serious fault samples. The ITSC fault diagnosis accuracy was 100% on the training data set and 93.33 % on the test data set. There was no misclassification between normal and serious ITSC fault samples.

Compared with conventional methods of fault diagnosis for power transformers, which have defects such as imperfect encoding and too absolute encoding boundaries, this paper systematically discusses various intelligent approaches applied in fault diagnosis and decision making for large oil-immersed power transformers based on dissolved gas analysis (DGA), including expert system (EPS), artificial neural network (ANN), fuzzy theory, rough sets theory (RST), grey system theory (GST), swarm intelligence (SI) algorithms, data mining technology, machine learning (ML), and other intelligent diagnosis tools, and summarizes existing problems and solutions. From this survey, it is found that a single intelligent approach for fault diagnosis can only reflect operation status of the transformer in one particular aspect, causing various degrees of shortcomings that cannot be resolved effectively. Combined with the current research status in this field, the problems that must be addressed in DGA-based transformer fault diagnosis are identified, and the prospects for future development trends and research directions are outlined. This contribution presents a detailed and systematic survey on various intelligent approaches to faults diagnosing and decisions making of the power transformer, in which their merits and demerits are thoroughly investigated, as well as their improvement schemes and future development trends are proposed. Moreover, this paper concludes that a variety of intelligent algorithms should be combined for mutual complementation to form a hybrid fault diagnosis network, such that avoiding these algorithms falling into a local optimum. Moreover, it is necessary to improve the detection instruments so as to acquire reasonable characteristic gas data samples. The research summary, empirical generalization and analysis of predicament in this paper provide some thoughts and suggestions for the research of complex power grid in the new environment, as well as references and guidance for researchers to choose optimal approach to achieve DGA-based fault diagnosis and decision of the large oil-immersed power transformers in preventive electrical tests.

Single-phase-to-ground fault in non-effectively grounded systems poses serious public safety concern. Along with increasing deployment of low-voltage (LV) sensors, new opportunities and ways are created for solving this traditional problem in distribution systems. A new approach, identifying primary single-phase-to-ground line fault and locating it through measurement data from smart sensors deployed in the secondary side of distribution transformers, is proposed in this paper. When a fault occurs in primary distribution feeder, the transient aerial mode voltage (AMV) of each LV smart sensor is calculated. The fault line can be identified by an abrupt change value of AMV at LV side. Next, by finding the position of the maximum value of this AMV from LV sensors on the fault line, the fault location can be pinpointed to two neighboring distribution transformers. The proposed method has been proven to be efficient and reliable by simulation studies.

Although ovarian cystic teratoma is the most common ovarian tumor, complications are quite rare. However, it is important to be recognized by the radiologist in order to avoid inaccurately diagnosing them as malignant lesions. This case report describes a 61-year-old postmenopausal woman, who presented to the emergency room with abdominal pain following a minor blunt abdominal trauma. In this context, a CT scan was performed, which showed the presence of round, hypodense masses randomly distributed in the peritoneum, with coexisting ascites in moderate amount; ovarian carcinoma with peritoneal carcinomatosis was suspected. The patient was hospitalized and an MRI of the abdomen and pelvis was recommended for a more detailed lesion characterization. Following this examination, the patient was diagnosed with mature cystic ovarian teratoma complicated by rupture. Surgery was performed, and the outcome was favorable. The cases of ruptured cystic teratomas are rare, and to our knowledge, this is the first occurrence described in literature. Special attention must be paid when confronting with such a case in medical practice, since it can easily misdiagnosed as peritoneal carcinomatosis

The Sanaga River Valley is a deep-seated structure of about 220 km in width, bounded on its northern and southern sides by 025-0550 fault zones. Its internal structure has been very little described before this study. It is characterized by the presence of surface features where a thick stratum of shale and argillaceous sandstones have been documented. The use of electrical resistivity tomography for near-surface imaging and hydrogeological prospecting within shale succession is widespread. However, several methods of spatial modeling of resistivity contours are generally proposed for the interpretation of inverse resistivity model sections. To determine the most appropriate method for interpreting resistivity tomographies in the context of subsoil marked by significant heterogeneity, logarithmic contour intervals, and linear contour interval processing were implemented on data collected over five areas. The data consists of outcrops data, cuttings samples from groundwater boreholes, and resistivity sections ranging in length from 240 to 1000 m. Well-control of the inverse resistivity model sections derived from both processes shows that the linear contour intervals modeling gives a more realistic picture of the reservoir size of the wa-ter-bearing sand in both shale and argillaceous sandstone succession. The sedimentary architecture over Sanaga fault breccia is marked by vertical intrusion anomalies up to 80 m high. The shape of these anomalies, as well as the very low resistivity values that characterize them, suggests that they could be related to mud intrusion.

The Eastern Kunlun Fault Zone (EKFZ) is located in a seismic blank area. This study investigates the hydrogeochemical characteristics of varied-temperature springs in the EKFZ to understand the relationship between fractures, fluids and earthquakes. It aids in establishing their induction mechanisms and assists in monitoring the earthquake precursors of the EKFZ. In this study, the main elements, trace elements, hydrogen and oxygen isotopes and strontium isotopes of 23 varied-temperature springs in the EKFZ were analyzed. The results reveal the source of groundwater recharge, hydrochemical types, mineral saturation, and for a select few springs indicative of geothermal activity, collected geothermal reservoir temperatures. The study also explores the relationship between earthquakes and springs, identifying sensitive chemical indicators. Based on continuous monitoring at Maqu Station, we found that before the occurrence of the Maerkang Ms 6.0 earthquake, the concentration of Cl− rose by 2.9 times, and 46 days before the Gande earthquake (Ms = 4.7), the concentrations of Na+ and SO42− significantly increased. Finally, a conceptual model of the hydrogeochemistry of springs is presented to describe the groundwater circulation in the study area. This research is of great significance for the analysis of fluid geochemistry in this area and for assessing the seismic hazards of the EKFZ.

In patients with primary central nervous system lymphoma (PCNSL), the choice of surgical strategy for histopathologic assessment is still controversial, particularly in terms of preoperative corticosteroid (CS) therapy. To provide further evidence for clinical decision-making, we retrospectively analyzed data from 148 consecutive patients who underwent surgery at our institution. Although patients treated with corticosteroids preoperatively were significantly more likely to require a second or third biopsy (p=0.049), it was only necessary in less than 10% of the cases with preoperative corticosteroid treatment. The choice of surgical procedure did not affect diagnostic accuracy (p>0.05). Preoperative CSF sampling did not provide additional information but was associated with delayed surgery (p=0.02). Surprisingly, diagnostic accuracy was significantly lower when patients were treated with anticoagulation or dual antiplatelet therapy (p=0.015). In conclusion, preoperative CS therapy can challenge the histological diagnosis of PCNSL. At the same time, our data suggest that preoperative CS treatment only presents a relative contraindication for an early surgical intervention. The standard surgical approach is stereotactic biopsy, but other approaches can be individually considered. If a definitive diagnosis cannot be made after the first surgical intervention, the timing of a repeat biopsy after discontinuation of CS remains a case-by-case decision.

HIV early detection (CD4 counts ≥350 cells/μL) is correlated with higher life expectancy among people living with HIV (PLHIV). Several factors including physical, cultural, structural, and financial barriers have contributed to HIV late detection. This is the first-of-its-kind study on the regional differences in early detection of HIV within Tajikistan and any country in the Central Asia region. Utilizing Tajikistan Ministry of Health's national HIV data (N=10,700) spanning 2010 to 2023, we developed median regression models with median CD4 cell count as the outcome and as predictors: time (years), region, age, gender, and area (urban/rural status). Individuals younger than 19 years old are more likely to be detected early for HIV, whereas those older than 39 years are more prone to late detection. Given their active engagement in age-related and sexual activities, those older than 39 years face a higher risk of HIV transmission to others if diagnosed late. Therefore, they require further attention and targeted interventions. Females are detected earlier compared to their male counterparts, regardless of region of residence. Rural populations are detected earlier in most years compared to their urban counterparts. The COVID-19 pandemic accelerated HIV early detection in 2021 but most regions have returned to near pre-pandemic levels of detection in 2022 and 2023. These fluctuations in early detection may signify a shift in attention and resource allocation, potentially affecting efforts to address access gaps during the initial year of the COVID-19 pandemic. There are significant health inequities among different demographic and geographic groups which warrant further attention.

Background: Microscopic examination of acid-fast stained sputum smears for detecting mycobacterial acid-fast bacilli (AFB) remains the most economical and readily available method for laboratory diagnosis of tuberculosis (TB). However, this conventional approach has limitations, including low sensitivity and labor-intensive procedures. Methods: An automated microscopy system incorporating artificial intelligence (AI) and machine learning for AFB identification was evaluated. The study was conducted at an Infectious Disease Hospital in Jiangsu Province, China, utilizing an intelligent microscope system (TB-Scan, Wellgen Medical, Kaohsiung). A total of 1,000 sputum smears were included in the analysis, with the system capturing digital microscopic images and employing an image recognition model to automatically identify and classify AFB. Referee technicians provided the gold standard for discrepant results. Results: The automated system demonstrated an overall accuracy of 95.00% (950/1,000), sensitivity of 91.24% (177/194), and specificity of 95.91% (773/806). Notably, the system identified 21 smears as positive that were previously reported as negative, with referee technicians confirming 17 of these as true positive and retracting the test results accordingly. Recalculating the performance, the accuracy increased to 96.70% (967/1,000), sensitivity to 91.94% (194/211), and specificity to 97.97% (773/789), with a false negative rate of 8.06% (17/211) and a false positive rate of 2.03% (16/789). Conclusions: The incorporation of AI and machine learning into an automated microscopy system demonstrated the potential to enhance the sensitivity and efficiency of AFB detection in sputum smears compared to conventional manual microscopy. This approach holds promise for widespread application in TB diagnostics and potentially other fields requiring labor-intensive microscopic examination.

Aim: To investigate inflammation indices and erythropoietin (EPO) levels for their potential role in distinguishing polycythemia vera (PV) from secondary polycythemia (SP), and to compare different parameter combinations in terms of diagnostic accuracy. Methods: This retrospective cohort was created from patients assessed for polycythemia from January 2020 to December 2023. PV diagnosis was made according to the 2016 WHO criteria (n=145). Those who did not fulfill the criteria were defined as having SP (n=84). Results: NLR, PLR and SII were significantly higher in the PV group (p

Tumid Lupus Erythematosus has been the subject of heated debate as to its correct nosographic classification. In particular, its definition has changed over time, depending on the different studies performed. In this review we address the initial definition of TLE, the changes that have taken place in the understanding and placement within the classification of Lupus Erythematosus (LE), and focus on clinical, histopathological, immunophenotypical and differential diagnosis aspects.

In the conservation of monumental heritage, the collection and utilization of information are of primary importance. The Heritage Building Information Modeling (HBIM) procedure harnesses the potential of three-dimensional models, offering significant advantages in accessing documentation, interoperability, multidimensionality of intervention design, cost evaluation and maintenance management. Attention here is focused on the Certosa di Pisa, a large historical complex built in the 14th century as a monastery of the Carthusian order, currently in a state of deterioration and in need of restoration and re-functionalization. The multifaceted nature of this monumental complex, with its intricate interplay of architectural elements spanning different historical periods and featuring diverse techniques, poses a significant challenge for structural safety assessment. This case study presents an opportunity to explore an HBIM approach to streamline the diagnostic process and facilitate the intervention design phase. The goal is achieved by utilizing an accurate 3D model enriched with data from multiple sources and automating certain operations for structural assessment. The usefulness of the HBIM methodology is highlighted as a valuable tool in the realm of Cultural Heritage structures for both technicians and scholars alike.

Neural decoding from spiking activity is an essential tool for understanding the information encoded in population neurons, especially in applications like brain-computer interface (BCI). Various quantitative methods have been proposed and have shown superiorities under different scenarios respectively. From the machine learning perspective, the decoding task is to map the high-dimensional spatial & temporal neuronal activity to the low-dimensional physical quantities (e.g., velocity, position). Because of the complex interactions and the abundant dynamics among neural circuits, good decoding algorithms usually have the capability of capturing flexible spatiotemporal structures embedded in the input feature space. Recently, the Transformer-based models are widely used in processing natural languages and images due to its superior performances in handling long-range and global dependencies. Hence, in this work we examine the potential applications of Transformers in neural decoding and introduce two Transformer-based models. Besides adapting the Transformer to neuronal data, we also propose a data augmentation method for overcoming the data shortage issue. We test our models on three experimental datasets and their performances are comparable to the previous state-of-the-art (SOTA) RNN-based methods. In addition, Transformer-based models show increased decoding performances when the input sequences are longer, while LSTM-based models deteriorate quickly. Our research suggests that Transformer-based models are important additions to the existing neural decoding solutions, especially for large datasets with long temporal dependencies.

Brushless Synchronous Machines (BSM) are replacing conventional synchronous machines with static excitation in generation facilities due to the absence of sparking and lower maintenance. However, this excitation system makes challenging measuring electric parameters in the rotor. This fact highly difficult the detection of ground faults, which are the most common type of electrical fault in electric machines. In this paper, a ground fault detection method for BSM is proposed. It is based on an inductive AC/DC rotating current sensor installed in the shaft. In case of a ground fault in the rotating parts of the BSM, a fault current will flow through the rotor’s sensor, inducing voltage in its stator. Analyzing the frequency components of the induced voltage the detection of a ground fault in the rotating elements is possible. The ground faults detection method proposed covers the whole rotor and discern between DC and AC sides. To corroborate the detection method, experimental tests have been performed using a prototype of this sensor connected to laboratory synchronous machines achieving satisfactory results.

The application of artificial intelligence to point-of-care testing (POCT) disease detection has become a hot research field, in which breath detection which detects the patient's exhaled VOCs combined with sensor arrays of Convolutional Neural Network (CNN) algorithms as a new lung cancer detection is attracting more researchers' attention. However, due to low accuracy, high complexity computation and large number of parameters make the CNN algorithms difficult transplant to the embedded system of POCT devices. A lightweight neural network (LTNet) in this work is proposed to deal with this problem, and meanwhile, achieve high-precision classification of acetone and ethanol gases, which are respiratory markers for lung cancer patients. Compared to currently popular lightweight CNN models such as EfficientNet, LTNet has fewer parameters (32K) and its training weight size is only 0.155 MB. LTNet achieved an overall classification accuracy of 99.06% and 99.14% in the own mixed gas dataset and the University of California (UCI) dataset, which are both higher than that of the five existing models’, and it also offers the shortest training (844.38s and 584.67s) and inference time (23s and 14s) in the same validation set. Compared to the existing CNN models, LTNet is more suitable for resource-limited POCT devices.

The detection of Fasciola eggs in ruminant fecal samples typically occurs around 15 weeks post-infection during patent infections. The recent introduction of coproantigen ELISA (cELISA) diagnostics, which capture antigenic enzymes in fecal material, holds promise for monitoring Fasciola fecal egg count (FFEC) to implement control programs, particularly targeted treatments. This study compared two study groups, those with positive FFEC (FFEC+ve) and negative FFEC (FFEC-ve), to assess the sensitivity of Flukefinder sedimentation and a cELISA kit. This study reports that the coproantigen ELISA detection limit was 4.5 eggs per gram (epg) for a 100% positivity rate. Additionally, a moderate, statistically significant positive correlation (r²=0.716, p-value < 0.01) and an odds ratio of 1.96 (p-value < 0.01) were observed between FFEC and Fasciola coproantigen from cELISA. This implies that for every single unit increase in FFEC, there is a 96% likelihood of obtaining a higher optical density (OD) reading from the cELISA test. The results suggest that cELISA can complement fecal sedimentation tests, serving as a valuable tool for detecting cattle with high FFEC. This capability facilitates targeted treatment strategies, thereby aiding in the control and prevention of the spread of fasciolosis within the studied area.

Background/Objectives: Vitamin B12 deficiency can cause variable symptoms, which may be irreversible if not diagnosed and treated in a timely manner. We aimed to develop a widely accepted expert consensus to guide the practice of diagnosing and treating B12 deficiency. Methods: We conducted a scoping review of the literature published in PubMed since January 2003. Data were used to design a two-round Delphi survey to study the level of consensus among 42 experts. Results: The panelists agreed on the need for educational and organizational changes in the current medical practices for diagnosing and treating B12 deficiency. Recognition of clinical symptoms should receive the highest priority in establishing the diagnosis. There is agreement that the serum B12 concentration is useful as a screening marker, whereas methylmalonic acid or homocysteine can support the diagnosis. Patient lifestyle, disease history and medications can provide clues to the cause of B12 deficiency. Regardless of the cause of the deficiency, initial treatment with parenteral B12 was regarded as the first choice for patients with acute and severe manifestations of B12 deficiency. The use of high-dose oral B12 at different frequencies may be considered for long-term treatment. Prophylactic B12 supplementation should be considered for specific high-risk groups. Conclusions: There is a consensus that clinical symptoms need to receive more attention in establishing a diagnosis. B12 laboratory markers can support the diagnosis. The severity of clinical symptoms, the causes of B12 deficiency and the treatment goals govern decisions regarding the route and dose of B12 therapy.

Primary ciliary dyskinesia (PCD) is an inherited disorder that impairs motile cilia, essential for respiratory health, with a reported prevalence of 1 in 16,309 within Hispanic populations. Despite having the RSPH4A [c.921+3_921+6del (intronic)] founder mutation in 70% of Puerto Rican patients, the characterization of the ciliary dysfunction remains unidentified due to the unavailability of advanced diagnostic modalities like High-Speed Video Microscopy Analysis (HSVA). Our study implemented HSVA for the first time on the island as a tool to better diagnose and characterize the RSPH4A [c.921+3_921+6del (intronic)] founder mutation in Puerto Rican patients. By applying HSVA, we analyzed the ciliary beat frequency (CBF) and pattern (CBP) in native Puerto Rican patients with PCD. Our results showed decreased CBF and a rotational CBP linked to the RSPH4A founder mutation in Puerto Ricans, presenting a novel diagnostic marker that could be implemented as an axillary test into the PCD diagnosis algorithm in Puerto Rico. The integration of HSVA technology in Puerto Rico substantially enhances the framework for PCD evaluation and diagnosis, facilitating prompt detection and early intervention for improved disease management. This initiative, demonstrating the potential of HSVA as an adjunctive test within the PCD diagnostic algorithm, could serve as a blueprint for analogous developments throughout Latin America.

Obtaining a genetic diagnosis of a primary mitochondrial disease (PMD) is often framed as a diagnostic odyssey. Yet, even after receiving a diagnosis, parents of affected children experience ongoing therapeutic and prognostic uncertainty, and considerable psychosocial challenges. Semi-structured interviews (N= 24) were conducted with parents of 13 children (aged 2-19 years) with a genetically confirmed PMD. Paternal (N=11) and maternal (N=13) perspectives were obtained, and thematic analysis performed on all interviews. A genetic diagnosis was valuable and empowering for parents, despite eliciting varied emotional responses. While the diagnosis helped focus management decisions, families often felt overwhelmed and unsupported in navigating the healthcare system. Most parents reported a serious impact on their romantic relationship. The sources of social support varied with a preference for established friendship and family support networks over disease-specific community support groups. Most parents favored prenatal genetic testing in the event of a future pregnancy. This study provides insight into the lived experiences of parents after a genetic diagnosis of PMD in their children. The findings draw awareness to supportive care needs and highlight important gaps that should be addressed to ensure that parents feel supported within a holistic framework of management for PMDs.

In this paper, we introduce Syntax-Enhanced Transformer Model (SET), a groundbreaking approach in the realm of Transformer-based language modeling that seeks to redefine the boundaries of linguistic analysis and comprehension. SET innovatively combine (i) the well-established high-level performance, scalability, and adaptability of traditional Transformers with (ii) a sophisticated analysis of syntactic structures. This synergy is enabled by a novel attention mechanism tailored to parse syntactic nuances and a deterministic process adept at transforming linearized parse trees into meaningful linguistic representations. Our comprehensive experiments reveal that SET significantly advance the field by surpassing existing benchmarks in sentence-level language modeling perplexity. They exhibit exceptional proficiency in tasks that require an acute awareness of syntax, setting new standards for language models in understanding complex linguistic structures. Furthermore, SET demonstrate an enhanced capability to grasp nuanced linguistic patterns that have traditionally been challenging for standard Transformer models. However, our studies also uncover a unique aspect of SET: while they excel in sentence-level tasks, their representation of sentences as singular vectors—owing to the syntactic composition constraints intrinsic to their design—introduces certain limitations in document-level language modeling. This observation points to an intriguing area for future exploration; it suggests the potential need for an alternative or complementary memory mechanism within Transformer models, one that functions independently from, yet in harmony with, syntactic structures. Such a mechanism could be pivotal in enhancing the model's ability to comprehend and process long-form texts effectively. In conclusion, SET mark a significant stride in the journey towards more sophisticated, syntax-aware language models. They offer promising insights into the integration of deep linguistic knowledge with cutting-edge machine learning techniques, potentially opening doors to a new era of natural language understanding and processing.

The evolution of sentence representation learning, especially with parse tree encoders, has shown remarkable progress. Traditional approaches predominantly rely on recursive encoding of tree structures, which impedes parallel processing capabilities. Additionally, these methods often overlook the significance of dependency tree arc labels. To overcome these limitations, we introduce the Syntax-Enhanced Transformer (SET), incorporating a novel dual-attention mechanism that integrates relation-focused attention alongside traditional self-attention. This design effectively encodes both dependency and spatial positional relationships within sentence dependency trees. Our approach innovatively incorporates syntactic information into the Transformer framework without compromising its inherent parallelizability. The SET demonstrates superior or comparable performance to contemporary methods across various sentence representation tasks, significantly enhancing computational efficiency.

Recent advancements in neural language models, particularly attention-based architectures like the Transformer, have substantially surpassed traditional methods in various natural language processing tasks. These models adeptly generate nuanced token representations by considering contextual relations within a sequence. However, augmenting these models with explicit syntactic knowledge, such as part of speech tags, has been found to remarkably bolster their effectiveness, especially under constrained data scenarios. This study introduces the Linguistic Enhanced Transformer (LET), which integrates multiple syntactic features, showing a notable increase in translation accuracy, evidenced by an improvement of up to 1.99 BLEU points on subsets of the WMT '14 English-German dataset. Furthermore, this paper demonstrates that enriching BERT models with syntax-aware embeddings enhances their performance on several GLUE benchmark tasks.

Dynamic virtual testing by Hardware in the Loop (HIL) real time simulation systems is common to minimize physical tests to validate and verify control algorithms, logics and software, under normal and emergency conditions. The accurate but costly HIL models setup activities could have an extended use to simulate faulty conditions that are seldom observable in the real system, yet they must be detected in advance and recognized. Data driven diagnostic methods have reached a mature development, in various sectors, proving effective in early detecting slowly varying deviations from nominal patterns of signals, even without a priori knowledge of their nature and behavior. These methods rely on vast amount of data logged from real systems that are ever and ever richer of monitoring telemetries that are worth being exploited. However, due to the usually reliable and safe systems being managed, it is often difficult to collect enough data on anomalous situations to validate fault detection and isolation and limit false positives. HIL model-based simulations allow generating and observing operational domains or transients rarely observed in real operations. This allows identifying the signals that are most correlated to faults and that could be selected to setup data-based diagnostic models of parts or subsystems, which are more suitable than the whole HIL model for online diagnostics, as well as to identify the features and trends that are most symptomatic of anomalous conditions.

Time series forecasting has been a challenging area in the field of Artificial Intel-ligence. Various approaches such as linear Neural Networks, Recurrent Linear Neural Networks, Convolutional Neural Networks and recently Transformers have been attempted for the time series forecasting domain. Although, Trans-former-based architectures have been outstanding in the Natural Language Pro-cessing domain, especially in autoregressive language modeling, the initial at-tempts to use transformers in the time series arena have met with mixed success. One of the recent papers demonstrated that modeling the multi-variate time se-ries problem as independent channels on a transformer architecture produced lower mean square and mean absolute errors on benchmarks, however, another recent paper claimed that a simple linear neural network out-performs previous approaches including transformer-based designs. We investigate this paradox in detail comparing the linear Neural Network and Transformer based designs, provide insights to why a certain approach may be better for a particular type of problem. We also improve upon the recently proposed simple linear Neural Network based architecture by using dual pipelines with batch normalization and reversible instance normalization. Our enhanced architecture outperforms all existing architectures for time series forecasting on majority of the popular benchmarks.

Multispectral image (MSI) and hyperspectral image (HSI) fusion (MHIF) aims to address the challenge of acquiring high-resolution (HR) HSI images. This field combines a low-resolution (LR) HSI with an HR-MSI to reconstruct HR-HSI. Existing methods directly utilize transformers to perform feature extraction and fusion. Despite the demonstrated success, there exist two limitations: 1) Employing the entire transformer model for feature extraction and fusion fails to fully harness the transformer’s potential in integrating the spectral of the HSI and spatial information of the MSI. 2) HSI has a strong spectral correlation and exhibits sparsity in the spatial domain. Existing transformer-based models do not optimize this physical property, which makes their methods prone to spectral distortion. To accomplish these issues, this paper introduces a novel framework for MHIF called Sparse Mix-Attention Transformer (SAMformer). Specifically, to fully harness the advantages of the Transformer architecture, we propose a Spectral Mix Attention Block (SMAB), which concatenates the keys and values extracted from LR-HSI and HR-MSI to create a new multi-head attention module. This design facilitates the extraction of detailed long-range information across spatial and spectral dimensions. Besides, to address the spatial sparsity inherent in HSI, we incorporated a sparse mechanism within the core of SMAB called Sparse Spectral Mix Attention Block (SSMAB). In the SSMAB, we compute attention maps from queries and keys and select the K highly correlated values as the sparse attention map. This approach enables us to achieve a sparse representation of spatial information while eliminating spatially disruptive noise. Extensive experiments conducted on three benchmark datasets, namely Cave, Harvard, and Pavia Center, demonstrate the SMAformer method outperforms state-of-the-art methods.

Heat transfer fluids are used in various industrial systems to maintain them in perfect operating conditions. Extensive research efforts have been dedicated to enhance the thermal properties of these heat transfer fluids to improve their efficiency. Developing nanofluids is a potential candidate for such enhancements. This study investigates the impact of incorporating TiO2 nanoparticles into two types of oils: transformer oil (NYTRO LIBRA) and virgin coconut oil (manufactured by Govi Aruna Pvt. Ltd.) at different temperatures and with varying volume fractions. The nanofluids were prepared using a two-step method by adding CTAB (Cetyltrimethylammonium bromide) surfactant. To minimize nanoparticle agglomeration, this study employed relatively low-volume fractions. Thermal properties by means of thermal conductivity, thermal diffusivity, and volumetric heat capacity were measured in accordance with ASTM (American Society for Testing and Materials) standard methods, using a multifunctional thermal conductivity meter (LAMBDA thermal conductivity meter). The measured thermal conductivity values were compared with theoretical models and previous research findings. It was confirmed that the modification of thermal properties was enhanced by doping TiO2 nanoparticles with different volume fraction.

Identification of plants is a challenging task which aims to identify the family, genus, and species level according to morphological features. Automated deep learning-based computer vision algorithms are widely used for identifying plants and can help users to narrow down the possibilities. However, numerous morphological similarities between and within species make the classification difficult. In this paper, we tested a custom convolution neural network (CNN) and vision transformer (ViT) based models using the PyTorch framework to classify plants. We used a large dataset of 88K and 16K images for classifying plants at genus and species levels respectively. Our results show that for classifying plants at the genus level, ViT models perform better compared to CNN-based models ResNet50 and ResNet-RS-420, and other state-of-the-art CNN-based models suggested in previous studies on a similar dataset. The ViT model achieved top accuracy of 83.3% for classifying plants at the genus level. ViT models also perform better for classifying plants at the species level compared to CNN-based models ResNet50 and ResNet-RS-420, with a top accuracy of 92.5%. We show that the correct set of augmentation techniques plays an important role in classification success.

This paper describes the successful application of the Transformer model used in the natural language processing and vision tasks as a means of processing the time series of signals from gyroscope and accelerometer sensors for the classification of human activities. The Transformer model is based on deep neural networks with many layers which can generalize well on signals. All measured signals come from a smartphone placed in a waist bag. Activity prediction is sequence-to-sequence, each time step of the signal is assigned a designation of the performed activity. Emphasis is placed on attention mechanisms, which express individual dependencies between signal values within a time series. In comparison with another recent result, the recognition precision was improved from 89.67 percent to 99.2 percent. The transformer model should in the future be included among the top options in machine learning methods for human activity recognition.

Agriculture is pivotal in national economies, with pest detection significantly influencing food quality and quantity. Pest classification remains challenging in automated agriculture monitoring systems, exacerbated by the non-uniform pest scales and the scarcity of high-quality datasets. In this study, we constructed a pest dataset by acquiring domain-agnostic images from the Internet and resizing them to a standardized 299x299 pixel format. Additionally, we employed diffusion models to generate supplementary data. While Convolutional Neural Networks (CNNs) are prevalent for prediction and classification, they often lack effective global information integration and discriminative feature representation. To address these limitations, we propose the RS Transformer, an innovative model that combines elements like the Region Proposal Network, Swin Transformer, and ROI Align. Additionally, we introduce the Randomly Generated Stable Diffusion Dataset (RGSDD) to augment the availability of high-quality pest datasets. Extensive experimental evaluations demonstrate the superiority of our approach compared to both two-stage models (SSD and Faster R-CNN) and one-stage models (YOLOv3, YOLOv4, YOLOv5m, YOLOv8, and DETR). We rigorously assess performance using metrics such as mean Average Precision (mAP), F1Score, Recall, and mean Detection Time (mDT). Our research contributes to advancing pest detection methodologies in automated agriculture systems, promising improved food production and quality.

It is necessary to manage the power consumption and use fault-tolerance techniques to meet high reliability in Real-Time Embedded Systems, . Hence, in recent years, this is the main reason for providing an ideal approach to decrease power consumption through the worst-case behavior of instantaneous power management (peak-power management), while observing the Thermal Design Power (TDP). Although the multi-core chips in real-time embedded systems provide great opportunity for implementation of Two-phase Triple modular redundancy to meet high reliability, the energy overhead management of concurrently executing tasks is one of the challenges facing designers. In this article, we propose a scheme named Permanent Fault Aware, Two-Phase Peak-Power Management (PFA-TP3M), for scheduling real-time tasks in multi-core systems to eliminate peak power overlap from concurrent running tasks to maintain peak power consumption at the chip TDP. and through mapping different parts of each task on separate cores, prevents consecutive conflicts on cores, which have faced permanent faults to design the fault-tolerant system. Our simulation results show that our proposed scheme provides up to 700x fault tolerance increase (630x on average) compared to the state-of-the-art power management algorithm, an achievement costs up to 14%. (average 11%) increase the length of the task graph compared to it.

We describe an interesting case report about a patient with hemophilia A with severe chronic elbow arthropathy who underwent multiple surgical because of his condition. We collected all the clinical and imaging findings, and we compared the decision-making flow chart and the surgery performed with the most recent indications, treatments and complications reported in the literature. The aim of this case report is to show how usually the hemophilic patient even if young usually comes to our attention from the beginning with complex and advance musculoskeletal disease. Elbow hemophilic arthropathy is a complex disease and the management in these patients could be more difficult than others because of the higher risk of complications rate after all surgical procedures, for this reason it’s very important to treat these patients in hub centers with expertise in well-coordinated multidisciplinary teams. The path from diagnosis to surgical treatment of hemophilic elbow arthropathy can be a risky one, as it happened in this case.

High efficiency and safety are critical factors in ensuring optimal performance and reliability of systems and equipment across various industries. Fault Monitoring (FM) techniques play a pivotal role in this regard by continuously monitoring system performance and identifying the presence of faults or abnormalities. However, traditional FM methods face limitations in fully capturing the complex interactions within a system and providing real-time monitoring capabilities. To overcome these challenges, Digital Twin (DT) technology has emerged as a promising solution to enhance existing FM practices. By creating a virtual replica or digital copy of a physical equipment or system, DT offers the potential to revolutionize fault monitoring approaches. This paper aims to explore and discuss the diverse range of predictive methods utilized in DT and their implementations in FM across industries. Furthermore, it will showcase successful implementations of DT in FM across a wide array of industries, including manufacturing, energy, transportation, and healthcare The utilization of DT in FM enables a comprehensive understanding of system behavior and performance by leveraging real-time data, advanced analytics, and machine learning algorithms. By integrating physical and virtual components, DT facilitates the monitoring and prediction of faults, providing valuable insights into the system’s health and enabling proactive maintenance and decision-making.

Blood cell analysis is a crucial diagnostic process in medical practice. In particular, detecting white blood cells (WBCs) is essential for diagnosing of many diseases. The manual screening of blood films is a time-consuming and subjective process, which can lead to inconsistencies and errors. Therefore, automated detection of blood cells can improve the accuracy and efficiency of the screening process. In this study, an explainable Vision Transformer (ViT) model was proposed for the automatic detection of WBCs from blood films. The proposed model utilizes the self-attention mechanism to extract relevant features from the input images and leverages transfer learning by incorporating pre-trained model weights to improve its performance. The proposed model achieved a classification accuracy of 99.40% for five distinct types of WBCs and exhibited potential in reducing the time required for manual screening of blood films by pathologists. Upon examination of the misclassified test samples, it was observed that incorrect predictions were correlated with the presence or absence of granules in the cell samples. To validate this observation, the dataset was divided into two classes, namely Granulocytes and Agranulocytes, and a secondary training process was conducted. The resulting ViT model trained for binary classification achieved an accuracy of 99.70%, recall of 99.54%, precision of 99.32%, and F-1 score of 99.43% during the test phase. To ensure the reliability of the ViT model's multi-class classification of WBCs, the pixel areas that the model focuses on in its predictions are visualized through the Score-CAM algorithm.

Color image binarization plays a pivotal role in image preprocessing work, significantly impacting subsequent tasks, particularly in text recognition. This paper concentrates on Document Image Binarization (DIB), aiming to separate a image into foreground (text) and background (non-text content). Through a thorough analysis of conventional and deep learning-based approaches, we conclude that prevailing DIB methods leverage deep learning technology. Furthermore, we explore the receptive fields pre- and post-network training to underscore the Transformer model's advantages. Subsequently, we introduce a lightweight model based on the U-Net structure, enhanced with the Mobile ViT module to better capture global information features in document images. Given its adeptness at learning both local and global features, our proposed model exhibits superior performance on two standard datasets (DIBCO2012 and DIBCO2017) compared to state-of-the-art methods. Notably, our proposed DIB method presents a straightforward end-to-end model devoid of additional image preprocessing or post-processing. Moreover, its parameter count is less than a quarter of the HIP'23 model, which achives best results on three datasets(DIBCO2012, DIBCO2017 and DIBCO2018). Finally, two sets of ablation experiments were conducted to verify the effectiveness of the proposed binarization model.

Estimating the Remaining Useful Life (RUL) of aircraft engines holds a pivotal role in enhancing safety, optimizing operations, and promoting sustainability, thus being a crucial component of modern aviation management. Precise RUL predictions offer valuable insights into an engine’s condition, enabling informed decisions regarding maintenance and crew scheduling. In this context, we propose a novel RUL prediction approach in this paper, harnessing the power of Bi-directional LSTM and Transformer architectures, known for their success in sequence modeling, such as natural languages. We adopt the encoder part of the full Transformer as the backbone of our framework, integrating it with a self-supervised denoising autoencoder that utilizes Bidirectional LSTM for improved feature extraction. Within our framework, a sequence of multivariate time series sensor measurements serves as the input, initially processed by the Bidirectional LSTM autoencoder to extract essential features. Subsequently, these feature values are fed into our Transformer encoder backbone for RUL prediction. Notably, our approach simultaneously trains the autoencoder and Transformer encoder, different from the naive sequential training method. Through a series of numerical experiments carried out on the C-MAPSS datasets, we demonstrate that the efficacy of our proposed models either surpasses or stands on par with that of other existing methods.

Indoor localization is an active area of research dominated by traditional machine-learning techniques. Deep learning-based systems have shown unprecedented improvements and have accomplished exceptional results over the past decade, especially the Transformer network within natural language processing (NLP) and computer vision domains. We propose the hyper-class Transformer (HyTra), an encoder-only Transformer with multiple classification heads (one per class) and learnable embeddings, to investigate the effectiveness of Transformer-based models for received signal strength (RSS) based WiFi fingerprinting. HyTra leverages learnable embeddings and the self-attention mechanism to determine the relative position of the wireless access points (WAPs) within the high-dimensional embedding space, improving the prediction of user location. From an NLP perspective, we consider a fixed order sequence of all observed WAPs as a sentence and the captured RSS value(s) for every given WAP at a given reference point from a given user as words. We test our proposed network on public and private datasets of different sizes, proving that the quality of the learned embeddings and overall accuracy improves with increments in samples.

In this research paper, a high gain transformer less inverter modeling which is used for the smart grid technology or as the stand alone for home appliances is proposed. The proposed transformer less topology provides a higher voltage gain, low cost, small size and simple control stand alone transformer less inverter for home appliances. The above inverter is modeled by using software which is known as MATLAB/ Simulimk.

The article discusses early diagnosis and intervention for developmental delays in children, emphasizing the role of specialized services and personnel in supporting recovery and development. It presents findings from a pilot project initiated in Bucharest, aiming to assess the incidence of developmental delays in children aged 1-3 years in selected kindergartens, including ASD. The study involved children, parents, and specialists, utilizing systematic behavior observation (SBO) and semi-structured interviews. Results indicate that out of 613 evaluated children, 81 received specialized control recommendations, with 4 cases showing potential risk of ASD. Additionally, 8 children were diagnosed with autism. The incidence of autism in children aged 1-3 years was 1 in 51. Although exploratory, these findings suggest a model of good practice for future early diagnosis campaigns nationally. Conclusively, the study underscores the importance of early diagnosis and intervention for developmental delays, advocating for a responsive community and emphasizing the significance of national-level efforts to address these issues effectively.

Electrification of society, increasing renewable energy sources and mobility charging lead to new loading patterns for power transformers. Dynamic load conditions induce enhanced mechanical stress on the transformers’ windings, potentially causing degradation of the solid insulation over time and compromising the transformer's short-circuit withstand capability. Thermal expansion of the windings, caused by losses in the copper conductors, occurring as the transformer is load-ed, increases the stress. Conversely, magnetic losses in the core and tie plate expansion contribute to a reduction in stress. This paper presents the effect of step changes in core losses and copper losses by on-line measurements of the clamping pressure, to better understand the mechanical stresses acting upon the solid insulation cellulose materials.

Detection of partial discharge (PD) activities in high-voltage equipment can be done according to the several mechanisms of signal detection, which are electromagnetic wave signal detection, acoustic signal detection, chemical reactions, electrical signal detection, or optical emission detection. Recently, multiple methods of detection and localization of partial discharge activities occurred in power transformers and gas-insulated switchgear (GIS) have been proposed to monitor the health condition of high-voltage equipment, especially when the awareness regarding preventive maintenance has been emphasized at the industrial level and electrical providers. In aligning the needs of industrial and the improvement of PD detection methods, this manuscript focused on reviewing the current practice methods for the detection and localization of PD signals in high-voltage equipment and comparing their efficacy, in summarizing the future direction of research work-related methods of PD detection. The comparative reviews are discussed in terms of the mechanism of PD signal detection, indication parameters, calibration technique, advantages, and limitations of each method of PD measurement in detail.

When an aircraft malfunctions, quickly and accurately identifying the faulty unit is essential for ensuring normal operation. Unfortunately, maintenance engineers often struggle to acquire the necessary fault-related knowledge due to poor management and utilization of aircraft fault documents. To address this issue, we introduce knowledge graph technology into the field of aircraft fault diagnosis, exploring its construction and application for effective knowledge management. Our work starts by analyzing the critical knowledge elements required for aircraft fault diagnosis and designing a schema layer for fault knowledge graphs. We then we then combine deep learning and heuristic rules to extract fault knowledge from both structured and unstructured data, enabling the construction of aircraft fault knowledge graphs. Finally, we develop a fault question-answering system based on fault knowledge graphs that can accurately give solutions to questions posed by maintenance engineers. Our practice demonstrates that knowledge graphs provide an effective means of managing aircraft fault knowledge, assisting engineers in locating fault reasons accurately and quickly.

Recommendation systems are crucial in navigating the vast digital market. However, user data’s dynamic and non-stationary nature often hinders their efficacy. Traditional models struggle to adapt to the evolving preferences and behaviours inherent in user interaction data, posing a significant challenge for accurate prediction and personalisation. Addressing this, we propose a novel theoretical framework, the Non-stationary Transformer, designed to capture and leverage the temporal dynamics within data effectively. This approach enhances the traditional transformer architecture by introducing mechanisms accounting for non-stationary elements, offering a robust and adaptable solution for recommendation systems. Our experimental analysis, encompassing deep learning and reinforcement learning paradigms, demonstrates the framework’s superiority over benchmark models. The empirical results confirm the efficacy of our proposed framework, which not only provides significant performance enhancements, approximately 8% in Logloss reduction and up to 2% increase in F1 score but also underscores its potential applicability across accumulative reward scenarios. These findings advocate adopting Non-stationary Transformer models to tackle the complexities of today’s recommendation tasks.

We propose Context-aware Feature Transformer Network (CaFTNet), a novel network for human pose estimation. To address the issue of limited modeling of global dependencies in convolutional neural networks, we design Transformerneck to strengthen the expressive power of features. Transformerneck directly substitutes the 3×3 convolution in bottleneck of HRNet with Contextual Transformer (CoT) block, while reducing the complexity of the network. Specifically, CoT first produces keys with static contextual information through 3×3 convolution. Then, relying on the query and contextualization keys, the dynamic contexts are generated through two concatenated 1×1 convolutions. Static and dynamic contexts are eventually fused as an output. Additionally, for the multi-scale networks, in order to further refine the features of the fusion output, we propose an Attention Feature Aggregation Module(AFAM). Technically, given an intermediate input, AFAM successively deduces attention maps along channel and spatial dimensions. Then, Adaptive refinement module(ARM) is exploited to activate the obtained attention maps. Finally, the input undergoes adaptive feature refinement through multiplication with the activated attention maps. Through the above studies, our lightweight network provides a powerful clue for detection of keypoints. Experiments are implemented on the COCO and MPII datasets. The model achieves 76.2 AP on the COCO val2017. Compared to other methods with the CNN as the backbone, CaFTNet reduces the number of parameters by 72.9 %. On the MPII, our method uses only 60.7% of the number of parameters, acquiring semblable results to other methods with the CNN as the backbone.

Due to the influence of background conditions, lighting conditions, occlusion issues and the image resolution, how to extract robust person features is one of the difficulties in ReID research. Vision in Transformers (ViT) has achieved significant results in the field of computer vision. However, the existing problems still limit its application in ReID due to slow extraction of person features and difficulty in utilizing local features of people. To solve the mentioned problems, we utilize Pyramid Vision Transformer (PVT) as the backbone of feature extraction and propose a PVT-based ReID method in conjunction with other studies. Firstly, some improvements suitable for ReID are used on the PVT backbone, and we establish a basic model by using powerful methods verified on CNN-based ReID. Secondly, in an effort to further promote the robustness of the person features extracted by the PVT backbone, two new modules are designed. (1) The local feature clustering (LFC) is recommend to enhance the robustness of person features by calculating the distance between local features and global feature to select the most discrete local features and clustering them. (2) The side information embeddings (SIE) are used to encode non-visual information and send it into the network for training to reduce its impact on person features. Finally, the experiments show that PVTReID has achieved excellent results in ReID datasets and are 20% faster on average than CNN-based ReID methods.

Structural magnetic resonance imaging (sMRI) is widely used in the clinical diagnosis of diseases due to its advantages: high definition and noninvasive. Therefore, computer-aided diagnosis based on sMRI images is broadly applied in classifying Alzheimer’s disease (AD). Due to the excellent performance of Transformer in computer vision, Vision Transformer (ViT) has been employed for AD classification in recent years. ViT relies on access to large datasets, while the sample size of brain imaging datasets is relatively insufficient. Moreover, the pre-processing procedures of brain sMRI images are complex and labor-intensive. To overcome the limitations mentioned above, we propose Resizer Swin Transformer (RST), a deep learning model that can extract information from brain sMRI images that are only briefly processed to achieve multi-scale and cross-channel features. In addition, we pre-trained our RST on a natural image dataset and obtained better performance. The experimental results of ADNI and AIBL datasets prove that RST can achieve better classification performance in AD prediction compared with CNN-based and Transformer models.

Long unpunctuated texts containing complex linguistic sentences are a stumbling block to processing any low-resource languages. Thus, approaches that attempt to segment lengthy texts with no proper punctuation into simple candidate sentences are a vitally important preprocessing task in many hard-to-solve NLP applications. In this paper, we propose (PDTS) a punctuation detection approach for segmenting Arabic text, built on top of a multilingual BERT-based model and some generic linguistic rules. Furthermore, we showcase how PDTS can be effectively employed as a text tokenizer for unpunctuated documents (i.e., mimicking the transcribed audio-to-text documents). Experimental findings across two evaluation protocols (involving an ablation study and a human-based judgment) demonstrate that PDTS is practically effective in both performance quality and computational cost.

(1) Background: The aim of this study was to investigate the circadian rhythms of tongue features according to the effects of physiological phases over a 24-hour period. (2) Methods: Fifteen healthy participants aged 20 to 69 years were recruited. The participants did not have current chronic diseases or past diseases and had to meet the inclusion and exclusion criteria. The participants stayed at the Gil Hospital for a duration of 2 nights and 3 days. On the first day, at 18:00, they consumed their allocated portions of food and water and then completed a questionnaire. At approximately 21:00, their tongue images were acquired using a computerized tongue image acquisition system, following which they slept for 8 hours, commencing at 23:00. Measurements were taken from 07:00 through 21:00 on the second day, and the final acquisition was taken at 07:00 on the following morning, resulting in a total of eight images. The circadian rhythm was authenticated and quantified utilizing the single cosinor analysis, a technique for periodic regression analysis for fitting a 24-hour cosine curve. (3) Results: Cosinor analysis revealed that all tongue features were significantly related to circadian rhythm. (4) Conclusions: The results of this study may be important for considering the time of day at which the tongue is observed and tongue status is evaluated.

In a densely populated country like Bangladesh, universities grapple with the challenge of efficiently addressing myriad queries from a large student body, leading to a heightened workload for university stakeholders. To tackle these challenges, we introduce PixieGPT, a tailor-made Generative Pre-Trained Transformer for Bangladeshi universities. PixieGPT significantly mitigates workload by adeptly handling common university-related queries, thereby enhancing user experience. The hierarchical structure plays a crucial role in managing diverse queries from thousands of students about the university system. The solution introduces a modular hierarchical knowledge base (KB) with simpler complexities, addressing the intricacies of efficiently managing large volumes of queries. PixieGPT is designed in a modular way so that the solution is also adaptable for the implementation of other universities worldwide based on the requirements of a particular administrative system. The modular nature facilitates easy adaptation with minor changes based on specific university requirements, ensuring a seamless integration process. This paper delves into the intricacies of PixieGPT's design, emphasizing its pivotal role in mitigating workload challenges for university stakeholders in Bangladesh. The incorporation of BERT for Natural Language Understanding(NLU) and GPT models for Natural Language Generation(NLG) enhances PixieGPT's capabilities, contributing to the scalability and efficiency of the system. The presented use case underscores the practical benefits of PixieGPT, positioning it as a promising solution for universities globally with similar operational frameworks.

The purpose of this study is to ​​explore the use of a custom Transformer model in brain-computer interfaces (BCIs) that translate the neural activity present when an individual with limited verbal and fine-motor skills attempts to handwrite. As found in previous studies, Transformers have performed better than recurrent neural networks (RNNs) in translation tasks which are similar to its usage here in decoding neural signals into intended handwritten text. Due to the known benefits of a Transformer, the hypothesis was that the Transformer would show promise in the context of a BCI through the recorded metrics. The neural signals of a tetraplegic individual, when they attempted to handwrite, were provided by existing research. Four trials were conducted using data with or without augmentation which the model used when training to separately minimize training loss and validation loss. When comparing the results of a BCI with the implementation of a Transformer model with the original RNN BCI (the original data source), the Transformer model performed less favorably across all four trials. Although the results do not indicate that the Transformer model currently outperforms an RNN BCI, it is important to note that further testing of the model's capabilities (such as training it with a larger and more preferable dataset and/or for longer, comparing training times between the RNN and Transformer, and/or seeing how the Transformer is improved with an offline autocorrect feature) is necessary before determining whether Transformers can enhance communication in this manner.

Deep Learning (DL) has made significant advances in computer vision with the advent of Vision Transformers (ViT). Unlike Convolutional Neural Networks (CNNs), ViTs use self-attention to extract both local and global features from image data, and then use residual connections to feed these features directly into a fully networked multilayer perceptron head. In hospitals, hematologists prepare peripheral blood smears (PBSs) and read them under a medical microscope to detect abnormalities in blood counts such as leukemia. However, this task is time-consuming and prone to human error. This study investigates the transfer learning process of Google ViT and ImageNet CNNs to automate the reading of PBSs. The study used two online PBS datasets, PBC and BCCD, and transferred them into balanced datasets to investigate the influence of data amount and noise immunity on both neural networks. The PBC results show that Google ViT is an excellent DL neural solution for data scarcity. The BCCD results show that Google ViT is superior to ImageNet CNNs in dealing with unclean, noisy image data because it is able to extract both global and local features and use residual connections, despite the additional time and computational overhead.

This study develops a progressive optimal fault-tolerant control method based on insufficient fault information. By combining passive and active fault-tolerant control manners during the process of fault diagnosis, insufficient fault information is fully used, and optimal fault-tolerant control effect is achieved. In addition, the fault-tolerant control method based on guaranteed robust cost control is introduced. The proposed progressive optimal fault-tolerant control method considers two aspects. First, as the amount of fault information continually increases, the performance index of the progressive optimal fault-tolerant controller improves. Second, at each moment, based on the corresponding insufficient fault information and prior knowledge, optimal fault-tolerant control is achieved according to current fault information. The process of progressive optimal fault-tolerant control converges to active fault-tolerant control when the fault is completely identified and the optimal fault-tolerant controller is no longer reconfigured until no more useful fault information can be provided. Furthermore, a progressive optimal fault-tolerant control algorithm based on the grid segmentation in the parameter uncertainty domain and the selection of different auxiliary center points is introduced. The simulation results verify the feasibility of the proposed algorithm and the validity of the proposed theory.

This work aims to develop an integrated fault location and restoration approach for microgrids (MGs). This work contains two parts. Part I presents the fault location algorithm, and Part II shows the restoration algorithm. The proposed algorithms are implemented by particle swarm optimization (PSO). The fault location algorithm is based on network connection matrices, which are the modifications of bus-injection to branch-current and branch-current to bus-voltage (BCBV) matrices, to form the new system topology. The backward/forward sweep approach is used for the prefault power flow analysis. After the occurrence of fault, the voltage variation at each bus is calculated by using the Zbus modification algorithm to modify Zbus. Subsequently, the voltage error matrix is computed to search for the fault section by using PSO. After the allocation of the fault section, the multi-objective function is implemented by PSO for optimal restoration with its constraints. Finally, the IEEE 37-bus test system connected to distributed generations is utilized as the sample system for a series simulation and analysis. The outcomes demonstrated that the proposed optimal algorithm can effectively solve the fault location and restoration problem in MGs.

This paper describes a novel thruster fault-tolerant control system (FTC) for open-frame remotely operated vehicles (ROVs). The proposed FTC consists of two subsystems: a model-free thruster fault detection and isolation subsystem (FDI) and a fault accommodation subsystem (FA). The FDI subsystem employs fault detection units (FDUs), associated with each thruster, to monitor their state. The robust, reliable and adaptive FDUs use a model-free pattern recognition neural network (PRNN) to detect internal and external faulty states of the thrusters in real time. The FA subsystem combines information provided by the FDI subsystem with predefined, user-configurable actions to accommodate partial and total faults and to perform an appropriate control reallocation. Software-level actions include penalisation of faulty thrusters in solution of control allocation problem and reallocation of control energy among the operable thrusters. Hardware-level actions include power isolation of faulty thrusters (total faults only) such that the entire ROV power system is not compromised. The proposed FTC system is implemented as a LabVIEW virtual instrument (VI) and evaluated in virtual (simulated) and real-world environments. The proposed FTC module can be used for open frame ROVs with up to 12 thrusters: eight horizontal thrusters configured in two horizontal layers of four thrusters each, and four vertical thrusters configured in one vertical layer. Results from both environments show that the ROV control system, enhanced with the FDI and FA subsystems, is capable of maintaining full 6 DOF control of ROV in the presence of up to 6 simultaneous total faults in the thrusters. With the FDI and FA subsystems in place the control energy distribution of the healthy thrusters is optimised so that the ROV can still operate in difficult conditions under fault scenarios.

Distribution systems can form islands when faults occur. Each island represents a subsection with variable boundaries subject to the location of a fault(s) in the system. A subsection with variable boundaries is referred to as island in this paper. For operation in autonomous mode, it is imperative to detect the island configurations and stabilize these subsections. This paper presents a novel scheme for the detection of islanding boundaries and stabilizing the system during autonomous operation. In the first stage, a boundary detection method is proposed to detect the configuration of the island. In the second stage a dynamic voltage sensitivity factor (DVSF) is proposed to assess the dynamic performance of the system. In the third stage, a wide area load shedding program is adopted based on DVSF to shed the load in weak busbars and stabilize the system. The proposed scheme is validated and tested on a generic 18-bus system using a combination of EMTDC/PSCAD and MATLAB softwares.

In the realm of the five-category classification endeavor, there has been limited exploration into applied techniques for classifying Arabic text. These methods have primarily leaned on singletask learning, incorporating manually crafted features that lack robust sentence representations. Recently, the Transformer paradigm has emerged as a highly promising alternative. However, when these models are trained using single-task learning, they often face challenges in achieving outstanding performance and generating robust latent feature representations, especially when dealing with small datasets. This issue is particularly pronounced in the context of the Arabic dialect, which has a scarcity of available resources. Given these constraints, this study introduces an innovative approach to dissecting sentiment in Arabic text. This approach combines Inductive Transfer (INT) with the Transformer paradigm to augment the adaptability of the model and refine the representation of sentences. By employing self-attention SE-A and feed-forward sub-layers as a shared Transformer encoder for both the five-category and three-category Arabic text classification tasks, this proposed model adeptly discerns sentiment in Arabic dialect sentences. The empirical findings underscore the commendable performance of the proposed model, as demonstrated in assessments of the Hotel Arabic-Reviews Dataset, the Book Reviews Arabic Dataset, and the LARB dataset.

Although wireless capsule endoscopy (WCE) detects small bowel diseases effectively, it has some limitations. For example, the reading process can be time-consuming due to the numerous images generated per case, and lesion detection accuracy may rely on the operators' skills and experiences. Hence, many researchers have recently developed deep learning-based methods to address these limitations. However, they tend to select only a portion of the images from a given WCE video and analyze each image individually. In this study, we note that more information can be extracted from the unused frames and temporal relations of sequential frames. Specifically, to increase the accuracy of lesion detection without depending on experts' frame selection skills, we suggest using whole video frames as the input to the deep-learning system. Thus, we propose a new Transformer-based neural encoder that takes the entire video as the input, exploiting the power of the Transformer to extract long-term global correlation within and between the input frames. Subsequently, we can capture the temporal context of the input frames and the attentional features within a frame. Tests on benchmark datasets of four WCE videos showed 95.1% sensitivity and 83.4% sensitivity. These results may significantly advance automated lesion detection techniques for WCE images. Our code is available at https://github.com/syupoh/VWCE-Net.git.