One of the most crucial elements in deeply understanding humans on a psychological level is manifested through facial expressions. The analysis of a human behavior can be informed by their facial expressions, making it essential to employ indicators such as expression (Expr), valence-arousal (VA), and action units (AU). In this paper, we introduce the method proposed in the Challenge of the 6th Workshop and Competition on Affective Behavior Analysis in-the-wild (ABAW) at CVPR 2024. Our proposed method utilizes the multi-modal Aff-wild2 dataset, which is splitted into spatial and audio modalities. For the spatial data, we extract features using a SimMiM model that was pre-trained on a diverse set of facial expression data. For the audio data, we extract features using a WAV2VEC model. To fusion the extracted spatial and audio features, we employed the cascaded cross-attention mechanism of a transformer.

The COVID-19 pandemic caused significant training disruptions during the 2020-21 season due to lockdowns, quarantines, and strict adherence to pandemic protocols. The main purpose of this study was to determine how pandemic training restrictions affected training volume and performance in one collegiate swim team. Cumulative training volume data, across a 28-week season, were compared between a pandemic (2020-2021) versus non-pandemic (2019-2020) season. Swimmers were categorized into three groups (Sprinters, Mid-Distance, and Long-Distance) based on training group. Performance times in 25 swimmers who competed in Regional Championships, during both the non-pandemic and pandemic year, were compared via 1-way ANOVA. 26 male and 22 female swimmers commenced the 2020-21 (pandemic) season, with 23% of swimmers voluntarily opting out. Three COVID-19 cases were confirmed (2%) by the medical staff with no long-term effects. Significant reductions in average swim volume were verified in Sprinters (32,867±10,135 vs.14,800±7,995yards;p<0.001), Mid-Distance (26,457±10,692 vs.17,054±9.923yards;p<0.001), and Long-Distance (37,600±14,430 vs.22,254±14,418yards;p<0.001) swimmers (non-pandemic vs. pandemic season, respectively). In the Regional performance analyses, the Sprinters swam faster (n=8;-0.5±0.6secs), while Mid-Distance (n=10;0.17±2.1secs) and Long-Distance (n=7;6.0±4.9secs) swimmers swam slower (F=11.76;p=0.0003;r²=0.52). Thus, the pandemic caused significant reductions in swim training volume, with Sprinters performing better and Long-Distance swimmers performing worse at Regional Championships.

Few-shot object detection (FSOD) aims to address the challenge of requiring a substantial amount of annotations for training in conventional object detection, which is very labor-intensive. However, existing few-shot methods achieve high precision with the sacrifice of time-consuming for exhaustive fine-tuning, or take poor performance in novel-class adaptation. We presume the major reason is that the valuable correlation feature among different categories is insufficiently exploited, hindering the generalization of knowledge from base to novel categories for object detection. In this paper, we propose Few-Shot object detection via Correlation-RPN and Transformer Encoder-Decoder (CRTED), a novel training network to learn object-relevant features of inter-class correlation and intra-class compactness while suppressing object-agnostic features in the background with limited annotated samples. And we also introduce a 4-way tuple-contrast training strategy to positively activate the training progress of our object detector. Experiments over two few-shot benchmarks (Pascal VOC, MS-COCO) demonstrate that, our proposed CRTED without further fine-tuning can achieve comparable performance with current state-of-the-art fine-tuned works. The codes and pre-trained models will be released.

Glycosaminoglycans (GAGs) with unique structures from marine animals show intriguing pharmacological activities and negligible biological risks, providing more options for us to explore safer agents. Swim bladder is a tonic food and folk medicine, and its GAGs show good anticoag-ulant activity. In this study, two GAGs SJG-1.0 and GMG-1.0 have been extracted and isolated from the swim bladder of Sphyraena jello and Gadus morhua. The physicochemical properties, pre-cise structural characteristics, and anticoagulant activities of these GAGs were determined. The analysis results of the SJG-1.0 and GMG-1.0 showed that they were chondroitin sulfate (CS)/dermatan sulfate (DS) hybrid chains with molecular weights of 109.32 kDa and 123.13 kDa, respectively. They were mainly composed of the repeating disaccharide unit of -{IdoA-α1,3-GalNAc4S-β1,4-}- (DS-A). The DS-B disaccharide unit of -{IdoA2S-α1,3-GalNAc4S-β1,4-}- also existed in both SJG-1.0 and GMG-1.0. SJG-1.0 had a higher proportion of CS-O disaccharide unit -{-GlcA-β1,3-GalNAc-β1,4-}-, while GMG-1.0 contained higher proportion of CS-E disaccha-ride unit -{-GlcA-β1,3-GalNAc4S6S-β1,4-}-. The disaccharide compositions of the GAGs varied in a species-specific manner. Anticoagulant activity assay revealed that both SJG-1.0 and GMG-1.0 had potent anticoagulant activity, which can significantly prolong activated partial thrombosis time. GMG-1.0 also can prolong the thrombin time. SJG-1.0 showed no intrinsic tenase inhibition ac-tivity, while GMG-1.0 can obviously inhibit intrinsic tenase with EC50 of 58 nM. Their significantly different anticoagulant activities may be due to their different disaccharide structural units and proportions. These findings suggested that the swim bladder CS/DS hybrid chains with well-defined structure may be safer anticoagulants with low bleeding risk.

Neural decoding from spiking activity is an essential tool for understanding the information encoded in population neurons, especially in applications like brain-computer interface (BCI). Various quantitative methods have been proposed and have shown superiorities under different scenarios respectively. From the machine learning perspective, the decoding task is to map the high-dimensional spatial &amp; temporal neuronal activity to the low-dimensional physical quantities (e.g., velocity, position). Because of the complex interactions and the abundant dynamics among neural circuits, good decoding algorithms usually have the capability of capturing flexible spatiotemporal structures embedded in the input feature space. Recently, the Transformer-based models are widely used in processing natural languages and images due to its superior performances in handling long-range and global dependencies. Hence, in this work we examine the potential applications of Transformers in neural decoding and introduce two Transformer-based models. Besides adapting the Transformer to neuronal data, we also propose a data augmentation method for overcoming the data shortage issue. We test our models on three experimental datasets and their performances are comparable to the previous state-of-the-art (SOTA) RNN-based methods. In addition, Transformer-based models show increased decoding performances when the input sequences are longer, while LSTM-based models deteriorate quickly. Our research suggests that Transformer-based models are important additions to the existing neural decoding solutions, especially for large datasets with long temporal dependencies.

In this paper, we introduce Syntax-Enhanced Transformer Model (SET), a groundbreaking approach in the realm of Transformer-based language modeling that seeks to redefine the boundaries of linguistic analysis and comprehension. SET innovatively combine (i) the well-established high-level performance, scalability, and adaptability of traditional Transformers with (ii) a sophisticated analysis of syntactic structures. This synergy is enabled by a novel attention mechanism tailored to parse syntactic nuances and a deterministic process adept at transforming linearized parse trees into meaningful linguistic representations. Our comprehensive experiments reveal that SET significantly advance the field by surpassing existing benchmarks in sentence-level language modeling perplexity. They exhibit exceptional proficiency in tasks that require an acute awareness of syntax, setting new standards for language models in understanding complex linguistic structures. Furthermore, SET demonstrate an enhanced capability to grasp nuanced linguistic patterns that have traditionally been challenging for standard Transformer models. However, our studies also uncover a unique aspect of SET: while they excel in sentence-level tasks, their representation of sentences as singular vectors—owing to the syntactic composition constraints intrinsic to their design—introduces certain limitations in document-level language modeling. This observation points to an intriguing area for future exploration; it suggests the potential need for an alternative or complementary memory mechanism within Transformer models, one that functions independently from, yet in harmony with, syntactic structures. Such a mechanism could be pivotal in enhancing the model's ability to comprehend and process long-form texts effectively. In conclusion, SET mark a significant stride in the journey towards more sophisticated, syntax-aware language models. They offer promising insights into the integration of deep linguistic knowledge with cutting-edge machine learning techniques, potentially opening doors to a new era of natural language understanding and processing.

The evolution of sentence representation learning, especially with parse tree encoders, has shown remarkable progress. Traditional approaches predominantly rely on recursive encoding of tree structures, which impedes parallel processing capabilities. Additionally, these methods often overlook the significance of dependency tree arc labels. To overcome these limitations, we introduce the Syntax-Enhanced Transformer (SET), incorporating a novel dual-attention mechanism that integrates relation-focused attention alongside traditional self-attention. This design effectively encodes both dependency and spatial positional relationships within sentence dependency trees. Our approach innovatively incorporates syntactic information into the Transformer framework without compromising its inherent parallelizability. The SET demonstrates superior or comparable performance to contemporary methods across various sentence representation tasks, significantly enhancing computational efficiency.

Recent advancements in neural language models, particularly attention-based architectures like the Transformer, have substantially surpassed traditional methods in various natural language processing tasks. These models adeptly generate nuanced token representations by considering contextual relations within a sequence. However, augmenting these models with explicit syntactic knowledge, such as part of speech tags, has been found to remarkably bolster their effectiveness, especially under constrained data scenarios. This study introduces the Linguistic Enhanced Transformer (LET), which integrates multiple syntactic features, showing a notable increase in translation accuracy, evidenced by an improvement of up to 1.99 BLEU points on subsets of the WMT '14 English-German dataset. Furthermore, this paper demonstrates that enriching BERT models with syntax-aware embeddings enhances their performance on several GLUE benchmark tasks.

Nonlinear thermal transport of non-Newtonian polymer flows is an increasingly important area in materials engineering. Motivated by new developments in this area which entail more re-fined and mathematical frameworks, the present analysis investigates the boundary layer ap-proximation and heat transfer persuaded by a symmetrical cylindrical surface positioned hori-zontally. To simulate thermal relaxation impacts the bioconvection cross nanofluid flow Buongiorno model is deployed. The impact of the magnetic field applied on the nanofluid using the heat generation and melting phenomena are inspected. The nonlinear effect of thermosolutal buoyant forces is incorporated into the proposed model. The novel mathematical equations comprise thermophoresis and Brownian diffusion effects. Via robust transformation techniques, the primitive resulting partial equations for momentum, energy, concentration, and motile living microorganism are rendered into nonlinear ordinary equations with convective boundary postulates. An explicit and efficient numerical solver procedure in Mathematica 11.0 programming platform is developed to engage the nonlinear equations. The consequence of multiple governing parameters on dimensionless fluid profiles is inspected through plotted visuals and tables. Finally, outcomes declared on the surface drag force, heat, and mass transfer coefficients are exhibited through 3D visuals via different influential parameters.

Time series forecasting has been a challenging area in the field of Artificial Intel-ligence. Various approaches such as linear Neural Networks, Recurrent Linear Neural Networks, Convolutional Neural Networks and recently Transformers have been attempted for the time series forecasting domain. Although, Trans-former-based architectures have been outstanding in the Natural Language Pro-cessing domain, especially in autoregressive language modeling, the initial at-tempts to use transformers in the time series arena have met with mixed success. One of the recent papers demonstrated that modeling the multi-variate time se-ries problem as independent channels on a transformer architecture produced lower mean square and mean absolute errors on benchmarks, however, another recent paper claimed that a simple linear neural network out-performs previous approaches including transformer-based designs. We investigate this paradox in detail comparing the linear Neural Network and Transformer based designs, provide insights to why a certain approach may be better for a particular type of problem. We also improve upon the recently proposed simple linear Neural Network based architecture by using dual pipelines with batch normalization and reversible instance normalization. Our enhanced architecture outperforms all existing architectures for time series forecasting on majority of the popular benchmarks.

Multispectral image (MSI) and hyperspectral image (HSI) fusion (MHIF) aims to address the challenge of acquiring high-resolution (HR) HSI images. This field combines a low-resolution (LR) HSI with an HR-MSI to reconstruct HR-HSI. Existing methods directly utilize transformers to perform feature extraction and fusion. Despite the demonstrated success, there exist two limitations: 1) Employing the entire transformer model for feature extraction and fusion fails to fully harness the transformer’s potential in integrating the spectral of the HSI and spatial information of the MSI. 2) HSI has a strong spectral correlation and exhibits sparsity in the spatial domain. Existing transformer-based models do not optimize this physical property, which makes their methods prone to spectral distortion. To accomplish these issues, this paper introduces a novel framework for MHIF called Sparse Mix-Attention Transformer (SAMformer). Specifically, to fully harness the advantages of the Transformer architecture, we propose a Spectral Mix Attention Block (SMAB), which concatenates the keys and values extracted from LR-HSI and HR-MSI to create a new multi-head attention module. This design facilitates the extraction of detailed long-range information across spatial and spectral dimensions. Besides, to address the spatial sparsity inherent in HSI, we incorporated a sparse mechanism within the core of SMAB called Sparse Spectral Mix Attention Block (SSMAB). In the SSMAB, we compute attention maps from queries and keys and select the K highly correlated values as the sparse attention map. This approach enables us to achieve a sparse representation of spatial information while eliminating spatially disruptive noise. Extensive experiments conducted on three benchmark datasets, namely Cave, Harvard, and Pavia Center, demonstrate the SMAformer method outperforms state-of-the-art methods.

Heat transfer fluids are used in various industrial systems to maintain them in perfect operating conditions. Extensive research efforts have been dedicated to enhance the thermal properties of these heat transfer fluids to improve their efficiency. Developing nanofluids is a potential candidate for such enhancements. This study investigates the impact of incorporating TiO2 nanoparticles into two types of oils: transformer oil (NYTRO LIBRA) and virgin coconut oil (manufactured by Govi Aruna Pvt. Ltd.) at different temperatures and with varying volume fractions. The nanofluids were prepared using a two-step method by adding CTAB (Cetyltrimethylammonium bromide) surfactant. To minimize nanoparticle agglomeration, this study employed relatively low-volume fractions. Thermal properties by means of thermal conductivity, thermal diffusivity, and volumetric heat capacity were measured in accordance with ASTM (American Society for Testing and Materials) standard methods, using a multifunctional thermal conductivity meter (LAMBDA thermal conductivity meter). The measured thermal conductivity values were compared with theoretical models and previous research findings. It was confirmed that the modification of thermal properties was enhanced by doping TiO2 nanoparticles with different volume fraction.

Identification of plants is a challenging task which aims to identify the family, genus, and species level according to morphological features. Automated deep learning-based computer vision algorithms are widely used for identifying plants and can help users to narrow down the possibilities. However, numerous morphological similarities between and within species make the classification difficult. In this paper, we tested a custom convolution neural network (CNN) and vision transformer (ViT) based models using the PyTorch framework to classify plants. We used a large dataset of 88K and 16K images for classifying plants at genus and species levels respectively. Our results show that for classifying plants at the genus level, ViT models perform better compared to CNN-based models ResNet50 and ResNet-RS-420, and other state-of-the-art CNN-based models suggested in previous studies on a similar dataset. The ViT model achieved top accuracy of 83.3% for classifying plants at the genus level. ViT models also perform better for classifying plants at the species level compared to CNN-based models ResNet50 and ResNet-RS-420, with a top accuracy of 92.5%. We show that the correct set of augmentation techniques plays an important role in classification success.

This paper describes the successful application of the Transformer model used in the natural language processing and vision tasks as a means of processing the time series of signals from gyroscope and accelerometer sensors for the classification of human activities. The Transformer model is based on deep neural networks with many layers which can generalize well on signals. All measured signals come from a smartphone placed in a waist bag. Activity prediction is sequence-to-sequence, each time step of the signal is assigned a designation of the performed activity. Emphasis is placed on attention mechanisms, which express individual dependencies between signal values within a time series. In comparison with another recent result, the recognition precision was improved from 89.67 percent to 99.2 percent. The transformer model should in the future be included among the top options in machine learning methods for human activity recognition.

Agriculture is pivotal in national economies, with pest detection significantly influencing food quality and quantity. Pest classification remains challenging in automated agriculture monitoring systems, exacerbated by the non-uniform pest scales and the scarcity of high-quality datasets. In this study, we constructed a pest dataset by acquiring domain-agnostic images from the Internet and resizing them to a standardized 299x299 pixel format. Additionally, we employed diffusion models to generate supplementary data. While Convolutional Neural Networks (CNNs) are prevalent for prediction and classification, they often lack effective global information integration and discriminative feature representation. To address these limitations, we propose the RS Transformer, an innovative model that combines elements like the Region Proposal Network, Swin Transformer, and ROI Align. Additionally, we introduce the Randomly Generated Stable Diffusion Dataset (RGSDD) to augment the availability of high-quality pest datasets. Extensive experimental evaluations demonstrate the superiority of our approach compared to both two-stage models (SSD and Faster R-CNN) and one-stage models (YOLOv3, YOLOv4, YOLOv5m, YOLOv8, and DETR). We rigorously assess performance using metrics such as mean Average Precision (mAP), F1Score, Recall, and mean Detection Time (mDT). Our research contributes to advancing pest detection methodologies in automated agriculture systems, promising improved food production and quality.

Blood cell analysis is a crucial diagnostic process in medical practice. In particular, detecting white blood cells (WBCs) is essential for diagnosing of many diseases. The manual screening of blood films is a time-consuming and subjective process, which can lead to inconsistencies and errors. Therefore, automated detection of blood cells can improve the accuracy and efficiency of the screening process. In this study, an explainable Vision Transformer (ViT) model was proposed for the automatic detection of WBCs from blood films. The proposed model utilizes the self-attention mechanism to extract relevant features from the input images and leverages transfer learning by incorporating pre-trained model weights to improve its performance. The proposed model achieved a classification accuracy of 99.40% for five distinct types of WBCs and exhibited potential in reducing the time required for manual screening of blood films by pathologists. Upon examination of the misclassified test samples, it was observed that incorrect predictions were correlated with the presence or absence of granules in the cell samples. To validate this observation, the dataset was divided into two classes, namely Granulocytes and Agranulocytes, and a secondary training process was conducted. The resulting ViT model trained for binary classification achieved an accuracy of 99.70%, recall of 99.54%, precision of 99.32%, and F-1 score of 99.43% during the test phase. To ensure the reliability of the ViT model's multi-class classification of WBCs, the pixel areas that the model focuses on in its predictions are visualized through the Score-CAM algorithm.

Color image binarization plays a pivotal role in image preprocessing work, significantly impacting subsequent tasks, particularly in text recognition. This paper concentrates on Document Image Binarization (DIB), aiming to separate a image into foreground (text) and background (non-text content). Through a thorough analysis of conventional and deep learning-based approaches, we conclude that prevailing DIB methods leverage deep learning technology. Furthermore, we explore the receptive fields pre- and post-network training to underscore the Transformer model's advantages. Subsequently, we introduce a lightweight model based on the U-Net structure, enhanced with the Mobile ViT module to better capture global information features in document images. Given its adeptness at learning both local and global features, our proposed model exhibits superior performance on two standard datasets (DIBCO2012 and DIBCO2017) compared to state-of-the-art methods. Notably, our proposed DIB method presents a straightforward end-to-end model devoid of additional image preprocessing or post-processing. Moreover, its parameter count is less than a quarter of the HIP'23 model, which achives best results on three datasets(DIBCO2012, DIBCO2017 and DIBCO2018). Finally, two sets of ablation experiments were conducted to verify the effectiveness of the proposed binarization model.

Estimating the Remaining Useful Life (RUL) of aircraft engines holds a pivotal role in enhancing safety, optimizing operations, and promoting sustainability, thus being a crucial component of modern aviation management. Precise RUL predictions offer valuable insights into an engine’s condition, enabling informed decisions regarding maintenance and crew scheduling. In this context, we propose a novel RUL prediction approach in this paper, harnessing the power of Bi-directional LSTM and Transformer architectures, known for their success in sequence modeling, such as natural languages. We adopt the encoder part of the full Transformer as the backbone of our framework, integrating it with a self-supervised denoising autoencoder that utilizes Bidirectional LSTM for improved feature extraction. Within our framework, a sequence of multivariate time series sensor measurements serves as the input, initially processed by the Bidirectional LSTM autoencoder to extract essential features. Subsequently, these feature values are fed into our Transformer encoder backbone for RUL prediction. Notably, our approach simultaneously trains the autoencoder and Transformer encoder, different from the naive sequential training method. Through a series of numerical experiments carried out on the C-MAPSS datasets, we demonstrate that the efficacy of our proposed models either surpasses or stands on par with that of other existing methods.

Indoor localization is an active area of research dominated by traditional machine-learning techniques. Deep learning-based systems have shown unprecedented improvements and have accomplished exceptional results over the past decade, especially the Transformer network within natural language processing (NLP) and computer vision domains. We propose the hyper-class Transformer (HyTra), an encoder-only Transformer with multiple classification heads (one per class) and learnable embeddings, to investigate the effectiveness of Transformer-based models for received signal strength (RSS) based WiFi fingerprinting. HyTra leverages learnable embeddings and the self-attention mechanism to determine the relative position of the wireless access points (WAPs) within the high-dimensional embedding space, improving the prediction of user location. From an NLP perspective, we consider a fixed order sequence of all observed WAPs as a sentence and the captured RSS value(s) for every given WAP at a given reference point from a given user as words. We test our proposed network on public and private datasets of different sizes, proving that the quality of the learned embeddings and overall accuracy improves with increments in samples.

In this research paper, a high gain transformer less inverter modeling which is used for the smart grid technology or as the stand alone for home appliances is proposed. The proposed transformer less topology provides a higher voltage gain, low cost, small size and simple control stand alone transformer less inverter for home appliances. The above inverter is modeled by using software which is known as MATLAB/ Simulimk.

Electrification of society, increasing renewable energy sources and mobility charging lead to new loading patterns for power transformers. Dynamic load conditions induce enhanced mechanical stress on the transformers’ windings, potentially causing degradation of the solid insulation over time and compromising the transformer's short-circuit withstand capability. Thermal expansion of the windings, caused by losses in the copper conductors, occurring as the transformer is load-ed, increases the stress. Conversely, magnetic losses in the core and tie plate expansion contribute to a reduction in stress. This paper presents the effect of step changes in core losses and copper losses by on-line measurements of the clamping pressure, to better understand the mechanical stresses acting upon the solid insulation cellulose materials.

Detection of partial discharge (PD) activities in high-voltage equipment can be done according to the several mechanisms of signal detection, which are electromagnetic wave signal detection, acoustic signal detection, chemical reactions, electrical signal detection, or optical emission detection. Recently, multiple methods of detection and localization of partial discharge activities occurred in power transformers and gas-insulated switchgear (GIS) have been proposed to monitor the health condition of high-voltage equipment, especially when the awareness regarding preventive maintenance has been emphasized at the industrial level and electrical providers. In aligning the needs of industrial and the improvement of PD detection methods, this manuscript focused on reviewing the current practice methods for the detection and localization of PD signals in high-voltage equipment and comparing their efficacy, in summarizing the future direction of research work-related methods of PD detection. The comparative reviews are discussed in terms of the mechanism of PD signal detection, indication parameters, calibration technique, advantages, and limitations of each method of PD measurement in detail.

Recommendation systems are crucial in navigating the vast digital market. However, user data’s dynamic and non-stationary nature often hinders their efficacy. Traditional models struggle to adapt to the evolving preferences and behaviours inherent in user interaction data, posing a significant challenge for accurate prediction and personalisation. Addressing this, we propose a novel theoretical framework, the Non-stationary Transformer, designed to capture and leverage the temporal dynamics within data effectively. This approach enhances the traditional transformer architecture by introducing mechanisms accounting for non-stationary elements, offering a robust and adaptable solution for recommendation systems. Our experimental analysis, encompassing deep learning and reinforcement learning paradigms, demonstrates the framework’s superiority over benchmark models. The empirical results confirm the efficacy of our proposed framework, which not only provides significant performance enhancements, approximately 8% in Logloss reduction and up to 2% increase in F1 score but also underscores its potential applicability across accumulative reward scenarios. These findings advocate adopting Non-stationary Transformer models to tackle the complexities of today’s recommendation tasks.

We propose Context-aware Feature Transformer Network (CaFTNet), a novel network for human pose estimation. To address the issue of limited modeling of global dependencies in convolutional neural networks, we design Transformerneck to strengthen the expressive power of features. Transformerneck directly substitutes the 3×3 convolution in bottleneck of HRNet with Contextual Transformer (CoT) block, while reducing the complexity of the network. Specifically, CoT first produces keys with static contextual information through 3×3 convolution. Then, relying on the query and contextualization keys, the dynamic contexts are generated through two concatenated 1×1 convolutions. Static and dynamic contexts are eventually fused as an output. Additionally, for the multi-scale networks, in order to further refine the features of the fusion output, we propose an Attention Feature Aggregation Module(AFAM). Technically, given an intermediate input, AFAM successively deduces attention maps along channel and spatial dimensions. Then, Adaptive refinement module(ARM) is exploited to activate the obtained attention maps. Finally, the input undergoes adaptive feature refinement through multiplication with the activated attention maps. Through the above studies, our lightweight network provides a powerful clue for detection of keypoints. Experiments are implemented on the COCO and MPII datasets. The model achieves 76.2 AP on the COCO val2017. Compared to other methods with the CNN as the backbone, CaFTNet reduces the number of parameters by 72.9 %. On the MPII, our method uses only 60.7% of the number of parameters, acquiring semblable results to other methods with the CNN as the backbone.

Due to the influence of background conditions, lighting conditions, occlusion issues and the image resolution, how to extract robust person features is one of the difficulties in ReID research. Vision in Transformers (ViT) has achieved significant results in the field of computer vision. However, the existing problems still limit its application in ReID due to slow extraction of person features and difficulty in utilizing local features of people. To solve the mentioned problems, we utilize Pyramid Vision Transformer (PVT) as the backbone of feature extraction and propose a PVT-based ReID method in conjunction with other studies. Firstly, some improvements suitable for ReID are used on the PVT backbone, and we establish a basic model by using powerful methods verified on CNN-based ReID. Secondly, in an effort to further promote the robustness of the person features extracted by the PVT backbone, two new modules are designed. (1) The local feature clustering (LFC) is recommend to enhance the robustness of person features by calculating the distance between local features and global feature to select the most discrete local features and clustering them. (2) The side information embeddings (SIE) are used to encode non-visual information and send it into the network for training to reduce its impact on person features. Finally, the experiments show that PVTReID has achieved excellent results in ReID datasets and are 20% faster on average than CNN-based ReID methods.

Structural magnetic resonance imaging (sMRI) is widely used in the clinical diagnosis of diseases due to its advantages: high definition and noninvasive. Therefore, computer-aided diagnosis based on sMRI images is broadly applied in classifying Alzheimer’s disease (AD). Due to the excellent performance of Transformer in computer vision, Vision Transformer (ViT) has been employed for AD classification in recent years. ViT relies on access to large datasets, while the sample size of brain imaging datasets is relatively insufficient. Moreover, the pre-processing procedures of brain sMRI images are complex and labor-intensive. To overcome the limitations mentioned above, we propose Resizer Swin Transformer (RST), a deep learning model that can extract information from brain sMRI images that are only briefly processed to achieve multi-scale and cross-channel features. In addition, we pre-trained our RST on a natural image dataset and obtained better performance. The experimental results of ADNI and AIBL datasets prove that RST can achieve better classification performance in AD prediction compared with CNN-based and Transformer models.

Long unpunctuated texts containing complex linguistic sentences are a stumbling block to processing any low-resource languages. Thus, approaches that attempt to segment lengthy texts with no proper punctuation into simple candidate sentences are a vitally important preprocessing task in many hard-to-solve NLP applications. In this paper, we propose (PDTS) a punctuation detection approach for segmenting Arabic text, built on top of a multilingual BERT-based model and some generic linguistic rules. Furthermore, we showcase how PDTS can be effectively employed as a text tokenizer for unpunctuated documents (i.e., mimicking the transcribed audio-to-text documents). Experimental findings across two evaluation protocols (involving an ablation study and a human-based judgment) demonstrate that PDTS is practically effective in both performance quality and computational cost.

In a densely populated country like Bangladesh, universities grapple with the challenge of efficiently addressing myriad queries from a large student body, leading to a heightened workload for university stakeholders. To tackle these challenges, we introduce PixieGPT, a tailor-made Generative Pre-Trained Transformer for Bangladeshi universities. PixieGPT significantly mitigates workload by adeptly handling common university-related queries, thereby enhancing user experience. The hierarchical structure plays a crucial role in managing diverse queries from thousands of students about the university system. The solution introduces a modular hierarchical knowledge base (KB) with simpler complexities, addressing the intricacies of efficiently managing large volumes of queries. PixieGPT is designed in a modular way so that the solution is also adaptable for the implementation of other universities worldwide based on the requirements of a particular administrative system. The modular nature facilitates easy adaptation with minor changes based on specific university requirements, ensuring a seamless integration process. This paper delves into the intricacies of PixieGPT's design, emphasizing its pivotal role in mitigating workload challenges for university stakeholders in Bangladesh. The incorporation of BERT for Natural Language Understanding(NLU) and GPT models for Natural Language Generation(NLG) enhances PixieGPT's capabilities, contributing to the scalability and efficiency of the system. The presented use case underscores the practical benefits of PixieGPT, positioning it as a promising solution for universities globally with similar operational frameworks.

The purpose of this study is to ​​explore the use of a custom Transformer model in brain-computer interfaces (BCIs) that translate the neural activity present when an individual with limited verbal and fine-motor skills attempts to handwrite. As found in previous studies, Transformers have performed better than recurrent neural networks (RNNs) in translation tasks which are similar to its usage here in decoding neural signals into intended handwritten text. Due to the known benefits of a Transformer, the hypothesis was that the Transformer would show promise in the context of a BCI through the recorded metrics. The neural signals of a tetraplegic individual, when they attempted to handwrite, were provided by existing research. Four trials were conducted using data with or without augmentation which the model used when training to separately minimize training loss and validation loss. When comparing the results of a BCI with the implementation of a Transformer model with the original RNN BCI (the original data source), the Transformer model performed less favorably across all four trials. Although the results do not indicate that the Transformer model currently outperforms an RNN BCI, it is important to note that further testing of the model's capabilities (such as training it with a larger and more preferable dataset and/or for longer, comparing training times between the RNN and Transformer, and/or seeing how the Transformer is improved with an offline autocorrect feature) is necessary before determining whether Transformers can enhance communication in this manner.

Deep Learning (DL) has made significant advances in computer vision with the advent of Vision Transformers (ViT). Unlike Convolutional Neural Networks (CNNs), ViTs use self-attention to extract both local and global features from image data, and then use residual connections to feed these features directly into a fully networked multilayer perceptron head. In hospitals, hematologists prepare peripheral blood smears (PBSs) and read them under a medical microscope to detect abnormalities in blood counts such as leukemia. However, this task is time-consuming and prone to human error. This study investigates the transfer learning process of Google ViT and ImageNet CNNs to automate the reading of PBSs. The study used two online PBS datasets, PBC and BCCD, and transferred them into balanced datasets to investigate the influence of data amount and noise immunity on both neural networks. The PBC results show that Google ViT is an excellent DL neural solution for data scarcity. The BCCD results show that Google ViT is superior to ImageNet CNNs in dealing with unclean, noisy image data because it is able to extract both global and local features and use residual connections, despite the additional time and computational overhead.

Safe, high-quality and economical electric energy transportation is the basic requirements of modern power system operation. Transformer, as one of the core equipment of power system and national grid system, has the characteristics of diverse types, variable models and wide deployment. It is the basic equipment for power system to realize voltage change and electric energy distribution. Because the power system transformer needs to operate with load for a long time, the probability of failure is usually higher than that of other power equipment in general. This paper starts from the transformer fault and fault diagnosis. Firstly, the transformer fault types, traditional transformer fault diagnosis techniques and the advantages of machine learning in transformer fault diagnosis are reviewed. Secondly, the application of information system theory and information entropy in transformer fault diagnosis is introduced. Then it introduces machine learning technology, feature selection and extraction technology in transformer fault diagnosis, and machine learning algorithms such as support vector machine and extreme learning machine for transformer fault diagnosis. Finally, the potential development trend of information system theory, information entropy and machine learning in transformer fault diagnosis is forecasted. The combination of transformer fault prediction and machine learning algorithm is helpful for power system maintenance personnel to accurately predict the running state of power equipment, and also provides a new method and technology for the safe and reliable operation and regular maintenance of power system.

In the realm of the five-category classification endeavor, there has been limited exploration into applied techniques for classifying Arabic text. These methods have primarily leaned on singletask learning, incorporating manually crafted features that lack robust sentence representations. Recently, the Transformer paradigm has emerged as a highly promising alternative. However, when these models are trained using single-task learning, they often face challenges in achieving outstanding performance and generating robust latent feature representations, especially when dealing with small datasets. This issue is particularly pronounced in the context of the Arabic dialect, which has a scarcity of available resources. Given these constraints, this study introduces an innovative approach to dissecting sentiment in Arabic text. This approach combines Inductive Transfer (INT) with the Transformer paradigm to augment the adaptability of the model and refine the representation of sentences. By employing self-attention SE-A and feed-forward sub-layers as a shared Transformer encoder for both the five-category and three-category Arabic text classification tasks, this proposed model adeptly discerns sentiment in Arabic dialect sentences. The empirical findings underscore the commendable performance of the proposed model, as demonstrated in assessments of the Hotel Arabic-Reviews Dataset, the Book Reviews Arabic Dataset, and the LARB dataset.

Although wireless capsule endoscopy (WCE) detects small bowel diseases effectively, it has some limitations. For example, the reading process can be time-consuming due to the numerous images generated per case, and lesion detection accuracy may rely on the operators' skills and experiences. Hence, many researchers have recently developed deep learning-based methods to address these limitations. However, they tend to select only a portion of the images from a given WCE video and analyze each image individually. In this study, we note that more information can be extracted from the unused frames and temporal relations of sequential frames. Specifically, to increase the accuracy of lesion detection without depending on experts' frame selection skills, we suggest using whole video frames as the input to the deep-learning system. Thus, we propose a new Transformer-based neural encoder that takes the entire video as the input, exploiting the power of the Transformer to extract long-term global correlation within and between the input frames. Subsequently, we can capture the temporal context of the input frames and the attentional features within a frame. Tests on benchmark datasets of four WCE videos showed 95.1% sensitivity and 83.4% sensitivity. These results may significantly advance automated lesion detection techniques for WCE images. Our code is available at https://github.com/syupoh/VWCE-Net.git.

We introduce a novel hybrid Transformer-CNN architecture for robotic grasp detection, designed to enhance the accuracy of grasping unknown objects. Our proposed architecture has two key designs. Firstly, we develop a hierarchical transformer as the encoder, incorporating the external attention to effectively capture the correlation features across the data. Secondly, the decoder is constructed with cross-layer connections to efficiently fuse multi-scale features. Channel attention is introduced in the decoder to model the correlation between channels and to adaptively recalibrate the channel correlation feature response, thereby increasing the weight of the effective channels. Our method is evaluated on the Cornell and Jacquard public datasets, achieving an image-wise detection accuracy of 98.3% and 95.8% on each dataset, respectively. Additionally, we achieve object-wise detection accuracy of 96.9% and 92.4% on the same datasets. A physical experiment is also performed using the Elite 6Dof robot, with a grasping accuracy rate of 93.3%, demonstrating the proposed method's ability to grasp unknown objects in real-world scenarios. The results of this study show that our proposed method outperforms other state-of-the-art methods.

Incorporating source-side linguistic knowledge into the neural machine translation (NMT) model has recently achieved impressive performance on machine translation tasks. One popular method is to generalize the word embedding layer of the encoder to encode each word and its linguistic features. The other method is to change the architecture of the encoder to encode syntactic information. However, the former cannot explicitly balance the contribution from the word and its linguistic features. The latter cannot flexibly utilize various types of linguistic information. Focusing on the above issues, this paper proposes a novel NMT approach that models the words in parallel to the linguistic knowledge by using two separate encoders. Compared with the single encoder based NMT model, the proposed approach additionally employs the knowledge-based encoder to specially encode linguistic features. Moreover, it shares parameters across encoders to enhance the model representation ability of the source-side language. Extensive experiments show that the approach achieves significant improvements of up to 2.4 and 1.1 BLEU points on Turkish→English and English→Turkish machine translation tasks, respectively, which indicates that it is capable of better utilizing the external linguistic knowledge and effective improving the machine translation quality.

To enhance the overall reliability of the power system, engineers have redirected their focus toward health monitoring and early detection of faults in transformers. Among these faults, transformer core defects demand particular attention. While fault simulation using software has traditionally been the preferred approach, these methods suffer from data inaccuracies in real-world conditions. Consequently, conducting actual experimental setups with induced faults is imperative to investigate core issues. This study uses Hilbert Transform (HT) as a signal processing technique to extract crucial data characteristics, thereby enhancing the performance of the classifier model. The research involves analyzing electric current signals from a single-phase 1kVA transformer. A comparative assessment of our proposed model was conducted using raw data and Fast Fourier Transform (FFT), evaluating accuracy, precision, recall, F1-score, and computational time. The results demonstrate a significant improvement in all metrics for the classifier models, particularly the k-nearest neighbor (KNN) algorithm, which exhibited values of 83.89%, 84.39%, 83.89%, 83.79%, and 0.0156 seconds, respectively. Future work aims to extend this analysis under different loading conditions.

The question of molecular similarity is core in cheminformatics, and is usually assessed via a pairwise comparison based on vectors of properties or molecular fingerprints. We recently exploited variational autoencoders to embed 6M molecules in a chemical space, such that their (Euclidean) distance within the latent space so formed could be assessed within the framework of the entire molecular set. However, the standard objective function used did not seek to manipulate the latent space so as to cluster the molecules based on any perceived similarity. Using a set of some 160,000 molecules of biological relevance, we here bring together three modern elements of deep learning to create a novel and disentangled latent space, viz transformers, contrastive learning, and an embedded autoencoder. The effective dimensionality of the latent space was varied such that clear separation of individual types of molecules could be observed within individual dimensions of the latent space. The capacity of the network was such that many dimensions were not populated at all. As before, we assessed the utility of the representation by comparing clozapine with its near neighbours, and did the same for various antibiotics related to flucloxacillin. Transformers, especially when as here coupled with contrastive learning, effectively provide one-shot learning, and lead to a successful and disentangled representation of molecular latent spaces that at once uses the entire training set in their construction while allowing ‘similar’ molecules to cluster together in an effective and interpretable way.

Accurate estimation of Remaining Useful Life (RUL) for aircraft engines is essential for ensuring safety and uninterrupted operations in the aviation industry. Numerous investigations have leveraged the success of attention-based Transformer architecture in sequence modeling tasks, particularly in its application to RUL prediction. These studies primarily focus on utilizing onboard sensor readings as input predictors. While various Transformer-based approaches have demonstrated improvement in RUL predictions, their exclusive focus on temporal attention within multivariate time series sensor readings, without considering sensor-wise attention, raises concerns about potential inaccuracies in RUL predictions. To address this concern, our paper proposes a novel solution in the form of a two-stage attention based hierarchical transformer (STAR) frame-work. This approach incorporates a two-stage attention mechanism, systematically addressing both temporal and sensor-wise attentions. Furthermore, we enhance the STAR RUL prediction framework by integrate hierarchical encoder-decoder structures to capture valuable information across different time scales. By conducting extensive numerical experiments with the CMAPSS datasets, we demonstrate that our proposed STAR framework significantly outperforms current state-of-the-art models for RUL prediction.

Social media platforms are increasingly enabling the propagation of content from groups related to drug use, thus posing risks for the wider population and, in particular, individuals who are amenable to drug use and drug addiction. The detection of drug use content on social media platforms is a priority for governments, technology companies, and drug law enforcement organizations. To counter this issue, various techniques have been developed to identify and promptly remove drug use content, while also blocking its creators from network access. In this paper, we introduce a manually annotated Twitter dataset, comprising 156,521 tweets published between 2008 and 2022, specifically compiled for the purpose of drug use detection. The dataset underwent annotation by several group of expert annotators who classified the tweets as either drug use or non-drug use. Exploratory data analysis was conducted to comprehend the dataset's characteristics. Various classification algorithms, including SVM, XGBoost, RF, NB, LSTM, and BERT were employed using the dataset. Among the traditional machine learning models, SVM utilizing term frequency-inverse document frequency features achieved the highest F1-Score (0.9017). However, BERT with textual features concatenated with numerical and categorical features in ensemble method surpassed the performance of traditional models, attaining F1-Score of 0.9112. To facilitate future research and enhance English online drug use classification accuracy, the dataset will be made publicly available.

The operation of transformers suffers from natural or man-made disasters, subjecting the equipment to prolonged exposure to temperature, lightning strikes, transient over-voltages, and over-current, gradually producing insulation aging phenomenon, which results in partial discharges within the transformer. Without dealing with it beforehand properly, it may lead to insulation breakdown. Nowadays, with the mature development of microchip control technology and wireless communication technology, which is helpful for realizing the research for online real-time and long-term monitoring capabilities for power equipment. A transformer operating condition monitoring and diagnostic system that can rapidly and effectively prevent the breakdown of transformer insulation, which can impact the overall power supply system is developed in this paper. The system is divided into two parts based on its function. The first part is the operating condition monitoring and real-time alert unit for the transformer, primarily composed of an embedded computing module, a sensor module, and a transmission module. Its work content is to capture real-time online partial discharge ultrasonic signals and high frequency current comparator pulse signals, and analyze and determine the condition of the internal insulation and operational status whether it is fault or not. The second part is the central control unit, consisting mainly of an industrial computer and a transmission module. Its work content is to store the ultrasonic and high frequency current comparator pulse signals from the transformer operation monitoring and real-time alert unit. It uses the software to eliminate signal noise and interference, and then utilizes artificial neural networks to identify the type of fault. In this paper, the research for the phenomenon of insulation degradation in transformer equipment aims to establish aging trend profiles through the dual malfunctioning alert and aging process analysis, as well as the long-term measurement of ultrasonic signals from partial discharges and high-frequency current comparator pulse signals. This approach provides crucial reference data and a foundation for disposable on-site measurement, assessing the phenomenon of insulation aging stages, defects and damage of the transformers effectively. It allows for timely replacement or maintenance in advance, achieving the prevention of malfunctioning and predictive diagnosis of aging.

Machinery degradation assessment can offer meaningful prognosis and health management in-formation. Although numerous machine prediction models based on artificial intelligence have emerged in recent years, they still face a series of challenges: (1) Many models continue to rely on manual feature extraction. (2) Deep learning models still struggle with long sequence prediction tasks. (3) Health indicators are inefficient for remaining useful life (RUL) prediction with cross-operational environments when dealing with high-dimensional datasets as inputs. This research proposes a health indicator construction methodology based on a transformer self-attention transfer network (TSTN). This methodology can directly deal with the high-dimensional raw dataset and keep all the information without missing when the signals are taken as the input of the diagnosis and prognosis model. First, we design an encoder with a long-term and short-term self-attention mechanism to capture crucial time-varying information from a high-dimensional dataset. Second, we propose an estimator that can map the embedding from the encoder output to the estimated degradation trends. Then, we present a domain dis-criminator to extract invariant features from different machine operating conditions. The case studies with the FEMTO-ST bearing dataset and the Monte Carlo method for RUL prediction during the degradation process are conducted. The experiment results fully exhibited the signif-icant advantages of the proposed method compared to other state-of-the-art techniques.

In recent times, BERT based transformer models have become an inseparable part of the 'tech stack' of text processing models. Similar progress is being observed in the speech domain with a multitude of models observing state-of-the-art results by using audio transformer models to encode speech. This begs the question of what are these audio transformer models learning. Moreover, although the standard methodology is to choose the last layer embedding for any downstream task, but is it the optimal choice? We try to answer these questions for the two recent audio transformer models, Mockingjay and wave2vec2.0. We compare them on a comprehensive set of language delivery and structure features including audio, fluency and pronunciation features. Additionally, we probe the audio models' understanding of textual surface, syntax, and semantic features and compare them to BERT. We do this over exhaustive settings for native, non-native, synthetic, read and spontaneous speech datasets

This study leverages transformer-based models and focuses on data representation strategies in the named entity recognition task, including "single" (one sentence per vector), "merged" (multiple sentences per vector), and "context" (sentences joined with attention to context). Performance analysis reveals that models trained with a single strategy may not perform well on different data representations. A combined training procedure is proposed to address this limitation, using all three strategies to enhance the stability and adaptability of the model. The results of this approach are presented and discussed for various datasets for four languages (English, Polish, Czech, and German), demonstrating the effectiveness of the combined strategy.

Buildings are responsible for approximately 40% of the world’s energy consumption and 36% of the total carbon dioxide emissions. Building occupancy is essential, enabling Occupant-Centric Control for zero emissions and decarbonization. Although existing machine learning and deep learning methods for building occupancy prediction have achieved remarked progress, their analyses remain limited when applied to complex real-world scenarios. Besides, there is a high expectation for Transformer algorithms to predict building occupancy accurately. Therefore, this paper presents an Occupancy Prediction Transformer network (OPTnet). We fuse and feed multi-sensor data (building occupancy, indoor environmental conditions, HVAC operations) into a Transformer model to forecast the future occupancy presence in multiple zones. We perform experimental analysis and compare it to different occupancy prediction methods (e.g., Decision Tree, Long Short-Term Memory networks, Multi-layer perceptron) and diverse time horizons (1,2,3,5,10,20,30mins). The performance metrics (e.g., Accuracy and Mean Squared Error) are employed to evaluate the effectiveness of prediction algorithms. Our OPTnet method achieves superior performance on our experimental two-week data compared to existing methods. The improved performance signifies its potential to enhance HVAC control systems and energy optimization strategies. We will make the code publicly available at https://github.com/kailaisun/occupancy-prediction-binary to promote transparency and reproducibility.

We demonstrate an RF photonic fractional Hilbert transformer based on an integrated Kerr micro-comb source featuring a record low free spectral range of 49 GHz. By programming and shaping the comb lines according to calculated tap weights for up to 39 wavelengths across the C-band, we achieve tunable bandwidths ranging from 1.2 to 15.3 GHz as well as variable center frequencies from baseband to 9.5 GHz, for both standard integral and arbitrary fractional orders. We experimentally characterize the RF amplitude and phase response of the tunable bandpass and lowpass Hilbert transformers with 90 and 45-degree phase shifts. The experimental results show good agreement with theory, confirming the effectiveness of our approach as a powerful way to implement standard and fractional order Hilbert transformers with broad and variable bandwidths and center frequencies, with high reconfigurability and greatly reduced size and complexity. Tan, and D. J. Moss are with the Optical Sciences Centre, Swinburne University of Technology, Hawthorn, VIC 3122, Australia. (Corresponding e-mail: [email protected]). Xu is with the Electro-Photonics Laboratory, Department of Electrical and Computer System Engineering, Monash University, Clayton, 3800 VIC, Australia

Oil immersed paper insulation condition is a crucial aspect of power transformer’s life condition diagnostic. The measurement testing database collected over the years made it possible for researchers to implement classification analysis to in-service power transformer. This article presents classification analysis of transformer oil-immersed paper insulation condition. The measurements data (dielectric characteristics, dissolved gas analysis, and furanic compounds) of 149 transformers with primary voltage of 150 kV had been gathered and analyzed. The algorithm used for developing classification model is Support Vector Machine (SVM). The model has been trained and tested using different datasets. Different models have been created and the best chosen, resulting in 90.63% accuracy in predicting the oil-immersed paper insulation condition. Further implementation was executed to classify oil-paper condition of 19 Transformers which Furan data is not available. The classification results combined, reviewed, and compared to conventional assessment methods and standards, confirming that the model developed has the ability to do classification of current oil-paper condition based on Dissolved Gasses and Dielectric Characteristics.

Utilizing deep learning for semantic segmentation of cropland from remote sensing imagery has become a crucial technique in land surveys. Cropland illustrates diverse morphologies and degrees of fragmentation on the Earth’s surface, underscoring the importance of accurately perceiving the complex boundaries of cropland which are crucial for effective segmentation. This paper introduces a UNet-like boundary-aware compensation model BAFormer. Cropland boundaries typically exhibit rapid transformations in pixel values and texture features, often appearing as high-frequency features in remote-sensing images. To enhance the recognition of these high-frequency features as represented by cropland boundaries, the proposed BAFormer integrates a Feature Adaptive Mixer (FAM) and develops a Deep Wide Large Kernel Multi-Layer Perceptron (DWLK-MLP) to enrich the global and local cropland boundaries features separately. Specifically, FAM adaptively mixes high-frequency and low-frequency features through the advantages of convolution and self-attention; DWLK-MLP expands the convolutional receptive field by deeply decomposing large kernel convolutions. The efficacy of BAFormer has been evaluated on the Vaihingen, Potsdam, and LoveDA public datasets, as well as the Mapcup dataset. It has demonstrated advanced performance, achieving mIoU scores of 84.5%, 87.3%, 53.5%, and 83.1% on these datasets respectively. Notably, BAFormer-T, the lightweight iteration of the model, surpasses other lightweight models on the Vaihingen dataset with scores of 91.3% F1 and 84.1% mIoU. The source code is available at https://github.com/WangYouM1999/BAFormer.

In recent times, models like the Transformer have showcased remarkable prowess in tasks related to natural language processing. However, these models tend to be excessively intricate and demand extensive training. Additionally, while the multi-head self-attention mechanism in the Transformer model aims to capture semantic connections between words in a sequence, it encounters limitations when handling short sequences, thereby limiting its effectiveness in 5-polarity Arabic sentiment analysis tasks. The switch-transformer model has recently emerged as a high-performing alternative. Nevertheless, when these models are trained using single-task learning, they often fall short of achieving exceptional performance and struggle to generate robust latent feature representations, especially when working with compact datasets. This challenge is particularly pronounced in the case of the Arabic dialect, which is considered a low-resource language. Given these constraints, this research introduces a novel approach to sentiment analysis in Arabic text. This method leverages multitask learning in tandem with the switch-transformer shared encoder to enhance model adaptability and refine sentence representation. By introducing a mixture of expert (MoE) mechanism that break down the problem into smaller, more manageable sub-problems, the model becomes adept at handling lengthy sequences and intricate input-output relationships, benefiting both five-point and three-polarity Arabic sentiment analysis tasks. This proposed model effectively discerns sentiment in Arabic dialect sentences. The empirical results highlight the outstanding performance of the suggested model, as evidenced in evaluations on the Hotel Arabic-Reviews Dataset, the Book Reviews Arabic Dataset, and the LARB dataset.

Smartphones are prone to SMS phishing due to the rapid growth in the availability of smart mobile technologies driven by Internet connections. Also, detecting phishing SMS is a challenging task due to the unstructured nature of SMS text data with non-linear complex correlations. In this concern, considering the recent advancements in the domain of cybersecurity, we have proposed a hybrid deep learning framework that extracts robust features from SMS texts followed by an automatic detection of Phishing SMS. Due to combining the potential capability of individual models into one hybrid framework, it has outperformed various other individual machine learning and deep learning models. The proposed Phishing Detection framework is an effective hybrid combination of pretrained transformer model, MPNet (Masked and Permuted Language Modeling), with supervised ConvNets (CNN) and Bi-directional Gated Recurrent Units (GRU). It is intended to successfully detect unstructured short phishing text messages that contain complex patterns.

This paper presents a symmetrical topology for the design of solid-state transformer, made up of power switching converters, to replace conventional bulky transformers. The proposed circuitry not only reduces the overall size but also provides power flow control with the ability to be interfaced with renewable energy resources (RESs) to fulfill the future grid requirements at consumer end. Solid state transformer provides bidirectional power flow with variable voltage and frequency operation and has the ability to maintain unity power factor, and current total harmonic distortion (THD) for any type of load within defined limits of IEEE standard. Solid State Transformer offers much smaller size as compared to that of the conventional iron core transformer. MATLAB/Simulink platform is adopted to test the validity of the proposed circuit for different scenarios by providing the simulation results evaluated at 25 kHz switching frequency.

A high step-up DC-to-DC converter that integrates an isolated transformer and a switched-clamp capacitor is presented in this study. The voltage stress of the main power switch should be clamped to 1/4 V by using the turn ratio and switched-clamp capacitor of an isolated transformer to achieve a high voltage gain. In addition, a passive clamp circuit is employed reduce voltage stress on the main power switch. The energy of the leakage inductor can be recycled by the clamp capacitor because of the passive clamp circuit, thereby improving the power converter efficiency. The converter consists of one isolated transformer, one main switch, three capacitors, and four diodes. Operating principle and steady-state analyses are also discussed. Finally, a 24-V-input voltage to 200-V-output voltage and a 150 W output power prototype converter are fabricated in the laboratory. The maximum efficiency of the converter is 95.1 at 60 W.

Visual object tracking is an important technology in camera based sensor networks, which has a wide range of practicability in auto drive system. A transformer is a deep learning model that adopts the mechanism of self-attention, and it differentially weights the significance of each part of the input data. It has been widely applied in the field of visual tracking. Unfortunately, the security of the transformer model is unclear. It makes such transformer-based applications be exposed to security threats. In this work, the security of the transformer model is investigated with the important component of autonomous driving, visual tracking. Such deep-learning-based visual tracking is vulnerable to adversarial attacks, so adversarial attacks are implemented as the security threats to conduct the investigation. First, adversarial examples are generated on top of video sequences to degrade tracking performance, and the frame-by-frame temporal motion is taken into consideration when generating perturbations over the predicted tracking results. Then, the influence of perturbations on performance is sequentially investigated and analyzed. Finally, numerous experiments on OTB100, VOT2018, and GOT-10k data sets demonstrate that the executed adversarial examples are effective on the performance drops of the transformer-based visual tracking.

In the leading/trailing edge’s adaptive machining of the near-net-shaped blade, a small portion of the theoretical part is retained for securing aerodynamic performance by manual work. However, this procedure is time-consuming and depends on the human experience. In this paper, we defined retained theoretical leading/trailing edge as the reconstruction area. To accelerate the reconstruction process, an anchor-free neural network model based on Transformer was proposed, named LETR (Leading/trailing Edge Transformer). LETR extracts image features from an aspect of mixed frequency and channel domain. We also integrated LETR with the newest meta-Acon activation function. We tested our model on the self-made dataset LDEG2021 on a single GPU and got an mAP of 91.9\%, which surpassed our baseline model, Deformable DETR by 1.1\%. Furthermore, we modified LETR’s convolution layer and named the new model after GLETR (Ghost Leading/trailing Edge Transformer) as a lightweight model for real-time detection. It is proved that GLETR has fewer weight parameters and converges faster than LETR with an acceptable decrease in mAP (0.1\%) by test results.

The ‘inverse problem’ of mass spectrometric molecular identification (‘given a mass spectrum, calculate/predict the 2D structure of the molecule whence it came’) is largely unsolved, and is especially acute in metabolomics where many small molecules remain unidentified. This is largely because the number of experimentally available electrospray mass spectra of small molecules is quite limited. However, the forward problem (‘calculate a small molecule’s likely fragmentation and hence at least some of its mass spectrum from its structure alone’) is much more tractable, because the strengths of different chemical bonds are roughly known. This kind of molecular identification problem may be cast as a language translation problem in which the source language is a list of high-resolution mass spectral peaks and the ‘translation’ a representation (for instance in SMILES) of the molecule. It is thus suitable for attack using the deep neural networks known as transformers. We here present MassGenie, a method that uses a transformer-based deep neural network, trained on ~6 million chemical structures with augmented SMILES encoding and their paired molecular fragments as generated in silico, explicitly including the protonated molecular ion. This architecture (containing some 400 million elements) is used to predict the structure of a molecule from the various fragments that may be expected to be observed when some of its bonds are broken. Despite being given essentially no detailed nor explicit rules about molecular fragmentation methods, isotope patterns, rearrangements, neutral losses, and the like, MassGenie learns the effective properties of the mass spectral fragment and valency space, and can generate candidate molecular structures that are very close or identical to those of the ‘true’ molecules. We also use VAE-Sim, a previously published variational autoencoder, to generate candidate molecules that are ‘similar’ to the top hit. In addition to using the ‘top hits’ directly, we can produce a rank order of these by ‘round-tripping’ candidate molecules and comparing them with the true molecules, where known. As a proof of principle, we confine ourselves to positive electrospray mass spectra from molecules with a molecular mass of 500Da or lower, including those in the last CASMI challenge (for which the results are known), getting 49/93 (53%) precisely correct. The transformer method, applied here for the first time to mass spectral interpretation, works extremely effectively both for mass spectra generated in silico and on experimentally obtained mass spectra from pure compounds. It seems to act as a Las Vegas algorithm, in that it either gives the correct answer or simply states that it cannot find one. The ability to create and to ‘learn’ millions of fragmentation patterns in silico, and therefrom generate candidate structures (that do not have to be in existing libraries) directly, thus opens up entirely the field of de novo small molecule structure prediction from experimental mass spectra.

In recent years, the analysis of macro- and micro-expression has drawn the attention of researchers since they provide visual cues of an individual's emotions for a broad range of potential applications such as lie detection and criminal detection. In this paper, we address the challenge of spotting facial macro- and micro-expression from videos and present compelling results by using a deep learning approach to analyze the optical flow features. Different from other deep learning approaches that are mainly based on Convolutional Neural Networks (CNNs), we propose a Transformer-based deep learning approach that predicts a score indicating the probability of a frame being within an expression interval. In contrast to other Transformer-based models that achieve high performance by being pre-trained on large datasets, our deep learning model, called SL-Swin, which incorporates Shifted Patch Tokenization and Locality Self-Attention into the backbone network Swin Transformer, effectively spots macro- and micro-expressions by being trained from scratch on small-size expression datasets. Our evaluation outcomes surpass the MEGC 2022 spotting baseline result, obtaining an overall F1-score of 0.1366. Additionally, our approach also performs well in the MEGC 2021 spotting task with an overall F1-score of 0.1824 and 0.1357 on CAS(ME)^2 and SAMM Long Videos, respectively. The code is publicly available on GitHub (https://github.com/eddiehe99/pytorch-expression-spotting).

Smart Internet of Vehicles (IoVs) combined with Artificial Intelligence (AI) will contribute to vehicle decision-making in the Intelligent Transportation System (ITS). Multi-Vehicle Pursuit games (MVP), a multi-vehicle cooperative ability to capture mobile targets, is becoming a hot research topic gradually. Although there are some achievements in the field of MVP in the open space environment, the urban area brings complicated road structures and restricted moving spaces as challenges to the resolution of MVP games. We define an Observation-constrained MVP (OMVP) problem in this paper and propose a Transformer-based Time and Team Reinforcement Learning scheme (T3OMVP) to address the problem. First, a new multi-vehicle pursuit model is constructed based on decentralized partially observed Markov decision processes (Dec-POMDP) to instantiate this problem. Second, by introducing and modifying the transformer-based observation sequence, QMIX is redefined to adapt to the complicated road structure, restricted moving spaces and constrained observations, so as to control vehicles to pursue the target combining the vehicle’s observations. Third, a multi-intersection urban environment is built to verify the proposed scheme. Extensive experimental results demonstrate that the proposed T3OMVP scheme achieves significant improvements relative to state-of-the-art QMIX approaches by 9.66%~106.25%. Code is available at https://github.com/pipihaiziguai/T3OMVP.

Fine-grained image classification remains an ongoing challenge in the computer vision field, which is particularly intended to identify objects within sub-categories. It is a difficult task since there is a minimal and substantial intra-class variance. The current methods address the issue by first locating selective regions with Region Proposal Networks (RPN), object localization, or part localization, followed by implementing a CNN Network or SVM classifier to those selective regions. This approach, however, makes the process simple by implementing a single-stage end-to-end feature encoding with a localization method, which leads to improved feature representations of individual tokens/regions by integrating the transformer encoder blocks into the Yolov5 backbone structure. These Transformer Encoder Blocks, with their self-attention mechanism, effectively captured the global dependencies and enabled the model to learn relationships between distant regions. This improved the model ability to understand context and captured long-range spatial relationships in the image. We also replaced the Yolov5 detection heads with three transformer heads at the output for object recognition using the discriminative and informative features maps from transformer encoder blocks. We established the potential of the single stage detector for the fine-grained image recognition task, by achieving state of the art 93.4% accuracy, as well as outperforming the existing Yolov5 model. The effectiveness of our approach is assessed using the Stanford car dataset, which includes 16,185 images of 196 different classes of vehicles with significantly identical visual appearances.

In the realm of power delivery to end-users, transformers are indispensable, with their malfunctions leading to substantial economic, safety, and environmental repercussions. The need for persistent surveillance is accentuated for in-situ oil-filled transformers, given the potential degradation of oil and the emergence of related ageing by-products. As the focus tilts towards online detection methodologies for transformer oil ageing, bypassing challenges associated with traditional offline methods such as sample contamination and misinterpretation, fiber optic sensors are gaining trac-tion due to their compact nature, cost-effectiveness, and resilience to electromagnetic disturbances typical in high-voltage environments. This work delves into the sensitivity analysis of intensi-ty-modulated plastic optical fiber sensors. The investigation encompasses key determinants such as the influence of optical source wavelengths, noise response dynamics, ramifications of varying sensing lengths, and repeatability assessments. Findings underscore that elongating the sensing length detrimentally affects both the linearity response and repeatability, largely attributed to the diminished resistance to external noise. Additionally, the choice of the optical source wavelength proved to be a critical variable in assessing sensor sensitivity.

Plasma generation by means of electrical discharge requires specialized power supply systems. The applicability of plasma for various plasma processes depends on its parameters, and these in turn depend on the parameters of the power supply systems. Arc plasma can be unstable, generating a lot of electromagnetic interference and overvoltage and overcurrent. The power system of a plasma reactor must guarantee good plasma control characteristics, be immune to disturbances and ensure good cooperation with the power grid. The article analyzes the cooperation of a three-phase plasma reactor, with gliding arc discharge, with a power supply system of a new type. This system integrates an AC/DC/AC converter with a five-column transformer of special design in a single device. Using the properties of magnetic circuits, it was possible to integrate the functions of ignition and sustaining the burning of the discharge in the reactor in a single transformer. Proper design of the transformer is crucial to achieve good cooperation of the AC/DC/AC converter with both the plasma reactor and the power supply network. The presented power supply design shows a number of positive features predisposing it to powering arc plasma reactors.

To realize high response and selectivity gas sensor in detecting dissolved gases in transformer oil, in this study, the adsorption of four kinds of gases (H2, CO, C2H2 and CH4) on Pd-graphyne as well as the gas sensing properties evaluation were investigated. The energetically favorable structure of Pd doped γ-Graphyne was first studied, including the comparison of different adsorption sites and discussion of electronic properties. Then, the adsorption of these four molecules on Pd-graphyne was explored. The adsorption structure, adsorption energy, electron transfer and electron distribution, the band structure and density of states were calculated and analyzed. The results show that the Pd atom prefers to be adsorbed on the middle of three C≡C bonds and the band gap is smaller. The CO adsorption exhibits the largest adsorption energy and electron transfer and brings obvious change to the structure and electron properties to Pd-graphyne. Because of the conductance decrease after adsorption CO and acceptable recovery time at high temperature, the Pd-graphyne can be promising gas sensing materials to detect CO with high selectivity. This work offers theoretical support for the design of nanomaterials based gas sensor using novel structure for industrial application.

U-Net, based on a deep convolutional neural network (CNN), has been clinically used to au-to-segment normal organs and potentially target volumes. However, CNNs with local geometric dependencies may limit the accuracy of segmentation. Additionally, the performance of CNNs can vary depending on the selection of network hyper-parameters, which was mitigated by the proposition of nnU-Net. We chose a vision transformer architecture called VT U-Net, which features a self-attention excluding the convolution layer, to overcome the limitations of CNNs by utilizing global geometric information of images. The VT U-Net v.2 became more powerful thanks to the adaptive hyper-parameter optimizer embedded in nnU-Net. However, despite leveraging the benefits of nnU-Net, VT U-Net v.2 still had additional network hyper-parameters that needed to be optimally chosen. Accordingly, among various hyper-parameters, this study attempted to find the optimal combination of the patch size and the embedded dimension regarding the transformer. From the 4-fold cross-validation, the modified VT U-Net v.2 showed the highest average performance for planning target volume (PTV) segmentation among the investigated networks. Though nnU-Net was based on convolution layers, the adaptive hyper-parameter optimizers turned out to enhance the performance. It was also confirmed that network hyper-parameters affected the segmentation accuracy of vision transformers.

Because imbalanced power will cause the loss of the propulsion motor of the railway vehicle, and the increase in temperature will shorten the service life of the electric vehicle. Not only this, but also increase the cost of electricity and maintenance. In the past, the industry only focused on methods to improve power quality such as load capacity, relay setting, and harmonic resolution. Now, the consider of three-phase unbalance rate (TPUR) must be applied. I propose special transformers wiring (STW) to improve the three unbalance rates and provide different transformer wiring methods. According to the IEEE Committee, in the future, power companies will need to install balanced relay stations to improve three-phase unbalance rate. the internal regulations of Taipower must be less than 4.5% (voltage unbalance rate (NPSUR)of 2.5% and motor temperature rise of 12.5%). the derivation of the transformer "three-phase unbalance rate" model is the focus of the railway system. This research is based on the model derivation of different wiring methods to improve the hot problem caused by the three-phase imbalance and improve the service life of the train. And pointed out that Scott, Le-Blanc, Modified-Woodbridge three wiring methods can be applied to future railway system routes to improve the three-phase unbalance rate, in line with the IEEE standard of less than 2%.

This paper develops a novel dynamic correction method for the reliability assessment of large oil-immersed power transformers. First, with the transformer oil-paper insulation system (TOPIS) as the target of evaluation and the winding hot spot temperature (HST) as the core point, an HST-based static ageing failure model is built according to the Weibull distribution and Arrhenius reaction law, in order to describe the transformer ageing process and calculate the winding HST for obtaining the failure rate and life expectancy of TOPIS. A grey target theory based dynamic correction model is then developed, combined with the data of Dissolved Gas Analysis (DGA) in power transformer oil, in order to dynamically modify the life expectancy calculated by the built static model, such that the corresponding relationship between the state grade and life expectancy correction coefficient of TOPIS can be built. Furthermore, the life expectancy loss recovery factor is introduced to correct the life expectancy of TOPIS again. Lastly, a practical case study of an operating transformer has been undertaken, in which the failure rate curve after introducing dynamic corrections can be obtained for the reliability assessment of this transformer. The curve shows a better ability of tracking the actual reliability level of transformer, thus verifying the validity of the proposed method and providing a new way for transformer reliability assessment. This contribution presents a novel model for the reliability assessment of TOPIS, in which the DGA data, as a source of information for the dynamic correction, is processed based on the grey target theory, thus the internal faults of power transformer can be diagnosed accurately as well as its life expectancy updated in time, ensuring that the dynamic assessment values can commendably track and reflect the actual operation state of the power transformers.

The fusion of global contextual information with local cropped block details is crucial for segmenting ultra-high resolution images. In this study, we introduce a novel fusion mechanism termed Global-Local Deep Fusion (GL-Deep Fusion) based on an enhanced transformer architecture, which efficiently integrates global contextual information and local details. Specifically, we propose the Global-Local Synthesis Networks (GLSNet), a dual-branch network where one branch processes the entire original image, while the other branch handles cropped local patches as input. The feature fusion of different branches in GLSNet is achieved through GL-Deep Fusion, significantly enhancing the accuracy of ultra-high resolution image segmentation. Particularly effective is GLSNet in identifying tiny overlapping items. To optimize GPU memory utilization, we meticulously design a dual-branch architecture that proficiently leverages the features it extracts, seamlessly integrating them into the enhanced transformer framework of GL-Deep Fusion. Extensive experiments conducted on challenging benchmarks, including DeepGlobe and Vaihingen datasets, demonstrate that GLSNet achieves a new state-of-the-art performance in terms of GPU memory utilization and segmentation accuracy tradeoff.

Speech emotion recognition (SER) is a technology that can be applied in distance education to analyze speech patterns and evaluate speakers’ emotional states in real-time. It provides valuable insights and can be used to enhance the learning experience by enabling the assessment of instructors’ emotional stability, a factor that significantly impacts information delivery effectiveness. Students demonstrate different engagement levels during learning activities, and assessing this engagement is an important aspect of controlling the learning process and improving e-learning systems. An important aspect that may influence student engagement is the emotional states of their instructors. Accordingly, this research uses deep learning techniques to create an automated system for recognizing instructors’ emotions in their speech when delivering distance learning. This methodology entails integrating Transformer, convolutional neural network, and long short-term memory architectures into an ensemble to enhance SER. Feature extraction from audio data used Mel-frequency cepstral coefficients, chroma, Mel spectrogram, zero crossing rate, spectral contrast, centroid, bandwidth, roll-off, and root-mean square, with subsequent optimization processes adding noise to, conducting time stretching, and shifting the audio data. Notably, several Transformer blocks were incorporated, and a multi-head self-attention mechanism was employed to identify the relationships between the input sequence segments. The pre-processing and data augmentation methodologies significantly enhanced the precision of the results in that the model achieved accuracy rates of 96.3%, 99.86%, 96.5%, and 85.3% on the Ryerson Audio-Visual Database of Emotional Speech and Song, Berlin Database of Emotional Speech, Surrey Audio-Visual Expressed Emotion, and Interactive Emotional Dyadic Motion Capture datasets. Furthermore, it achieved 83% accuracy on another dataset created for this research—the Saudi Higher Education Instructor Emotions dataset. The results demonstrate this model’s considerable accuracy in detecting emotions in speech data across different languages and datasets.

Many engineering systems are described by using differential models whose solutions, generally obtained after discretization, can exhibit a noticeable deviation with respect to the response of the physical systems that those models are expected to represent. In those circumstances one possibility consists of enriching the model in order to reproduce the physical system behavior. The present paper considers a dynamical system, and proposes enriching the model solution by learning the dynamical model of the gap between the system response and the model-based prediction, while ensuring that the time integration of the learnt model remains stable. The proposed methodology is applied on the simulation of the top-oil temperature evolution of a power transformer, whose data is provided by RTE, the French Electricity Transmission System Operator.

The paper focuses on the application of a multilevel, integrative and territorial approach to the protection of cultural heritage through planning instruments in Serbia. It points out the problems of the sectoral approach and discusses international recommendations that can be integrated into the planning methodology. The case study is the area of Djerdap National Park, which has an already established international and national importance. The research suggests that the cultural heritage in the area, with the exception of the Roman limes, is still recognized at the level of individual localities. The study emphasizes the importance of aligning all levels of governance to safeguard the whole spatial entity rather than focusing solely on its particular areas. The interna-tional and national importance of the planning area contributes to the strengthening of awareness of heritage and its institutional protection. However, the vitality of the area, which is key to its sustainable development, comes from the local level. Planning documents contribute to the inte-gration of local values and local communities into development programs and projects.

Glycosidic linkage analysis was conducted on the unfractionated polysaccharides in the alcohol-insoluble residues (AIRs) prepared from six red seaweeds (Gracilariopsis sp., Prionitis sp., Mastocarpus papillatus, Callophyllis sp., Mazzaella splendens, and Palmaria palmata) using GC-MS/FID analysis of partially methylated alditol acetates (PMAAs). The cell walls of P. palmata primarily contained mixed-linkage xylans and small amounts of sulfated galactans and cellulose. In contrast, the unfractionated polysaccharides of the other five species were rich in galactans displaying diverse 3,6-anhydro-galactose and galactose linkages with varied sulfation patterns. Different levels of cellulose were also observed. This glycosidic linkage method offers advantages for cellulose analysis over traditional monosaccharide analysis that is known for underrepresenting glucose in crystalline cellulose. Relative linkage compositions calculated from GC-MS and GC-FID measurements showed that anhydro sugar linkages generated more response in the latter detection method. This improved linkage workflow presents a useful tool for studying polysaccharide structural variations across red seaweed species. Furthermore, for the first time, relative linkage compositions from GC-MS and GC-FID measurements, along with normalized FID and total ion current (TIC) chromatograms without peak assignments, were analyzed using principal component analysis (PCA) as a proof-of-concept demonstration of the technique's potential to differentiate various red seaweed species.

Background: Educating college students about the importance of good sleep habits could lead to the adoption of healthier sleep routines, including sufficient sleep duration and sleep quality. The current pre-post study examines the impact of completing a sleep education program called “Sleep 101” on (1) sleep hygiene practices, (2) sleep quality, and (3) weekday and weekend sleep behaviors among college students. “Sleep 101” is an interactive online course developed to educate college students about the importance of sleep by addressing basic sleep physiology, the impact of sleep on mood, academic and physical performance, the interactions between sleep and various substances, and common sleep disorders. Methods: 338 college students were recruited from a midsized public university in the US and invited to participate in “Sleep 101”, of which 25 participants completed the baseline and post-intervention questionnaire. The Sleep Hygiene Index (SHI) was utilized to evaluate sleep hygiene practices, while standard questions were employed to assess weekday and weekend sleep behaviors and overall sleep quality. Results: Those who completed the study demonstrated a significant increase in weekday sleep duration and were less likely to engage in negative prior bedtime activities. In addition, 40% of those who completed baseline and post-intervention assessments noticed improvements in their sleep quality. Conclusion: These findings suggest that a brief online program is beneficial in improving sleep behaviors among college and could be a scalable approach to addressing current sleep issues and preventing future sleep problems in college students.

The profile of secondary metabolites occurring in apple cuticular layer is not only characteristic for particular apple cultivar, but also dynamically reflects various external factors in growing environment. In this study, the possibility to authenticate apple samples based on analysis of their cuticular layer extracts was investigated. Ultra-high-performance liquid chromatography coupled to high resolution tandem mass spectrometry (UHPLC-HRMS/MS) was employed for obtaining metabolomic fingerprints. In total, 274 authentic apple samples, four cultivars harvested within the seasons 2020 to 2022 in the Czech Republic and Poland were analysed. The generated complex data processed by univariate and multivariate statistical methods enabled to build classification models for discrimination of apple cultivars as well as their geographical origin. The models showed very good performance in differentiation of Czech and Polish samples for three of four cultivars: ‘Gala’, ‘Golden Delicious’ and ‘Idared’, moreover, the validity of the models was verified over harvest seasons. The diagnostic markers, besides metabolites of triterpene biosynthetic pathway, mainly represented wax esters. ‘Jonagold’, which is known to be susceptible to mutations, was the only cultivar for which the unambiguous classification of geographical origin was not possible.

Strawberry root rot caused by Neopestalotiopsis clavispora is one of the main diseases of strawberry and significantly impacts the yield and quality of strawberry fruit. There are now no effective control techniques available except for fungicide sprays, which may directly impact consumers. Biological control is becoming an alternative method for the control of plant diseases to replace or decrease the application of traditional synthetic chemical fungicides. Trichoderma is widely used as a biological agent for controlling strawberry root rot. In order to provide resources for screening the highly effective biocontrol fungus for controlling strawberry root rot caused by Neopestalotiopsis clavispora, the biocontrol mechanism,the control effects of Trichoderma asperellum CMT10 against strawberry root rot and growth-promoting effects on strawberry seedlings were investigated by plate culture, microscopy observation and root drenching methods.The results showed that CMT10 had obvious competitive, antibiotic and hyperparasitism effects on Neopestalotiopsis clavispora CMGF3. The CMT10 could quickly occupy nutritional space, and the inhibition rates of CMT10 against CMGF3 in confrontation culture on 7 d was 65.49%. The inhibition rates of volatile metabolite and fermentation metabolite produced by CMT10 against CMGF3 were 79.67% and 69.84%, respectively. The mycelium of strain CMT10 can act as hyperparasites by making contacting, winding and penetrating hyphae of CMGF3. Pot experiment showed that the biocontrol efficacy of CMT10 on strawberry root rot caused by Neopestalotiopsis clavispora was 63.00%. CMT10 had obvious promotion effect on strawberry growth, the plant height, root length, total fresh weight, root fresh weight, stem fresh weight and root dry weight, with the promotion rates were 20.09%, 22.39%, 87.11%, 101.58%, 79.82% and 72.33%, respectively. Overall, this study showed the ability of Trichoderma asperellum CMT10 to control strawberry root rot and their potential to develop as novel biocontrol agents to replace chemical fungicides for eco-friendly, sustainable agriculture.

Apis mellifera, especially weak ones, are highly vulnerable to Carpoglyphus lactis mites, which can rapidly infest and consume stored pollen, leading to weakened colonies and potentially colony collapse. This study aimed to ascertain and investigate the prevalence of this mite in honeybee colonies across 9 provinces in the Republic of Korea (ROK). A total of 615 honeybee colonies were collected, from 66 apiaries during the spring and 58 apiaries during the summer of 2023. A 1,242 bp segment of the the Cytochrome c oxidase subunit 1 (COI) gene was amplified using the polymerase chain reaction method. The detection levels of C. lactis in the honeybees were compared between winter and summer. Based on the COI sequence analysis, the nucleotide sequence similarity of C. lactis mites isolated in the ROK with those from China (NC048990.1) was found to be 99.5%, and with those from the United Kingdom (KY922482.1) was 99.3%. This study is the first report of C. lactis in Korean apiaries. The findings in this study demonstrate a significantly higher detection rate in winter, which is 4.1 times greater than that in summer (p &lt; 0.001). Furthermore, the results underscore the usefulness of molecular diagnostic techniques for detecting C. lactis mites.

COX II containing a dual core CuA active site is one of the three core subunits of mitochondrial Cco, which plays a significant role in the physiological process. In this report, the full-length cDNA of COXⅡ gene was cloned from Sitophilus zeamais, which had an ORF of 684 bp encoding 227 amino acids residues. The predicted COXⅡ protein had a molecular mass of 26.2 kDa with pI value of 6.37, and multiple sequence alignment and phylogenetic analysis indicated that Sitophilus zeamais COXⅡ had high sequence identity 78.51% with the COXⅡ of other insect species, especially similarity to sitophilus oryzae. This gene was subcloned into the prokaryotic expression vector pET-32a, and induced by IPTG in E.coli Transetta (DE3) expression system. Finally the COXⅡ with 6-His tag was purified using affinity chromatography with Ni²⁺-NTA agarose. WB showed the recombinant COXⅡ was about 44 kD, and the concentration of fusion protein was 50μg/mL. UV-spectrophotometer and infrared spectrometer analysis showed that recombinant COXⅡ could catalyze the oxidation of substrate Cytc, and influenced by AITC. It was found that AITC could form a hydrophobic region with COXⅡ protein via molecular docking, besides, a sulfur atom of AITC structure could form a length of 2.9 Å hydrogen bond with Leu-31. These results will provide valuable information for elucidating the role of COXⅡ in Sitophilus zeamais responses to AITC, meanwhile, it will helpful to carry out a point mutation in AITC binding sites for the future research.

The properties of the annual, semiannual and triennial oscillations (AO, SAO and TO) in the middle atmosphere have been investigated using the TIMED/SABER temperature data. The Lomb-Scargle and wavelet spectra were used to determine the dominant oscillations in the background temperature field. The AO is prominent at the mid-latitudes. The AO amplitudes present an asymmetry between the two Hemispheres, being larger in the mesosphere than in the stratosphere. The SAO dominates the tropical regions, with three amplitude maxima at altitudes of 45, 75, and 85 km. The SAOs in the upper mesosphere (75 km) are out of phase with those in the mesopause (85 km) in the tropical regions, which can generate an enhancement of 11 K at each equinox, contributing to the lower mesospheric inversion layer. The TO is significant in the tropical region, with amplitude being maximum at 35, 45 and 85 km. Result shows that there may be potential interaction by the TO with SAO at 85km at the equator. The relation between ENSO and TO has also been discussed. The ENSO signal may modulate the amplitude of the TO, mainly in the lower stratosphere. The real origin of the TO may lie in the wave-mean-flow interaction.

This paper is focused on typical rural settlements in the Stara Planina Mountain area in Serbia. They are distinguished by their authenticity, identity and character, and they have still not been destroyed by inappropriate development as is the case in some other mountain areas in Serbia, where the effects of urbanization, globalization and homogenization are obvious. Consequently, there is a need to prevent these effects in mountain areas where there is a threat of disbalance between development and the inherited natural and cultural values. The paper starts from several important concepts that relate contemporary approaches to cultural heritage preservation, place morphology and planning future development. The concept definitions from recent documents from related fields are used. These concepts are then applied to the area of Stara Planina Mountain and its rural settlements. The necessity for an integrative approach to planning this area with significant natural and anthropogenic potential is pointed out, including its integration into international programs of sustainable development.

The research reported on this paper was aimed at improving the overall efficiency of a PDO certified artisanal cheese production process. Being a PDO certified foodstuff by the EU, it is considered to have properties and qualities determined by the geographical environment in which is made, with its production taking place in a specific and determined geographical location, in this case the Serra da Estrela region. In that sense, the authors conducted a mapping according to a systemic perspective of the processes involved in the context of manufacturing and distribution of certified Serra da Estrela cheese. Numerous methods were used throughout the process, such as a systemic design analysis, and techniques derived from ethnographic methods, which led to the collection of data in the field and consequently provided the immersion of the researcher in genuine work situations. Critical points were identified and emphasized in the systemic map with the purpose of encouraging initiatives to address and overcome the gaps and inefficiencies detected. The systemic design analysis triggered the development of design work. Observations following an ethnographic approach identified ergonomic risks in cheese making during the process of cutting excess chips, fostering the emergence of musculoskeletal disorders at the wrist. A tool that fits best to the task at hand was developed. A prototype of the new tool enabled collecting feedback from use in the work context, in order to inform product development. The domains of agricultural production and microbiology, considering the specific microorganisms developed trough the ripening process of the cheese, turned out to be aspects of high importance for the issue under focus, contributing to a broader understanding of the ripening process and its risks, simultaneously improving the efficiency and success of cheese production. If it were not for the systemic analysis, which served as a link between the boundaries of distinct domains such as the risk of microorganism contamination, ergonomics, energy efficiency, legislation and regulation policies, transportation challenges and economic viability, approached throughout the research. Simultaneously creating bridges between them, the various problems might not have been detected in the first place, as they are usually addressed in specialized disciplines, predetermined by the restrictions of each specific area of knowledge. As a consequence of the development of this research, which was based on an analysis that sought to establish possible connections between various disciplines and tried to constantly maintain a holistic perspective, making new connections and observing the issues from a new angle, apart from the already established methodologies. All this allowed to lay out the seeds for the development of a plan to tackle the critical points identified by the systemic analysis reported in this paper.

Promoting green development has become an important way to optimize the ecological and economic structure and promote sustainable development. The Yangtze River Economic Belt is an important economic corridor in China, and it remains to be examined whether the implementation of environmental regulations has enhanced the green total factor productivity (GTFP) of cities. This paper calculates the green total factor productivity of 107 cities within the Yangtze River Economic Belt by using the super-efficient SBM model and the GML index with Chinese city panel data from 2007-2019 and measures the intensity of environmental regulations through textual analysis. The bidirectional fixed-effects model constructed in this paper suggests an inverted U-shaped relationship between environmental regulation and GTFP, which is confirmed by a series of robustness tests. Green technology innovation and advanced industrial structure play a mechanism role in this. In regions with lower levels of green technology and industrial structure, the inverted U-shaped relationship between environmental regulation and green total factor productivity is more significant. In addition, the phenomenon of GTFP rising and then falling because of environmental regulation is more obvious in cities in the middle and upper reaches of the Yangtze River and outside the urban agglomerations. Therefore, when formulating environmental regulation policies, it is necessary to balance the relationship between economic development and environmental protection and harmonize the environment and economic development of the entire Yangtze River Basin.

The wetlands in northeastern Bangladesh are home to some of the most prolific and valuable ecosystems on the planet, offering a wide range of benefits to both the local and wider communities. A limited number of research on this topic have been carried out in various wetlands in coastal hilsa, but none have been located in the northeastern region of Bangladesh. Thus, the goal of this study was to better understand the most commercially relevant species (anadromous hilsa) in northeastern Bangladesh as well as to assess the wetland ecosystem services more thoroughly with the contribution of their fish genetic resources. In addition to laboratory studies, fieldwork was done in the fishing settlements along the Surma River, Hakaluki Haor, and Tanguar Haor. The study classified 77 fish species into 21 subcategories of ecosystem services, of which 56% were not threatened, 17% were vulnerable, and 10% were highly endangered. The species Hilsa was found to be the most economically significant, accounting for 1% of the GDP overall. The study determined if the hilsa stock of the examined wetlands maintains a single or several subpopulations in comparison to other parts of the country when they migrate from saline water to northeastern Bangladesh (freshwater). But when compared to other groups, the FST score was between 0.000 to 0.017, indicating that the populations are identical and that there is genetic material sharing between them. Additionally, these statistics imply that the Sylhet haor and adjacent river systems contain a single stock of Hilsa fish. Nevertheless, a number of stresses and risks, including overexploitation, illicit and destructive fishing, siltation, and natural disasters like flash floods, have been linked to changes in the supply of hilsa and other ecosystem services. This study also emphasizes the necessity of policy attention and research to address the concerns.

In this paper, we introduce a specialized, fully automated experimental arrangement designed for assessing the effectiveness of augmented and virtual reality technologies in healthcare setting and explore its design principles focusing on depth sensor characterization. The main goal of this project is to establish a robust benchtop platform for the quantitative evaluation of extended reality technologies in a controlled environment, emphasizing the practical assessment of augmented reality head-mounted devices. We outline a design concept and considerations for an experimental configuration aimed at creating a realistic testing environment. This apparatus comprises an observation platform mounted on a three-degree-of-freedom motorized system and a test phantom stage. Focusing on real-case scenarios, we utilized a range of sensors, including readily available range-sensing cameras and commercial augmented reality headsets, such as the Intel RealSense L515 LiDAR camera, mounted on the motion control system. The setup enabled automated data collection and facilitates controlled assessments and validation of various facets of augmented reality technologies, including object, hand, and head tracking, as well as static and dynamic image registration. This paper describes the system architecture, the process of automated data collection, and presents several evaluation studies conducted with this setup, providing insights into the quality and temporal noise associated with static or moving objects or observers in augmented reality applications.

To conduct high-precision and high-resolution numerical simulation of complex flow structures in turbomachinery, a high-order finite volume weighted essentially non-oscillatory (WENO) scheme for the large eddy simulation (LES) is improved and embedded into the three-dimensional viscous unsteady CFD solver NUAA-Turbo. Firstly, the spectral characteristics and unsteady convergence of the improved WENO scheme are studied. Compared with the classical WENO scheme, the improved WENO scheme has better dissipation and dispersion characteristics and faster convergence speed. Then, the coefficient CW of the Wall-Adapting Local Eddy-viscosity (WALE) model is calibrated by decaying homogeneous isotropic turbulence (DHIT) test case. Finally, the scheme is applied to conduct high-precision LES calculations of turbulent boundary layer flow, supersonic compression corner flow, and low-pressure turbine cascade separation flow. The numerical simulation results show that this WENO scheme has excellent shock wave capture ability and turbulence resolution and can capture more flow field details with less mesh size, greatly reducing the computational cost and laying a foundation for large-scale engineering application of LES.

To secure logic circuits against the illegal copying the insertion of the so-called key bit inputs using XOR/XNOR gates has been proposed in . The inserted gates modify (lock) the behavior of the original circuit and only the correct choice of the secret key bits guarantees the equivalent behaviour of the locked circuit to the original circuit. To break this kind of security, i.e. to find the secret key bits, there was a SAT solver based attack proposed in . The aim of this work is to experimentally verify this attack on several locked circuits with various number of primary inputs and outputs and with various number of gates. Except for the random placement of the key gates we evaluate also the positioning with chaining elimination. The obtained and presented results show that we were able to unlock 10 of 11 circuits within few minutes on a common PC.

Intermetallic compounds are increasingly being expected to utilize in tribological environments, but to date the works are hindered by insufficient ductility at low and medium temperature. This paper presents a novel multiphase intermetallic alloy with the chemical composition of Mo-40Ni-13Si (at.%). Microstructure characterization reveals that a certain amount of ductile Mo phases formed during the solidification process of ternary Mo-Ni-Si alloy melt, which is undoubtedly beneficial to the ductility improvement of intermetallic alloy. Tribological properties of the designed alloy, including wear resistance, friction coefficient and metallic tribological compatibility, were evaluated under dry sliding wear test conditions at room temperature. Results suggested that the multiphase alloy possesses an excellent property for room-temperature wear applications, which is attributed to the unique microstructural features and thereby good combination in hardness and ductility. The corresponding wear mechanism is also reported by observing the worn surface, subsurface and wear debris of alloy, which to be found is soft abrasive wear.

With the integrated development of the Internet, wireless sensor technology, cloud computing, and mobile Internet, there has been a lot of attention given to research about and applications of the Internet of Things. A Wireless Sensor Network (WSN) is one of the important information technologies in the Internet of Things; it integrates multi-technology to detect and gather information in a network environment by mutual cooperation, using a variety of methods to process and analyze data, implement awareness, and perform tests. This paper mainly researches the localization algorithm of sensor nodes in a wireless sensor network. Firstly, a multi-granularity region partition is proposed to divide the location region. In the range-based method, the RSSI (Received Signal Strength indicator, RSSI) is used to estimate distance. The optimal RSSI value is computed by the Gaussian fitting method. Furthermore, a Voronoi diagram is characterized by the use of dividing region. Rach anchor node is regarded as the center of each region; the whole position region is divided into several regions and the sub-region of neighboring nodes is combined into triangles while the unknown node is locked in the ultimate area. Secondly, the multi-granularity regional division and Lagrange multiplier method are used to calculate the final coordinates. Because nodes are influenced by many factors in the practical application, two kinds of positioning methods are designed: the unknown node is in the positioning unit or not. When the unknown node is on the side of the positioning unit, we use the method of vector similarity. Moreover, we use the centroid algorithm to calculate the ultimate coordinates of unknown node. When the unknown node is not on the side of the positioning unit, we establish a Lagrange equation containing the constraint condition to calculate the first coordinates. Furthermore, we use the Taylor expansion formula to correct the coordinates of the unknown node. In addition, this localization method has been validated by establishing the real environment.

The electroencephalogram (EEG) is a record of brain activity. Brain Computer Interface (BCI) technology formed by the EEG signal has become one of the hotspots at present. How to extract the feature signal of EEG is the most basic research of BCI technology. In this paper, A new method of recognizing fatigue, conscious, concentrated state of human brain is proposed by the combination of discrete wavelet transform and the neural network based on EEG signal. First of all, the law signal is preprocessed by the wavelet denoising method because the law EEG signal contains a large number of high frequency noise, which is decomposed into multi-layer high frequency signal and low frequency signal. thus, δ wave, θ wave, α wave, β wave are obtained by the wavelet transform. And then, frequency band energy of the different wave is regards as the feature signal of EEG. In the experiment, the feature signal is classified by radial basic function (RBF) and annealed chaotic competitive learning network (ACCLN). RBF and ACCLN networks are trained with 500 sets of sample data and are tested by 100 sets of samples in different mental states. The experimental results show that the average accuracy of RBF network under three conditions are 88.75%, 88.25%, 88.5%, respectively, and the correct rate of ACCLN network is 97%, 98%, 98%, respectively.

Early discharge after childbirth has led to a rise in neonatal readmission, becoming a major concern in recent decades. Our research aimed to identify the risk factors and incidence of neonatal readmission, as well as explore preventive measures. Our study at the Clinical Hospital of Pediatrics in Ploiești, Romania included 108 neonates admitted during the neonatal period. This accounted for 2.06% of all admissions (5226). The most prevalent cases were malnutrition (25%), fever (20.3%) and bronchiolitis (17.5%). Diarrhea and infectious gastroenteritis were also observed (14.8%), along with acute rhinoconjunctivitis (9.2%) and late onset sepsis (3.7%). No deaths were recorded. The most significant characteristics identified were number of children (p&lt;0.001) and age at maternity discharge (p&lt;0.001). By following the prevention rules, malnutrition, feeding errors, and infections can be avoided. This includes practicing proper hand hygiene for both mothers and medical staff, as well as educating and demonstrating to mothers the benefits of breastfeeding. In addition, all newborns discharged from the maternity ward should benefit from follow-up at 7-10 days of life. Our results confirm the effectiveness of a multidisciplinary team and endorse promoting breastfeeding. Implementing quality control measures and regularly evaluating the surveillance program will help improve its effectiveness.

Wearable technology has been proposed as a potential tool to change the way of human life, such as the smart bracelet and the Google Glass. In the wearable technology, the inertial sensor has great significance in tracking the object movements. The paper focused on detecting the movements of user’s finger based on the inertial sensor to give the control signals. Firstly, the attitude matrix, which represented the transformation relation of carrier coordinate system and the navigation coordinate system, was obtained. Secondly, the attitude matrix was expressed based on the quaternions. Thirdly, the finger gesture was processed by the attitude matrix to get the attitude angle. Finally, the robot was controlled by attitude angle to make the moving action. The experimental results showed the detection of the finger movement is effective.

Two interesting compounds such as quaternary ammonium lignin(QAL) and 2-ethylhexyl phosphoric acid mono-2-ethylhexyl ester (P507) were synthesized as ionic liquids(QP-ILs) for the extraction of metal ions. The extraction behavior of Co(II) and Ni(II) from chloride solution was compared between QP-ILs and P507. The results showed that the extraction rates of Co(II) and Ni(II) in the two solutions varied with the extraction conditions, but QP-ILs has stronger extractability for cobalt than P507, while Ni is on the contrary. Under the same conditions, the Co/Ni separation performance(βCo/Ni) in QP-ILs is superior to that in p507. At pH4.0, 55℃, concentration of 20%, extraction time of 10 minutes, the βCo/Ni of QP-ILs reached to 2703, while that of P507 was only 164. In conclusion, QP-ILs was more efficient than P507 for separating Co from mixed solutions.

Brain aging causes a wide variety of changes at molecular and cellular levels, leading to the decline of cognitive functions and increased vulnerability to neurodegenerative disorders. The research aimed at understanding the aging of the brain has made much progress in recent decades. Technological innovations such as single-cell RNA-sequencing (scRNA-seq), proteomic analyses, and spatial transcriptomic analyses have facilitated the research on the dynamic changes occurring within neurons, glia, and other cells along with their impacts on intercellular communication during aging. In this review, we introduce recent trends of how neurons and glia change during aging and discuss the impact of the brain microenvironment such as the blood-brain barrier (BBB).

In this paper, we study the semilinear pseudo-parabolic equations $\displaystyle u_{t} - \triangle_{\mathbb{B}}u - \triangle_{\mathbb{B}}u_{t} = \left|u\right|^{p-1}u$ on a manifold with conical singularity, where $\triangle _{\mathbb{B}}$ is Fuchsian type Laplace operator investigated with totally characteristic degeneracy on the boundary $x_{1} = 0$. Firstly, we discuss the invariant sets and the vacuum isolating behavior of solutions with the help of a family of potential wells. Then, we derive a threshold result of existence and nonexistence of global weak solution: for the low initial energy $J(u_{0})<d$, the solution is global in time with $I(u_{0}) >0$ or $\displaystyle\Vert \nabla_{\mathbb{B}}u_{0}\Vert_{L_{2}^{\frac{n}{2}}(\mathbb{B})} = 0$ and blows up in finite time with $I(u_{0}) < 0$; for the critical initial energy $J(u_{0}) = d$, the solution is global in time with $I(u_{0}) \geq0$ and blows up in finite time with $I(u_{0}) < 0$. The decay estimate of the energy functional for the global solution and the estimates of the lifespan of local solution are also given.

Multimodal remote sensing data classification can enhance the model’s ability to distinguish land features through multimodal data fusion. In this context, how to help models understand the relationship between multimodal data and target tasks is the focus of researchers. Inspired by human feedback learning mechanisms, causal reasoning mechanisms, and knowledge induction mechanisms, this paper integrates causal learning, reinforcement learning, and meta learning into a unified remote sensing data classification framework and proposed the causal meta-reinforcement learning (CMRL). First, based on feedback learning mechanisms, we have overcome the limitations of traditional implicit optimization of fusion features and customized a reinforcement learning environment for multimodal remote sensing data classification tasks. Through feedback interactive learning between agents and the environment, we help them understand the complex relationships between multimodal data and labels, thereby achieving full mining of multimodal complementary information. Second, based on the causal inference mechanism we designed causal distribution prediction action, classification reward, and causal intervention reward, capturing pure causal factors in multimodal data and cutting off false statistical associations between non-causal factors and class labels. Finally, based on the knowledge induction mechanism, we designed a bi-layer optimization mechanism based on meta-learning. By constructing a meta training task and meta validation task simulation model in the generalization scenario of unseen data, we helped the model induce cross-task shared knowledge, thereby improving its generalization ability for unseen multimodal data. The experimental results on multiple sets of multimodal datasets show that the proposed method achieved state-of-the-art performance in multimodal remote sensing data classification tasks.

Moso bamboo is famous for fast growing and biomass accumulation, as well as high annual output for timber and bamboo shoots. These high outputs require high nutrient inputs to maintain and improve stand productivity. Soil nitrogen (N), phosphorus (P) and potassium (K) are important micronutrients for plant growth and productivity. Due to high variability of soils, analysing spatial patterns of soil N, P and K stocks is necessary for scientific nutrient management in Moso bamboo forests. In this study, soils were sampled from 138 locations across Yong’an City and ordinary kriging was applied for spatial interpolation of soil N, P and K stocks. Soil N stock showed a strong spatial dependence while soil N and P stocks presented a moderate spatial dependence, indicating soil N was mainly controlled by intrinsic factors while soil N and P stocks were controlled by both intrinsic and extrinsic factors. Different spatial patterns were observed for soil N, P and K stocks across the whole study area, indicating that fertilizations with different ratios of N:P:K should be applied for different sites to maintain and improve stand productivity. The total soil N, P and K stocks within 0-60 cm were 0.624, 0.020 and 0.583 Tg, respectively.

With the increasing concern of environment, the energy-efficiency scheduling of manufacturing industry is becoming urgent and popular. In turning processes, both spindle speed and processing time can affect the final energy consumption and thus the spindle speed and scheduling scheme need to be optimized simultaneously. Since the turning workshop can be regarded as the flexible flow shop, this paper formulates a mixed integer linear programming model for energy-efficient scheduling of flexible flow shop. Accordingly, a new decoding method is developed by considering of the optimization of spindle speed and scheduling scheme simultaneously, and an estimation of distribution algorithm adopting the new decoding method is proposed to solve large-size problems. The parameters of this algorithm are determined by statistical technique with a simplified practical case. In order to validate the proposed method, a case from practical factories is studied, in which the makespan can be shortened by 25.22%, and the consumed energy can be saved by 5.48%. These results demonstrate the effectiveness of the proposed mathematical model and algorithm.

Lignocellulosic biomass, an abundant and renewable resource, serves as a crucial raw material for the production of biofuels, biochemicals, and various value-added products. This paper aims to develop and optimize a mild alkaline treatment of sawdust assisted by ultrasound, along with enzymatic hydrolysis of the pretreated material. The sonochemical pretreatment with alkali emerged as the optimal approach to enhance the susceptibility of cellulose to subsequent enzymatic hydrolysis, thereby increasing the yield of reducing sugars. A comparative study was performed using various ultrasonic applicators (horn and bath) and conventional assisted alkaline pretreatment. The ultrasonic assisted pretreatment revealed a higher delignification as 68% (horn) and 57% (bath) comparing with conventional pretreatment. Processes were optimized using a statistical analysis based on a 23 factorial design. The ratio between sawdust and alkanine solution (RSL = 0.5–1.5 g/100 mL), US amplitude (A = 20–60%), and working temperature (t = 30–50 °C) were selected as process factors. The optimal operating conditions to maximize the reducing sugar yield (138.15 mg GE /gsubstrate) were found as following: solid/liquid ratio RSL,opt = 1.25 g/100 mL, US amplitude Aopt = 60%, and and pretreatment temperature topt = 50 °C. The overall outcomes clearly confirmed the intensification of delignification by ultrasound assisted alkaline pretreatment

At 12:28 UTC (8:28 PM, local time) on 15 January 2023, a shallow, moderate earthquake with a magnitude (Mw) of 4.7 and a depth of one (1) kilometer shook the northern part of Leyte Island in the central part of the Philippines. The ground shaking was felt at PHIVOLCS Earthquake Intensity Scale (PEIS) VI, (very strong) equivalent to Modified Mercalli Intensity (MMI) VI in areas along the strike of the Leyte segment of the Philippine Fault. Even though this earthquake is classified as moderate in size, significant geologic, structural, and socio-economic impacts were documented. Most of the earthquake impacts that include surface rupture, liquefaction, and mass movements are limited near the epicentral area. The earthquake produced an 8-km-long surface rupture, the first documented rupture generated by a magnitude &lt;6 along the Philippine Fault, and is unusual in other surface rupturing earthquakes worldwide. It injured 18 persons and damaged 434 residential buildings and 26 public infrastructures which amounts to about 500 thousand US dollars. Structural damages were caused by surface rupture and/or poor engineering construction practices. Analysis of the seismic waveform and recorded peak ground acceleration (PGA) suggests that the subsurface geology influenced the ground motion amplification in an area near the epicenter. Based on the hypocenter, focal mechanism solution, aftershock distribution, and actual field observation, the causative fault for this event is the northern end of the Philippine Fault – Leyte segment. Moderate in size, this earthquake emphasizes the need and importance of documenting moderate-sized earthquakes as a tool and guide for medium and long-term earthquake risk assessment and resiliency.

Background: The bacterium Capnocytophaga spp. is a part of the oral microbiome of dogs, which has zoonotic potential. This study aimed to assess factors that influence the prevalence of Capnocytophaga cynodegmi and Capnocytophaga canimorsus in Wrocaw’s dog population. Methods: Molecular detection (PCR) involved 105 swabs, examining parameters such as oral cavity condition, underlying health issues, recent antibiotics, age, medications, material collection, and dog chews. Results: The study highlighted significant associations between the presence of Capnocytophaga cynodegmi and oral cavity condition, material collection method, and use of dog’s chews. Conclusions: Correlations obtained in this study between the oral health of Wroclaw's dog population and the presence of Capnocytophaga cynodegmi suggest its significance in the oral microbiome of dogs. Limitations, including the small sample size, highlight the need for more research to comprehensively understand additional factors that affect the prevalence of Capnocytophaga spp. in dogs

A simple design of an ultrathin six-band polarization-insensitive terahertz perfect metamaterial absorber (PMMA) composed of a metal cross-cave-patch resonator (CCPR) placed over a ground plane was proposed and investigated numerically. The numerical simulation results demonstrate that the average absorption peaks are up to 95% at six resonance frequencies with high quality-factors (>65). In addition, the absorption properties can be kept stability for both normal incident transverse magnetic (TM) and transverse electric (TE) waves. The physical mechanism behind the observed high level absorption is illustrated by the electric and power loss density distributions. The different absorption mainly originates from the higher order multipolar and multipolar plasmon resonance of the structure, which are sharp different to the most previous studies of the PMMAs. Furthermore, the resonance absorption of the PMMA can be tunable by varying the geometric parameters of the unit cell.

A simple design of an ultrathin six-band polarization-insensitive terahertz perfect metamaterial absorber (PMMA) composed of a metal cross-cave-patch resonator (CCPR) placed over a ground plane was proposed and investigated numerically. The numerical simulation results demonstrate that the average absorption peaks are up to 95% at six resonance frequencies with high quality-factors (>65). In addition, the absorption properties can be kept stability for both normal incident transverse magnetic (TM) and transverse electric (TE) waves. The physical mechanism behind the observed high level absorption is illustrated by the electric and power loss density distributions. The different absorption mainly originates from the higher order multipolar and multipolar plasmon resonance of the structure, which are sharp different to the most previous studies of the PMMAs. Furthermore, the resonance absorption of the PMMA can be tunable by varying the geometric parameters of the unit cell.

The assortment of low-cost 3D printers for “in-practice” use, e.g., for clear aligner therapies, is ever increasing. To address concerns about the accuracy of orthodontic models produced on such printers when cost efficient modes of 3D printing are employed, this study examined the effect of print model body type and print angulation on accuracy. Six printing-configuration groups were included: 2 model types (solid or hollow shell) combined with 3 print angles (0°, 70°, or 90°) with 10 models/group; all models were printed with 100-µm layer thickness using a digital light processing-based 3-dimensional printer. Eleven selected structures and distances were measured on the printed models with a digital microscope and compared to the same measures on a digitized master model. The clinically-acceptability range was set at ±0.25 mm difference from the master model for single tooth measurements (intra-tooth) and ±0.5 mm for cross-arch measurements (inter-tooth). For individual measurements across all models, 98% fell within clinical acceptability. For mean measurements within each model group, only canine height for the shell-0° model had a mean difference (0.26 mm ± 0.03) outside the clinically acceptable range for intra-tooth measurements. Standard deviations for all intra-tooth measurements were within 0.07 mm. While none of the mean inter-tooth measurements exceeded the acceptability range, the standard deviations were larger (0.04 to 0.30 mm). Accuracy of orthodontic models for clear aligner therapies was not impacted beyond the clinically acceptable range when altering model body type and print angulation to improve efficiency of 3D printing. These findings suggest greater flexibility of the practitioner to alter print settings to address time and cost efficiency in various clinical scenarios and still maintain clinically acceptable model accuracy.

Background: Alfalfa, the most economically important forage legume worldwide, features modest genetic progress due to long selection cycles and large extent of non-additive genetic variance associated with its autotetraploid genome. Methods: To improve the efficiency of genomic selection in alfalfa, we explored the effects of genome parametrization (as autotetraploid and diploid dosage, plus allele ratios) and SNP marker subsetting (all available SNPs; only genic regions; only non-genic regions) on genomic regressions, together with various levels of filtering on reading depth and missing rates. We used Genotyping by Sequencing-generated data and focused on traits of different genetic complexity, i.e., dry biomass yield in moisture-favorable (FE) and drought stress (SE) environments, leaf size, and onset of flowering, assessed on 143 genotyped plants from a genetically-broad European reference population and their phenotyped half-sib progenies. Results: On average, allele ratio improved the predictive ability compared with other genome parametrizations (+7.9% vs. tetraploid dosage, +12.6% vs. diploid dosage), SNP subsetting offered an advantage compared with any tested subsettings (+3.7% vs. genic regions, +7.6% vs. non-genic regions). However, when focusing on specific traits, different combinations of genome parametrization and subsetting reached better performances. We also released Legpipe2, a SNP calling pipeline tailored for reduced representation (GBS, RAD) medium-sized genotyping experiments.

Climate change is challenging the agricultural sector worldwide. The pressure exerted by the altered thermal conditions drives the zonal shift for various cultivations. This study presents the multiyear analysis of the Growing Degree Days (GDD) index over the Northern Mediterranean Basin (NMB), focused on the high-value vine cultivation derived from the E-OBS dataset. To handle this extensive environmental dataset, R-language scripts and packages were applied, along with the capabilities of the GIS software. The investigated time period spans from 1969 to 2018, and the performed analysis indicates a broad shift/expansion in areas of GDD exceeding 2000 heat units. The extracted results specify the viticultural areas where the GDD index surpasses the suitable values for vine cultivation, owing to the increase of the thermal stress risk. In addition to mapping areas with GDD ≥ 2000, spatial calculations of the surface of areas meeting this criterion per country in the study area were made. In the northern parts of the NMB, the rise of the GDD index values indicates the establishment of vine plantations in the future.