Cerebrovascular and airway structures are tubular structures used for transporting blood and gases, respectively, providing essential support for the normal activities of the human body. Accurately segmenting these tubular structures is the basis of morphology research and patho-logical detection. Nevertheless, accurately segmenting these structures from images presents great challenges due to their complex morphological and topological characteristics. To address this challenge, this paper proposes a framework UARAI based on the U-Net multi-scale reverse at-tention network and sparse convolution network. The framework utilizes a multi-scale structure to effectively extract the global and deep detail features of vessels and airways. Further, it enhances the extraction ability of fine-edge features by a joint reverse attention module. In addition, the sparse convolution structure is introduced to improve the features' expression ability without increasing the model's complexity. Finally, the proposed training sample cropping strategy re-duces the influence of block boundaries on the accuracy of tubular structure segmentation. The experimental findings demonstrate that the UARAI-based metrics, namely Dice and IoU, achieve impressive scores of 90.31% and 82.33% for cerebrovascular segmentation and 93.34% and 87.51% for airway segmentation, respectively. Compared to commonly employed segmentation tech-niques, the proposed method exhibits remarkable accuracy and robustness in delineating tubular structures such as cerebrovascular and airway. These results hold significant promise in facilitating medical image analysis and clinical diagnosis, offering invaluable support to healthcare profes-sionals.

The adapted Posner spatial cue-target paradigm was used to explore the relationship between exogenous temporal attention caused by rhythm and endogenous and exogenous spatial attention. The study was divided into two experiments. In Experiment 1, 33 participants used arrow cues to orient endogenous spatial attention and rhythm to orient exogenous temporal attention. In Experiment 2, with 29 participants, exogenous spatial attention was directed by highlighting the cue box. Exogenous temporal attention was directed by rhythm. Experiment 1 indicated that RTs were faster for attended targets than the unattended. The main effect of temporal attention was significant, with RTs being faster for synchrony and late compared to early. RTs were faster for late compared to synchrony. The main effect of stimulus repetition was significant, with faster RTs for targets when the rhythmic cue consisted of five compared to four. The interaction between spatial attention and temporal attention was not significant. Experiment 2 demonstrated that exogenous spatial attention only exhibited IOR under early four stimulus repetitions. The main effect of temporal attention was significant, with RTs being faster for synchrony and late compared to early. The main effect of stimulus repetition was significant, with faster RTs for targets when the rhythmic cue consisted of five compared to four. The interaction between spatial attention and temporal attention was significant. The results indicated that rhythmic temporal attention supported foreperiod effects. Exogenous temporal attention and endogenous spatial attention independently affect behavior, while exogenous temporal attention and exogenous spatial attention mutually influenced behavior.

Transformer models have emerged as frontrunners in the field of natural language processing, primarily due to their adept use of self-attention mechanisms to grasp the semantic linkages between words in sequences. Despite their strengths, these models often face challenges in single-task learning scenarios, particularly when it comes to delivering top-notch performance and crafting strong latent feature representations. This challenge is more pronounced in the context of smaller datasets and is particularly acute for under-resourced languages such as Arabic. In light of these challenges, this study introduces a novel methodology for text classification of Arabic texts. This method harnesses the newly developed Reverse Positional Encoding (RPE) technique. It adopts inductive-transfer learning (ITL) framework combined with a switching self-attention shared encoder, thereby increasing the model's adaptability and improving its sentence representation accuracy. The integration of Mixture of Experts (MoE) and Reverse Positional Encoding (RPE) techniques empowers the model to process longer sequences more effectively. This enhancement is notably beneficial for Arabic text classification, adeptly supporting both the intricate five-point and the simpler ternary classification tasks. The empirical evidence points to its outstanding performance, achieving accuracy rates of 87.20% for the HARD dataset, 72.17% for the BRAD dataset, and 86.89% for the LABR dataset, as evidenced by the assessments conducted on these datasets.

Traditional 3D reconstruction models have consistently encountered a challenge: attaining high recall of object edges while preserving precision. In this paper, we introduce a post-processing method Multi-Head Attention Refiner (MA-R) aimed at tackling this challenge by integrating a multi-head attention mechanism within the U-Net style refiner module. The 3D reconstruction model applying this method demonstrates excellence in parsing intricate image details, resulting in significant enhancement of boundary predictions and increased recall rates. In our experiments, our method significantly enhances the reconstruction performance of Pix2Vox++ when multiple images are utilized as input. Specifically, it achieves an enhanced Intersection Over Union score of approximately 1.1% compared to the original Pix2Vox++ model when 16-view images are employed.

：Non-Euclidean data, such as social networks, and citation relationships between documents, has node information and structural information. Graph Convolutional Network(GCN) can automatically learn node features and association information between nodes. The core ideology of the graph convolutional network is to aggregate node information by using edge information, thereby generating a new node feature. In the process of updating node features, there are two core influencing factors. One is the number of neighboring nodes of the central node, the other is the contribution of the neighboring nodes to the central node. Due to the previous GCN methods not simultaneously considering the numbers and different contributions of neighboring nodes to the central node, we design the Adaptive Attention Mechanism(AAM). To further enhance the representational capability of the model, we utilize Multi-Head Graph Convolution(MHGC). Finally, we adopt cross-entropy(CE) loss function to describe the difference between the predicted results of node categories and the ground truth (GT). Combined with backpropagation, this ultimately achieves accurate node classification. Based on AAM, MHGC and CE, we contrive the novel Graph Adaptive Attention Network (GAAN). Experiments show that the classification accuracy has achieved outstanding performances on Cora, Citeseer and Pubmed datasets.

To address the problems of insufficient semantic fusion between text and questions and the lack of consideration of global semantic information encountered in machine reading comprehension models, we proposed a machine reading comprehension model called BERT_hybrid based on BERT and hybrid attention mechanism. In this model, BERT is utilized to separately map the text and questions into the feature space. Through the integration of Bi-LSTM, attention mechanism, and self-attention mechanism, the proposed model achieves comprehensive semantic fusion between text and questions. The probabilities distribution of answers is computed using Softmax. Experimental results on the public dataset DuReader demonstrate that the proposed model achieves improvements in BLEU-4 and ROUGE-L scores compared to existing models. Furthermore, to validate the effectiveness of the proposed model design, we analyze the factors influencing the model’s performance.

Multimodal emotion classification (MEC) involves analyzing and identifying human emotions by integrating data from multiple sources, such as audio, video, and text. This approach leverages the complementary strengths of each modality to enhance the accuracy and robustness of emotion recognition systems. However, one significant challenge is effectively integrating these diverse data sources, each with unique characteristics and levels of noise. Additionally, the scarcity of large, annotated multimodal datasets in Bangla limits the training and evaluation of models. In this work, we unveiled a pioneering multimodal Bangla dataset, MAViT-Bangla (Multimodal Audio Video Text Bangla dataset). This dataset, comprising 1002 samples across audio, video, and text modalities, is a unique resource for emotion recognition studies in the Bangla language. It features emotional categories such as anger, fear, joy, and sadness, providing a comprehensive platform for research. Additionally, we developed a framework for emotion recognition that employs a cross-modal attention mechanism among unimodal features. This mechanism fosters the interaction and fusion of features from different modalities, enhancing the model’s ability to capture nuanced emotional cues. The effectiveness of this approach was demonstrated by achieving an F1-score of 0.64, a significant improvement over unimodal methods.

With the development of deep learning, several Graph Neural Networks (GNN)-based approaches have been utilized for text classification. However, GNNs encounter challenges in capturing contextual text information within a document sequence. To address this, a novel text classification model RB-GAT is proposed by combining RoBERTa-BiGRU embedding and a multi-head Graph ATtention Network (GAT). First, the pre-trained RoBERTa model is exploited to learn word and text embeddings in different contexts. Second, the Bidirectional Gated Recurrent Unit (BiGRU) is employed to capture long-term dependencies and bidirectional sentence information from the text context. Next, the multi-head graph attention network is applied to analyze this information, which serves as a node feature for the document. Finally, the classification results are generated through a Softmax layer. Experimental results on three benchmark datasets demonstrate that our method can achieve an accuracy of 71.48%, 98.45%, and 80.32% on Ohsumed, R8, and MR, which is superior to the existing nine text classification approaches.

With the development of deep learning, the Super-Resolution (SR) reconstruction of microscopic images has improved significantly. However, the scarcity of microscopic images for training, the underutilization of hierarchical features in original Low Resolution (LR) images, and the high-frequency noise unrelated with the image structure generated during reconstruction process are still challenges in the Single Image Super-Resolution (SISR) field. Faced with these issues, we first collected sufficient microscopic images through Motic, a company engaged in the design and production of optical and digital microscopes, to establish a dataset. Secondly, we proposed a Residual Dense Attention Generative Adversarial Network (RDAGAN). The network comprises a generator, an image discriminator, and a feature discriminator. The generator includes a Residual Dense Block (RDB) and a Convolutional Block Attention Module (CBAM), focusing on extracting the hierarchical features of the original LR image. Simultaneously, the added feature discriminator enables the network to generate high-frequency features pertinent to the image’s structure. Finally, we conducted experimental analysis and compared our model with six classic models. Compared with the best model, our model improved PSNR and SSIM by about 1.5dB and 0.2, respectively.

Selecting road networks in cartographic generalization has consistently posed formidable challenges, driving research towards the application of intelligent models. Despite previous efforts, the accuracy and connectivity preservation in these studies, particularly when dealing with road types of similar sample sizes, still warrant improvement. To address these shortcomings, we introduce a Heterogeneous Graph Attention Network (HAN) for road selection, where feature masking method is initially utilized to assess the significance of road features. Concentrating on the most relevant features, two meta-paths are introduced within the HAN framework: one for aggregating features of the same road type within the first-order neighborhood, emphasizing local connectivity, and another extending this aggregation to the second-order neighborhood, capturing a broader spatial context. For a comprehensive evaluation, we introduce a set of metrics considering both quantitative and qualitative aspects of the road network. Compared to traditional neural networks, our HAN model demonstrates superior accuracy and F1-score, particularly for road types with comparable samples. Additionally, it enhances the overall connectivity of the selected network. In summary, our HAN-based method provides an advanced solution for road network selection, surpassing previous approaches in terms of accuracy and connectivity preservation.

In virology, the term reverse genetics refers to a set of methodologies in which changes are introduced into the viral genome and their effects on the generation of infectious viral progeny and their phenotypic features are assessed. Reverse genetics emerged thanks to advances in recombinant DNA technology, which made the isolation, cloning, and modification of genes through mutagenesis possible. Most virus reverse genetics studies depend on our capacity to rescue an infectious wild-type virus progeny from cell cultures transfected with an “infectious clone”. This infectious clone generally consists of a circular DNA plasmid containing a functional copy of the full-length viral genome, under the control of an appropriate polymerase promoter. For most DNA viruses, reverse genetics systems are very straightforward, since DNA virus genomes are relatively easy to handle and modify and are also (with few notable exceptions) infectious per se. This is not true for RNA viruses, whose genomes need to be reverse transcribed into cDNA before any modification can be done. Establishing reverse genetics systems for members of the Caliciviridae has proven exceptionally challenging, due to the low number of members of this family that propagate in cell culture. Despite the early successful rescue of a calicivirus from a genome-length cDNA more than two decades ago, reverse genetics methods are not routine procedures that can be easily extrapolated to other members of the family. Reports of calicivirus reverse genetics systems have been few and far between. In this review, we discuss the main pitfalls, failures, and delays behind the generation of several successful calicivirus infectious clones.

Real-time object detection remains a pivotal topic in the realm of computer vision. Balancing the accuracy and speed of object detectors poses a formidable challenge for both academic researchers and industry practitioners. While recent transformer-based models have showncase the prowess of the attention mechanism, delivering remarkable performance improvements over CNNs, their computational demands can hinder their effectiveness in real-time detection tasks. In this paper, we elect to use YOLOX as our robust starting point and introduce a series of effective enhancements, culminating in a new high-performance detector named YOLOAX. To further exploit the power of the attention mechanism, we devise multi-dimensional attention-based modules that activate CNNs, emphasizing the most pertinent regions and bolstering the capacity to learn the most informative image representations from feature maps. Moreover, we introduce a novel leading label assignment strategy called STA, along with a groundbreaking loss function named GEIOU Loss, to further refine our detector's performance. We provide extensive ablation studies on the COCO and PASCAL VOC 2012 detection datasets to validate our proposed methods. Remarkably, our YOLOAX is trained solely on the MS-COCO dataset from scratch, without leveraging any prior knowledge, which achieves an impressive 54.2% AP on the COCO 2017 test set while maintaining a real-time speed of 72.3 fps, surpassing YOLOX by a significant margin of 3.0% AP. Our source code and pre-trained models are openly accessible at https://github.com/KejianXu/yoloax.

In recent years, electroencephalogram (EEG) emotion recognition has emerged as a research hotspot in the field of artificial intelligence (AI). Despite advancements in EEG-based emotion recognition, room for enhancing performance persists due to EEG signal redundancy and limitations in feature extraction, leading to inefficient models and emotional information loss. To fully utilize EEG's emotional information and improve recognition accuracy while reducing computational costs, this paper proposes a Convolutional-Recurrent Hybrid Network with a dual-stream adaptive approach and an attention mechanism (CSA-SA-CRTNN). Firstly, the model utilizes a CSAM module to assign corresponding weights to EEG channels. Then, an adaptive dual-stream convolutional-recurrent network (SA-CRNN and MHSA-CRNN) is applied to extract local spatial-temporal features. After that, the extracted local features are concatenated and fed into a temporal convolutional network with a multi-head self-attention mechanism (MHSA-TCN) to capture global information. Finally, the extracted EEG information is used for emotion classification. We conducted binary and ternary classification experiments on the DEAP dataset, achieving 99.26% and 99.15% accuracy for arousal and valence in binary classification, and 97.69% and 98.05% in ternary classification, surpassing relevant algorithms. Additionally, the model's efficiency is significantly higher than other models, achieving better accuracy with lower resource consumption.

With the rapid developments that have been made in computer vision and computer technology, semantic segmentation of high-resolution images has emerged as a mainstream and challenging task. The, segmentation of water areas remains a complex task due to the similar features between water areas or between water areas and other land objects. Meanwhile, since coastlines and riverbanks are typically presented in irregular shapes, it is difficult to obtain the categories of pixels at boundaries. This paper proposed the use of a Water-Land Boundary Attention Network (WLBANet) to improve the accuracy of pixels at boundaries between water and land. This network also reinforced the performance of contextual information extraction into distinguishing between water areas and other land objects. To prove the validity of this proposed network, WLBANet was performed on the Water Land Dataset (WLD), which is also by this paper, and which contains water areas and other land objects categories. The results demonstrates that the proposed method has significant effectiveness.

For a number of reasons, a curative treatment for most chronic diseases is still unrealized [2–4] and the incidence of many chronic diseases is rapidly increasing [5–9]. A new model is offered as a solution; that being the individualized diagnosis of homeostasis, leading to the correction of epimutations. Individuals with chronic diseases are increasingly being defined by their epigenetic signatures [10,11]. Modern innovations in toxicogenomic studies are also becoming more accurate in their ability to identify the unique epigenetic signature of each toxin [12–14]. Hormesis studies (over 5,000) [15] suggest a universal principle, that a small dose is always a stimulant [16–18].These three facts present an opportunity; a method to diagnose and reverse chronic disease tendencies. This new model requires a paradigm shift in our understanding of disease origins: that dysfunctions in homeostasis [19,20] are the primary and deepest level of chronic disease causation. This is the level where the diagnosis needs to be made and where the corrections need to take place [21].

The objective of person re-identification (ReID) tasks is to match a specific individual across different times, locations, or camera viewpoints. The prevalent issue of occlusion in real-world scenarios affects image information, rendering the affected features unreliable. The difficulty and core challenge lie in how to effectively discern and extract visual features from human images under various complex conditions, including cluttered backgrounds, diverse postures, and the presence of occlusions. Some works have employed pose estimation or human keypoint detection to construct graph-structured information to counteract the effects of occlusions. However, this approach introduces new noise due to issues such as the invisibility of keypoints. Our proposed module, in contrast, does not require the use of additional feature extractors. Our module employs multi-scale graph attention for the reweighting of feature importance. This allows features to concentrate on areas genuinely pertinent to the re-identification task, thereby enhancing the model's robustness against occlusions. To address these problems, a model that employs multi-scale graph attention to re-weight the importance of features is proposed in this study, significantly enhancing the model’s robustness against occlusions. Our experimental results demonstrate that, compared to baseline models, the method proposed herein achieves a notable improvement in mAP on occluded data sets, with increases of 0.5%, 31.5%, and 12.3% in mAP scores.

To enhance the safety of power grid operations, this study proposes a high-precision short-term photovoltaic power prediction method that integrates information from surrounding pho-tovoltaic stations and the Conv-LSTM-ATT model. In the deep learning prediction model, not only is numerical weather prediction (NWP) data from the target photovoltaic station used as input features, but also highly correlated features from nearby photovoltaic stations are incor-porated. The research begins by analyzing the correlation between irradiance and power se-quences, along with distance factors, to calculate a composite similarity index between the target and other regional photovoltaic stations. Stations with high similarity indices are then selected as data sources. Subsequently, Bayesian optimization techniques are employed to find the optimal data fusion ratios. Ultimately, using the selected data, power prediction mod-eling is conducted via the Conv-LSTM-ATT deep neural network. Experimental results con-firm the superiority of the proposed model, which demonstrates higher predictive accuracy compared to three other classical models. The data fusion strategy determined by Bayesian optimization significantly enhances prediction accuracy, reducing the root mean square error (RMSE) of the test set by 20.04%, 28.24%, and 30.94% for three weather types, respectively.

The learning equations of an ANN are presented, giving an extremely concise derivation based on the principle of backpropagation through the descendent gradient. Then, a reflection is developed on the dual attention network that applies the learning equations and coordinates subnetworks toward purposeful behaviors. Speculation is made on possible developments of functionalities that could provide additional skills and at the same time shed light on competencies typical of ``natural intelligence".

(1) Background: TNF inhibitors (TNFi) have revolutionized the treatment of rheumatoid arthritis (RA). However, 30-40 % of RA patients do not respond adequately to those biologics. In addition to neutralizing soluble TNF, TNFi have the ability to bind the transmembrane form of TNF, tmTNF. Importantly, tmTNF can act itself as a receptor that induces a “Reverse Signaling” (RS) in cells. We previously showed that certolizumab, a Fab’ TNFi, activates RS in human primary monocytes, at least in part through the transcription factor NRF2 that is known to regulate the expression of genes involved in anti-inflammatory response and oxidative stress. (2) Methods: Here, we have developed an assay for the prediction of clinical response of RA patients to TNF inhibitors. This assay is based on mRNA quantitation of CD36 activation and of 6 genes induced by NRF2 following tmTNF RS in fresh monocytes. (3) Results: We could predict the response to anti-TNF monoclonal antibodies (mAbs) with 93.3 % accuracy. However, our method was not suitable for the prediction of the response to TNF soluble receptor etanercept. (4) Conclusions: We have developed a rather simple, short-term, test that can be standardized. Predicting the response to TNF mAbs will help physicians offer the best available treatment and provide patients with personalized medicine.

In today’s fast paced, attention-demanding society, executive functions and attentional resources are often taxed. Individuals need ways to sustain and restore these resources. We first review the concepts of attention and restoration, as instantiated in Attention Restoration Theory (ART). ART emphasizes the role of nature in restoring attention. We then discuss essentials of experiments on the causal influences of nature. Next, we expand the concept of ART to include modern, designed environments. We propose a wider perspective termed attentional ecology, in which attention behavior is viewed within a larger system involving the human and their interactions over time with environmental demands. When the ecology is optimal, mental functioning can be a positive “flow” that is productive, sustainable for the individual, and sometimes creative.

Attention deficit hyperactivity disorder (ADHD) is the most common childhood-onset neurodevelopmental disorder characterized by difficulty maintaining attention, impulsivity and hyperactivity. Although the cause of this disorder is still unclear, recent studies state that heredity is important in the development of ADHD. This is linked to a few comorbidities: depression, criminal behavior and anxiety. Although genetic factors play a major role in the pathogenesis of ADHD, there are also non-genetic factors, one of which would be oxidative stress (OS) that are associated with ADHD. OS is implicated in the pathogenesis of ADHD, through lower levels of antioxidant enzymes such as glutathione peroxidase (GPx), catalase (CAT), and superoxide dismutase (SOD), as well as a lower total antioxidant status (TOS) compared to control groups. Moreover, there is a close bidirectional connection between the nervous system and the intestinal microbiota, and the communication between the two systems is carried out through the gut-brain axis (GBA). A thorough review of diet, OS implications, mechanism of action, pharmacokinetics, and drug-drug interactions are reviewed here, with a special focus on treatment in adults with comorbid conditions.

Microscopic vision plays an important role in automated micro-assembly. However, some uncertain factors in the assembly process, such as occlusion and stains can lead to the mistakes of feature extraction. Herein, to solve the problem, the deep learning techniques are introduced into the feature recognition tasks, focusing on the attention mechanism and visualizing CNNs for DL-based microscopic vision. The main contributions are summarized as follows: The CBAM attention mechanism is combined with the YOLOv5 algorithm to improve the accuracy and robustness of feature extraction. The micropart feature occlusion experiment results show that at 70% occlusion degree, YOLOV5-CBAM can reach 97.9% [email protected], which is 4.6% higher than the original one. Visualization analysis of DL-based model is conducted using Grad-CAM to make the decision result more transparent and avoid potential visual detection risks during assembly. The heatmap matching degree between GT area and high-light area is increased by 27.81% on average, which further verify the effectiveness of attention mechanism in micropart feature localization. Additionally, micropart surface stain and droplet quality classification models based on ResNet50 are trained to replace the manual sorting. The visual results are consistent with human eye discernment and judgement, confirming the reliability of parts and droplets sorting.

Vaccination has been one of the most successful and the most significant scientific advances in human health and life expectancy all around the globe. The World Health Organization considers that immunization should be recognized as the main component of human health right, due to the fact that vaccination prevents 2.5 million deaths annually (World Health Organization, 2011). The most successful vaccines have been developed using conventional methods that follow the paradigm established by Pasteur: "to isolate, inactivate and inject" the pathogen microorganism and mimic a natural infection. Recently, metagenomics have played an important role in the discovery of new immunogens for vaccine design and the selection of antigens based on genomic information. The main approach that has used this strategy has been called "reverse vaccinology". This promising and arising field allows the screening of the entire potential antigenic repertoire of an organism using predictive bioinformatic tools. Once the antigenic protein or proteins have been selected, they are expressed and purified using molecular cloning and in vitro expression techniques. Following the in vitro production step, they are probed in animal models to evaluate the in vivo protective strength of the immune response. The main aim of this in vivo approach is to evaluate the ability of the immune response to eliminate or neutralize the pathogen at the time of infection. Those antigens capable of generate a specific immune response with neutralizing activity for natural infections are the best candidate vaccines. In this review we summarize the evolution of vaccinology since its inception, with special emphasis on the development of VLPs as vaccine platforms and their future in preventive medicine and we introduce a new recombinant platform for antigen presentation based on Junin virus VLPs (JUNV-VLPs).

A two-stage pilot plant study has been completed that evaluated the performance of a reverse osmosis (RO) membrane process for the treatment of a feedwater that consisted of a blend of nanofiltration (NF) concentrate and brackish groundwater. Membrane performance was assessed by monitoring the process operation, collecting water quality data, and documenting the blended feedwater’s impact on fouling due to a combination of, or solely caused by, plugging, scaling, microbiological, or organic means. Fluorescence and biological activity reaction tests were used to identify the types of organics and microorganisms present in the blended feedwater. Additionally, scanning electron microscopy (SEM) and energy dispersive x-ray spectroscopy (EDS) were used to analyze suspended matter that collected on the surfaces of cartridge filters used in the pilot’s pretreatment system. SEM and EDS were also used to evaluate solids collected on the surfaces of 0.45-µm silver filter pads after filtering known volumes of NF concentrate and RO feedwater blends. Water quality analyses confirmed that the blended feedwater contained little to no dissolved oxygen, and the blended feedwater was absent of a significant amount of particulate matter as defined by silt density index and turbidity measurements. However, water quality results suggested that the presence of sulfate, sulfide, iron, anaerobic bacteria, and humic acid organics likely contributed to the formation of pyrite observed on some of the membrane surfaces autopsied at the conclusion of pilot operations. It was determined that first-stage membrane productivity was impacted by the location of cartridge filter pretreatment; however, second-stage productivity was maintained with no observed flux decline during the entire pilot operation’s timeline. Study results indicated that the operation of an RO process treating a blend of NF concentrate and brackish groundwater could maintain a sustainable and productive operation that provided a practical zero-discharge process operation while the dilution of RO feedwater salinity would lower overall production costs.

Underwater image often exhibit detail blurring and color distortion due to light scattering, impurities, and other influences, obscuring essential textures and details. This presents a challenge for existing super-resolution techniques in identifying and extracting effective features, making high-quality reconstruction difficult. This research aims to innovate underwater image super-resolution technology to tackle this challenge. Initially, an underwater image degradation model was created by integrating random subsampling, Gaussian blur, mixed noise, and suspended particle simulation to generate a highly realistic synthetic dataset, thereby training the network to adapt to various degradation factors. Subsequently, to enhance the network's capability to extract key features, improvements were made based on the symmetrically structured Blind Super-Resolution Generative Adversarial Network (BSRGAN) model architecture. An attention mechanism based on energy functions was introduced within the generator to assess the importance of each pixel, and a weighted fusion strategy of adversarial loss, reconstruction loss, and perceptual loss was utilized to improve the quality of image reconstruction. Experimental results demonstrate that the proposed method achieved significant improvements in Peak Signal-to-Noise Ratio (PSNR) and Underwater Image Quality Measure (UIQM) by 0.85 dB and 0.19, respectively, significantly enhancing the visual perception quality and indicating its feasibility in super-resolution applications.

In recent years, graph neural networks (GNNs) have become a promising method for analyzing data structured in graph format. By considering connections between entities in a graph, GNNs are able to extract valuable insights. One notable variation of GNN is the graph attention network (GAT), which employs the attention mechanism and has demonstrated promising performance in various applications. However, its ability to incorporate feature information from nodes beyond the immediate neighborhood is limited, leading to degraded performance on heterophilic data. To address this limitation, this thesis proposes a novel attention-based model, namely the Directional Graph Attention Network (DGAT). This model combines the feature-based attention with the global directional information extracted from the graph topology, as inspired by the Directional Graph Network (DGN). A new class of Laplacian matrices is proposed and an existing theoretical result on DGN is extended. This extension bridges a gap in the literature. The experimental results presented in the thesis, based on nine real-world benchmarks and ten synthetic data sets, demonstrate the superiority of the proposed DGAT model compared to the GAT baseline model. Particularly on heterophilic data sets, DGAT showed a notable average increase of approximately 35% in node classification tasks across all heterophilic real-world data sets. In addition, DGAT outperforms GAT by an average margin of around 51% in all ten synthetic data sets with various levels of heterophily

The ribonuclease H (RNase H) active site of HIV-1 reverse transcriptase (RT) is the only viral enzyme not targeted by approved antiretroviral drugs. Using a fluorescence-based in vitro assay, we screened 65,239 compounds at a final concentration of 10 µM to identify inhibitors of RT RNase H activity. We identified 41 compounds that exhibited 50% inhibitory concentration (i.e., IC50) values < 1.0 µM. Two of these compounds, 2-(4-methyl-3-(piperidin-1-ylsulfonyl)phenyl)benzo[d]isothiazol-3(2H)-one (1) and ethyl 2-(2-(3-oxobenzo[d]isothiazol-2(3H)-yl)thiazol-4-yl)acetate (2), which both share the same benzisothiazolone pharmacophore, demonstrate robust antiviral activity (50% effective concentrations of 1.68 ± 0.94 µM and 2.68 ± 0.54, respectively) in the absence of cellular toxicity. A limited structure-activity relationship analysis identified two additional benzisothiazolone analogs, 2-methylbenzo[d]isothiazol-3(2H)-one (3) and N,N-diethyl-3-(3-oxobenzo[d]isothiazol-2(3H)-yl)benzenesulfonamide (4), which also resulted in inhibition of RT RNase H activity and virus replication. Compounds 1, 2 and 4, but not 3, inhibited the DNA polymerase activity of RT (IC50 values ~ 1 to 6 µM). In conclusion, benzisothiazolone derivatives represent a new class of multifunctional RT inhibitors that warrants further assessment for the treatment of HIV-1 infection.

With the advancement of technology, signal modulation types are becoming increasingly diverse and complex. The phenomenon of signal time-frequency overlap during transmission poses significant challenges for the classification and recognition of mixed signals, including poor recognition capabilities and low generality. This paper presents a recognition model for fine-grained analysis of mixed signal characteristics, proposing a Geometry Coordinate attention mechanism and introducing a low-rank bilinear pooling module to more effectively extract signal features for classification. The model employs a residual neural network as its backbone architecture and utilizes the Geometry Coordinate attention mechanism for time-frequency weighted analysis based on information geometry theory. This analysis targets multiple-scale features within the architecture, producing time-frequency weighted features of the signal. These weighted features are further analyzed through a low-rank bilinear pooling module, combined with the backbone features, to achieve fine-grained feature fusion. This results in a fused feature vector for mixed signal classification. Experiments were conducted on a simulated dataset comprising 39,600 mixed signal time-frequency plots. The model was benchmarked against a baseline using a residual neural network. The experimental outcomes demonstrated an improvement of 9% in the exact match ratio and 5% in the Hamming score. These results indicate that the proposed model significantly enhances the recognition capability and generalizability of mixed signal classification.

A significant portion of fatalities stemming from acute myocardial infarction (AMI) occur suddenly and without warning. This can be prevented through early detection of coronary stenosis. In recent years, coronary artery calcium (CAC) and computed tomography coronary angiography (CTCA) have been utilized. For instance, a 55-year-old interventional cardiologist had a CAC of 58 with 50% stenosis involving his left anterior descending (LAD) artery. Despite possibly having vulnerable plaque, which carries significant future cardiovascular events, the patient followed a plant-based diet (PBD), took supplements, and continued optimal medical therapy (OMT). After three years, there was a significant regression in both CAC and stenosis. During our discussion, we emphasized the importance of food selection, quantification, and how food is processed (raw) to achieve maximal benefit in regressing atherosclerosis. Additionally, we highlighted the importance of identifying the possibility of vulnerable plaque and the mechanism stabilizing it. The case supported the guidelines set by the American College of Cardiology (ACC) and the American Heart Association (AHA) for managing chronic coronary syndrome (CCS) by emphasizing OMT and lifestyle changes. We hope that in the future, more doctors and patients will take responsibility for implementing lifestyle changes rather than solely relying on medications and sophisticated medical technologies.

The increase in carbon dioxide emissions has a significant impact on human society and the global environment. As the most abundant and cheap C1 resource, the conversion and utilization of carbon dioxide has received extensive attention from researchers. In many methods of carbon dioxide conversion and utilization, the reverse water gas conversion reaction is considered to be one of the most effective ways. In this paper, the research progress of reverse water gas conversion reaction in recent years is introduced.

Most of the existing influence maximization algorithms are not suitable for large-scale social networks due to their high time complexity or limited influence propagation range. Therefore, a D-RIS influence maximization algorithm is proposed based on the independent cascade model and combined with the reverse reachable set sampling. Under the premise that the influence propagation function satisfies monotonicity and submodularity, the D-RIS algorithm uses automatic debugging method to determine the critical value of the number of reverse reachable sets, which not only obtains a better influence propagation range, and greatly reduce the time complexity. The experimental results on the two real data sets of Slashdot and Epinions show that D-RIS algorithm is close to the CELF algorithm and higher than RIS algorithm, HighDegree algorithm, LIR algorithm and pBmH algorithm in influence propagation range. At the same time, it is significantly better than the CELF algorithm and RIS algorithm in running time, which indicates that D-RIS algorithm is more suitable for large scale social network.

Inspired by the forward and the reverse channels from the image-size characterization problem in network information theory, we introduce a functional inequality which unifies both the Brascamp-Lieb inequality and Barthe's inequality, which is a reverse form of the Brascamp-Lieb inequality. For Polish spaces, we prove its equivalent entropic formulation using the Legendre-Fenchel duality theory. Capitalizing on the entropic formulation, we elaborate on a "doubling trick" used by Lieb and Geng-Nair to prove the Gaussian optimality in this inequality for the case of Gaussian reference measures.

Addressing real-time aircraft target detection in microsatellite-based visible light remote sensing video imaging requires considering the limitations of imaging payload resolution, complex ground backgrounds, and the relative positional changes between the platform and aircraft. These factors lead to multi-scale variations in aircraft targets, making high-precision real-time detection of small targets in complex backgrounds a significant challenge for the detection algorithms. Hence, this paper introduces a real-time aircraft target detection algorithm for remote sensing imaging using an improved lightweight attention mechanism that relies on the YOLOv7 framework (SE-CBAM-YOLOv7). The proposed algorithm replaces the standard convolution (Conv) with a lightweight convolutional SEConv to reduce the computational parameters and accelerate the detection process of small aircraft targets, thus enhancing real-time onboard processing capabilities. Besides, the SEConv-based SPPCSPC (Spatial Pyramid Pooling and Connected Spatial Pyramid Convolution) module extracts image features. It improves detection accuracy while the feature fusion section integrates the CBAM hybrid attention network, forming the CBAMCAT module. Furthermore, it optimizes small aircraft target features in channel and spatial dimensions, improving the model's feature fusion capabilities. Experiments on public remote sensing datasets reveal the proposed SE-CBAM-YOLOv7 improves detection accuracy by 3% and mAP value by 4.2% compared to YOLOv7, significantly enhancing the detection capability for small-sized aircraft targets in satellite remote sensing imaging.

Since the first published genome sequence of Trypanosoma cruzi in 2005, there has been tremendous technological advance in genomics, reverse genetics, and assay development for this elusive pathogen. However, there is still an unmet need for new and better drugs to treat Chagas disease. Here we introduce a T. cruzi assay strain that is useful for drug research as well as basic studies in host-pathogen interaction. Trypanosoma cruzi STIB980 is a strain of discrete typing unit TcI that grows well in culture as axenic epimastigotes or intracellular amastigotes. We have evaluated the optimal parameters for genetic transfection and constructed derivatives of T. cruzi STIB980 that express reporter genes for fluorescence- or bioluminescence-based drug efficacy testing, as well as a Cas9-expressing line for CRISPR/Cas9-mediated gene editing. The genome of T. cruzi STIB980 was sequenced by combining short-read Illumina with long-read Oxford Nanopore technologies. The latter served for the primary assembly, the former to correct mistakes and fill the gaps. This resulted in a high-quality nuclear haplotype assembly of 28 Mb in 400 contigs, containing 10,043 open-reading frames with a median length of 1077 bp. We believe that T. cruzi STIB980 is a useful addition to the antichagasic toolbox, and propose that it can serve as a DTU TcI reference strain for drug efficacy testing.

Nonsteroidal anti-inflammatory drugs (NSAIDs), which block the activity of cyclooxygenase (COX) isoenzymes and inhibit the synthesis of prostaglandin, have been used for pain relief. We have developed a method to separate a mixture of three NSAIDs, such as aspirin, paracetamol, and naproxen, using reverse-phase high-performance liquid chromatography (RP-HPLC). An isocratic mobile phase consisting of acidic water and acetonitrile was selected to run at a low flow rate, such as 0.8 mL/min. The mixture of three NSAIDs was injected at a low volume into a C18 column that was 150 mm in length and characterized using a UV detector at 230 nm. We identified three peaks in the chromatogram indicating the three compounds. The elution time of the peaks was less than 10 minutes. To identify multiple peaks on the isocratic flow using a short column, further studies are required regarding the proposed method to generate microfluidic devices for nanoLC.

Reverse engineering is applied to identify optimum polymerization conditions for the synthesis of polymer with pre-defined properties. The proposed approach uses multi-objective optimization (MOO) and provides multiple candidate polymerization procedures to reach the targeted polymer property. The objectives for optimization include maximal similarity of molar mass distributions (MMD) compared to the target MMD, minimal reaction time, and maximal monomer conversion. The method is tested for vinyl acetate radical polymerizations and can be adopted to other monomers. The data for the optimization procedure is generated by an in-house developed kinetic Monte-Carlo (kMC) simulator for a selected recipe search space. The proposed reverse engineering algorithm comprises several steps: kMC simulations for the selected recipe search space to derive initial data, performing MOO for a targeted MMD, and identification of the Pareto optimal space. The last step uses a weighted sum optimization function to calculate the weighted score of each candidate polymerization conditions. To decrease the execution time clustering of the search space based on MMDs is applied. The performance of the proposed approach was tested for various target MMDs. The suggested MOO-based reverse engineering provides multiple recipe candidates depending on competing objectives.

Mobile devices have become tools we spend our free time where we carry them with us every moment, they allow us to interact with the environment, we immortalize the moment when necessary. These devices which we spend most of our daily life become very common in recent years and even there are unique business areas emerged. It was announced that the number of people using smartphones is over than 2.5 billion in the first quarter of 2016. As people become more addicted to mobile technology, they become the target of malevolent people. A huge increase in the number of mobile malware is observed as the number of the users increase. Billions of users at risk day by day due to the development of the methods. We have addressed the recent methods used and the types of malware that target mobile devices in our study. We have mentioned the proxy server and reverse proxy server operation logic. We discuss the method of turning mobile devices into reverse proxy servers, risks involved and protection methods.

One of the most crucial elements in deeply understanding humans on a psychological level is manifested through facial expressions. The analysis of a human behavior can be informed by their facial expressions, making it essential to employ indicators such as expression (Expr), valence-arousal (VA), and action units (AU). In this paper, we introduce the method proposed in the Challenge of the 6th Workshop and Competition on Affective Behavior Analysis in-the-wild (ABAW) at CVPR 2024. Our proposed method utilizes the multi-modal Aff-wild2 dataset, which is splitted into spatial and audio modalities. For the spatial data, we extract features using a SimMiM model that was pre-trained on a diverse set of facial expression data. For the audio data, we extract features using a WAV2VEC model. To fusion the extracted spatial and audio features, we employed the cascaded cross-attention mechanism of a transformer.

Recently, attention mechanisms have developed into an important tool for performance improvement of deep neural networks. In computer vision, attention mechanisms are generally divided into two main branches: spatial and channel attention. Both attention categories have their own advantages. The fusion of both attentions achieves higher performance, on the cost of the computational load. This paper introduces an innovative and lighter n-shifted sigmoid channel and spatial attention (CSA) module to reduce the computational cost and to improve the 3D scene relevant features selection. To validate the proposed attention module, 3D scene object detection in the deep Hough voting point sets is considered as the testing application. The proposed attention module with its piecewise n-shifted sigmoid activation function improves the network’s learning and generalization capacity which effectively predict bounding box parameters directly from 3D scenes and detect objects more accurately. This advantage is achieved by selectively attending to more relevant features of the input data. When used in the deep Hough voting point sets, the proposed attention module outperforms state-of-the-art 3D detection methods on the sizable SUNRGBD dataset. Experiments conducted showed an increase of 12.02 mean accuracy precision (mAP) when compared to the celebrated VoteNet (without attention). It also got 9.92 mAP higher compared to the MLVCNet, and 10.32 mAP higher than the Point Transformer. The proposed model not only decreases the sigmoid vanishing gradient problem but also brings out valuable features by fusing channel-wise and spatial information while improving accuracy results in 3D object detection.

Enamel erosion is a process which happens every time we eat and it may be accelerated by some particular acid foods, drinks or other agents. Dental enamel when damaged by low pH substances becomes chalky, rough, opaque, yellowed and it can be related to dentinal hypersensitivity. To the present day, several possible solutions are available, therefore the aim of this study was to evaluate the effect of a biocompatible minerals serum based on calcium silicate, sodium phosphate and fluoride (Regenerate™) on the damaged enamel by four different acid liquids. 135 ovine teeth were equally divided into 5 groups and submerged for one week into lemon juice, energy drink, coffee, tea and physiologic solution for the negative control. The first 4 groups were evaluated for their color with an analogical color scale (Vita® Scale) and for their surface assigning a qualitative aspect among opaque, rough, chalky or smooth. Then they were treated with hydroxyapatite gels and re-evaluated for the same parameters. Data were checked for the normal distribution with Shapiro-Wilk test and analyzed with dependent t-test or Wilcoxon Signed Rank test, every test with a p≤0.05. Both color and surface aspect showed a strongly significant improvement after the treatment. Biocompatible minerals serum based on hydroxyapatite is able to reverse teeth erosion, improve the color and restore the smoothness of the dental enamel.

To efficiently use its finite resources, the visual system selects for further processing only a subset of the rich sensory information. Visual masking and spatial attention control the information transfer from visual sensory-memory to visual short-term memory. There is still a debate whether these two processes operate independently or interact, with empirical evidence supporting both arguments. However, recent studies pointed out that earlier studies showing significant interactions between common-onset masking and attention suffered from ceiling and/or floor effects. Our review of previous studies reporting metacontrast-attention interactions revealed similar artifacts. Therefore, we investigated metacontrast-attention interactions by using an experimental paradigm in which ceiling/floor effects were avoided. We also examined whether metacontrast masking is differently influenced by endogenous and exogenous attention. We analyzed mean absolute-magnitude of response-errors and their statistical distribution. Our results support the hypothesis that metacontrast and endogenous/exogenous attention are largely independent with negligible likelihood for interactions. Moreover, statistical modeling of the distribution of response-errors suggests weak interactions modulating the probability of “guessing” behavior for some observers in both types of attention. Nevertheless, our data suggest that any joint effect of attention and metacontrast can be adequately explained by their independent and additive contributions.

Anomaly detection and segmentation aim at distinguishing abnormal images from normal images and further localizing the anomalous regions. Feature reconstruction based method has become one of the mainstream methods for this task. This kind of method has two assumptions: (1) The features extracted by neural network is a good representation of the image. (2) The autoencoder solely trained on the features of normal images cannot reconstruct the features of anomalous regions well. But these two assumptions are hard to meet. In this paper, we propose a new anomaly segmentation method based on feature reconstruction. Our approach mainly consists of two parts: (1) We use a pretrained vision transformer (ViT) to extract the features of the input image. (2) We design a self-attention autoencoder to reconstruct the features. We regard that the self-attention operation which has a global receptive field is beneficial to the methods based on feature reconstruction both in feature extraction and reconstruction. The experiments show that our method outperforms the state-of-the-art approaches for anomaly segmentation on the MVTec dataset. It is both effective and time-efficient.

With the widespread adoption of 3D scanners, reverse engineering methods for obtaining CAD drawings from physical objects have become increasingly utilized. When converting point data obtained from a 3D scanner into a mesh structure, a smoothing process is typically applied because the point data often contains a lot of noise. However, this can result in the loss of important high-frequency details, or in cases where significant high-frequency information remains, there are limitations in representing the object with basic geometric shapes. In this paper, a method to address this issue by using environment mapping and supervised learning techniques is proposed. By mapping the object to an environment and then using supervised learning to analyze the data, it can accurately identify the basic geometric shapes. This approach reduces the working time and allows for easier design of complex surfaces that were previously difficult to model.

Flood routing in flood forecasting issue, calculation the height of flood bands, determining the river boundaries, and estimation of protective facilities for flood –exposed building is applicable. In many cases, due to the lack of measuring stations, the status of the upstream flood generating hydrograph is not known. The purpose of this study is to present an integrated method comprising of an optimization model and a hydrodynamic numerical model for flood modeling to determine the upstream hydrograph using the provided hydrograph at the downstream measuring station of a river. The routing procedure consists of three steps: (1) generating a hypothetical upstream hydrograph using genetic algorithm method; (2) hydrodynamic modeling using a numerical simulation model for flood routing according to the hypothetical hydrograph which is generated in the first step; (3) compare the calculated and observed hydrograph in downstream by using a fitness function. This recommended procedure was named as Reverse Flood Routing Method (RFRM) and was then applied to Karun River, the largest river in Iran. Comparing the generated upstream hydrograph by the RFRM model with the corresponding measured hydrograph at Ahvaz hydrometric station, as an ungauged river location, shows the high accuracy of the recommended model in this study.

Recent studies on the image of the Turin Shroud (TS) lead to think it could have been formed through a not well-identified mechanism of energy radiation. In order to remove some lacunas about this imaging process, a reverse engineering method has been applied to it, arriving to exclude some possible mechanisms. The image formation of a human face wrapped on a cloth by using an ad-hoc developed software has been simulated. The results of different kinds of the radiation depending from different parameters have been simulated, each one connected with accredited hypotheses. On the basis of the comparison among the different images produced by the software and the TS Face, some useful information both about the kind of radiation and the cloth wrapping conditions have been obtained. The effect of image distortion of a cloth wrapped around a face has been discussed too by defining the best laws of radiation and of their attenuation with distance. A Lambertian law is not compatible with the TS image. A vertical radiation shows a problem in reproducing the requested resolution. A radiation perpendicular to the emitting surface, like that produced by an electric field appears promising to explain the TS Face.

In this preliminary investigation, a concise molecular docking study using the Pyrx program screened thousands of compounds against the active site of HIV-1 reverse transcriptase. The Virtual Screening library was employed to assess binding energetics scores, focusing on identifying candidates with high Vina Scores. Eight compounds, including Tetrophan, Imatinib, Amentoflavone, Alprazolam, Bilobetin, Bafetinib, Nilotinib, and Ginketin, emerged as promising candidates with significant binding energies.Recognizing compounds that strongly bind to HIV-1 reverse transcriptase holds potential for antiretroviral drug development in the fight against HIV infection. Subsequently, the study evaluated the toxicity properties of these candidates using pKCSM. Amentoflavone, a natural biflavonoid found in Ginkgo biloba and Nilotinib, a tyrosine kinase inhibitor, demonstrated lower overall toxicity profiles compared to other candidates. Further toxicity analysis using Pro-Tox-II revealed Amentoflavone's higher predictive LD50, lower toxicity class, and reduced probabilities of hepatotoxicity, carcinogenicity, mutagenicity, and moderate immunotoxicity compared to Nilotinib. While Nilotinib, a pharmaceutical drug, exhibited higher probabilities of adverse effects in these categories. In summary, Amentoflavone and Nilotinib present as promising candidates with lower toxicity concerns. Amentoflavone, as a natural substance, showcases a more favorable toxicity profile than Nilotinib, offering valuable insights for potential therapeutic applications.

Glioblastoma (GBM) presents a significant public health challenge as the deadliest and most common malignant brain tumor in adults. Despite standard-of-care treatment, which includes surgery, radiation, and chemotherapy, mortality rates are high, underscoring the critical need for advancing GBM therapy. Over the past two decades, numerous clinical trials have been performed, yet only a small fraction demonstrated benefit, raising concerns about the predictability of current preclinical models. Traditionally, preclinical studies utilize treatment-naïve tumors, failing to model the clinical scenario where patients undergo standard-of-care treatment prior to recurrence. Recurrent GBM generally exhibits distinct molecular alterations influenced by treatment selection pressures. In this review, we discuss the impact of treatment - surgery, radiation, and chemotherapy - on GBM. We also provide a summary of treatments used in preclinical models, advocating for their integration to enhance the translation of novel strategies to improve therapeutic outcomes in GBM.

Verification of inclusivity of molecular detection methods gives indications on the reliability of viral infections diagnosis because of the tendency of viral pathogens to undergo sequence variation. This study was aimed to select inclusive probe based reverse transcription quantitative PCR (RT-qPCR) assays for the diagnosis of the most widespread and detrimental viruses infecting honeybees, namely the acute bee paralysis virus (ABPV), the black queen cell virus (BQCV), the chronic paralysis bee virus (CBPV), the deformed wing virus variants A (DWVA) and B (DWVB), and the sacbrood virus (SBV). Therefore, detection methods previously described were re-evaluated in silico for specificity and inclusivity. Based on this evaluation, selected methods were modified or new ones were designed and tested in duplex RT-qPCR reactions. The limits of detection (LODs), effect of multiplexing on sensitivity and viral RNA quantification potential in bees and hive debris were assessed. This study made available diagnostic assays able to detect an increased number of virus variants compared to previously described tests and two viral pathogens in a single PCR reaction.

The neural system has limited resources to interact with the environment, and this is where attention comes into play. Attention is a complex process that provides numerous benefits, but there has been a longstanding debate about the mechanisms involved in attentional orientation. Two widely proposed mechanisms are top-down and bottom-up, which relate to the organism's current behavioral goal and the salience of environmental stimuli, respectively. However, distinguishing between these mechanisms can be challenging in both behavioral and neural studies. This review introduces a new conceptualization in which both top-down and bottom-up mechanisms are viewed as aspects of the same process. This unified approach aims to prepare the organism to face stimuli and events based on its prior experiences, immediate (the current task that he/she is aware of), and innate (to be alive) demands.

One of the most leading causes of death worldwide is Colorectal cancer(CRC). Polyp segmentation is the most important detected measure for preventing CRC. However, there is still a missing rate for diminutive polyps and multiple ones. In order to solve the phenomenon, we propose to introduce auxiliary attention module(AAM) that can enhance the learning of features related to multiple and diminutive polyps by focusing more on the located and detailed information. Meanwhile, we design to decrease missed rate of multiple and diminutive polyps by implementing an area adaptive loss(AAL) which adapts the weight according to the area and the number of polyps. Our proposed novel AAM and AAL concentrates on training with hard examples and localized information. To evaluate the effectiveness and generalization ability of our proposed model, We utilize three different datasets of variable sizes and a cross dataset. Our proposed method achieves the best results on the Kvasir-SEG dataset, the CVC-ClinicDB dataset and the cross dataset, particularly for the Kvasir-Sessile dataset consisting of small,flat and diminutive polyps. Extensive experimental results show that our proposed DoubleAANet surpass the performance of all existing state-of-the-art segmentation methods.

Focusing on the problem of identifying and classifying aero-engine models, this paper measures the infrared spectrum data of aero-engine hot jets using a telemetry Fourier transform infrared spectrometer. Simultaneously, infrared spectral data sets with the six different types of aero-engines are created. For the purpose of classifying and identifying infrared spectral data, a CNN architecture based on the continuous wavelet transform peak seeking attention mechanism (CWT-AM-CNN) is suggested. This method calculates the peak value of middle wave band by continuous wavelet transform, and the peak data is extracted by the statistics of the wave number locations with high frequency. Attention mechanism is used for the peak data, and the attention mechanism is weighted to the feature map of the feature extraction block. The training set, vali-dation set and prediction set are divided in the ratio of 8:1:1 for the infrared spectral data sets. For three different data sets, CWT-AM-CNN proposed in this paper is compared with the classical classifier algorithm based on CO2 feature vector and the popular AE, RNN and LSTM spectral processing networks. The prediction accuracy of the proposed algorithm in the three data sets is as high as 97%, and the lightweight network structure design not only guarantees high precision, but also has a fast running speed, which can realize the rapid and high-precision classification of the infrared spectral data of the aero-engine hot jets.

Making sustainable business models, especially in manufacturing, is a key approach for organizations to adopt in order to create more sustainable processes. New technologies are needed to implement new policies that can minimize the economic, environmental, and social consequences of industrial activity. Sustainable maintenance is decisive to guarantee the availability, reliability, and safety of assets, surpassing traditional maintenance policies and embracing the principles of the circular economy. The main objective of Maintenance 4.0 is to increase the lifespan and availability of the equipment by preventing unplanned downtime, reducing planned shutdowns, and improving safety. This research focuses on the integration of advanced Industry 4.0 tools with conventional monitoring and control techniques in process industries. The article suggests that while complex neural networks might provide good predictions, simpler solutions can generalize well and have lower prediction errors because they can capture the underlying relationships between variables in a specific asset better. The combination of maintenance function, Industry 4.0 tools, and advanced statistical solutions to obtain sustainable processes can facilitate organizational change and aid decision-making in equipment management. These solutions seek to reduce interruptions and expenses through the unnecessary utilization of labor and spare parts. All these considerations improve communication and data processing, resulting in improved maintenance of a hydrogen compressor in the petrochemical industry.

Attention Deficit Hyperactivity Disorder (ADHD) it is known as a neuropsychiatric disorder. Anatomicaly components with implications in this previously mentioned disorder, are the anterior cingulate gyrus and dorsolateral prefrontal cortex (DLFPC) that are are found having a role in appearing this disease. ADHD is associated with cognitive and functional deficits that relate to diffuse abnormalities in the brain. ADHD is a specific pathology in children but may persisit to youth and also not so hard to find to adults.Till now, hard to find the curative treatment knowing ADHD as a neuropsychiatric disorder with enlarge unknown scientific points. Genetic and environmental component play an important role in diagnosis. Patients life style, a relevant history of individual geneticsand environmental factors are important in diagnosisThe management of ADHD, is also an important part togeter with future trends.

Teeth segmentation plays a pivotal role in dental diagnosis, treatment, planning, and the development of computer-aided dental systems. It enables precise identification and analysis of dental structures, aiding in detecting dental abnormalities, measuring tooth dimensions, and assessing oral health conditions. Accurate teeth segmentation also facilitates the automation of dental workflows, leading to improved efficiency and reduced human error. Artificial Intelligence (AI) has witnessed rapid advancements, with various approaches developed or enhanced. While Convolutional Neural Networks (CNNs) have been widely used in medical image segmentation, the U-Net architecture has emerged as a standout performer due to its exceptional segmentation capabilities. This paper presents a proof of concept for the Attention U-Net architecture, as previously used in [1], applied to teeth segmentation. The study demonstrates the superior performance of this network in accurately segmenting teeth using a newly available benchmark dataset called Tufts Dental X-Ray Dataset. When trained and tested on 10-fold cross-validation, the model achieved an average dice coefficient of 95.01%, intersection over union of 90.6%, and pixel accuracy of 98.82%. These scores surpass those of all other networks implemented on the same dataset. By leveraging the Attention U-Net architecture, our research showcases the potential of advanced AI techniques in dental radiography. The findings contribute to the ongoing efforts to develop automated systems to assist dental professionals in their clinical practice.

Reverse water gas shift reaction (RWGS) is an important process which plays a vital role in many CO2 utilization related reactions. Noble metals are the most active catalysts in RWGS, but the high price and low reserve strangled their applications. In the present work, we reported a non-transition-metal MgAl2O4 catalyst which showed outstanding activity and stability at high temperatures in the RWGS reaction and improved performance after doping of single atomic Nin+. The catalyst can obtain 46% of CO2 conversion in durability test of 75 h at 800 °C under high weight hourly space velocities (225 000 ml g-1 h-1). The adsorption sites, possible reaction route, and effects of Nin+ single atoms on the (111) surface of MgAl2O4 for RWGS were investigated by in situ DRIFTS and DFT calculations. The results indicated that the rate determining reaction step of RWGS on MgAl2O4 and Ni (SA)/MgAl2O4 were both the reaction of OH* + H* → H2O* + *, but the energy barrier was significantly reduced after introducing single atomic Nin+. Nin+ atoms can increase the hydroxyl coverage on the surface of catalyst and Al3+ sites near the Nin+ ion are considered as the predominant active sites for RWGS reactions.

This review explores the complex interrelationships between emotion, attention, and behavior, drawing upon empirical evidence from psychological, neuroscientific, and clinical studies. It delves into the neural mechanisms that underlie these interactions, with a focus on key brain regions such as the prefrontal cortex and amygdala. Clinical cases involving stroke and attention-deficit/hyperactivity disorder (ADHD) are examined to illustrate the real-world implications of these cognitive interactions. The review also discusses the impact of effective emotion regulation strategies and the role of attention as a cognitive mechanism that influences both emotion and behavior. Neuroimaging studies, particularly functional MRI, are highlighted for their role in providing a deeper understanding of these intricate relationships. The review concludes by emphasizing the importance of this triadic relationship in adaptive functioning and its broader implications for mental health, interpersonal relationships, and quality of life.

The demand for precise indoor localization services is steadily increasing. Among various methods, fingerprint-based indoor localization has become a popular choice due to its exceptional accuracy, cost-effectiveness, and ease of implementation. However, its performance degrades significantly as a result of multipath signal attenuation and environmental changes. In this paper, we propose an indoor localization method based on fingerprints using self-attention and long short-term memory (LSTM). By integrating a self-attention mechanism and LSTM network, the proposed method exhibits outstanding positioning accuracy and robustness in diverse experimental environments. The performance of the proposed method is evaluated under two different experimental scenarios, which involve 2D and 3D moving trajectories, respectively. The experimental results demonstrate that our approach achieves an average localization error of 1.76 m and 2.83 m in the respective scenarios, outperforming the existing state-of-the-art methods by 42.67% and 31.64%.

FV (finger vein) identification is a biometric identification technology that extracts the features of FV images for identity authentication. To address the limitations of CNN-based FV identification, particularly the challenge of small receptive fields and difficulty in capturing long-range dependencies, an FV identification method Let-Net(Large kernel and attention mechanism Network) was introduced, which combines local and global information. Firstly, Let-Net employs large kernels to broaden the receptive field and incorporates depthwise convolution with residual connections to reduce parameter count. Secondly, Let-Net integrates an attention mechanism to enhance the information flows in channels and spaces for more comprehensive and distinctive FV feature extraction. The experimental results on nine public datasets show that Let-Net has excellent identification performance, and the EER and accuracy rate on the FV_USM dataset can reach 0.04% and 99.77%. The parameter number and FLOPs of Let-Net are only 0.89M and 0.25G, which means that the time cost of training and reasoning of the model is low, and it is easier to deploy and integrate into various applications.

Multispectral image (MSI) and hyperspectral image (HSI) fusion (MHIF) aims to address the challenge of acquiring high-resolution (HR) HSI images. This field combines a low-resolution (LR) HSI with an HR-MSI to reconstruct HR-HSI. Existing methods directly utilize transformers to perform feature extraction and fusion. Despite the demonstrated success, there exist two limitations: 1) Employing the entire transformer model for feature extraction and fusion fails to fully harness the transformer’s potential in integrating the spectral of the HSI and spatial information of the MSI. 2) HSI has a strong spectral correlation and exhibits sparsity in the spatial domain. Existing transformer-based models do not optimize this physical property, which makes their methods prone to spectral distortion. To accomplish these issues, this paper introduces a novel framework for MHIF called Sparse Mix-Attention Transformer (SAMformer). Specifically, to fully harness the advantages of the Transformer architecture, we propose a Spectral Mix Attention Block (SMAB), which concatenates the keys and values extracted from LR-HSI and HR-MSI to create a new multi-head attention module. This design facilitates the extraction of detailed long-range information across spatial and spectral dimensions. Besides, to address the spatial sparsity inherent in HSI, we incorporated a sparse mechanism within the core of SMAB called Sparse Spectral Mix Attention Block (SSMAB). In the SSMAB, we compute attention maps from queries and keys and select the K highly correlated values as the sparse attention map. This approach enables us to achieve a sparse representation of spatial information while eliminating spatially disruptive noise. Extensive experiments conducted on three benchmark datasets, namely Cave, Harvard, and Pavia Center, demonstrate the SMAformer method outperforms state-of-the-art methods.

Recently deep cross-modal hashing networks have received increasing interests due to its superior query efficiency and low storage cost. However, most of existing methods concentrate less on hash representations learning part, which means the semantic information of data cannot be fully used. Furthermore, they may neglect the high-ranking relevance and consistency of hash codes. To solve these problems, we propose a Self-Attention and Adversary Guided Hashing Network (SAAGHN). Specifically, it employs self-attention mechanism in hash representations learning part to extract rich semantic relevance information. Meanwhile, in order to keep invariability of hash codes, adversarial learning is adopted in the hash codes learning part. In addition, to generate higher-ranking hash codes and avoid local minima early, a new batch semi-hard cosine triplet loss and a cosine quantization loss are proposed. Extensive experiments on two benchmark datasets have shown that SAAGHN outperforms other baselines and achieves the state-of-the-art performance.

Music and language are hypothesized to share neural resources, particularly at the level of syntax processing. Recent reports suggest that attention modulates this sharing of neural resources, but the time-course of the effects of attention, and the degree to which attention operates similarly on music and language, are yet unclear. In this EEG study we manipulate the syntactic structure of simultaneously presented musical chord progressions and garden-path sentences in a modified rapid serial visual presentation paradigm, while varying top-down attentional demands to the two modalities. The Early Right Anterior Negativity (ERAN) was observed in response to both attended and unattended musical syntax violations. In contrast, an N400 was only observed in response to attended linguistic syntax violations, and a P3 only in response to attended musical syntax violations. Results show that top-down allocation of attention indeed affects the processing of syntax in both music and language, with different neural resources acting upon the two modalities particularly at later stages of cognitive processing. However, the processing of musical syntax at an earlier stage of the perceptual-cognitive pathway, as indexed by the ERAN, is partially automatic, and is strongly indicative of separate neural resources for music and language.

As hematite ores become lower in grade, finer in grain size, and more complex in compositions, their beneficiation by froth flotation to produce the high Fe grade concentrate has become increasingly more difficult. A systematic and in-depth process mineralogy study based on the multi-element chemical and MLA analysis combined with other characterization techniques was conducted to explore the fundamental reasons for difficulties in refractory hematite flotation separation. The results show that the valuable mineral in the sample was mainly hematite and gangue mineral was primarily quartz. Hematite had a fine particle size distributed over a range of 0~45 μm with a degree of mineral liberation of 90.19%. The particle size of quartz was relatively coarse and was mainly distributed in the range of 20~150 μm with a liberation degree of only 67.72%. Unliberated quartz was mainly associated with hematite and the composite particle content was 36.44%. The rougher flotation tests produced a flotation concentrate of 66.71% TFe grade at a recovery of 65.47%. The screening analysis results with rougher flotation products indicated that the main reasons for the poor performance of rougher flotation were the serious entrainment of fine hematite particles and the difficulty in effective collection of coarse low-grade composite particles. Possible approaches for improving hematite flotation performance have been proposed based on the results from this study.

This paper presents an overview of the principal structural and dynamics characteristics of reverse micelles (RMs) in order to highlight their structural flexibility and versatility, along with the possibility to modulate their parameters in a controlled-manner. The multifunctionality in a large range of different scientific fields is exemplified in two distinct directions: a theoretical model for mimicry of biological microenvironment and practical application in the field of nanotechnology and nano-based sensors. RMs represents a convenient experimental approach that limits the drawbacks of the conventionally biological studies in vitro, while the particular structure confers them the status of simplified mimics of cells by reproducing a complex supramolecular organization in an artificial system. The biological relevance of RMs is discussed in some particular cases referring to the confinement and crowding environment, molecular dynamics of water and cell membrane structure. The use of RMs in different range of applications seems to be more promising due to their structural and compositional flexibility, a high efficiency and selectivity being achieved. The advance in nanotechnology is based on developing new methods of nanomaterials synthesis and deposition. This review highlighting the advantages of using RMs in synthesis of nanoparticles with specific properties and in nano (bio)sensors design.

In this paper, a two-stage stochastic programming modelling is proposed to design a multi-period, multistage, and single-commodity integrated forward/reverse logistics network design problem under uncertainty. The problem involves both strategic and tactical decision levels. The first stage deals with strategic decisions, which are the number, capacity, and location of forward and reverse facilities. At the second stage tactical decisions such as base stock level as an inventory policy is determined. The generic introduced model consists of suppliers, manufactures, and distribution centers in forward logistic and collection centers, remanufactures, redistribution, and disposal centers in reverse logistic. The strength of proposed model is its applicability to various industries. The problem is formulated as a mixed-integer linear programming model and is solved by using Benders’ Decomposition (BD) approach. In order to accelerate the Benders’ decomposition, a number of valid inequalities are added to the master problem. The proposed accelerated BD is evaluated through small-, medium-, and large-sized test problems. Numerical results reveal that proposed solution algorithm increases convergence of lower bound and upper bound of BD and is able to reach an acceptable optimality gap in a convenient CPU time.

This project investigates the behavior of multi-head attention in Transformer models, specifically focusing on the differences between benign and trojan models in the context of sentiment analysis. Trojan attacks cause models to perform normally on clean inputs but exhibit misclassifications when presented with inputs containing predefined triggers. We characterize attention head functions in trojan and benign models, identifying specific 'trojan' heads and analyzing their behavior.

Remote sensing imagery is of great significance for policy decisions, especially for disaster assessment and disaster relief. To ensure the privacy and inviolability of personal buildings, the information containing these buildings must be anonymized during the remote sensing mapping process. Traditional processing methods for these targets in remote sensing mapping are mainly based on manual retrieval and image editing tools, which are inefficient. Deep learning provides a new direction for target hiding. Although the image inpainting method based on deep learning is faster than the manual method, the cost of training calculation is a disadvantage. And the element-wise product operation used in the model increases the risk of vanished or exploded gradients. We propose a Residual Attention Target Hiding (RATH) model for remote sensing target hiding based on deep learning. RATH uses residual attention modules to replace gated convolutions, reducing parameters and mitigating gradient issues. The residual attention module preserves gated convolution performance but provides an adjustable kernel size. RATH retains gated convolutions for dynamic feature selection and balances model depth and width. Furthermore, this paper modifies the contextual attention layer by adjusting the fusion process to enlarge the fusion patch size. Finally, we extend the edge-guided function to preserve the original target information and confound viewers. Ablation studies on an open dataset prove RATH’s efficiency for image inpainting and target hiding. RATH achieves state-of-the-art results with lower complexity. And it has the highest similarity for edge-guided target hiding. RATH enables robust, efficient target hiding for privacy protection in remote sensing imagery while balancing performance and complexity. Experiments show RATH's superiority over existing methods in hiding arbitrary-shaped targets.

The spread of 2019 novel coronavirus disease (COVID-19) throughout the world has been a severe challenge for public health. The human angiotensin-converting enzyme 2 (ACE2) has a remarkably high affinity binding to severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). By the search for network database and re-analysis of pubic data, we found the level of ACE2 expression in adipose tissue was higher than that in lung tissue, which indicated the adipose tissue might be vulnerable to SARS-CoV-2 as well; the levels of ACE2 expressed by adipocytes and adipose progenitor cells were similar between non-obese individuals and obese individuals, but obese individuals have more adiposes so as to increase the number of ACE2-expressing cells; the expression of ACE2 in tumor tissues posed by five different types of cancers increased significantly compared with that in adjacent tissues. Thus, we suggest that more attentions might be given to obese individuals and the five types of cancer patients during the outbreak of COVID-19.

The pulse duration in short-pulse schemes for Self-Amplified Spontaneous Emission Free Electron Lasers (SASE FELs) is limited by the FEL coherence time. A recently proposed concept allows to overcome the coherence time barrier and to get much shorter pulses. When the lasing part of an electron bunch is much shorter than the coherence time, one can suppress the radiation in the long main undulator while preserving microbunching within that short lasing slice. Then a short radiation pulse is produced in a relatively short radiator. A possible suppression method, an excessive reverse undulator taper, is discussed and illustrated numerically in this paper. We also performed first experimental tests of this method at the soft X-ray FEL user facility FLASH. The measured pulse duration approaches 1 fs (FWHM) at the wavelength of 5 nm.

Emotion detection holds significant importance in facilitating human-computer interaction, enhancing the depth of engagement. By integrating this capability, we pave the way for forthcoming AI technologies to possess a blend of cognitive and emotional understanding, bridging the divide between machine functionality and human emotional complexity. This progress has the potential to reshape how machines perceive and respond to human emotions, ushering in an era of empathetic and intuitive artificial systems. This paper introduces a novel approach to multimodal emotion recognition, seamlessly integrating speech and text modalities to accurately infer emotional states. Employing CNNs, we meticulously analyze speech using Mel spectrograms, while a BERT-based model processes the textual component, leveraging its bidirectional layers for profound semantic comprehension. The outputs from both modalities are combined using an attention-based fusion mechanism that optimally weighs their contributions. The proposed method undergoes meticulous testing on two distinct datasets: Carnegie Mellon University’s Multimodal Opinion Sentiment and Emotion Intensity (CMU-MOSEI) dataset and the Multimodal Emotion Lines Dataset (MELD). The results demonstrate superior efficacy compared to existing frameworks, achieving an accuracy of 88.4% and an F1-score of 87.9% on the CMU-MOSEI dataset, and a notable weighted accuracy (WA) of 67.81% and a weighted F1 (WF1) score of 66.32% on the MELD dataset. This comprehensive system offers precise emotion detection and introduces several significant advancements in the field.

Water distribution networks are often susceptible to pipeline leaks caused by mechanical damages, natural hazards, corrosion, and other factors. This paper focuses on the detection of leaks in water distribution networks (WDN) using a data-driven approach based on machine learning. A hybrid Autoencoder neural network (AE) is developed, which utilizes unsupervised learning to address the issue of unbalanced data (as anomalies are rare events). The AE consists of a 3DCNN encoder, a ConvLSTM decoder, and a ConvLSTM future predictor, making the anomaly detection robust. Additionally, spatial, and temporal attention mechanisms are employed to enhance leak localization. The AE first learns the expected behavior and subsequently detects leaks by identifying deviations from this expected behavior. To evaluate the performance of the proposed method, the Water Network Tool for Resilience (WNTR) Simulator is utilized to generate water pressure and flow rate data in a water supply network. Various conditions such as fluctuating water demands, data noise, and the presence of leaks are considered using the pressure-driven demand (PDD) method. Datasets with and without pipe leaks are obtained, where the AE is trained using the dataset without leaks and tested using the dataset with simulated pipe leaks. The results, based on a benchmark WDN and a confusion matrix analysis, demonstrate that the proposed method successfully identifies leaks in 96% of cases and a false positive rate of 4% compared to a random forest model baseline based on supervised learning with a false positive rate of 15% due to unbalanced data. Furthermore, a real case study demonstrates the applicability of the developed model for leak detection in operational conditions of water supply networks using inline sensor data.

Using digital media has become the most popular leisure activity for children and adolescents. The effects of digital media use on the developing brain and cognitive processes of children are subject to debate. Here, we examine the effect of digital media use on attention subdomains in children aged 6 to 10 years. In total, 77 children participated in the study. Selective and divided attention as well as switching between attentional demands were quantified by the SwAD task. Parents were asked to assess the screen time of their children (TV, smartphone, laptop/PC, game console, tablet). Results show no main or interaction effects of screen time on any of the attention conditions investigated. Based on the present findings, as well as previous studies, we suggest a possible non-linear relationship between the amount of screen time and attention function. Furthermore, we emphasize the relevance of considering the socio-economic background of children and a need for longitudinal studies.

Deep convolutional neural network (CNN) has shown their great advantages in the single image deraining task. However, most existing CNN-based single image deraining methods still suffer from residual rain streaks and details lost. In this paper, we propose a deep neural network including the Multi-scale feature extraction module and the channel attention module, which are embed in the feature extraction sub-network and the rain removal sub-network respectively. In the feature extraction sub-network, the Multi-scale feature extraction module is constructed by a Multi-layer Laplacian pyramid, and is then integrated multi-scale feature maps by a feature fusion module. In the rain removal sub-network, the channel attention module, which assigns different weights to the different channels, is introduced for preserving image details. Experimental results on visually and quantitatively comparison demonstrate that the proposed method performs favorably against other state-of-the-art approaches

The LED light source is an important light source for indoor visible light communication. It has the characteristics of a large divergence angle and a high transmission rate. Therefore, using LED as the light source for visible light full-duplex communication can not only satisfy the lighting requirements but also transmit information at high speed. To analyze the factors that affect the optical power of the indoor single-light source visible light communication uplink receiving end, an indoor visible light communication model was established, and mathematical calculation formulas were derived based on the model establishment, and the maximum movable range formula of the retroreflective end under specific conditions was derived; The reliability of the formula was verified with the help of Zemax simulation software. Theoretical analysis and experimental results show that increasing the movement range of the retroreflective end can be achieved by increasing the lens diameter, reducing the focal length, and increasing the link distance.

I present the first complete theory of ADHD. ADHD occurs when the organism adapts to try to maintain higher glucose levels than normal. The main mechanism via which this is done is by faster opening of KATP channels, mainly Kir6.2/SUR1, which increases the cell's intrinsic \xtblty. I show that this induces all of the symptoms of ADHD. The optimal treatment for ADHD already exists, since drugs of the sulfonylurea family close KATP channels and have been used for safely treating people for dozens of years.

This review focuses on the evidence for neurotherapeutics for Attention Deficit Hyperactivity Disorder (ADHD). EEG-Neurofeedback has been tested for about 45 years with latest meta-analyses of randomised controlled trials (RCT) showing small/medium effects compared to non-active controls only. Three small studies piloted neurofeedback of frontal activations in ADHD using functional magnetic resonance imaging or near-infrared spectroscopy, finding no superior effects over control conditions. Brain stimulation has been applied to ADHD using mostly repetitive transcranial magnetic and direct current stimulation (rTMS/tDCS). rTMS has shown mostly negative findings on improving cognition or symptoms. Meta-analyses of tDCS studies targeting mostly dorsolateral prefrontal cortex show small effects on cognitive improvements with only two out of three studies showing clinical improvements. Trigeminal nerve stimulation has shown to improve ADHD symptoms with medium effect in one RCT. Modern neurotherapeutics are attractive due to their relative safety and potential neuroplastic effects. However, they need to be thoroughly tested for clinical and cognitive efficacy across settings and beyond core symptoms and for their potential for individualised treatment.

Panchromatic (PAN) images contain abundant spatial information that is useful for earth observation, but always suffer from low-resolution due to the sensor limitation and large-scale view field. The current super-resolution (SR) methods based on traditional attention mechanism have shown remarkable advantages but remain imperfect to reconstruct the edge details of SR images. To address this problem, an improved super-resolution model which involves the self-attention augmented WGAN is designed to dig out the reference information among multiple features for detail enhancement. We use an encoder-decoder network followed by a fully convolutional network (FCN) as the backbone to extract multi-scale features and reconstruct the HR results. To exploit the relevance between multi-layer feature maps, we first integrate a convolutional block attention module (CBAM) into each skip-connection of the encoder-decoder subnet, generating weighted maps to enhance both channel-wise and spatial-wise feature representation automatically. Besides, considering that the HR results and LR inputs are highly similar in structure, yet cannot be fully reflected in traditional attention mechanism, we therefore design a self augmented attention (SAA) module, where the attention weights are produced dynamically via a similarity function between hidden features, this design allows the network to flexibly adjust the fraction relevance among multi-layer features and keep the long-range inter information, which is helpful to preserve details. In addition, the pixel-wise loss is combined with perceptual and gradient loss to achieve comprehensive supervision. Experiments on benchmark datasets demonstrate that the proposed method outperforms other SR methods in terms of both objective evaluation and visual effect.

A 47-year-old physician suddenly noticed a persistent difficulty maintaining attention. He was awake, alert, and oriented. After two hours he developed fever, ageusia, and anosmia. He denied any previous history of psychiatric illness and was hydrated at the time of the subjective attention impairment. On admission, the patient remained oriented. He reported the persistence of attention problems, anosmia, and mild fatigue. The oxygen saturation 99% while he was breathing ambient air. Laboratory tests were unremarkable. A high-resolution computed tomography of the chest was normal. Nasopharyngeal and throat swabs specimens on reverse transcription-polymerase chain reaction analysis tested positive for SARS-CoV2. On illness day 3, the examination was unchanged, but he continued to complain of difficulties to stay focused. Then, he performed an objective attention test. The test demonstrated a moderate attentional impairment. On day 6, the patient reported a subjective worse in his concentration and performed a second test. Although his physical examination remained normal, the attention performance was worse as compared to day 3. Eight hours after worsening of attention impairment, the patient’s oxygen saturation dropped to 94%. From illness days 9 to 14, the patient evolved with clinical improvement. On day 10, a third objective attention test indicated a mild deficit. On day 16, he did not report any other symptom and the attention test was completely normal. Then, the patient returned to work. Neurological symptoms had been previously described in COVID- 19 patients. However, no previous research had investigated early cognitive deficits preceding the traditional symptoms.

This paper is an interdisciplinary study of novel applications of techniques and tools of an area of brain science, known as Synesthesia (involving associations and/or confusion between distinct senses), to area of Computer Science known as Immersive Virtual Reality (VR), that makes the subject’s awareness of physical self be diminished by being surrounded in an engrossing artificial environment. Natural Synesthesia has for the last decade been an important emerging area in brain science but is present in only a small proportion of the population. For example a person with Natural Synesthesia, when viewing a grapheme, may perceive a color additionally to be associated to the grapheme. In contrast, Artificial synesthesia (also known as virtual synesthesia or synthetic synesthesia) has been defined as the sensory joining due a cross-modal mapping device, where information of one sense is accompanied by an induced perception in another sense. In particular, we propose use of a multimodal manner of displaying information in VR to increase and concentrate attention. Artificial Synesthesia to synthetically create induced associations between senses, allowing Artificial Synesthesia to be experienced by anyone using a VR system. The paper describes the enhancement of immersive VR by use of Artificial Synesthesia to improve the system’s performance at steering and directing the attention of the user. We describe techniques for an enhanced immersive VR that displays associations between a variety of senses: between colors and characters, also between colors and sounds, and between sounds and the position of tactile sensations. The sense association provided by Artificial Synesthesia allows the system to better capture the user’s attention and better direct that attention. A major application of our work in VR-induced Artificial Synesthesia is to provide an enhanced methodology for controlling the attention of the subject, and to improve the direction of attention of subjects undergoing guided imagery therapies for pain relief. Other potential high-impact applications include improved immersive VR, more programmable human/computer interfaces and other medical therapies.

In recent years, there has been significant growth in the ubiquity and popularity of three dimensional(3D) point clouds, with an increasing focus on the classification of 3D point clouds. To extract richer features from point clouds, many researchers have turned their attention to various point set regions and channels within irregular point clouds. However, this approach has limited capability in attending to crucial regions of interest in 3D point clouds and may overlook valuable information from neighboring features during feature aggregation. Therefore, this paper proposes a novel 3D point cloud classification method based on global attention and adaptive graph convolution. The method consists of two main branches: the first branch com-putes attention masks for each point, while the second branch employs adaptive graph convolu-tion to extract global features from the point set. It dynamically learns features based on point interactions, generating adaptive kernels to effectively and precisely capture diverse relationships among points from different semantic parts. Experimental results demonstrate that the proposed model achieves 93.8% in overall accuracy and 90.8% in average accuracy on the ModeNet40 dataset.

With the development of remote sensing satellite technology for Earth observation, remote sensing stereo images have been used for three-dimensional reconstruction in various fields, such as urban planning and construction. However, remote sensing images often include noise, occluded regions, weakly textured areas and repeated textures, which can lead to reduced accuracy in stereo matching and affect the quality of the 3D reconstruction results. To reduce the impact of complex scenes in remote sensing images on stereo matching and to ensure both speed and accuracy, we propose a new end-to-end stereo matching network based on convolutional neural networks (CNNs). The proposed stereo matching network can learn features at different scales from the original images and construct cost volumes with varying scales to obtain richer scale information. Additionally, when constructing the cost volume, we introduce negative disparity to adapt to the common occurrence of both negative and nonnegative disparities in remote sensing stereo image pairs. For cost aggregation, we employ a 3D convolution-based encoder-decoder structure that allows the network to adaptively aggregate information. Before feature aggregation, we also introduce an attention module to retain more valuable feature information, enhance feature representation, and obtain a higher-quality disparity map. By training on the publicly available US3D dataset, we obtain the accuracy that 1.115 pixel in end-point error (EPE) and 5.32% in the error pixel ratio (D1) on the test dataset, and the inference speed is 92 ms. Comparing our model with existing state-of-the-art models, we achieve higher accuracy, and the network is beneficial for the three-dimensional reconstruction of remote sensing images.

Cloud detection in remote sensing images is a crucial preprocessing step that efficiently identifies and extracts cloud-covered areas within the images, ensuring the precision and reliability of subsequent analyses and applications. Given the diversity of clouds and the intricacies of the surface, distinguishing the boundaries between thin clouds and the underlying surface is a major challenge in cloud detection. To address these challenges, an advanced cloud detection method, CloudformerV3, is presented in this paper. The proposed method employs a multi-scale adapter to incorporate dark and bright channel prior information into the model's backbone, enhancing the model's ability to capture prior information and multi-scale details from remote sensing images. Additionally, multi-level large window attention is utilized, enabling high-resolution feature maps and low-resolution feature maps to mutually focus and subsequently merge during the resolution recovery phase. This facilitates the establishment of connections between different levels of feature maps and offers comprehensive contextual information for the model's decoder. Experimental results on the GF1_WHU dataset demonstrate that the method introduced in this paper exhibits superior detection accuracy when compared to state-of-the-art cloud detection models. Furthermore, enhanced detection performance is achieved along cloud edges and with respect to thin clouds, showcasing the efficacy of the proposed method.

Nuclear DNA mutations, mitochondrial DNA mutations, combined nuclear and mitochondrial DNA defects, and random occurrences are the main causes of mitochondrial disease. Black pigmentation loss is a major sign of Parkinsonism. Because of the loss of dopaminergic neurons in the substantia nigra, it drops to less than 80%. The degree of motor impairment was correlated with the amount of black pigmentation loss. After RNA extraction, reverse transcription is carried out because reverse transcriptase was used to create cDNA. One microliter of total RNA supplemented with IORT Buffer, dNTPs, random hexamers, Multi-Scribe Reverse Transcriptase, and nuclease-free was used to create cDNA. The following was how the reaction was carried out in a thermal cycler: 10 minutes at 25°C, 120 minutes at 37°C, 5 seconds at 85°C, and lastly 4°C. The data was expressed as a v-value, which shows how much the target gene is enriched in comparison to the reference gene. Earlier research using mice injected with functional HtrA2/Omi protease activity revealed similar outcomes, including induced up-regulation of CHOP, decreased mitochondrial function, and early brain cell aging because of an increase in mtDNA deletions. The cell viability of the genotypes exhibits a dmg concentration-dependent effect in these results, suggesting that high content ratios of drug treatment with 6-OHDA may be the cause of cellular content depletion. After 6-OHDA neurotoxin treatment, CHOP is up-regulated. Prior in vitro research has shown that treatment with a model based on 6-OHDA neurotoxin causes the activation of mitochondrial stress pathways, which in turn promotes the death of neurons. 6-OHDA reversibly inhibited complexes I and IV's activities in rat brain cells, which led to dopaminergic neurodegeneration, a defining feature of PD pathogens. As a result, the number of living cells will directly correlate with the dmg concentration, supporting the results of the current study. Real-time PCR can generally demonstrate that the removal of HtrA 2 results in a significant up-regulation of Hsp60 expression when compared to WT cells. This could be linked to a decreased threshold for mitochondrial stress in HtrA2 KO cells, which would explain why, following ADEP4 and ACP5 treatment, Hsp60 is significantly up-regulated in HtrA2 KO cells compared to WT cells.

The central dogma of molecular biology dictates that, with only a few exceptions, information proceeds from DNA to protein through an RNA intermediate. Examining the enigmatic steps from prebiotic to biological chemistry, we take another road suggesting that primordial peptides acted as template for the self-assembly of the first nucleic acids polymers. Arguing in favour of a sort of archaic “reverse translation” from proteins to RNA, our basic premise is a Hadean Hearth where key biomolecules such as amino acids, polypeptides, purines, pyrimidines, nucleosides and nucleotides were available under different prebiotically plausible conditions, including meteorites delivery, shallow ponds and hydrothermal vents scenarios. Supporting a protein-first scenario alternative to the RNA world hypothesis, we propose the primeval occurrence of short peptides termed “selective amino acid- and nucleotide-matching oligopeptides” (henceforward SANMAOs) that noncovalently bind at the same time the polymerized amino acids and the single nucleotides dispersed in the prebiotic milieu. We describe the chemical features of this hypothetical oligopeptide, its biological plausibility and its virtues from an evolutionary perspective. We provide a theoretical example of SANMAO’s selective pairing between amino acids and nucleosides, simulating a poly-Glycine peptide that acts as a template to build a purinic chain corresponding to the glycine’s extant triplet codon GGG. Further, we discuss how SANMAO might have endorsed the formation of low-fidelity RNA’s polymerized strains, well before the appearance of the accurate genetic material’s transmission ensured by the current translation apparatus.

The demand of high data rate and ubiquitous coverage in heterogeneous cellular (HetNets) is increasing progressively. In order to meet this demand, sophisticated model having applied interference reduction scheme and cell association technique is needed. The small base station (sBS)are deployed inside the broadcasting area of macro base station (mBS), in heterogeneous cellular networks (HetNets). Since mBS has high transmission power therefore a large number of users get connected with mBS. This causes disproportion of load distribution across the HetNets. For load balancing users from high power mBS are migrated to low power sBS to increase network capacity and to decrease the load from mBS. This results in interference in the communication signal because of strong mBS Interference. Hence, we need interference management technique to mitigate interference and user association and to efficiently use sBSs’ resources. Inter-cell interference (ICI) limit the HetNets’ performance. Additionally, there exist deliberate jamming interference which depends on jammers transmission power and its proximity with the target, which notably degrades the network performance. In this paper, we employ reverse frequency allocation scheme (RFA) to reduce inter cell interference, deliberate jamming interference and to accomplish load balancing. The proposed setup is analyzed inquisitively and with the help of simulations. The result shows reduction in interferences as well as balance of load distribution in the network achieved by employing RFA scheme together with cell association.

This note shows that the well-known reverse order law $(AB)^{\dag} = B^{\dag}A^{\dag}$ for the Moore--Penrose inverse of matrix product is equivalent to many other equalities for that are composed of multiple products $(AB)^{\dag}$ and $B^{\dag}A^{\dag}$ by means of the definition of the Moore--Penrose inverse and orthogonal projector theory.

Regulatory cystathionine β-synthase (CBS) domains are widespread in proteins; however, difficulty in structure determination prevents a comprehensive understanding of the underlying regulation mechanism. Tetrameric microbial inorganic pyrophosphatase containing such domains (CBS-PPase) is allosterically inhibited by AMP and ADP and activated by ATP and cell alarmones diadenosine polyphosphates. Each CBS-PPase subunit contains a pair of CBS domains but binds cooperatively only one molecule of the mono-adenosine derivatives. We used site-directed mutagenesis of Desulfitobacterium hafniense CBS-PPase to identify the key elements determining the direction of the effect (activation or inhibition) and the “half-of-the-sites” ligand binding stoichiometry. Seven amino acid residues were selected in CBS1 domain based on the available X-ray structure of the regulatory domains and substituted by alanine and other residues. The interaction of 11 CBS-PPase variants with the regulating ligands was characterized by activity measurements and isothermal titration calorimetry. Lys100 replacement reversed the effect of ADP from inhibition to activation, whereas Lys95 and Gly118 replacements made ADP activator at low concentrations but inhibitor at high concentrations. Replacements of these residues for alanine increased the stoichiometry of mono-adenosine phosphate binding twofold. These findings identify several key protein residues and suggest “two non-interacting pairs of interacting regulatory sites” concept in CBS-PPase regulation.

It is a classic topic in algebras to construct and verify equalities that are composed of various algebraic operations of elements and their inverses or generalized inverses. In this note, the author constructs a matrix equality $(AB)^{\dag} = B^{\ast}(A^{\ast}ABB^{\ast})^{\#}A^{\ast}$ (called a mixed reverse-order law), where $A$ and $B$ are two matrices of appropriate sizes, $(\cdot)^{\ast}$, $(\cdot)^{\dag}$, and $(\cdot)^{\#}$ denote the conjugate transpose, the Moore--Penrose inverse, and the group inverse of a matrix, respectively, and shows that the mixed reverse-order law always holds. A list of variation forms of this matrix equality are also given, and necessary and sufficient conditions are obtained for them to hold. Especially, we show a remarkable fact that the two reverse-order laws $(AB)^{\dag} = B^{\dag}A^{\dag}$ and $(A^{\ast}ABB^{\ast})^{\#} = (BB^{\ast})^{\#}(A^{\ast}A)^{\#}$ are equivalent.

Speech Emotion Recognition (SER) is an interesting and difficult problem to handle. In this paper, we deal with it through the implementation of deep learning networks. We have designed and implemented six different deep learning networks, a Deep Belief Network (DBN), a simple deep neural network (SDNN), a LSTM network (LSTM), a LSTM network with the addition of an attention mechanism (LSTM-ATN), a Convolutional neural network (CNN), and a Convolutional neural network with the addition of an attention mechanism (CNN-ATN), having in mind, apart from solving the SER problem, to test the impact of attention mechanism to the results. Dropout and Batch Normalization techniques are also used to improve the generalization ability (prevention of overfitting) of the models as well as to speed up the training process. The Surrey Audio-Visual Expressed Emotion database (SAVEE), and the Ryerson Audio-Visual Database (RAVDESS) database were used for training and evaluation of our models. The results showed that networks with the addition of the attention mechanism did better than the others. Furthermore, they showed that CNN-ATN was the best among tested networks, achieving an accuracy of 74% for the SAVEE and 77% for the RAVDESS dataset, and exceeded existing state-of-the-art systems for the same datasets.

Attention Deficit/Hyperactivity Disorder (ADHD) is a neurodevelopmental disorder that affects attention and behavioral control, characterized by constant presence of inattention and hyperactivity. This article describes a study that used a database with results from tests of voluntary and automatic attentional orientation activity in a complex network of ADHD patients, in order to understand the characteristics of the elements and attentional variability of patients. Centrality metrics and the Louvain method were applied to obtain the network communities. The most important elements of the network were identified and differences in reaction times of the activities were observed in the identified communities. The study provides useful information to understand of deficit hyperactivity disorder spectrum in patients with ADHD.

Attention deficit hyperactivity disorder (ADHD) is a prevalent neurodevelopmental disorder that can diminish the quality of life of both children and adults in academic, occupational, and social contexts. The kynurenine pathway (KP) contains a set of enzymatic reactions involved in tryptophan (TRP) degradation. It is known to be associated with the risk of developing ADHD. This review will address the KP and underlying mechanism of inflammation in ADHD. Potential inflammatory biomarkers reported in the most recent studies are summarized. Although a strong neuroimmunological basis has been established due to advances of recent neurobiological research, the pathophysiology of ADHD remains unclear.

The detection accuracy of bridge superficial defect using the deep neural network approach decreases significantly under light variation and weak texture condition. To address these issues, an enhanced intelligent detection method based on the YOLOv8 deep neural network is proposed in this study. Firstly, multi-branch coordinate attention (MBCA) is proposed to improve the accuracy of coordinate positioning by introducing a global perception module in coordinate attention mechanism. Furthermore, a deformable convolution based on MBCA is developed to improve the adaptability for complex feature shapes. Lastly, the deformable convolutional network-attention-YOLO (DAC-YOLO) detection algorithm is formed by replacing the deep C2F structure in the YOLOv8 architecture with deformable convolution. A supervised dataset consisting of 4794 bridge surface damage images is employed to verify the proposed method, and results show that it achieves improvements of 2.0% and 3.4% in mAP and R. Meanwhile, the model complexity decreases by 1.2G, increasing the detection speed by 3.5/f·s-1.

IIt is important that Master’s Degree students in psychology, regardless of their future specialisa-tion, know about Attention Deficit Hyperactivity Disorder (ADHD). The aim is evaluate and an-alyse the ADHD-related knowledge held by students of Early Childhood Education and Primary Education. The findings that were obtained in this study (on the chronicity of the disorder, changes in manifestations throughout the life cycle, and the importance of early and multidisci-plinary intervention) have clear implications in relation to the specific training in ADHD for fu-ture teachers. It is essential to broaden the specific training in relation to ADHD in studies for the Master’s Degrees in Early Childhood Education and Primary Education and through contin-uous training.

Color can direct visual attention to specific locations through bottom-up and top-down mechanisms. Using Continuous Flash Suppression (CFS) as way to investigate the factors that gate access to consciousness, the current study investigated whether color also directly affected the timing of conscious perception. Low or high spatial frequency (SF) gratings with different orientations were shown as targets to the non-dominant eye of human participants. CFS patterns were presented at a rate of 10Hz to the dominant eye to delay conscious perception of the targets, and participants had the task to report the target’s orientation as soon as they could see it. With low-SF targets, two types of color-based effects became evident. First, when the targets and the CFS patterns had different colors, the targets entered consciousness faster than in trials where the targets and CFS patterns had the same color. Second, when participants searched for a specific target color, targets that matched these search settings entered consciousness faster compared to conditions where the target color was irrelevant and could vary from trial to trial. Thus, the current study demonstrates that color is a central feature of human perception and leads to faster conscious perception of visual stimuli through bottom-up and top-down attentional mechanisms.

Reverse order laws for generalized inverses of matrix products is a classic object of study in the theory of generalized inverses. One of the well-known reverse order laws for a matrix product $AB$ is $(AB)^{(i,\ldots,j)} = B^{(s_2,\ldots,t_2)}A^{(s_1,\ldots,t_1)}$, where $(\cdot)^{(i,\ldots,j)}$ denotes an $\{i,\ldots, j\}$-generalized inverse of matrix. Because $\{i,\ldots, j\}$-generalized inverse of a singular matrix is unique, the relationships between both sides of the reverse order law can be divided into four situations for consideration. This paper provides a thorough coverage of the reverse order laws for $\{i,\ldots, j\}$-generalized inverses of $AB$, from the development of background and preliminary tools to the collection of miscellaneous formulas and facts on the reverse order laws in one place with cogent introduction and references for further study. We begin with the introduction of a linear mixed model $y = AB\beta + A\gamma + \epsilon$ and the presentation of two least-squares methodologies to estimate the fixed parameter vector $\beta$ in the model, and the description of connections between the two types of least-squares estimators and the reverse order laws for generalized inverses of $AB$. We then prepare some valued matrix analysis tools, including a general theory on linear or nonlinear matrix identities, a group of expansion formulas for calculating ranks of block matrices, two groups of explicit formulas for calculating the maximum and minimum ranks of $B^{(s_2,\ldots,t_2)}A^{(s_1,\ldots,t_1)}$, as well as necessary and sufficient conditions for $B^{(s_2,\ldots,t_2)}A^{(s_1,\ldots,t_1)}$ to be invariant with respect to the choice of $B^{(s_2,\ldots,t_2)}A^{(s_1,\ldots,t_1)}$. We then present a unified approach to the 512 matrix set inclusion problems associated with the above reverse order laws for the eight commonly-used types of generalized inverses of $A$, $B$, and $AB$ through use of the definitions of generalized inverses, the block matrix method (BMM), the matrix rank method (MRM), the matrix equation method (MEM), and various algebraic calculations of matrices.

Loss of function of the hippocampus or frontal cortex is associated with reduced performance on memory tasks in which subjects are incidentally exposed to cues at specific places in the environment and are subsequently asked to recollect the location at which the cue was experienced. Here, we examined the roles of the rodent hippocampus and frontal cortex in cue-directed attention during encoding of memory for the location of a single incidentally experienced cue. During a spatial sensory preconditioning task, rats explored an elevated platform while an auditory cue was incidentally presented at one corner. The opposite corner acted as an unpaired control location. The rats demonstrated recollection of location by avoiding the paired corner after the auditory cue was in turn paired with shock. Damage to either the dorsal hippocampus or the frontal cortex impaired this memory ability. However, we also found that hippocampal lesions enhanced attention directed towards the cue during the encoding phase while frontal cortical lesions reduced cue-directed attention. These results suggest that the deficit in spatial sensory preconditioning caused by frontal cortical damage may be mediated by inattention to the location of cues during the latent encoding phase, while deficits following hippocampal damage must be related to other mechanisms such as generation of neural plasticity.

Our study is part of the ongoing discussion concerning influencer marketing as there seems to have been a shift and social media marketing is bigger than ever. Social media outlets are excellent vehicles for fostering relationships with consumers who can be susceptible to influencer advertising. Therefore, companies now pay for posts on users’ profiles to generate popularity for products. How this approach affects consumers’ buying behavior is an interesting research question. We reference Herbert Simon’s economics of attention as an appropriate theoretical construct for describing the reality of the internet. Based on unique survey data from 513 Polish respondents, the study applies econometric methods and supervised and unsupervised machine learning techniques to identify the primary consumer groups with different characteristics of engagement and sensitivity to influencer activities, revealing the possible drivers of purchase intent. The findings provide valuable insights into consumers’ informational preferences, demonstrating how social media influencers may attract attention and drive sales.

Abstract: The promotion and development of healthy cities are vital for enhancing human habitats and fostering sustainable economic growth. Based on the core database of Web of Science and the knowledge graph software, this paper makes a quantitative analysis of the literature related to attention recovery abroad. It is found that in recent years, the research on attention recovery has developed rapidly, the number of related literature has been increasing, and the research content presents the characteristics of interdisciplinary integration. By further analyzing the characteristics of research literature, research context, and knowledge basis, this paper summarizes the empirical research based on the existing quantitative analysis, reviews the research field based on the mechanism of attention recovery, and analyzes the development process and trend based on the research basis of attention recovery. Due to the change of modern life style, human health problems are becoming more and more prominent. Attention restoration design provides a new research idea and method to balance the relationship between humans and the urban environment.

The study focuses on the crucial aspect of lossless compression for FAST pulsar search data. The deep generative model PixelCNN, stacking multiple masked convolutional layers, achieves neural network autoregressive modeling, making it one of the most excellent image density estimators. However, the local nature of convolutional networks causes PixelCNN to concentrate only on nearby information, neglecting important information at greater distances. Although deepening the network can broaden the receptive field, excessive depth can compromise model stability, leading to issues like gradient degradation. To address these challenges, the study combines causal attention modules with residual connections, proposing the Causal Residual Attention Module to enhance the PixelCNN model. This innovation not only resolves convergence problems arising from network deepening but also widens the receptive field. It effectively utilizes global features, particularly capturing vertically correlated features prominently present in subgraphs of candidates. This significantly enhances its capability to model pulsar data.In the experiments, the model is trained and validated using the HTRU1 dataset. The study compares the average negative log-likelihood score with baseline models like GMM, STM, and PixelCNN. The results demonstrate the superior performance of the our model over other models. Finally, the study introduces the practical compression encoding process by combining the proposed model with arithmetic coding.

This paper proposes a multimodal fusion 3D target detection algorithm based on the attention mechanism to improve the performance of 3D target detection. The algorithm utilizes point cloud data and information from camera. For image feature extraction, the ResNet50+FPN architecture extracts features at four levels. Point cloud feature extraction employs the voxel method and FCN to extract point and voxel features. The fusion of image and point cloud features is achieved through regional point fusion and regional voxel fusion methods. After information fusion, the Coordinate attention mechanism and SimAM attention mechanism extract fusion features at a deep level. The algorithm's performance is evaluated using the DAIR-V2X dataset. The results show that compared to the Part-A2 algorithm, the proposed algorithm improves the mAP value by 7.9% in BEV view and 7.8% in 3D view at IOU=0.5 (cars) and IOU=0.25 (pedestrians and cyclist). At IOU=0.7 (cars) and IOU=0.5 (pedestrians and cyclist), the mAP value of the SECOND algorithm is improved by 5.4% in the BEV view and 4.3% in the 3D view, compared to other comparison algorithms.

3D point cloud classification tasks have been a hot topic in recent years. Most existing point cloud processing frameworks lack context-aware features due to the deficiency of sufficient local feature extraction information. Therefore, we design an augmented sampling and grouping (ASG) module to efficiently obtain fine-grained features from the original point cloud. In particular, this method strengthens the domain near each centroid and makes reasonable use of the local mean and global standard deviation to mine point cloud’s local and global features. In addition to this, inspired by the transformer structure UFO-ViT in 2D vision tasks, we first try to use a linearly-normalized attention mechanism in point cloud processing tasks, investigating a novel transformer-based point cloud classification architecture UFO-Net. An effective local feature learning module is adopted as a bridging technique to connect different feature extraction modules. Importantly, UFO-Net employs multiple stacked blocks to better capture feature representation of the point cloud. Extensive ablation experiments on public datasets show that our method outperforms other state-of-the-art methods. For instance, our network performed with 93.7% overall accuracy on the ModelNet40 dataset, which was 0.5% higher than PCT. Our network also archived 83.8% overall accuracy on the ScanObjectNN dataset, which is 3.8% better than PCT.