In recent years, neural networks based on attention mechanisms have been increasingly widely used in speech recognition, separation, enhancement, and other fields. In particular, the convolution-augmented transformer has achieved good performance as it can combine the advantages of convolution and self-attention. Recently, the gated attention unit (GAU) has been proposed. Compared with the traditional multi-head self-attention, approaches with GAU are effective and computationally efficient. In this article, we propose a network for speech enhancement called CGA-MGAN, a kind of Metric GAN based on convolution-augmented gated attention. CGA-MGAN captures local and global correlations in speech signals at the same time through the fusion of convolution and gated attention units. Experiments on Voice Bank + DEMAND show that the CGA-MGAN we propose achieves an excellent performance (3.47 PESQ, 0.96 STOI, and 11.09dB SSNR) at a relatively small model size (1.14M).

FV (finger vein) identification is a biometric identification technology that extracts the features of FV images for identity authentication. To address the limitations of CNN-based FV identification, particularly the challenge of small receptive fields and difficulty in capturing long-range dependencies, an FV identification method Let-Net(Large kernel and attention mechanism Network) was introduced, which combines local and global information. Firstly, Let-Net employs large kernels to broaden the receptive field and incorporates depthwise convolution with residual connections to reduce parameter count. Secondly, Let-Net integrates an attention mechanism to enhance the information flows in channels and spaces for more comprehensive and distinctive FV feature extraction. The experimental results on nine public datasets show that Let-Net has excellent identification performance, and the EER and accuracy rate on the FV_USM dataset can reach 0.04% and 99.77%. The parameter number and FLOPs of Let-Net are only 0.89M and 0.25G, which means that the time cost of training and reasoning of the model is low, and it is easier to deploy and integrate into various applications.

Panchromatic (PAN) images contain abundant spatial information that is useful for earth observation, but always suffer from low-resolution due to the sensor limitation and large-scale view field. The current super-resolution (SR) methods based on traditional attention mechanism have shown remarkable advantages but remain imperfect to reconstruct the edge details of SR images. To address this problem, an improved super-resolution model which involves the self-attention augmented WGAN is designed to dig out the reference information among multiple features for detail enhancement. We use an encoder-decoder network followed by a fully convolutional network (FCN) as the backbone to extract multi-scale features and reconstruct the HR results. To exploit the relevance between multi-layer feature maps, we first integrate a convolutional block attention module (CBAM) into each skip-connection of the encoder-decoder subnet, generating weighted maps to enhance both channel-wise and spatial-wise feature representation automatically. Besides, considering that the HR results and LR inputs are highly similar in structure, yet cannot be fully reflected in traditional attention mechanism, we therefore design a self augmented attention (SAA) module, where the attention weights are produced dynamically via a similarity function between hidden features, this design allows the network to flexibly adjust the fraction relevance among multi-layer features and keep the long-range inter information, which is helpful to preserve details. In addition, the pixel-wise loss is combined with perceptual and gradient loss to achieve comprehensive supervision. Experiments on benchmark datasets demonstrate that the proposed method outperforms other SR methods in terms of both objective evaluation and visual effect.

Cerebrovascular and airway structures are tubular structures used for transporting blood and gases, respectively, providing essential support for the normal activities of the human body. Accurately segmenting these tubular structures is the basis of morphology research and patho-logical detection. Nevertheless, accurately segmenting these structures from images presents great challenges due to their complex morphological and topological characteristics. To address this challenge, this paper proposes a framework UARAI based on the U-Net multi-scale reverse at-tention network and sparse convolution network. The framework utilizes a multi-scale structure to effectively extract the global and deep detail features of vessels and airways. Further, it enhances the extraction ability of fine-edge features by a joint reverse attention module. In addition, the sparse convolution structure is introduced to improve the features' expression ability without increasing the model's complexity. Finally, the proposed training sample cropping strategy re-duces the influence of block boundaries on the accuracy of tubular structure segmentation. The experimental findings demonstrate that the UARAI-based metrics, namely Dice and IoU, achieve impressive scores of 90.31% and 82.33% for cerebrovascular segmentation and 93.34% and 87.51% for airway segmentation, respectively. Compared to commonly employed segmentation tech-niques, the proposed method exhibits remarkable accuracy and robustness in delineating tubular structures such as cerebrovascular and airway. These results hold significant promise in facilitating medical image analysis and clinical diagnosis, offering invaluable support to healthcare profes-sionals.

In recent years, there has been significant growth in the ubiquity and popularity of three dimensional(3D) point clouds, with an increasing focus on the classification of 3D point clouds. To extract richer features from point clouds, many researchers have turned their attention to various point set regions and channels within irregular point clouds. However, this approach has limited capability in attending to crucial regions of interest in 3D point clouds and may overlook valuable information from neighboring features during feature aggregation. Therefore, this paper proposes a novel 3D point cloud classification method based on global attention and adaptive graph convolution. The method consists of two main branches: the first branch com-putes attention masks for each point, while the second branch employs adaptive graph convolu-tion to extract global features from the point set. It dynamically learns features based on point interactions, generating adaptive kernels to effectively and precisely capture diverse relationships among points from different semantic parts. Experimental results demonstrate that the proposed model achieves 93.8% in overall accuracy and 90.8% in average accuracy on the ModeNet40 dataset.

The detection accuracy of bridge superficial defect using the deep neural network approach decreases significantly under light variation and weak texture condition. To address these issues, an enhanced intelligent detection method based on the YOLOv8 deep neural network is proposed in this study. Firstly, multi-branch coordinate attention (MBCA) is proposed to improve the accuracy of coordinate positioning by introducing a global perception module in coordinate attention mechanism. Furthermore, a deformable convolution based on MBCA is developed to improve the adaptability for complex feature shapes. Lastly, the deformable convolutional network-attention-YOLO (DAC-YOLO) detection algorithm is formed by replacing the deep C2F structure in the YOLOv8 architecture with deformable convolution. A supervised dataset consisting of 4794 bridge surface damage images is employed to verify the proposed method, and results show that it achieves improvements of 2.0% and 3.4% in mAP and R. Meanwhile, the model complexity decreases by 1.2G, increasing the detection speed by 3.5/f·s-1.

The adapted Posner spatial cue-target paradigm was used to explore the relationship between exogenous temporal attention caused by rhythm and endogenous and exogenous spatial attention. The study was divided into two experiments. In Experiment 1, 33 participants used arrow cues to orient endogenous spatial attention and rhythm to orient exogenous temporal attention. In Experiment 2, with 29 participants, exogenous spatial attention was directed by highlighting the cue box. Exogenous temporal attention was directed by rhythm. Experiment 1 indicated that RTs were faster for attended targets than the unattended. The main effect of temporal attention was significant, with RTs being faster for synchrony and late compared to early. RTs were faster for late compared to synchrony. The main effect of stimulus repetition was significant, with faster RTs for targets when the rhythmic cue consisted of five compared to four. The interaction between spatial attention and temporal attention was not significant. Experiment 2 demonstrated that exogenous spatial attention only exhibited IOR under early four stimulus repetitions. The main effect of temporal attention was significant, with RTs being faster for synchrony and late compared to early. The main effect of stimulus repetition was significant, with faster RTs for targets when the rhythmic cue consisted of five compared to four. The interaction between spatial attention and temporal attention was significant. The results indicated that rhythmic temporal attention supported foreperiod effects. Exogenous temporal attention and endogenous spatial attention independently affect behavior, while exogenous temporal attention and exogenous spatial attention mutually influenced behavior.

ABSTRACT Purpose: Tongue image analysis for disease diagnosis is an ancient traditional non-invasive diagnosis technique widely used by traditional medicine practitioners. Deep Learning based multi-label disease detection models offer tremendous potential to clinical decision support systems, by facilitating preliminary diagnosis. Methods: In this work, we propose a multi-label disease detection pipeline, where in observation and analysis of tongue images captured and received via smartphones assist in predicting the health status of an individual. All images are voluntarily given by subjects consulting collaborating physicians. Images thus acquired are first and foremost classified either into a diseased or a normal category by a 5-fold cross-validation algorithm using a convolution neural network (MobileNetV2) model for binary classification. Once the diseased label is predicted, the image is used to diagnose multiple diseases using the prediction algorithm based on DenseNet121. Results: Average accuracy of 93 % was achieved in classifying diseased from normal healthy tongue by detection model with MobileNetV2 architecture. Multilabel disease classification produced more than 90% accurate results for the seven class labels considered. Conclusion: AI based image analysis shows promising results and an extensive dataset could provide further improvements to this approach. Rather than employing high-cost sophisticated image capturing setup, experimenting with smartphone images opens opportunity to provide preliminary health status to individuals on smartphone prior to further line of treatment and diagnosis.

In this paper, we introduce a specialized, fully automated experimental arrangement designed for assessing the effectiveness of augmented and virtual reality technologies in healthcare setting and explore its design principles focusing on depth sensor characterization. The main goal of this project is to establish a robust benchtop platform for the quantitative evaluation of extended reality technologies in a controlled environment, emphasizing the practical assessment of augmented reality head-mounted devices. We outline a design concept and considerations for an experimental configuration aimed at creating a realistic testing environment. This apparatus comprises an observation platform mounted on a three-degree-of-freedom motorized system and a test phantom stage. Focusing on real-case scenarios, we utilized a range of sensors, including readily available range-sensing cameras and commercial augmented reality headsets, such as the Intel RealSense L515 LiDAR camera, mounted on the motion control system. The setup enabled automated data collection and facilitates controlled assessments and validation of various facets of augmented reality technologies, including object, hand, and head tracking, as well as static and dynamic image registration. This paper describes the system architecture, the process of automated data collection, and presents several evaluation studies conducted with this setup, providing insights into the quality and temporal noise associated with static or moving objects or observers in augmented reality applications.

The purpose of this paper is to explore the implementation of Retrieval-Augmented Gen- 14 eration (RAG) technology with open-source Large Language Models (LLMs). For this purpose, a 15 web-based application named PaSSER that integrates RAG with three models - Mistral:7b, 16 Llama2:7b: Orca2:7b, is developed. In its development various technologies are used, including 17 Blockchain for managing and storing assessment results of built-in testing modules. PaSSER em- 18 ploys a set of evaluation metrics for LLMs’ performance - METEOR, ROUGE, BLEU, Perplexity, 19 Cosine similarity, Pearson correlation, and F1 score. The specialized knowledge base is in the smart 20 agriculture domain. As an illustration, the paper presents results and analysis of two tests. First one 21 is assessing the performance of LLMs across different hardware configurations, the other is deter- 22 mining the model that delivers most accurate and contextually relevant responses within the RAG. 23 The paper also discusses the integration of blockchain technology with LLMs to manage and store 24 assessment results within a blockchain environment. The tests revealed that Mistral:7b demon- 25 strates the best results across most of the evaluated metrics. The discussion section comments on 26 technical and hardware considerations that affect the performance of LLMs. Future development 27 will focus in leveraging new larger pre-trained open-source LLMs, exploring different finetuning 28 approaches, and further integration with Blockchain and IPFS.

This paper introduces an innovative approach to lipreading, leveraging a web application designed to generate subtitles for videos where the speaker's mouth is visible and a comprehensive literature review that precedes the discussion, encompassing a thorough examination of various lipreading methods employed over the past decade. Our method employs a powerful deep learning model, featuring a 3D-convolution network and bidirectional LSTM, enabling accurate sentence-level predictions based solely on visual lip movements. With an impressive accuracy of 97%, our model is trained using pre-segmented lips regions, transformed into animated GIFs for effective pre-training. This work stands as a significant contribution to the evolving landscape of lipreading research, offering a practical and accurate solution for real-world applications.

In this paper we use the Mellin convolution theorem, which is related to Perron's formula. Also we introduce new explicit formulae for arithmetic function which generalize the explicit formulae of Weil for other arithmetic functions different from the Von-Mangoldt function.

Underwater image often exhibit detail blurring and color distortion due to light scattering, impurities, and other influences, obscuring essential textures and details. This presents a challenge for existing super-resolution techniques in identifying and extracting effective features, making high-quality reconstruction difficult. This research aims to innovate underwater image super-resolution technology to tackle this challenge. Initially, an underwater image degradation model was created by integrating random subsampling, Gaussian blur, mixed noise, and suspended particle simulation to generate a highly realistic synthetic dataset, thereby training the network to adapt to various degradation factors. Subsequently, to enhance the network's capability to extract key features, improvements were made based on the symmetrically structured Blind Super-Resolution Generative Adversarial Network (BSRGAN) model architecture. An attention mechanism based on energy functions was introduced within the generator to assess the importance of each pixel, and a weighted fusion strategy of adversarial loss, reconstruction loss, and perceptual loss was utilized to improve the quality of image reconstruction. Experimental results demonstrate that the proposed method achieved significant improvements in Peak Signal-to-Noise Ratio (PSNR) and Underwater Image Quality Measure (UIQM) by 0.85 dB and 0.19, respectively, significantly enhancing the visual perception quality and indicating its feasibility in super-resolution applications.

Microscopic vision plays an important role in automated micro-assembly. However, some uncertain factors in the assembly process, such as occlusion and stains can lead to the mistakes of feature extraction. Herein, to solve the problem, the deep learning techniques are introduced into the feature recognition tasks, focusing on the attention mechanism and visualizing CNNs for DL-based microscopic vision. The main contributions are summarized as follows: The CBAM attention mechanism is combined with the YOLOv5 algorithm to improve the accuracy and robustness of feature extraction. The micropart feature occlusion experiment results show that at 70% occlusion degree, YOLOV5-CBAM can reach 97.9% [email protected], which is 4.6% higher than the original one. Visualization analysis of DL-based model is conducted using Grad-CAM to make the decision result more transparent and avoid potential visual detection risks during assembly. The heatmap matching degree between GT area and high-light area is increased by 27.81% on average, which further verify the effectiveness of attention mechanism in micropart feature localization. Additionally, micropart surface stain and droplet quality classification models based on ResNet50 are trained to replace the manual sorting. The visual results are consistent with human eye discernment and judgement, confirming the reliability of parts and droplets sorting.

The education landscape is an environment prone to change due to the volatile and ever-changing nature of the digital society in which we all live. Although the world moves at a different pace and any generalization is bound to have several exceptions, there is evidence from research conducted in different places and contexts that educational methods are becoming increasingly digitized and driven by technological innovation. Among technological trends fuelled in many cases by the COVID-19 pandemic and the need to stay at home but online, augmented reality solutions received an additional push as a valid and versatile educational technology worth exploring and eventually integrating into several teaching methods already in use. Although the technology still faces problems related to its affordability, accessibility, and the technical skills required of users, some ongoing projects have already provided evidence that using augmented reality solutions as teaching and learning tools can improve teachers’ and students’ learning outcomes by increasing their engagement and interactivity. The same issues arose when personal computers, tablets, and smartphones were first discussed as valuable tools for education and have now found their way into most classrooms. This paper reviews some of the key concepts related to augmented reality, as well as some current trends, benefits, and concerns related to its inclusion in educational contexts in areas such as life sciences, engineering, and health. The work carried out and presented in this paper provides an interesting insight into a technology that has led to global phenomena, such as Pokémon Go, and is constantly improving in terms of portability, usability, and overall user experience. Throughout the paper and in the conclusions section, we discuss the relevance of using the best features of augmented reality and how they can contribute to positive educational outcomes.

The learning equations of an ANN are presented, giving an extremely concise derivation based on the principle of backpropagation through the descendent gradient. Then, a reflection is developed on the dual attention network that applies the learning equations and coordinates subnetworks toward purposeful behaviors. Speculation is made on possible developments of functionalities that could provide additional skills and at the same time shed light on competencies typical of ``natural intelligence".

Let be a power function $f_{r,M}(s)$ defined for every $s$ within the finite set $M$ as follows $$f_{r,M}(s)= \begin{cases} s^r, \ &s\in M,\\ 0, \ &\mathrm{otherwise}. \end{cases} $$ Let a discrete convolution of $f_{r,M}(s)$ be denoted as follows $\mathrm{Conv}_{r,M}[n]=(f_{r,M}*f_{r,M})[n]$. Let a real coefficients $A_{m,j}$ be given by the following recurrence $$ A_{m,j} = \begin{cases} 0, & \mathrm{if } \ j<0 \ \mathrm{or } \ j>m, \\ (2j+1)\binom{2j}{j} \sum_{d=2j+1}^{m} A_{m,d} \binom{d}{2j+1} \frac{(-1)^{d-1}}{d-j} B_{2d-2j}, & \mathrm{if } \ 0 \leq j < m, \\ (2j+1)\binom{2j}{j}, & \mathrm{if } \ j=m. \end{cases} $$ In this paper we show that for every $n>0$ the following odd-power identities involving coefficients $A_{m,j}$ and convolution transform $\mathrm{Conv}_{r,M}[n]$ hold $$ \begin{split} n^{2m+1}+1&=\sum_{r=0}^{m}A_{m,r}\mathrm{Conv}_{r,\mathbb{N}}[n],\\ n^{2m+1}-1&=\sum_{r=0}^{m}A_{m,r}\mathrm{Conv}_{r,\mathbb{Z}_{>0}}[n],\\ n^{2m+1}&=\sum_{r=0}^{m}A_{m,r}\sum_{k=1}^{n} k^r(n-k)^r\\ &=\sum_{r=0}^{m}A_{m,r}\sum_{k=0}^{n-1} k^r(n-k)^r. \end{split} $$

Immersive Unit Visualization is an emergent form of visualization that arose from Immersive Analytics where, unlike traditional visualizations, each data point is represented by an individual visual mark in an immersive virtual environment. This practice has focused almost exclusively on virtual reality, excluding augmented reality (AR). This article develops and tests a prototype of an immersive Unit Visualization (Floating Companies II) with two AR devices: head-mounted display (HMD) and hand-held display (HHD). Results from the testing sessions with 20 users were analyzed through qualitative research analysis and thematic coding indicating that, while the HHD enabled a first contact with AR visualization on a familiar device, HMD improved the perception of hybrid space by supporting greater stability of virtual content; wider field of view; improved spatial perception; increased sense of immersion; and more realistic simulation, which impacted on information reading and sense-making. The materialization of abstract quantitative values into concrete reality through its simulation in the real environment and the ludic dimension stand out as important opportunities of this type of visualization. This paper investigates the aspects distinguishing two experiences regarding data visualization in hybrid space; and characterizes ways of seeing information with AR, identifying opportunities to advance information design research.

Convolution forms one of the most essential operations for the FPGA-based hardware accelerator. However, the existing designs often neglect the inherent architecture of FPGA, which puts forward an austere challenge on hardware resource requirements. Even though some previous works have proposed approximate multipliers or convolution acceleration algorithms to deal with this issue, the inevitable accuracy loss and resource occupation easily lead to performance degradation. Toward this, we first propose two kinds of resource-efficient optimized accurate multipliers based on LUTs or carry chains. Then targeting FPGA-based platforms, a generic multiply-accumulate structure is constructed by directly accumulating the partial products produced by our proposed optimized radix-4 Booth multipliers without intermediate multiplication and addition results. Experimental results demonstrate that our proposed multiplier achieves a maximum 51% look-up-table (LUT) reduction compared to the Vivado area optimized multiplier IP. Furthermore, the convolutional process unit using the proposed structure achieves a 36% LUT reduction compared to existing methods. As case studies, the proposed method is applied to DCT transformer and LeNet to achieves hardware resource saving without loss of accuracy.

In today’s fast paced, attention-demanding society, executive functions and attentional resources are often taxed. Individuals need ways to sustain and restore these resources. We first review the concepts of attention and restoration, as instantiated in Attention Restoration Theory (ART). ART emphasizes the role of nature in restoring attention. We then discuss essentials of experiments on the causal influences of nature. Next, we expand the concept of ART to include modern, designed environments. We propose a wider perspective termed attentional ecology, in which attention behavior is viewed within a larger system involving the human and their interactions over time with environmental demands. When the ecology is optimal, mental functioning can be a positive “flow” that is productive, sustainable for the individual, and sometimes creative.

Convolutional Neural Networks (CNNs) present drawbacks for modeling geometric transformations, such as scaling and rotation, caused by the convolution operation’s locality. Deformable convolution (DCON), a mechanism that substitutes standard convolution, increasing the receptive field to capture relevant features, is a promising approach to solve this drawback and improve the robustness of CNNs. However, the optimal way to replace the standard convolution with its deformable counterpart in a CNN model is unclear. In this study, we clarify this aseveration by conducting several experiments using deformable convolutions applied in the layers that conform a small four-layer CNN model. We also use deformable convolutions on the four-layers of several ResNet CNNs with depths 18, 34, 50, and 101. The models were tested in binary balanced classes with 2D data for image classification: Cats &amp; Dogs, EyesPACS, Spyders &amp; Chickens, and Shapes. After this testing, we evaluated DCON in 3D data for action recognition: UCF101 and Human2 (a dataset we compiled to control movement, clothing and background). The contribution of this research lies in a guideline to use DCON. It can be summarized as follows: if DCON is used on the first layers of the proposal of model (with simple features), the computational resources expressed as the quantity of Flops will tend to increase and produce bigger misclassification than the standard CNN. However, if the DCON is used at the end layers, the quantity of Flops used in the training and testing will decrease, and the classification accuracy will improve by up to 20% about the base model. Moreover, it gains robustness when using deformable convolutions because it can adapt to the region of interest. Also, the best kernel size of the DCON is three. It showed better results than size five. In the last case, the quantity of Flops increase quadratically, but their performance does not increase significantly. With these results, we propose a guideline to use the DCON and contribute to understanding the impact of DCON on the robustness of CNNs.

This paper presents the Advanced Syntactic-Graph Convolutional Model (ASGCM), a pioneering approach in Aspect-Based Sentiment Analysis (ABSA) that integrates syntactic dependency features within a graph convolution framework. ASGCM stands out for its novel use of dependency edge encoding and tag-based graph convolutions, providing a fine-grained analysis of sentiments associated with specific aspects in text. This model meticulously captures the intricacies of syntactic structures, thereby offering enhanced precision in sentiment analysis. Notably, ASGCM incorporates a dual-layer graph convolution system: one layer processes syntactic dependencies (edges), while the other interprets semantic roles (tags), ensuring a comprehensive understanding of both structural and contextual elements in text. We rigorously tested ASGCM on multiple datasets, including both English and Chinese languages, and our findings reveal a significant improvement in sentiment classification accuracy compared to existing models. The versatility of ASGCM makes it a robust tool for diverse linguistic environments, setting a new standard for ABSA methodologies.

Research on image-inpainting tasks has mainly focused on enhancing performance by augmenting various stages and modules. However, this trend does not consider the increase in the number of model parameters and operational memory, which increases the burden on computational resources. To solve this problem, we propose a Parametric Efficient Image InPainting Network (PEIPNet) for efficient and effective image-inpainting. Unlike other state-of-the-art methods, the proposed model has a one-stage inpainting framework in which depthwise and pointwise convolutions are adopted to reduce the number of parameters and computational costs. To generate semantically appealing results, we selected three unique components: spatially-adaptive denormalization (SPADE), dense dilated convolution module (DDCM), and efficient self-attention (ESA). The SPADE was adopted to conditionally normalize activations according to the mask to distinguish between damaged and undamaged regions. The DDCM was employed at every scale to overcome the gradient-vanishing obstacle and gradually fill-in pixels by capturing global information along the feature maps. The ESA was utilized to obtain clues from unmasked areas by extracting long-range information. In terms of efficiency, our model has the lowest operational memory compared with other state-of-the-art methods. Both qualitative and quantitative experiments demonstrate the generalized inpainting of our method on three public datasets: Paris StreetView, CelebA, and Places2.

Identification of plants is a challenging task which aims to identify the family, genus, and species level according to morphological features. Automated deep learning-based computer vision algorithms are widely used for identifying plants and can help users to narrow down the possibilities. However, numerous morphological similarities between and within species make the classification difficult. In this paper, we tested a custom convolution neural network (CNN) and vision transformer (ViT) based models using the PyTorch framework to classify plants. We used a large dataset of 88K and 16K images for classifying plants at genus and species levels respectively. Our results show that for classifying plants at the genus level, ViT models perform better compared to CNN-based models ResNet50 and ResNet-RS-420, and other state-of-the-art CNN-based models suggested in previous studies on a similar dataset. The ViT model achieved top accuracy of 83.3% for classifying plants at the genus level. ViT models also perform better for classifying plants at the species level compared to CNN-based models ResNet50 and ResNet-RS-420, with a top accuracy of 92.5%. We show that the correct set of augmentation techniques plays an important role in classification success.

There are four categories of medical waste that cannot be mixed as this will cause serious problems such as environmental pollution or infection. In the past, the classification of medical waste often involved a lot of human and material resources to process, with workers at risk of exposure to infectious substances. Therefore, an augmented reality (AR) and artificial intelligence (AI) medical waste classification system and method were developed. This innovative medical waste classification system and method combines AR and AI identification technology to reduce the risk of manual judgment errors by clinical staff when handling medical waste.

One of the most crucial elements in deeply understanding humans on a psychological level is manifested through facial expressions. The analysis of a human behavior can be informed by their facial expressions, making it essential to employ indicators such as expression (Expr), valence-arousal (VA), and action units (AU). In this paper, we introduce the method proposed in the Challenge of the 6th Workshop and Competition on Affective Behavior Analysis in-the-wild (ABAW) at CVPR 2024. Our proposed method utilizes the multi-modal Aff-wild2 dataset, which is splitted into spatial and audio modalities. For the spatial data, we extract features using a SimMiM model that was pre-trained on a diverse set of facial expression data. For the audio data, we extract features using a WAV2VEC model. To fusion the extracted spatial and audio features, we employed the cascaded cross-attention mechanism of a transformer.

Bundle recommendation is provided to users by combining related items into a bundle, enhancing the user's shopping experience and increase the merchant's sales revenue. Despite the success of existing solutions based on Graph Neural Networks(GNN), there are still some significant challenges: (1)It is demanding to explicitly model multiple complex associations using standard graph neural networks. (2)Numerous additional nodes and edges are introduced to approximate higher-order associations. (3)The user-bundle historical interaction data is highly sparse. In this work, we propose a Global Structural Hypergraph Convolution model for Bundle Recommendation (SHCBR) to address the above problems. Specifically, we jointly incorporate multiple complex interactions between users, items, and bundles(three entities) into a relational hypergraph without introducing additional nodes and edges. Higher-order associations are already involved in the hypergraph structure which alleviate the training burden of neural networks and the dilemma of scarce data. In addition, we design a special matrix propagation rule that captures non-pairwise complex relationships between entities. Using item nodes as links, hypergraph convolution propagation between user and bundle nodes generates the learned representations. Experimental results on two real-world datasets demonstrate that SHCBR outperforms the state-of-the-art baselines by 11.07%-25.66\% on Recall and 16.81%-33.53% on NDCG. We publicly release the codes and datasets at https://github.com/Lxtdzh/SHCBR-master/.

Multi-task Gaussian processes (MTGPs) are a powerful approach for modeling structured dependencies among multiple tasks. Researchers on MTGPs have contributed to enhance this approach in various ways. Current MTGP methods, however, cannot model nonlinear task correlations in a general way. In this paper we address this problem. We focus on spectral mixture (SM) based kernels and propose an enhancement of this type of kernels, called multi-task generalized convolution spectral mixture (MT-GCSM) kernel. The MT-GCSM kernel can model nonlinear task correlations and mixtures dependency, including time and phase delay, not only between different tasks but also within a task at the spectral mixture level. Each task in MT-GCSM has its own generalized convolution spectral mixture kernel (GCSM) with a different number of convolution structures and all spectral mixtures from different tasks are dependent. Furthermore, the proposed kernel uses inner and outer full cross convolution between base spectral mixtures, so that the base spectral mixtures in the tasks are not necessarily aligned. Extensive experiments on synthetic and real-life datasets illustrate the difference between MT-GCSM and other kernels as well as the practical effectiveness of MT-GCSM.

In recent years, graph neural networks (GNNs) have become a promising method for analyzing data structured in graph format. By considering connections between entities in a graph, GNNs are able to extract valuable insights. One notable variation of GNN is the graph attention network (GAT), which employs the attention mechanism and has demonstrated promising performance in various applications. However, its ability to incorporate feature information from nodes beyond the immediate neighborhood is limited, leading to degraded performance on heterophilic data. To address this limitation, this thesis proposes a novel attention-based model, namely the Directional Graph Attention Network (DGAT). This model combines the feature-based attention with the global directional information extracted from the graph topology, as inspired by the Directional Graph Network (DGN). A new class of Laplacian matrices is proposed and an existing theoretical result on DGN is extended. This extension bridges a gap in the literature. The experimental results presented in the thesis, based on nine real-world benchmarks and ten synthetic data sets, demonstrate the superiority of the proposed DGAT model compared to the GAT baseline model. Particularly on heterophilic data sets, DGAT showed a notable average increase of approximately 35% in node classification tasks across all heterophilic real-world data sets. In addition, DGAT outperforms GAT by an average margin of around 51% in all ten synthetic data sets with various levels of heterophily

In this paper, a relatively new hyper convolution spectra for characterization liquid, viscoelastic and solid samples is presented. Special attention is paid to the biophysical characterization of epithelial tissues and early detection of cancer of the skin, cervix, colon, and oral cavity. The method is based on the use of two types of white light, diffuse and polarized, from the same LED light sources. Based on the subtraction of the intensity values of these two lights and using the hyper convolution algorithm, the ratio of paired and unpaired electrons of tissue is obtained. This ratio correlates well with the state of the tissue: normal, irritating, precancerous, and cancerous. First, a proof-of-concept studies were performed, and later clinical studies on samples from one thousand two hundred fifteen people were performed. It showed that hyper Opto-Magnetic Imaging Spectroscopy (OMIS) can detect epithelial tissue cancers with an accuracy of 85-96%. Bearing in mind that the OMIS method also acquires the biophysical characteristics of the deeper skin layers (epidermis, basement membrane, dermis) by analysing convolution spectra of RGB channels of both diffuse and polarized white light, it is possible to apply this method in cosmetics (skin hydration, collagen, and elastin states, etc.). During OMIS applications, we noticed places where improvements could be made to increase method’s accuracy using advanced machine learning methodologies.

Cancer being a multi-factorial disease, a multi-target approach is needed to treat it with minimal side-effects. Therefore, combined use of a proven herbal formula with chemo-therapy could be the better therapeutic. It may maintain homeostasis by synergistically targeting multiple signaling pathways involved in tumorigenesis, thus circumventing recurrence, resistance, and immunosuppression. Here we aim to determine the effectiveness and safety of an FDA-approved herbal formula, SR033 in combination with 5-fluorouracil (5FU) and paclitaxel (PTX). We report chemo-sensitization and chemo-synergy in HeLa and MCF-7 cell lines, immunomodulation of COX-2, PD-L1, VEGF and TGFβ and overall survival in-vitro and in-vivo via oral and topical delivery of SR033. In-vitro, SR033/5FU significantly reverses 5FU and PTX-resistance, lower COX-2, and PD-L1, resulting in TGFβ/ VEGF axis modulation. Furthermore, the study suggests that due to anti-oxidative potential of SR033, oral administration exerts chemo-preventive activity and restores cellular compartment in solid tumor and ascites-bearing mice models. Furthermore, the topical application, SR033L with low-dose 5FU increases survival rate, reduces tumor growth, and completely restores local and peripheral neutrophil-lymphocyte ratio in solid tumor mice model. The study indicates that SR033 could be a strong candidate in combination with low-dose 5FU and PTX for a holistic approach to cancer management.

Today, there are commercially available high-performance electric wheelchairs, capa-ble of responding to strong limitations. However, despite these advancements, there is a significant portion of the population with severe disabilities who cannot access this mobility solution due to safety reasons. Indeed, either due to motor issues preventing reliable control of the wheelchair's commands, or associated visual or cognitive pathologies, the use of an electric wheelchair by these individuals would put them at risk and could also constitute a danger to those around them. This is why our research team is working on the development of augmented wheelchairs that allow a greater autonomy. We are mainly developing a system compatible with all electric wheel-chairs on the market, capable of making them anti-collision and anti-fall on uneven ground (sidewalks, stairs, etc.). In this article, we present our solution regarding the anti-collision function, in particular the sensors used to do this, as well as the strategy. We will focus on the shortcomings and weaknesses of various types of sensors and demonstrate how, by combining them in a certain way, we can develop a collision avoidance device capable of managing the diversity of everyday life situations. The two types of sensors that will be combined here are an in-house developed special near infrared sensor from the laboratory and a commercially available ultrasonic sensor. We will present the internal operation of the sensors, their limitations, experimental tests involving integration with the wheelchair, and the structure of the complete device.

Spatio-temporal aspects of data lead to critical information. Sensors capture data at all scales continually so it is imperative that useful information be extracted ubiquitously and regularly. Location plays a vital part by helping understand relations between datasets. It is crucial to link developmental works with spatial attributes and current challenge is to create an open platform that manages real-time sensor data and provides critical spatial analytics atop expert domain knowledge provided in the system. That is a two-faced problem where the solution tackles not only data from multiple sources but also runs data management platform, a spatial data infrastructure(SDI) as backbone framework able to harness sensor web(SW). The paper proposes development of such a globally shared open spatial expert system(ES), SmaCiSENS, a first of a kind geo-enabled knowledge based(KB) ES for multiple fields, smarter cities to climate modeling. SmaCiSENS is integration of SW and SDI with domain KB on data and problems, ready to infer solutions. The paper describes an architecture for semantic enablement for SW, SDI; connect interfaces, functions of SDI and SW, and sensor data application program interfaces (APIs) to better manage climate modeling, geohazard, global changes, and other vital areas of attention and action.

Air traffic congestion is caused by the unbalance between increasing traffic demand and saturating capacity. Flight delay not only causes huge economical lost, but also has very negative environmental impact in the whole air transportation system. In order to identify the impact of extended TMA on airport capacity, an airspace capacity assessment method based on augmented cell transmission model was proposed. Firstly, the airspace structure was modeled with points, segments, layers, and cells. Secondly, mixed integer linear programming model was built up with maximum throughput or capacity as the objective function. Finally, genetic algorithm was used to find the optimal result, and the results were validated by comparing with the fast-time simulation results generated by total airspace and airport modeler (TAAM) software. It is found that the proposed method could achieve a relatively accurate result in a much affordable and fast way. The numerical results could be very helpful for air traffic controllers to analyze the dynamic traffic flow entering and exiting TMA, so as to make decisions via reasonable analysis and do planning in advance by referring to the airport capacity.

The airborne and satellite-based synthetic aperture radar enables the acquisition of high-resolution SAR oceanographic images in which even the outlines of ships can be identified. The detection of ship targets from SAR images has a wide range of applications, such as the military, where the dynamic grasp of enemy targets can help improve the early warning capability of naval defence, and the civilian detection of illegal fishing vessels can help improve the level of maritime management. Due to the density of ships in SAR images, the extreme imbalance between foreground and background clutter, and the diversity of target sizes, achieving lightweight and highly accurate multi-scale ship target detection remains a great challenge. To this end, this paper proposes an attention mechanism for multiscale receptive fields convolution block (AMMRF). AMMRF not only makes full use of the location information of the feature map to accurately capture the regions in the feature map that are useful for detection results, but also effectively captures the relationship between the feature map channels, so as to better learn the relationship between the ship and the background. Based on this, a new YOLOv7-based ship target detection method, You Only Look Once SAR Ship Identification (YOLO-SARSI), is proposed, which acquires the abstract semantic information extracted from the high-level convolution while retaining the detailed semantic information extracted from the low-level convolution. Compared to the deep learning detection methods proposed by previous authors, our model is more lightweight, only 18.43M. We examined the effectiveness of our method on two SAR image public datasets: the High-Resolution SAR Images Dataset (HRSID) and the Large-Scale SAR Ship Detection Dataset-v1.0 (LS-SSDD-V1.0). The results show that the average accuracy AP50 of the detection method YOLO-SARSI proposed in this paper on the HRSID and LS-SSDD-V1.0 datasets is 4.9% and 5% higher than that of YOLOv7, respectively.

Multi-floor environments are usually ignored while designing an autonomous robot for indoor cleaning applications. However, for efficient operation in such environments, the ability of a robotic platform to traverse staircases is crucial. Staircase detection and localization is highly important for planning the traversal on staircases. This paper describes a deep learning approach using Convolutional Neural Networks (CNNs) based Robot Operation System (ROS) to staircase detection and localization. We use an object detection network to detect staircases in images. We also localize these staircases using a contour detection algorithm to detect the target point, a point close to the center of the first step, and the angle of approach to the target point. Experiments are performed with data obtained from images captured on different types of staircases at different view points/angles. Results show that the approach is very accurate in identifying the presence of the staircase in the working environment and is also able to locate the target point with good accuracy.

Many studies in the current literature annotate patterns in stock prices and use computer vision models to learn and recognize these patterns from stock price-action chart images. Additionally, current literature also use Long Short-Term Memory Networks to predict prices from continuous dollar amount data. In this study, we combine the two techniques. We annotate the consolidation breakouts for a given stock price data, and we use continuous stock price data to predict consolidation breakouts. Unlike computer vision models that look at the image of a stock price action, we explore using the convolution operation on raw dollar values to predict consolidation breakouts under a supervised learning problem setting. Unlike LSTMs that predict stock prices given continuous stock data, we use the continuous stock data to classify a given price window as breakout or not. Finally, we do a regularization study to see the effect of L₁, L₂, and Elastic Net regularization. We hope that combining regression and classification shed more light on stock market prediction studies.

The way in which the human being learns certain complex contents has always been a focus of interest and a challenge for researchers. Given the fact that children's cognitive abilities do not fully develop until a certain age, this topic is particularly important in the young children's learning scope as they do not correctly and easily learn some content of abstract nature, such as contents in math class. This work presents the results of the use of an application called "Mathematics Learning System with Augmented Reality based on Kinect" (SAM-RAK by its acronym in Spanish), which was designed to cover basic topics of mathematics in the Basic General Education level (EGB by its acronym in Span-ish) in Ecuador. The research was carried out under an experimental quantitative approach with 30 children (18 girls and 12 boys), who study in third grade of EGB level, from 2 different educational in-stitutions in Riobamba city. In order to obtain the results that evaluate the developed application, a pre-test and a post-test were applied, which were contrasted with the student’s t-test for paired samples. The statistical evidence suggests that the proposed computer system had a positive effect on children's performance, when it was used as a support tool in the classroom. The system was more effective in low performance children compared to those of high performance. It was also proved that children were motivated and showed positive attitudes when using the proposed System.

Water pollutants removal by biomass adsorbent has been considered innovative and cost effective, thus commendable for application in industrial applications. However, certain important aspects have been overlooked by researchers, namely the efficiency in the operation time and pollutant removal. In this research, landfill leachate samples with organic components were treated using bentonite-enriched with sawdust augmented (SBR) process. By modifying the pH, the sawdust samples were categorized into three: the acidic, the alkaline, and the neutral. To bentonite samples, the pH-adjusted sawdust was added at 10%, 20%, and 30% amounts by mass respectively. At the optimum aeration rate of 7.5 L/min and contact period of 22 h, the treatment achieved 99.28% and 95.41% removal of COD and NH₃-N with bentonite respectively. For both pollutants, in the presence of sawdust, the removal reduced by about 17% with contact period reduced to 2 h which was a considerable achievement.

International trade has been one of the most significant economic activities among countries, and its contributions towards a country’s economic growth and sustainable development have been acknowledged. In recent times, international trade and global trade networks have received preeminent attention due to the sharp growth in trade volumes and its contributions to poverty reduction and general welfare. Despite the growth in global trade volumes, there are worrying concerns about the unprecedented changes in international trade patterns and growing imbalances in trade in recent times. Whereas China’s trade volumes have more than tripled over the last decades and have maintained the largest trade surplus spot ahead of Germany, other major trade surplus countries such as Japan, the USA, etc. have become trade deficit countries with their trade volumes increasing at a much slower pace. In view of the growing imbalances in global trade volumes, we use an augmented gravity model of trade that incorporates social network measurement, the real effective exchange rate which is a measurement of international competitiveness, as well as the Linder theory of trade, to investigate the factors that determine the export performance of countries. Using data from 51 countries for 41 years, our results indicate that the GDP of both the home country and the partner country affects the home country’s exports positively. Similarly, the real effective exchange rate REER, trade openness OPEN and dummy variables BORDER, ENGLISH, and EU have produced positive and statistically significant coefficient estimates, and these are in line with our theoretical expectations.

Existing Knowledge Graph (KG) models for commonsense question answering present two challenges: (i) existing methods retrieved entities related to questions from the knowledge graph, which may extract noise and irrelevant nodes, and (ii) lack of interaction representation between questions and graph entities. However, current methods mainly focus on retrieving relevant entities with some noisy and irrelevant nodes. In this paper, we propose a novel Retrieval-augmented Knowledge Graph (RAKG) model, which solves the above issues through two key innovations. First, we leverage the density matrix to make the model reason along the corrected knowledge path and extract an enhanced knowledge graph subgraph. Second, we fuse representations of questions and graph entities through a bidirectional attention strategy, in which two representations fuse and update by Graph Convolutional Network (GCN). To evaluate the performance of our method, we conduct experiments on two widely-used benchmark datasets CommonsenseQA and OpenBookQA. The case study gives insight into findings that the augmented subgraph provides reasoning along the corrected knowledge path for question answering.

The Practicum is regarded as a fundamental aspect of the training of prospective teachers. In addition, digital tools are increasingly used to enrich a traditional face-to-face experience. However, the technological exploitation of augmented reality (AR) by undergraduate students studying early childhood and primary education is low. A Systematic Literature Review (SLR) on the use of augmented reality (AR) in teacher training was conducted. Based on the overarching objectives of the ERASMUS+ project, entitled Digital Practicum 3.0 Exploring Augmented Reality, Remote Classrooms, and Virtual Learning to Enrich and Expand Preservice Teacher Education Preparation (2020-1-ES01-KA226-HE- 096120), the ultimate purpose of this study was to assess whether the use of this resource favors learning and expertise. Two main results are prominent. First, it is noteworthy how the use of this digital technology is limited, given the scarcity of studies. Second, the research studies available focus largely on the benefits of the use of AR in teacher education at a theoretical level. Thus, future research needs to further explore the use of AR in teacher training specially focused on the student teachers’ learning processes.

Background: Ongoing molecular profiling studies enabled by advances in biomedical technologies are producing vast amounts of ‘omic’ data for early detection, monitoring, and prognosis of diverse diseases. A major common limitation is the scarcity of biological samples, necessitating integrative modeling frameworks that can make optimal use of available data for disease classification tasks. Related data sets are often available from different studies, but may have been generated using different technology platforms. Thus, there is a critical need for flexible modeling methods that can handle data from diverse sources to facilitate the discovery of robust biomarkers that underlie disease regulatory processes. Results: In this paper, we introduce a novel framework called Knowledge Augmented Rule Learning (KARL), which incorporates two sources of knowledge, domain, and data, for pattern discovery from small and high-dimensional datasets, such as transcriptomic data. We propose KARL as a transfer rule learning framework in which knowledge of the domain is transferred to the learning process on data in order to 1) improve the reliability of the discovered patterns, and 2) study the knowledge of the domain when used along with data for modeling. In this work, we generated KARL models on gene expression datasets for five types of cancer, including brain, breast, colon, lung, and prostate. As our knowledge of the domain, we used the Ingenuity Knowledge Base (IKB) to extract genes related to hallmarks of cancer and annotated these prior relationships before learning classifiers from these datasets. Conclusions: Our results show that KARL produces, on average, rule models that are more robust classifiers than the baseline without such background knowledge, for our tasks of cancer prediction using 25 publicly available gene expression datasets. Moreover, KARL helped us learn insights about previously known relationships in these gene expression datasets, along with new relationships not input as known, to enable informed biomarker discovery for cancer prediction tasks. KARL can be applied to modeling similar data from any other domain and classification task. Future work would involve extensions to KARL to handle hierarchical knowledge to derive more general hypotheses to drive biomedicine.

The primary goal of picture compression is to reduce the amount of unused image data while still storing or transmitting it in a format that is appropriate. The compression of raw binary data is quite different from the compression of a picture, and these differences may be rather substantial. In light of this, compression is often regarded as an essential technique for the purposes of both data storage an d transmission in order to mitigate the excessive amounts of data that are generated by these images. In order to transmit enormous datasets, particularly for the purposes of telemedicine and teleradiology, one needs a significant amount of storage capacity as well as an expansive network. As a result, compression is an important aspect of medical imaging. In addition to the importance of compression, the quality of the photos themselves is also an essential factor in the success of analysis. In addition to this, the amount of time necessary to compress the photographs before sending them should be reduced.

Speech emotion recognition remains a heavy lifting in natural language processing. It has strict requirements to the effectiveness of feature extraction and that of acoustic model. With that in mind, a Heterogeneous Parallel Convolution Bi-LSTM model is proposed to address these challenges. It consists of two heterogeneous branches: the left one contains two dense layers and a Bi-LSTM layer, while the right one contains a dense layer, a convolution layer, and a Bi-LSTM layer. It can exploit the spatiotemporal information more effectively, and achieves 84.65%, 79.67%, and 56.50% unweighted average recall on the benchmark databases EMODB, CASIA, and SAVEE, respectively. Compared with the previous research results, the proposed model achieves better performance stably.

To efficiently use its finite resources, the visual system selects for further processing only a subset of the rich sensory information. Visual masking and spatial attention control the information transfer from visual sensory-memory to visual short-term memory. There is still a debate whether these two processes operate independently or interact, with empirical evidence supporting both arguments. However, recent studies pointed out that earlier studies showing significant interactions between common-onset masking and attention suffered from ceiling and/or floor effects. Our review of previous studies reporting metacontrast-attention interactions revealed similar artifacts. Therefore, we investigated metacontrast-attention interactions by using an experimental paradigm in which ceiling/floor effects were avoided. We also examined whether metacontrast masking is differently influenced by endogenous and exogenous attention. We analyzed mean absolute-magnitude of response-errors and their statistical distribution. Our results support the hypothesis that metacontrast and endogenous/exogenous attention are largely independent with negligible likelihood for interactions. Moreover, statistical modeling of the distribution of response-errors suggests weak interactions modulating the probability of “guessing” behavior for some observers in both types of attention. Nevertheless, our data suggest that any joint effect of attention and metacontrast can be adequately explained by their independent and additive contributions.

Using the senses is essential to interact with objects in real-world environments. However, not all the senses are available when interacting with virtual objects in virtual environments. This paper presents a diamond methodology to fuse two technologies to represent the senses of sight and touch when interacting with a virtual object. The sense of sight is represented through augmented reality, and the sense of touch is represented through kinesthetic haptics. The diamond methodology is centered on the user experience and comprises five general stages: Experience design, Sensory representation, Development, Display, and Fusion. The first stage comes from the expected, proposed, or needed user experience. Then, each technology takes its homologous activities from the second to the fourth stage, diverging from each other along their development. Finally, the technologies converge to the fifth and final stage for fusion in the user experience. The diamond methodology was tested by generating a user's dual sensation when interacting with the elasticity of a tension virtual spring. The user can simultaneously perceive the visual and tactile change of the virtual spring during the interaction, representing the object's deformation. The experimental results demonstrated that an interactive experience can be felt and seen in augmented reality following the diamond methodology.

Internationalization and alternative ways for strategic management have been an objective for stakeholders in cultural industry, especially after COVID-19 pandemic crisis. During the past years “internationalization” has been almost exclusively related with promoting creation or content to larger audiences. Such a strategy seemed sufficient, even if empirical data did not always support such a belief. Technological progress and costs reduction in developing Virtual Reality (VR) and Augmented Reality (AR) applications, provides to cultural industry the opportunity to reach global audiences and to enrich their experience. Current research provides evidence about developing VR and AR tools that can act as internationalization facilitators when it comes to cultural industry. Research conducted during “VARSOCUL” project funded by the European Regional Development Fund (ERDF) as part of the Greek National Scope Action entitled "RESEARCH-CREATE-INNOVATE". The project’s main result, alongside with VR and AR tools developed are presented.

Anomaly detection and segmentation aim at distinguishing abnormal images from normal images and further localizing the anomalous regions. Feature reconstruction based method has become one of the mainstream methods for this task. This kind of method has two assumptions: (1) The features extracted by neural network is a good representation of the image. (2) The autoencoder solely trained on the features of normal images cannot reconstruct the features of anomalous regions well. But these two assumptions are hard to meet. In this paper, we propose a new anomaly segmentation method based on feature reconstruction. Our approach mainly consists of two parts: (1) We use a pretrained vision transformer (ViT) to extract the features of the input image. (2) We design a self-attention autoencoder to reconstruct the features. We regard that the self-attention operation which has a global receptive field is beneficial to the methods based on feature reconstruction both in feature extraction and reconstruction. The experiments show that our method outperforms the state-of-the-art approaches for anomaly segmentation on the MVTec dataset. It is both effective and time-efficient.

Amyotrophic Lateral Sclerosis (ALS) is a prototypical neurodegenerative disease characterized by progressive degeneration of motor neurons to severely effect the functionality to control voluntary muscle movement. Most of the non additive genetic aberrations responsible for ALS make its molecular classification very challenging along with limited sample size, curse of dimensionality, class imbalance and noise in the data. Deep learning methods have been successful in many other related areas but have low minority class accuracy and suffer from the lack of explainailbilty when used directly with RNA expression features for ALS molecular classification. In this paper we propose a deep learning based molecular ALS classification and interpretation framework. Our framework is based on training a convolution neural network (CNN) on images obtained from converting RNA expression values into pixels based on DeepInsight similarity technique. Then we employed Shapley Additive Explanations (SHAP) to extract pixels with higher relevance to ALS classifications. These pixels were mapped back to the genes which made them up. This enabled us to classify ALS samples with high accuracy for a minority class along with identifying genes that might be playing an important role in ALS molecular classifications. Taken together with RNA expression images classified with CNN, our preliminary analysis of the genes identified by SHAP interpretation demonstrate the value of utilising Machine Learning to perform molecular classification of ALS and uncover disease-associated genes.

Implementing digital technologies, such augmented reality and 3D models, to various cultural sectors is an ongoing procedure, especially favorable after COVID-19 pandemic. Even though such technologies are familiar to museums, galleries and archaeological places all over the world, little research or practical cases have been developed when it comes to theaters and theatrical costumes. Proposed research article describes the methodology of both reference material collection and applications development, while an analysis of functions and aesthetic results are described, especially when it comes to 3D models. The paper’s aim to reveal that theatrical operations (as part of cultural sector) as well as structured parts (such as acts, performances and costumes) can be preserved and served to larger audiences via technological means, such as an augmented reality application.

As the world increasingly becomes more interconnected, the demand for safety and security is ever-increasing, particularly for industrial networks. This has prompted numerous researchers to investigate different methodologies and techniques suitable for intrusion detection systems (IDS) requirements. Over the years, many studies have proposed various solutions in this regard including signature-based and machine-learning (ML) based systems. More recently, researchers are considering deep learning (DL) based anomaly detection approaches. Most proposed works in this research field aimed to achieve either one or a combination of high accuracy, considerably low false alarm rates (FARs), high classification specificity and detection sensitivity, achieving lightweight DL models, or other ML and DL-related performance measurement metrics. In this study, we propose a novel method to convert a raw dataset to an image dataset to magnify patterns. Based on this we devise an anomaly detection for IDS using a lightweight convolutional neural network (CNN) that classifies denial of service and distributed denial of service. The proposed methods were evaluated using a modern dataset, CSE-CIC-IDS2018, and a legacy dataset, NSL-KDD. We have also applied a combined dataset to assess the generalization of the proposed model across various datasets. Our experimental results have demonstrated that the proposed methods achieved high accuracy and considerably low FARs with high specificity and sensitivity. The resulting loss and accuracy curves have also demonstrated the excellent generalization of the proposed lightweight CNN model, effectively avoiding overfitting. This holds for both the modern and legacy datasets, including their mixed version.

In the realm of autonomous vehicle environment perception, the primary objective of point cloud target detection is to swiftly and accurately identify three-dimensional objects from point cloud data. To meet this requirement, the prevalent network architecture employed in the industry is the voxel-based PointPillars model. Nonetheless, this model faces challenges in maintaining detection accuracy when objects are obscured or diminutive in size. In response to this issue, we introduce AGPNet, a novel model that seamlessly integrates four key modules: Data Augmentation, Dynamic Graph CNN, Pillar Feature Net, and Detection Head (SSD). The Data Augmentation module enhances the adaptability of point cloud data to complex and ever-changing real-world environments. The Dynamic Graph CNN module endows the network structure with geometric features, which encapsulate not only the point itself but also its adjacent points. The Pillar Feature Net module translates three-dimensional point cloud data into pseudo-image data through the utilization of voxels. Subsequently, the Detection Head (SSD) module leverages this pseudo-image data to conduct target detection of three-dimensional objects. Our experiments, conducted on the KITTI dataset, demonstrate that our proposed method boosts object detection accuracy by 6-7 percentage points compared to the PointPillars model, while maintaining similar detection times.

With the recent developments in augmented reality (AR) technologies comes an increased interest in the use of smart glasses for hands-on training. Whether this interest is turned into market success or not depends at the least on whether the interaction with smart AR glasses satisfies users, an aspect of AR use that so far has received little attention. With this contribution, we seek to change this. The objective of the article, therefore, is to investigate user satisfaction in AR applied to three cases of practical use. User satisfaction of AR can be broken down into satisfaction with the interaction and satisfaction with the delivery device. A total of 142 participants from three different industrial sectors contributed to this study, namely, aeronautics, medicine, and astronautics. In our analysis, we investigated the influence of different factors, such as age, gender, level of education, level of Internet knowledge, and the roles of the participants in the different sectors. Even though users were not familiar with the smart glasses, results show that general computer knowledge has a positive effect on user satisfaction. Further analysis using two-factor interactions shows that there is no significant interaction between the different factors and user satisfaction. The results of the study affirm that the questionnaires developed for user satisfaction of smart glasses and the AR application performed well, but leave room for improvement.

Augment reality (AR) is crucial for immersive human-computer interaction (HCI) and vision of artificial intelligence (AI). Labeled data drove object recognition in AR. However, manual annotating data is expensive and labor-intensive, and furthermore, scanty labeled data limits the application of AR. Aiming at solving the problem of insufficient training data in AR object recognition, an automated vision data synthesis method called BAGAN is proposed in this paper based on the 3D modeling and GAN algorithm. Our approach has been validated to have better performance than other methods through image recognition task on natural image database ObjectNet3D. This study can shorten the algorithm development time of AR and expand the application scope of AR, which is of great significance to immersive interactive systems.

Agriculture is one of the indispensable fields for the survival of mankind. Potatoes also have a significant role in the field of agriculture. The quality and quantity of potatoes are significantly impacted by several diseases, such as early blight and late blight, and manual interpretation of these leaf diseases is time-consuming and inconvenient. Fortunately, leaf appearance is used to detect diseases in potato plants. Productivity will considerably rise if the infections are detected early. Different types of image processing methods and machine learning methods are used for early recognition of those diseases from leaf images so that the product losses are decreased significantly. For the incredible and marvelous performance of CNN, it is the most popular deep learning method that is used immensely for the recognition of leaf diseases from images. Several pretrained deep learning models, such as VGG16, ResNet50, InceptionV3, MobileNetV2, Xception, and a deep learning model developed using CNN, are employed for potato leaf disease classification and recognition on the same dataset. The transfer learning technique is applied to the pretrained model and the data augmentation technique is applied to the Proposed CNN model for potato disease classification from leaf samples. Compared to pretrained models, the proposed CNN model offers the lowest loss and highest accuracy for potato leaf disease detection while using fewer parameters and layers. It achieves the best performance with a test accuracy of 99.33% compared to other Pretrained models used in the diagnosis of potato leaf disease.

In this study, we investigate the performance of the saddlepoint approximation of the probability mass function and the cumulative distribution function for the weighted sum of independent Poisson random variables. The goal is to approximate the hazard rate function for this complicated model. The better performance of this method is shown by numerical simulations and comparison with a performance of other approximation methods.

Cyber security plays an important role to protect our computer, network, program and data from unauthorized access. Intrusion detection system (IDS) and intrusion prevention system (IPS) are two main categories of cyber security, designed to identify any suspicious activities present in inbound and outbound network packets and restrict the suspicious incident. Deep neural network plays a significant role in the construction of IDS and IPS. This paper highlights a novel IDS using optimized convolution neural network (CNN-IDS). An optimized CNNIDS model is an improvement over CNN which selects the best weighted model by considering the loss in every epoch. All the experiments have been conducted on the well known NSL-KDD dataset. Information gain has been used for dimensionality reduction. The accuracy of the proposed model is evaluated through optimized CNN for both binary and multiclass categories. Finally, a critical comparison has been performed with other general classifiers like J48, Naive Bayes, NB tree, Random forest, Multilayer Perceptron (MLP), Support Vector Machine (SVM), Recurrent Neural Network (RNN) and Convolution Neural Network(CNN). All the experimental results demonstrate that the optimized CNN-IDS model records the best recognition rate with minimum model construction time.

A major challenge of augmented and mixed reality applications is identifying the context and semantics of the real environment. Studies on object and action recognition were developed based on the improvement of machine learning techniques, allowing them to be annotated and recognized. This study aims to characterize current knowledge on the use of machine learning for recognizing objects and actions in augmented and mixed reality environments, increasing context awareness. Therefore, a systematic literature review of works related to these topics was made, using the Scopus and Web of Science knowledge bases. We searched articles and conference reviews or papers published between 2018 and 2022 and selected fifteen studies to be reviewed. The results indicate that there is a great demand for using machine learning to immersive technologies in factories, engineering, entertainment, education, health, among other application domains. However, these real-time interactive systems still have challenges and limitations to be solved, involving network communication, prediction time and the creation of a model that recognize objects and actions in broad contexts. Furthermore, additional research is needed to investigate how object and action recognition can increase context awareness in augmented reality applications.

The neural system has limited resources to interact with the environment, and this is where attention comes into play. Attention is a complex process that provides numerous benefits, but there has been a longstanding debate about the mechanisms involved in attentional orientation. Two widely proposed mechanisms are top-down and bottom-up, which relate to the organism's current behavioral goal and the salience of environmental stimuli, respectively. However, distinguishing between these mechanisms can be challenging in both behavioral and neural studies. This review introduces a new conceptualization in which both top-down and bottom-up mechanisms are viewed as aspects of the same process. This unified approach aims to prepare the organism to face stimuli and events based on its prior experiences, immediate (the current task that he/she is aware of), and innate (to be alive) demands.

One of the most leading causes of death worldwide is Colorectal cancer(CRC). Polyp segmentation is the most important detected measure for preventing CRC. However, there is still a missing rate for diminutive polyps and multiple ones. In order to solve the phenomenon, we propose to introduce auxiliary attention module(AAM) that can enhance the learning of features related to multiple and diminutive polyps by focusing more on the located and detailed information. Meanwhile, we design to decrease missed rate of multiple and diminutive polyps by implementing an area adaptive loss(AAL) which adapts the weight according to the area and the number of polyps. Our proposed novel AAM and AAL concentrates on training with hard examples and localized information. To evaluate the effectiveness and generalization ability of our proposed model, We utilize three different datasets of variable sizes and a cross dataset. Our proposed method achieves the best results on the Kvasir-SEG dataset, the CVC-ClinicDB dataset and the cross dataset, particularly for the Kvasir-Sessile dataset consisting of small,flat and diminutive polyps. Extensive experimental results show that our proposed DoubleAANet surpass the performance of all existing state-of-the-art segmentation methods.

Through the refinement of approaches to applying visual augmentation to virtual environments, the possibilities of utilising this process in robotics continues to be explored. However these endeavours have only yielded a collaborative relationship between the two technologies, where the augmented reality (AR) component is separate from the robot functionality. Regarding telepresence robots, research has shown that their perceived usefulness wanes in comparison to that of video conferencing tools as they do not offer a level of immersion and modified visual experience to justify their use. Therefore this paper contributes a novel virtually augmented robot (VAR) model that embeds AR functionality into telepresence, through the use of augmentation and facial recognition sub-models and algorithms. Experimental results show that using pulse width modulation (PWM), duty cycles, digital signals and accelerometer angles provides an approach for stabilising robot motion and the transference of human to robot head movement. The results also show the benefit of having a robot model with intrinsic AR functionality, as it offers a greater level of immersion and visual control of an environment.

Attention Deficit Hyperactivity Disorder (ADHD) it is known as a neuropsychiatric disorder. Anatomicaly components with implications in this previously mentioned disorder, are the anterior cingulate gyrus and dorsolateral prefrontal cortex (DLFPC) that are are found having a role in appearing this disease. ADHD is associated with cognitive and functional deficits that relate to diffuse abnormalities in the brain. ADHD is a specific pathology in children but may persisit to youth and also not so hard to find to adults.Till now, hard to find the curative treatment knowing ADHD as a neuropsychiatric disorder with enlarge unknown scientific points. Genetic and environmental component play an important role in diagnosis. Patients life style, a relevant history of individual geneticsand environmental factors are important in diagnosisThe management of ADHD, is also an important part togeter with future trends.

Teeth segmentation plays a pivotal role in dental diagnosis, treatment, planning, and the development of computer-aided dental systems. It enables precise identification and analysis of dental structures, aiding in detecting dental abnormalities, measuring tooth dimensions, and assessing oral health conditions. Accurate teeth segmentation also facilitates the automation of dental workflows, leading to improved efficiency and reduced human error. Artificial Intelligence (AI) has witnessed rapid advancements, with various approaches developed or enhanced. While Convolutional Neural Networks (CNNs) have been widely used in medical image segmentation, the U-Net architecture has emerged as a standout performer due to its exceptional segmentation capabilities. This paper presents a proof of concept for the Attention U-Net architecture, as previously used in [1], applied to teeth segmentation. The study demonstrates the superior performance of this network in accurately segmenting teeth using a newly available benchmark dataset called Tufts Dental X-Ray Dataset. When trained and tested on 10-fold cross-validation, the model achieved an average dice coefficient of 95.01%, intersection over union of 90.6%, and pixel accuracy of 98.82%. These scores surpass those of all other networks implemented on the same dataset. By leveraging the Attention U-Net architecture, our research showcases the potential of advanced AI techniques in dental radiography. The findings contribute to the ongoing efforts to develop automated systems to assist dental professionals in their clinical practice.

Laser-targeted weeding methods further enhance the sustainable development of green agriculture, with one key technology being the improvement of weed localization accuracy. Here, we propose an improved YOLOv8 instance segmentation based on bidirectional feature fusion and deformable convolution (BFFDC-YOLOv8-seg) to address the challenges of insufficient weed localization accuracy in complex environments with resource-limited laser weeding devices. Initially, by training on extensive datasets of plant images, the most appropriate model scale and training weights are determined, facilitating the development of a lightweight network. Subsequently, the introduction of the Bidirectional Feature Pyramid Network (BiFPN) during feature fusion effectively prevents the omission of weeds. Lastly, the use of Dynamic Snake Convolution (DSConv) to replace some convolutional kernels enhances flexibility, benefiting the segmentation of weeds with elongated stems and irregular edges. Experimental results indicate that the BFFDC-YOLOv8-seg model achieves a 4.9% increase in precision, an 8.1% increase in recall rate, and a 2.8% increase in mAP50 value to 98.8% on a vegetable weed dataset compared to the original model. It also shows improved mAP50 over other typical segmentation models such as Mask R-CNN, YOLOv5-seg, and YOLOv7-seg by 10.8%, 13.4%, and 1.8%, respectively. Furthermore, the model achieves a detection speed of 24.8 FPS on the Jetson Orin nano standalone device, with a model size of 6.8MB that balances between size and accuracy. The model meets the requirements for real-time precise weed segmentation, suitable for complex vegetable field environments and resource-limited laser weeding devices.

Deep learning methods have been widely used in PolSAR image classification. To learn the polarimetric information, many deep learning methods expect to learn high-level semantic features from original PolSAR data. However, only original data cannot learn multiple scattering features and complex structures for extremely heterogeneous terrain objects. In addition, deep learning methods always cause edge confusion due to the high-level features. To overcome these shortages, we propose a double-channel CNN network combined with an edge-preserving MRF model(DCCNN-MRF) for PolSAR image classification. Firstly, to combine complex matrix data and multiple scattering features together, a double-channel convolution network(DCCNN) is developed, which consists of a Wishart-based complex matrix and multi-feature subnetworks. The Wishart-based complex matrix network can learn the statistical characteristics and channel correlation well, and the multi-feature network can learn high-level semantic features well. Then, a unified network framework is designed to fuse two kinds of features to enhance advantageous features and reduce redundant ones. Finally, an edge preserving MRF model is designed to combine with the DCCNN network. In the MRF model, a sketch map-based edge energy function is designed by defining adaptive weighted neighborhood for edge pixels. Experiments are conducted on four real PolSAR data sets with different sensors and bands. Experimental results demonstrate the effectiveness of the proposed DCCNN-MRF method.

Periacetabular osteotomy (PAO) is an effective approach for surgical treatment of developmental dysplasia of the hip (DDH). However, due to the complex anatomical structure around the hip and limited field of view (FoV) during the surgery, it is challenging for surgeons to perform a PAO surgery. To solve this challenge, we propose a robot-assisted augmented reality (AR)-guided surgical navigation system for PAO. The system mainly consists of a robot arm, an optical tracker, and a Microsoft HoloLens 2 which is a state-of-the-art (SOTA) optical see-through head-mounted display (OST-HMD). For AR guidance, we propose an optical marker-based virtual-physical registration method to estimate a transformation from the optical tracker coordinate system (COS) to the virtual space COS, such that virtual models can be superimposed on the corresponding physical counterparts. Furthermore, to guide the osteotomy, the developed system automatically aligns the bone saw with osteotomy planes planned in preoperative images, and then provides surgeons with not only robot assistance but also AR guidance. Comprehensive experiments were conducted to evaluate both virtual-physical registration accuracy and osteotomy accuracy of the developed navigation system. The proposed virtual-physical registration method achieved an average mean absolute distance error (mADE) of 1.96 ± 0.43 mm. The developed system achieved an average distance deviation of 0.82 ± 0.17 mm and an average angular deviation of 3.77 ± 0.85 . Experimental results demonstrated high virtual-physical registration accuracy. The sub-millimeter distance deviation demonstrated the osteotomy accuracy of the proposed system.

The post-pandemic has forced it Indonesian cloth sellers in Indonesia are facing changes in consumer behavior who tend to shop online. They need to find innovative ways to market products and reach potential customers. One of the problems faced is how to present traditional fabrics effectively to potential buyers. Therefore, a more creative and interactive marketing approach is needed. Using the needs analysis method to design innovative augmented reality (AR) integration in the sale of Indonesian fabrics could be an interesting solution. With AR, which will later be called PARTIKA, sellers can show potential buyers how the fabric looks in various situations, provide virtual interaction with the product, and provide detailed information. This application can thus provide a more in-depth and convincing experience, helping customers make better purchasing decisions.

In the last years, interactive exhibitions based on digital technologies are becoming widely common, thanks to their flexibility and effectiveness in engaging visitors and creating memorable experiences. One of the topics in which digital technologies can be particularly effective is the communication of abstract concepts that are difficult for the human mind to imagine. An emblematic example is the astronomy discipline, which requires us to imagine and understand phenomena far away from our everyday life. In this paper, the authors present a research project, MARSS, in which digital technologies are used effectively to enhance the Users’ Experience of the Museo Astronomico di Brera located in Milan. Specifically, the MARSS project aims at designing and developing a new digital journey inside the museum to allow different categories of visitors to enjoy the exhibition in an engaging and interactive way. The paper presents the design and development phases of the experience and its evaluation with users. The results of the evaluation indicate that the digital interactive experience has been appreciated by users and is successful in translating the content of high scientific value into more engaging and easily understandable elements.

A single paragraph of about 200 words maximum. For research articles, abstracts should give a pertinent overview of the work. We strongly encourage authors to use the following style of structured abstracts, but without headings: (1) Background: Place the question addressed in a broad context and highlight the purpose of the study; (2) Methods: briefly describe the main methods or treatments applied; (3) Results: summarize the article's main findings; (4) Conclu-sions: indicate the main conclusions or interpretations. The abstract should be an objective rep-resentation of the article and it must not contain results that are not presented and substantiated in the main text and should not exaggerate the main conclusions.

The challenges to sustainability governance across multiple geographical/cultural contexts lead us to the “piecemeal engineering” idea advocated by the philosopher Karl Popper, which explicitly considers context. We argue for adopting the piecemeal engineering approach, augmented by adaptive policies and modern (online) collaboration platforms to maximize the prospects of sustainable practices worldwide. This recommended course is not intended to be a theory in itself. Rather, it is a well-grounded, practical and practicable stop-gap measure in times when complexity and change outpace theories and strategies. We present a philosophical foundation for this “Augmented Popperian Experimentation.” Focusing on The Water Network (the largest collaborative platform for water researchers and professionals), we show that sustainability-oriented organizations in the water realm and others are inching toward the practice we advocate. We discuss implications.

With advances in Building Information Modeling (BIM), Virtual Reality (VR) and Augmented Reality (AR) technologies have many potential applications in the Architecture, Engineering, and Construction (AEC) industry. However, the AEC industry, relative to other industries, has been slow in adopting AR/VR technologies, partly due to lack of feasibility studies examining the actual cost of implementation versus an increase in profit. The main objectives of this paper are to understand the industry trends in adopting AR/VR technologies and identifying gaps within the industry. The identified gaps can lead to opportunities for developing new tools and finding new use cases. To achieve these goals, two rounds of a survey at two different time periods (a year apart) were conducted. Responses from 158 industry experts and researchers were analyzed to assess the current state, growth, and saving opportunities for AR/VR technologies for the AEC industry. The findings demonstrate that older generations are significantly more confident about the future of AR/VR technologies and they see more benefits in AR/VR utilization. Furthermore, the research results indicate that Residential and commercial sectors have adopted these tools the most, compared to other sectors and institutional and transportation sectors had the highest growth from 2017 to 2018. Industry experts anticipated a solid growth in the use of AR/VR technologies in 5 to 10 years, with the highest expectations towards healthcare. Ultimately, the findings show a significant increase in AR/VR utilization in the AEC industry from 2017 to 2018.

This review explores the complex interrelationships between emotion, attention, and behavior, drawing upon empirical evidence from psychological, neuroscientific, and clinical studies. It delves into the neural mechanisms that underlie these interactions, with a focus on key brain regions such as the prefrontal cortex and amygdala. Clinical cases involving stroke and attention-deficit/hyperactivity disorder (ADHD) are examined to illustrate the real-world implications of these cognitive interactions. The review also discusses the impact of effective emotion regulation strategies and the role of attention as a cognitive mechanism that influences both emotion and behavior. Neuroimaging studies, particularly functional MRI, are highlighted for their role in providing a deeper understanding of these intricate relationships. The review concludes by emphasizing the importance of this triadic relationship in adaptive functioning and its broader implications for mental health, interpersonal relationships, and quality of life.

The demand for precise indoor localization services is steadily increasing. Among various methods, fingerprint-based indoor localization has become a popular choice due to its exceptional accuracy, cost-effectiveness, and ease of implementation. However, its performance degrades significantly as a result of multipath signal attenuation and environmental changes. In this paper, we propose an indoor localization method based on fingerprints using self-attention and long short-term memory (LSTM). By integrating a self-attention mechanism and LSTM network, the proposed method exhibits outstanding positioning accuracy and robustness in diverse experimental environments. The performance of the proposed method is evaluated under two different experimental scenarios, which involve 2D and 3D moving trajectories, respectively. The experimental results demonstrate that our approach achieves an average localization error of 1.76 m and 2.83 m in the respective scenarios, outperforming the existing state-of-the-art methods by 42.67% and 31.64%.

Multispectral image (MSI) and hyperspectral image (HSI) fusion (MHIF) aims to address the challenge of acquiring high-resolution (HR) HSI images. This field combines a low-resolution (LR) HSI with an HR-MSI to reconstruct HR-HSI. Existing methods directly utilize transformers to perform feature extraction and fusion. Despite the demonstrated success, there exist two limitations: 1) Employing the entire transformer model for feature extraction and fusion fails to fully harness the transformer’s potential in integrating the spectral of the HSI and spatial information of the MSI. 2) HSI has a strong spectral correlation and exhibits sparsity in the spatial domain. Existing transformer-based models do not optimize this physical property, which makes their methods prone to spectral distortion. To accomplish these issues, this paper introduces a novel framework for MHIF called Sparse Mix-Attention Transformer (SAMformer). Specifically, to fully harness the advantages of the Transformer architecture, we propose a Spectral Mix Attention Block (SMAB), which concatenates the keys and values extracted from LR-HSI and HR-MSI to create a new multi-head attention module. This design facilitates the extraction of detailed long-range information across spatial and spectral dimensions. Besides, to address the spatial sparsity inherent in HSI, we incorporated a sparse mechanism within the core of SMAB called Sparse Spectral Mix Attention Block (SSMAB). In the SSMAB, we compute attention maps from queries and keys and select the K highly correlated values as the sparse attention map. This approach enables us to achieve a sparse representation of spatial information while eliminating spatially disruptive noise. Extensive experiments conducted on three benchmark datasets, namely Cave, Harvard, and Pavia Center, demonstrate the SMAformer method outperforms state-of-the-art methods.

Recently deep cross-modal hashing networks have received increasing interests due to its superior query efficiency and low storage cost. However, most of existing methods concentrate less on hash representations learning part, which means the semantic information of data cannot be fully used. Furthermore, they may neglect the high-ranking relevance and consistency of hash codes. To solve these problems, we propose a Self-Attention and Adversary Guided Hashing Network (SAAGHN). Specifically, it employs self-attention mechanism in hash representations learning part to extract rich semantic relevance information. Meanwhile, in order to keep invariability of hash codes, adversarial learning is adopted in the hash codes learning part. In addition, to generate higher-ranking hash codes and avoid local minima early, a new batch semi-hard cosine triplet loss and a cosine quantization loss are proposed. Extensive experiments on two benchmark datasets have shown that SAAGHN outperforms other baselines and achieves the state-of-the-art performance.

Music and language are hypothesized to share neural resources, particularly at the level of syntax processing. Recent reports suggest that attention modulates this sharing of neural resources, but the time-course of the effects of attention, and the degree to which attention operates similarly on music and language, are yet unclear. In this EEG study we manipulate the syntactic structure of simultaneously presented musical chord progressions and garden-path sentences in a modified rapid serial visual presentation paradigm, while varying top-down attentional demands to the two modalities. The Early Right Anterior Negativity (ERAN) was observed in response to both attended and unattended musical syntax violations. In contrast, an N400 was only observed in response to attended linguistic syntax violations, and a P3 only in response to attended musical syntax violations. Results show that top-down allocation of attention indeed affects the processing of syntax in both music and language, with different neural resources acting upon the two modalities particularly at later stages of cognitive processing. However, the processing of musical syntax at an earlier stage of the perceptual-cognitive pathway, as indexed by the ERAN, is partially automatic, and is strongly indicative of separate neural resources for music and language.

Technology can be seen everywhere and has been integrated into our lives.We are always using technology and enjoying the convenience brought by technology. However, physical retailers and e-commerce companies are also gradually adopting advanced technologies. Technology improves the purchasing environment and purchasing experience. Virtual reality and augmented reality have been hotly discussed in recent years. Technology, although virtual reality and augmented reality technology have not yet matured, it can be said that they will in the future It has great development potential. Virtual reality and augmented reality are also beginning to sprout in the retail industry. However, research on the acceptance of the use of virtual reality and augmented reality in the apparel shopping process is still lacking because This study explores how usefulness, ease of use, hedonicity, customer experience, customer engagement and satisfaction. To influence customer loyalty, this study adopted questionnaire survey and convenience sampling methods, and collected a total of 308 valid questionnaires. The analysis method used confirmatory factor analysis and structural equation model to verify the research hypothesis relationship. The results of this study found. Hedonic has a significant impact on customer loyalty, while usefulness, ease of use, customer experience, customer engagement and satisfaction Satisfaction does not have a significant impact on customer loyalty. This study explains the academic contribution of the research results. The practical implications in marketing are put forward, and specific suggestions and directions for future research are given.

Table detection is a preliminary step in extracting reliable information from tables in scanned document images. We present CasTabDetectoRS, a novel end-to-end trainable table detection framework that operates on Cascade Mask R-CNN, including Recursive Feature Pyramid network and Switchable Atrous Convolution in the existing backbone architecture. By utilizing a comparatively lightweight backbone of ResNet-50, this paper demonstrates that superior results are attainable without relying on pre and post-processing methods, heavier backbone networks (ResNet-101, ResNeXt-152), and memory-intensive deformable convolutions. We evaluate the proposed approach on five different publicly available table detection datasets. Our CasTabDetectoRS outperforms the previous state-of-the-art results on four datasets (ICDAR-19, TableBank, UNLV, and Marmot) and accomplishes comparable results on ICDAR-17 POD. Upon comparing with previous state-of-the-art results, we obtain a significant relative error reduction of 56.36%, 20%, 4.5%, and 3.5% on the datasets of ICDAR-19, TableBank, UNLV, and Marmot, respectively. Furthermore, this paper sets a new benchmark by performing exhaustive cross-datasets evaluations to exhibit the generalization capabilities of the proposed method.

：Non-Euclidean data, such as social networks, and citation relationships between documents, has node information and structural information. Graph Convolutional Network(GCN) can automatically learn node features and association information between nodes. The core ideology of the graph convolutional network is to aggregate node information by using edge information, thereby generating a new node feature. In the process of updating node features, there are two core influencing factors. One is the number of neighboring nodes of the central node, the other is the contribution of the neighboring nodes to the central node. Due to the previous GCN methods not simultaneously considering the numbers and different contributions of neighboring nodes to the central node, we design the Adaptive Attention Mechanism(AAM). To further enhance the representational capability of the model, we utilize Multi-Head Graph Convolution(MHGC). Finally, we adopt cross-entropy(CE) loss function to describe the difference between the predicted results of node categories and the ground truth (GT). Combined with backpropagation, this ultimately achieves accurate node classification. Based on AAM, MHGC and CE, we contrive the novel Graph Adaptive Attention Network (GAAN). Experiments show that the classification accuracy has achieved outstanding performances on Cora, Citeseer and Pubmed datasets.

Remote sensing imagery is of great significance for policy decisions, especially for disaster assessment and disaster relief. To ensure the privacy and inviolability of personal buildings, the information containing these buildings must be anonymized during the remote sensing mapping process. Traditional processing methods for these targets in remote sensing mapping are mainly based on manual retrieval and image editing tools, which are inefficient. Deep learning provides a new direction for target hiding. Although the image inpainting method based on deep learning is faster than the manual method, the cost of training calculation is a disadvantage. And the element-wise product operation used in the model increases the risk of vanished or exploded gradients. We propose a Residual Attention Target Hiding (RATH) model for remote sensing target hiding based on deep learning. RATH uses residual attention modules to replace gated convolutions, reducing parameters and mitigating gradient issues. The residual attention module preserves gated convolution performance but provides an adjustable kernel size. RATH retains gated convolutions for dynamic feature selection and balances model depth and width. Furthermore, this paper modifies the contextual attention layer by adjusting the fusion process to enlarge the fusion patch size. Finally, we extend the edge-guided function to preserve the original target information and confound viewers. Ablation studies on an open dataset prove RATH’s efficiency for image inpainting and target hiding. RATH achieves state-of-the-art results with lower complexity. And it has the highest similarity for edge-guided target hiding. RATH enables robust, efficient target hiding for privacy protection in remote sensing imagery while balancing performance and complexity. Experiments show RATH's superiority over existing methods in hiding arbitrary-shaped targets.

The spread of 2019 novel coronavirus disease (COVID-19) throughout the world has been a severe challenge for public health. The human angiotensin-converting enzyme 2 (ACE2) has a remarkably high affinity binding to severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). By the search for network database and re-analysis of pubic data, we found the level of ACE2 expression in adipose tissue was higher than that in lung tissue, which indicated the adipose tissue might be vulnerable to SARS-CoV-2 as well; the levels of ACE2 expressed by adipocytes and adipose progenitor cells were similar between non-obese individuals and obese individuals, but obese individuals have more adiposes so as to increase the number of ACE2-expressing cells; the expression of ACE2 in tumor tissues posed by five different types of cancers increased significantly compared with that in adjacent tissues. Thus, we suggest that more attentions might be given to obese individuals and the five types of cancer patients during the outbreak of COVID-19.

Although proposition of “Virtual Reality” (VR) and “Augment Reality” (AR) can be traced back to the 60s, both areas are actually blooming in recent decades. Thanks to the latest deep learning techniques, an enormous advance in computer vision research community has taken place. Since VR and AR are highly related to computer vision tasks, these areas have enjoyed the benefits as well. Yet there is no sufficient survey on such impact and new research areas arising from it. This paper mainly focuses on the latest research progress in ACM Symposium on Eye Tracking Research & Applications (ETRA) 2019, as well as several recent representative paper works. It aims to figure out the influence of deep learning techniques on latest VR/AR research. Meanwhile, new issues have popped up with the development of VR and AR technology, such as privacy and computation efficiency. This paper draws attention to such newly produced topics as well. In addition, this paper also investigates on the effect of latest VR and AR techniques on people, such as level of teamwork in collaborative tasks, assistance and treatment to patients and the disabled, etc.

Visualization techniques are a powerful communication tool between construction stakeholders. The advancement of technology from 2D drawings to 3D models, Virtual Reality (VR), and Augmented Reality (AR) has emphasized the crucial role of efficient communication of ideas, designs, and concepts in preventing project delays and other issues in the Architecture, Engineering, and Construction (AEC) industry. Contemporary innovations such as web-based virtual reality cloud platforms that facilitate collaborative AEC projects and Head-mounted Displays that enable the viewing of VR environments are some of the latest technological developments that are emerging in the construction industry. These technological advances have the potential to improve communication, increase project efficiency, and enhance the quality of construction work. The purpose of this research is to identify existing trends and potential future directions by appropriating the state of the art of the intellectual growth of Virtual reality and Augmented Reality. The study used scientometric analysis in reviewing existing publications to scientifically map the evolution of VR and AR in the AEC sector. The study observed an emerging but little amount of publications on VR and AR in construction. While Africa contributes little significance, advancement in VR and AR research is led by United States and America. The study expresses concern over the dearth of research and the low amount of collaborations amongst institutions in diverse countries. The study concludes that VR and AR research in the AEC sector must be afforded the needed focus and attention. In recent times, the global Coronavirus pandemic has shown that technology such as VR and AR is inevitable in the success of a project.

Emotion detection holds significant importance in facilitating human-computer interaction, enhancing the depth of engagement. By integrating this capability, we pave the way for forthcoming AI technologies to possess a blend of cognitive and emotional understanding, bridging the divide between machine functionality and human emotional complexity. This progress has the potential to reshape how machines perceive and respond to human emotions, ushering in an era of empathetic and intuitive artificial systems. This paper introduces a novel approach to multimodal emotion recognition, seamlessly integrating speech and text modalities to accurately infer emotional states. Employing CNNs, we meticulously analyze speech using Mel spectrograms, while a BERT-based model processes the textual component, leveraging its bidirectional layers for profound semantic comprehension. The outputs from both modalities are combined using an attention-based fusion mechanism that optimally weighs their contributions. The proposed method undergoes meticulous testing on two distinct datasets: Carnegie Mellon University’s Multimodal Opinion Sentiment and Emotion Intensity (CMU-MOSEI) dataset and the Multimodal Emotion Lines Dataset (MELD). The results demonstrate superior efficacy compared to existing frameworks, achieving an accuracy of 88.4% and an F1-score of 87.9% on the CMU-MOSEI dataset, and a notable weighted accuracy (WA) of 67.81% and a weighted F1 (WF1) score of 66.32% on the MELD dataset. This comprehensive system offers precise emotion detection and introduces several significant advancements in the field.

Water distribution networks are often susceptible to pipeline leaks caused by mechanical damages, natural hazards, corrosion, and other factors. This paper focuses on the detection of leaks in water distribution networks (WDN) using a data-driven approach based on machine learning. A hybrid Autoencoder neural network (AE) is developed, which utilizes unsupervised learning to address the issue of unbalanced data (as anomalies are rare events). The AE consists of a 3DCNN encoder, a ConvLSTM decoder, and a ConvLSTM future predictor, making the anomaly detection robust. Additionally, spatial, and temporal attention mechanisms are employed to enhance leak localization. The AE first learns the expected behavior and subsequently detects leaks by identifying deviations from this expected behavior. To evaluate the performance of the proposed method, the Water Network Tool for Resilience (WNTR) Simulator is utilized to generate water pressure and flow rate data in a water supply network. Various conditions such as fluctuating water demands, data noise, and the presence of leaks are considered using the pressure-driven demand (PDD) method. Datasets with and without pipe leaks are obtained, where the AE is trained using the dataset without leaks and tested using the dataset with simulated pipe leaks. The results, based on a benchmark WDN and a confusion matrix analysis, demonstrate that the proposed method successfully identifies leaks in 96% of cases and a false positive rate of 4% compared to a random forest model baseline based on supervised learning with a false positive rate of 15% due to unbalanced data. Furthermore, a real case study demonstrates the applicability of the developed model for leak detection in operational conditions of water supply networks using inline sensor data.

Using digital media has become the most popular leisure activity for children and adolescents. The effects of digital media use on the developing brain and cognitive processes of children are subject to debate. Here, we examine the effect of digital media use on attention subdomains in children aged 6 to 10 years. In total, 77 children participated in the study. Selective and divided attention as well as switching between attentional demands were quantified by the SwAD task. Parents were asked to assess the screen time of their children (TV, smartphone, laptop/PC, game console, tablet). Results show no main or interaction effects of screen time on any of the attention conditions investigated. Based on the present findings, as well as previous studies, we suggest a possible non-linear relationship between the amount of screen time and attention function. Furthermore, we emphasize the relevance of considering the socio-economic background of children and a need for longitudinal studies.

Deep convolutional neural network (CNN) has shown their great advantages in the single image deraining task. However, most existing CNN-based single image deraining methods still suffer from residual rain streaks and details lost. In this paper, we propose a deep neural network including the Multi-scale feature extraction module and the channel attention module, which are embed in the feature extraction sub-network and the rain removal sub-network respectively. In the feature extraction sub-network, the Multi-scale feature extraction module is constructed by a Multi-layer Laplacian pyramid, and is then integrated multi-scale feature maps by a feature fusion module. In the rain removal sub-network, the channel attention module, which assigns different weights to the different channels, is introduced for preserving image details. Experimental results on visually and quantitatively comparison demonstrate that the proposed method performs favorably against other state-of-the-art approaches

Extensive growth in the volume of irregular brain cells is known as brain tumor. Human brain is surrounded by stiff skull. There are various issues that occur due to the growth of any tumor inside this restricted space. The malignant and benign are two main categories of the brain tumor. The skull is pressurized to enlarge from inside in case of growth of any benign or malignant tumor. This tumor leads to harm in brain and it may be dangerous to life also. The brain tumor is divided into two kinds - primary or secondary. The brain tumor detection techniques have various phases. In this paper, comparative study of CNN with GLCM approach and superpixel based spectral clustering is done tumor. This work takes into account metrics like accuracy, sensitivity and specificity for drawing the comparison between both the techniques.

Edge AI accelerators have been emerging as a solution for near customers’ applications in areas such as unmanned aerial vehicles (UAVs), image recognition sensors, wearable devices, robotics, and remote sensing satellites. These applications not only require meeting performance targets but also meeting strict reliability and resilience constraints due to operations in harsh and hostile environments. Numerous research articles have been proposed, but not all of these include full specifications. Most of these tend to compare their architecture with other existing CPUs, GPUs, or other reference research. This implies that the performance results of the articles are not comprehensive. Thus, this work lists the three key features in the specifications such as computation ability, power consumption, and the area size of prior art edge AI accelerators and the CGRA accelerators during the past few years to define and evaluate the low power ultra-small edge AI accelerators. We introduce the actual evaluation results showing the trend in edge AI accelerator design about key performance metrics to guide designers on the actual performance of existing edge AI accelerators’ capability and provide future design directions and trends for other applications with challenging constraints.

The calibration of three-dimensional (3D) coordinates in augmented reality (AR) systems is a complex activity. It involves the recognition of environmental characteristics and technology that models the 3D space of the device, determining its position and orientation. In the industrial environment, it is common for AR applications to cover large spaces, making it difficult to maintain attributes such as precision and accuracy. The set of sensors and mapping algorithms available in HoloLens stimulate the development of virtual reality (VR) applications, in particular localization techniques. This study proposes calibration models of the 3D coordinates of the HoloLens for indoor industrial environments. The performance of tests in a relevant environment provides data necessary to evaluate the performance of the proposed models in terms of precision and accuracy in determining point coordinates in the study environment. The results show improvements in determining the axes that define the 3D space, with a direct influence on the position of the points observed in the experiment

Underwater robotics equipped with visual detection systems have the function of detecting un-derwater artifacts, which is of great significance to deep-sea archaeology. Underwater artifacts are located in complex environments with poor imaging conditions, and the targets have chal-lenging problems such as breakage, stacking, and sediment burial, which causes the marine cul-tural target detection failures. To solve these problems, this paper proposes an underwater cul-tural target detection algorithm based on the deformable deep aggregation network model for underwater robotics exploration. To fully extract the target feature information of underwater targets in complex environments, this paper designs a multi-scale deep aggregation network with deformable convolutional layers. Besides, the BAM attention module is designed for fea-ture optimization, which enhances the potential feature information of the target while weak-ening the background interference information. Finally, the target prediction is achieved through feature fusion at different scales. The proposed algorithm has been extensively validat-ed and analyzed on the collected underwater artifact datasets, and the precision, recall, and mAP of the algorithm have reached 93.1%, 91.4%, and 92.8%, respectively. In addition, the present al-gorithm has been practically deployed on the underwater robotics. In the deep-sea tests, the ar-tifact detection frame rate reaches up to 19 fps, which satisfies the real-time target detection。

Grapes are a globally popular fruit, with grape cultivation worldwide being second only to citrus. This article focuses on the low efficiency and accuracy of traditional manual grading of red grape external appearance and proposes a small-sample red grape external appearance grading model based on transfer learning with convolutional neural networks (CNNs). Initially, the CNN transfer learning method was used to transfer the pre-trained AlexNet, VGG16, GoogleNet, InceptionV3, and ResNet50 network models on the ImageNet image dataset to the red grape image grading task. By comparing the classification performance of the CNN models of these five different network depths with fine-tuning, ResNet50 with a learning rate of 0.001 and a loop number of 10 was determined to be the best feature extractor for red grape images. Moreover, given the small number of red grape image samples in this study, different convolutional layer features output by the ResNet50 feature extractor were analyzed layer by layer to determine the effect of deep features extracted by each convolutional layer on SVM classification performance. This analysis helped to obtain a ResNet50+SVM red grape external appearance grading model based on the optimal ResNet50 feature extraction strategy. Experimental data showed that the classification model constructed using the feature parameters extracted from the 10th node of the ResNet50 network achieved an accuracy rate of 95.08% for red grape grading. These research results provide a reference for the online grading of red grape clusters based on external appearance quality and have certain guiding significance for the quality and efficiency of grape industry circulation and production.

Deep neural network (DNN) watermarking is a potential approach for protecting the intellectual property rights of DNN models. Similar to classical watermarking techniques for multimedia content, the requirements for DNN watermarking include capacity, robustness, and transparency, and other factors. Studies have focused on robustness against retraining and fine-tuning. However, less important neurons in the DNN model may be pruned. Moreover, although the encoding approach in renders DNN watermarking robust against pruning attacks, the watermark is assumed to be embedded only into the fully connected layer in the fine-tuning model. In this study, we extended the method such that the model can be applied to any convolution layer of the DNN model and designed a watermark detector based on a statistical analysis of the extracted weight parameters to evaluate whether the model is watermarked. Using a nonfungible token mitigates the overwriting of the watermark and enables checking when the DNN model with the watermark was created.

The colossal depths of the deep neural network sometimes suffer from ineffective backpropagation of the gradients through all its depths. Whereas, The strong performance of shallower multilayer neural structures prove their ability to increase the gradient signals in the early stages of training which easily gets backpropagated for global loss corrections. Shallow neural structures are always a good starting point for encouraging the sturdy feature characteristics of the input. In this research, a shallow, deep neural structure called PrimeNet is proposed. PrimeNet is aimed to dynamically identify and encourage the quality visual indicators from the input to be used by the subsequent deep network layers and increase the gradient signals in the lower stages of the training pipeline. In addition to this, the layerwise training is performed with the help of locally generated errors which means the gradient is not backpropagated to previous layers, and the hidden layer weights are updated during the forward pass, making this structure a backpropagation free variant. PrimeNet has obtained state-of-the-art results on various image datasets, attaining the dual objective of (1) compact dynamic deep neural structure, which (2) eliminates the problem of backwards-locking. The PrimeNet unit is proposed as an alternative to traditional convolution and dense blocks for faster and memory-efficient training, outperforming previously reported results aimed at adaptive methods for parallel and multilayer deep neural systems.

This review focuses on the evidence for neurotherapeutics for Attention Deficit Hyperactivity Disorder (ADHD). EEG-Neurofeedback has been tested for about 45 years with latest meta-analyses of randomised controlled trials (RCT) showing small/medium effects compared to non-active controls only. Three small studies piloted neurofeedback of frontal activations in ADHD using functional magnetic resonance imaging or near-infrared spectroscopy, finding no superior effects over control conditions. Brain stimulation has been applied to ADHD using mostly repetitive transcranial magnetic and direct current stimulation (rTMS/tDCS). rTMS has shown mostly negative findings on improving cognition or symptoms. Meta-analyses of tDCS studies targeting mostly dorsolateral prefrontal cortex show small effects on cognitive improvements with only two out of three studies showing clinical improvements. Trigeminal nerve stimulation has shown to improve ADHD symptoms with medium effect in one RCT. Modern neurotherapeutics are attractive due to their relative safety and potential neuroplastic effects. However, they need to be thoroughly tested for clinical and cognitive efficacy across settings and beyond core symptoms and for their potential for individualised treatment.

A 47-year-old physician suddenly noticed a persistent difficulty maintaining attention. He was awake, alert, and oriented. After two hours he developed fever, ageusia, and anosmia. He denied any previous history of psychiatric illness and was hydrated at the time of the subjective attention impairment. On admission, the patient remained oriented. He reported the persistence of attention problems, anosmia, and mild fatigue. The oxygen saturation 99% while he was breathing ambient air. Laboratory tests were unremarkable. A high-resolution computed tomography of the chest was normal. Nasopharyngeal and throat swabs specimens on reverse transcription-polymerase chain reaction analysis tested positive for SARS-CoV2. On illness day 3, the examination was unchanged, but he continued to complain of difficulties to stay focused. Then, he performed an objective attention test. The test demonstrated a moderate attentional impairment. On day 6, the patient reported a subjective worse in his concentration and performed a second test. Although his physical examination remained normal, the attention performance was worse as compared to day 3. Eight hours after worsening of attention impairment, the patient’s oxygen saturation dropped to 94%. From illness days 9 to 14, the patient evolved with clinical improvement. On day 10, a third objective attention test indicated a mild deficit. On day 16, he did not report any other symptom and the attention test was completely normal. Then, the patient returned to work. Neurological symptoms had been previously described in COVID- 19 patients. However, no previous research had investigated early cognitive deficits preceding the traditional symptoms.

This paper is an interdisciplinary study of novel applications of techniques and tools of an area of brain science, known as Synesthesia (involving associations and/or confusion between distinct senses), to area of Computer Science known as Immersive Virtual Reality (VR), that makes the subject’s awareness of physical self be diminished by being surrounded in an engrossing artificial environment. Natural Synesthesia has for the last decade been an important emerging area in brain science but is present in only a small proportion of the population. For example a person with Natural Synesthesia, when viewing a grapheme, may perceive a color additionally to be associated to the grapheme. In contrast, Artificial synesthesia (also known as virtual synesthesia or synthetic synesthesia) has been defined as the sensory joining due a cross-modal mapping device, where information of one sense is accompanied by an induced perception in another sense. In particular, we propose use of a multimodal manner of displaying information in VR to increase and concentrate attention. Artificial Synesthesia to synthetically create induced associations between senses, allowing Artificial Synesthesia to be experienced by anyone using a VR system. The paper describes the enhancement of immersive VR by use of Artificial Synesthesia to improve the system’s performance at steering and directing the attention of the user. We describe techniques for an enhanced immersive VR that displays associations between a variety of senses: between colors and characters, also between colors and sounds, and between sounds and the position of tactile sensations. The sense association provided by Artificial Synesthesia allows the system to better capture the user’s attention and better direct that attention. A major application of our work in VR-induced Artificial Synesthesia is to provide an enhanced methodology for controlling the attention of the subject, and to improve the direction of attention of subjects undergoing guided imagery therapies for pain relief. Other potential high-impact applications include improved immersive VR, more programmable human/computer interfaces and other medical therapies.

Background Augmented reality (AR) in surgery can offer an enhanced view of reality through the superimposition of computer-generated digital images on the real environment. It allows surgeons to integrate image visualisation, improving operative efficiency, surgical outcomes, surgical training and patient education. This review aims to evaluate the current status of augmented reality in surgery, surgical training and potential future applications. Methods We performed a non-systematic review of available literature from January 2005 to August 2021 by searching PubMed, EMBASE and the Cochrane library using a combination of terms “augmented reality”, “virtual reality”, “surgery”, “simulation” and “training”. Articles considered for this review were identified by relevant search criteria including title, keywords, abstract, and full-text. Conclusions AR technologies present an exciting new trend with multiple potential applications in surgery. Intraoperative AR systems have shown promise in specialties involving fine movement of organs during surgical procedures, including Neurosurgery, Ears, Nose and Throat and Orthopaedic Surgery. AR has also exhibited the potential to enhance surgical training and improve knowledge acquisition; it can foster international collaborations via telesurgery and telepresence. In the near future, AR will likely work in symbiosis with surgeons, serving as a complex computer-human coalition which can improve patient outcomes, patient education and surgical training.

Background: Since the advent of virtual reality (VR), it has been used in medical education for surgical training and anatomy teaching. Recently, other modalities of extended reality (XR) such as augmented reality (AR) and mixed reality (MR) has also made its way into medical education. Although there has been research validating XR’s use in medical education, there have been few studies on the research trends of the different XR modalities. The paper aims to compare the research trends of the XR modalities in general and in terms of the medical fields studied and outcomes measured. Methods: Web of Science was searched, and preliminary data was extracted to analyze the general trend. Inclusion and exclusion criteria were then applied, and finalized articles were analyzed and grouped based on the medical field studied and outcomes measured. Results: 31 articles on VR, eight on AR and one on MR were included in the final analysis. We found that there is increasing research in VR since 1990 and AR since 2008. The research in MR is constant. Most of the papers on VR studied endoscopic surgery and anatomy whereas AR studied mostly anatomy and endovascular procedures. Using Miller’s prism of clinical competence, the competency measured most for VR and AR is “show”. Discussion and conclusion: Advancement in computing, communication and display technologies since 1990 may contribute to the increase in research on VR whereas the ubiquity of smartphone since 2008 may explain the increase in research on AR. Although both VR and AR are used in surgical training and anatomy teaching, we found possible strengths of VR in counseling and AR in practical skills. The competency "show" was measured most as most of the papers were on surgery, and the XR simulators used can capture surgical parameters