.Purpose: This paper presents a comparative analysis of state-of-the-art DIR algorithms in the context of head and neck squamous cell carcinoma (HNSCC) radiation therapy. Materials and Methods: We used a dataset of head and neck cancer patients within the Cancer Image Archive, which includes 31 patients with 3D CT image data from pre-treatment, mid-treatment, and post-treatment stages of radiotherapy. We applied DIR algorithms to two datasets, one for pre-treatment to mid-treatment registration and another for mid-treatment to post-treatment registration, by aligning one CT image to another CT image. To quantitatively analyze the patient data, we focused on the spinal cord, optic nerve, brain stem, cochlea, and PTV as the OAR datasets. To verify the DIR algorithm, we used two non-learning-based methods, SyN and NiftyReg, as well as three deep learning-based methods, Voxelmorph, Cyclemorph, and Transmorph. We trained a deep learning model by adjusting the ratio of the training dataset, validation dataset, and test dataset to 7:1:2. Results: The average DSCs of SyN and NiftyReg, the non-learning-based methods, were 0.74±0.06 and 0.70±0.12, respectively. The deep learning-based methods, Voxelmorph, Cyclemorph, and Transmorph, had average DSCs of 0.72±0.08, 0.68±0.11, and 0.69±0.13, respectively. The deep learning DIR algorithm produced transformed outputs of OAR/PTV in a shorter time than other models, including commercial and conventional mathematical algorithms (At Inference(sec/images), Voxelmorph: 0.36, Cyclemorph: 0.3, Transmorph: 5.1, SyN: 140, NiftyReg: 40.2). Conclusions: In conclusion, our study provides a comprehensive comparison of commercial DIR algorithms with traditional and deep learning-based DIR methods. Our results demonstrate that commercial DIR algorithms outperform traditional DIR methods in terms of accuracy and efficiency. However, we also show that deep learning-based DIR methods have the potential to achieve similar performance to commercial algorithms with proper training and optimization. Our findings suggest that both commercial and deep learning-based DIR methods have their respective advantages and limitations, and the choice of method should depend on the specific requirements of the clinical application. Overall, our study contributes to ongoing efforts to improve the accuracy and efficiency of DIR methods for better patient outcomes.

Fundus image registration plays a crucial role in the clinical evaluation of ocular diseases, such as diabetic retinopathy and macular degeneration, necessitating meticulous monitoring. The alignment of multiple fundus images enables the longitudinal analysis of patient progression, widening the visual scope, or augmenting resolution for detailed examinations. Currently, prevalent methodologies rely on feature-based approaches for fundus registration. However, certain methods exhibit high feature point density, posing challenges in matching due to point similarity. This study introduces a novel fundus image registration technique integrating U-Net for the extraction of feature points employing FIVES for its training and evaluation, a novel and large dataset for blood vessels segmentation, prioritizing point distribution over abundance. Subsequently, the method employs medial axis transform and pattern detection to obtain feature points characterized by the Fast Retina Keypoint (FREAK) descriptor, facilitating matching for transformation matrix computation. Assessment of the vessel segmentation achieves 0.7559 for Intersection Over Union (IoU), while evaluation on the Fundus Image Registration Dataset (FIRE) demonstrates the method’s comparative performance against existing methods, yielding a registration error of 0.596 for area under the curve, refining similar earlier methods and suggesting promising performance comparable to prior methodologies.

Remote sensing image registration plays an important role in military and civilian fields, such as natural disaster damage assessment, military damage assessment and ground targets identification, etc. However, due to the ground relief variations and imaging viewpoint changes, non-rigid geometric distortion occurs between remote sensing images with different viewpoint, which further increases the difficulty of remote sensing image registration. To address the problem, we propose a multi-viewpoint remote sensing image registration method which contains the following contributions. (i) A multiple features based finite mixture model is constructed for dealing with different types of image features. (ii) Three features are combined and substituted into the mixture model to form a feature complementation, i.e., the Euclidean distance and shape context are used to measure the similarity of geometric structure, and the SIFT (scale-invariant feature transform) distance which is endowed with the intensity information is used to measure the scale space extrema. (iii) To prevent the ill-posed problem, a geometric constraint term is introduced into the L2E-based energy function for better behaving the non-rigid transformation. We evaluated the performances of the proposed method by three series of remote sensing images obtained from the unmanned aerial vehicle (UAV) and Google Earth, and compared with five state-of-the-art methods where our method shows the best alignments in most cases.

Image registration (IR) is a process that deforms images to align them with respect to a reference space, making it easier for medical practitioners to examine various medical images in a standardized reference frame, such as having the same rotation and scale. This document introduces image registration using a simple numeric example. It provides a definition of image registration along with a space-oriented symbolic representation. This review covers various aspects of image transformations, including affine, deformable, invertible, and bidirectional transformations, as well as medical image registration algorithms such as Voxelmorph, Demons, SyN, Iterative Closest Point, and SynthMorph. It also explores atlas-based registration and multistage image registration techniques, including coarse-fine and pyramid approaches. Furthermore, this survey paper discusses medical image registration taxonomies, datasets, evaluation measures, such as correlation-based metrics, segmentation-based metrics, processing time, and model size. It also explores applications in image-guided surgery, motion tracking, and tumor diagnosis. Finally, the document addresses future research directions, including the further development of transformers.

Image stitching is a crucial aspect of image processing. However, factors like perspective and environment often lead to irregular shapes in stitched images. Cropping or completion methods typically result in substantial loss of information. This paper proposes a method for rectifying irregularly images into rectangles using deformable meshes and residual networks. The method utilizes a convolutional neural network to quantify rigid structures of images. Choosing the most suitable mesh structure based on the extraction results, offering options such as triangular, rectangular, and hexagonal. Subsequently, the irregularly image, predefined mesh structure, and predicted mesh structure are input into a wide residual neural network for regression. The loss function comprises local and global, aimed at minimizing the loss of image information within the mesh and global target. This method not only significantly reduces information loss during rectification but also adapting to different images with various rigid structures. Validation on the DIR-D dataset shows this method outperforms state-of-the-art methods in image rectification.

This study proposes a method for image matching between infrared(IR)-RGB images using a deep learning network to estimate the deformation field. We propose a deformation field generator (DFG) that estimates the deformation field of the transformation matrix to match each pixel or IR image to the RGB image. DFG is a network that receives IR and RGB images as input; the output size is two channels and has the sample resolution as the input image. By warping the IR image through a grid-sampler that warps the image according to the value of the deformation field, we can obtain a warped IR image that matches the RGB image. Additionally, to check whether the warped IR image matched the RGB image, the masking images detecting the segmentation of objects were photographed in two images. Without directly comparing IR and RGB images, we proposed mask loss that warps the IR mask image through the deformation field and grid sampler and then compares the warped IR mask image with the RGB mask image. Mask loss solves the spatial similarity comparison problem with multi-modality images, such as IR and RGB images, by comparing the mask image with the same modality image as the mask image.

Convolutional Neural Networks (CNNs) present drawbacks for modeling geometric transformations, such as scaling and rotation, caused by the convolution operation’s locality. Deformable convolution (DCON), a mechanism that substitutes standard convolution, increasing the receptive field to capture relevant features, is a promising approach to solve this drawback and improve the robustness of CNNs. However, the optimal way to replace the standard convolution with its deformable counterpart in a CNN model is unclear. In this study, we clarify this aseveration by conducting several experiments using deformable convolutions applied in the layers that conform a small four-layer CNN model. We also use deformable convolutions on the four-layers of several ResNet CNNs with depths 18, 34, 50, and 101. The models were tested in binary balanced classes with 2D data for image classification: Cats & Dogs, EyesPACS, Spyders & Chickens, and Shapes. After this testing, we evaluated DCON in 3D data for action recognition: UCF101 and Human2 (a dataset we compiled to control movement, clothing and background). The contribution of this research lies in a guideline to use DCON. It can be summarized as follows: if DCON is used on the first layers of the proposal of model (with simple features), the computational resources expressed as the quantity of Flops will tend to increase and produce bigger misclassification than the standard CNN. However, if the DCON is used at the end layers, the quantity of Flops used in the training and testing will decrease, and the classification accuracy will improve by up to 20% about the base model. Moreover, it gains robustness when using deformable convolutions because it can adapt to the region of interest. Also, the best kernel size of the DCON is three. It showed better results than size five. In the last case, the quantity of Flops increase quadratically, but their performance does not increase significantly. With these results, we propose a guideline to use the DCON and contribute to understanding the impact of DCON on the robustness of CNNs.

Image registration has an imperative role in medical imaging. In this work, a grey-wolf optimizer (GWO) based non-rigid demons registration is proposed to support the retinal image registration process. A comparative study of the proposed GWO-based demons registration framework with cuckoo search, firefly algorithm, and particle swarm optimization- based demons registration is conducted. In addition, a comparative analysis of different demons registration methods, such as Wang’s demons, Tang’s demons, and Thirion’s demons which are optimized using the proposed GWO is carried out. The results established the superiority of the GWO-based framework which achieved 0.9977 correlation, and fast processing compared to the use of the other optimization algorithms. Moreover, GWO-based Wang’s demons performed better accuracy compared to the Tang’s demons and Thirion’s demons framework. It also achieved the best less registration error of 8.36×10^-5.

Multi-source image registration often suffered from great radiation and geometric differences. Specifically, gray scale and texture from similar landforms in different source images often show significantly different visual features. And these differences disturb the corresponding point extraction in the following image registration process. Considering that edges between heterogeneous images can provide homogeneous information and more consistent features can be extracted based on image edges, an edge consistency radiation-change insensitive feature transform (EC-RIFT) method is proposed in this paper. Firstly, the noise and texture interference are reduced by preprocessing according to the image characteristics. Secondly, image edges are extracted based on phase congruency, and an orthogonal Log-Gabor filter is performed to replace the global algorithm. Finally, the descriptors are built with logarithmic partition of the feature point neighborhood, which improves the robustness of descriptors. Comparative experiments on datasets containing multi-source remote sensing image pairs show that the proposed EC-RIFT method outperforms other registration methods in terms of precision and effectiveness.

Star image registration is the most important step in the application of astronomical image differencing, stacking and mosaicking, which requires high robustness, accuracy and real--time of the algorithm, but there is no high--performance registration algorithm in this field. In this paper, we propose a star image registration algorithm that relies only on radial module features (RMF) and rotation angle features (RAF), which has excellent robustness, high accuracy, and good real--time performance. The test results on a large amount of simulated and real data show that the comprehensive performance of the proposed algorithm is significantly better than the four classical baseline algorithms in the presence of rotation, insufficient overlapping area, false stars, position deviation, magnitude deviation and complex sky background, which is a more ideal star image registration algorithm.

Image stitching is a crucial aspect of image processing. However, factors like perspective and environment often lead to irregular shapes in stitched images. Cropping or completion methods typically result in substantial loss of information. This paper proposes a method for rectifying irregularly images into rectangles using deformable meshes and residual networks. The method utilizes a convolutional neural network to quantify rigid structures of images. Choosing the most suitable mesh structure based on the extraction results, offering options such as triangular, rectangular, and hexagonal. Subsequently, the irregularly image, predefined mesh structure, and predicted mesh structure are input into a wide residual neural network for regression. The loss function comprises local and global, aimed at minimizing the loss of image information within the mesh and global target. This method not only significantly reduces information loss during rectification but also adapting to different images with various rigid structures. Validation on the DIR-D dataset shows this method outperforms state-of-the-art methods in image rectification.

For Synthetic Aperture Radar (SAR) image registration, successive processes following feature extraction are required by both the traditional feature-based method and the deep learning method. Among these processes, the feature matching process—whose time and space complexity are related to the number of feature points extracted from sensed and reference images, as well as the dimension of feature descriptors—proves to be particularly time-consuming. Additionally, the successive processes introduce data sharing and memory occupancy issues, requiring an elaborate design to prevent memory leaks. To address these challenges, this paper introduces the OptionEM-based reinforcement learning framework to achieve end-to-end SAR image registration. This framework outputs registered images directly without requiring feature matching and calculation of the transformation matrix, leading to significant processing time savings. The Transformer architecture is employed to learn image features, while a correlation network is introduced to learn the correlation and transformation matrix between image pairs. Reinforcement learning, as a decision process, can dynamically correct errors, making it more efficient and robust compared to supervised learning mechanisms like deep learning. We present a hierarchical reinforcement learning framework combined with episodic memory to mitigate the inherent problem of invalid exploration in generalized reinforcement learning algorithms. This approach effectively combines coarse and fine registration, further enhancing training efficiency. Experiments conducted on three sets of SAR images, acquired by TerraSAR-X and Sentinel-1A, demonstrate that the proposed method’s average runtime is sub-second, achieving subpixel registration accuracy.

This study presents a method for the rapid and accurate generation of two-dimensional (2D) orthomosaic maps using selected image data collected by drone-captured video. The focus is on developing a real-time method capable of creating maps more quickly than image selection. The scale-invariant feature transform (SIFT) algorithm is applied to drone images to extract features in various scale regions. For feature point matching, a matching method based on the fast library for approximate nearest neighbors (FLANN) was adopted. A comparison of the computational speed of the FLANN with that of the k-nearest neighbors (KNN) and brute force matcher during the matching process revealed FLANN's superior capability for real-time data processing. The random sample consensus (RANSAC) algorithm was employed to enhance the accuracy of the matching by removing outliers, effectively identifying and eliminating mismatches, and reinforcing the reliability of feature point matching. The combination of SIFT, FLANN, and RANSAC algorithms demonstrates the capacity to process drone-captured image data in real time, facilitating the generation of precise 2D orthomosaic maps. The proposed method was assessed and validated using imagery obtained as the drone executed curvilinear and straight flight paths, confirming its accuracy and operational efficiency concurrently with the image capture process.

For multi-sensor integrated systems, such as a mobile mapping system (MMS), data fusion at sensor-level, i.e., the 2D-3D registration between optical camera and LiDAR, is a prerequisite for higher level fusion and further applications. This paper proposes a line-based registration method for panoramic images and LiDAR point cloud collected by a MMS. We first introduce the system configuration and specification, including the coordinate systems of the MMS, the 3D LiDAR scanners, and the two panoramic camera models. We then establish the line-based transformation model for panoramic camera. Finally, the proposed registration method is evaluated for two types of camera models by visual inspection and quantitative comparison. The results demonstrate that the line-based registration method can significantly improve the alignment of the panoramic image and LiDAR datasets under either the ideal spherical or the rigorous panoramic camera model, though the latter is more reliable.

Wetting of deformable substrates has gained significant interest over the past decade due to its extensive applications and uses. This interest has developed due to technological advances which are able to capture interfacial behavior taking place when a liquid droplet is placed on a deformable substrate. Researchers have developed different theories to explain processes taking place in the process of wetting of deformable/soft substrates. For the scope of this review, we will consider the fluid to be Newtonian, partially wetting, and surface forces are incorporated with the help of disjoining/conjoining pressure acting in the vicinity of the apparent, three-phase contact line. The following subjects are briefly reviewed: (i) Equilibrium of droplets on soft substrates. It is shown that properties of the disjoining/conjoining pressure isotherm and properties of the deformable substrate determine both the shape of the liquid droplet and deformation of the substrate; (ii) Equilibrium conditions of droplets on deformable substrates. It is shown that for a droplet to be at equilibrium on a deformable substrate under consideration, Jacobi’s sufficient condition is satisfied; (iii) Hysteresis of contact angle of sessile droplets on deformable substrates. It is shown that as the elasticity of the deformable substrate is increased, both advancing and receding contact angles are reduced.

The key links of face recognition are digital image preprocessing, facial feature extraction and pattern recognition, this article aimed at the current problem of slow speed and low recognition accuracy of face recognition , from the above three key links, on the basic of analyzing the therories of Fractional Differential Masks Operator (FDMO), Principal Component Analysis (PCA) and Support Vector Machine (SVM), design a kind of FDMO+PVA+SVM coupling algorithm that applies to face recognition to improve the speed and accuracy of it. To realize FDMO+PCA+SVM coupling algorithm, first, we should apply FDMO to face image processing binary marginalization, the purpose is getting face contour; Then, we apply PCA to get the feature of face image which is disposed by binary marainalization. At last, we can apply One-Against All of the SVM classifier and LibSVM software package to realize face recognition. Beside, the article with nine different coupling algorithm design four groups of experimental reaults on the ORL face database verified by comparative analysic FDMO+PCA+SVM coupling algorithm in the superiority of face recognition accuracy and speed.

Open-vocabulary learning has recently gained prominence as a means to enable image segmentation for arbitrary categories based on textual descriptions. This advancement has extended the applicability of segmentation systems to a broader range of generally purpose scenarios. However, current methods often revolve around specialized architectures and parameters tailored to specific segmentation tasks, resulting in a fragmented landscape of segmentation models. In response to these challenges, we introduce OVAMTSeg, a versatile framework designed for Open-Vocabulary and Multitask Image Segmentation. OVAMTSeg harnesses adaptive prompt learning to empower the model to capture category-sensitive concepts, enhancing its robustness across diverse multi-task and scenario contexts. Text prompts are employed to effectively capture semantic and contextual features of the text, while cross-attention and cross-modal interactions enable the fusion of image and text features. Furthermore, a transformer-based decoder is incorporated for dense prediction. Extensive experimental results underscore the effectiveness of OVAMTSeg, showcasing its state-of-the-art performance and superior generalization capabilities across three segmentation tasks. Notable achievements include a 47.5 mIoU in referring expression segmentation, 51.6 mIoU on Pascal-VOC with four unseen classes, 46.6 mIoU on Pascal-Context in zero-shot segmentation, 65.9 mIoU on Pascal-5i, and 35.7 mIoU on COCO-20i datasets for one-shot segmentation.

A mathematical model that comprehensively captures the real behavior of riverbed deformation, encompassing all pertinent effects, is developed. The underwater slope reformation process, with the generatrix aligned along the flow velocity in the model, is considered. A numerical model is introduced to calculate the flow involving a deformable bottom, and the model's validation is established through rigorous analysis of experimental findings. The research firmly confirms the suitability of the proposed mathematical and numerical model for describing deformations in uneven and unsteady river flows, including the movement of dredging slots and channel quarries. The model's minimal equation count and reliance on empirical constants demonstrate the model's efficiency. The model's predictions align strongly with experimental data, although optimal values of empirical coefficients vary slightly across different experiments. Hence, there is a call for further investigation to derive more universally applicable closure relationships for the model. The importance of validating the model with reliable field data and its potential extension to accommodate hydraulically diverse soils is emphasized. Such an extension is feasible due to the concentration transfer equation, enabling independent calculations for particle fractions of varying sizes as long as the total particle concentration in the stream remains within reasonable limits. This dedicated research contributes significantly to understanding riverbed deformations and advancing accurate modeling and management of riverine environments.

Precision agriculture is a farm management technology that involves sensing and then responding to the observed variability in the field. Remote sensing is one of the tools of precision agriculture. The emergence of small unmanned aerial vehicles (sUAV) have paved the way to accessible remote sensing tools for farmers. This paper describes the comparison of two popular off-the-shelf sUAVs: 3DR Iris and DJI Phantom 2. Both units are equipped with a camera gimbal attached with a GoPro camera. The comparison of the two sUAV involves a hovering test and a rectilinear motion test. In the hovering test, the sUAV was allowed to hover over a known object and images were taken every second for two minutes. The position of the object in the images was measured and this was used to assess the stability of the sUAV while hovering. In the rectilinear test, the sUAV was allowed to follow a straight path and images of a lined track were acquired. The lines on the images were then measured on how accurate the sUAV followed the path. Results showed that both sUAV performed well in both the hovering test and the rectilinear motion test. This demonstrates that both sUAVs can be used for agricultural monitoring.

This paper proposes a new approach for multi-focus images fusion based on Region Mosaicing on Contrast Pyramids (REMCP). A density-based region growing method is developed to construct a focused region mask for multi-focus images. The segmented focused region mask is decomposed into a mask pyramid, which is then used for supervised region mosaicking on a contrast pyramid. In this way, the focus measurement and the continuity of focused regions are incorporated and the pixel level pyramid fusion is improved at the region level. Objective and subjective experiments show that the proposed REMCP is more robust to noise than compared algorithms and can fully preserves the focus information of the multi-focus images meanwhile reducing distortions of the fused images.

Rapid and accurate detection of road cracks is of great significance for road health monitoring, but currently this work is mainly completed through manual site surveys. Low-altitude UAV remote sensing can obtain images with centimeter or even subcentimeter ground resolution, which provides a new efficient and economical approach for rapid crack detection. Nevertheless, crack detection networks face challenges such as edge blurring and misidentification due to the heterogeneity of road cracks and the complexity of the background. To address these issues, we propose a real-time edge reconstruction crack detection network (ERNet) which adopts multi-level information aggregation to reconstruct crack edges and improve the accuracy of segmentation between the target and background. To capture global dependencies across spatial and channel levels, we propose an efficient bilateral decomposed convolutional attention module (BDAM) that combines depth separable convolution and dilated convolution to capture global dependencies across spatial and channel levels. To enhance the accuracy of crack detection, we use a coordinate-based fusion module that integrates spatial, semantic, and edge reconstruction information. In addition, we propose an automatic measurement of crack information for extracting the crack trunk and its corresponding length and width. Experimental results demonstrate that our network achieves the best balance between accuracy and inference speed.

This paper describes the first results of an Image Recognition Based Location (IRBL) for mobile application focusing on the procedure to generate a Database of range images (RGB-D). In an indoor environment, to estimate the camera position and orientation, a prior spatial knowledge of the surrounding is needed. In order to achieve this objective a complete 3D survey of two different environment (Bangbae metro station of Seoul and E.T.R.I. building in Daejeon – Republic of Korea) was performed using LiDAR (Light Detection And Ranging) instrument and the obtained scans were processed in order to obtain a spatial model of the environments. From this, two databases of reference images were generated using a specific software realized by the Geomatics group of Politecnico di Torino (ScanToRGBDImage). This tool allow to generate synthetically different RGB-D images) centered in the each scan position in the environment. Later, the external parameters (X, Y, Z, ω, φ, κ) and the range information extracted from the DB images retrieved, are used as reference information for pose estimation of a set of acquired mobile pictures in the IRBL procedure. In this paper the survey operations, the approach for generating the RGB-D images and the IRB strategy are reported. Finally the analysis of the results and the validation test are described.

In order to improve contrast and restore color for underwater image captured by camera sensors without suffering from insufficient details and color cast, a fusion algorithm for image enhancement in different color spaces based on contrast limited adaptive histogram equalization (CLAHE) is proposed in this article. The original color image is first converted from RGB color space to two different special color spaces: YIQ and HSI. The color space conversion from RGB to YIQ is a linear transformation, while the RGB to HSI conversion is nonlinear. Then, the algorithm separately operates CLAHE in YIQ and HSI color spaces to obtain two different enhancement images. The luminance component (Y) in the YIQ color space and the intensity component (I) in the HSI color space are enhanced with CLAHE algorithm. The CLAHE has two key parameters: Block Size and Clip Limit, which mainly control the quality of CLAHE enhancement image. After that, the YIQ and HSI enhancement images are respectively converted backward to RGB color. When the three components of red, green, and blue are not coherent in the YIQ-RGB or HSI-RGB images, the three components will have to be harmonized with the CLAHE algorithm in RGB space. Finally, with 4 direction Sobel edge detector in the bounded general logarithm ratio operation, a self-adaptive weight selection nonlinear image enhancement is carried out to fuse YIQ-RGB and HSI-RGB images together to achieve the final fused image. The enhancement fusion algorithm has two key factors: average of Sobel edge detector and fusion coefficient, and these two factors determine the effects of enhancement fusion algorithm. A series of evaluate metrics such as mean, contrast, entropy, colorfulness metric (CM), mean square error (MSE) and peak signal to noise ratio (PSNR) are used to assess the proposed enhancement algorithm. The experiments results showed that the proposed algorithm provides more detail enhancement and higher values of colorfulness restoration as compared to other existing image enhancement algorithms. The proposed algorithm can suppress effectively noise interference, improve the image quality for underwater image availably.

Computing the rotation tensor is vital in the analysis of deformable bodies. This paper describes an explicit expression for the SO(3) rotation tensor R of the deformation gradient F, and successfully establishes an intrinsic relation between the exponential mapping Q = exp A and the deformation F. As an application, Truesdell's simple shear deformation is revisited.

Background: Microscopic examination of acid-fast stained sputum smears for detecting mycobacterial acid-fast bacilli (AFB) remains the most economical and readily available method for laboratory diagnosis of tuberculosis (TB). However, this conventional approach has limitations, including low sensitivity and labor-intensive procedures. Methods: An automated microscopy system incorporating artificial intelligence (AI) and machine learning for AFB identification was evaluated. The study was conducted at an Infectious Disease Hospital in Jiangsu Province, China, utilizing an intelligent microscope system (TB-Scan, Wellgen Medical, Kaohsiung). A total of 1,000 sputum smears were included in the analysis, with the system capturing digital microscopic images and employing an image recognition model to automatically identify and classify AFB. Referee technicians provided the gold standard for discrepant results. Results: The automated system demonstrated an overall accuracy of 95.00% (950/1,000), sensitivity of 91.24% (177/194), and specificity of 95.91% (773/806). Notably, the system identified 21 smears as positive that were previously reported as negative, with referee technicians confirming 17 of these as true positive and retracting the test results accordingly. Recalculating the performance, the accuracy increased to 96.70% (967/1,000), sensitivity to 91.94% (194/211), and specificity to 97.97% (773/789), with a false negative rate of 8.06% (17/211) and a false positive rate of 2.03% (16/789). Conclusions: The incorporation of AI and machine learning into an automated microscopy system demonstrated the potential to enhance the sensitivity and efficiency of AFB detection in sputum smears compared to conventional manual microscopy. This approach holds promise for widespread application in TB diagnostics and potentially other fields requiring labor-intensive microscopic examination.

This work presents an approach for detecting mathematical formulas in scanned document images. The proposed approach is end-to-end trainable. Since many OCR engines cannot reliably work with the formulas, it is essential to isolate them to obtain the clean text for information extraction from the document. Our proposed pipeline comprises a hybrid task cascade network with deformable convolutions and a Resnext101 backbone. Both of these modifications help in better detection. We evaluate the proposed approaches on the ICDAR-2017 POD and Marmot datasets and achieve an overall accuracy of 96% for the ICDAR-2017 POD dataset. We achieve an overall reduction of error of 13%. Furthermore, the results on Marmot datasets are improved for the isolated and embedded formulas. We achieved an accuracy of 98.78% for the isolated formula and 90.21% overall accuracy for embedded formulas. Consequently, it results in an error reduction rate of 43% for isolated and 17.9% for embedded formulas.

Manipulating cloth-like deformable objects (CDOs) is a long-standing problem in the robotics community. CDOs are flexible (non-rigid) objects that do not show a detectable level of com- pression strength while two points on the article are pushed towards each otherand include objects such as ropes (1D), fabrics (2D) and bags (3D). In general, CDOs’ many degrees of freedom (DoF) introduce severe self-occlusion and complex state-action dynamics as significant obstacles for perception and manipulation systems. These challenges exacerbate existing issues of modern robotic control methods such as imitation learning (IL) and reinforcement learning (RL). This review focuses on the application details of data-driven control methods on four major task families in this domain: cloth-shaping, rope manipulation, dressing and bag manip- ulation. Furthermore, we identify specific inductive biases in these four domains that present challenges for more general IL and RL algorithms, and summarise the future direction for the development of the field.

End-to-end learned image compression codecs have notably emerged in recent years. These codecs have demonstrated superiority over conventional methods, showcasing remarkable flexibility and adaptability across diverse data domains while supporting new distortion losses. Despite challenges such as computational complexity, learned image compression methods inherently align with learning-based data processing and analytic pipelines due to their well-suited internal representations. The concept of Video Coding for Machines has garnered significant attention from both academic researchers and industry practitioners. This concept reflects the growing need to integrate data compression with computer vision applications. In light of these developments, we present a comprehensive survey and review of lossy image compression methods. Additionally, we provide a concise overview of two prominent international standards, MPEG Video Coding for Machines and JPEG AI. These standards are designed to bridge the gap between data compression and computer vision, catering to practical industry use cases.

In this paper, a new approach to retrieve semantic images based on shape and geometric features of image in conjunction with multi-class support vector machine is proposed. Zernike moment as shape feature is to verify the invariance of objects for silhouette image. In addition, a set of geometrical features is to explore the objects shape using two features of rectangularity and circularity. Then the extracted features are normalized and employed for multi-class support vector machine either for learning or retrieving processes. The retrieving process relies on three main tasks which namely Query Engine, Matching Module and Ontology Manger, respectively. Query Engine is to build the input text or image query using SPARQL language. The matching module extracts the shape and geometric features of image’s objects and employ them to Ontology Manger which in turn inserts them in ontology knowledge base. Benchmark mammals have been conducted to empirically conclude the outcome of proposed approach. Our experiment on text and image retrieval yields efficient results to problematic phenomena than previously reported.

Longitudinal image registration of pulmonary computed tomography (PCT) images may serve as an essential tool for investigating the relationship between radiation dose distribution and the occurrence and phenotype of radiation-induced lung disease (RILD). Although numerous longitudinal registration algorithms have been developed for PCT, most similarity-based approaches are not suitable for PCT involving RILD due to the complex tissue variation between two PCT images. Moreover, conventional feature-based approaches might fail to find a sufficient number of matched pairs of feature points due to the disparate lung deformation caused by breathing and RILD. To overcome the challenges resulting from RILD, component structure coherence point drift (CSCPD) was proposed to establish a deformation model by decomposing the chest into several components and matching them with individual parameters based on coherence point drift (CPD). Moreover, a regional vascular point matching (RVPM) algorithm was proposed to generate a vascular subtree and to substantially increase the number of corresponding pairs between two images. Eventually, the components were recomposed and aligned by a thin plate spline algorithm. A performance assessment on 15 pairs of PCT images of patients with RILD yielded recall and precision values of 0.85 and 0.89 for RVPM, respectively. Moreover, the target registration error of CSCPD with RVPM (2.3 ± 1.79) was significantly better than that of conventional CPD with RVPM (2.95 ± 1.89) and conventional CPD (5.04 ± 2.87). Therefore, the proposed registration system is robust enough to address the disparate deformation of lungs with RILD, and it improves registration accuracy within the parenchyma.

Direct georeferencing of airborne pushbroom scanner data usually suffers from the limited precision of navigation sensors onboard of the aircraft. The bundle adjustment of images and orientation parameters, used to perform geocorrection of frame images during the post-processing phase, cannot be used for pushbroom cameras without difficulties: it relies on matching corresponding points between scan lines, which is not feasible in the absence of sufficient overlap and texture information. We address this georeferencing problem by equipping our aircraft with both a frame camera and a pushbroom scanner: the frame images and the navigation parameters measured by a couple GPS/Inertial Measurement Unit (IMU) are input to a bundle adjustment algorithm; the output orientation parameters are used to project the scan lines on a Digital Elevation Model (DEM) and on an orthophoto generated during the bundle adjustement step; using the image feature matching algorithm Speeded Up Robust Features (SURF), corresponding points between the image formed by the projected scan lines and the orthophoto are matched, and through a least-squares method, the boresight between the two cameras is estimated and included in the calculation of the projection; finally, using Particle Image Velocimetry (PIV) on the gradient image, the projection is deformed into a final image that fits the geometry of the orthophoto. We apply this algorithm to five test acquisitions over Lake Geneva region (Switzerland) and Lake Baikal region (Russia). The results are quantified in terms of Root Mean Square Error (RMSE) between matching points of the RGB orthophoto and the pushbroom projection. From a first projection where the Interior Orientation Parameters (IOP) are known with limited precision and the RMSE goes up to 41 pixels, our geocorrection estimates IOP, boresight and Exterior Orientation Parameters (EOP) and produces a new projection which RMSE with the reference orthophoto is around two pixels.

The essence of cross-modal generation and retrieval modeling for image-text interactions lies in semantic consistency. Among these, cross-modal representation alignment serves as the foundational requirement for achieving cross-modal semantic consistency. The crux of our proposed method entails the collaborative training of an image captioning model(referred to as the ’captioner’) and a pair of contrastive encoders for image-text matching(referred to as the ’concoder’). This synergistic approach yields concurrent enhancements in concoder’s performance, captioner’s proficiency, and cross-modal semantic coherence. We coin the proposed method as ‘ReCap’. To begin, we initialize the concoder through knowledge distillation from a pre-trained model. During the training process, we use the output of the initialized concoder as input to a residual attention network, jointly training it with the captioner to achieve semantic consistency. Subsequently, we iteratively update the concoder during the image-text momentum encoding phase using the residual attention network, creating a closed-loop for semantic consistency resolution. Upon completion of training, the concoder and captioner modules can be used independently to perform tasks related to cross-modal retrieval and cross-modal generation of text and images. In order to substantiate the efficacy of our proposed method, we initially conducted empirical experiments encompassing image-text retrieval and image captioning tasks, employing a widely recognized benchmark dataset, MSCOCO. Subsequently, we assessed the fine-grained cross-modal alignment performance of the concoder through an image classification task on the iNaturalist 2018 dataset. The achieved performance metrics notably surpassed those achieved by several incumbent state-of-the-art models, thus validating the proficiency of our method. Finally, motivated by the practical requirements of handling the nature conservation image data, we performed caption annotation for the iNaturalist 2018 dataset. Subsequently, we trained the ReCap on this annotated data. Experimental results demonstrate that our proposed method can maintain semantic consistency between cross-modal retrieval and image caption generation for species with similar visual features but distinct semantics. This achievement signifies a meaningful exploration in the field of cross-modal semantic consistency representation, holding significant practical value in the domain of biological research.

Bridges enable communications and transportation of goods nationally and internationally, underpinning economic and social activities, thus they are pylons of our prosperity and mobility. Bridges worldwide are constantly subjected to physical wear, ageing, deterioration, hazards, environmental influences, and increased loading. Loss of performance and functionality of bridge structures would have a crucial impact on overall infrastructural resilience and would cause significant negative economic and social consequences. Monitoring their behaviour for different loading conditions relies on accurate estimations of the stress-strain state of various critical components and remaining capacities. These activities are of high importance for better planning lifespan prolongation, that is the extension of their service life and prevention of unforeseen collapses, in line with sustainability principles of well-informed maintenance. In many cases, access to the structure is limited or even impossible, which causes the need for the deployment of remote and contactless methods. One such innovative technique, which has recently attracted attention in scientific and practical applications is the digital image correlation (DIC). DIC is a contactless approach applicable for long-term measurements, which enables obtaining the full field of strains and deformations. Although the DIC approach has been widely used in world engineering practice for monitoring bridges and has proved to be a reliable and accurate method, there is a lack of systematic integral review on previous practical applications, revealing limitations and perspectives. This is the main motivation and novelty of this study, which will describe selected case studies, in which DIC was used on real full-scale bridge structures and propose improvements for the method.

Fire is a serious security threat that can lead to casualties, property damage, and environmental damage. However, despite the availability of object detection algorithms, challenges persist in detecting fires and smoke. These challenges include slow convergence speed, poor performance in detecting small targets, and high computational cost limiting deployments. In this paper, Fire smoke and human detection based on ConvNeXt and Mixed encoder (FCM-DETR), an end-to-end object detection algorithm based on Deformable DETR, is proposed. Firstly, we introduce ConvNeXt to take the place of Resnet, which greatly reduces the amount of computation and improves the ability to extract irregular flame features. Secondly, to effectively process multi-scale features, the original encoder is decoupled into two modules. Then Mixed encoder, an innovative encoder structure, is proposed, resulting in excellent performance of multi-scale fire and smoke features fusion. What can’t be overlooked is that the encoder block is compatible with any DETR-based models. Finally, the convergence speed is accelerated and the mean of average precision is improved by applying a novel loss function called Powerful IoU v2. The experimental results indicate that our model achieves the best detection accuracy compared to other models, with mAP reaching 66.7%, mAPs and Accuracyfire achieving impressive 50.2% and 98.05%, respectively.

Laser-targeted weeding methods further enhance the sustainable development of green agriculture, with one key technology being the improvement of weed localization accuracy. Here, we propose an improved YOLOv8 instance segmentation based on bidirectional feature fusion and deformable convolution (BFFDC-YOLOv8-seg) to address the challenges of insufficient weed localization accuracy in complex environments with resource-limited laser weeding devices. Initially, by training on extensive datasets of plant images, the most appropriate model scale and training weights are determined, facilitating the development of a lightweight network. Subsequently, the introduction of the Bidirectional Feature Pyramid Network (BiFPN) during feature fusion effectively prevents the omission of weeds. Lastly, the use of Dynamic Snake Convolution (DSConv) to replace some convolutional kernels enhances flexibility, benefiting the segmentation of weeds with elongated stems and irregular edges. Experimental results indicate that the BFFDC-YOLOv8-seg model achieves a 4.9% increase in precision, an 8.1% increase in recall rate, and a 2.8% increase in mAP50 value to 98.8% on a vegetable weed dataset compared to the original model. It also shows improved mAP50 over other typical segmentation models such as Mask R-CNN, YOLOv5-seg, and YOLOv7-seg by 10.8%, 13.4%, and 1.8%, respectively. Furthermore, the model achieves a detection speed of 24.8 FPS on the Jetson Orin nano standalone device, with a model size of 6.8MB that balances between size and accuracy. The model meets the requirements for real-time precise weed segmentation, suitable for complex vegetable field environments and resource-limited laser weeding devices.

This paper introduces PatchFusion, an innovative approach for nonrigid tracking and reconstruction of deformable objects using a single RGB-D sensor. Existing methods face challenges in accurately capturing the rapid deformations of soft and flexible objects, thereby limiting their utility in diverse scenarios. Our approach overcomes this challenge by employing a dynamic patch-based framework that adapts to rapid inter-frame motions. Firstly, patch-wise rigid transformation fields for non-overlapping patches are solved via Iterative Closest Point (ICP) by incorporating geometric features as additional similarity constraints, thereby enhancing robustness and accuracy. Secondly, deformation optimization based on a nonrigid solver is applied to refine the coarse transformation fields. In order to enable simultaneous tracking and reconstruction of deformable objects, the patch-based rigid solver is designed to run in parallel with the nonrigid solver, serving as a plug-and-play module requiring minimal modifications for integration while enabling real-time performance. Following a comprehensive evaluation, PatchFusion showcases superior performance in effectively dealing with rapid inter-frame deformations when compared to existing techniques, rendering it a promising solution with broad applicability across domains such as robotics, computer vision, and human-computer interaction.

This paper presents a novel architecture for detecting mathematical formulas in document images, which is an important step for reliable information extraction in several domains. Recently, Cascade Mask R-CNN networks have been introduced to solve object detection in computer vision. In this paper, we suggest a couple of modifications to the existing Cascade Mask R-CNN architecture: First, the proposed network uses deformable convolutions instead of conventional convolutions in the backbone network to spot areas of interest better. Second, it uses a dual backbone of ResNeXt-101, having composite connections at the parallel stages. Finally, our proposed network is end-to-end trainable. We evaluate the proposed approach on the ICDAR-2017 POD and Marmot datasets. The proposed approach demonstrates state-of-the-art performance on ICDAR-2017 POD at a higher IoU threshold with an f1-score of 0.917, reducing the relative error by 7.8%. Moreover, we accomplished correct detection accuracy of 81.3% on embedded formulas on the Marmot dataset, which results in a relative error reduction of 30%.

This study aims to test a model linking destination image, perceived value, tourist satisfaction, and tourist loyalty. Based on a sample of 300 tourists travelling by car from the World Natural Heritage Site of Tianchi, China, a new model of destination image was explored and data were analysed using partial least squares structural equation modelling (PLS-SEM). The results show that perceived value and satisfaction are direct antecedents of destination loyalty. Above all, perceived value and tourist satisfaction mediate the relationship between destination image and loyalty. Finally, this study discusses the theoretical and management implications of the findings in order to boost the tourism industry in the context of car trips.

Interferometric synthetic aperture radar (InSAR) and tomographic SAR measurement techniques are commonly used for the three-dimensional (3D) reconstruction of complex areas, while the effectiveness of these methods relies on the interferometric coherence among SAR images with minimal angular disparities. Radargrammetry exploits stereo image matching to determine the spatial coordinates of corresponding points in two SAR images, and acquire their 3D properties. The performance of the image matching process directly impacts the quality of the resulting digital surface model (DSM). However, the presence of speckle noise, along with dissimilar geometric and radiometric distortions, poses considerable challenges to achieve accurate stereo SAR image matching. To address the aforementioned challenges, this paper proposes a radargrammetric method based on composite registration of multi-aspect SAR images. The proposed method combines coarse registration using scale invariant feature transform (SIFT) with precise registration using normalized cross-correlation (NCC) to achieve accurate registration between multi-aspect SAR images with large disparities. Furthermore, the multi-aspect 3D point clouds are merged by the proposed radargrammetric 3D imaging method, resulting in 3D imaging of target scenes based on multi-aspect SAR images. For validation purpose, this paper presents a comprehensive 3D reconstruction of the Five-hundred-meter Aperture Spherical radio Telescope (FAST) by using Ka-band airborne SAR images. It does not necessitate prior knowledge of the target and is applicable to the detailed 3D imaging of large-scale areas with complex structures. In comparison to other SAR 3D imaging techniques, it reduces the requirements for orbit control and radar system parameters. To sum up, the proposed 3D imaging method with composite registration guarantees imaging efficiency while enhances the imaging accuracy of crucial areas with limited data.

Urban scene point cloud pose significant challenges for registration due to its large data volume, similar scenarios and dynamic objects. In this paper, we propose PCRMLP, a model for urban scene point cloud registration that achieves comparable registration performance to prior learning-based methods. Compared to previous works which focus on extracting features and estimating correspondence, the model estimates the transformation implicitly from concrete instances. An instance-level urban scene representation method is introduced to extract instance descriptors via semantic segmentation and DBSCAN, which enable the model to obtain robust instance features, filter dynamic objects and estimate transformation in a more logical manner. Then a lightweight network consisting of MLPs is employed to obtain transformation in an encoder-decoder manner. We validate the approach on KITTI dataset. Experimental results demonstrate that PCRMLP can obtain a satisfactory coarse transformation from instance descriptors just in 0.0028s. With a subsequent ICP refinement module, the proposed method achieves higher registration accuracy and computational efficiency than prior learning-based works.

With the advancement of photoelectric technology and computer image processing technology, the visual measurement method based on point clouds is gradually applied to the 3D measurement of large workpieces. Point cloud registration is a key step in 3D measurement, and its registration accuracy directly affects the accuracy of 3D measurements. In this study, we designed a novel MPCR-Net for multiple partial point cloud registration networks. First, an ideal point cloud was extracted from the CAD model of the workpiece and was used as the global template. Next, a deep neural network was used to search for the corresponding point groups between each partial point cloud and the global template point cloud. Then, the rigid body transformation matrix was learned according to these correspondence point groups to realize the registration of each partial point cloud. Finally, the iterative closest point algorithm was used to optimize the registration results to obtain a final point cloud model of the workpiece. We conducted point cloud registration experiments on untrained models and actual workpieces, and by comparing them with existing point cloud registration methods, we verified that the MPCR-Net could improve the accuracy and robustness of the 3D point cloud registration.

Background and Objectives: Clinical trials are a critical step in the development of new medicines and medical devices, testing the efficacy and safety of new treatment regimens. However, if the results of clinical trials are not made public, the evidence base on interventions is incomplete and possibly distorted, which lead to suboptimal treatment choices and negatively affect public health. This study analyses and contrasts the laws and regulations governing clinical trial registration and reporting in China and the United States. Methods: We used desk research to compile, assess and compare current laws, regulations, compliance patterns, and enforcement mechanisms and actions in China and the United States (U.S.). Policy documents were downloaded from Chinese and U.S. government websites. A spreadsheet analysis was utilized for direct comparison. Results: Both China and the U.S. have laws and regulations governing clinical trial registration and reporting. Chinese legislation covers a broader range of trials. In the U.S. trial results must be disclosed to both the national regulator and the public, while Chinese law mandates disclosure to the regulator alone. Cross-country comparisons of regulatory compliance by trial sponsors are impossible due to the opacity of the Chinese data platform. Neither country effectively ensures that all clinical trial results are made public as required by the Declaration of Helsinki and recommended by the WHO. Interpretation: While neither country is perfect, both may be able to learn from each other. There is a major gap in the literature regarding the extent of non-publication of clinical trial results by sponsors operating in China.

Underwater image often exhibit detail blurring and color distortion due to light scattering, impurities, and other influences, obscuring essential textures and details. This presents a challenge for existing super-resolution techniques in identifying and extracting effective features, making high-quality reconstruction difficult. This research aims to innovate underwater image super-resolution technology to tackle this challenge. Initially, an underwater image degradation model was created by integrating random subsampling, Gaussian blur, mixed noise, and suspended particle simulation to generate a highly realistic synthetic dataset, thereby training the network to adapt to various degradation factors. Subsequently, to enhance the network's capability to extract key features, improvements were made based on the symmetrically structured Blind Super-Resolution Generative Adversarial Network (BSRGAN) model architecture. An attention mechanism based on energy functions was introduced within the generator to assess the importance of each pixel, and a weighted fusion strategy of adversarial loss, reconstruction loss, and perceptual loss was utilized to improve the quality of image reconstruction. Experimental results demonstrate that the proposed method achieved significant improvements in Peak Signal-to-Noise Ratio (PSNR) and Underwater Image Quality Measure (UIQM) by 0.85 dB and 0.19, respectively, significantly enhancing the visual perception quality and indicating its feasibility in super-resolution applications.

Abstract: The Micro-Electro-Mechanical System (MEMS) LiDAR point cloud in autonomous vehicles has a large deflection range, which results in slow registration speed and poor applicability. To maximize speed, an improved NDT (Normal Distribution Transform) method that integrates point cloud density features has been proposed. First, the point cloud is reduced using a modified voxel filter and a pass-through filter. Next, the ISS (Intrinsic Shape Signature) algorithm is utilized to analyze the point cloud features and extract keypoints, the 4PCS (4-Point Congruent Sets) algorithm is then employed to calculate the initial pose under the constraints of the keypoint set to complete the coarse registration. Finally, the self-adaptive segmentation model is constructed by using KD-tree to obtain the density features of keypoints, and the NDT algorithm is combined with this model to form an SSM-NDT algorithm, which is used for fine registration. Each algorithm was compared on the autonomous vehicle dataset PandaSet and actual collected data sets, the results show that the novel method increases the speed by at least 60% and takes into account good registration accuracy and strong anti-interference.

With the progression of AI, embedding advanced AI technologies into small robotics and mobile devices has become essential, driving research towards lightweighting AI models. Our study enhances the EPINET depth estimation model for light field images, aiming for compactness and faster inference while preserving accuracy. We conducted two-step experiments aimed at enhancing inference efficiency: Initially, by adjusting input streams and convolution layers, we simplified the CNN model, achieving faster inference times at the cost of reduced accuracy. To address this reduction in accuracy, we then applied knowledge distillation, allowing the simplified model to learn from the original model’s more complex patterns. In our quantitative experiments using two error metrics, MSE (Mean Squared Error) and BadPix, we identified optimal knowledge positions and evaluated the required complexity for the student model. As a result, our method improved MSE by 21% and BadPix by 14% compared to training without it. Furthermore, the student model achieved an inference speed 13% faster than the teacher model and surpassed its accuracy by 10% in MSE. Additionally, we demonstrated that repeatedly applying our approach could further enhance both model compactness and accuracy.

Non-rigid registration presents a significant challenge in the domain of point cloud processing. The general objective is to model complex non-rigid deformations between two or more overlapping point clouds. Applications are diverse and span multiple research fields, including registration of topographic data, scene flow estimation, and dynamic shape reconstruction. To provide context, we begin with a general introduction to the topic of point cloud registration, including a categorization of methods. Next, we introduce a general mathematical formulation for point cloud registration and extend it to address non-rigid registration. A detailed discussion and categorization of existing approaches to non-rigid registration follows. We then introduce our own method where the usage of piece-wise tricubic polynomials for modeling non-rigid deformations is proposed. Our method offers several advantages over existing methods. These advantages include easy control of flexibility through a small number of intuitive tuning parameters, a closed-form optimization solution, and an efficient transformation of huge point clouds. We demonstrate our method through multiple examples that cover a broad range of applications, with a focus on remote sensing applications - namely, the registration of Airborne Laser Scanning (ALS), Mobile Laser Scanning (MLS), and Terrestrial Laser Scanning (TLS) point clouds. The implementation of our algorithms is open source and can be found on GitHub.

In Indonesia, types of meat are still identified manually due to increasing prices for beef and buf-falo ahead of Idul Fitri. Traders mix beef with pork to thwart the beef scam. Haar wavelet and GLCM, GLCM with angles of 0°, 45°, 90°, and 135°, as well as matrices using contrast, correlation, energy, homogeneity, and entropy, are used in feature extraction. The following are the results of meat image classification testing using k-NN, Haar wavelet, and GLCM: The k-NN algorithm shows superiority in identifying fresh (99%), frozen (99%), and rotten (96%) meat texture images with the most fantastic accuracy results in every situation. Meanwhile, GLCM routinely provides good results, especially regarding the texture image of fresh meat (183.21) and rotten meat (115.79). However, despite delivering less throughput than k-NN and GLCM, Haar wavelets are still helpful, especially when dealing with fresh meat texture images (89,96).

Multispectral image (MSI) and hyperspectral image (HSI) fusion (MHIF) aims to address the challenge of acquiring high-resolution (HR) HSI images. This field combines a low-resolution (LR) HSI with an HR-MSI to reconstruct HR-HSI. Existing methods directly utilize transformers to perform feature extraction and fusion. Despite the demonstrated success, there exist two limitations: 1) Employing the entire transformer model for feature extraction and fusion fails to fully harness the transformer’s potential in integrating the spectral of the HSI and spatial information of the MSI. 2) HSI has a strong spectral correlation and exhibits sparsity in the spatial domain. Existing transformer-based models do not optimize this physical property, which makes their methods prone to spectral distortion. To accomplish these issues, this paper introduces a novel framework for MHIF called Sparse Mix-Attention Transformer (SAMformer). Specifically, to fully harness the advantages of the Transformer architecture, we propose a Spectral Mix Attention Block (SMAB), which concatenates the keys and values extracted from LR-HSI and HR-MSI to create a new multi-head attention module. This design facilitates the extraction of detailed long-range information across spatial and spectral dimensions. Besides, to address the spatial sparsity inherent in HSI, we incorporated a sparse mechanism within the core of SMAB called Sparse Spectral Mix Attention Block (SSMAB). In the SSMAB, we compute attention maps from queries and keys and select the K highly correlated values as the sparse attention map. This approach enables us to achieve a sparse representation of spatial information while eliminating spatially disruptive noise. Extensive experiments conducted on three benchmark datasets, namely Cave, Harvard, and Pavia Center, demonstrate the SMAformer method outperforms state-of-the-art methods.

Cervical cancer is a worldwide public health problem with a high rate of illness and mortality among women. In this study, we proposed a novel framework based on Faster RCNN-FPN ar-chitecture for the detection of abnormal cervical cells in cytology images from cancer screening test. We extended the Faster RCNN-FPN model by infusing deformable convolution layers into the feature pyramid network (FPN) to improve scalability. Furthermore, we introduced a global contextual aware module alongside the Region Proposal Network (RPN) to enhance the spatial correlation between the background and the foreground. Extensive experimentations with the proposed deformable and global context aware (DGCA) RCNN were carried out using the cer-vical image dataset of “Digital Human Body" Vision Challenge from the Alibaba Cloud TianChi Company. Performance evaluation based on the mean average precision (mAP) and receiver operating characteristic (ROC) curve has demonstrated considerable advantages of the proposed framework. Particularly, when combined with tagging of the negative image samples using tra-ditional computer-vision techniques, 6-9% increase in mAP has been achieved. The proposed DGCA-RCNN model has potential to become a clinically useful AI tool for automated detection of cervical cancer cells in whole slide images of Pap smear.

Visible light photography diagnostic images are coloured ex vivo medical images popularly used in Dermatology and Endoscopy for diagnosis and monitoring. The need to protect the integrity of these images as well as associated patient data calls for techniques such as image steganography and watermarking. This research explores and compares the effect of watermarking on the YIQ and YCbCr colour transforms used in processing digital coloured images and video in recent times. Using a new spread spectrum watermarking algorithm, it was found that YIQ has better distortion performance than YCbCr in the order of 3dB while YCbCr had lower BER for accurate watermark retrieval and tamper detection in the order of 1.3 x 10-3.

Recently, cobalt iron boron (CoFeB) thin films have been widely investigated to apply to magnetic sensors, due to their high magnetic moment, anisotropy, and stability. However, most of these studies are conducted on rigid silicon substrates. For more diverse applications of magnetic sensors and angle sensors, it is important to explore the properties of ferromagnetic thin films grown on non-rigid deformable substrates. Here, using representative deformable substrates such as polyimide (PI), polyethylene naphthalate (PEN) and polydimethylsiloxane (PDMS) that can be bent or stretched, we report experimental comparison of in-plane magnetic field angle-dependent properties of the amorphous Ta/CoFeB/MgO/Ta thin film which is grown on those deformable substrates. We investigate effects of substrate roughness, tensile stress, characteristics of deformable substrates, and sputtering process on the change of magnetic properties like coercive field (Hc), remanence over saturation magnetization (Mr/Ms), and their biaxial characteristics. This work presents unconventional foundations for exploring deformable magnetic sensors capable of detecting magnetic field angle.

This study addresses the challenge of treating skin cancer effectively, especially in visible areas like the face, where traditional methods may be undesirable. Current options, including surgery and radiation therapy, have limitations such as complexity, expense, and imprecise dose delivery. The proposed solution involves additively manufacturing personalized patches using diagnostic imaging data, offering a targeted and controlled dose of beta-emitting isotopes like Y-90. The patches, tailored to the tumor's shape and depth, aim to minimize damage to healthy tissues and structures. Through 3D printing technology we demonstrated the feasibility of creating individualized applicators filled with radioisotopes, that have the potential to deliver therapeutic doses while ensuring patient comfort and affordability. This innovative approach, based on radiation delivery simulations, offers a promising future alternative to conventional radiation therapy methods. Clinical trials are required to validate its efficacy and safety, but the potential for reduced radiation exposure and enhanced treatment precision positions this personalized and targeted therapy as a valuable advancement in skin cancer treatment.

This paper describes an image processing method that makes use of image parts instead of neural parts. Neural networks excel at image or pattern recognition and they do this by constructing complex networks of weighted values that can cover the complexity of the pattern data. These features however are integrated holistically into the network, which means that they can be difficult to use in an individual sense. A different method might scan individual images and use a more local method to try to recognise the features in it. This paper suggests such a method, where a trick during the scan process can not only recognise separate image parts, as features, but it can also produce an overlap between the parts. It is therefore able to produce image parts with real meaning and also place them into a positional context. Tests show that it can be quite accurate, on some handwritten digit datasets, but not as accurate as a neural network, for example. The fact that it offers an explainable interface could make it interesting however. It also fits well with an earlier cognitive model, and an ensemble-hierarchy structure in particular.

Saliency detection in synthetic aperture radar (SAR) image is a difficult problem. This paper proposed a multitask saliency detection (MSD) model for the saliency detection task of SAR image. Firstly, we extract four features of SAR image as the input of the MSD model, which include the intensity, orientation, uniqueness and global contrast. Then, the saliency map is generated by the multitask sparsity pursuit (MTSP) which integrates the multiple features collaboratively. Subjective and objective evaluation of the MSD model verifies its effectiveness. Based on the saliency maps of the source images, an image fusion method is proposed for the SAR and color optical image fusion. The experimental results of real data show the proposed image fusion method is superior to the presenting methods in terms of several universal quality evaluation indexes, as well as in the visual quality. The salient areas in the SAR image can be highlighted and the spatial and spectral details of color optical image can also be preserved in the fusion result.

Quantum theory is the land of indiscernible things, of things that in some situations cannot be put apart. This contrasts in much with standard mathematics and classical logic, which were elaborated to deal with \textit{individuals}, discernible things. Many thinkers, among them the mathematician Yuri Manin, have proposed that a more general theory of `sets' than standard set theories (where sets are collections of discernible elements) should be elaborated to cope with quantum physics. Quasi-set theory was proposed with such an aim. In this paper, we consider some aspects of this theory and discuss the way we can use such a theory as a framework for constructing deformable (not rigid) structures where indiscernible things can be considered but with one additional and fundamental detail: these structures cannot be extended to rigid structures as it happens in the standard frameworks. Really, the way of dealing with indiscernible (or indistinguishable) elements within a `standard' framework such as a `classical' set theory (like the ZFC system) requires the confinement of the discussion to deformable (non-rigid) structures. But in ZFC every structure can be extended to a rigid structure (encompassing only the trivial automorphism -- the identity function), so that in the extended structure (or in the whole universe) one can realize that the supposed indiscernible objects are not indiscernible at all. Quasi-set theory is such that the universe of quasi-sets is deformable and in such a theory one can construct deformable structures which cannot be extended to rigid ones. The aim of this paper is to put these things in a clear way.

Early identification of viruses leads to more efficient disease management and control, and is extremely important. A possible new approach for creating virus sensors is the Electromagnetic echo effect (EMEE). An important feature is that the signal from EMEE is highly dependent on the state of the irradiated body. This makes it possible to control ongoing reactions, even if these reactions are invisible to the human eye or other equipment. This article shows the possibility of registering reaction occurring in the presence of an avian coronavirus causing infectious bronchitis, strain Massachusetts. The same methodology can be applied for other types of viruses as well.

Medical image segmentation is a critical step in various healthcare applications, aiding in diagnosis, treatment planning, and disease monitoring. In this study, we investigate the efficacy of a segmentation approach based on the 2D wavelet transform. Leveraging a dataset comprising 10 diverse medical images, we evaluate the performance of our segmentation method using three key metrics: accuracy, precision, and recall. Our findings demonstrate that the proposed approach enhances segmentation accuracy, offering promising results compared to existing methods. By harnessing the multi-resolution feature extraction capabilities of the 2D wavelet transform, our method achieves improved delineation of medical image structures, paving the way for more accurate and efficient healthcare interventions.

Deep learning image reconstruction (DLIR) algorithms employs convolutional neural networks (CNNs) for CT image reconstruction to produce CT images with a very low noise level, even at low radiation dose. The aim of this study was to assess whether the DLIR algorithm reduces the CT effective dose (ED) and im-proves CT image quality in comparison with filtered back projection (FBP) and iterative reconstruction (IR) algorithms in intensive care unit (ICU) patients. We identified all consecutive patients referred to the ICU of a single hospital who underwent at least two consecutive chest and/or abdominal contrast-enhanced CT scans within a time period of 30 days using DLIR and subsequently FBP or IR algorithm (Advanced Mod-eled Iterative Reconstruction model-based algorithm [ADMIRE], or Adaptive Iterative Dose Reduction 3D [AIDR 3D]) for CT image reconstruction. The radiation ED, noise level, and signal-to-noise ratio (SNR) were compared between the different CT scanners. The non-parametric Wilcoxon test was used for statistical comparison. Statistical significance was set at p < 0.05. A total of 83 patients (mean age, 59 ± 15 years [standard deviation]; 56 men) were included. DLIR vs FBP reduced ED (18.45 ± 13.16 mSv vs 22.06 ± 9.55 mSv, P < 0.05), while DLIR vs FBP and vs ADMIRE and AIDR 3D IR algorithms reduced image noise (8.45 ± 3.24 vs 14.85 ± 2.73 vs 14.77 ± 32.77 and 11.17 ± 32.77\, P < 0.05) and increased SNR (11.53 ± 9.28 vs 3.99 ± 1.23 vs 5.84 ± 2.74 and 3.58 ± 2.74, P < 0.05). CT scanners employing DLIR reduced radiation ED and im-proved SNR compared to CT scanners using FBP, whereas CT scanners using DLIR improved SNR com-pared to CT scanners using FBP or IR algorithms in ICU patients.

As technology and multimedia production have advanced, there has been a significant rise in attacks on digital media, resulting in duplicated, fraudulent, and altered data and the infringement of copyright laws. This paper presents a robust and secure digital image watermarking technique that has been implemented in the spatial domain and exploits the erratic and chaotic behaviour of the powerful elementary cellular automata rule-30. The crucial characteristics of the watermarking system, i.e., imperceptibility, capacity, and robustness, have been perfectly balanced by the suggested blind watermarking technique. In this approach, prior to embedding, the grayscale watermark image is downsized to its two Most Significant Bits (MSBs). Then, the 2-MSBs watermark is encrypted using an ECA rule-30 so as to level up the security attribute of the system. Then, the host image is scrambled using ECA rule-30 to distribute the watermark pixels throughout the host image and thus achieve the highest robustness against geometrical attacks. Finally, the encrypted watermark data is embedded into the scrambled host image using the ECA rule-30-based embedding key. The proposed method performs better in terms of imperceptibility, capacity, and robustness when compared to several systems with similar competencies. The simulation's findings demonstrate strong imperceptibility as evaluated by the Peak Signal-to-Noise Ratio (PSNR), which has an average value of 58.3735 dB and a high payload. The experimental outcomes, observed across a diverse range of standardized attack scenarios, unequivocally establish the ascendancy of the proposed algorithm over competing methodologies in the realm of image watermarking.

Thermal infrared imagery provides temperature information on target objects, and has been widely applied in non-destructive testing. However, thermal infrared imagery is not always able to display detailed textures of inspected objects, which hampers the understanding of geometric entities consisting of temperature information. Although some commercial software has been developed for 3D thermal model displays, the software requires the use of expensive specific thermal infrared sensors. This study proposes a cost-effective method for 3D thermal model reconstruction based on image-based modeling. Two smart phones and a low-cost thermal infrared camera are employed to acquire visible images and thermal images, respectively, that are fused for 3D thermal model reconstruction. The experiment results demonstrate that the proposed method is able to effectively reconstruct a 3D thermal model which extremely approximates its corresponding entity. The total computation time for the 3D thermal model reconstruction is intensive while generating dense points required for the creation of a geometric entity. Future work will improve the efficiency of the proposed method in order to expand its potential applications to in-time monitoring.

Facial recognition systems are widely used systems around the globe. Their applications in real world scenarios like law enforcement, surveillance, ID card identification, information security, access control and many more has made them very important in today’s world. These systems have shown promising results and excellent performance; however, these systems need tremendous number of facial images for training before they are implemented in the real-world scenarios. The problem arises when we face lack of training images due to which the performance of such systems decreases exponentially. The problem becomes even worse when there is only one image per subject for training our facial recognition system, the probe image might contain variation like illumination, expression and disguise which are hard to be accurately recognized. Generative models have achieved great success for handling the lack of training data by generating synthetic data that resembles the original data. We have created a new method by fine tuning the basic Conditional Generative Adversarial Network (CGAN) to generate synthetic facial images provided only single image per subject. These synthetic facial images contain six variations that are smile, anger, stare, illumination and disguise. We increased the size of the dataset and then applied a convolutional neural network for facial recognition, which improved the accuracy of our system from 0.76 to 0.99.

When the image quality is evaluated, the human visual system (HVS) infers the details in the image through its internal generative mechanism. In this process, the HVS integrates both local and global information of the image, utilizes contextual information to restore the original image information, and compares it with the distorted image information for image quality evaluation. Inspired by this mechanism, a no-reference image quality assessment method is proposed based on a multitask image restoration network. The multitask image restoration network generates a pseudo-reference image as the main task and produces structural similarity index measure map as an auxiliary task. By mutually promoting the two tasks, a higher quality pseudo-reference image is generated. In addition, when predicting the image quality score, both the quality restoration features and the difference features between the distorted and reference images are used, thereby fully utilizing the information from the pseudo-reference image. To enable the model to focus on both global and local features, a multi-scale feature fusion module is proposed. Experimental results demonstrate that the proposed method achieves excellent performance on both synthetically and authentically distorted databases.

Thresholding is considered as a statistical-decision making theory which can lessen the average error incurred in allocating pixels to two or more groups. The traditional Bayes decision rule can be applied with the prior knowledge of the Probability Density Function (PDF) of each class. It is surmised that a threshold resulting in the best class separation is the optimal one. In this paper, Otsu’s thresholding for image segmentation has been implemented. The well-known Otsu’s method is to learn a threshold that can maximize the between-class variance or equivalently make light of the within-class variance of the entire image. At first, a color image of a tree is taken. After that, the image is transformed into a grayscale image. Then in the first part, two-level thresholding is conducted, and later on, three-level thresholding is also applied. Again, two-level thresholding, as well as three level thresholding, are also applied to some other images. Finally, the comparison is made between two level thresholding and three level thresholding

Euler’s product formula over the primes and Euler’s zeta function equate to enshrine the Fundamental Theorem of Arithmetic that every integer > 1 is the product of a unique set of primes. The product formula has no zero, and with a domain ≤1 Euler’s zeta diverges. Dirichlet’s eta function η(s), negates alternate terms of zeta, permitting convergence when s∈C and Re(s) < 1, and its non-trivial zeros {ρ}, have a deep relationship with the distribution of the primes. The Riemann Hypothesis is that all the non-trivial zeros have Re(ρ) = 1/2. This work examines the symmetries in a partial Euler’s zeta series with a complex domain equating it to the difference between two finite vector series whose matched terms have mirror-image arguments, but whose magnitudes differ when Re(s) ≠ 1/2. Analytical continuation generates a modified eta series η_l(s), in which every l^th term is multiplied by (1-l). If the integer l is appropriately determined by the Im(s), similar paired finite vector series have a difference that closely follows η_l (s) and their terminal vectors intersect in a unique way permitting zeros only when Re(s) = 1/2. Furthermore, those vectors tracking the derivatives of the series, have a special relationship permitting zeros of the differential only when Re(s) > 1/2.

Scene classification plays an important role in the intelligent processing of high-resolution satellite (HRS) remotely sensed image. In HRS image classification, multiple features, e.g. shape, color, and texture features, are employed to represent scenes from different perspectives. Accordingly, effective integration of multiple features always results in better performance compared to methods based on a single feature in the interpretation of HRS image. In this paper, we introduce a multi-task joint sparse and low-rank representation model to combine the strength of multiple features for HRS image interpretation. Specifically, a multi-task learning formulation is applied to simultaneously consider sparse and low-rank structure across multiple tasks. The proposed model is optimized as a non-smooth convex optimization problem using an accelerated proximal gradient method. Experiments on two public scene classification datasets demonstrate that the proposed method achieves remarkable performance and improves upon the state-of-art methods in respective applications.

Cancer diagnosis and classification are pivotal for effective patient management and treatment planning. In this study, we present a comprehensive approach utilizing ensemble deep learning techniques to analyze breast cancer histopathology images. Our datasets are based on two widely employed datasets from different centers for two different tasks: BACH and BreakHis. Within the BACH Dataset, we deployed an ensemble strategy incorporating VGG16 and ResNet50 architec-tures to achieve precise classification of breast cancer histopathology images. Introducing a novel image patching technique, to preprocess a high-resolution image, which facilitates focused analysis of localized regions of interest. The annotated BACH dataset encompasses 400 WSIs across four distinct classes: Normal, Benign, In Situ Carcinoma, and Invasive Carcinoma. In addition, we employed the BreakHis dataset, utilizing VGG16, ResNet34, and ResNet50 models to classify mi-croscopic images into eight distinct categories (four benign and four malignant). For both models we leveraged a five-fold cross-validation approach for rigorous training and testing. Preliminary ex-perimental results indicate a Patch classification accuracy of 95.31% (on BACH dataset) and WSI image classification accuracy of 98.43% (BreakHis). This research significantly contributes to on-going endeavors in harnessing artificial intelligence to advance breast cancer diagnosis, potentially fostering improved patient outcomes and alleviating healthcare burdens.

Urinary tract infections (UTIs) are highly prevalent in long-term care facilities, constituting the most common infection in this setting. Our research focuses on analyzing clinical characteristics and antimicrobial prescriptions for UTIs in residents across nursing homes (NH) in Spain. This cross-sectional report is part of a before/after intervention study using a multifaceted approach based on the normalization process theory to improve healthcare quality provided by nursing staff in 34 NHs in Spain. In this study we present the results of the first audit including 719 UTI cases, with an average age of 85.5 years and 74.5% being women. Cystitis and pyelonephritis presented distinct symptom patterns. Notably, 6% of asymptomatic bacteriuria cases were treated. The prevalence of dipstick usage was 83%, raising concerns about overreliance, including in the 46 asymptomatic cases, leading to potential overdiagnosis and antibiotic overtreatment. Improved diagnostic criteria and personalized strategies are crucial for UTI management in NHs, emphasizing the need for personalized guidelines on management of UTIs, to mitigate indiscriminate antibiotic use in asymptomatic cases.

This study describes the development of an image-based insect trap diverging from the plug-in camera insect trap paradigm. In short, a) it does not require manual annotation of images to learn how to count targeted pests and, b) it self-disposes the captured insects, and therefore is suitable for long-term deployment. The device consists of an imaging sensor integrated with Raspberry Pi microcontroller units with embedded deep learning algorithms that count agricultural pests inside a pheromone-based funnel trap. The device also receives commands from the server which configures its operation while an embedded servomotor can automatically rotate the detached bottom of the bucket to dispose of hydrated insects as they begin to pile up. Therefore, it completely overcomes a major limitation of camera-based insect traps: the inevitable overlap and occlusion caused by the decay and layering of insects during long-term operation, thus extending the autonomous operational capability. We study cases that are underrepresented in literature such as counting in situations of congestion and significant debris using crowd counting algorithms encountered in human surveillance. Finally, we perform comparative analysis of the results from different deep-learning approaches (YOLO7/8, crowd counting, deep learning regression) and we open-source the code and a large database of Lepidopteran plant pests.

Document image binarization is a challenging task, especially when it comes to text segmentation in degraded document images. The binarization, as a pre-processing step of optical character recognition (OCR), is one of the most fundamental and commonly used segmentation methods. It separates the foreground text from the background of the document image to facilitate subsequent image processing. In view of the different degradation degree of document image, researchers have proposed a variety of solutions. This paper reviews the main binarization techniques, including both traditional algorithms and deep learning-based algorithms. We also summarize some difficulties and challenges in the field of document image binarization. Here, we evaluate various image binarization techniques to identify shortcomings in current methods and provide some help for future research.

Non-linear activation functions are one of the main parts of deep neural network architectures. The choice of the activation function can affect model speed, performance and convergence. Most popular activation functions don't have any trainable parameters and don't alter during the training. We propose different activation functions with and without trainable parameters. Said activation functions have a number of advantages and disadvantages. We'll be testing the performance of said activation functions and comparing the results with widely known activation function ReLU. We assume that the activation functions with trainable parameters can outperform functions without ones, because the trainable parameters allow the model to "select'' the type of each of the activation functions itself, however, this strongly depends on the architecture of the deep neural network and the activation function itself.

Capsule endoscopy, which uses a wireless camera to take images of the digestive tract, is emerging as an alternative to traditional colonoscopy. The diagnostic values of these images depend on the quality of revealed underlying tissue surfaces. In this paper, we consider the problem of enhancing the visibility of detail and shadowed tissue surfaces for capsule endoscopy images. Using concentric circles at each pixel for random walks combined with stochastic sampling, the proposed method enhances the details of vessel and tissue surfaces. The framework decomposes the image into two detail layers that contain shadowed tissue surfaces and detail features. The target pixel value is recalculated for the smooth layer using similarity of the target pixel to neighboring pixels by weighting against the total gradient variation and intensity differences. In order to evaluate the diagnostic image quality of the proposed method, we used clinical subjective evaluation with a rank order on selected KID image database and compared to state of the art enhancement methods. The result showed that the proposed method provides a better result in terms of diagnostic image quality and objective quality contrast metrics and structural similarity index.

Neural-objective and image optimization approaches for drilling fluid rheology automation are crucial for drilling engineering optimization. A myriad of intelligent computational models are employed to predict and monitor the parameters of mud rheology and filter cake permeability posture using an artificial neural network feedforward (ANN-FF) function, a non-ANN-FF function, an image processing tool, and a model optimization tool. 498 datasets of synthetic-based mud (SBM) flat rheology from a drilling mud laboratory at Nazarbayev University were imported into a user-friendly MATLAB application using image processing and nftool. Apart from the Google TensorFlow Sequential API DNN architecture used, a Levenberg-Marquardt training algorithm with input sigmoid hidden neurons 10, 12, and 18 coupled with a linear output layer was also used to predict the SBM flow index. OBM and SBM filter cakes were processed for void spaces; however, a model study was extrapolated to maximize filtration volume Vf. The study’s findings show that the ANN-FF model employed for rheological property monitoring and prediction had higher steady and exponential levels of accuracy and a correlation coefficient of 0.96-0.99. More so, SBM and OBM image processing presented an area of void spaces of 1790M2 and 1739M2, respectively. The porosity and permeability postures of both SBM and OBM resulted in a significant void space capable of maximizing the flow index. In addition, the single-objective modelling based on a genetic algorithm did validate the experimental rheological data for flow index or filtration volume Vf optimization; the study resulted in the finding that the constrained physics-informed objective function hindered maximizing oil recovery and instead predicted possible formation damage. It is empirical to note that automating flow predictions with neural, objective, and image functions has presented an alternative novel method for non-programmers using MATLAB and Google Colabs that is capable of enhancing mud rheological parameters, drilling efficiency, and hydrocarbon recovery.

Medical image analysis is an important branch in the field of medicine, which mainly uses image processing and analysis techniques to interpret and diagnose medical image data. Medical image data helps doctors to effectively observe and diagnose patients' body structures, tissues and lesions. Medical image analysis has been an important research area in the medical field, and it is important for disease diagnosis, treatment planning, and condition monitoring. In recent years, the rapid development of deep learning and computer vision technologies has contributed greatly to the automation, multimodal data fusion, real-time application, and accuracy improvement of medical image analysis. In addition, the development of deep learning has given rise to some new research areas in medical image analysis, such as Generative Adversarial Networks (GANs) for synthetic medical images, self-supervised learning for unsupervised feature learning, and neural network interpretability. In this paper, we will introduce some optimisation methods for medical images which are effective in improving the accuracy, efficiency and reliability of medical image analysis.

Recent advances in microscopy imaging and image analysis motivate more and more institutes world-wide to establish dedicated core-facilities for bio-image analysis. To maximize the benefits research groups at these institutes gain from their core-facilities, they should be established to fit well into their respective environment. In this article, we introduce common collaborator requests and corresponding potential services core-facilities can offer. We also discuss potential conflicts of interests between the targeted missions and implementations of services to guide decision makers and core-facility founders to circumvent common pitfalls.

In view of the problem of cracking easily and partial distortion of images after encryption or decryption, a novel image encryption and decryption algorithm based on Arnod Transform and fractional chaotic is proposed. To begin with, the Arnold transform is used to encrypt. So that the spatial confidence of the original image has been comprehensively disturbed. Secondly, the XOR involving the fractional order chaotic sequence is used to encrypt. The key sequence is dynamically generated to ensure the randomness and difference of key generation. When decryption is required, the first decryption is performed using the key and XOR. Then the second decryption is carried out by using the inverse Arnold transform, and finally the decrypted image is obtained. Experimental results show that the improved algorithm has achieved better performance in encryption and decryption.

In rye, there is a considerable variety of grain color which is determined by the diversity of compounds localized in different parts of the grain (caryopsis) - pericarp, testa, and aleurone. The localization of anthocyanins and proanthocyanidins was analyzed in 26 rye samples with identified anthocyanin genes, along with the analysis of CIE color coordinates. The Grain Scan program [1] was used to analyze images of individual grains. The localization of anthocyanins and proanthocyanidins was studied on longitudinal and cross sections of grains using light microscopy and MALDI-imaging. The violet-grained samples contain anthocyanins in the pericarp, and the green-grained samples contain anthocyanins in the aleurone layer. The green, violet and yellow-grained rye, with the exception of two anthocyaninless mutants vi3 and vi6, shows the presence of proanthocyanidins in the brown-colored testa. Four main color groups of the rye grains (yellow, green, brown, violet) could be differentiated using the color coordinate h° (hue angle). Interspecies and intraspecies variability for the localization of colored flavonoids in cereal grains is discussed.

Currently, maritime traffic is increasing with economic growth in several regions worldwide. However, this growth in maritime traffic has led to increased risk of marine accidents. These accidents have a higher probability of occurring in regions where geographical features, such as islands, are present. Further, the positioning of rescue ships in a particular ocean region with a high level of maritime activity is critical for rescue operations. This paper proposes a method for determining an optimal set of locations for stationing rescue ships in an ocean region with numerous accident sites in the Wando islands of South Korea. The computational challenge in this problem is identified as the positioning of numerous islands of varying sizes located in the region. Thus, the proposed method combines a clustering-based optimization method and an image processing approach that incorporates flood filling to calculate the shortest distance between two points in the ocean that detours around the islands. Experimental results indicate that the proposed method reduces the distance from rescue ships and each accident site by 5.0 km compared to the original rescue ship locations. Thus, rescue time is reduced.

: Image guided superficial radiation therapy (IGSRT) combines superficial radiation therapy (SRT) with full dermal visualization (FDV) via high resolution dermal ultrasound (HRDUS) for the treatment of non-melanoma skin cancer (NMSC). The gold standard for IGSRT delivery includes a comprehensive cancer care model with support for the dermatologists by a multidisciplinary team. When delivered in this model, IGSRT can achieve cure rates of 99% for treatment of NMSC. This paper focuses on the benefits of IGSRT during therapy. Medical records from 7 dermatology clinics of 883 patients with 1,507 cases of NMSC treated with IGSRT be-tween 2017 and 2018 were retrospectively reviewed. 92% of the NMSC lesions showed daily depth fluctuations, 60.32% of lesions did not require changes during therapy, and nearly 40% of lesions required at least one compensatory change during therapy. 83% of NMSC lesions were labeled high-risk based on the 2024 NCCN guidelines. Increasing and decreasing tumor depth measurements during IGSRT inform dermatologists when adaptive changes in energy (kV), TDF and dose will result in more efficacy and less toxicity, respectively.

In this paper, the filtering method of biomedical image denoising is described comprehensively. Firstly, it introduces the biomedical image denoising, describes the relationship between biomedical image denoising and medical care, introduces the filtering methods, the filtering methods of biomedical image denoising, the challenges encountered by the current filtering methods, and other application fields of filtering methods. Firstly, the background of biomedical image denoising is introduced. Biomedical image denoising is a challenge. Different imaging modes have different noise characteristics, and noise levels can vary greatly depending on the specific application. Secondly, it describes that biomedical image denoising plays an important role in medical care, and the biomedical image directly affects the patient's diagnosis, treatment plan and the overall quality of medical care service. Then the filtering method is introduced in detail, describing the core concepts and related features of linear filtering, nonlinear filtering and frequency domain filtering, and then focusing on the adaptive filtering method, describing the characteristics, conditions of use, common algorithms and advantages of adaptive filtering method. Then the filter methods of biomedical image denoising are introduced, and the core concepts of Gaussian filter, median filter, total variation denoising and Wiener filter are introduced respectively. Then, the challenges encountered by filtering methods are described, such as the accurate selection of filters, the balance between noise reduction and image detail preservation are introduced. Finally, the application of filtering method in other fields is mentioned, such as audio processing, speech recognition and so on. In summary, this paper comprehensively expounds the denoising and filtering methods of biomedical images, the filtering methods of medical image denoising, the relationship between medical image denoising and medical care, and the challenges encountered by filtering methods.

In recent years, significant advancements in the field of machine learning have influenced the domain of image restoration. While these technological advancements present prospects for improving the quality of images, they also present difficulties, particularly the proliferation of manipulated or counterfeit multimedia information on the internet. The objective of this paper is to provide a comprehensive review of existing inpainting algorithms and forgery detections, with a specific emphasis on techniques that are designed for the purpose of removing objects from digital images. In this study, we will examine various techniques encompassing conventional texture synthesis methods, as well as those based on neural networks. Furthermore, we will explore the artifacts associated with the identification of modified photos and present the artifacts frequently introduced by the inpainting procedure and assess the state-of-the-art technology for detecting such modifications. Lastly, we shall look at the available datasets and how the methods compare with each other. Having covered all of the above, the final outcome of this study is to provide a comprehensive perspective on the abilities and constraints to detect images for which an inpainting object removal method was applied.

Image denoising has been one of the important problems in the field of computer vision, and it has a wide range of practical value in many applications, such as medical image processing, image enhancement, and computational photography. Traditional image denoising methods are usually based on hand-designed features and filters, but these methods perform poorly under complex noise and image structures. In recent years, the rapid development of neural network technology has revolutionized the image-denoising task. This paper introduces the knowledge about neural networks and image denoising, explores the impact of neural networks on image denoising, and how is it possible to denoise images by neural networks. It also summarises other image-denoising methods and finally points out the challenges and problems faced by image-denoising at present. Some possible new development directions are proposed to provide new solutions for image-denoising researchers and to promote the development of the field.

Image synthesis poses a challenging problem that researchers in computer vision and machine learning have been grappling with for several decades. Numerous machine learning techniques have emerged and proven effective in generating high-fidelity artificial images. This study breaks new ground by exploring image synthesis through generative learning using the D-Wave 2000Q quantum annealer, marking the first attempt to address the issue of generative image synthesis on a Quantum Processing Unit (QPU). Alongside executing image synthesis on the quantum annealer, this research also compares its performance with existing classical models and delves into resolving the Generative Learning Trilemma.

Deep neural networks with powerful auto-optimization tools have been widely applied in various research fields, e.g., NLP and computer vision. However, existing neural network architectures typically are constructed using different inductive biases, e.g., preconceptions, expecting to decrease parameter search space during training, reduce computational cost or introduce expert knowledge in the neural network design. As an alternative, Multilayer Perceptron (MLP) provides much better freedom for exploration, has a lower inductive bias than convolutional neural networks (CNNs), and offers good flexibility in learning complex patterns. Even though, such neural architectures are commonly built in a flat Euclidean space, which is not necessarily the optimal space for any data, and is especially not good for modeling hierarchical correlations. Hyperbolic neural networks (HNNs) have gained attention for their ability to capture hierarchical structures present in complex data types like graphs. Recently, there has been an increasing interest to extend HNNs to computer vision tasks, motivated by the observations that images possess rich hierarchical relations. However, this is generally applied by employing a Euclidean backbone for learning higher-level semantic representations and only incorporating a hyperbolic classifier for classification, which, we argue, does not make full use of the advantage of hyperbolic space. Considering the recovery of the attention-free Multilayer Perceptron(MLP), in this paper, we extend it to non-Euclidean space and propose a novel architecture, named Hyperbolic Res-MLP (HR-MLP), that leverages fully hyperbolic layers to learn feature embeddings and perform image classification in an end-to-end fashion. With the help of the proposed Lorentz cross-patch and cross-channel layers, we can directly perform operations in the hyperbolic domain with fewer parameters, making it faster to train and providing comparatively better performance than its Euclidean counterpart. Experiments on CIFAR10, CIFAR100, and MiniImageNet demonstrate a comparable and superior performance when compared to Euclidean baselines. Our code is available at (https://github.com/Ahmad-Omar-Ahsan/HR-MLP)

A single paragraph of about 200 words maximum. For research articles, abstracts should give a pertinent overview of the work. We strongly encourage authors to use the following style of structured abstracts, but without headings: (1) Background: place the question addressed in a broad context and highlight the purpose of the study; (2) Methods: describe briefly the main methods or treatments applied; (3) Results: summarize the article’s main findings; (4) Conclusions: indicate the main conclusions or interpretations. The abstract should be an objective representation of the article, it must not contain results which are not presented and substantiated in the main text and should not exaggerate the main conclusions.

Gradient-domain image processing is a technique where, instead of operating directly on the image pixel values, the gradient of the image is computed and processed. The resulting image is obtained by reintegrating the processed gradient. This is normally done by solving the Poisson equation, most oftenly by means of a finite difference implementation of the gradient descent method. However, this technique in some cases lead to severe haloing artefacts in the resulting image. To deal with this, local or anisotropic diffusion has been added as an ad-hoc modification of the Poisson equation. In this paper, we show that a version of anisotropic gradient-domain image processing can result from a more general variational formulation through the minimisation of a functional formulated in terms of the eigenvalues of the structure tensor of the differences between the processed gradient and the gradient of the original image. Example applications of linear and non-linear local contrast enhancement and colour image daltonisation illustrate the behaviour of the method.

Traditional image steganography conceals secret messages into unprocessed natural images by modifying the pixel value, causing the obtained stego different from the original image in terms of statistical distribution, thereby could be detected by a well-trained classifier for steganalysis. To ensure the steganography is imperceptible and in line with the trend of art images produced by Artificial Intelligence Generated Content (AIGC) becoming popular in social networks, this paper proposes to embed hidden information throughout the process of the generation of an art-style image by designing an image style transformation neural network with steganography function. The proposed scheme takes a content image, an art-style image, and messages to be embedded as inputs, processing them with an encoder-decoder model, and finally generates a styled image containing the secret messages at the same time. An adversarial training technique is applied to enhance the imperceptibility of the generated art-styled stego image with from plain style-transferred images. The lack of the original cover image makes it difficult for the opponent learning a steganalyzer to identify the stego. The recommended approach can successfully withstand existing steganalysis techniques and attain the embedding capacity of 3 bits per pixel for a color image, according to experimental results.

Image encryption based on chaotic maps is an important way to ensure the secure communication of digital multimedia on the Internet. To improve the encryption performance and security of image encryption systems, a new image encryption algorithm is proposed by employing a compound chaotic map and random cyclic shift. Firstly, an improved Hybrid chaotic system is designed by coupling Logistic, ICMIC, Tent, and Chebyshev maps (HLITC). Comparison tests with previous chaotic maps in terms of chaotic trajectory, Lyapunov exponent, and Kolmogorov entropy illustrate the new hybrid chaotic map has better chaotic performance. Then the proposed HLITC chaotic system is used to develop a new chaotic image encryption scheme with the double cyclic shift. The improved HLITC chaotic system is performed to generate key sequences used in the image scrambling and diffusion stage. The spiral transformation controlled by chaotic sequence is used to scramble the pixels of the plaintext image, while the XOR operation based on a chaotic map is used for pixel diffusion. Extensive experiments of statistical analysis, key sensitivity, and keyspace analysis are conducted. Experimental results show the proposed encryption scheme has good robustness against brute force attacks, statistical attacks, and differential attacks, and is more effective than many existing chaotic image encryption algorithms.

This study has investigated the effect of nutrition labeling on consumer guilt, in situations where consumers ingest products that have an unhealthy image. The first investigation has examined the effects of types of nutrition labeling (adding healthy ingredients/reducing unhealthy ingredients). The second investigation has examined the influence of two goal-activation types(utilitarian and hedonic) and nutrition labeling on consumer guilt. The findings reveal that the utilitarian-goal-activation group felt less guilty about consuming a product with a reduced unhealthy ingredient than they did about consuming a product with an added healthy ingredient. In addition, there were interactions between the two variables, since consumer goal activation had more effect on consumer guilt about products with reduced unhealthy ingredients than on products with added healthy ingredients. Based on these results, the academic and practical implications of the present study are discussed. and proposes several directions for future research.

Image segmentation and classification still represent an active area of research since no universal solution can be identified. Established segmentation algorithms like thresholding are problem specific, treat well the easy cases and mostly relied on single parameter i.e intensity. Machine learning approaches offer alternatives where predefined features are combined into different classifiers. On the other hand, the outcome of machine learning is only as good as the underlying feature space. Differential geometry can substantially improve the outcome of machine learning since it can enrich the underlying feature space with new geometrical objects, called invariants. In this way, the geometrical features form a high-dimensional feature space for each pixel, where original objects can be resolved. Alternatives based on the geometry of the image scale-invariant interest points have been exploited successfully in the field of computer vision. Here, we integrate geometrical feature extraction based on signal processing, machine learning, and input relying on domain knowledge. The approach is exemplified on the ISBI 2012 image segmentation challenge data set. As a second application, we demonstrate powerful image classification functionality based on the same principles, which was applied to the HeLa and HEp-2 data sets. Obtained results demonstrate that feature space enrichment properly balanced with feature selection functionality can achieve performance comparable to deep learning approaches.

This article develops algorithms for the characterization and the visualization of micro-scale features by using a small number of sample points, and with a goal to mitigate for the measurement shortcomings which are often destructive or time consuming. We implement the algorithms to rapidly examine the microscopic features of a Microelectromechanical System (MEMS) surface. Such images are highly dense; therefore, traditional image processing techniques might be computationally expensive. The contribution of this research include first, we develop local and global algorithm based on modified Thin Plate Spline (TPS) model to reconstruct high resolution images of the micro-surface’s topography, and its derivatives by using low resolution images. Second, we obtain a bending energy algorithm from our modified TPS model, and use it to filter out image defects. Finally, we develop a computationally efficient Windowing technique, which combines TPS and Linear Sequential Estimation (LSE), to enhance the visualization of images. The Windowing technique allows rapid image reconstruction based on the reduction of inverse problem.

White matter hyperintensity (WMH) has been considered the primary biomarker from small-vessel cerebrovascular disease to Alzheimer’s disease (AD) and has been reported for its correlation of brain structural changes. To perform WMH related analysis with brain structure, both T1-weighted (T1w) and (Fluid Attenuated Inversion Recovery(FLAIR) are required. However, in a clinical situation, it is limited to obtain 3D T1w and FLAIR images simultaneously. Also, the most of brain segmentation technique supports 3D T1w only. Therefore, we introduced the semi-supervised learning method that can perform brain segmentation using FLAIR image only. Our method achieved a dice overlap score of 0.86 for brain tissue segmentation on FLAIR, with the relative volume difference between T1w and FLAIR segmentation under 4.8%, which is just as reliable as the segmentation done by its paired T1w image. We believe our semi-supervised learning method has a great potential to be used to other MRI sequences and provide encouragement to people who seek brain tissue segmentation from a non-T1w image.

In the last few decades, glaucoma became the second biggest leading cause of irreversible vision loss. Because of its asymptotic growth, it is not properly diagnosed until the relatively late stage. To stop the severe damage by glaucoma it is needed to detect glaucoma in its early stages. Surprisingly diabetes also be the greatest cause of glaucoma. In the modern era, artificial intelligence makes great progress in the medical image processing field. Image analysis based on machine learning gives a huge success in diagnosis glaucoma without any misdiagnosis. The aim of this proposed paper is to create an automated process that can detect glaucoma and diabetic retinopathy. Here various Machine Learning models are used and results of these methods are presented.

In the past few decades, the transmission of data over an unsecure channel resulted in an increased rate of hacking. Therefore, the requirement to make multimedia data more secure is increasing day by day. Numerous algorithms are developed to improve efficiency and robustness. In this article, a novel and secure image encryption algorithm is presented. It is based on a modified chaotic logistic map (CLM) that provides the advantage of having less computational time to encrypt an input image. The encryption algorithm is based on Shannon’s idea of using substitution-permutation and one-time-pad network to achieve ideal secrecy. The CLM is used for substitution and permutation to improve randomness and increase dependency on the encryption key. Various statistical tests are conducted, such as Key Space Analysis, Complexity Analysis, Sensitivity Analysis, Strict Avalanche Criteria (SAC), Histogram Analysis, Entropy Analysis, Mean of Absolute Deviation (MAD) Analysis, Correlation Analysis, Contrast Analysis, and Homogeneity to give a comparative analysis of the proposed algorithm and verify its security. As a result of various statistical tests, it is evident that the proposed algorithm is more efficient and robust as compared to previous ones.

Spectral image analysis has the potential to replace traditional approaches for assessing plant responses to different types of stress including herbicide, through non-destructive and high-throughput screening (HTS). Therefore, this study was conducted to develop a rapid bioassay method using a multi-well plate and spectral image analysis for diagnosis of herbicide activity and mode of action. Crabgrass (Digitaria ciliaris) as a model weed was cultivated in multi-well plates and subsequently treated with 6 herbicides with different modes of action when they reached the 1-leaf stage, using only a quarter of the recommended dose. To detect plant response to herbicides, plant spectral images were acquired after herbicide treatment using RGB, infrared (IR) thermal, and chlorophyll fluorescence (CF) sensors and analyzed for diagnosing herbicide efficacy and mode of action. Principal Component Analysis (PCA) using all spectral data successfully distinguished herbicides and clustered depending on their modes of action. The performed experiments have shown that the multi-well plate assay combined with spectral image analysis can be successfully applied for herbicide bioassay. In addition, the use of spectral image sensors, especially in CF image, would facilitate HTS by enabling rapid observation of herbicide response, as early as 3 hours after herbicide treatment.

Research on image-inpainting tasks has mainly focused on enhancing performance by augmenting various stages and modules. However, this trend does not consider the increase in the number of model parameters and operational memory, which increases the burden on computational resources. To solve this problem, we propose a Parametric Efficient Image InPainting Network (PEIPNet) for efficient and effective image-inpainting. Unlike other state-of-the-art methods, the proposed model has a one-stage inpainting framework in which depthwise and pointwise convolutions are adopted to reduce the number of parameters and computational costs. To generate semantically appealing results, we selected three unique components: spatially-adaptive denormalization (SPADE), dense dilated convolution module (DDCM), and efficient self-attention (ESA). The SPADE was adopted to conditionally normalize activations according to the mask to distinguish between damaged and undamaged regions. The DDCM was employed at every scale to overcome the gradient-vanishing obstacle and gradually fill-in pixels by capturing global information along the feature maps. The ESA was utilized to obtain clues from unmasked areas by extracting long-range information. In terms of efficiency, our model has the lowest operational memory compared with other state-of-the-art methods. Both qualitative and quantitative experiments demonstrate the generalized inpainting of our method on three public datasets: Paris StreetView, CelebA, and Places2.

Autonomous image recognition has numerous potential applications in the field of planetary science and geology. For instance, having the ability to classify images of rocks would allow geologists to have immediate feedback without having to bring back samples to the laboratory. Also, planetary rovers could classify rocks in remote places and even in other planets without needing human intervention. Shu et al. classified 9 different types of rock images using a Support Vector Machine (SVM) with the image features extracted autonomously. Through this method, the authors achieved a test accuracy of 96.71%. In this research, Convolutional Neural Networks(CNN) have been used to classify the same set of rock images. Results show that a 3-layer network obtains an average accuracy of 99.60% across 10 trials on the test set. A version of Self-taught Learning was also implemented to prove the generalizability of the features extracted by the CNN. Finally, one model has been chosen to be deployed on a mobile device to demonstrate practicality and portability. The deployed model achieves a perfect classification accuracy on the test set, while taking only 0.068 seconds to make a prediction, equivalent to about 14 frames per second.

As sustainability gains significance within Higher Education Institutions (HEIs) worldwide, the University of British Columbia (UBC) stands as one of the global champions of sustainability. In 2019, Times Higher Education ranked UBC as number one in the world for taking urgent action to combat climate change and its impacts and ranked one in Canada for making cities inclusive, safe, resilient, and sustainable. Over the years, UBC students have been instrumental to sustainability on the UBC campus by advocating for divestment, climate justice, and other sustainability commitments and projects in the university. Hence, this qualitative study examines students’ engagement with or their perception of the university’s sustainability programs and image. The study found that students acknowledged and commended the university’s sustainability efforts in teaching, research, providing sustainability-related opportunities for students, and in sustainability operations. However, students also addressed hesitation on the part of university administration in championing climate justice and bolder climate action. The conclusion is that continued support and engagement with students are critical for UBC to achieve its climate action plans and sustainability goals in general. The study contributes to the ongoing discourse on the influential role of young people and the youth climate movement in catalyzing ambitious global climate action at all levels.

Deep Learning is a recent and important addition to the computational toolbox available for image reconstruction in fluorescence microscopy. We review state-of-the-art applications such as image restoration, super-resolution, and light-field imaging, and discuss how the latest Deep Learning research can be applied to other image reconstruction tasks such as structured illumination, spectral deconvolution, and sample stabilisation. Despite its successes, Deep Learning also poses significant challenges, has often misunderstood capabilities, and overlooked limits. We will address key questions, such as: What are the challenges in obtaining training data? Can we discover structures not present in the training data? And, what is the danger of inferring unsubstantiated image details?

Hyperspectral images are an important tool to assess ecosystem biodiversity both on terrestrial and benthic habitats. To obtain more precise analysis of biodiversity indicators that agree with indicators obtained using field data, analysis of spectral diversity calculated from images have to be validated with field based diversity estimates. The plant species richness is one of the most important indicators of biodiversity. This indicator can be measured in hyperspectral images considering the Spectral Variation Hypothesis (SVH) which states that the spectral heterogeneity is related to spatial heterogeneity and thus to species richness. The goal of this research is to capture spectral heterogeneity from hyperspectral images for a terrestrial neo tropical forest site using Vector Quantization (VQ) method and then use the result for prediction of plant species richness. The results are compared with that of Hierarchical Agglomerative Clustering (HAC). The validation of the process index is done calculating the Pearson correlation coefficient between the Shannon entropy from actual field data and the Shannon entropy computed in the images. Terrestrial dry forest and marine coastal hyperspectral images with different resolutions have been used for spectral diversity feature validation.

An effective on-board cloud detection method in small satellites would greatly improve the downlink data transmission efficiency and reduce the memory cost. In this paper, an ensemble method combining a lightweight U-Net with wavelet image compression is proposed and evaluated. The red, green, blue and infrared waveband images from Landsat-8 dataset are trained and tested to estimate the performance of proposed method. The LeGall-5/3 wavelet transform is applied on the dataset to accelerate the neural network and improve the feasibility of on-board implement. The experiment results illustrate that the overall accuracy of the proposed model achieves 97.45% by utilizing only four bands. Tests on low coefficients of compressed dataset have shown that the overall accuracy of the proposed method is still higher than 95%, while its inference speed is accelerated to 0.055 second per million pixels and maximum memory cost reduces to 2Mb. By taking advantage of mature image compression system in small satellites, the proposed method provides a good possibility of on-board cloud detection based on deep learning.