Multispectral remote sensing data may contain component images which are heavily corrupted by noise and pre-filtering (denoising) procedure is often applied to enhance these component images. To do this, one can use reference images – component images having relatively high quality and which are similar to the image subject to pre-filtering. Here we study the following problems: how to select component images that can be used as references (e.g., for the Sentinel multispectral remote sensing data) and how to perform the actual denoising. We demonstrate that component images of the same resolution as well as component images of a better resolution can be used as references. Examples of denoising of real-life images demonstrate high efficiency of the proposed approach.

Αbstract: To date, countless satellite image fusions have been made, mainly with panchromatic spatial resolution to a multispectral image ratio of 1/4, fewer fusions with lower ratios, and relatively recently fusions with much higher spatial resolution ratios have been published. Apart from this, there is a small number of publications studying the fusion of aerial photographs with satellite images, with the year of image acquisition varying and the dates of acquisition not mentioned. In addition, in these publications, either no quantitative controls are performed on the composite images produced, or the aerial photographs are recent and colorful and only the RGB bands of the satellite images are used for data fusion purposes. The objective of this paper is the study of the addition of multispectral information from satellite images to black and white aerial photographs of the 80s decade (1980–1990) with small difference (just a few days) in their image acquisition date, the same year and season. Quantitative tests are performed in two case studies and the results are encouraging, as the accuracy of the classification of the features and objects of the Earth’s surface is improved and the automatic digital extraction of their form and shape from the archived aerial photographs is now allowed. This opens up a new field of use for the black and white aerial photographs and archived multispectral satellite images of the same period in a variety of applications, such as the temporal changes of cities, forests and archaeological sites.

Honey is a sweet substance extensively consumed in the world for its nutritional and healthy properties. However, residues of pesticides and environmental contaminants can compromise its quality. For this reason, the physicochemical parameters, and the organic contamination of monofloral and multifloral honeys from three regions of Algeria (Tiaret, Laghouat and Tindouf) were monitored to evaluate the quality of honey and the safety for consumers. In general, the results obtained from the physicochemical analyses were in line with the EU standards. In terms of contamination, pesticides authorised and used in Algerian agriculture (matalaxyl-M and cyromazine), as well as banned pesticide (carbaryl), were found in almost all the samples. However, only the concentration of cyromazine was higher than the relative EU maximum residue levels. PCB 180, PCB 189, anthracene, fluorene and phenanthrene were mainly detected. All the honeys show traces of DiBP, DBP, DEHP and DEHT, but no traces of bisphenols were found. Moreover, the dietary exposure assessment shows that a small amount of Algerian honey can be safely consumed. Overall, data from this study should motivate the Algerian government to enhance their monitoring activities in beekeeping and to find solutions for implementing more sustainable agricultural practices harmonizing with the international legislation.

One of the tools for optimal crop production is regular monitoring and assessment of crops. During the growing season of fruit trees, the bloom period has increased photosynthetic rates that correlate with the fruiting process. This paper presents the development of an image processing algorithm to detect peach blossoms on trees. Images of an experimental peach orchard were acquired from the Parma Research and Extension Center of the University of Idaho using an off-the-shelf unmanned aerial system (UAS), equipped with a multispectral camera (Near-infrared, Green, Blue). The orchard has different stone fruit varieties and different plant training system. Individual tree images (high-resolution) and arrays of trees images (low-resolution) were acquired to evaluate the detection capability. The image processing algorithm was based on different vegetation indices. Initial results showed that the image processing algorithm could detect peach blossoms and demonstrate good potential as a monitoring tool for orchard management.

Here, we report the prediction of vegetative stages variables of canary bean crop by means of RGB and multispectral images obtained from UAV during the ripening stage, correlating the vegetation indices with biometric variables measured manually in the field. Results indicated a highly significant correlation of plant height with eight RGB image vegetation indices for the canary bean crop, which were used for predictive models, obtaining a maximum correlation of R2 = 0.79. On the other hand, the estimated indices of multispectral images did not show significant correlations.

Abstract: Early assessment of crop development is a key aspect of precision agriculture. Shortening the time of response before a deficit of irrigation, nutrients and damage by diseases is one of the usual concerns in agriculture. Early prediction of crop yields can increase profitability in the farmer's economy. In this study we aimed to predict the yield of four maize commercial hybrids (Dekalb7508, Advanta9313, MH_INIA619 and Exp_05PMLM) using remotely sensed spectral vegetation indices (VI). A total of 10 VI (NDVI, GNDVI, GCI, RVI, NDRE, CIRE, CVI, MCARI, SAVI, and CCCI) were considered for evaluating crop yield and plant cover at 31, 39, 42, 46 and 51 days after sowing (DAS). A multivariate analysis was applied using principal component analysis (PCA), linear regression, and r-Pearson correlation. In the present study, highly significant correlations were found between plant cover with VIs at 46 (GNDVI, GCI, RVI, NDRE, CIRE and CCCI) and 51 DAS (GNDVI, GCI, NDRE, CIRE, CVI, MCARI and CCCI). The PCA indicated a clear discrimination of the dates evaluated with VIs at 31, 39 and 51 DAS. The inclusion of the CIRE and NDRE in the prediction model contributed to estimate the performance, showing greater precision at 51 DAS. The use of RPAS to monitor crops allows optimizing resources and helps in making timely decisions in agriculture in Peru.

This study explores novel techniques to improve the detection accuracy of skarn iron deposits using advanced image processing methodologies. Leveraging the capabilities of Aster image, Band Ratio (BR) images, and Principal Component Analysis (PCA), alongside the power of 3D Convolutional Neural Networks (3D-CNN), the research aims to enhance the precision and efficiency of ore detection in complex geological environments. The proposed method employs a specific 3D-CNN architecture, accepting input as a 7×7×C image patch, where C represents the combined number of selected Aster image bands, Principal Component (PC) bands, and computed BR images. To evaluate the accuracy of the proposed method, five distinct image bands combinations, including the proposed bands combination, were tested and evaluated based on the overall accuracy (OA), average accuracy (AA), and kappa coefficient. The results demonstrated that while the incorporation of BR images alongside Aster bands initially seemed promising, it introduced significant confusion in certain classifications, leading to unexpected mis-classification rates. Surprisingly, utilizing solely Aster bands as input parameters yielded higher accuracy rates (OA= 93.13%, AA = 91.96%, Kappa = 90.91%) compared to scenarios involving the integration with band ratios (OA = 87.02%, AA = 79.15, and Kappa = 82.60%) or the integration of BR images to PC bands (OA= 87.78%, AA = 82.39%, Kappa = 83.81%). However, the amalgamation of Aster bands with selected PC bands showed slight improvements in accuracy (OA= 94.65%, AA = 92.93%, Kappa = 93.45%), although challenges in accurately classifying certain features persisted. Ultimately, the proposed combination of Aster bands, PC bands, and BR images (proposed bands combination) presented the most visually appealing and statistically accurate results (OA = 96.95%, AA= 94.87%, and Kappa = 95.93%), effectively addressing misclassifications observed in the other combinations. These findings underscore the synergistic contributions of each of the Aster bands, PC bands, and BR images, with Aster bands proving pivotal for optimal skarn classification, PC bands enhancing intrusions classification accuracy, and BR images strengthening wall rock classification accuracy. In conclusion, the proposed combination of input image bands emerges as a robust and comprehensive methodology, demonstrating unparalleled accuracy in the remote sensing detection of skarn iron minerals.

Understanding the distribution of rock glaciers provides key information for investigating and recognizing the status and changes of the periglacial environment. Deep learning algorithms and red-green-blue (RGB) bands from high-resolution satellite images have been extensively employed to map rock glaciers. However, the near-infrared (NIR) band offers rich spectral information and sharp edge features that could significantly contribute to semantic segmentation tasks, but it is rarely utilized in constructing rock glacier identification models due to the limitation of three input bands for classical semantic segmentation networks, like DeeplabV3+. In this study, a dual-encoder DeeplabV3+ network (DEDNet) was designed to overcome the flaws of classical DeeplabV3+ network (CDNet) when identifying rock glaciers using multispectral remote sensing images by extracting spatial and spectral features from RGB and NIR bands, respectively. This network, trained with manually labeled rock glacier samples from QiLian Mountains, established a model with accuracy, precision, recall, specificity, and mIoU (Mean Intersection over Union) of 0.9131, 0.9130, 0.9270, 0.9195, and 0.8601, respectively. The well-trained model was applied to identify new rock glaciers in a test region, achieving a producer's accuracy of 93.68% and a user's accuracy of 94.18%. Furthermore, the model was employed to two study areas in northern Tien Shan (Kazakhstan) and Daxue Shan (Hengduan Shan, China) with high accuracy, which proved that the DEDNet offers an innovative solution to more accurately map rock glaciers on a larger scale due to its robustness across diverse geographic regions.

Carotid atherosclerotic lesions are a major cause of cerebrovascular disease (CVD). Identification and quantification of carotid plaques are important for categorizing the vulnerability of plaques for rupture and assessing the impact of treatments. The irregularity of plaque surface is associated with previous plaque rupture and plays an important role in the risk of stroke. Thus, the aim of this study is to develop and validate novel vulnerability biomarkers from three-dimensional ultrasound (3DUS) images by analyzing the surface morphological characterization of carotid plaque using fractal geometry features. 3D box-counting and 3D blanket are the two types of 3D fractal dimension that were employed to describe the smoothness of plaques. This fractal dimension analysis tool was used to evaluate the effect of atorvastatin using 3DUS carotid images, which were acquired from 6 patients treated with atorvastatin with 80 mg daily and 5 patients with placebo. The Student's T Test results showed that those two fractal features were effective for detecting the statin-related changes in carotid atherosclerosis with p<0.0068 and p<0.015 respectively, suggesting that 3D fractal dimension measurements can be used effectively to analyze the surface characteristics of carotid plaques, especially for evaluating the impact of the treatment.

Cloud-induced atmospheric extinction and occlusion have a major effect on the effectiveness and quality of telescope observations. Real-time cloud cover distribution and long-term statistical data are essential for astronomical siting and telescope operations. At ground-based astronomical telescope sites, cloud cover distribution is currently analyzed using manual observation methods. However, the main disadvantages of manual observation methods are human subjective, heavy workloads and poor real-time performance. Therefore, a real-time automatic cloud images classification method is desperately needed. This paper presents a new cloud identification method, which is named PSO+XGBoost model by combining eXtreme Gradient Boosting (XGBoost) and Particle Swarm Optimization (PSO). The entire cloud image is divided into 37 sub-regions in order to more precisely identify the distribution of the clouds. 19 features are then extracted, including the sky background, star density, lighting conditions, and subregion grayscale values. The experimental results have shown that the overall classification accuracy of 96.91% and our model is able to outperform several state-of-the-art baseline methods. Our approach achieves high accuracy in comparison with the manual observation methods. Moreover, this method meets telescope real-time scheduling requirements.

ABSTRACT Purpose: Tongue image analysis for disease diagnosis is an ancient traditional non-invasive diagnosis technique widely used by traditional medicine practitioners. Deep Learning based multi-label disease detection models offer tremendous potential to clinical decision support systems, by facilitating preliminary diagnosis. Methods: In this work, we propose a multi-label disease detection pipeline, where in observation and analysis of tongue images captured and received via smartphones assist in predicting the health status of an individual. All images are voluntarily given by subjects consulting collaborating physicians. Images thus acquired are first and foremost classified either into a diseased or a normal category by a 5-fold cross-validation algorithm using a convolution neural network (MobileNetV2) model for binary classification. Once the diseased label is predicted, the image is used to diagnose multiple diseases using the prediction algorithm based on DenseNet121. Results: Average accuracy of 93 % was achieved in classifying diseased from normal healthy tongue by detection model with MobileNetV2 architecture. Multilabel disease classification produced more than 90% accurate results for the seven class labels considered. Conclusion: AI based image analysis shows promising results and an extensive dataset could provide further improvements to this approach. Rather than employing high-cost sophisticated image capturing setup, experimenting with smartphone images opens opportunity to provide preliminary health status to individuals on smartphone prior to further line of treatment and diagnosis.

YOLOv8, as an efficient object detection method, can swiftly and precisely identify objects within images. However, traditional algorithms encounter difficulties when detecting small targets in remote sensing images, such as missing information, background noise, and interactions among multiple objects in complex scenes, which may affect performance. To tackle these challenges, we propose an enhanced algorithm optimized for detecting small objects in remote sensing images, named HP-YOLOv8. Firstly, we design the C2f-D-Mixer (C2f-DM) module as a replacement for the original C2f module. This module integrates both local and global information, significantly improving the ability to detect features of small objects. Secondly, we introduce a feature fusion technique based on attention mechanisms, named Bi-Level Routing Attention in Gated Feature Pyramid Network (BGFPN). This technique utilizes an efficient feature aggregation network and reparameterization technology to optimize information interaction between different scale feature maps, and through the Bi-level Routing Attention (BRA) mechanism, it effectively captures critical feature information of small target objects. Finally, we propose the Smooth Mean Perpendicular Distance Intersection over Union (SMPDIoU) loss function. The method comprehensively considers the shape and size of detection boxes, enhances the model's focus on the attributes of detection boxes and provides a more accurate bounding box regression loss calculation method. To demonstrate our approach's efficacy, we conduct comprehensive experiments across the RSOD, NWPU VHR-10, and VisDrone2019 datasets. The experimental results show that the HP-YOLOv8 achieves 95.11%, 93.05%, and 53.49% in the [email protected] metric, and 72.03%, 65.37%, and 38.91% in the more stringent [email protected]:0.95 metric, respectively.

In the present work, a portable device system applied in the detection and classification of different metallic ions was proposed and developed, aiming at its application in the monitoring of hydrological systems like rivers, lakes and groundwater. Considering the system features, a portable colorimetric system was developed by using a multispectral optoelectronic sensor. All the technology of quantification and classification of metallic ions using Optoelectronic Multispectral sensors was fully integrated in the embedded hardware FPGA technology and software based on virtual Instrumentation (NI LabView ®). The system was used as a colorimeter by using the chromogen reagent of 1-(2-pyridylazo)-2-naphthol (PAN) as an indicator and the results obtained together with the signal processing and pattern analysis using the method of the linear discriminant analysis, allowed to obtain excellent results in detection and classification of Pb(II), Cd(II), Zn(II), Cu(II), Fe(III) and Ni(II) ions, with almost the same level of performance in relation to those obtained from the UV-VIS spectrometers of high spectral resolution.

Optical tissue imaging has several advantages over the routine clinical imaging methods, including non-invasiveness (does not change the structure of tissues), remote operation (avoids infection) and ability to quantify the tissue condition by means of specific image parameters. Dermatologists and other skin experts need compact (preferably pocket-size), self-sustained and easy-to-use imaging devices. The operational principles and designs of ten portable in-vivo skin imaging prototypes developed at the Biophotonics Laboratory of Institute of Atomic Physics and Spectroscopy, University of Latvia during the recent five years are presented in this paper. Four groups of imaging devices are considered. Multi-spectral imagers offer possibilities for distant mapping of specific skin parameters, so facilitating better diagnostics of skin malformations. Autofluorescence intensity and photobleaching rate imagers show a promising potential for skin tumor identification and margin delineation. Photoplethysmography video-imagers ensure remote detection of cutaneous blood pulsations and can provide real-time information on cardiovascular parameters and anesthesia efficiency. Multimodal skin imagers perform several of the above-mentioned functions by taking a number of spectral and video images with the same image sensor. Design details of the developed prototypes and results of clinical tests illustrating their functionality are presented and discussed.

Image stitching is a crucial aspect of image processing. However, factors like perspective and environment often lead to irregular shapes in stitched images. Cropping or completion methods typically result in substantial loss of information. This paper proposes a method for rectifying irregularly images into rectangles using deformable meshes and residual networks. The method utilizes a convolutional neural network to quantify rigid structures of images. Choosing the most suitable mesh structure based on the extraction results, offering options such as triangular, rectangular, and hexagonal. Subsequently, the irregularly image, predefined mesh structure, and predicted mesh structure are input into a wide residual neural network for regression. The loss function comprises local and global, aimed at minimizing the loss of image information within the mesh and global target. This method not only significantly reduces information loss during rectification but also adapting to different images with various rigid structures. Validation on the DIR-D dataset shows this method outperforms state-of-the-art methods in image rectification.

Pavement crack detection is one of the key links in highway pavement maintenance management. In the current road crack detection, the network model easily ignores the shallow geometric features of cracks and cannot extract the key feature information of cracks. Aiming at the above problems, an EC-YOLOX network model is proposed. The CFPN is constructed to cross-fuse different scale features to solve the feature scale invariance. In the strengthen feature extraction layer, ECANet is fused to enhance the ability to pay attention to key information. The WEIoU loss function is proposed, which assigns different penalty terms to the target box in the vertical and horizontal directions. In terms of data, geometric distortion constraint correction is performed on the single-point perspective pavement image. The experimental data show that the accuracy of EC-YOLOX on the self-built data set reaches 76.34% [email protected], which is 4.45% higher than that of YOLOX. The loss curve of EC-YOLOX is smoother than that of YOLOX, and the minimum training loss value is 2.136, which is 0.648 lower than the minimum loss value 2.784 of YOLOX. Many experiments have verified the effectiveness of EC-YOLOX in improving the detection effect in pavement crack detection.

Transcatheter Aortic Valve Implantation (TAVI) now represents the mainstay in the treatment of severe aortic stenosis. Owing to its exceptional procedural efficacy and safety, TAVI has been extended to include patients at lower surgical risk, thus now encompassing a diverse patient population receiving this treatment. Yet, long-term outcomes also depend on optimal medical therapy for secondary vascular prevention, with antithrombotic therapy serving as a cornerstone. Leveraging data from multiple randomized controlled trials, current guidelines generally recommend single antithrombotic therapy, with either single antiplatelet therapy (SAPT) or oral anticoagulation (OAC) alone in those patients without, or with atrial fibrillation respectively. Yet, individualization of this pattern, as well as specific case uses, may be needed based on individual-patient characteristics and concurrent procedures. This review aims to discuss the evidence supporting antithrombotic treatments in patients treated with TAVI, indications for a standardized treatment, as well as specific considerations for an individualized approach to treatment.

Many have speculated that events of personal and financial loss in Rembrandt’s life caused depression and that this is revealed by examination of his self-portraits particularly those painted in old age. Some report detecting various physiological diseases associated with aging, including vision impairment, which may have affected his mood and work. Aging and neurodegenerative disease which often accompanies it, are both associated with depression. Recent advances in imaging and computer technology make it possible to empirically examine changes in artistic style which can contribute to understanding artists’ physical and mental health. In the current study changes in contrast, colour and fractal dimension were measured in the entire corpus of Rembrandt’s painted self-portraits and portraits to determine whether changes in style indicate depression or disease. Productivity was also examined as an indirect indicator. Given the high salience attributed to self-images, it also examined whether differences in style could be detected between self-portraits and portraits of related and unrelated others. The results indicate that it is unlikely that Rembrandt suffered from unipolar or bipolar depression, age-related cognitive decline, or neurodegenerative disease. The data are consistent with someone experiencing episodes of low mood consistent with normal grieving and adversity followed by resilient recovery. There is evidence of a gradient in saliency and complexity between self-portraits and related and unrelated portraits, of a less formal style in portraits of related others and of a ‘late’ style identified by leading art historians consistent with macular degeneration. The results are also consistent with an association of aesthetic preference with mid-level fractal values tending towards the Golden Mean long associated with beauty in nature and in art.

Comprehensive understanding of tree characteristics and conditions holds paramount importance for the precise management of hazelnut orchards. It facilitates the determination of tree vigor, pruning requirements, phytosanitary interventions, and plant water consumption. The primary objective of this study was to explore, for the first time on a fruit tree with a bushy structure and across trees of four Italian distinct hazelnut cultivars, the efficacy of multispectral and thermal UAV (Unmanned Aerial Vehicle) technologies in assessing canopy attributes, vegetative growth, and predicting abiotic stresses. These technologies serve as tools for precision agriculture, enabling the computation of various indices such as the Normalized Difference Vegetation Index (NDVI) and crop water stress index (CWSI). The study of water content is of particular importance at this time, especially considering the increasing water stress levels in Europe as well as globally. While Red Green Blue (RGB) and thermal imagery collectively demonstrated superior performance in model reconstruction, the multispectral UAV remained more adept at characterizing size traits of hazelnut plants. Thermal images alone proved inadequate for accurately reconstructing hazelnut biometric characteristics. Furthermore, all indices were found to be cultivar-specific, underscoring the importance of conducting studies across different cultivars. The utilization of two UAVs, namely multispectral and thermal, facilitated the examination of the relationship between NDVI and CWSI across tree species.

This paper investigated building data from multispectral and single-photon Lidar systems. The multispectral datasets from the individual channels and fused channels were explored. The multispectral and single-photon Lidar data were compared across multiple aspects: the data acquisition geometry, number of echoes, intensity, density, resolution, data defects, noise level, and the absolute and relative accuracy. In addition, we explored the performance of the multispectral and single-photon data for roof plane detection for eight complex/stylish buildings to investigate the suitability of these data for 3D building reconstruction. The building data from the single-photon and multispectral Lidar systems were evaluated with respect to the reference building vector data with an accuracy of better than 5 cm. The advantages and disadvantages of both technologies and their applications in the urban building environment are discussed.

Mapping short-term wetland vegetation and water storage changes is valuable for monitoring the biogeochemical processes of wetland systems. Old Woman Creek National Estuarine Research Reserve is a dynamic freshwater estuary that experiences intermittent changes in water level over the course of a year. Small unmanned aerial systems (sUAS) are useful tools in monitoring changes as they are rapidly deployed, repeatable, and high-resolution. In this study, commercial quadcopters were paired with a red/green/near-infrared MAPIR Survey 3W camera to produce normalized difference vegetation index (NDVI) and normalized difference water index (NDWI) maps to observe short-term changes at OWC. Orthomosaics were produced for flights on 8 days throughout 2018 and early 2019. The orthomosaics were calibrated to bottom-of-atmosphere reflectance using the Empirical Line Correction method and NDVI and NDWI maps were created. The NDVI pixel values were used to generate maps of vegetation extent showing density changes over time. Identifying dominant vegetation in these maps allowed for the application of the National Estuarine Reserve System (NERRS) Classification Codes to zones of interest. NDWI provided water extent at different water levels and when paired with LiDAR and bathymetric data yielded water volume and residence time estimates. The produced maps contribute to the overall understanding of habitats affected by water inundation variations.

Balsam fir trees are a specialty agricultural species that are largely used as Christmas trees. Soil or tissue sampling is seldom performed to assess balsam fir nutrition needs, which can contribute to over or under fertilization and subsequent environmental challenges. Remote sensing to determine the normalized difference vegetation index (NDVI) has had strong relationships with nutrition in other plants. This research aimed to determine whether there is a relationship between NDVI and nutrition in balsam fir. A random sample of 45 trees was selected in autumn of 2021 and then another 70 trees selected in spring of 2022. Soil and needle tissue samples were analyzed for N, P, K, Ca, Mg, S, Fe, Zn, Mn, B, and Cu. An uncrewed aerial vehicle equipped with a multispectral camera was flown over the orchard to determine the NDVI for each tree. Nutrition and NDVI were analyzed for correlations through all sampled trees. Separate correlation analyses were repeated for mature trees (greater than 5 years old) and young trees (less than 5 years old). Soil nutrients N, P, K had a significant relationship with NDVI in autumn sampling. Only N was correlated consistently in both autumn and spring, with R2 of 37% and 33% respectively. Relationships were much stronger when only mature trees were considered, increasing to 60% and 51% respectively. NDVI was found to offer predictive power for tissue N that can be useful to producers to help optimize fertilizer input. However, further work is needed to refine these relationships.

Multispectral image (MSI) and hyperspectral image (HSI) fusion (MHIF) aims to address the challenge of acquiring high-resolution (HR) HSI images. This field combines a low-resolution (LR) HSI with an HR-MSI to reconstruct HR-HSI. Existing methods directly utilize transformers to perform feature extraction and fusion. Despite the demonstrated success, there exist two limitations: 1) Employing the entire transformer model for feature extraction and fusion fails to fully harness the transformer’s potential in integrating the spectral of the HSI and spatial information of the MSI. 2) HSI has a strong spectral correlation and exhibits sparsity in the spatial domain. Existing transformer-based models do not optimize this physical property, which makes their methods prone to spectral distortion. To accomplish these issues, this paper introduces a novel framework for MHIF called Sparse Mix-Attention Transformer (SAMformer). Specifically, to fully harness the advantages of the Transformer architecture, we propose a Spectral Mix Attention Block (SMAB), which concatenates the keys and values extracted from LR-HSI and HR-MSI to create a new multi-head attention module. This design facilitates the extraction of detailed long-range information across spatial and spectral dimensions. Besides, to address the spatial sparsity inherent in HSI, we incorporated a sparse mechanism within the core of SMAB called Sparse Spectral Mix Attention Block (SSMAB). In the SSMAB, we compute attention maps from queries and keys and select the K highly correlated values as the sparse attention map. This approach enables us to achieve a sparse representation of spatial information while eliminating spatially disruptive noise. Extensive experiments conducted on three benchmark datasets, namely Cave, Harvard, and Pavia Center, demonstrate the SMAformer method outperforms state-of-the-art methods.

With the rapid developments that have been made in computer vision and computer technology, semantic segmentation of high-resolution images has emerged as a mainstream and challenging task. The, segmentation of water areas remains a complex task due to the similar features between water areas or between water areas and other land objects. Meanwhile, since coastlines and riverbanks are typically presented in irregular shapes, it is difficult to obtain the categories of pixels at boundaries. This paper proposed the use of a Water-Land Boundary Attention Network (WLBANet) to improve the accuracy of pixels at boundaries between water and land. This network also reinforced the performance of contextual information extraction into distinguishing between water areas and other land objects. To prove the validity of this proposed network, WLBANet was performed on the Water Land Dataset (WLD), which is also by this paper, and which contains water areas and other land objects categories. The results demonstrates that the proposed method has significant effectiveness.

Fluorescence microscopic images of cells contain a large number of morphological features that are used as an unbiased source of quantitative information about cell status, through which researchers can extract quantitative information about cells and study the biological phenomena of cells through statistical and analytical analysis. As an important research object of phenotypic analysis, images have a great influence on the research results. Saturation artifacts present in the image result in a loss of grayscale information that does not reveal the true value of fluorescence intensity. From the perspective of data post-processing, we propose a two-stage cell image recovery model based on generative adversarial network to solve the problem of phenotypic feature loss caused by saturation artifacts. The model is capable of restoring large areas of missing phenotypic features. In the experiment, we adopt the strategy of progressive restore to improve the robustness of the training effect, and add the contextual attention structure to enhance the stability of the restore effect. We hope to use deep learning methods to mitigate the effects of saturation artifacts to reveal how chemical, genetic, and environmental factors affect cell state, providing an effective tool for studying the field of biological variability and improving image quality in analysis.

This research delves into the intricate challenges confronting the agricultural sector, with a specialized focus on mitigating infections in tomato crops, particularly powdery mildew induced by the Leveillula Taurica pathogen. Tomatoes, renowned for their nutritional richness, are vital to global food security. However, conventional methodologies for disease detection exhibit both laborious processes and limited accuracy. In response to these challenges, this study advocates for an innovative fusion of hyperspectral imaging and deep learning methodologies to detect crop disease and its severity. The systematic workflow commenced with the curation of a dataset, involving the acquisition of live images through OpenCV, followed by conversion to RGB format and subsequent feature extraction utilizing a pre-trained visual geometry group (VGG-16) model for enhanced analysis. Sequentially, RGB images were transformed into simulated hyperspectral images (SHSI) leveraging a Neural Network generator model, offering a distinctive viewpoint on spectral information. This novel approach transcends conventional constraints by delivering a three-dimensional perspective, seamlessly integrating spatial and spectral dimensions for holistic data acquisition. The SHSI is further transmuted into a 3D visualization cube comprehensive grasp of spatial and spectral aspects encompassing spectral, spatial, and Haralick features. The research concludes with severity detection, categorized as low, moderate, or high, employing a Gaussian Mixture Model (GMM) and K-means for visualization.

Reservoirs created by damming rivers significantly modify the environment and problems may arise: the storage of nutrients and organic matter in reservoirs often leads to decreased water quality due to eutrophication. Reservoirs built on lowland rivers are exposed to significant nutrient loads, often leading to eutrophication. In this article, the Sulejów Reservoir, in Central Poland, was the subject of the research, which focused on the use of Sentinel-2 remote sensing data to detect phytoplankton blooms, and on understanding the pattern of wind-driven surface currents using the CCHE2D model (a depth-averaged hydrodynamic model). The calculation of the total phosphorus load has shown that the reservoir mainly acts as nutrient storage. Still, during the low flow and intensive phytoplankton bloom, it can be a source of nutrients. The distribution of phytoplankton bloom on the Sulejów Reservoir was documented using eight Sentinel-2 satellite images from the vegetation season of 2020 and the Normalized Difference Chlorophyll Index (NDCl). Coupling remote sensing data and numerical modelling helps to interpret the hydrodynamic model results and understand nutrients and sediment dynamics within the reservoir. Hydrodynamic modelling combined with remote sensing data can be a valuable tool for selecting appropriate locations for water quality measurements at monitoring stations.

Catastrophic mass flows originating from the high mountain cryosphere often cause hazard cascades. With increasing human activities in the alpine region and the sensitivity of glaciers, snow and permafrost to climate warming, the cryospheric hazard risks tend to be more active in the Tibetan Plateau(TP). The remoteness and inaccessibility of high mountain regions make the remote sensing technology the most effective approach for monitoring and investigating the cryospheric hazards. Exploring the evolution process and impact of ice avalanches and subsequent hazards are crucial to understand drivers and nature of mass flow process chain in order to prevent and mitigate potential hazard consequences. In this study, the glacier and ice-rock avalanches occurred in Arutso and Sedongpu basins in Tibet were investigated on the basis of Sentinel-2 time-series images and in-situ investigation, the evolution process of these events were reconstructed, and impacts and driving factors were analyzed. The massive Chamoli rock-ice avalanche occurred in February 2021 in the western Himalayas was also reviewed using using same methods. The study shows that Arutso glacier No. 53 (Arutso-53) avalanche completely melted away in July 2018 after two years from occurrence to final disappearance, while Arutso glacier No. 50 (Arutso-50) avalanche completely melted by the end of August 2023 after lasting for seven years. Four large-scale ice-rock avalanche and debris flow events in the Sedongpu basin in 2017 and 2018 not only had significant impacts on the river flow, landscape and geomorphologic shape in the basin, but also caused serious disasters in the basin and downstream. In March 2021, a small-scale ice-rock avalanche and debris flow event occurred again in the Sedongpu basin. The glacier and ice-rock avalanches occurred in Tibet area were mainly induced by climate warming, heavy precipitation and seismic activity, which acting on specific topographic and geomorphic structure of glacier properties in the high mountain regions. Catastrophic hazard events originating from the high-elevation glacier and ice-rock collapses in the mountain cryosphere and subsequent hazard cascades in the TP and Himalayas highlight the importance of mountain hazard monitoring, early warning systems and sustainable mountain development.

The application of artificial intelligence to point-of-care testing (POCT) disease detection has become a hot research field, in which breath detection which detects the patient's exhaled VOCs combined with sensor arrays of Convolutional Neural Network (CNN) algorithms as a new lung cancer detection is attracting more researchers' attention. However, due to low accuracy, high complexity computation and large number of parameters make the CNN algorithms difficult transplant to the embedded system of POCT devices. A lightweight neural network (LTNet) in this work is proposed to deal with this problem, and meanwhile, achieve high-precision classification of acetone and ethanol gases, which are respiratory markers for lung cancer patients. Compared to currently popular lightweight CNN models such as EfficientNet, LTNet has fewer parameters (32K) and its training weight size is only 0.155 MB. LTNet achieved an overall classification accuracy of 99.06% and 99.14% in the own mixed gas dataset and the University of California (UCI) dataset, which are both higher than that of the five existing models’, and it also offers the shortest training (844.38s and 584.67s) and inference time (23s and 14s) in the same validation set. Compared to the existing CNN models, LTNet is more suitable for resource-limited POCT devices.

A multispectral superconducting nanowire single photon detector sensitive to different incident photon wavelength bands, is proposed. The SNSPD consists of a Distributed Bragg Reflector, a gold mirror, and two regions employing four NbN nanowires. Using the DBR both as a filter and a reflector, two distinct detection bands are created. The first detection band has a peak absorbance of > 0.75 at a wavelength of 1143 nm, while the second band has an absorbance of > 0.70 in the wavelength range 1440 to 2000 nm. The design of the device can be tuned to provide sensitivity in different wavelength bands. While SNSPDs do not typically provide photon wavelength sensitivity, the band-selection design proposed in this work opens up potential applications for future quantum communication technology.

Oil spills from offshore drilling and coastal refineries often cause degradation of coastal wetlands that can take a long time to recover. Early oil detection may prevent losses and speed up recovery if monitoring of the initial oil extent, oil impact, and recovery are in place. Satellite imagery data can provide a cost-effective alternative to expensive airborne imagery or labor intensive field campaigns for monitoring effects of oil spills on wetlands. However, these satellite data may be restricted in their ability to detect and map ecosystem recovery post-spill given their spectral measurement properties and temporal frequency. In this study, we assessed whether spatial and spectral resolution, and other sensor characteristics influence the ability to detect and map vegetation stress and die-off due to oil. We compared how well three satellite multispectral sensors: WorldView2, RapidEye and Landsat EMT+, match the ability of the airborne hyperspectral AVIRIS sensor to map oil-induced vegetation stress, recovery, and die-off after the DeepWater Horizon oil spill in the Gulf of Mexico in 2010. We found that finer spatial resolution (3.5m) provided better delineation of the oil-impacted wetlands and better detection of vegetation stress along oiled shorelines in saltmarsh wetland ecosystems. As spatial resolution become coarser (3.5m to 30m) the ability to accurately detect and map stressed vegetation decreased. Spectral resolution did improve the detection and mapping of oil-impacted wetlands but less strongly than spatial resolution, suggesting that broad-band data may be sufficient to detect and map oil-impacted wetlands. AVIRIS narrow-band data performs better detecting vegetation stress, followed by WorldView2, RapidEye and then Landsat 15m (pan sharpened) data. Higher quality sensor optics and higher signal-to-noise ratio (SNR) may also improve detection and mapping of oil-impacted wetlands; we found that resampled coarser resolution AVIRIS data with higher SNR performed better than either of the three satellite sensors. The ability to acquire imagery during certain times (midday, low tide, etc.) or a certain date is also important in these tidal wetlands; WorldView2 imagery captured at high-tide detected a narrower band of shoreline affected by oil likely because some of the impacted wetland was below the tideline. These results suggest that while multispectral data may be sufficient for detecting the extent of oil-impacted wetlands, high spectral and spatial resolution, high-quality sensor characteristics, and the ability to control time of image acquisition may improve assessment and monitoring of vegetation stress and recovery post oil spills.

Surface water distribution extracted from remote sensing data has been used in water resource assessment, coastal management, and environmental change studies. Traditional manual methods for extracting water bodies cannot satisfy the requirements for mass processing of remote sensing data; therefore, accurate automated extraction of such water bodies has remained a challenge. The histogram bimodal method (HBM) is a frequently used objective tool for threshold selection in image segmentation. The threshold is determined by seeking twin peaks, and the valley values between them; however, automatically calculating the threshold is difficult because complex surfaces and image noise which lead to not perfect twin peaks (single or multiple peaks). We developed an operational automated water extraction method, the modified histogram bimodal method (MHBM). The MHBM defines the threshold range of water extraction through mass static data; therefore, it does not require the identification of twin histogram peaks. It then seeks the minimum values in the threshold range to achieve automated threshold. We calibrated the MHBM for many lakes in China using Landsat 8 Operational Land Imager (OLI) images, for which the relative error (RE) and squared correlation coefficient (R2) for threshold accuracy were found to be 2.1% and 0.96, respectively. The RE and root-mean-square error (RMSE) for the area accuracy of MHBM were 0.59% and 7.4 km2. The results show that the MHBM could easily be applied to mass time-series remote sensing data to calculate water thresholds within water index images and successfully extract the spatial distribution of large water bodies automatically.

For multi-sensor integrated systems, such as a mobile mapping system (MMS), data fusion at sensor-level, i.e., the 2D-3D registration between optical camera and LiDAR, is a prerequisite for higher level fusion and further applications. This paper proposes a line-based registration method for panoramic images and LiDAR point cloud collected by a MMS. We first introduce the system configuration and specification, including the coordinate systems of the MMS, the 3D LiDAR scanners, and the two panoramic camera models. We then establish the line-based transformation model for panoramic camera. Finally, the proposed registration method is evaluated for two types of camera models by visual inspection and quantitative comparison. The results demonstrate that the line-based registration method can significantly improve the alignment of the panoramic image and LiDAR datasets under either the ideal spherical or the rigorous panoramic camera model, though the latter is more reliable.

India ranks among the top ten nations in the world for grape production. Fungal pathogens inflict damage to crop plants in turn making cultivators bear huge economical losses. With an output of 1.21 million tons (about 2% of 57.40 million tons produced globally). 1.2% of the nation’s total fruit cropland is covered by grapes. But due to fungal diseases the effect of the yield produced ranges from 5-80% depending on the severity of diseases which will affect the yield of grape vineyard. In precision agriculture, new sensing technologies and artificial intelligence could be used to automatically identify grapevine and disease pest symptoms. Traditional manual disease-monitoring methods are inefficient, labor-intensive, and ineffective. Timely effective and precise evaluation of grape diseases is admitted as a critical step in the field management. In this paper, we are explaining about different optical sensing methods applied for RGB, Multispectral and Thermal cameras. Section-wise we will be describing environmental set up for image-aquation, data-preprocessing, different modelling methods, evaluation matrix, result, and reviewer’s comment.

We propose a probabilistic graphical model for discriminative substrate characterization, to support geological and biological habitat mapping in aquatic environments. The model, called a fully connected conditional random field (CRF), is demonstrated using multispectral and monospectral acoustic backscatter from heterogeneous seafloors in Patricia Bay, British Columbia, and Bedford Basin, Nova Scotia. Unlike previously proposed discriminative machine learning algorithms, the CRF model considers both the relative backscatter magnitudes of different substrates and their relative proximities. The model therefore combines the statistical flexibility of a machine learning algorithm with an inherently spatial treatment of the substrate. The CRF model predicts substrates such that nearby locations with similar backscattering characteristics are likely to be in the same substrate class. The degree of proximity and allowable backscatter similarity are controlled by parameters that are learned from the data. CRF model results were evaluated against a popular generative model known as a Gaussian Mixture model that doesn't include spatial dependencies, only covariance between substrate backscattering response over different frequencies. Both models are used in conjunction with sparse bed observations/samples in a supervised classification. A detailed accuracy assessment, including a leave-one-out cross-validation analysis, was performed using both models. Using multispectral backscatter, the GMM model trained on 50% of the bed observations resulted in a 75% and 89% average accuracies in Patricia Bay and Bedford Basin, respectively. The same metrics for the CRF model were 78% and 95%. Further, the CRF model resulted in a 91% mean cross-validation accuracy across four substrate classes at Patricia Bay, and a 99.5% mean accuracy across three substrate classes at Bedford Basin, which suggest that the CRF model generalizes extremely well to new data. This analysis also showed that the CRF model was much less sensitive to the specific number and locations of bed observations than the generative model, owing to its ability to incorporate spatial autocorrelation in substrates. The CRF approach therefore may prove to be a powerful `spatially aware' alternative to other discriminative classifiers.

In recent years, using multispectral cameras on UAVs has provided an opportunity to capture separate bands that offer the extraction of spectral features used for early detection of diseased plants. One of the main steps in disease detection is radiometric calibration that converts digital numbers to reflectance values commonly using white reference panels. This paper focused on the necessity of radiometric calibration to distinguish disease trees in orchards based on aerial multi-spectral images. For this purpose, two study sites with various climate conditions and tree species as well as different disease types were selected where multispectral images were taken using a multirotor UAV. The impact of radiometric correction on plant disease detection was assessed in two ways: 1) comparison of separability between the healthy and diseased classes using T-test and entropy distances; 2) radiometric calibration effect on the accuracy of classification. The experimental result showed the insignificant effect of radiometric calibration on separability criteria. Furthermore, based on T-test and entropy distances criteria, NIR and R spectral features made highest distances between healthy and Greening infected citrus trees, respectively, at the first study site while NDRE and BNDVI spectral features made highest distances between healthy and peach leaf curl infected trees, respectively, at the other study site. In the second strategy, the experimental result showed that radiometric calibration had no effect on the accuracy of classification. As a result, the overall accuracy and kappa values for both un-calibrated and calibrated orthomosaic classifications of the citrus orchard were 96.6% and 0.94%, respectively, using five spectral bands as well as DVI, NDRE, NDVI and GNDVI vegetation indices using a random forest classifier. The experimental results were also similar at the other study site. Therefore, the overall accuracy and kappa values for both the un-calibrated and calibrated orthomosaic classifications were 96.1%, 0.92, respectively, using five spectral bands as well as NDRE, BNDVI, GNDVI, DVI, and NDVI vegetation indices.

Semantic segmentation of high-resolution remote sensing images provides detailed and precise feature information, playing a pivotal role in decision-making and analysis in sectors such as water management, agriculture, military, and environmental protection. However, most methods merely combine features from various branches directly, without a mechanism for spatial location feature screening, and treat all extracted features as equally important. To overcome these limitations, we introduce a novel spatially adaptive interaction network (SAINet) for dynamic interaction across different features in remote sensing semantic segmentation task. Specifically, we propose a spatial refined module that leverages local context information to filter spatial locations and extract salient regions. Following this, we introduce an innovative spatial interaction module that uses a spatial adaptive modulation mechanism to dynamically select and allocate spatial position weights. This facilitates interaction between local salient areas and global information, allowing the network to focus more on relevant regions. This flexible approach enables the network to capture more informative features, thereby enhancing segmentation accuracy. Experiments conducted on the DeepGlobe, Vaihingen, and Potsdam public datasets confirm the effectiveness and capability of SAINet. Our code and models will be publicly available

This study introduces SkinLiTE, a lightweight supervised contrastive learning model, tailored to enhance the detection and typification of skin lesions in dermoscopic images. The core of SkinLiTE lies in its unique integration of supervised and contrastive learning approaches, which leverages labeled data to learn generalizable representations. This approach is particularly adept at handling the complexities and imbalances inherent in skin lesions datasets. The methodology encompasses a two-phase learning process. In the first phase, SkinLiTE utilizes an encoder network and a projection head to transform and project dermoscopic images into a feature space where contrastive loss is applied, focusing on minimizing intra-class variations while maximizing inter-class differences. The second phase freezes the encoder's weights, leveraging the learned representations for classification through a series of dense and dropout layers. The model was evaluated using three datasets from Skin Cancer ISIC 2019-2020, covering a wide range of skin conditions. SkinLiTE demonstrated superior performance across various metrics—accuracy, AUC , and F1 score—particularly when compared with traditional supervised learning models. Notably, SkinLiTE achieved an accuracy of 0.9087 using AugMix augmentation for binary classification of skin lesions. It also showed comparable results with the state-of-the-art approaches of ISIC challenge without relying on external data, underscoring its efficacy and efficiency. The results highlight the potential of SkinLiTE as a significant step forward in the field of dermatological AI, offering a robust, efficient, and accurate tool for skin lesion detection and classification. Its lightweight architecture and ability to handle imbalanced datasets make it particularly suited for integration into Internet of Medical Things environments, paving the way for enhanced remote patient monitoring and diagnostic capabilities. This research contributes to the evolving landscape of AI in healthcare, demonstrating the impact of innovative learning methodologies in medical image analysis.

The advent of deep learning (DL) has revolutionized medical imaging, offering unprecedented avenues for accurate disease classification and diagnosis. DL models have shown remarkable promise for classifying brain tumor from Magnetic Resonance Imaging (MRI) scans. However, despite their impressive performance, the opaque nature of DL models poses challenges in understanding their decision-making processes, particularly crucial in medical contexts where interpretability is essential. This paper explores the intersection of medical image analysis and DL interpretability, aiming to elucidate the decision-making rationale of DL models in brain tumor classification. Leveraging state-of-the-art DL frameworks with transfer learning, we conduct a comprehensive evaluation encompassing both classification accuracy and interpretability. Using state-of-the-art DL frameworks with transfer learning, we conduct a thorough evaluation covering both classification accuracy and interpretability. We employ adaptive path-based techniques to understand the underlying decision-making mechanisms of these models. Grad-CAM and Grad-CAM++ highlight critical image regions where the tumors are located.

The present work proposed a low-cost portable device as an enabling technology for Smart Farms using multispectral imaging and Machine Learning in soil texture. Clay is an important factor for the verification and monitoring of soil use due to its fast reaction to chemical and surface changes. The system developed uses the analysis of reflectance in wavebands for clay prediction. The selection of each wavelength is performed through an LED lamp panel. A NoIR microcamera controlled by a Raspberry Pi device is employed to acquire the image and unfold it in RGB histograms. Results showed an good prediction performance with R2 of 0.96, RMSEC of 3.66% and RMSECV of 16.87%. The high portability allows the equipment to be used in a field providing strategic information related to soil sciences.

As part of the Earth Climate Observatory space mission concept for the direct observation from space of the Earth Energy Imbalance, we propose an advanced camera suite for the high resolution observation of the Total Outgoing Radiation of the Earth. For the observation of the Reflected Solar Radiation, we propose the use of two multispectral cameras covering the range from 400 to 950 nm, with a nadir resolution of 1.7 km, combined with a high resolution RGB camera, with a nadir resolution of 0.57 km. For the observation of the Outgoing Longwave Radiation, we propose the use of 6 microbolometer cameras, with each a spectral bandwidth of 1 μm in the range from 8 to 14 μm, and with a nadir resolution of 2.2 km.

Short-term changes in shallow bathymetry affect the coastal zone and therefore their monitoring is an essential task in coastal planning projects. This study provides a novel approach for monitoring shallow bathymetry change based on drone multispectral imagery. Particularly we apply a shallow water inversion algorithm on two composite multispectral datasets being acquired five months apart in a small Mediterranean sandy embayment (Chania, Greece). Initially, we perform radiometric corrections using proprietary software and following we combine the bands from standard and multispectral cameras resulting in a six-band composite image suitable for applying the shallow water inversion algorithm. Bathymetry inversion results showed good correlation and low errors (< 0.3m) with sonar measurements collected with an uncrewed surface vehicle (USV). Bathymetry maps and true-color orthomosaics assist in identifying morphobathymetric features representing crescentic bars with rip channel systems. The temporal bathymetry and true-color data reveal important erosional and depositional patterns, which were developed under the impact of winter storms. Furthermore, bathymetric profiles show that the crescentic bar appears to migrate across and along-shore over the 5-months period. Drone-based multispectral imagery proves to be an important and cost-effective tool for shallow seafloor mapping and monitoring when it is combined with shallow water analytical models.

During the last 25 years the scientific community has coexisted with the most fascinating protocol due to Quantum Physics: quantum teleportation (QTele), which would have been impossible if quantum entanglement, so questioned by Einstein, did not exist. In this work, a complete architecture for the teleportation of Computational Basis States (CBS) is presented. Such CBS will represent each of the possible 24 classical bits commonly used to encode every pixel of a 3-color-channel-image (red-green-blue, or cyan-yellow-magenta). For this purpose, a couple of interfaces: classical-to-quantum (Cl2Qu) and quantum-to-classical (Qu2Cl) are presented with two versions of the teleportation protocol: standard and simplified.

Landslides, resulting from disturbances in slope equilibrium, pose a significant threat to landscapes, infrastructure, and human life. Triggered by factors such as intense precipitation, seismic activities, or volcanic eruptions, these events can cause extensive damage and endanger nearby communities. A comprehensive understanding of landslide characteristics, including spatio-temporal patterns, dimensions, and morphology, is vital for effective landslide-disaster management. Existing Remote Sensing approaches mostly use either optical or Synthetic Aperture Radar (SAR) sensors. Integrating information from both these types of sensors promises greater accuracy for identifying and locating landslides. This study proposes a novel approach, the ML-LaDeCORsat (Machine Learning-based coseismic Landslide Detection using Combined Optical and Radar Satellite Imagery), that integrates freely available Sentinel-1, Palsar-2, and Sentinel-2 imagery data, along with relevant spectral indices and suitable bands using machine-learning-based classification for coseismic landslide detection implemented in Google Earth Engine (GEE). The approach includes a robust and reproducible training and validation strategy. Using landslides from four different earthquake case studies, we demonstrate the superiority of our approach over existing solutions in coseismic landslide iden-tification and localization, providing a detection accuracy of 87-92%. ML-LaDeCORsat can be adapted to other landslide events (GEE script is provided). Transfer learning experiments proofed that our model can be applied to other coseismic landslide events without the need for additional training data. Our novel approach therefore facilitates quick and reliable identification of co-seismic landslides, highlighting its potential to contribute towards more effective disaster management.

Sentinel-2 can provide multi-spectral optical remote sensing images in RGBN bands with a spatial resolution of 10m, but the spatial details provided are not enough for many applications. WorldView can provide HR multi-spectral images less than 2m, but it is a commercial paid resource with relatively high usage costs. In this paper, without any available reference images, Sentinel-2 images at 10m resolution are improved to a resolution of 2.5m through super-resolution (SR) based on deep learning technology. Our model, named DKN-SR-GAN, uses degradation kernel estimation and noise injection to construct a dataset of near-natural low-high-resolution (LHR) image pairs, with only low-resolution (LR) images and no high-resolution (HR) prior information. DKN-SR-GAN uses the Generative Adversarial Networks (GAN) combined of ESRGAN-type generator, PatchGAN-type discriminator and the VGG-19-type feature extractor, using perceptual loss to optimize the network, so as to obtain SR images with clearer details and better perceptual effects. Experiments demonstrate that in the quantitative comparison of the non-reference image quality assessment (NR-IQA) metrics like NIQE, BRISQUE and PIQE, as well as the intuitive visual effects of the generated images, compared with state-of-the-art models such as EDSR8-RGB, RCAN and RS-ESRGAN, our proposed model has obvious advantages.

Medical brain image analysis is a necessary step in the Computers Assisted /Aided Diagnosis (CAD) systems. Advancements in both hardware and software in the past few years have led to improved segmentation and classification of various diseases. In the present work, we review the published literature on systems and algorithms that allow for classification, identification, and detection of White Matter Hyperintensities (WMHs) of brain MRI images specifically in cases of ischemic stroke and demyelinating diseases. For the selection criteria, we used the bibliometric networks. Out of a total of 140 documents we selected 38 articles that deal with the main objectives of this study. Based on the analysis and discussion of the revised documents, there is constant growth in the research and proposal of new models of deep learning to achieve the highest accuracy and reliability of the segmentation of ischemic and demyelinating lesions. Models with indicators (Dice Score, DSC: 0.99) were found, however with little practical application due to the uses of small datasets and lack of reproducibility. Therefore, the main conclusion is to establish multidisciplinary research groups to overcome the gap between CAD developments and their complete utilization in the clinical environment.

The application of deep learning algorithms to predict the molecular profiles of various cancers from digital images of hematoxylin and eosin (H&E)-stained slides has been reported in recent years, mainly in gastric and colon cancers. In this study, we investigated the potential use of H&E-stained endometrial cancer slide images to predict the associated mismatch repair (MMR) status. H&E-stained slide images were collected from 127 cases of the primary lesion of endometrial cancer. After digitization using a Nanozoomer virtual slide scanner (Hamamatsu Photonics), we segmented the scanned images into 5,397 tiles of 512 × 512 pixels. The MMR proteins (PMS2, MSH6) were immunohistochemically stained, classified into MMR proficient/deficient, and annotated for each case and tile. We trained several neural networks, including convolutional and attention-based networks, using tiles annotated with the MMR status. Among the tested networks, ResNet50 exhibited the highest area under the receiver operating characteristic curve (AUROC) of 0.91 for predicting the MMR status. The constructed prediction algorithm may be applicable to other molecular profiles and useful for pre-screening before implementing other, more costly genetic profiling tests.

This paper provides orthogonal moments (OM) such as, Zernike Moments(ZM), Psuedo Zernike Moments(PZM) and Orthogonal Fourier Mellin Moments(OFMM) for the analysis of melanoma images. The moment invariants may vary with respect to geometric variations. For the analysis of orthogonal moments hundred random melanoma images and hundred non-melanoma images have been taken into consideration from the database of 570 melanoma images and 250 non-melanoma images respectively. Orthoganal moments have been computed by varying the phase angles from 10° to 40° with an equal interval of 10° degree for the orders 2, 4,8,16,32,64,128,256 respectively. For the optimal OMs Particle Swarm Optimization (PSO) technique have been used. These set of extracted optimal OMs have been further applied to classify melanoma images. Support Vector Machine (SVM) has been used for the classification of [1]sensitivity=88.78%.

The Fractal Analysis of Medical Images is an investigation field in those that numerous results of important value have been obtained. This work describes the basic foundations of the Fractal Analysis and its application has more than enough medical images, leaning on in five scientific investigations.

An image consisting of (m, n) pixels can be seen as a matrix of m × n size. Based on the formula of angles between two subspaces, a pair of angles can be defined between two matrices, by utilizing column spaces and row spaces of the two matrices. The singular values of each matrix can be used to calculate distances. Thus, a distance representation is obtained, and a pair of angles between 2 matrices of the same size.

Hyperspectral imaging provides vital information about the objects and elements present inside the image. That’s why they are very useful in satellite imagery as well as image forensics. Hyperspectral document analysis (HSDI) can be used for document authentication using ink analysis which can provide sufficient information about the composition and type of ink. In this project, we have implemented HSDI based ink classification technique using Principle Component Analysis for dimensionality reduction and K-means clustering for ink classification. This is unsupervised learning approach and it is very simple and efficient in order to classify limited number of bands. We have used this technique to classify 33 different bands of ink.

Snow parameters have traditionally been retrieved using discontinuous, multi-band sensors; however, continuous hyperspectral sensor are now being developed as an alternative. In this paper we investigate the performance of various sensor configurations using machine learning neural networks trained on a simulated dataset. Our results show improvements in accuracy of retrievals of snow grain size and impurity concentration for continuous hyperspectral channel configurations. Retrieval accuracy of snow albedo was found to be similar for all channel configurations.

Whenever vegetated areas are monitored over time, phenological changes in land cover should be decoupled from changes in acquisition conditions, like atmospheric components, sun and satellite heights, and imaging instrument. This especially holds when the multispectral (MS) bands are sharpened for spatial resolution enhancement by means of a panchromatic (Pan) image of higher resolution, a process referred to as pansharpening. In this paper, we provide evidence that pansharpening of visible/near-infrared (VNIR) bands takes advantage from a correction of the path radiance term introduced by the atmosphere, during the fusion process. This holds whenever the fusion mechanism emulates the radiative transfer model ruling the acquisition of the Earth’s surface from space, that is, for methods exploiting a multiplicative, or contrast-based, injection model of spatial details extracted from the panchromatic (Pan) image into the interpolated multispectral (MS) bands. The path radiance should be estimated and subtracted from each band before the product by Pan is accomplished. Both empirical and model-based estimation techniques of MS path radiances are compared within the framework of optimized algorithms. Simulations carried out on two GeoEye-1 observations of the same agricultural landscape at different dates highlight that the de-hazing of MS before fusion is beneficial for an accurate detection of seasonal changes in the scene, as measured by the normalized differential vegetation index (NDVI).

Previous research has shown that the effectiveness of selecting filter set from a large set of commercial broadband filters by vector analyzing method based on maximum linear independence (MLI). However, the traditional MLI is suboptimal due to predefining the first filter of the selected filter set being the maximum ℓ2 norm among all those of the filters. An exhaustive imaging simulation is conducted to investigate the features of the most competent filter set. In the simulation, every filter in a subset of all the filters is selected serving as the first filter in turn. From the results of the simulation, we found there are remarkable characteristics for the most competent filter set. Besides smaller condition number, the geometric features of the best-performed filter set comprise the distinct peak of the transmittance of the first filter, the generally uniform distributing of the peaks of the transmittance curve of the filters, the substantial overlapping of the transmittance curves with those of the adjacent filer sets. Therefore, the best-performed filter sets can be decided intuitively by simple vector analyzing and just a few experimental verifications. This work would be useful for optimizing spectral sensitivity of broadband multispectral imaging sensors or SFA sensors.

This study assesses the applicability of different-resolution multispectral remote sensing images for mapping and estimating the aboveground biomass (AGB) of Carpobrotus edulis, a prominent invasive species in European coastal areas. The performance of three sets of multispectral images with different resolutions was compared: (i) 2.5 cm Ground Sample Distance (GSD), 5 cm GSD and 10 cm GSD images. The images were classified using the supervised classification algorithm Random Forest and later improved applying a sieve filter. The results show that the three tested image resolutions allow constructing reliable coverage maps of C. edulis, with Overall Accuracy values of 89%, 85% and 88% for the classification of the 2.5 cm, 5 cm and 10 cm GSD images, respectively. Samples were also collected, dried and weighed to estimate AGB using the relationship between the Dry Weight and Vegetation Indices (VI). The regressions were evaluated based on their R² and Normalised RMSE. The best-performing VI-DW regression models achieved: R² = 0.87 and NRMSE = 0.09 for the 2.5 cm resolution; R² = 0.77 and NRMSE = 0.12 for the 5 cm resolution; and, R² = 0.64 and NRMSE = 0.15 for the 10 cm resolution. C. edulis area and total AGB were: 3441.10 m² and 28,327.1 kg (with a Relative Error (RE) = 0.08), for the 2.5 cm resolution; 3070.04 m² and 29,170.8 kg (RE = 0.08), for the 5 cm resolution; and, 2305.06 m² and 22,135.7 kg (RE = 0.11), for the 10 cm resolution. Differences were analysed in detail, spatially, to determine their causes. Final analyses suggest that, for C. edulis, multispectral imagery of up to 5 cm GSD is adequate for the estimation of the species’ distribution and biomass.

Shallow bathymetry inversion algorithms have long been applied in various types of remote sensing imagery with relative success. However, this approach requires that imagery with increased radiometric resolution in the visible spectrum is available. The recent developments in drones and camera sensors allow for testing current inversion techniques on new types of datasets. This study explores the bathymetric mapping capabilities of fused RGB and multispectral imagery, as an alternative to costly hyperspectral sensors. Combining drone-based RGB and multispectral imagery into a single cube dataset, provides the necessary radiometric detail for shallow bathymetry inversion applications. This technique is based on commercial and open-source software and does not require input of reference depth measurements in contrast to other approaches. The robustness of this method was tested on three different coastal sites with contrasting seafloor types. The use of suitable end-member spectra which are representative of the seafloor types of the study area and the sun zenith angle are important parameters in model tuning. The results of this study show good correlation (R2>0.7) and less than half a meter error when they are compared with sonar depth data. Consequently, integration of various drone-based imagery may be applied for producing centimetre resolution bathymetry maps at low cost for small-scale shallow areas.

Endoscopic medical images can suffer from uneven illumination, low contrast, and lack of texture information due to the use of point directional light sources and the presence of narrow tissue structures, posing diagnostic difficulties for physicians. In this paper, a deep learning-based su-pervised illumination enhancement network is designed for low-light endoscopic images, aiming to improve both global illumination and local details. Initially, a global illumination enhancement module is formulated utilizing a higher-order curve function to improve global illumination. Sec-ondly, a local feature extraction module incorporating dual attention is designed to capture local detailed features. Considering the significance of color fidelity in biomedical scenarios, the designed loss function prioritizes introducing color loss to alleviate image color distortion. Compared with seven state-of-the-art enhancement algorithms on Endo4IE endoscopic datasets, experimental re-sults show that the proposed method can better enhance low-light endoscopic images and avoid image color distortion. It provides an efficient method to enhance images captured by endoscopes which can effectively assist clinical diagnosis and treatment.

While there are millions of reptile images available online, they are not well organized and not easily findable, accessible, interoperable, or reproducible (FAIR). More importantly, they are not standardized and thus hardly comparable. Here we present a reference database of more than 14,000 standardized images of 1,045 reptile species (969 lizard and 76 snake species), that are based on preserved specimens in 20 different collections, including 533 type species of genera and type specimens of 72 species. All images were taken with standardized views, including dorsal and ventral body shots as well as dorsal, ventral, and lateral views of the heads and other body parts. Although only 11 out of the 20 collections are cross-referenced in Vertnet, some others are indexed in GBIF, and this fraction will certainly grow in the near future. The utility of this and similar image collections will further grow with additional material and further cross-referencing, e.g., to DNA sequence databases or citizen science projects. The images are searchable and freely available on Morphobank.org (Project 5121) and on Figshare.com.

The evolution in imaging technologies and artificial intelligence algorithms, coupled with improvements in UAV technology, has enabled the use of unmanned aircraft in a wide range of applications. The feasibility of this kind of approach for cattle monitoring has been demonstrated by several studies, but practical use is still challenging due to the particular characteristics of this application, such as the need to track mobile targets and the extensive areas that need to be covered in most cases. The objective of this study was to investigate the feasibility of using a tilted angle to increase the area covered by each image. Deep Convolutional Neural Networks (Xception architecture) were used to generate the models for the experiments, which covered aspects like ideal input dimensions, effect of the distance between animals and sensor, effect of classification error on the overall detection process, and impact of physical obstacles on the accuracy of the model. Experimental results indicate that oblique images can be successfully used under certain conditions, but some practical limitations need to be addressed in order to make this approach appealing.

Event-based vision is an emerging field of computer vision that offers unique properties such as asynchronous visual output, high temporal resolutions, and dependence on brightness changes to generate data. These properties can enable robust high-temporal-resolution object detection and tracking when combined with frame-based vision. In this paper, we present a hybrid, high-temporal-resolution, object detection and tracking approach, that combines learned and classical methods using synchronized images and event data. Off-the-shelf frame-based object detectors are used for initial object detection and classification. Then, event masks, generated per each detection, are used to enable inter-frame tracking at varying temporal resolutions using the event data. Detections are associated across time using a simple low-cost association metric. Moreover, we collect and label a traffic dataset using the hybrid sensor DAVIS 240c. This dataset is utilized for quantitative evaluation using state-of-the-art detection and tracking metrics. We provide ground truth bounding boxes and object IDs for each vehicle annotation. Further, we generate high-temporal-resolution ground truth data to analyze the tracking performance at different temporal rates. Our approach shows promising results with minimal performance deterioration at higher temporal resolutions (48 – 384 Hz) when compared with the baseline frame-based performance at 24 Hz.

Multispectral and 3D LiDAR remote sensing data sources are valuable tools for characterizing the 3D vegetation structure and thus understanding the relationship between forest structure, biodiversity and microclimate. This study focuses on mapping riparian forest species in the canopy strata using a fusion of Airborne LiDAR data and multispectral multi-sources and multi-resolution satellite imagery; Sentinel-2 and Pleiades at tree level. The idea is to assess the contribution of each data source in the tree species classification at the considered level. The data fusion was processed at feature-level and decision level. At feature level, LiDAR 2D attributes were derived and combined with vegetation indices. At decision level, LiDAR data was used for 3D tree crown delimitation providing unique trees or groups of trees that are used as a support for the species classification. Data augmentation techniques were used to improve the training process. Best results were obtained by the fusion of Sentinel-2 time series and LiDAR data with a Kappa of 0.66 thanks to red-edge based indices that better discriminate vegetation species and the temporal resolution of Sentinel-2 images that allows monitoring the phenological stages helping to discriminate the species.

The visualization of hyperspectral images in display devices, having RGB colour composition channels is quite difficult due to the high dimensionality of these images. Thus, principal component analysis has been used as a dimensionality reduction algorithm to reduce information loss, by creating uncorrelated features. To classify regions in the hyperspectral images, K-means clustering has been used to form clusters/regions. These two algorithms have been implemented on the three datasets imaged by AVIRIS and ROSIS sensors.

Recent state-of-the-art scene text recognition methods have primarily focused on horizontal text in images. However, in several Asian countries, including China, large amounts of text in signs, books, and TV commercials are vertically directed. Because the horizontal and vertical texts exhibit different characteristics, developing an algorithm that can simultaneously recognize both types of text in real environments is necessary. To address this problem, we adopted the direction encoding mask (DEM) and selective attention network (SAN) methods based on supervised learning. DEM contains directional information to compensate in cases that lack text direction; therefore, our network is trained using this information to handle the vertical text. The SAN method is designed to work individually for both types of text. To train the network to recognize both types of text and to evaluate the effectiveness of the designed model, we prepared a new synthetic vertical text dataset and collected an actual vertical text dataset (VTD142) from the Web. Using these datasets, we proved that our proposed model can accurately recognize both vertical and horizontal text and can achieve state-of-the-art results in experiments using benchmark datasets, including the street view test (SVT), IIIT-5k, and ICDAR. Although our model is relatively simple as compared to its predecessors, it maintains the accuracy and is trained in an end-to-end manner.

Mapping vegetation species is critical to facilitate related quantitative assessment, and for invasive plants mapping their distribution is important to enhance monitoring and controlling activities. Integrating high resolution multispectral remote sensing (RS) image and lidar (light detection and ranging) point clouds can provide robust features for vegetation mapping. However, using multiple source of high-resolution RS data for vegetation mapping at large spatial scale can be both computationally and sampling intensive. Here we designed a two-step classification workflow to decrease computational cost and sampling effort, and to increase classification accuracy by integrating multispectral and lidar data to derive spectral, textural, and structural features for mapping target vegetation species. We used this workflow to classify kudzu, an aggressive invasive vine, in the entire Knox County (1,362 km2) of Tennessee, the United States. Object-based image analysis was conducted in the workflow. The first-step classification used 320 kudzu samples and extensive coarsely labeled samples (based on national land cover) to generate an overprediction map of kudzu using random forest (RF). For the second step, 350 samples were randomly extracted from the overpredicted kudzu and labeled manually for the final prediction using RF and support vector machine (SVM). Computationally intensive features were only used for the second-step classification. SVM had constantly better accuracy than RF, and the Producer’s Accuracy, User’s Accuracy, and Kappa for the SVM model on kudzu was 0.94, 0.96, and 0.90, respectively. SVM predicted 1010 kudzu patches covering 1.29 km2 in Knox County. We found the sample size of kudzu used for algorithm training impacted the accuracy and number of kudzu predicted. The proposed workflow could also improve sampling efficiency and specificity. Our workflow had much higher accuracy than the traditional method conducted in this research, and could be easily implemented to map kudzu in other regions or other vegetation species.

Remote sensing is one of the modern methods that have significantly developed over the last two decades and nowadays provides a new means for forest monitoring. High spatial and temporal resolutions are demanded for accurate and timely monitoring of forests. In this study multi-spectral Unmanned Aerial Vehicle (UAV) images were used to estimate canopy parameters (definition of crown extent, top and height as well as photosynthetic pigment contents). The UAV images in Green, Red, Red-Edge and NIR bands were acquired by Parrot Sequoia camera over selected sites in two small catchments (Czech Republic) covered dominantly by Norway spruce monocultures. Individual tree extents, together with tree tops and heights, were derived from the Canopy Height Model (CHM). In addition, the following were tested i) to what extent can the linear relationship be established between selected vegetation indexes (NDVI and NDVIred edge) derived for individual trees and the corresponding ground truth (e.g., biochemically assessed needle photosynthetic pigment contents), and ii) whether needle age selection as a ground truth and crown light conditions affect the validity of linear models. The results of the conducted statistical analysis show that the two vegetation indexes (NDVI and NDVIred edge) tested here have a potential to assess photosynthetic pigments in Norway spruce forests at a semi-quantitative level, however the needle-age selection as a ground truth was revealed to be a very important factor. The only usable results were obtained for linear models when using the 2nd year needle pigment contents as a ground truth. On the other hand, the illumination conditions of the crown proved to have very little effect on the model’s validity. No study was found to directly compare these results conducted on coniferous forest stands. This shows that there is a further need for studies dealing with a quantitative estimation of the biochemical variables of nature coniferous forests when employing spectral data acquired by the UAV platform at a very high spatial resolution.

This article presents an automated vision-based algorithm for the die-scale inspection of wafer images captured using scanning acoustic tomography (SAT). This algorithm can find defective and abnormal die-scale patterns, and produce a wafer map to visualize the distribution of defects and anomalies on the wafer. The main procedures include standard template extraction, die detection through template matching, pattern candidate prediction through clustering, and pattern classification through deep learning. To conduct the template matching, we first introduce a two-step method to obtain a standard template from the original SAT image. Subsequently, a majority of the die patterns are detected through template matching. Thereafter, the columns and rows arranged from the detected dies are predicted using a clustering method; thus, an initial wafer map is produced. This map is composed of detected die patterns and predicted pattern candidates. In the final phase of the proposed algorithm, we implement a deep learning-based model to determine defective and abnormal patterns in the wafer map. The experimental results verified the effectiveness and efficiency of our proposed algorithm. In conclusion, the proposed method performs well in identifying defective and abnormal die patterns, and produces a wafer map that presents important information for solving wafer fabrication issues.

This paper highlights the importance of one-shot learning from prototype SKU images for efficient product recognition in retail and inventory management. Traditional methods require large supervised datasets to train deep neural networks, which can be costly and impractical. One-shot learning techniques mitigate this issue by enabling classification from a single prototype image per product class, thus reducing data annotation efforts. We introduce the variational prototyping-encoder (VPE), a novel deep neural network for one-shot classification. Utilizing a support set of prototype SKU images, VPE learns to classify query images by capturing image similarity and prototypical concepts. Unlike metric learning-based approaches, VPE pre-learns image translation from real-world object images to prototype images as a meta-task, facilitating efficient one-shot classification with minimal supervision. Our research demonstrates that VPE can significantly reduce the need for large datasets while accurately classifying query images into their respective categories, providing a practical solution for product classification tasks.

Nowadays, semantic segmentation is increasingly used in exploration by underwater robots, for example in autonomous navigation, so that the robot can recognise the nature and elements of its environment during the mission and act according to this classification to avoid collisions. Other applications can be found in the search for archaeological artefacts, in the inspection of underwater structures or in species monitoring. Therefore, it is necessary to try to improve the performance in these tasks as much as possible. To this end, we compare some methods for improving image quality and for data augmentation and test whether higher performance metrics can be achieved with both strategies. The experiments are performed with the SegNet implementations and the SUIM dataset with 8 common underwater classes to compare the obtained results with the already known ones. The results obtained with both strategies show that they are beneficial and lead to better performance results by achieving a mean IoU of 56% and an increased overall accuracy of 81.8%. The single result shows that there are 5 classes with an IoU value above 60% and only one class with an IoU value below 30%, which is a more reliable result and easier to use in real contexts.

Synthetic Aperture Radar (SAR) is an active sensor that uses microwave for sense, it is unrestricted by weather and illumination conditions, and it can observe targets all day and weather. Aircraft targets are important monitoring objects in military and civilian fields, and how to efficiently detect and recognize aircraft targets is an important topic in the field of SAR image interpretation. Based on the features of SAR images, such as complex background, high resolution, and multi-scale, we proposed an improved method based on YOLOv5s. Firstly, this paper proposed the structure of the multi-scale receptive field and channel attention fusion, which is applied to the shallow layer of the backbone of YOLOv5s, it can adjust the weights of the multi-scale receptive field during the training process to enhance the extraction ability of feature information. Secondly, we proposed four de-coupled detection heads to replace the original part in YOLOv5s, which can improve the efficiency and accuracy of SAR image interpretation for small targets. Thirdly, in the case of the limited amount of SAR images, this paper proposed multi methods of data augmentation, which can enhance the diversity and generalization of the network. Fourthly, this paper proposed the K-means++ to re-place the original K-means to improve the network convergence speed and detection accuracy. Finally, Experiments demonstrate that the improved YOLOv5s can enhance the accuracy of SAR image interpretation by 9.3%, and the accuracy of small targets is improved more obviously, reaching 13.1%.

A morphological feature estimation method is presented, that can be used to monitor fish from low contrast underwater images and videos. The fish orientation is classified in order to apply a shape alignment technique that is based on the Ensemble of Regression Trees machine learning method. Shape alignment allows the estimation of fish dimensions (length, height, mass) and the location of fish body parts of particular interest such as the eyes and gills. The developed system can be exploited both for fish monitoring in open sea as well as aquacultures where non-invasive, low cost morphological feature extraction is essential. Fish health can be assessed from malformations in body shape, the color of the eyes or the gills as well as the fish behavior. The proposed method can estimate the position of 18 landmarks with an accuracy of about 95% from low resolution and low contrast underwater images where the fish can be hardly distinguished from its background. Hardware acceleration can be applied at various stages of the proposed method for real time video processing. As a case study, the developed system has been trained and tested with several Mediterranean fish species in the category of seabream or similar: diplodous sargus annularis (white seabream), diplodus annularis seabream (spawn), oblada melanura (saddled seabream), pagrus pagrus (common seabream), etc. A large dataset with low resolution underwater videos and images has been created in the context of this work.

Big Data in medicine includes possibly fast processing of large data sets, both current and historical in purpose supporting the diagnosis and therapy of patients' diseases. Support systems for these activities may include pre-programmed rules based on data obtained from the interview medical and automatic analysis of test results diagnostic results will lead to classification of observations to a specific disease entity. The current revolution using Big Data significantly expands the role of computer science in achieving these goals, which is why we propose a Big Data computer data processing system using artificial intelligence to analyze and process medical images.

Edge detection is one of the key issues in the field of computer vision and remote sensing image analysis. Although many different edge-detection methods have been proposed for gray-scale, color, and multispectral images, they still face difficulties when extracting edge features from hyperspectral images (HSIs) that contain a large number of bands with very narrow gap in the spectral domain. Inspired by the clustering characteristic of the gravitation, a novel edge-detection algorithm for HSIs is presented in this paper. In the proposed method, we first construct a joint feature space by combining the spatial and spectral features. Each pixel of HSI is assumed to be a celestial object in the joint feature space, which exerts gravitational force to each of its neighboring pixel. Accordingly, each object travels in the joint feature space until it reaches a stable equilibrium. At the equilibrium, the image is smoothed and the edges are enhanced, where the edge pixels can be easily distinguished by calculating the gravitational potential energy. The proposed edge-detection method is tested on several benchmark HSIs and the obtained results were compared with those of three state-of-the-art approaches. The experimental results confirm the efficacy of the proposed method

Taekwondo has evolved from a traditional martial art into an official Olympic sport. This study introduces a novel action recognition model tailored for Taekwondo unit actions, utilizing joint motion data acquired via wearable inertial measurement unit (IMU) sensors. The utilization of IMU sensor-measured motion data facilitates the capture of the intricate and rapid movements characteristic of Taekwondo techniques. The model, underpinned by a conventional convolutional neural network (CNN)-based image classification framework, synthesizes action images to represent individual Taekwondo unit actions. These action images are generated by mapping joint motion profiles onto the RGB color space, thus encapsulating the motion dynamics of a single unit action within a solitary image. To further refine the representation of rapid movements within these images, a time-warping technique was applied, adjusting motion profiles in relation to the velocity of the action. The effectiveness of the proposed model was assessed using a dataset compiled from 40 Taekwondo experts, yielding remarkable outcomes: an accuracy of 0.998, precision of 0.983, recall of 0.982, and an F1-score of 0.982. These results underscore the time-warping technique's contribution to enhancing feature representation, as well as the proposed method's scalability and effectiveness in recognizing Taekwondo unit actions.

A topic of growing interest in urban remote sensing is the automated extraction of geometrical building information for 3D city modeling. Roof geometry information is useful for applications such as urban planning, solar potential estimation and telecommunication installation planning, and wind flow simulations for pollutant diffusion analysis. Recent research has proven that the advance in remote sensing technologies and deep learning methods offer the prospects of deriving the roof structure information accurately and efficiently. In this study, we propose a Vectorized Roof Extractor- method based on Fully Convolutional Networks (FCNs) and advanced polygonization method to extract roof structure from aerial imagery and a normalized Digital Surface Models (nDSM) in a regularized vector format. The roof structure consists of building outlines, external edges of the building roof, inner rooflines, internal intersections of the main roof planes. The methodology is comprised of segmentation, vectorization and post-processing for outer rooflines, external edges of the building roof, and inner rooflines, and internal intersections of the main roof planes. For the comparison, we adapt the Frame field Learning (FFL) method originally designed to extract building polygons [1]. Our experiments are conducted on a custom data set derived for the city of Enschede, The Netherlands, using aerial imagery, nDSM and manually digitized training polygons. The results show that the proposed Vectorized Roof Extractor outperformed adapted FFL on PoLiS distance with values of 3.5 m and 1.2 m for outlines and inner rooflines, respectively. Furthermore, the model surpassed the adapted FFL on PoLiS-thresholded F-score for outlines and inner rooflines, with 0.31 and 0.57, respectively. The Vectorized Roof Extractor produced adequate visual results, with straighter walls and fewer missed inner roofline detections. It can predict buildings with common walls thanks to skeleton graph computation. To summarize, the proposed method is suitable for urban applications and has the potential to be improved further.

Lesion studies are crucial in establishing brain-behavior relationships, and accurately segmenting the lesion represents the first step in achieving this. Manual lesion segmentation is the gold standard for chronic strokes. However, it is labor-intensive, subject to bias, and limits sample size. Therefore, our objective is to develop an automatic segmentation algorithm for chronic stroke lesions on T1-weighted MR images. Methods: To train our model, we utilized an open-source dataset: ATLAS v2.0 (Anatomical Tracings of Lesions After Stroke). We partitioned the dataset of 655 T1 images with manual segmentation labels into five subsets and performed a 5-fold cross-validation to avoid overfitting of the model. We used a deep neural network (DNN) architecture for model training. Results: To evaluate the model performance, we used three metrics that pertain to diverse aspects of volumetric segmentation including shape, location, and size. The Dice similarity coefficient (DSC) compares the spatial overlap between manual and machine segmentation. The average DSC was 0.65 (0.61- 0.67; 95% bootstrapped CI). Average symmetric surface distance (ASSD) measures contour distances between the two segmentations. ASSD between manual and automatic segmentation was 12mm. Finally, we compared the total lesion volumes and the Pearson correlation coefficient (ρ) between the manual and automatically segmented lesion volumes, which was 0.97(p-value &lt; 0.001). Conclusions: We present the first automated segmentation model trained on a large multicentric dataset. This model will enable automated on-demand processing of MRI scans and quantitative chronic stroke lesion assessment.

In this article, a method for the moisture mapping of the soil surface of agrophytocenosis was proposed using neural network based on synchronized radar and multispectral optoelectronic data of Sentinel-1,2. To verify the developed method, data from two experimental plots were used. These plots were located two on irrigated soybean crops. The first of them was located on the right bank (1st plot) and the second one on the left bank (2nd plot) of the down part of Volga River. Two experimental soil moisture geo-datasets were done by measurements and geo-referencing points using gravimetric method (1st plot) and with proximal sensing method (2nd plot) using Soil Moisture Sensor ML3-KIT (THETAKIT, Delta). The soil moisture retrieval algorithm was based on the use of a neural network to predict reflection coefficient of an electromagnetic wave from the soil surface, followed by inversion into soil moisture using a dielectric model that takes into account the soil texture. The input parameter of the neural network was the ratio of the microwave radar vegetation index (calculated on the basis of Sentinel-1 data) to the index (calculated on the basis of data of multispectral optoelectronic channels 8 and 11 of Sentinel-2). Such way calculated index reveals showed a significantly greater dependence on soil moisture than on vegetation height that was been used in previous studies. The retrieved values of soil moisture were compared with the soil moisture measured in-situ. The proposed method with a determination coefficient of 0.44-0.65 and a standard deviation of 2.4%-4.2% for the 1st plot as well as with and of the same metrics for the 2nd allows predicting the soil moisture of both a test plots covered by soybean plants, relative to soil moisture measured in-situ. The conducted research created the scientific basis for a new technology for remote sensing the moisture content of the soil surface of agrophytocenosis as an element of the precision farming system and agroecology.

Knowledge on the health of banana trees is critical for farmers to profit from banana cultivation. Fusarium wilt and banana blood diseases (BDB), two significant diseases infecting banana trees, are caused by Fusarium oxysporum and Ralstonia syzygii, respectively. They have successfully caused a decline in crop yield as they destroy the trees, starting sequentially from the pseudostem to the fruits. The entire distribution of BDB and Fusarium on a plantation can be understood using advanced geospatial information obtained from multispectral aerial photographs taken using an unmanned aerial vehicle (UAV), combined with the reliable data field of infected trees. Vegetation and soil indices derived from a multispectral aerial photograph, such as normalized difference vegetation index, modified chlorophyll absorption ratio index, normalized difference water index (NDWI) and soil pH, may have to be relied on to explain the precise location of these two diseases. In this study, a random forest algorithm was used to handle a large dataset consisting of two models: the banana diseases multispectral model and the banana diseases spectral model. The results show that the soil indices, soil pH and NDWI are the most important variables for predicting the spatial distribution of these two diseases. Simultaneously, the plantation area affected by BDB is more extensive than that affected by Fusarium, if the variation of planted banana cultivars is not considered.

UAV network operation enables gathering and fusion from disparate information sources for flight control in both manned and unmanned platforms. In this investigation, a novel procedure for detecting runways and horizons as well as enhancing surrounding terrain is introduced based on fusion of enhanced vision system (EVS) and synthetic vision system (SVS) images. EVS and SVS image fusion has yet to be implemented real-world situations due to signal misalignment. We address this through a registration step to align the EVS and SVS images. Four fusion rules combining discrete wavelet transform (DWT) sub-bands are formulated, implemented and evaluated. The resulting procedure is tested on real EVS-SVS image pairs and pairs containing simulated turbulence. Evaluations reveal that runways and horizons can be detected accurately even in poor visibility. Furthermore, it is demonstrated that different aspects of the EVS and SVS images can be emphasized by using different DWT fusion rules. The procedure is autonomous throughout landing, irrespective of weather. We believe the fusion architecture developed holds promise for incorporation into head-up displays (HUDs) and UAV remote displays to assist pilots landing aircraft in poor lighting and varying weather. The algorithm also provided a basis rule selection in other signal fusion applications.

In recent years, ontology plays an important role in facilitating the semantic description of images which consists of describing the image by a set of words to describe the scene which signifies the belonging of the image. This description specified in several archaeological fields such as cultural, religious objects and heritage objects of France. However, the description of archaeological images is not yet exploited because this field is very diverse. In this article, we present a panel of ontology construction methods as well as archaeological ontologies. Also, we show our own OntunAr ontology to describe Tunisian archaeological images. In addition, we integrate OnTunAr into the automatic annotation of Tunisian archaeological images.

The growing amount of data demands methods that can gradually learn from new samples. However, it is not trivial to continually train a network. Retraining a network with new data usually results in a known phenomenon, called “catastrophic forgetting.” In a nutshell, the performance of the model drops on the previous data by learning from the new instances. This paper explores this issue in the table detection problem. While there are multiple datasets and sophisticated methods for table detection, the utilization of continual learning techniques in this domain was not studied. We employed an effective technique called experience replay and performed extensive experiments on several datasets to investigate the effects of catastrophic forgetting. Results show that our proposed approach mitigates the performance drop by 15 percent. To the best of our knowledge, this is the first time that continual learning techniques are adopted for table detection, and we hope this stands as a baseline for future research.

Visual Question Generation (VQG) from images is a rising research topic in both fields of natural language processing and computer vision. Although there are some recent efforts towards generating questions from images in the open domain, the VQG task in the medical domain has not been well-studied so far due to the lack of labeled data. In this paper, we introduce a goal-driven VQG approach for radiology images called VQGRaD that generates questions targeting specific image aspects such as modality and abnormality. In particular, we study generating natural language questions based on the visual content of the image and on additional information such as the image caption and the question category. VQGRaD encodes the dense vectors of different inputs into two latent spaces, which allows generating, for a specific question category, relevant questions about the images, with or without their captions. We also explore the impact of domain knowledge incorporation (e.g., medical entities and semantic types) and data augmentation techniques on visual question generation in the medical domain. Experiments performed on the VQA-RAD dataset of clinical visual questions showed that VQGRaD achieves 61.86% BLEU score and outperforms strong baselines. We also performed a blinded human evaluation of the grammaticality, fluency, and relevance of the generated questions. The human evaluation demonstrated the better quality of VQGRaD outputs and showed that incorporating medical entities improves the quality of the generated questions. Using the test data and evaluation process of the ImageCLEF 2020 VQA-Med challenge, we found that relying on the proposed data augmentation technique to generate new training samples by applying different kinds of transformations, can mitigate the lack of data, avoid overfitting, and bring a substantial improvement in medical VQG.

Several depth image based rendering (DIBR) watermarking methods have been proposed, but they have various drawbacks, such as non-blindness, low imperceptibility, and vulnerability to signal or geometric distortion. This paper proposes a template based DIBR watermarking method that overcomes the drawbacks of previous methods. The proposed method exploits two properties to resist DIBR attacks: the pixel is only moved horizontally by DIBR, and the smaller block is not distorted by DIBR. The one dimensional (1D) discrete cosine transform (DCT) and curvelet domains are adopted to utilize these two properties. A template is inserted in the curvelet domain to restore the synchronization error caused by geometric distortion. A watermark is inserted in the 1D DCT domain to insert and detect a message from the DIBR image. Experimental results of the proposed method show high imperceptibility and robustness to various attacks, such as signal and geometric distortions. The proposed method is also robust to DIBR distortion and DIBR configuration adjustment, such as depth image preprocessing and baseline distance adjustment.

Ship detection in large-scene offshore synthetic aperture radar (SAR) images is crucial in civil and military fields, such as maritime management and wartime reconnaissance. However, the problems of low detection rates, high false alarm rates, and high missed detection rates of offshore ship targets in large-scene SAR images are due to the occlusion of objects or mutual occlusion among targets, especially for small ship targets. To solve this problem, this study proposes a target detection model (TAC_CSAC_Net) that incorporates a multi-attention mechanism for detecting marine vessels in large-scene SAR images. Experiments were conducted on two public datasets, the SAR-Ship-Dataset and high-resolution SAR image dataset (HRSID), with multi-scene and multi-size, and the results showed that the proposed TAC_CSAC_Net model achieves good performance for both small and occluded target detection. Experiments were conducted on a real large-scene dataset, LS-SSDD, to obtain the detection results of subgraphs of the same scene. Quantitative comparisons were made with classical and recently developed deep learning models, and the experiments demonstrated that the proposed model outperformed other models for large-scene SAR image target detection.

Hyperspectral image and LiDAR image fusion plays a crucial role in remote sensing by capturing spatial relationships and modeling semantic information for accurate classification and recognition. However, existing methods, like Graph Convolutional Networks (GCNs), face challenges in constructing effective graph structures due to variations in local semantic information and limited receptiveness to large-scale contextual structures. To overcome these limitations, we proposed a invariant attribute-driven binary bi-branch classification (IABC) method which is a unified network that combines binary Convolutional Neural Network (CNN) and GCN with invariant attributes. Our approach utilizes a joint detection framework that can simultaneously learn features from small-scale regular regions and large-scale irregular regions, resulting in an enhanced structured representation of HSI and LiDAR images in the spectral-spatial domain. This approach not only improves the accuracy of classification and recognition but also reduces storage requirements and enables real-time decision-making, which is crucial for effectively processing large-scale remote sensing data. Extensive experiments demonstrates the superior performance of our proposed method in hyperspectral image analysis tasks. The combination of CNNs and GCNs allows for accurate modeling of spatial relationships and effective construction of graph structures. Furthermore, the integration of binary quantization enhances computational efficiency, enabling real-time processing of large-scale data. Therefore, our approach presents a promising opportunity for advancing remote sensing applications using deep learning techniques.

In this work, the problem is considered for eliminating a non-uniform rectilinear smearing of an image by mathematical and computer-based way, for example, a picture of several cars taken with a fixed camera and moving with different speeds. The problem is described by a set of 1-dimensional Fredholm integral equations (IEs) of the first kind of convolution type with a 1-dimensional point spread function (PSF) at uniform smearing and by a set of new 1-dimensional IEs of a general type (not convolution type) with a 2-dimensional PSF at non-uniform smearing. The problem is also described by one 2-dimensional IE of convolution type with a 2-dimensional PSF at uniform smearing and by a new 2-dimensional IE of a general type with a 4-dimensional PSF at non-uniform smearing. The problem for solving Fredholm IE of the first kind is ill-posed (unstable). Therefore, IEs of convolution type are solved by the Fourier transform (FT) method and Tikhonov's regularization (TR), and IEs of general type are solved by the quadrature/cubature and TR methods. Moreover, the magnitude of the image smear Δ is determined by the original “spectral method”, which increases the accuracy of image restoration. It is shown that the use of a set of 1-dimensional IEs is preferable to one 2-dimensional IE in the case of non-uniform smearing. In the inverse problem (image restoration), the Gibbs effect (the effect of false waves) in the image may occur. It can be edge or inner. The edge effect is well suppressed by the proposed technique “diffusing the edges". In the case of an inner effect, it is eliminated with difficulty, but the image smearing itself plays the role of diffusing and suppresses the inner Gibbs effect to a large extent. It is shown (in the presence of impulse noise in an image) that the well-known Tukey median filter can distort the image itself, and the Gonzalez adaptive filter also distorts the image (but to a lesser extent). We propose a modified adaptive filter. A software package was developed in MatLab and illustrative calculations are performed.

Telemedicine is the use of Information and Communication Technology (ICT) for clinical health care from a distance. The exchange of radiographic images and electronic patient health information/records (ePHI/R) for diagnostic purposes has the risk of confidentiality, ownership identity, and authenticity. In this paper, a data hiding technique for ePHI/R is proposed. The color information in the cover image is used for key generation, and stego-images are produced with ideal case. As a result, the whole stego-system is perfectly secure. This method includes the features of watermarking and steganography techniques. The method is applied to radiographic images. For the radiographic images, this method resembles watermarking, which is an ePHI/R data system. Experiments show promising results for the application of this method to radiographic images in ePHI/R for both transmission and storage purpose.

Containing hundreds of spectral bands (features), hyperspectral images (HSIs) have high ability in discrimination of land cover classes. Traditional HSIs data processing methods consider the same importance for all bands in the original feature space (OFS), while different spectral bands play different roles in identification of samples of different classes. In order to explore the relative importance of each feature, we learn a weighting matrix and obtain the relative weighted feature space (RWFS) as an enriched feature space for HSIs data analysis in this paper. To overcome the difficulty of limited labeled samples which is common case in HSIs data analysis, we extend our method to semisupervised framework. To transfer available knowledge to unlabeled samples, we employ graph based clustering where low rank representation (LRR) is used to define the similarity function for graph. After construction the RWFS, any arbitrary dimension reduction method and classification algorithm can be employed in RWFS. The experimental results on two well-known HSIs data set show that some dimension reduction algorithms have better performance in the new weighted feature space.

Background/Objectives: To evaluate incidental findings in the mandible after the placement of dental implants using a new cone-beam computed tomography (CBCT) software. Methods: The initial sample consisted of 2,872 CBCT scans of patients of both sexes. The parameters evaluated in this study were the location of the implants in the mandible, implant length, anatomical relationship of the implant with the mandibular canal, presence or absence of damage to the adjacent teeth, presence or absence of implant fractures, and presence or absence of bone support. Fisher's exact test was performed to compare the variables. The significance level was set at p = 0.05. Results: Out of 2,872 CBCT scans, 214 images of patients with an average age of 44.5 years were included. The most frequent location of the implants was the posterior region (93.5%), with 54% of the implants having a length between 9 and 14 mm. It was found that 92% of the implants were positioned above the mandibular canal. Three damage to adjacent teeth was observed, with no correlation with the implant positioning (p = 0.999). In 100% of cases of implants in the anterior region, there was bone support. Fracture was observed in 1.7% of implants with a length between 9- and 14-mm. Conclusions: The installation of implants in the mandible occurs more frequently in the posterior region, with a high presence of bone support and a low incidence of damage to adjacent teeth, anatomical structures, and fractures.

Skin image analysis using artificial intelligence (AI) has recently attracted significant research interest, particularly for analyzing skin images captured by mobile devices. Acne is one of the most common skin conditions with profound effects in severe cases. In this study, we developed an AI system called AcneDet for automatic acne object detection and acne severity grading using facial images captured by smartphones. AcneDet includes two models for conducting two tasks: (1) a Faster R-CNN-based deep learning model for the detection of acne lesion objects of four types including blackheads/whiteheads, papules/pustules, nodules/cysts, and acne scars; and (2) a LightGBM machine learning model for grading acne severity using the Investigator’s Global Assessment (IGA) scale. The output of the Faster R-CNN model, i.e., the counts of each acne type, were used as input for the LightGBM model for acne severity grading. A dataset consisting of 1,572 labeled facial images captured by both iOS and Android smartphones was used for training. The results show that the Faster R-CNN model achieves a mAP of 0.54 for acne object detection. The mean accuracy of acne severity grading by the LightGBM model is 0.85. With this study, we hope to contribute to the development of artificial intelligent systems that are able to help acne patients understand more about their conditions and support doctors in acne diagnosis.

Brain tumor being one of the major health hazards always needs a prompt diagnosis for the early treatment options to improve the chances of the survival of the patients. Traditional manual assessment of MRI (magnetic resonance imaging) to identify these conditions is a common practice. Hence, automation of the diagnosis practices can considerably improve the quality of the treatment procedures. In recent years almost every method for the automated diagnosis of brain tumor detection uses a deep learning technique. Despite decent works current techniques need a significant improvement to produce better results. Along with failure to produce decent results, the current deep learning models present very complex architectures which sometimes require huge computational resources. Therefore, in this paper we present a novel method that uses a lightweight dual-stream model with dual-input to detect brain tumors on MRI images. Both the inputs use different pre-processing mechanisms based on Contrast Limited Adaptive Histogram Equalization (CLAHE) and White Patch Retinex algorithm in order to enhance the feature learning capabilities of the proposed model. In addition, the proposed method uses a two-fold margin loss to boost training process for better feature learning. The proposed method produces state-of-the-art results for the detection of Glioma, Meningioma and Pituitary tumors. The model presents accuracy of 99%, 98% and 99% respectively for Glioma, Meningioma and Pituitary tumor detection.

In this paper we develop and explore a methodical pipeline for swimmer localisation in outdoor environments. The developed framework is intended to be used for enhancing swimmer safety. A main issue we deal with by the proposed approach is the lack of real world training data in such outdoor environments. Natural lighting changes, dynamic water textures and possibly barely visible swimming persons are key elements to approach. We account for these difficulties by adopting an effective background removal technique with available training data. This allows us to edit swimmers into natural environment backgrounds for the use in subsequent image augmentation. We created 17 training datasets with real images, synthetic images and a mixture of both to investigate different aspects and characteristics of the proposed approach. The datasets are used to train a YOLO architecture for the possible future application in real-time detection. The trained framework is then tested and evaluated on outdoor environment imagery acquired by a safety drone to investigate and confirm the usefulness for outdoor swimmer localisation.

With the rapid advancements in remote sensing technology, the spectral information from hyperspectral remote sensing images has become increasingly rich, facilitating detailed spectral analysis of the Earth's surface objects. However, this abundance of spectral data poses significant challenges in data processing, such as the curse of dimensionality leading to the “Hughes” phenomenon, "strong correlation" due to high resolution, and "non-linear characteristics" caused by varied surface reflectance rates. Therefore, dimensionality reduction of hyperspectral data has become a crucial task. This paper, grounded in manifold theory and manifold learning techniques, and considering the non-linear structures and features in hyperspectral remote sensing data, elucidates the principles and processes of dimensionality reduction in hyperspectral remote sensing images using manifold learning, with a formalized expression of the process. This article introduces spectral information divergence (SID) into the nearest neighbor graph computation of manifold learning algorithms. The principles and computational processes of nearest neighbor graph algorithms based on Euclidean distance (ED), spectral angle mapping (SAM), and SID are studied, and a comparative analysis of the dimensionality reduction effects under these three metrics in hyperspectral data is conducted. Experiments on feature extraction under different metrics were performed using the publicly available Indian Pines hyperspectral dataset. The intrinsic features obtained post-dimensionality reduction were used as inputs for classification algorithms in ground objects classification experiments, with algorithm runtime, overall accuracy, and Kappa coefficient as evaluation metrics for dimensionality reduction quality. The results demonstrate that nearest neighbor graph computation based on SAM and SID outperforms traditional ED methods; SAM-based computation has the lowest time complexity, while SID-based manifold learning yields the highest accuracy in ground objects classification. Thus, manifold learning based on SAM and SID metrics proves to be an effective method for feature extraction in hyperspectral remote sensing data, underscoring the potential of manifold learning techniques in the dimensionality reduction of hyperspectral remote sensing images.

Several studies in computer vision have examined specular removal, which is crucial for object detection and recognition. This research has traditionally been divided into two tasks: specular highlight removal, which focuses on removing specular highlights on object surfaces, and reflection removal, which deals with specular reflections occurring on glass surfaces. In reality, however, both types of specular effects often coexist, making it a fundamental challenge that has not been adequately addressed. Recognizing the necessity of integrating specular components handled in both tasks, we constructed a Specular-Light (S-Light) DB for training single-image-based deep learning models. Moreover, considering the absence of benchmark datasets for quantitative evaluation, the Multi-Scale Normalized Cross Correlation (MS-NCC) metric, which considers the correlation between specular and diffuse components, was introduced to assess the learning outcomes.

With the development of remote sensing satellite technology for Earth observation, remote sensing stereo images have been used for three-dimensional reconstruction in various fields, such as urban planning and construction. However, remote sensing images often include noise, occluded regions, weakly textured areas and repeated textures, which can lead to reduced accuracy in stereo matching and affect the quality of the 3D reconstruction results. To reduce the impact of complex scenes in remote sensing images on stereo matching and to ensure both speed and accuracy, we propose a new end-to-end stereo matching network based on convolutional neural networks (CNNs). The proposed stereo matching network can learn features at different scales from the original images and construct cost volumes with varying scales to obtain richer scale information. Additionally, when constructing the cost volume, we introduce negative disparity to adapt to the common occurrence of both negative and nonnegative disparities in remote sensing stereo image pairs. For cost aggregation, we employ a 3D convolution-based encoder-decoder structure that allows the network to adaptively aggregate information. Before feature aggregation, we also introduce an attention module to retain more valuable feature information, enhance feature representation, and obtain a higher-quality disparity map. By training on the publicly available US3D dataset, we obtain the accuracy that 1.115 pixel in end-point error (EPE) and 5.32% in the error pixel ratio (D1) on the test dataset, and the inference speed is 92 ms. Comparing our model with existing state-of-the-art models, we achieve higher accuracy, and the network is beneficial for the three-dimensional reconstruction of remote sensing images.

The corrugated board is a versatile and durable material that is widely used in the packaging industry. Its unique structure provides strength and cushioning, while its recyclability and bio-degradability make it an environmentally friendly option. The strength of corrugated board depends on many factors, including the type of individual papers on flat and corrugated layers, the geometry of the flute, temperature, humidity, etc. This paper presents a new approach to analysis geometric features of corrugated boards based on the images. It allows for precise determination of the geometry of the corrugated layer, as well as the thickness of individual papers in all cardboard layers. The experimental set used in the work and the created software are characterized by high reliability and precision of measurement thanks to the use of an identification procedure based on image analysis and evolutionary algorithms. This allows to quickly find the main geometric characteristics of the corrugated board, which in turn leads to the possibility of performing numerical analyzes taking into account the real model of the corrugated board. Calculations made on a real (correctly mapped geometrically) model allow, for example, a more reliable analysis of the composition of the cardboard, and thus also to obtain greater savings in the optimization process.

Manual interpretation of these huge amounts of image volumes are susceptible to inter-reader variability and human error. Thus, accurate automated CAD scheme is highly desirable in clinical pathological diagnosis. In this research, plethora of machine learning paradigms (e.g. feature extraction, dimensionality reduction and supervised classification methods) were explored, evaluated, compared and analyzed to identify the optimal pathway for brain MR images (normal vs neoplastic) binary classification task. External validation dataset was used to test the generalizability of the optimal predictive models implemented. Relevant and informative features were selected to construct cross-validated decision tree and eventually simple rule set was built based on the decision tree. The experimental results show that almost all pattern recognition paradigms achieve high accuracy with careful selection of number of attributes. LDA+ELM with 55 features are the optimal pipelines which achieve perfect classification when training and test data are of same source; and achieving (accuracy=97.5%, AUC=0.989, sensitivity=95% and specificity=100%) under balanced test dataset; (accuracy=99.5%, AUC=0.988, sensitivity=95% and specificity=100%). Cross-validated decision tree model also shows comparable performance: accuracy=98.8%, AUC=99.1%, sensitivity=99.6% and specificity=98.2%. Three highly relevant and robust attributes are visualized and selected for construction of decision tree models and finally a rule sets are read directly off the decision tree. This rule sets can potentially serve as fast and accurate classification algorithm.

In recent years, remote sensing technology has been widely used to predict forest stand parameters. In order to compare the effects of different features of remote sensing images and topographic information on the prediction of forest stand parameters, multivariate stepwise regression analysis method was used to build estimation models for important forest stand parameters by using textural and spectral features as well as topographic information of SPOT-5 satellite images in northeastern Heilongjiang Province in China as independent variables. The study results show that the optimal window to predict forest stand parameters using textural features of SPOT-5 satellite image is 9×9; the ability of textural features was better than that of spectral features in terms of predicting forest stand parameters; with the inclusion of topographic information, the accuracy of prediction of all models was improved, of which elevation has the most significant effect. The highest accuracy was achieved when predicting the stand volume (SV) (R²_adj=0.820), followed by basal area (BA) (R²_adj =0.778), accuracy of both above models exceeded 75%. The results show that models combined use of textural, spectral features and topographic information of SPOT-5 images have a good application prospect in predicting forest stand parameters.

Recent advancements in computer vision, especially deep learning models, have shown considerable promise in tasks related to plant image object detection. However, the efficiency of these deep learning models heavily relies on input image quality, with low-resolution images significantly hindering model performance. Therefore, reconstructing high-quality images through specific techniques will help extract features from plant images, thus improve model performance. In this study, we explored the value of super-resolution technology for improving object detection model performance on plant images. Firstly, we built a comprehensive dataset comprising 1030 high-resolution plant images, named the PlantSR dataset. Subsequently, we developed a super-resolution model using the PlantSR dataset and benchmarked it against several state-or-the-art models designed for general image super-resolution tasks. Our proposed model demonstrated superior performance on the PlantSR dataset, indicating its efficacy in enhancing the super-resolution of plant images. Furthermore, we explored the effect of super-resolution on two specific object detection tasks: apple counting and soybean seed counting. By incorporating super-resolution as a pre-processing step, we observed a significant reduction in mean absolute error. Specifically, on the YOLOv7 model employed for apple counting, the mean absolute error decreased from 13.085 to 5.71. Similarly, on the P2PNet-Soy model utilized for soybean seed counting, the mean absolute error decreased from 19.159 to 15.085. These findings underscore the substantial potential of super-resolution technology in improving the performance of object detection models for accurately detecting and counting specific plants from images. The source codes and associated datasets are available at https://github.com/SkyCol/PlantSR.

Vegetation identification using remote sensing is essential for understanding terrestrial ecosystems and monitoring climate change. This technology by providing high-resolution images of the Earth's surface from satellites, aircraft, and drones has revolutionized the way scientists study and un-derstand vegetation patterns, providing information on the distribution, structure, and health of plant communities in different regions and biomes. However, identifying vegetation in multi and hyperspectral images remains a difficult, time-consuming, and costly process. Traditional methods for vegetation mapping involve the in-terpretation of spectral indices such as the Normalized Difference Vegetation Index (NDVI), alt-hough they often suffer from limitations such as manual interpretation and limited spatial resolution of satellite images. Furthermore, machine learning techniques, artificial neural networks, decision trees, support vector machines, and random forests have shown promising results in identifying and classifying vegetation cover from hyperspectral images. However, due to the need for per-son-nel with specialized expertise, their application on a large scale is still challenging. On the other hand, correlation methods between curves have emerged as powerful and simplified tool for comparing spectral signatures of hyperspectral image pixels and efficiently classifying vegetation in a study area. Pearson's correlation coefficient and spectral angle mapper are among the most common correlation methods used in vegetation mapping. These correlation methods, among many others available, offer an easily implemented and computationally efficient approach, making them particularly useful for applications in developing countries or regions with limited resources. In this article, a comparative study of correlation/distance metrics was conducted for the detection of vegetation pixels in hyperspectral images. The study allowed for the comparison of five distance and/or correlation metrics: direct correlation, cosine similarity, normalized Euclidean distance, Bray-Curtis’s distance, and Pearson correlation. The two metrics that yielded the best accuracy results in vegetation pixel detection were direct correlation and Pearson correlation. Based on the selected methods, a vegetation detection algorithm was implemented and validated on a hyper-spectral image of the Manga neighborhood in Cartagena de Indias, Colombia. The spectral library was utilized for image processing, while the numpy and scipy libraries in the Python programming language were used for the mathematical calculation of correlations. Both the study's approach and the implemented algorithm aim to serve as a reference for conducting detection studies of various material types in hyperspectral images using open-access programming platforms.

There is great interest in automatically detecting road weather and understanding its impacts on the overall safety of the transport network. This can, for example, support road condition-based maintenance or even serve as detection systems that assist safe driving during adverse climate conditions. In computer vision, previous work has demonstrated the effectiveness of deep learning in predicting weather conditions from outdoor images. However, training deep learning models to accurately predict weather conditions using real-world road-facing images is difficult due to: (1) the simultaneous occurrence of multiple weather conditions; (2) imbalanced occurrence of weather conditions throughout the year; and (3) road idiosyncrasies, such as road layouts, illumination, road objects etc. In this paper, we explore the use of focal loss function to force the learning process to focus on weather instances that are hard to learn with the objective to help address data imbalance. In addition, we explore the attention mechanism for pixel based dynamic weight adjustment to handle road idiosyncrasies using state-of-the-art vision transformer models. Experiments with a novel multi-label road weather dataset show that focal loss significantly increases the accuracy of computer vision approaches for imbalanced weather conditions. Furthermore, vision transformers outperforms current state-of-the-art convolutional neural networks in predicting weather conditions with a validation accuracy of 92% and F1-score of 81.22%, which is impressive considering the imbalanced nature of the dataset.