This paper addresses the evolving landscape of electricity markets in Europe, with a focus on the integration of Renewable Energy Communities as introduced by the Renewable Energy Directive 2018/2001. Residents within a postal code area are highly incentivized to join a community, which enables them to exchange energy among themselves at lower procurement costs. Thereby, energy management systems optimize the operation of respective energy systems, with electrical load forecasting playing a key role. Given that prosumers may switch between communities on a daily basis, electricity demands within these groups will vary, leading to data that is non-stationary, discontinuous as well as non-identical and independently distributed. To encounter this issue, we propose a sophisticated forecasting model that applies federated learning, using informations from various distributed communities to learn domain-invariant features. To achieve this, we initially utilize synthetic electrical load time series at district level and aggregate them to profiles of Renewable Energy Communities with dynamic portfolios. Subsequently, we develop a forecasting model that accounts for the composition of residents of a Renewable Energy Community, adapt data pre-processing in accordance with the time series process, and detail a federated learning algorithm that incorporates weight averaging and data sharing. Following the training of various experimental setups, we ultimately evaluate their effectiveness. The findings suggest that our proposed framework is capable of effectively forecast non-stationary and discontinuous time series and that it can be applied to new, unseen data through the integration of knowledge from multiple sources.

Climate change is increasing air temperatures and altering the precipitation and hydrological re-gime on a global scale. Challenges arise when assessing the impacts of climate change on the local scale for water resources management proposes, especially for low mountain headwater catch-ments that not only serve as important water towers for local communities, but also have distinct hydrological characteristics. Until now, no low flow or hydrological drought studies have been carried out on the Lauter River. This study is unique in that it compares the Lauter River, a transboundary Rhine tributary with a nearby station on the River Rhine just below its confluence at the French-German border. The Lauter catchment is a mostly natural, forested catchment, however, its water course has been influenced by past and present cultural activities. Climate change disturbances cascade through the hydrologic regime right down to the local scale. As we are expecting more low flow events, the decrease in water availability could cause conflicts be-tween different water user groups in the Lauter catchment. However, the choice of different methods for identifying low flow periods may cause confusion for local water resources manag-ers. Using flow rate time series of the Lauter River between 1956 and 2022 we compare for the first time three low flow identification methods: the variable threshold method (VT), the fixed threshold method (FT), and the Standardized Streamflow Index (SSI). Similar analyses are applied and compared to the adjacent Maxau station on the Rhine River for the same time period. This study aims at 1) interpreting the differences amongst the various low flow identification methods and 2) revealing the differences in low flow characteristics of the Lauter catchment compared to the Rhine River. It appears that the FT reacts faster to direct climate or anthropogenic impacts whereas VT is more sensitive to indirect factors such as decreasing subsurface flow which is typical for small headwater catchments, such as the Lauter where flow dynamics react faster to flow disturbances. Abnormally low flow during the early Spring in tributaries such as the Lauter can help predict low flow conditions of the Rhine River during the following half year and espe-cially for the summer. The results could facilitate Early Warning of hydrological droughts and drought management for water users in the Lauter catchment and further downstream along some of the Rhine.

Iron (Fe), the main component of non-exhaust particulates, is known to have variable health effects that depend on the chemical species of iron. This study characterized the possible contribution of iron oxides and hydroxides to airborne brake-wear particles under realistic vehicle driving and braking conditions with different brake-pad friction materials. We found significant differences in wear coefficients and PM₁₀ emissions between non-asbestos organics (NAO) and European performance (ECE) brake pads. Iron was the dominant contributor to PM₁₀ and PM_2.5 brake-wear particles for both NAO and ECE. The iron concentration ratio in the particle mass were comparable to the disc to pads ratio measured by wear mass. The fact that magnetite, which is of interest with respect to health effects, was less abundant in NAO than in ECE suggested that tribo-oxidations occurred in NAO. Metallic iron is generated not only from abrasive wear but also from tribo-chemical reduction with magnetite as the starting material. We found differences not only in PM emissions between brake friction materials but also that the phase transformations of iron differed between friction materials. These differences were apparent in the distribution of iron oxides and hydroxides. Heat, tribo-oxidation, and tribo-reduction are intricately involved in these reactions.

Segmentation is an important step in medical imaging. In particular, machine learning, especially deep learning, has been widely used to efficiently improve and speed up the segmentation process in clinical practice. Despite the acceptable segmentation results of multi-stage models, little attention was paid to the use of deep learning algorithms for brain image segmentation, which could be due to the lack of training data. Therefore, in this paper, we propose a Generative Adversarial Network (GAN) model that performs transfer learning to segment MRI brain images.Our model enables the generation of more labeled brain images from existing labeled and unlabeled images. Our segmentation targets brain tissue images, including white matter (WM), gray matter (GM), and cerebrospinal fluid (CSF). We evaluate the performance of our GAN model using a commonly used evaluation metric, which is Dice Coefficient (DC). Our experimental results reveal that our proposed model significantly improves segmentation results compared to the standard GAN model. We observe that our model is 2.1–10.83 minutes faster than stat-of-the-art-models.

Human beatboxing is a vocal art making use of speech organs to produce vocal drum sounds and imitate musical instruments. Beatbox sound classification is a current challenge that can be used for automatic database annotation and music-information retrieval. In this study, a large-vocabulary humanbeatbox sound recognition system was developed with an adaptation of Kaldi toolbox, a widely-used tool for automatic speech recognition. The corpus consisted of eighty boxemes, which were recorded repeatedly by two beatboxers. The sounds were annotated and transcribed to the system by means of a beatbox specific morphographic writing system (Vocal Grammatics). The image processing techniques plays vital role on image Acquisition, image pre-processing, Clustering, Segmentation and Classification techniques with different kind of images such as Fruits, Medical, Vehicle and Digital text images etc. In this study the various images to remove unwanted noise and performs enhancement techniques such as contrast limited adaptive histogram equalization, Laplacian and Harr filtering, unsharp masking, sharpening, high boost filtering and color models then the Clustering algorithms are useful for data logically and extract pattern analysis, grouping, decision-making, and machine-learning techniques and Segment the regions using binary, K-means and OTSU segmentation algorithm. It Classifying the images with the help of SVM and K-Nearest Neighbour(KNN) Classifier to produce good results for those images.

Multimodal medical image fusion is a fundamental but challenging problem in the fields of brain science research and brain disease diagnosis, and it is challenging for sparse representation (SR)-based fusion to characterize activity level with single measurement and no loss of effective information. In this paper, the Kronecker-criterion-based SR framework is applied for medical image fusion with a patch-based activity level integrating salient features of multiple domains. Inspired by the formation process of vision system, the spatial saliency is characterized by textural contrast (TC), which is composed of luminance and orientation contrasts to promote more highlighted texture information to participate in the fusion process. As substitution of the conventional l1-norm-based sparse saliency, a metric of sum of sparse salient features (SSSF) is used for promoting more significant coefficients to participate in the composition of activity level measure. The designed activity level measure is verified to be more conducive to maintain the integrity and sharpness of detailed information. Various experiments on multiple groups of clinical medical images verify the effectiveness of the proposed fusion method on both visual quality and objective assessment. Furthermore, the research work of this paper is helpful for further detection and segmentation of medical images.

Based upon Maxwell's equations, it has long been established that oscillating electromagnetic (EM) fields incident upon a metal surface decay exponentially inside the conductor, leading to a virtual EM vacuum at sufficient depths. Magnetic resonance imaging (MRI) utilizes radiofrequency (r.f.) EM fields to produce images. Here we present the first visualization of a virtual EM vacuum inside a bulk metal strip by MRI, amongst several novel findings. We uncover unexpected MRI intensity patterns arising from two orthogonal pairs of faces of a metal strip, and derive formulae for their intensity ratios, revealing differing effective elemental volumes (voxels) underneath these faces. Further, we furnish chemical shift imaging (CSI) results that discriminate different faces (surfaces) of a metal block according to their distinct nuclear magnetic resonance (NMR) chemical shifts, which holds much promise for monitoring surface chemical reactions noninvasively. Bulk metals are ubiquitous, and MRI is a premier noninvasive diagnostic tool. Combining the two, the emerging field of bulk metal MRI can be expected to grow in importance. The fundamental nature of results presented here may impact bulk metal MRI and CSI across many fields.

Diffusion magnetic resonance imaging (dMRI) is an imaging technique that provides information on the microstructural organization of biological tissue. dMRI allows for non-invasive visualization and quantitative assessment of white matter architecture in the brain by characterizing restrictions on the random motion of water molecules. Ultra-high field MRI scanners, such as those operating at 7 Tesla (7T) or higher, can boost signal-to-noise ratio (SNR) to improve dMRI compared with what is attainable at conventional field strengths such as 3T or 1.5T. However, at 7T wavelength effects cause lower transmit magnetic field efficiency in the human brain, mainly in the posterior fossa region, manifesting as signal dropouts in this region. Recently, we reported a simple approach of using a wireless radiofrequency (RF) surface array to improve transmit efficiency and signal sensitivity at 7T. Here we demonstrate the feasibility and effectiveness of using this RF enhancer for in-vivo dMRI at 7T. The use of the RF enhancer can effectively recover signal dropouts in the regions with intrinsically lower SNR such as cerebellum, leading to a better depiction of principal fiber orientations and enhanced visualization of extended tracts to the brainstem and pons enabling more comprehensive delineation of the full white matter architecture.

This review provides an overview of eXplainable AI (XAI) methods for oncological ultrasound image analysis and compares their performance evaluations. A systematic search of Medline Embase and Scopus between March 25 and April 14 2024 identified 17 studies describing 14 XAI methods, including visualization, semantics, example-based, and hybrid functions. These methods primarily provided specific, local, and post-hoc explanations. Performance evaluations focused on AI model performance, with limited assessment of explainability impact. Standardized evaluations incorporating clinical end-users are generally lacking. Enhanced XAI transparency may facilitate AI integration into clinical workflows. Future research should develop real-time methodologies and standardized quantitative evaluative metrics.

The popularity of handheld devices for point-of-care ultrasound (POCUS) has increased in recent years due to their portability and cost-effectiveness. However, POCUS has the drawback of lower imaging quality compared to conventional ultrasound, because of hardware limitations. Improving the quality of POCUS through post-image processing would therefore be beneficial, with deep learning approaches showing promise in this regard. This review investigates the state-of-the-art progress of image enhancement using deep learning suitable for POCUS applications. A systematic search was conducted from January 2024 to February 2024 on PubMed and Scopus. From the 457 articles that were found, the full text was retrieved for 69 articles. From this selection, 15 articles were identified addressing multiple quality enhancement aspects. A disparity in the baseline performance of the low-quality input images was seen across these studies, ranging between 8.65–29.24 dB for the Peak Signal-to-Noise Ratio (PSNR) and 0.03-0.71 for the Structural Similarity Index Measure (SSIM). In six studies, where both PSNR and the SSIM metrics were reported for the baseline and the generated images a mean difference of 6.60 (SD ± 2.99) and 0.28 (SD ± 0.15) was observed for the PSNR and SSIM, respectively. The reported performances demonstrate the potential of deep-learning-based image enhancement for POCUS. However, variability in the extent of performance gain across datasets and articles was notable, and the heterogeneity across articles makes quantifying the exact improvements challenging.

Twelve clinically healthy and sexually mature New Zealand White rabbits were studied. The non-contrast imaging included T1-weighted and T2-weighted spin echo and gradient echo sequences in transverse, sagittal and dorsal planes. Transverse MRI (Т2-weighted image) through L1 demonstrated only the right kidney. The transverse T2-weighted image through L2 showed both kidneys. The cranial part of the urinary bladder on T1-weighted transverse scans through L4 was flexed to the left. The T2-weighted sagittal image 30 mm to the right of the median plane showed the right kidney, the right ureter and the urinary bladder. The T2-weighted sagittal image 30 mm to the left of the median plane showed part of the left kidney, the left ureter and the urinary bladder. The T2-weighted sagittal image 45 mm to the left of the median plane presented the lateral part of the left kidney. The dorsal MRI image (Т2-weighted sequence) through the horizontal plane 30 mm ventral to the spine demonstrated the whole organs. The data will be useful in imaging anatomy and diagnostic studies of various pathologies of the excretory system in rabbits and other mammalian species.

Snow parameters have traditionally been retrieved using discontinuous, multi-band sensors; however, continuous hyperspectral sensor are now being developed as an alternative. In this paper we investigate the performance of various sensor configurations using machine learning neural networks trained on a simulated dataset. Our results show improvements in accuracy of retrievals of snow grain size and impurity concentration for continuous hyperspectral channel configurations. Retrieval accuracy of snow albedo was found to be similar for all channel configurations.

We study the brain segmentation by dividing the brain into multiple tissues. Given possible brain segmentation by deep, machine learning can be efficiently exploited to expedite the segmentation process in the clinical practice. To accomplish segmentation process, a MRI and tissues transfer using generative adversarial networks is proposed. Given the better result, we propose the transfer model using GAN. For the case of the brain tissues, white matter (WM), gray matter (GM) and cerebrospinal fluid (CSF) are segmented. Empirical results show that this proposed model significantly improved segmentation results compared to the stat-of-the-art results. Furthermore, a dice coefficient (DC) metric is used to evaluate the model performance.

Medical image segmentation is a critical step in various healthcare applications, aiding in diagnosis, treatment planning, and disease monitoring. In this study, we investigate the efficacy of a segmentation approach based on the 2D wavelet transform. Leveraging a dataset comprising 10 diverse medical images, we evaluate the performance of our segmentation method using three key metrics: accuracy, precision, and recall. Our findings demonstrate that the proposed approach enhances segmentation accuracy, offering promising results compared to existing methods. By harnessing the multi-resolution feature extraction capabilities of the 2D wavelet transform, our method achieves improved delineation of medical image structures, paving the way for more accurate and efficient healthcare interventions.

Enclosed public spaces are the hotspots for airborne disease transmission. To measure and maintain indoor air quality in terms of airborne transmission, an open source, low cost and distributed array of Particulate Matter Sensors has been developed and named as Dynamic Aerosol Transport for Indoor Ventilation or DATIV system. This system can use multiple Particulate Matter Sensors (PMS) simultaneously and can be remotely controlled using a Raspberry Pie based operating system. The data acquisition system can be easily operated using the GUI within any common browser installed on a remote device such as a PC or Smartphone with corresponding IP address. The software architecture and validation measurements are presented together with possible future developments.

In this multicenter, retrospective study we evaluated the added value of magnetic resonance dispersion imaging (MRDI) to standard multiparametric MRI (mpMRI) for PCa detection. The study included 76 patients - 51 with clinically significant prostate cancer (csPCa), who underwent radical prostatectomy and had an mpMRI including dynamic contrast enhanced-MRI. Two radiologists performed three separate randomized scorings based on mpMRI, MRDI and mpMRI+MRDI. Radical prostatectomy histopathology was used as the reference standard. Imaging and histopathology were both scored according to the Prostate Imaging-Reporting and Data System V2.0 sector map. Sensitivity and specificity for PCa detection were evaluated for mpMRI, MRDI and mpMRI+MRDI. Inter- and intra-observer variability for both radiologists were evaluated using Cohen’s Kappa. On a per patient level, sensitivity for csPCa for radiologist 1 (R1) for mpMRI, MRDI and mpMRI+MRDI were 0.94, 0.82 and 0.94, respectively. For the second radiologist (R2) these were 0.78, 0.94 and 0.96. R1 detected 4% additional csPCa cases using MRDI compared to mpMRI and R2 detected 20% extra csPCa cases using MRDI. Inter-observer agreement was significant only for MRDI (Cohen’s kappa = 0.4250, p=0.004). The results of this study show the potential of MRDI to improve interobserver variability and the detection of csPCa.

Underwater imaging presents unique challenges, notably color distortions and reduced contrast due to light attenuation and scattering. Most underwater image enhancement methods, first use linear transformations for color compensation and then enhance the image. We observed that linear transformation for color compensation is not suitable for certain images. For such images, a non-linear mapping is a better choice. Our paper introduces a unique underwater image restoration approach leveraging a streamlined convolutional neural network (CNN) for dynamic weight learning for linear and non-linear mapping. In the first phase, a classifier is applied that classifies the input images into Type-I or Type-II. In the second phase, depending on the classification, the Deep Line Model (DLM) for Type-I images or the Deep Curve Model (DCM) for Type-II images. For mapping an input image to an output image, DML creatively combines color compensation and contrast adjustment in a single step and uses deep lines for transformation, whereas DCM employs higher-order curves. Both models utilize lightweight neural networks that learn per-pixel dynamic weights based on the input image’s characteristics. Comprehensive evaluations on benchmark datasets using metrics like peak signal-to-noise ratio(PSNR) and root mean squares error (RMSE) affirm our method’s effectiveness in accurately restoring underwater images, outperforming existing techniques.

Desertification and dune progression over vegetation is quantified using remote sensing data, but vegetation, eventually temporarily, buried under sand blowout may escape such assessment, and to estimate the extent of buried vegetation, a GPR campaign was conducted over the coastal sand-dune of Tottori Prefecture (Japan) in combination with a high-resolution topographic UAV-based survey of the topography. The result shows that buried vegetation exists underneath sand-blowout, especially near the dune ridges, and that this vegetation can extend 20 – 30 m further than the estimation made from airborne remote sensing. Furthermore, the presence of palaeo-vegetation in palaeodune layers also provide information on the long-term evolution of sand dunes (with periods of stability vs rapid change), which can be used to reconstruct Quaternary coastal environments.

The key links of face recognition are digital image preprocessing, facial feature extraction and pattern recognition, this article aimed at the current problem of slow speed and low recognition accuracy of face recognition , from the above three key links, on the basic of analyzing the therories of Fractional Differential Masks Operator (FDMO), Principal Component Analysis (PCA) and Support Vector Machine (SVM), design a kind of FDMO+PVA+SVM coupling algorithm that applies to face recognition to improve the speed and accuracy of it. To realize FDMO+PCA+SVM coupling algorithm, first, we should apply FDMO to face image processing binary marginalization, the purpose is getting face contour; Then, we apply PCA to get the feature of face image which is disposed by binary marainalization. At last, we can apply One-Against All of the SVM classifier and LibSVM software package to realize face recognition. Beside, the article with nine different coupling algorithm design four groups of experimental reaults on the ORL face database verified by comparative analysic FDMO+PCA+SVM coupling algorithm in the superiority of face recognition accuracy and speed.

Open-vocabulary learning has recently gained prominence as a means to enable image segmentation for arbitrary categories based on textual descriptions. This advancement has extended the applicability of segmentation systems to a broader range of generally purpose scenarios. However, current methods often revolve around specialized architectures and parameters tailored to specific segmentation tasks, resulting in a fragmented landscape of segmentation models. In response to these challenges, we introduce OVAMTSeg, a versatile framework designed for Open-Vocabulary and Multitask Image Segmentation. OVAMTSeg harnesses adaptive prompt learning to empower the model to capture category-sensitive concepts, enhancing its robustness across diverse multi-task and scenario contexts. Text prompts are employed to effectively capture semantic and contextual features of the text, while cross-attention and cross-modal interactions enable the fusion of image and text features. Furthermore, a transformer-based decoder is incorporated for dense prediction. Extensive experimental results underscore the effectiveness of OVAMTSeg, showcasing its state-of-the-art performance and superior generalization capabilities across three segmentation tasks. Notable achievements include a 47.5 mIoU in referring expression segmentation, 51.6 mIoU on Pascal-VOC with four unseen classes, 46.6 mIoU on Pascal-Context in zero-shot segmentation, 65.9 mIoU on Pascal-5i, and 35.7 mIoU on COCO-20i datasets for one-shot segmentation.

The paper describes the new method for image compression based on coordinated group signal transformation. The algorithm is a type of difference coding. Coordinated processing significantly simplifies the difference signal conversion scheme using a single group codec for all signals. The described method considers color channels as correlated signals of a multi-channel communication system. The specifics of the processed data required modification of the coordinated group processing algorithm. First, we changed how to calculate the difference signals to prevent data loss. Secondly, the group codec was supplemented with a neural network to improve the quality of reconstructed images. We considered the following types of neural networks: fully connected, recurrent, convolution, and convolution in the Fourier space. Based on the simulation results, it is best to use fully connected neural networks if the goal is to minimize processing delay time. These networks have a response time of 13 ms. On the other hand, if the priority is to improve quality in cases where delays are not critical, then convolution neural networks in the Fourier space should be used. These networks have a response time of 140 ms and are of significant interest.

Color image binarization plays a pivotal role in image preprocessing work, significantly impacting subsequent tasks, particularly in text recognition. This paper concentrates on Document Image Binarization (DIB), aiming to separate a image into foreground (text) and background (non-text content). Through a thorough analysis of conventional and deep learning-based approaches, we conclude that prevailing DIB methods leverage deep learning technology. Furthermore, we explore the receptive fields pre- and post-network training to underscore the Transformer model's advantages. Subsequently, we introduce a lightweight model based on the U-Net structure, enhanced with the Mobile ViT module to better capture global information features in document images. Given its adeptness at learning both local and global features, our proposed model exhibits superior performance on two standard datasets (DIBCO2012 and DIBCO2017) compared to state-of-the-art methods. Notably, our proposed DIB method presents a straightforward end-to-end model devoid of additional image preprocessing or post-processing. Moreover, its parameter count is less than a quarter of the HIP'23 model, which achives best results on three datasets(DIBCO2012, DIBCO2017 and DIBCO2018). Finally, two sets of ablation experiments were conducted to verify the effectiveness of the proposed binarization model.

Polyethylene terephthalate (PET) is one of the most produced plastic materials in the world. The emer-gence of microplastics and nanoplastics (MPs/NPs) as a significant environmental contaminant has become a matter of increasing concern. While the toxicological effects of PET NPs have been widely re-searched, there is a lack of methodologies for studying their accumulation. The present study introduces a novel method to monitor the distribution of PET NPs in germinating wheat (Triticum aestivum L.) seeds. This involves the functionalization of superparamagnetic iron oxide nanoparticles (SPIONs) with PET NPs (PET-fSPION) coupled with magnetic resonance microimaging (µMRI) to provide insight into their distribution within the seed. The present study has demonstrated that PET-fSPION accumulates in specific regions of germinating wheat seeds, including the shoot apical meristem, the radicle, the cole-optile, the plumule, and the scutellum. Furthermore, the accumulation of PET-fSPION has been shown to exert a discernible effect on spin-spin relaxation, as observed via MRI and quantitative T2 relaxation time analysis. The accumulation of PET NPs in embryo regions was also confirmed by SEM. Diffu-sion-weighted magnetic resonance imaging (DW-MRI) and non-invasive chemical shift imaging analyses demonstrated that PET NPs resulted in restricted diffusion within the highlighted areas, as well as an impact on lipid content. Our study reveals that using µMRI with fSPION provides a non-invasive method to monitor the biodistribution of PET nanoparticles in wheat seeds. Additionally, it offers valuable in-sights into the microstructural interactions of PET.

Convolutional Neural Networks (CNNs) present drawbacks for modeling geometric transformations, such as scaling and rotation, caused by the convolution operation’s locality. Deformable convolution (DCON), a mechanism that substitutes standard convolution, increasing the receptive field to capture relevant features, is a promising approach to solve this drawback and improve the robustness of CNNs. However, the optimal way to replace the standard convolution with its deformable counterpart in a CNN model is unclear. In this study, we clarify this aseveration by conducting several experiments using deformable convolutions applied in the layers that conform a small four-layer CNN model. We also use deformable convolutions on the four-layers of several ResNet CNNs with depths 18, 34, 50, and 101. The models were tested in binary balanced classes with 2D data for image classification: Cats & Dogs, EyesPACS, Spyders & Chickens, and Shapes. After this testing, we evaluated DCON in 3D data for action recognition: UCF101 and Human2 (a dataset we compiled to control movement, clothing and background). The contribution of this research lies in a guideline to use DCON. It can be summarized as follows: if DCON is used on the first layers of the proposal of model (with simple features), the computational resources expressed as the quantity of Flops will tend to increase and produce bigger misclassification than the standard CNN. However, if the DCON is used at the end layers, the quantity of Flops used in the training and testing will decrease, and the classification accuracy will improve by up to 20% about the base model. Moreover, it gains robustness when using deformable convolutions because it can adapt to the region of interest. Also, the best kernel size of the DCON is three. It showed better results than size five. In the last case, the quantity of Flops increase quadratically, but their performance does not increase significantly. With these results, we propose a guideline to use the DCON and contribute to understanding the impact of DCON on the robustness of CNNs.

Precision agriculture is a farm management technology that involves sensing and then responding to the observed variability in the field. Remote sensing is one of the tools of precision agriculture. The emergence of small unmanned aerial vehicles (sUAV) have paved the way to accessible remote sensing tools for farmers. This paper describes the comparison of two popular off-the-shelf sUAVs: 3DR Iris and DJI Phantom 2. Both units are equipped with a camera gimbal attached with a GoPro camera. The comparison of the two sUAV involves a hovering test and a rectilinear motion test. In the hovering test, the sUAV was allowed to hover over a known object and images were taken every second for two minutes. The position of the object in the images was measured and this was used to assess the stability of the sUAV while hovering. In the rectilinear test, the sUAV was allowed to follow a straight path and images of a lined track were acquired. The lines on the images were then measured on how accurate the sUAV followed the path. Results showed that both sUAV performed well in both the hovering test and the rectilinear motion test. This demonstrates that both sUAVs can be used for agricultural monitoring.

Brain magnetic resonance imaging (MRI) offers a unique lens to study neuroanatomic support of human neurocognition and intelligence. A core mystery is the MRI explanation of individual differences in neurocognition and intelligence. The past four decades have seen great advancement in studying this century-long mystery, but the sample size and population-level studies limit the explanation at the individual level. The recent rise of big data and artificial intelligence offers novel opportunities. Yet, data sources, harmonization, study design, and interpretation need to be carefully considered. This review aims to summarize past work, discuss rising opportunities and challenges, and facilitate further investigations on machine intelligence inferring human intelligence.

Medical brain image analysis is a necessary step in the Computers Assisted /Aided Diagnosis (CAD) systems. Advancements in both hardware and software in the past few years have led to improved segmentation and classification of various diseases. In the present work, we review the published literature on systems and algorithms that allow for classification, identification, and detection of White Matter Hyperintensities (WMHs) of brain MRI images specifically in cases of ischemic stroke and demyelinating diseases. For the selection criteria, we used the bibliometric networks. Out of a total of 140 documents we selected 38 articles that deal with the main objectives of this study. Based on the analysis and discussion of the revised documents, there is constant growth in the research and proposal of new models of deep learning to achieve the highest accuracy and reliability of the segmentation of ischemic and demyelinating lesions. Models with indicators (Dice Score, DSC: 0.99) were found, however with little practical application due to the uses of small datasets and lack of reproducibility. Therefore, the main conclusion is to establish multidisciplinary research groups to overcome the gap between CAD developments and their complete utilization in the clinical environment.

Numerous image processing techniques (IPTs) have been employed to detect crack defects, offering an alternative to human-conducted onsite inspections. These IPTs manipulate images to extract defect features, particularly cracks in surfaces produced through Additive Manufacturing (AM). This article presents a vision-based approach that utilizes deep convolutional neural networks (CNNs) for crack detection in AM surfaces. Traditional image processing techniques face challenges with diverse real-world scenarios and varying crack types. To overcome these challenges, our proposed method leverages CNNs, eliminating the need for extensive feature extraction. Annotation for CNN training is facilitated by LabelImg without the requirement for additional IPTs. The trained CNN, enhanced by OpenCV preprocessing techniques, achieves an outstanding 99.54% accuracy on a dataset of 14,982 annotated images with resolutions of 1536 × 1103 pixels. Evaluation metrics exceeding 96% precision, 98% recall, and a 97% F1-score highlight the precision and effectiveness of the entire process.

This paper introduces a novel framework for zero-shot learning (ZSL), i.e., to recognize new categories that are unseen during training, by distilling knowledge from foundation models. Specifically, we first employ ChatGPT and DALL-E to synthesize reference images of unseen categories from text prompts. Then, the test image is aligned with text and reference images using CLIP and DINO. Finally, the predicted logits are aggregated according to their confidence to produce the final prediction.Experiments are conducted on multiple datasets, including CIFAR-10, CIFAR-100, and TinyImageNet. The results demonstrate that our model can significantly improve classification accuracy compared to previous approaches, achieving AUROC scores above 96\% across all test datasets. Our code is available at https://github.com/1134112149/MICW-ZIC.

This paper proposes a new approach for multi-focus images fusion based on Region Mosaicing on Contrast Pyramids (REMCP). A density-based region growing method is developed to construct a focused region mask for multi-focus images. The segmented focused region mask is decomposed into a mask pyramid, which is then used for supervised region mosaicking on a contrast pyramid. In this way, the focus measurement and the continuity of focused regions are incorporated and the pixel level pyramid fusion is improved at the region level. Objective and subjective experiments show that the proposed REMCP is more robust to noise than compared algorithms and can fully preserves the focus information of the multi-focus images meanwhile reducing distortions of the fused images.

The objective of image super-resolution is to reconstruct a high-resolution (HR) image with the prior knowledge from one or several low-resolution (LR) images. However, in the real world, due to the limited complementary information, the performance of both single-frame and multi-frame super-resolution reconstruction degrades rapidly as the magnification increases. In this paper, we propose a novel two-step image super resolution method concatenating multi-frame super-resolution (MFSR) with single-frame super-resolution (SFSR), to progressively upsample images to the desired resolution. The proposed method consisting of an L0-norm constrained reconstruction scheme and an enhanced residual back-projection network, integrating the flexibility of the variational model-based method and the feature learning capacity of the deep learning-based method. To verify the effectiveness of the proposed algorithm, extensive experiments with both simulated and real world sequences were implemented. The experimental results show that the proposed method yields superior performance in both objective and perceptual quality measurements, compared to the baseline super-resolution algorithms in the cascade model. In addition, the experiment indicates that this cascade model can be robustly applied to different SFSR and MFSR methods.

The advent of deep learning (DL) has revolutionized medical imaging, offering unprecedented avenues for accurate disease classification and diagnosis. DL models have shown remarkable promise for classifying brain tumor from Magnetic Resonance Imaging (MRI) scans. However, despite their impressive performance, the opaque nature of DL models poses challenges in understanding their decision-making processes, particularly crucial in medical contexts where interpretability is essential. This paper explores the intersection of medical image analysis and DL interpretability, aiming to elucidate the decision-making rationale of DL models in brain tumor classification. Leveraging state-of-the-art DL frameworks with transfer learning, we conduct a comprehensive evaluation encompassing both classification accuracy and interpretability. Using state-of-the-art DL frameworks with transfer learning, we conduct a thorough evaluation covering both classification accuracy and interpretability. We employ adaptive path-based techniques to understand the underlying decision-making mechanisms of these models. Grad-CAM and Grad-CAM++ highlight critical image regions where the tumors are located.

Breast cancer stands as a predominant health concern for women globally. As mammography is the primary screening tool for breast cancer detection, improving the detection of breast cancer at screening could save more lives. This mammography re-view paper provides a systematic review of computer-aided techniques during a specific time frame for the segmentation and classification of microcalcification, evaluating image processing, machine learning, and deep learning techniques. The systematic review is meticulously carried out, adhering closely to the preferred reporting items for Systematic Reviews and Meta-Analysis (PRISMA) guidelines. This article focuses on mammographic breast cancer detection approaches based on automated systems, discussed chronologically from 1970 through 2023. This article encompasses the breadth of artificial intelligence-based methods from the most primitive to the most sophisticated models. Image processing and machine learning-based methods are compre-hensively reviewed. The evaluation of a deep learning architecture based on self-extracted features for classification tasks demonstrated outclass performance. Large-scale datasets required for a broader and in-depth analysis of novel methods for breast cancer detection are also discussed in this article. This research work is aligned with the United Nations' sustainability de-velopment goals.

This paper describes the first results of an Image Recognition Based Location (IRBL) for mobile application focusing on the procedure to generate a Database of range images (RGB-D). In an indoor environment, to estimate the camera position and orientation, a prior spatial knowledge of the surrounding is needed. In order to achieve this objective a complete 3D survey of two different environment (Bangbae metro station of Seoul and E.T.R.I. building in Daejeon – Republic of Korea) was performed using LiDAR (Light Detection And Ranging) instrument and the obtained scans were processed in order to obtain a spatial model of the environments. From this, two databases of reference images were generated using a specific software realized by the Geomatics group of Politecnico di Torino (ScanToRGBDImage). This tool allow to generate synthetically different RGB-D images) centered in the each scan position in the environment. Later, the external parameters (X, Y, Z, ω, φ, κ) and the range information extracted from the DB images retrieved, are used as reference information for pose estimation of a set of acquired mobile pictures in the IRBL procedure. In this paper the survey operations, the approach for generating the RGB-D images and the IRB strategy are reported. Finally the analysis of the results and the validation test are described.

Rapid and accurate detection of road cracks is of great significance for road health monitoring, but currently this work is mainly completed through manual site surveys. Low-altitude UAV remote sensing can obtain images with centimeter or even subcentimeter ground resolution, which provides a new efficient and economical approach for rapid crack detection. Nevertheless, crack detection networks face challenges such as edge blurring and misidentification due to the heterogeneity of road cracks and the complexity of the background. To address these issues, we propose a real-time edge reconstruction crack detection network (ERNet) which adopts multi-level information aggregation to reconstruct crack edges and improve the accuracy of segmentation between the target and background. To capture global dependencies across spatial and channel levels, we propose an efficient bilateral decomposed convolutional attention module (BDAM) that combines depth separable convolution and dilated convolution to capture global dependencies across spatial and channel levels. To enhance the accuracy of crack detection, we use a coordinate-based fusion module that integrates spatial, semantic, and edge reconstruction information. In addition, we propose an automatic measurement of crack information for extracting the crack trunk and its corresponding length and width. Experimental results demonstrate that our network achieves the best balance between accuracy and inference speed.

Magnetic resonance (MR) image acquisitions are usually time-consuming, limiting utilization in neuroimaging. For multiple sclerosis (MS) patients, MR imaging plays a major role in drug therapy decision-making. The purpose of this study was to evaluate whether an ultrafast, T2-weighted (T2w), deep-learning-enhanced (DL), echo-planar-imaging-based (EPI) fluid-attenuated inversion recovery (FLAIR) sequence (FLAIRUF) that has been targeting neurological emergencies so far might even be an option to detect MS lesions of the brain compared to conventional FLAIR sequences. Therefore, 17 MS patients were enrolled prospectively in this exploratory study. Standard MR protocols and ultrafast acquisitions were conducted at 3 tesla (T), including three-dimensional (3D)-FLAIR, turbo/fast spin echo (TSE)-FLAIR, and FLAIRUF. Inflammatory lesions were grouped by size and location. Lesion conspicuity and image quality were rated on an ordinal five-point Likert scale, and lesion detection rates were calculated. Statistical analyses were performed to compare results. Altogether, 568 different lesions were found. Data indicated no significant differences in lesion detection (sensitivity and positive predictive value [PPV]) between FLAIRUF and axially reconstructed 3D-FLAIR (lesion size ≥ 3 mm × ≥ 2 mm) and no differences in sensitivity between FLAIRUF and TSE-FLAIR (lesion size ≥ 3 mm total). Lesion conspicuity in FLAIRUF was similar in all brain regions except for superior conspicuity in the occipital lobe and inferior conspicuity in central brain regions. Further findings include location-dependent limitations of signal-to-noise ratio (SNR) and contrast-to-noise ratio (CNR) as well as artifacts such as spatial distortions in FLAIRUF. In conclusion, FLAIRUF could potentially be an expedient alternative to conventional methods for brain imaging in MS patients since the acquisition can be performed in a fraction of time while maintaining good image quality.

As the fast growth of information technology (IT), the safety of image transmission and the storing of images are increasingly concerned. Traditional image encryption algorithms have certain limitations in transmission and security, so there is an urgent need for a secure and reliable image encryption algorithm. A universal compression sensing (CS) image encryption (IE) algorithm based on DNA-triploid mutation (DTM) is presented in this paper. Firstly, by using CS algorithm an image is compressed while obtaining a range of chaotic sequences by iteration of chaotic map. Then DNA sequences are generated by encoding the image, and based on the DTM, new mutant DNA sequences are generated according to specific rules. Next, the chaotic sequences are operated at the DNA level to do confusion and diffusion operations on the image to ensure the security of the data. At last, DNA decoding is carried out to obtain the compressed-encrypted image. Both simulation experiments and performance tests fully show that a high level of security and reliability of the proposed algorithm in protecting image privacy is achieved.

In order to improve contrast and restore color for underwater image captured by camera sensors without suffering from insufficient details and color cast, a fusion algorithm for image enhancement in different color spaces based on contrast limited adaptive histogram equalization (CLAHE) is proposed in this article. The original color image is first converted from RGB color space to two different special color spaces: YIQ and HSI. The color space conversion from RGB to YIQ is a linear transformation, while the RGB to HSI conversion is nonlinear. Then, the algorithm separately operates CLAHE in YIQ and HSI color spaces to obtain two different enhancement images. The luminance component (Y) in the YIQ color space and the intensity component (I) in the HSI color space are enhanced with CLAHE algorithm. The CLAHE has two key parameters: Block Size and Clip Limit, which mainly control the quality of CLAHE enhancement image. After that, the YIQ and HSI enhancement images are respectively converted backward to RGB color. When the three components of red, green, and blue are not coherent in the YIQ-RGB or HSI-RGB images, the three components will have to be harmonized with the CLAHE algorithm in RGB space. Finally, with 4 direction Sobel edge detector in the bounded general logarithm ratio operation, a self-adaptive weight selection nonlinear image enhancement is carried out to fuse YIQ-RGB and HSI-RGB images together to achieve the final fused image. The enhancement fusion algorithm has two key factors: average of Sobel edge detector and fusion coefficient, and these two factors determine the effects of enhancement fusion algorithm. A series of evaluate metrics such as mean, contrast, entropy, colorfulness metric (CM), mean square error (MSE) and peak signal to noise ratio (PSNR) are used to assess the proposed enhancement algorithm. The experiments results showed that the proposed algorithm provides more detail enhancement and higher values of colorfulness restoration as compared to other existing image enhancement algorithms. The proposed algorithm can suppress effectively noise interference, improve the image quality for underwater image availably.

With the development of deep learning, the Super-Resolution (SR) reconstruction of microscopic images has improved significantly. However, the scarcity of microscopic images for training, the underutilization of hierarchical features in original Low Resolution (LR) images, and the high-frequency noise unrelated with the image structure generated during reconstruction process are still challenges in the Single Image Super-Resolution (SISR) field. Faced with these issues, we first collected sufficient microscopic images through Motic, a company engaged in the design and production of optical and digital microscopes, to establish a dataset. Secondly, we proposed a Residual Dense Attention Generative Adversarial Network (RDAGAN). The network comprises a generator, an image discriminator, and a feature discriminator. The generator includes a Residual Dense Block (RDB) and a Convolutional Block Attention Module (CBAM), focusing on extracting the hierarchical features of the original LR image. Simultaneously, the added feature discriminator enables the network to generate high-frequency features pertinent to the image’s structure. Finally, we conducted experimental analysis and compared our model with six classic models. Compared with the best model, our model improved PSNR and SSIM by about 1.5dB and 0.2, respectively.

Gastric cancer is the fifth most common and fourth deadliest cancer worldwide, with a bleak 5-year survival rate of about 20%. Despite significant research into its pathobiology, prognostic predictability remains insufficient due to pathologists’ heavy workloads and the potential for diagnostic errors. Consequently, there is a pressing need for automated and precise histopathological diagnostic tools. This study leverages Machine Learning and Deep Learning techniques to classify histopathological images into healthy and cancerous categories. By utilizing both handcrafted and deep features and shallow learning classifiers on the GasHisSDB dataset, we conduct a comparative analysis to identify the most effective combinations of features and classifiers for differentiating normal from abnormal histopathological images without employing fine-tuning strategies. Our methodology achieves an accuracy of 95% with the SVM classifier, underscoring the effectiveness of feature fusion strategies. Additionally, cross-magnification experiments produced promising results with accuracies close to 80% and 90% when testing the models on unseen testing images with different resolutions.

Objective biomarkers have been a critical challenge for the field of psychiatry, where diagnostic, prognostic and theranostics assessments are still based on subjective narratives. Psychopathology operates with idiographic knowledge and subjective evaluations incorporated into clinical as-sessment inventories, but is considered to be a medical discipline and, as such, uses medical in-tervention methods (e.g., pharmacological, ECT; rTMS; tDCS), and therefore is supposed to oper-ate with the language and methods of nomothetic networks. The idiographic assessments are pro-visionally “quantified” into “structured clinical scales” to in some way resemble nomothetic measures. Instead of fostering data merging and integration, this approach further encapsulates the clinical psychiatric methods, as all other, biological tests (molecular, neuroimaging) are per-formed separately, only after the clinical assessment has provided diagnosis. Translational cross-validation of clinical assessment instruments and fMRI is an attempt to address the gap. The aim of this approach is to investigate whether there exist common and specific neural circuits, which underpin differential item responses to clinical self-rating scales during fMRI session in pa-tients suffering from the two main spectra of mental disorders: schizophrenia and major depres-sion. The current status of this research program and future implications to promote the devel-opment of psychiatry as a medical discipline are discussed.

The Range–Doppler (R-D) model is extensively employed for the geometric processing of Synthetic Aperture Radar (SAR) images. Refining the sensor motion state and imaging parameters is the most common method for achieving high-precision geometric processing using the R-D model, comprising a process that involves numerous parameters and complex computations. In this study, we introduce a novel approach to improve the positioning accuracy of the R-D model, implementing a low-order polynomial to compensate for the original imaging errors without altering the initial positioning parameters. We also design low-order polynomial compensation models with different parameters. The models are evaluated on various SAR images from different platforms and bands, including spaceborne TerraSAR-X and GF3-C images, manned airborne SAR-X images, and unmanned aerial vehicle-mounted miniSAR-Ku images. Furthermore, image positioning experiments involving the use of different polynomial compensation models and various numbers and distributions of Ground Control Points (GCPs) are conducted. The experimental results demonstrate that geometric processing accuracy comparable to that of the classical rigorous positioning method can be achieved even when applying only an affine transformation model to the images. Compared to classical refinement models, however, the proposed image-compensated R-D model is much simpler and easy to implement. Thus, this study provides a convenient, robust, and widely applicable method for the geometric positioning processing of SAR images, offering a potential approach for the joint-positioning processing of multi-source SAR images.

Objective: Interstitial fibrosis / tubular atrophy (IFTA) is a common, irreversible, and progressive form of chronic kidney allograft injury, and it is considered a critical predictor of kidney allograft outcomes. The extent of IFTA is estimated through a graft biopsy, while a non-invasive test is lacking. The aim of this study was to evaluate the feasibility and accuracy of an MRI radiomic-based machine learning (ML) algorithm in estimating the degree of IFTA in a cohort of transplanted patients. Approach: Patients who underwent MRI and renal biopsy within a 6-month interval from 1/1/2012 to 1/3/2021 were included. Stable MRI sequences were selected, and renal parenchyma, renal cortex and medulla were segmented. After image filtering and pre-processing, we computed radiomic features which were subsequently selected through a LASSO algorithm for their highest correlation with the outcome and lowest intercorrelation. Selected features and relevant patients’ clinical data were used to produce ML-algorithms using 70% of the study cases for feature selection, model training and validation with a 10-fold cross-validation, and 30% for model testing. Performances were evaluated using AUC with 95% confidence interval. Main results: 70 coupled tests (63 patients, 35.4% females, mean age 52.2 years) have been included and subdivided into a wider cohort of 50 for training and a smaller cohort of 20 for testing. For IFTA ≥ 25%, AUCs in test cohort were 0.60, 0.59, and 0.54 for radiomic features only, clinical variables only, and combined radiomic-clinical model, respectively. For IFTA ≥ 50%, AUCs in training cohort were 0.89, 0.84, 0.96, and in test cohort were 0.82, 0.83, and 0.86, for radiomic features only, clinical variables only, and combined radiomic-clinical model, respectively. Significance: An ML-based MRI radiomic algorithm showed promising discrimination capacity for IFTA>50%, especially when combined with clinical variables. These results need to be confirmed in larger cohorts.

Tsallis entropy has been widely used in image thresholding because of its non-extensive properties. The non-extensive parameter q contained in this entropy plays an important role in various adaptive algorithms and has been successfully applied in bi-level image thresholding. In this paper, the relationships between parameter q and pixels’ long-range correlations have been further studied within multi-threshold image segmentation. It is found that the pixels’ correlations are remarkable and stable for images generated by a known physical principle, such as infrared images and medical CT images. And the corresponding non-extensive parameter q can be evaluated by using self-adaptive Tsallis entropy algorithm. The results of this algorithm are compared with those of Shannon entropy algorithm and the original Tsallis entropy algorithm, in terms of quantitative image quality evaluation metrics PSNR (Peak Signal-to-Noise Ratio) and SSIM (Structural Similarity). Furthermore, we observed that for image series with the same background, the q values determined by the adaptive algorithm are consistently kept in a narrow range. Therefore, similar or identical scenes during imaging would produce similar strength of long-range correlations, which provides potential applications for unsupervised image processing.

Accurate prostate volume estimation is crucial for effective prostate disease management. Ultrasound (US) imaging, particularly transrectal ultrasound, offers a cost-effective and rapid assessment. However, US images often suffer from artifacts and poor contrast, making prostate volume estimation challenging. This review explores recent advancements in deep learning (DL) techniques for automatic prostate segmentation in US images as a primary step for prostate volume estimation. We examine various DL architectures, including traditional U-Net modifications and innovative designs incorporating residual connections, multi-directional image data, and attention mechanisms. Additionally, we discuss pre-processing methods to enhance image quality, the integration of shape information, and strategies to improve the consistency and robustness of DL models. The effectiveness of these techniques is evaluated through metrics such as Dice Similarity Coefficient, Jaccard Index, and Hausdorff Distance. The review highlights the potential of DL in improving prostate volume estimation accuracy and reducing clinical workload, while also identifying areas for future research to enhance model performance and generalizability.

Hyperspectral images (HSI) contain abundant spectral information. Efficient extraction and utilization of this information for image classification remain prominent research topics. Previously, hyperspectral classification techniques primarily relied on statistical attributes and mathematical models of spectral data. Deep learning classification techniques have recently been extensively utilized for hyperspectral data classification, yielding promising outcomes. This study proposes a deep learning approach that uses polarization feature maps for classification. Initially, the polar coordinate transformation method is employed to convert the spectral information of all pixels in the image into spectral feature maps. Subsequently, the proposed Deep Context Feature Fusion Network (DCFF-NET) is utilized to classify these feature maps. The model is validated using three open-source hyperspectral datasets: Indian Pines, Pavia University, and Salinas. The experimental results indicated that DCFF-NET achieves excellent classification performance. Experimental results on three public HSI datasets demonstrate that the proposed method accurately recognizes different objects with an overall accuracy (OA) of 86.68%, 94.73%, and 95.14% based on the pixel method, and 98.15%, 99.86%, and 99.98% based on the pixel-patch method.

Rectal cancer presents significant diagnostic and therapeutic challenges, with neoadjuvant therapy playing a pivotal role in improving resectability and patient outcomes. MRI serves as a critical tool in assessing treatment response. However, differentiating viable tumor tissue from therapy-induced changes on MRI remains a complex task. In this comprehensive review, we explore treatment options for rectal cancer based on resectability status, focusing on the role of MRI in guiding therapeutic decisions. We delve into the nuances of MRI-based evaluation of treatment response following neoadjuvant therapy, with particular attention to emerging techniques like radiomics. Drawing from current literature and insights, we provide essential recommendations for post-neoadjuvant therapy management in rectal cancer, all within the context of MRI-based findings.

Background: Microscopic examination of acid-fast stained sputum smears for detecting mycobacterial acid-fast bacilli (AFB) remains the most economical and readily available method for laboratory diagnosis of tuberculosis (TB). However, this conventional approach has limitations, including low sensitivity and labor-intensive procedures. Methods: An automated microscopy system incorporating artificial intelligence (AI) and machine learning for AFB identification was evaluated. The study was conducted at an Infectious Disease Hospital in Jiangsu Province, China, utilizing an intelligent microscope system (TB-Scan, Wellgen Medical, Kaohsiung). A total of 1,000 sputum smears were included in the analysis, with the system capturing digital microscopic images and employing an image recognition model to automatically identify and classify AFB. Referee technicians provided the gold standard for discrepant results. Results: The automated system demonstrated an overall accuracy of 95.00% (950/1,000), sensitivity of 91.24% (177/194), and specificity of 95.91% (773/806). Notably, the system identified 21 smears as positive that were previously reported as negative, with referee technicians confirming 17 of these as true positive and retracting the test results accordingly. Recalculating the performance, the accuracy increased to 96.70% (967/1,000), sensitivity to 91.94% (194/211), and specificity to 97.97% (773/789), with a false negative rate of 8.06% (17/211) and a false positive rate of 2.03% (16/789). Conclusions: The incorporation of AI and machine learning into an automated microscopy system demonstrated the potential to enhance the sensitivity and efficiency of AFB detection in sputum smears compared to conventional manual microscopy. This approach holds promise for widespread application in TB diagnostics and potentially other fields requiring labor-intensive microscopic examination.

Advanced MRI methods and PET using radiolabeled amino acids provide valuable information in addition to conventional MR imaging for brain tumor diagnostics. These methods are particularly helpful in challenging situations such as the differentiation of malignant processes from benign lesions, the identification of non-enhancing glioma subregions, the differentiation of tumor progression from treatment-related changes, and the early assessment of response to anticancer therapy. The debate over which of the methods is preferable in which situation is ongoing and has been addressed in numerous studies. Currently, most radiology and nuclear medicine departments perform these examinations independently of each other leading to multiple examinations for the patient. The advent of hybrid PET/MRI allowed a convergence of the methods but to date simultaneous imaging has reached little relevance in clinical neuro-oncology. This is partly due to the limited availability of hybrid PET/MRI scanners, but is also due to the fact that PET is a second-line examination in brain tumors. PET is only required in equivocal situations, and spatial co-registration of PET examinations of the brain to previous MRI is possible without disadvantage. A key factor for the benefit of PET/MRI in neuro-oncology is a multimodal approach that provides decisive improvements in the diagnostics of brain tumors compared with a single modality. This systematic review focuses on studies that were able to demonstrate the additive value of amino acid PET and ‘advanced’ MRI in the diagnosis of brain tumors. Available studies suggest that the combination of amino acid PET and advanced MRI improves grading and the histomolecular characterization of newly diagnosed tumors. However, data concerning the delineation of tumor extent and biopsy guidance are of limited value. A clear additive diagnostic value of amino acid PET and advanced MRI can be achieved regarding the differentiation of tumor recurrence from treatment-related changes. Here, PET-guided evaluation of advanced MR methods seems to be helpful. In summary, there is growing evidence that a multimodal approach can achieve decisive improvements in the diagnostics of brain tumors, for which hybrid PET/MRI offers optimal conditions.

MRI shows in-vivo the three archetypal patterns of CNS volume loss underlying progressive ataxias, namely spinal atrophy (SA), cortical cerebellar atrophy (CCA) and olivopontocerebellar atrophy (OPCA). The MRI-based CNS atrophy pattern was reviewed in 128 progressive ataxias. A CNS atrophy pattern was identified in 91 conditions: SA in Freidreich’s ataxia, CCA in 5 acquired and 72 (24 dominant, 47 recessive,1 X-linked) inherited ataxias, OPCA in Multi-System Atrophy and 12 (9 dominant, 2 recessive,1 X-linked) inherited ataxias. The MRI-based CNS atrophy pattern may be useful for genetic assessment, identification of shared cellular targets, and repurposing therapies or enlargement of drugs indications in progressive ataxias.

Magnetic Resonance Imaging (MRI) is a powerful, non-invasive and nondestructive tool, capable of providing three-dimensional (3D) images of living organisms. The use of magnetic contrast agents has allowed clinical researchers and analysts to enormously increase the sensitivity and specificity of MRI since these substances change the intrinsic properties of the tissues within a living body, increasing the information present in the images. The advances in nanotechnology and materials science as well as the research of new magnetic effects have been the driving forces that propel the use of magnetic nanostructures as promising alternatives to the commercial contrast agents used in MRI. This review discusses the principles associated with the use of contrast agents in MRI as well as the most recent reports focused on nanostructured contrast agents. The potential applications of gadolinium (Gd) and manganese Mn-based nanomaterials and iron oxide nanoparticles in this imaging technique are discussed as well, from their magnetic behavior to the mainly used materials and nanoarchitectures. Then, it is also addressed the recent efforts made to develop new types of contrast agents based on synthetic antiferromagnetic and high-aspect ratio nanostructures. Furthermore, the application of these materials in theragnosis, either as contrast agents and controlled drug release, contrast agents and thermal therapy or contrast agents and radiosensitizers, is also presented.

Fundus image registration plays a crucial role in the clinical evaluation of ocular diseases, such as diabetic retinopathy and macular degeneration, necessitating meticulous monitoring. The alignment of multiple fundus images enables the longitudinal analysis of patient progression, widening the visual scope, or augmenting resolution for detailed examinations. Currently, prevalent methodologies rely on feature-based approaches for fundus registration. However, certain methods exhibit high feature point density, posing challenges in matching due to point similarity. This study introduces a novel fundus image registration technique integrating U-Net for the extraction of feature points employing FIVES for its training and evaluation, a novel and large dataset for blood vessels segmentation, prioritizing point distribution over abundance. Subsequently, the method employs medial axis transform and pattern detection to obtain feature points characterized by the Fast Retina Keypoint (FREAK) descriptor, facilitating matching for transformation matrix computation. Assessment of the vessel segmentation achieves 0.7559 for Intersection Over Union (IoU), while evaluation on the Fundus Image Registration Dataset (FIRE) demonstrates the method’s comparative performance against existing methods, yielding a registration error of 0.596 for area under the curve, refining similar earlier methods and suggesting promising performance comparable to prior methodologies.

Multispectral image (MSI) and hyperspectral image (HSI) fusion (MHIF) aims to address the challenge of acquiring high-resolution (HR) HSI images. This field combines a low-resolution (LR) HSI with an HR-MSI to reconstruct HR-HSI. Existing methods directly utilize transformers to perform feature extraction and fusion. Despite the demonstrated success, there exist two limitations: 1) Employing the entire transformer model for feature extraction and fusion fails to fully harness the transformer’s potential in integrating the spectral of the HSI and spatial information of the MSI. 2) HSI has a strong spectral correlation and exhibits sparsity in the spatial domain. Existing transformer-based models do not optimize this physical property, which makes their methods prone to spectral distortion. To accomplish these issues, this paper introduces a novel framework for MHIF called Sparse Mix-Attention Transformer (SAMformer). Specifically, to fully harness the advantages of the Transformer architecture, we propose a Spectral Mix Attention Block (SMAB), which concatenates the keys and values extracted from LR-HSI and HR-MSI to create a new multi-head attention module. This design facilitates the extraction of detailed long-range information across spatial and spectral dimensions. Besides, to address the spatial sparsity inherent in HSI, we incorporated a sparse mechanism within the core of SMAB called Sparse Spectral Mix Attention Block (SSMAB). In the SSMAB, we compute attention maps from queries and keys and select the K highly correlated values as the sparse attention map. This approach enables us to achieve a sparse representation of spatial information while eliminating spatially disruptive noise. Extensive experiments conducted on three benchmark datasets, namely Cave, Harvard, and Pavia Center, demonstrate the SMAformer method outperforms state-of-the-art methods.

The integration of advanced image analysis using artificial intelligence (AI) is pivotal for the evolution of autonomous vehicles (AVs). This article provides a thorough review of the most significant datasets and the latest state-of-the-art AI solutions employed in image analysis for AVs. Datasets such as Cityscapes, NuScenes, and CARLA form the benchmarks for training and evaluating different AI models, with unique characteristics catering to various aspects of autonomous driving. Key AI methodologies, including Convolutional Neural Networks (CNNs), Recurrent Neural Networks (RNNs), Transformer models, and Generative Adversarial Networks (GANs), are discussed. The article also presents a comparative analysis of various AI techniques in real-world scenarios, focusing on semantic image segmentation, 3D object detection, and vehicle control in virtual environments. Simultaneously, the role of multisensor datasets and simulation platforms like AirSim, TORCS, and SUMMIT in enriching the training data and testing environments for AVs is highlighted. By synthesizing information on datasets, AI solutions, and comparative performance evaluations, the article serves as a crucial resource for researchers, developers, and industry stakeholders. Offering a clear view of the current landscape and future directions in autonomous vehicle image analysis technologies.

In this paper, a new approach to retrieve semantic images based on shape and geometric features of image in conjunction with multi-class support vector machine is proposed. Zernike moment as shape feature is to verify the invariance of objects for silhouette image. In addition, a set of geometrical features is to explore the objects shape using two features of rectangularity and circularity. Then the extracted features are normalized and employed for multi-class support vector machine either for learning or retrieving processes. The retrieving process relies on three main tasks which namely Query Engine, Matching Module and Ontology Manger, respectively. Query Engine is to build the input text or image query using SPARQL language. The matching module extracts the shape and geometric features of image’s objects and employ them to Ontology Manger which in turn inserts them in ontology knowledge base. Benchmark mammals have been conducted to empirically conclude the outcome of proposed approach. Our experiment on text and image retrieval yields efficient results to problematic phenomena than previously reported.

Background Corpus callosum abnormalities (CCA) are midline developmental brain malformations and are usually associated with a wide spectrum of other neurological and non-neurological abnormalities. The study aims to highlight the diagnostic role of fetal MRI to characterize heterogeneous corpus callosum abnormalities using the latest classification system. It also helps to identify associated anomalies, which have prognostic implications on the postnatal outcome. Methods In this study, retrospective data from antenatal women who underwent fetal MRI between January 2014 and July 2023 at Rush University Medical Center were evaluated for CCA and classified based on structural morphology. Patients were further assessed for associated neurological and non-neurological anomalies. Results The most frequent class of CCA was complete agenesis (79.1%), followed by hypoplasia (12.5%), dysplasia (4.2%) and hypoplasia with dysplasia (4.2%). Amongst them, 17% had isolated CCA, while the majority (83%) had complex forms of CCA associated with other CNS and non-CNS anomalies. Out of the complex CCA cases, 58% were associated with other CNS anomalies, while 8% were associated with non-CNS anomalies. 17% of cases had both. Conclusion The use of fetal MRI is valuable in the classification of abnormalities of the corpus callosum after the confirmation of a diagnosis suspected on prenatal ultrasound. This technique is an invaluable method for distinguishing between isolated and complex forms of CCA, especially in the cases of apparent isolated CCA. The use of diffusion-weighted imaging or diffusion tensor imaging in fetal neuroimaging is expected to provide further insights into white matter abnormalities in fetuses diagnosed with CCA in the future.

End-to-end learned image compression codecs have notably emerged in recent years. These codecs have demonstrated superiority over conventional methods, showcasing remarkable flexibility and adaptability across diverse data domains while supporting new distortion losses. Despite challenges such as computational complexity, learned image compression methods inherently align with learning-based data processing and analytic pipelines due to their well-suited internal representations. The concept of Video Coding for Machines has garnered significant attention from both academic researchers and industry practitioners. This concept reflects the growing need to integrate data compression with computer vision applications. In light of these developments, we present a comprehensive survey and review of lossy image compression methods. Additionally, we provide a concise overview of two prominent international standards, MPEG Video Coding for Machines and JPEG AI. These standards are designed to bridge the gap between data compression and computer vision, catering to practical industry use cases.

This study explores novel techniques to improve the detection accuracy of skarn iron deposits using advanced image processing methodologies. Leveraging the capabilities of Aster image, Band Ratio (BR) images, and Principal Component Analysis (PCA), alongside the power of 3D Convolutional Neural Networks (3D-CNN), the research aims to enhance the precision and efficiency of ore detection in complex geological environments. The proposed method employs a specific 3D-CNN architecture, accepting input as a 7×7×C image patch, where C represents the combined number of selected Aster image bands, Principal Component (PC) bands, and computed BR images. To evaluate the accuracy of the proposed method, five distinct image bands combinations, including the proposed bands combination, were tested and evaluated based on the overall accuracy (OA), average accuracy (AA), and kappa coefficient. The results demonstrated that while the incorporation of BR images alongside Aster bands initially seemed promising, it introduced significant confusion in certain classifications, leading to unexpected mis-classification rates. Surprisingly, utilizing solely Aster bands as input parameters yielded higher accuracy rates (OA= 93.13%, AA = 91.96%, Kappa = 90.91%) compared to scenarios involving the integration with band ratios (OA = 87.02%, AA = 79.15, and Kappa = 82.60%) or the integration of BR images to PC bands (OA= 87.78%, AA = 82.39%, Kappa = 83.81%). However, the amalgamation of Aster bands with selected PC bands showed slight improvements in accuracy (OA= 94.65%, AA = 92.93%, Kappa = 93.45%), although challenges in accurately classifying certain features persisted. Ultimately, the proposed combination of Aster bands, PC bands, and BR images (proposed bands combination) presented the most visually appealing and statistically accurate results (OA = 96.95%, AA= 94.87%, and Kappa = 95.93%), effectively addressing misclassifications observed in the other combinations. These findings underscore the synergistic contributions of each of the Aster bands, PC bands, and BR images, with Aster bands proving pivotal for optimal skarn classification, PC bands enhancing intrusions classification accuracy, and BR images strengthening wall rock classification accuracy. In conclusion, the proposed combination of input image bands emerges as a robust and comprehensive methodology, demonstrating unparalleled accuracy in the remote sensing detection of skarn iron minerals.

Bridges enable communications and transportation of goods nationally and internationally, underpinning economic and social activities, thus they are pylons of our prosperity and mobility. Bridges worldwide are constantly subjected to physical wear, ageing, deterioration, hazards, environmental influences, and increased loading. Loss of performance and functionality of bridge structures would have a crucial impact on overall infrastructural resilience and would cause significant negative economic and social consequences. Monitoring their behaviour for different loading conditions relies on accurate estimations of the stress-strain state of various critical components and remaining capacities. These activities are of high importance for better planning lifespan prolongation, that is the extension of their service life and prevention of unforeseen collapses, in line with sustainability principles of well-informed maintenance. In many cases, access to the structure is limited or even impossible, which causes the need for the deployment of remote and contactless methods. One such innovative technique, which has recently attracted attention in scientific and practical applications is the digital image correlation (DIC). DIC is a contactless approach applicable for long-term measurements, which enables obtaining the full field of strains and deformations. Although the DIC approach has been widely used in world engineering practice for monitoring bridges and has proved to be a reliable and accurate method, there is a lack of systematic integral review on previous practical applications, revealing limitations and perspectives. This is the main motivation and novelty of this study, which will describe selected case studies, in which DIC was used on real full-scale bridge structures and propose improvements for the method.

Translation of basic animal research to find effective methods of diagnosing and treating human neurological disorders requires parallel analysis infrastructures. Small animals such as mice provide exploratory animal disease models. However, many interventions developed using small animal models fail to translate to human use due to physical or biological differences. Recently, large-animal minipigs have emerged in neuroscience due to both brain similarity and economic advantages. Medical image processing is a crucial part of research as it allows researchers to monitor their experiments and understand disease development. However, although many algorithms are created and optimized for MR analysis of human data, those tools are not directly applicable or sufficiently sensitive to measure minipig data. In this work, we propose PigSNIPE - a pipeline for the automated handling, processing, and analyzing of large-scale data sets of minipig MR images. The pipeline allows for image registration, AC-PC alignment, landmark detection, skull stripping, brainmasks and intracranial volume segmentation (DICE 0.98), tissue segmentation (DICE 0.82), and caudate-putamen brain segmentation (DICE 0.8) in under two minutes. To the best of our knowledge, this is the first automated pipeline tool aimed at large animal images.

Popular geo-computer vision works make use of aerial imager with sizes ranging from 64 × 64 to 1024 × 1024 pixels without any overlap, although the learning process of deep learning models can be affected by the reduced semantic context or the lack of information near image boundaries. In this work, the impact of three image sizes (256 × 256, 512 × 512, and 1024 × 1024 pixels) and two image overlap levels (no overlap and 12.5% overlap) on the performance of road classification models was statistically evaluated. For this, two convolutional neural networks used in various tasks of geospatial object extraction were trained (using the same hyperparameters) on a large dataset (containing aerial image data covering 8650 km² of the Spanish territory that was labelled with binary road information) under twelve different scenarios, each scenario featuring a different combination of tile size and overlap. To assess their generalisation capacity, the performance of all resulting models was evaluated on a data from novel areas covering approximately 825 km². The performance metrics obtained were analysed using appropriate descriptive and inferential statistical techniques to evaluate the impact of the performance at distinct levels of the fixed factors (tile size, tile overlap, neural network architecture). Statistical tests were applied to study the main and interaction effects of the fixed factors on the performance. A significance level of 0.05 was applied to all the null hypothesis tests. The results were highly significant for the main effects (p-values lower than 0.001), while the two-way and three-way interaction effects among them had different levels of significance. The results indicate that the training of road classification models on images with a higher tile size (more semantic context) and tile overlap (additional border context and continuity) significantly impacts their performance. The best model was trained on a dataset featuring tiles with a size of 1024 × 1024 pixels and a 12.5% overlap and achieved a loss value of 0.0984, an F1 score of 0.8728, and an ROC-AUC score of 0.9766, together with an error rate of 3.5% on the test set.

In response to the burgeoning global demand for premium agricultural products, particularly within the competitive nut market, this paper introduces an innovative methodology aimed at enhancing the grading process for almonds and their shells. Leveraging state-of-the-art Deep Convolutional Neural Networks (CNNs), specifically the AlmondNet-20 architecture, our study achieves exceptional accuracy exceeding 99%, facilitated by the utilization of a 20-layer CNN model. To bolster robustness in differentiating between almonds and shells, data augmentation techniques are employed, ensuring the reliability and accuracy of our classification system. Our model, meticulously trained over 1000 epochs, demonstrates remarkable performance, boasting an accuracy rate of 99% alongside a minimal loss function of 0.0567. Rigorous evaluation through test datasets further validates the efficacy of our approach, revealing impeccable precision, recall, and F1-score metrics for almond detection. Beyond its technical prowess, this advanced classification system offers tangible benefits to both industry experts and non-specialists alike, ensuring globally reliable almond classification. The application of deep learning algorithms, as showcased in our study, not only enhances grading accuracy but also presents opportunities for product patents, thereby contributing to the economic value of our nation. Through the adoption of cutting-edge technologies such as the AlmondNet-20 model, we pave the way for future advancements in agricultural product classification, ultimately enriching global trade and economic prosperity.

The essence of cross-modal generation and retrieval modeling for image-text interactions lies in semantic consistency. Among these, cross-modal representation alignment serves as the foundational requirement for achieving cross-modal semantic consistency. The crux of our proposed method entails the collaborative training of an image captioning model(referred to as the ’captioner’) and a pair of contrastive encoders for image-text matching(referred to as the ’concoder’). This synergistic approach yields concurrent enhancements in concoder’s performance, captioner’s proficiency, and cross-modal semantic coherence. We coin the proposed method as ‘ReCap’. To begin, we initialize the concoder through knowledge distillation from a pre-trained model. During the training process, we use the output of the initialized concoder as input to a residual attention network, jointly training it with the captioner to achieve semantic consistency. Subsequently, we iteratively update the concoder during the image-text momentum encoding phase using the residual attention network, creating a closed-loop for semantic consistency resolution. Upon completion of training, the concoder and captioner modules can be used independently to perform tasks related to cross-modal retrieval and cross-modal generation of text and images. In order to substantiate the efficacy of our proposed method, we initially conducted empirical experiments encompassing image-text retrieval and image captioning tasks, employing a widely recognized benchmark dataset, MSCOCO. Subsequently, we assessed the fine-grained cross-modal alignment performance of the concoder through an image classification task on the iNaturalist 2018 dataset. The achieved performance metrics notably surpassed those achieved by several incumbent state-of-the-art models, thus validating the proficiency of our method. Finally, motivated by the practical requirements of handling the nature conservation image data, we performed caption annotation for the iNaturalist 2018 dataset. Subsequently, we trained the ReCap on this annotated data. Experimental results demonstrate that our proposed method can maintain semantic consistency between cross-modal retrieval and image caption generation for species with similar visual features but distinct semantics. This achievement signifies a meaningful exploration in the field of cross-modal semantic consistency representation, holding significant practical value in the domain of biological research.

Understanding the distribution of rock glaciers provides key information for investigating and recognizing the status and changes of the periglacial environment. Deep learning algorithms and red-green-blue (RGB) bands from high-resolution satellite images have been extensively employed to map rock glaciers. However, the near-infrared (NIR) band offers rich spectral information and sharp edge features that could significantly contribute to semantic segmentation tasks, but it is rarely utilized in constructing rock glacier identification models due to the limitation of three input bands for classical semantic segmentation networks, like DeeplabV3+. In this study, a dual-encoder DeeplabV3+ network (DEDNet) was designed to overcome the flaws of classical DeeplabV3+ network (CDNet) when identifying rock glaciers using multispectral remote sensing images by extracting spatial and spectral features from RGB and NIR bands, respectively. This network, trained with manually labeled rock glacier samples from QiLian Mountains, established a model with accuracy, precision, recall, specificity, and mIoU (Mean Intersection over Union) of 0.9131, 0.9130, 0.9270, 0.9195, and 0.8601, respectively. The well-trained model was applied to identify new rock glaciers in a test region, achieving a producer's accuracy of 93.68% and a user's accuracy of 94.18%. Furthermore, the model was employed to two study areas in northern Tien Shan (Kazakhstan) and Daxue Shan (Hengduan Shan, China) with high accuracy, which proved that the DEDNet offers an innovative solution to more accurately map rock glaciers on a larger scale due to its robustness across diverse geographic regions.

Remote sensing image registration plays an important role in military and civilian fields, such as natural disaster damage assessment, military damage assessment and ground targets identification, etc. However, due to the ground relief variations and imaging viewpoint changes, non-rigid geometric distortion occurs between remote sensing images with different viewpoint, which further increases the difficulty of remote sensing image registration. To address the problem, we propose a multi-viewpoint remote sensing image registration method which contains the following contributions. (i) A multiple features based finite mixture model is constructed for dealing with different types of image features. (ii) Three features are combined and substituted into the mixture model to form a feature complementation, i.e., the Euclidean distance and shape context are used to measure the similarity of geometric structure, and the SIFT (scale-invariant feature transform) distance which is endowed with the intensity information is used to measure the scale space extrema. (iii) To prevent the ill-posed problem, a geometric constraint term is introduced into the L2E-based energy function for better behaving the non-rigid transformation. We evaluated the performances of the proposed method by three series of remote sensing images obtained from the unmanned aerial vehicle (UAV) and Google Earth, and compared with five state-of-the-art methods where our method shows the best alignments in most cases.

Visible light photography diagnostic images are coloured ex vivo medical images popularly used in Dermatology and Endoscopy for diagnosis and monitoring. The need to protect the integrity of these images as well as associated patient data calls for techniques such as image steganography and watermarking. This research explores and compares the effect of watermarking on the YIQ and YCbCr colour transforms used in processing digital coloured images and video in recent times. Using a new spread spectrum watermarking algorithm, it was found that YIQ has better distortion performance than YCbCr in the order of 3dB while YCbCr had lower BER for accurate watermark retrieval and tamper detection in the order of 1.3 x 10-3.

This study aimed to establish a predictive model for neoadjuvant chemoradiotherapy (nCRT) response in patients with locally advanced rectal carcinoma (LARC) using clinicopathological (CP) features along with radiomics from pretreatment Magnetic Resonance Imaging (MRI) 3D T2W contrast sequence scans. The study also assessed the impact of radiomic dimensionality on predictive performance. Seventy-five patients were prospectively enrolled with clinicopathologically confirmed LARC who underwent nCRT before surgery. Tumor properties were assessed by calculating 2142 shape, first-order, and second-order radiomics features. Least absolute shrinkage and selection operator (LASSO) and multivariate regression were used for feature selection. Two predictive models were constructed, one using 72 CP and 107 radiomics features, and the other using 72 CP and 1862 radiomics features. The models revealed moderately advantageous impact of increased dimensionality, while their predictive performance was in the range generally considered excellent, with respective AUCs of 0.86 and 0.90. A CP-only model (AUC=0.80) served as the benchmark for predictive performance without radiomics. The predictive models developed in this study using pretreatment MRI data, radiomics features, and clinicopathological parameters could potentially be used to routinely predict chemoradiotherapy responders, enabling clinicians to personalize treatment strategies for rectal carcinoma.

Background: Epileptic patients frequently encounter cognitive impairment. Functions that are mostly affected involve memory, attention and executive function; however this is mainly dependant on the location of the epileptic activity. The aim of the study is to assess cognitive functions in MRI-negative epilepsy patients by means of neurophysiological and neuropsychological measures. Methods: The patients were enrolled from the outpatient Epilepsy/Clinical Neurophysiology clinic over a time period of 6 months. The study sample comprised 20 MRI negative epilepsy patients [mean age ± standard deviation (SD), 30.3 ± 12.56 years; age range 16-60 years; average disease duration, 13.95 years) and 10 age-matched controls (mean age ± SD, 24.22 ± 15.39 years), that were also education-matched (p>0.05) Patients with epileptogenic lesions were excluded from the study. Informed consent was obtained from all subjects involved in the study. Auditory ERPs and the cognitive screening tool EpiTrack, were administered to all subjects. Results: Latencies of P300 and slow waves were prolonged in patients compared to controls (p<0.05). ASM load and the patients’ performance in the EpiTrack maze subtest were the most significant predictors of P300 latency. A decline in memory, attention, and speed of information processing has been observed in patients with cryptogenic epilepsy compared to age-matched controls, as reflected by P300 latency and EpiTrack scores.

Alzheimer's disease is a neurological illness that worsens gradually. It is known as the most frequent cause of dementia. Moreover, Alzheimer's disease is a general term for memory loss and other cognitive impairments severe enough to disrupt daily life. The disease often grows in middle-aged and elderly people with the gradual loss of cognitive ability. Since the diagnosis of the illness is time consuming, a novel machine learning approach is proposed in this research to diagnose Alzheimer's levels based on Magnetic Resonance Imaging (MRI). More specifically, to provide distinct information for classification we have implemented the proposed method on a native MRI scans dataset containing three MRI channels; namely T1, T2, and, T2 tirm, which are shown in red, blue and green, respectively. The five middle layers of these three types of MRI scans are combined to form five RGB layers. In addition, we use a Convolutional Neural Network to classify each composed layer, and the final disease type is predicted using majority voting. finally, the F1-Score has been used to assess method performance, indicated that 92% of predictions of the proposed model were accurate.

CT scans are currently the most common imaging modality used for suspected stroke patients due to their short acquisition time and wide availability. However, MRI offers superior tissue contrast and image quality. In this study, eight deep learning models are developed, trained, and tested using a dataset of 181 CT/MR pairs from stroke patients. The resultant synthetic MRIs generated by these models are compared through a variety of qualitative and quantitative methods. The synthetic MRIs generated by a 3D UNet model consistently demonstrated superior performance across all methods of evaluation. Overall, the generation of synthetic MRIs from CT scans using the methods described in this paper produces realistic MRIs that can guide the registration of CT scans to MRI atlases. The synthetic MRIs enable the segmentation of white matter, gray matter, and cerebrospinal fluid using algorithms designed for MRIs, exhibiting a high degree of similarity to true MRIs.

1) Introduction: Brain parcellation is an important processing step in the analysis of structural brain MRI. Existing software implementations are optimized for fully developed adult brains, and provide inadequate results when applied to neonatal brain imaging. 2) Methods: We developed a semi-automated pipeline, NeBSS, for extracting 50 discrete brain structures from neonatal brain MRI, using an atlas registration method that leverages the existing ALBERT neonatal atlas 3) Results: We demonstrate a simple linear workflow for neonatal brain parcellation. NeBSS is robust to variation in imaging acquisition protocol and magnet field strength. 4) Conclusion: NeBSS is a robust pipeline capable of parcellating neonatal brain MRIs using a simple processing workflow. NeBSS fills a need in clinical translational research in neonatal imaging, where existing automated or semi-automated implementations are too rigid to be successfully applied to multi-center neuroprotection studies and clinically heterogeneous cohorts. The software is open source and freely available.

With the progression of AI, embedding advanced AI technologies into small robotics and mobile devices has become essential, driving research towards lightweighting AI models. Our study enhances the EPINET depth estimation model for light field images, aiming for compactness and faster inference while preserving accuracy. We conducted two-step experiments aimed at enhancing inference efficiency: Initially, by adjusting input streams and convolution layers, we simplified the CNN model, achieving faster inference times at the cost of reduced accuracy. To address this reduction in accuracy, we then applied knowledge distillation, allowing the simplified model to learn from the original model’s more complex patterns. In our quantitative experiments using two error metrics, MSE (Mean Squared Error) and BadPix, we identified optimal knowledge positions and evaluated the required complexity for the student model. As a result, our method improved MSE by 21% and BadPix by 14% compared to training without it. Furthermore, the student model achieved an inference speed 13% faster than the teacher model and surpassed its accuracy by 10% in MSE. Additionally, we demonstrated that repeatedly applying our approach could further enhance both model compactness and accuracy.

Underwater image often exhibit detail blurring and color distortion due to light scattering, impurities, and other influences, obscuring essential textures and details. This presents a challenge for existing super-resolution techniques in identifying and extracting effective features, making high-quality reconstruction difficult. This research aims to innovate underwater image super-resolution technology to tackle this challenge. Initially, an underwater image degradation model was created by integrating random subsampling, Gaussian blur, mixed noise, and suspended particle simulation to generate a highly realistic synthetic dataset, thereby training the network to adapt to various degradation factors. Subsequently, to enhance the network's capability to extract key features, improvements were made based on the symmetrically structured Blind Super-Resolution Generative Adversarial Network (BSRGAN) model architecture. An attention mechanism based on energy functions was introduced within the generator to assess the importance of each pixel, and a weighted fusion strategy of adversarial loss, reconstruction loss, and perceptual loss was utilized to improve the quality of image reconstruction. Experimental results demonstrate that the proposed method achieved significant improvements in Peak Signal-to-Noise Ratio (PSNR) and Underwater Image Quality Measure (UIQM) by 0.85 dB and 0.19, respectively, significantly enhancing the visual perception quality and indicating its feasibility in super-resolution applications.

The detection and recognition of tables in image-based documents is a challenging and essential task for automated data extraction and anal- ysis. This paper introduces a methodology that utilizes Convolutional Neural Networks (CNNs) to address this problem. By harnessing the ro- bust visual recognition abilities of CNNs, the proposed method effectively detects and extracts tables from image-based documents. Additionally, an Encoder-Dual Decoder (EDD) architecture is employed to extract the textual content from table cells, enabling the transformation of visual data into structured, machine-readable formats. This structured data is then further processed using a Vector Space Model (VSM)-based language modeling technique for query-based table retrieval. The methodology’s accuracy is assessed by analyzing the spatial relationships between the extracted cells and comparing them against a pre-defined table structure. The results provide an evidence to the effectiveness of the proposed ap- proach, with an impressive 85% accuracy rate and a corresponding error rate of 15%. This accurate extraction and recognition of tables from image-based documents can significantly enhance applications in data analysis, information retrieval, and knowledge extraction.

This paper describes an image processing method that makes use of image parts instead of neural parts. Neural networks excel at image or pattern recognition and they do this by constructing complex networks of weighted values that can cover the complexity of the pattern data. These features however are integrated holistically into the network, which means that they can be difficult to use in an individual sense. A different method might scan individual images and use a more local method to try to recognise the features in it. This paper suggests such a method, where a trick during the scan process can not only recognise separate image parts, as features, but it can also produce an overlap between the parts. It is therefore able to produce image parts with real meaning and also place them into a positional context. Tests show that it can be quite accurate, on some handwritten digit datasets, but not as accurate as a neural network, for example. The fact that it offers an explainable interface could make it interesting however. It also fits well with an earlier cognitive model, and an ensemble-hierarchy structure in particular.

This study aims to test a model linking destination image, perceived value, tourist satisfaction, and tourist loyalty. Based on a sample of 300 tourists travelling by car from the World Natural Heritage Site of Tianchi, China, a new model of destination image was explored and data were analysed using partial least squares structural equation modelling (PLS-SEM). The results show that perceived value and satisfaction are direct antecedents of destination loyalty. Above all, perceived value and tourist satisfaction mediate the relationship between destination image and loyalty. Finally, this study discusses the theoretical and management implications of the findings in order to boost the tourism industry in the context of car trips.

Saliency detection in synthetic aperture radar (SAR) image is a difficult problem. This paper proposed a multitask saliency detection (MSD) model for the saliency detection task of SAR image. Firstly, we extract four features of SAR image as the input of the MSD model, which include the intensity, orientation, uniqueness and global contrast. Then, the saliency map is generated by the multitask sparsity pursuit (MTSP) which integrates the multiple features collaboratively. Subjective and objective evaluation of the MSD model verifies its effectiveness. Based on the saliency maps of the source images, an image fusion method is proposed for the SAR and color optical image fusion. The experimental results of real data show the proposed image fusion method is superior to the presenting methods in terms of several universal quality evaluation indexes, as well as in the visual quality. The salient areas in the SAR image can be highlighted and the spatial and spectral details of color optical image can also be preserved in the fusion result.

In response to a threefold increase in osteoporotic vertebral fractures (OVF) at our institution over the past decade and the subsequent development of new fractures within a year in a third of cases, we evaluated the effectiveness of STIR MRI scans in conjunction with CT scans for initial OVF diagnosis. This study, conducted over five months, involved full spine sagittal STIR MRI scans alongside CT scans for patients over 50 with minor injury-related vertebral fractures. The independent assessments by radiologists and neurosurgeons of 64 patients revealed that while CT scans identified 161 fresh fractures, of which only 68 were previously reported, MRI detected 266 fractures, 1.65 times more than CT. CT scans showed single fractures in 27% of patients and multiple fractures in 73%, whereas MRI identified single fractures in 9% and multiple fractures in 91% of patients. Additionally, MRI demonstrated a 1.5-fold increase in adjacent fracture detection. The use of MRI influenced treatment plans in 67% of cases. Given these findings, we advocate for including a STIR MRI of the entire spine alongside CT scans in OVF cases, as it significantly enhances fracture detection and can alter treatment strategies.

A growing number of studies focus on methods to estimate and analyze the functional connectome of the human brain. Graph theoretical measures are commonly employed to interpret and synthesize complex network-related information. While resting state functional MRI (rsfMRI) is often employed in this context, is known to exhibit poor reproducibility, a key factor which is commonly neglected in typical cohort studies using connectomics-related measures as biomarkers. We aimed to fill this gap by analyzing and comparing inter- and intra- subject variability of connectivity matrices as well as graph-theoretical measures in a large (n=1003) database of young healthy subjects which underwent four consecutive rsfMRI sessions. We analyzed both directed (Granger Causality and Transfer Entropy) and undirected (Pearson Correlation and Partial Correlation) time-series association measures and related global and local graph-theoretical measures. While matrix weights exhibit a higher reproducibility in undirected as opposed to directed methods, this difference disappears when looking at global graph metrics and, in turn, exhibits strong regional dependence in local graphs metrics. Our results warrant caution in the interpretation of connectivity studies, and serve as a benchmark for future investigations by providing quantitative estimates for the inter- and intra- subject variabilities in both directed and undirected connectomic measures.

In Indonesia, types of meat are still identified manually due to increasing prices for beef and buf-falo ahead of Idul Fitri. Traders mix beef with pork to thwart the beef scam. Haar wavelet and GLCM, GLCM with angles of 0°, 45°, 90°, and 135°, as well as matrices using contrast, correlation, energy, homogeneity, and entropy, are used in feature extraction. The following are the results of meat image classification testing using k-NN, Haar wavelet, and GLCM: The k-NN algorithm shows superiority in identifying fresh (99%), frozen (99%), and rotten (96%) meat texture images with the most fantastic accuracy results in every situation. Meanwhile, GLCM routinely provides good results, especially regarding the texture image of fresh meat (183.21) and rotten meat (115.79). However, despite delivering less throughput than k-NN and GLCM, Haar wavelets are still helpful, especially when dealing with fresh meat texture images (89,96).

Physical fitness is a fundamental indicator of health, leading to increased interest in fitness activ-ities under professional guidance. Fitness instructors play an essential role, requiring both tech-nical and interpersonal skills. Their image significantly influences participants perceptions and satisfaction. The objective of this study is to conduct a comparative analysis between Romania and Portugal regarding the quality of services offered within group fitness classes, focusing on instructors. It involved 133 group fitness instructors and 210 participants from Romania and Portugal. An adaptation of the Szumilewicz et al. (2008) questionnaire was used to assess the importance of the different attributes of fitness instructor image. Statistical analyses included de-scriptive statistics, t-tests, and effect size to compare perceptions between countries and groups. Romanian instructors and participants generally attributed higher importance to the fitness in-structor’s image compared to their Portuguese counterparts. Significant differences were found in attributes like physical fitness, technical execution and communication. Instructors tented to overestimate the importance of their image compared to participants. The fitness instructor image is crucial in determining participant satisfaction and perceptions of service quality. This study highlights the need for a balanced approach in instructor training, emphasizing both technical proficiency and interpersonal skills tailored to cultural contexts.

Polarimetric Synthetic Aperture Radar (PolSAR) images encompass valuable information that can facilitate extensive land cover interpretation and generate diverse output products. Extracting meaningful features from PolSAR data poses challenges distinct from those encountered in optical imagery. Deep Learning (DL) methods offer effective solutions for overcoming these challenges in PolSAR feature extraction. Convolutional Neural Networks (CNNs) play a crucial role in capturing PolSAR image characteristics by leveraging kernel capabilities to consider local information and the complex-valued nature of PolSAR data. In this study, a novel three-branch fusion of complex-valued CNN named Shallow to Deep Feature Fusion Network (SDF2Net) is proposed for PolSAR image classification. To validate the performance of the proposed method, classification results are compared against multiple state-of-the-art approaches using the Airborne Synthetic Aperture Radar (AIRSAR) datasets of Flevoland, San Francisco, and ESAR Oberpfaffenhofen dataset. The results indicate that the proposed approach demonstrates improvements in OA, with 1.3% and 0.8% enhancement for the AIRSAR datasets and 0.5% improvement for the ESAR dataset. The analyses conducted on the Flevoland data underscore the effectiveness of the SDF2Net model, revealing a promising OA of 96.01% even with only 1% sampling ratio.

Background: This study assesses the effects of the ‘Radiant’ image enhancement technique on fetal nuchal translucency (NT) measurements during first trimester sonographic ex-ams. Methods: A retrospective analysis of 263 ultrasound images of first trimester midsagittal sections was conducted. NT measurements were obtained using a semi-automatic tool. Statistical methods were applied to compare NT measurements with and without ‘Radi-ant’ enhancement. An in-vitro setup with predefined line distances provided additional data. Results: Incremental increases in NT measurements were observed with varying levels of ‘Radiant’ application: An average increase of 0.19 mm with ‘Radiant min’, 0.24 mm with ‘Radiant mid’ and 0.30 mm with ‘Radiant max.’ The in-vitro results supported these findings, showing consistent effects on line thickness and measurement accuracy, with the smallest mean deviation occurring at the ‘Radiant mid’ setting. Conclusions: ‘Radiant’ image enhancement leads to significant increases in NT measure-ments. To avoid systematic biases in clinical assessments, it is advisable to disable ‘Radi-ant’ during NT measurement procedures. Further studies are necessary to corroborate these findings and to consider updates to the NT reference tables based on this technology.

Prostate cancer (PCa) is the most diagnosed non-cutaneous cancer in men. Despite therapies such as radical prostatectomy, which is considered curative, distant metastases may form resulting in biochemical recurrence (BCR). This study used radiomic features calculated from multi-parametric magnetic resonance imaging (MP-MRI) to evaluate their ability to predict BCR and PCa presence. Data from a total of 279 patients, of which 46 experienced BCR, undergoing MP-MRI prior to surgery were assessed for this study. After surgery, the prostate was sectioned using patient-specific 3D-printed slicing jigs modeled using the T2-weighted imaging (T2WI). Sectioned tissue was stained, digitized, and annotated by a GU-fellowship trained pathologist for cancer presence. Digitized slides and annotations were co-registered to the T2WI and radiomic features were calculated across the whole prostate and cancerous lesions. A tree regression model was fitted to assess the ability of radiomic features to predict BCR, and a tree classification model was fitted with the same radiomic features to classify regions of cancer. We found that 10 radiomic features predict eventual BCR with an AUC of 0.97 and classifying cancer at an accuracy of 89.9%. This study showcases the application for a radiomics-based tool to screen for the presence of prostate cancer and assess patient prognosis, as determined by biochemical recurrence.

Infrared and visible light image fusion technology integrates image feature information from two different modalities to generate an image that integrates complementary information from the source images. However, in low-light scenarios, the degradation of lighting in visible light images leads to existing fusion methods being unable to effectively extract texture detail information from the scene. At this time, the target prominence information provided by infrared images alone is far from sufficient. To address this challenge, this paper proposes a lightweight infrared and visible light image fusion method based on low-light enhancement, named LLE-Fuse. Firstly, the method improves the MobileOne Block by embedding the Sobel operator in the Edge-MobileOne Block to perform feature extraction and downsampling on the source images. Then, intermediate features of different scales are obtained and fused through a cross-modal attention fusion module, followed by image reconstruction using a decoder with upsampling. Next, the CLAHE algorithm is used for image enhancement of infrared and visible light images, and the enhanced loss guides the network model to learn the capability of low-light enhancement. Finally, upon completion of the network training, the method optimizes the Edge-MobileOne Block into the direct connection structure of MobileNetV1 through structural re-parameterization, effectively reducing the computational resource consumption of the model network. Through extensive experimental comparisons, this paper's method demonstrates excellent performance in both visual appeal and evaluation metrics, providing satisfactory fusion results even in low-light scenarios.

Deep learning image reconstruction (DLIR) algorithms employs convolutional neural networks (CNNs) for CT image reconstruction to produce CT images with a very low noise level, even at low radiation dose. The aim of this study was to assess whether the DLIR algorithm reduces the CT effective dose (ED) and im-proves CT image quality in comparison with filtered back projection (FBP) and iterative reconstruction (IR) algorithms in intensive care unit (ICU) patients. We identified all consecutive patients referred to the ICU of a single hospital who underwent at least two consecutive chest and/or abdominal contrast-enhanced CT scans within a time period of 30 days using DLIR and subsequently FBP or IR algorithm (Advanced Mod-eled Iterative Reconstruction model-based algorithm [ADMIRE], or Adaptive Iterative Dose Reduction 3D [AIDR 3D]) for CT image reconstruction. The radiation ED, noise level, and signal-to-noise ratio (SNR) were compared between the different CT scanners. The non-parametric Wilcoxon test was used for statistical comparison. Statistical significance was set at p < 0.05. A total of 83 patients (mean age, 59 ± 15 years [standard deviation]; 56 men) were included. DLIR vs FBP reduced ED (18.45 ± 13.16 mSv vs 22.06 ± 9.55 mSv, P < 0.05), while DLIR vs FBP and vs ADMIRE and AIDR 3D IR algorithms reduced image noise (8.45 ± 3.24 vs 14.85 ± 2.73 vs 14.77 ± 32.77 and 11.17 ± 32.77\, P < 0.05) and increased SNR (11.53 ± 9.28 vs 3.99 ± 1.23 vs 5.84 ± 2.74 and 3.58 ± 2.74, P < 0.05). CT scanners employing DLIR reduced radiation ED and im-proved SNR compared to CT scanners using FBP, whereas CT scanners using DLIR improved SNR com-pared to CT scanners using FBP or IR algorithms in ICU patients.

Artificial intelligence provides a new research concept for digital image processing. However, at present, artificial intelligence is rarely introduced into the teaching of digital image processing in colleges and universities, and there are problems such as obsolete teaching content, single teaching methods, and simple course experiments, which affect the teaching effect and are not conducive to the cultivation of comprehensive and innovative talents. Digital image processing technology brings more possibilities to communication engineering and makes communication more convenient. For example, video calls and photo transmission make people's communication methods in daily life more and more diversified. Time and space limitations allow people to meet online, creating more communication possibilities. However, there are still many problems and methods worthy of in-depth exploration. Therefore, this paper has a comprehensive understanding and mastery of the traditional and deep learning methods of digital image processing to improve the relevant project practice and scientific research exploration ability and refer for similar research conclusions.

This paper presents an advanced approach for the Detection of MRI brain tumor images using Convolutional Neural Networks (CNNs). The study focuses on employing sophisticated techniques such as data augmentation, model optimization, and rigorous performance evaluation metrics to achieve high accuracy in multi-class classification tasks. Additionally, we integrate the concept of Self-Expanding Convolutional Neural Networks (SECNNs), which dynamically adjust model complexity during training. This approach ensures optimal performance while maintaining computational efficiency. The dataset used in this research comprises MRI images categorized into four distinct classes: glioma, meningioma, no tumor, and pituitary tumor. Our method demonstrates a notable test accuracy of 93.98%

Simple summary: The noninvasive differentiation of hepatocellular carcinoma (HCC) from intrahepatic cholangiocarcinoma (ICC) remains challenging. In recent years, the number of studies on the application of radiomics in liver cancer has grown dramatically. However, there have been very few studies on the differentiation of HCC from ICC based on multisequence magnetic resonance imaging (MRI) radiomics. This study aimed to investigate the efficacy of a radiomic model based on preoperative fat suppression T2-weighted imaging (FS-T2WI) and dynamic contrast-enhanced MRI features in the arterial phase (A) and portal venous phase (P) for the differentiation of HCC from ICC. Abstract: The purpose of this study was to investigate the efficacy of magnetic resonance imaging (MRI) radiomics in differentiating hepatocellular carcinoma (HCC) from intrahepatic cholangiocarcinoma (ICC). The clinical and MRI data of 129 pathologically confirmed HCC cases and 48 ICC cases from April 2016 to December 2021 at the Affiliated Hospital of North Sichuan Medical College were retrospectively analyzed. Included cases were randomly divided at a ratio of 7:3 into a training group of 124 cases (90 HCC cases and 34 ICC cases) and a validation group of 53 cases (39 HCC cases and 14 ICC cases). Radiomic features were extracted from axial fat-suppression T2-weighted imaging (FS-T2WI) and axial arterial-phase (A) and portal-venous-phase (P) dynamic contrast-enhanced MRI sequences, and the corresponding datasets were generated. The least absolute shrinkage and selection operator (LASSO) method was used to select the best radiomic features. Logistic regression was used to establish a radiomic model for each sequence (FS-T2WI, A, and P models) and a joint model (M model) integrating the radiomic features of all the sequences. The performance of each model was evaluated using the area under the receiver operating characteristic curve (AUC). The AUC of the FS-T2WI, A, P, and M models for distinguishing HCC from ICC was 0.693, 0.863, 0.818, and 0.914 in the training group and 0.690, 0.784, 0.727, and 0.802 in the validation group, respectively. The results of this study suggest that MRI-based radiomics may help noninvasively differentiate HCC from ICC. The model integrating the radiomic features of multiple sequences showed further improvement in performance.

Brain tissue segmentation is an important component of clinical diagnosis of brain diseases by means of multi-modal magnetic resonance imaging (MR). Brain tissue segmentation is developed by many unsupervised methods in literature. The most commonly used unsupervised methods are: K-Means, Expectation Maximization and Fuzzy Clustering. Fuzzy clustering methods offer considerable benefits compared with the aforementioned methods as they are capable of handling brain images which are complex, largely uncertain and imprecise in nature. However, this approach suffers from the intrinsic noise and intensity inhomogeneity (IIH) in the data resulted from the acquisition process. To resolve these issues, we propose a fuzzy consensus clustering algorithm that defines a membership function resulted from a voting schema to cluster the pixels. In particular, we first pre-process the MRI data and employ several segmentation techniques based on traditional fuzzy sets and intuitionistic sets. Then, we adopted a voting schema to fuse the results of the applied clustering methods. Finally, to evaluate the proposed method, we used the well-known performance measures (boundary measure, overlap measure and volume measure) on two publicly available datasets (OASIS and IBSR18). The experimental results show the superior performance of the proposed method in comparison with the recent state of the arts.

Abstract: Rationale. Object tracking has significance in many applications ranging from control of unmanned vehicles to autonomous monitoring of specific situations and events, especially when providing safety for patients with certain adverse conditions such as epileptic seizures. Conventional tracking methods face many challenges, such as the need for dedicated attached devices or tags, influence by high image noise, complex object movements, and intensive com-putational requirements. We have developed earlier computationally efficient algorithms for global optical flow reconstruction of group velocities that provide means for convulsive seizure detection and have potential applications in fall and apnea detection. Here, we address the chal-lenge of using the same calculated group velocities for object tracking in parallel. Methods. We propose a novel optical flow-based method for object tracking. It utilizes real-time image se-quences from the camera and directly reconstructs global motion-group parameters of the con-tent. These parameters can steer a rectangular region of interest surrounding the moving object to follow the target. The method successfully applies to multi-spectral data, further improving its effectiveness. Results. Experimental results on simulated tests and complex real-world data demonstrate the method's capabilities. The proposed optical flow reconstruction can provide accurate, robust, and faster results compared to current state-of-the-art approaches.

The primary objective of this study was to demonstrate the potential of digital image analysis as a tool to identify microplastic (MP) particles in surface waters and to facilitate their characterisation in terms of 2D and 3D morphology. Digital image analysis preceded by microscopic analysis was used for an exhaustive quantitative and qualitative evaluation of MPs isolated from the Vistula river. Using image processing procedures, 2D and 3D shape descriptors were determined. The Principal Components Analysis (PCA) was used to interpret the relationships between the parameters studied, characterising MP particle geometry, type and colour. This multivariate analysis of the data allowed 3 or 4 main factors to be extracted, explaining approximately 90% of the variation in the data characterising MP morphology. It was found that the first principal component for granules, flakes and films was largely represented by strongly correlated with 2D shape descriptors (area, perimeter, equivalent area diameter) and 3D shape descriptors (CSF, Compactness, Dimensionality). Considering the scraps, PC1 was represented by only five of the above descriptors, and the Compactness variable had the largest contribution to PC2. In addition, for granules, flakes and films, a relationship between 2D shape and the colour of their particles could be observed. For the most numerous MP group identified of multicoloured scraps, no such association was found. The results of our study can be used for further multivariate analysis regarding the presence of microplastic floating on the river surface, with a particular focus on particles of secondary origin. This is of key importance for optimising future efforts in conducting small-scale and multidimensional monitoring of and reducing plastics in the aquatic environment.

Brain tumor being one of the major health hazards always needs a prompt diagnosis for the early treatment options to improve the chances of the survival of the patients. Traditional manual assessment of MRI (magnetic resonance imaging) to identify these conditions is a common practice. Hence, automation of the diagnosis practices can considerably improve the quality of the treatment procedures. In recent years almost every method for the automated diagnosis of brain tumor detection uses a deep learning technique. Despite decent works current techniques need a significant improvement to produce better results. Along with failure to produce decent results, the current deep learning models present very complex architectures which sometimes require huge computational resources. Therefore, in this paper we present a novel method that uses a lightweight dual-stream model with dual-input to detect brain tumors on MRI images. Both the inputs use different pre-processing mechanisms based on Contrast Limited Adaptive Histogram Equalization (CLAHE) and White Patch Retinex algorithm in order to enhance the feature learning capabilities of the proposed model. In addition, the proposed method uses a two-fold margin loss to boost training process for better feature learning. The proposed method produces state-of-the-art results for the detection of Glioma, Meningioma and Pituitary tumors. The model presents accuracy of 99%, 98% and 99% respectively for Glioma, Meningioma and Pituitary tumor detection.

Thermal infrared imagery provides temperature information on target objects, and has been widely applied in non-destructive testing. However, thermal infrared imagery is not always able to display detailed textures of inspected objects, which hampers the understanding of geometric entities consisting of temperature information. Although some commercial software has been developed for 3D thermal model displays, the software requires the use of expensive specific thermal infrared sensors. This study proposes a cost-effective method for 3D thermal model reconstruction based on image-based modeling. Two smart phones and a low-cost thermal infrared camera are employed to acquire visible images and thermal images, respectively, that are fused for 3D thermal model reconstruction. The experiment results demonstrate that the proposed method is able to effectively reconstruct a 3D thermal model which extremely approximates its corresponding entity. The total computation time for the 3D thermal model reconstruction is intensive while generating dense points required for the creation of a geometric entity. Future work will improve the efficiency of the proposed method in order to expand its potential applications to in-time monitoring.

Facial recognition systems are widely used systems around the globe. Their applications in real world scenarios like law enforcement, surveillance, ID card identification, information security, access control and many more has made them very important in today’s world. These systems have shown promising results and excellent performance; however, these systems need tremendous number of facial images for training before they are implemented in the real-world scenarios. The problem arises when we face lack of training images due to which the performance of such systems decreases exponentially. The problem becomes even worse when there is only one image per subject for training our facial recognition system, the probe image might contain variation like illumination, expression and disguise which are hard to be accurately recognized. Generative models have achieved great success for handling the lack of training data by generating synthetic data that resembles the original data. We have created a new method by fine tuning the basic Conditional Generative Adversarial Network (CGAN) to generate synthetic facial images provided only single image per subject. These synthetic facial images contain six variations that are smile, anger, stare, illumination and disguise. We increased the size of the dataset and then applied a convolutional neural network for facial recognition, which improved the accuracy of our system from 0.76 to 0.99.

Background. To describe the characteristics of anterior mediastinal masses on conventional magnetic resonance imaging (MRI) and to assess the role of the Apparent Diffusion Coefficient (ADC) value in distinguishing benign from malignant mediastinal lesions. Methods. We conducted a retrospective cross-sectional study on 55 patients with anterior mediastinal mass who performed MRI before treatment. Biopsy and histopathological assessments were done after that. A radiologist evaluates the changes of signal intensity on these sequences: T1- weighted VIBE DIXON pre and post-contrast with Gadolinium, T2 HASTE, T2 TIRM, DWI/ADC, to determine the size, margin of the lesion, the presence of fat, cystic in it. ADCs values were calculated from the ADC maps which were constructed from b = 0 and b = 2000 Results. The study was composed of 55 patients, with 5 benign lesions and 50 malignant lesions. The ADCmean, ADCmedian, ADC10, and ADC90 in the histogram-based approach and hot-spot-ROI-based mean ADC for the malignant lesions was significantly lower than those found in benign lesions (P-value <0.05). The hot-spot-ROI-based mean ADC had the highest value in differentiation between benign and malignant mediastinal lesions, between group A (benign lesions, thymoma A, AB, B1) and group B (thymoma B2, B3 and other malignant lesions). The cut-off point of the ADC value differentiating malignant from benign mediastinal lesions was 1,17x10-3mm2/s with sensitivity of 80%, and specificity of 80%. The cut off point of the ADC value differentiating group A from group B was 0.99 x10-3mm2/s with sensitivity of 78,4%, and specificity of 88.9%. The cut-off point of the ADC value differentiating lymphoma from other malignant lesions was 0,91 x10-3mm2/s with sensitivity of 100%, and specificity of 60.5%. Conclusion. Diffusion-weighted MRI and measurement of ADC value in histogram-based approach and hot-spot-ROI-based mean ADC are very helpful in the differentiation between benign and malignant anterior mediastinal lesions.

Timely and accurate acquisition of information on distribution of the crop planting structure in Loess Plateau of eastern Gansu Province, one of the most important agricultural areas in western China, is crucial for promoting fine management of agriculture and ensuring food security. In this study, the Object-Based Image Classification (OBIC), the Random Forest (RF) and Convolutional Neural Network (CNN) models were employed to classify the crop planting structure of four representative test areas in Qingyang City in a precise manner. Firstly, different optimal segmentation scales for various crops were selected using the Estimation of Scale Parameter 2 (ESP2) tool and the Ratio of Mean Difference to Neighbors(ABS) to Standard Deviation (RMAS)model. The images were then segmented through multiresolution segmentation combined with the Canny Edge Detection algorithm. Secondly, the L1 regularized logistic regression model was utilized to select and optimize 39 spatial feature factors including spectral, textural, geometric, and index features, in conjunction with phenological factors. Lastly, under the multi-level classification framework, the Random Forest (RF) classifier and Convolutional Neural Network (CNN) model, combined with object-based multiresolution segmentation, was used to classify the crop planting structure. The findings show that: Thanks to the Canny Edge Detection algorithm, we can obtain a more complete boundary of the segmented objects and improve the separability. The optimal segmentation scales for corn, vegetables, and buckwheat were found to be 55, 70, and 35, respectively, while wheat and apple had optimal segmentation scales of 65. In addition to phenological characteristics, the number of selected spatial features for corn, vegetables, buckwheat, wheat, and apple were 9, 7, 16, 12, and 10, respectively. The CNN model demonstrated high consistency with the RF model in the classification results, but the accuracy of RF model is higher than that of CNN model on the whole. The overall accuracy of classification using RF model in four test areas registered 91.93%, 94.92%, 89.37% and 90.68%, respectively. This paper introduced crop phenological factors, effectively improving the extraction precision of shattered agricultural planting structure in the Loess Plateau of eastern Gansu Province. Its findings have important application value in crop monitoring, management, food security and other related fields.

This study addresses the challenge of treating skin cancer effectively, especially in visible areas like the face, where traditional methods may be undesirable. Current options, including surgery and radiation therapy, have limitations such as complexity, expense, and imprecise dose delivery. The proposed solution involves additively manufacturing personalized patches using diagnostic imaging data, offering a targeted and controlled dose of beta-emitting isotopes like Y-90. The patches, tailored to the tumor's shape and depth, aim to minimize damage to healthy tissues and structures. Through 3D printing technology we demonstrated the feasibility of creating individualized applicators filled with radioisotopes, that have the potential to deliver therapeutic doses while ensuring patient comfort and affordability. This innovative approach, based on radiation delivery simulations, offers a promising future alternative to conventional radiation therapy methods. Clinical trials are required to validate its efficacy and safety, but the potential for reduced radiation exposure and enhanced treatment precision positions this personalized and targeted therapy as a valuable advancement in skin cancer treatment.

Magnetic resonance imaging (MRI) is crucial for its superior soft tissue contrast and high spatial resolution. Integrating deep learning algorithms into MRI reconstruction enhances image quality and efficiency, but a comprehensive review of optimization-based deep learning models for MRI reconstruction has been missing. This study fills that gap by examining the latest optimization-based algorithms in deep learning for MRI reconstruction, including gradient descent algorithms, proximal gradient descent algorithms, ADMM, PDHG, and diffusion models combined with gradient descent. Learnable optimization algorithms (LOA) are highlighted for their ability to map optimization processes to structured neural networks, improving model interpretability and performance. The study demonstrates significant advancements in MRI reconstruction through deep learning, with successful clinical applications. These findings provide valuable insights and resources for researchers aiming to advance medical imaging using innovative deep learning techniques.

The aim of this retrospective study was to identify myocardial injury after COVID-19 inflamation and to explore whether myocardial damage could be a possible cause of the persistent symptoms following COVID-19 infection in previously healthy individuals. The study included 139 patients who were enrolled between January-June 2021, mean age 46.7±15.2 years, 68 were men, 71 were women without known cardiac or pulmonary diseases. All patients underwent clinical work up, lab. analyses, cardiac ultrasound, and CMR on 1.5 T scanner using a recommended protocol for morphological and functional assessment before and after contrast media application with multi-parametric sequences. In 39% of patients late gadolinium enhancement (LGE) was found as a sign of myocarditis. Fibrinogen was statistically significantly higher in patients with LGE than in those without LGE, (4.3±0.23 vs 3.2±0.14g/L, p<0.05; respectively), as well as D-dimer (1.8±0.3 vs 0.8±0.1 mg/L FEU). Also troponin was statistically significantly higher in patients with myocardial LGE (13.1±0.4ng/L) compared to those with normal myocardium (4.9±0.3ng/L, p<0.001). We demonstrated chest pain, fatigue and elevated troponin to be independent predictors for LGE. Septal LGE was shown to be predictor for arrhythmias. The use of CMR is a potential risk stratification tool in evaluating outcomes following COVID-19 myocarditis.