This paper presents a system for identification of wind features, such as gusts and wind shear. These are of particular interest in the context of energy-efficient navigation of Small Unmanned Aerial Systems (UAS). The proposed system generates real-time wind vector estimates and a novel algorithm to generate wind field predictions. Estimations are based on the integration of an off-the-shelf navigation system and airspeed readings in a so-called direct approach. Wind predictions use atmospheric models to characterize the wind field with different statistical analyses. During the prediction stage, the system is able to incorporate, in a big-data approach, wind measurements from previous flights in order to enhance the approximations. Wind estimates are classified and fitted into a Weibull probability density function. A Genetic Algorithm (GA) is utilized to determine the shaping and scale parameters of the distribution, which are employed to determine the most probable wind speed at a certain position. The system uses this information to characterize a wind shear or a discrete gust and also utilizes a Gaussian Process regression to characterize continuous gusts. The knowledge of the wind features is crucial for computing energy-efficient trajectories with low cost and payload. Therefore, the system provides a solution that does not require any additional sensors. The system architecture presents a modular decentralized approach, in which the main parts of the system are separated in modules and the exchange of information is managed by a communication handler to enhance upgradeability and maintainability. Validation is done providing preliminary results of both simulations and Software-In-The-Loop testing. Telemetry data collected from real flights, performed in the Seville Metropolitan Area in Andalusia (Spain), was used for testing. Results show that wind estimation and predictions can be calculated at 1 Hz and a wind map can be updated at 0.4 Hz. Predictions show a convergence time with a 95% confidence interval of approximately 30 s.

As the most serious of the many worse new pathological changes caused by diabetes, there are many risk factors for the occurrence and development of DR. It mainly includes hyperglycemia, hypertension, hyperlipidemia and so on. Among them, hyperglycemia is the most critical cause, which plays a key role in the pathological changes of DR.High-sucrose diets(HSDs) lead to elevated blood glucose levels in vivo, which, through oxidative stress, inflammation, the production of AGEs and VEGF, causes plenty of pathological damages to the retina and ultimately bring about loss of vision. The existing therapies for DR primarily target the terminal stage of the disease, when irreversible visual impairment has appeared. Therefore, early prevention is particularly critical. Early prevention of DR-related vision loss requires adjustments to dietary habits, mainly by reducing sugar intake. This article primarily discusses the risk factors, pathophysiological processes, and molecular mechanisms associated with the development of DR caused by HSDs. It aims to raise awareness of the crucial role of diet in the occurrence and progression of DR, promote timely changes in dietary habits, prevent vision loss, and improve the quality of life. The aim is to make people aware of the importance of diet in the occurrence and progression of DR. According to the dietary modification strategies we give, patients can change their poor eating habits timely, avoid the retinopathy that can be avoided theoretically, and obtain a excellent outcome.

Background: Visual acuity (VA) assessments are crucial in ophthalmology but traditionally rely on in-clinic evaluations. The emergence of telemedicine has spurred interest in creating dependable self-administered VA tests for use beyond standard clinical environments. This study evaluates the practicality and validity of a self-administered Near VA card test against traditional Snellen and Rosenbaum Pocket Vision Screener (RPVS) methods for home monitoring and enhancing clinical workflow. Methods: In a cross-sectional study a near VA card (Hadassah Self-Visual Acuity Screener-HSVA) was developed with written and videotaped instructions for self-use. Patients with a minimal best corrected VA (BCVA) of 1.0 LogMAR in at least one eye were recruited from Ophthalmology and Optometry clinics. Outcomes included mean BCVA difference between the self-administered and those obtained by the examiner, and correlations among BCVA values obtained by Snellen, RPVS, HSVA and previous distance BCVA according to the patient electronic medical records. Results: A total of 275 participants (mean age: 42.5±19.4 years, range: 18-89 years, 47% female) were included. Test-retest reliability analysis for the HSVA demonstrated very good correlation and repeatability (n=38 patients.; Rs=1.0, P

The reasons for the circular sense of human color perception generated by two sorts of color opponent neurons and three cone types are not well understood. Here we use geometrical analysis to examine the hypothesis that opponency, the recursive nature of color perception, and trichromacy arise as the most efficient ways of distinguishing spectrally different points on a plane using a minimum of color classes and receptor types.

A time-sequential working, spatially multiplexed autostereoscopic 3D display design consisting of a fast switchable RGB-color filter array is presented. The wavelength-selective filter barrier emits the light from a display over a larger active area than common autostereoscopic barrier displays. An optical modelling of wavelength-selective barriers has been used for instance to calculate the light ray distribution properties of that arrangement. To find well working display designs, automated searches by simulation and computational evaluation has been proceeded. Wavelength-selective filter barrier arrangements exhibit characteristics different from common barrier displays with similar barrier pitch and ascent. In particular, these constructions show strong angular luminance dependency under barrier inclination specified by correspondent slant angle. In time-sequential implementation it is important to avoid that quick eye or eyelid movement lead to visible color artifacts. In the millisecond regime tunable liquid crystal Fabry-Pérot color filters for the colors red, green and blue are presented. They consist of a sub-micrometer thick nematic layer sandwiched between dielectric mirrors and ITO-electrodes. These cells shall switch narrow-banding light of red, green or blue. An array for a glasses-free 3D display has to be equipped with several thousand switchable filter elements having different color apertures. The newly introduced design is usable as a multi user display as well as a single user system with user adaptive control.

The paper delineates the developed vision system of the UR5 cobot and the operating algorithm of the robotic quality control station. The hardware-software architecture of the developed robotic station was shown, consisting of a UR5 cobot equipped with a web camera and a stationary industrial camera with a lighting system. Image processing and analysis algorithms were described, the method of control and communication between the station components was discussed, and two operating scenarios were presented as a single robotic station and a robotic line. Based on the results obtained, the level of measurement noise, accuracy, and repeatability of the developed vision system were estimated.

Vision impairment may delay responses to hazards when driving. In a proof-of-concept driving simulator study, we evaluated a hazard warning device designed for vision impaired drivers. Three groups participated: 11 persons with central vision loss (CVL; median age 60 years), 12 with homonymous field loss (HFL; 52 years) and 11 with normal vision (NV; 60 years). CVL is characterised by impaired visual acuity and contrast sensitivity while HFL is a loss of vision in the same half of the visual field (blind side) in both eyes. Participants completed drives with and without the device which gave a directional vibro-tactile warning for an approaching pedestrian hazard when collision risk exceeded a pre-defined threshold. Warnings significantly (p< 0.001) reduced brake response times for CVL (∆= 0.54s) and HFL (∆= 0.30s), but not NV participants. For HFL participants, the reduction was greater (p = 0.02) for hazards on the blind (∆= 0.57s) than seeing side (∆= 0.10s). The warnings significantly reduced collision rates for CVL participants from 11 to 0% (all hazards) and for HFL participants from 30 to 1.7% (blind side hazards). Thus, hazard warnings may be beneficial in improving safety of vision impaired drivers; further research is warranted.

Vertical Indoor Farming (VIF) with hydroponics offers a promising perspective for sustainable food production. Intelligent control of VIF system components plays a key role in reducing operating costs and increasing crop yields. Modern machine vision (MV) systems use Deep Learning (DL) in combination with camera systems for various tasks in agriculture, such as disease and nutrient deficiency detection, and flower and fruit identification and classification for pollination and harvesting. This study presents the applicability of MV technology with DL modelling to detect the growth stages of chilli plants using YOLOv8 networks. The influence of different bird’s eye and side view datasets and different YOLOv8 architectures was analysed. To generate the image data for training and testing the YOLO models, chilli plants were grown in a hydroponic environment and imaged throughout their life cycle using four camera systems. The growth stages were divided into growing, flowering and fruiting classes. All trained YOLOv8 models showed reliable identification of growth stages with high accuracy. The results indicate that models trained with data from both views show better generalisation. YOLO’s middle architecture achieved the best performance.

Abstract: Colistin is a last-resort antimicrobial for treating multidrug-resistant Gram-negative bacteria. Phe-notypic colistin resistance is highly associated with plasmid-mediated mobile colistin resistance (mcr) genes. mcr-bearing Enterobacteriaceae have been detected in many countries, with the emergence of colistin-resistant pathogens a global concern. This study assessed the distribution of mcr-1, mcr-2, mcr-3, mcr-4, and mcr-5 genes with the phenotypic colistin resistance in isolates from diarrheal infants and children in Bangladesh. Bacteria were identified using the API-20E biochemical panel and 16s rDNA gene sequencing. Polymerase chain reac-tions detected mcr gene variants in the isolates. Their susceptibilities to colistin were determined by agar dilu-tion and E-test by minimal inhibitory concentration (MIC) measurements. Over 30.0% (69/225) of isolates showed colistin resistance by agar dilution assessment (MIC> 2.0 μg/mL). Overall, 15.5% of isolates carried mcr genes (7, mcr-1; 17, mcr-2; 13, mcr-3; and co-occurrence occurred in 2 isolates). Clinical breakout MIC val-ues (≥ 4 μg/mL) were associated with 91.3% of mcr-positive isolates. The mcr-positive pathogens include twenty Escherichia spp., five Shigella flexneri, five Citrobacter spp., two Klebsiella pneumoniae, and three Pseudo-monas parafulva. mcr-genes appeared to be significantly associated with phenotypic colistin resistance phe-nomena (p=0.000), with 100% colistin-resistant isolates showing MDR phenomena. Age and sex of patients showed no significant association with detected mcr variants. Overall, mcr-associated colistin-resistant bacte-ria have emerged in Bangladesh, which warrants further research to determine their spread and instigate ac-tivities to reduce resistance.

Microscopic vision plays an important role in automated micro-assembly. However, some uncertain factors in the assembly process, such as occlusion and stains can lead to the mistakes of feature extraction. Herein, to solve the problem, the deep learning techniques are introduced into the feature recognition tasks, focusing on the attention mechanism and visualizing CNNs for DL-based microscopic vision. The main contributions are summarized as follows: The CBAM attention mechanism is combined with the YOLOv5 algorithm to improve the accuracy and robustness of feature extraction. The micropart feature occlusion experiment results show that at 70% occlusion degree, YOLOV5-CBAM can reach 97.9% [email protected], which is 4.6% higher than the original one. Visualization analysis of DL-based model is conducted using Grad-CAM to make the decision result more transparent and avoid potential visual detection risks during assembly. The heatmap matching degree between GT area and high-light area is increased by 27.81% on average, which further verify the effectiveness of attention mechanism in micropart feature localization. Additionally, micropart surface stain and droplet quality classification models based on ResNet50 are trained to replace the manual sorting. The visual results are consistent with human eye discernment and judgement, confirming the reliability of parts and droplets sorting.

Many accidents, such as those involving collisions or trips, appear to involve failures of vision; but the association between accident risk and vision as conventionally assessed, is weak or absent. We addressed this conundrum by embracing the distinction inspired by neuroscientific research, between vision for perception and vision for action. A dual-process perspective predicts that accident vulnerability will be associated more strongly with vision for action than vision for perception. Older and younger adults, with relatively high and relatively low self-reported accident vulnerability (Accident Proneness Questionnaire), completed three behavioural assessments targeting: vision for perception (Freiburg Visual Acuity Test); vision for action (Vision for Action Test - VAT); and the ability to perform physical actions involving balance, walking and standing (Short Physical Performance Battery). Accident vulnerability was not associated with visual acuity or with performance of physical actions; but was associated with VAT performance. VAT assesses the ability to link visual input with a specific action –launching a saccadic eye movement as rapidly as possible, in response to shapes presented in peripheral vision. The predictive relationship between VAT performance and accident vulnerability was independent of age, visual acuity and physical performance scores. Applied implications of these findings are considered.

Neutral facial expression recognition is of great importance in various domains and applications. This study introduces a data-centric approach for neutral facial expression recognition, presenting a comprehensive study that explores different methodologies, techniques, and challenges in the field to foster a deeper understanding. The results show that data augmentation plays a crucial role in improving dataset performance. Additionally, the study investigates different model architectures and training techniques to identify the most effective approach, with the InceptionV3 model achieving the highest accuracy of 72%. Furthermore, the research examines the influence of preprocessing methods on the performance of both InceptionV3 and a simplified CNN model. Interestingly, the results indicate that preprocessing techniques positively affect the performance of the simpler CNN model but negatively impact the InceptionV3 model. The implemented system, used to evaluate the findings, demonstrates promising results, correctly classifying 77% of neutral expressions. However, there are still areas for improvement. Creating a specialized dataset that includes both neutral and non-neutral expressions would greatly enhance the accuracy of the system. By addressing limitations and implementing suggested improvements, neutral facial expression recognition can be significantly enhanced, leading to more effective and accurate results.

A study of curvature along the contour provides important sources of information about the shape of an object. Knowledge of contour curvature allows for the perception of and interaction with 3D objects. In this review, we will explore the value of contour curvature in the field of neurophysiology, psychophysics, computer vision, and psychology. The serial consolidation of disjoint edges, oriented in a particular manner, into composited curves allows building of identifiable shapes in occluded natural environments [Hess1999, Wertheimer1923, Zucker1989, Feldman2001]. Examples are our ability to pick objects, sort and manage shapes otherwise hidden or confounded by occlusion in messy natural environments. Contour curvature has been intensively studied in psychology as it forms the first steps in 2D shape building which eventually becomes 3D object recognition in the human brain.

This paper presents a novel CNN-based architecture, referred to as Q-Net, to learn local feature descriptors that are useful for matching image patches from two different spectral bands. Given correctly matched and non-matching cross-spectral image pairs, a quadruplet network is trained to map input image patches to a common Euclidean space, regardless of the input spectral band. Our approach is inspired by the recent success of triplet networks in the visible spectrum, but adapted for cross-spectral scenarios, where for each matching pair there are always two possible non-matching patches; one for each spectrum. Experimental evaluations on a public cross-spectral VIS-NIR dataset shows that the proposed approach improves the state-of-the-art. Moreover, the proposed technique can also be used in mono-spectral settings, obtaining a similar performance to triplet network descriptors, but requiring less training data.

The purpose of this study is to show an automated laser vision correction (LVC) with the transep-ithelial refractive keratectomy (TransPRK) surgery technique. Since more surgical steps have been automated over the years, we have standardized the TransPRK technique. We have been using it since 2010. This paper aims to illustrate the processes that are readily applicable to automation. To meet the patient's expectations and ensure that the patient has uncorrected visual acuity at least equal to the preoperative corrected vision with glasses, patient selection is crucial in refractive surgical procedures. One major benefit of automating the surgery is that it can be performed in a similar way by each surgeon or laser correction centre, so once the standard and results are good, these can be per-formed by different surgeons.

For centuries, Foeniculi fructus (F. fructus) has been used as a traditional herbal medicine in China and Europe and is widely used as a natural therapy for digestive disorders, including indigestion, flatulence, and bloating. The mechanism by which F. fructus alleviates functional dyspepsia was analyzed through network pharmacology, and its therapeutic effect on an animal model of functional dyspepsia was investigated. The compounds, targets, and related diseases of F. fructus were studied utilizing the traditional Chinese medicine systems pharmacology (TCMSP) database. Information on the target genes was classified using the UniProt database. A network was built using Cytoscape 3.9.1, and functional dyspepsia-related genes were checked using the Cytoscape string application. The efficacy of F. fructus on functional dyspepsia, including gastroparesis and gastrointestinal motility, was confirmed by treatment with its extract in a mouse model of loperamide-induced functional dyspepsia. Seven compounds targeted twelve functional dyspepsia-associated genes. In a functional dyspepsia mouse model, F. fructus significantly suppressed the symptoms when compared to that in the control group. Our animal studies showed that the mechanism of action of F. fructus is closely related to gastrointestinal motility. Based on animal experimental results, the results showed that F. fructus provides a potential means to treat functional dyspepsia, suggesting that its medical mechanism for functional dyspepsia can be described by the relationship between seven key compounds of F. fructus, including oleic acid and β-sitosterol, and 12 functional dyspepsia-related genes.

The TRPV3 calcium ion channel is vital for maintaining skin health and has been associated with various skin-related disorders. Since TRPV3 is involved in the development of skin inflammation, inhibiting TRPV3 could be a potential treatment strategy. Alpha-mangostin isolated from Garcinia mangostana L. extract exhibits diverse positive effects on skin health; however, the underlying mechanisms remain obscure. This study investigated the TRPV3-inhibitory properties of alpha-mangostin on TRPV3 hyperactive mutants associated with Olmsted syndrome and its impact on TRPV3-induced cytokine secretion and cell death. Our findings demonstrate that alpha-mangostin effectively inhibits TRPV3, with an IC50 of 0.077 ± 0.013 μM, showing inhibitory effects on both wild-type and mutant TRPV3. TRPV3 inhibition with alpha-mangostin decreased calcium influx and cytokine release, protecting cells from TRPV3-induced death. These results indicate that alpha-mangostin reduced inflammation in TRPV3-activated skin keratinocytes, suggesting that alpha-mangostin could be potentially used for improving inflammatory skin conditions such as dermatitis.

Computer vision is a fast-expanding discipline focusing on analyzing, altering, and comprehending images at a high level. Its goal is to figure out what's going on in front of a camera and use that knowledge to manage a computer or robotic system or to show people new visuals that are more instructive or attractive than the original camera photos. Video surveillance, biometrics, automotive, photography, movie production, Web search, medicine, augmented reality gaming, new user interfaces, and many other applications are all possible with computer vision technologies. This paper aims to describe how computer vision will be used to play a winning game of blackjack.

Computer vision is considered as an ally to solve business problems that require human intervention, intelligence and criteria. This topic of research has evolved in XXI century at faster peace, delivering various alternatives from open source until commercial platforms. With so many options and market growing, it result difficult to make a decision on which one to use, or even worse, realize it was not suited for different scenarios. In this paper we analyze five options selected arbitrarily and tested on a dataset of 755 images to detect persons in an image, using object detectors. We analyze elapsed time to process an image, error with observations by humans, number of persons detected, correlation of time and person density, object detected size and F1 Score, considering precision and recall. As we found there are score ties and similar behaviors among options available, we introduce a novel index that takes in consideration the number of persons and their pixel size, to propose the Vision Acuity Index of Computer Vision. The results demonstrate this is a good option to serve as indicator to make decisions. Also, this index proposed have a potential to be expanded for different business use cases, and to measure new proposed algorithms in the future along with the traditional metrics used previously.

Multi-view stereo (MVS) employs multi-point photography for image point positioning and three-dimensional reconstruction technology. Recently, this technology has been introduced into the monitoring of road slopes due to advances in photography and computing technology. In general, the various phases of post-image processing procedures are applied to various photographic data. In this study a novel, automated image-monitoring system is proposed to improve the ability of automatic processing. First, an Internet of things (IoT)-based digital photography system architecture was constructed to provide automatic control of camera photography and real-time transmission of image data. In addition, a visual SfM-MVS 3D reconstruction technique was used to develop related software and hardware interfaces based on the built-in Python computing framework of Photoscan Pro. The software integrates fully automatic photography, image transmission, monitoring of data processing and product release programs. The experimental results show that the system architecture can be applied to fully automatic three-dimensional monitoring of road slopes.

We describe a vision for a national-scale heavy mineral (HM) map generated through automated mineralogical identification and quantification of HMs contained in floodplain sediments from large catchments covering most of Australia. The composition of the sediments reflects the dominant rock types in each catchment, with the generally resistant HMs largely preserving the mineralogical fingerprint of their host protoliths through the weathering-transport-deposition cycle. Heavy mineral presence/absence, absolute and relative abundance, and co-occurrence are metrics useful to map, discover and interpret catchment lithotype(s), geodynamic setting, magmatism, metamorphic grade, alteration or mineralization. Underpinning this vision is a pilot project, focusing on a subset of the national sediment sample archive, which is used to demonstrate the feasibility of the larger, national-scale project. We preview a bespoke, cloud-based mineral network analysis (MNA) tool to visualize, explore and discover relationships between HMs as well as between them and geological setting or mineral deposits. We envisage that the Heavy Mineral Map of Australia and MNA tool will contribute significantly to mineral prospectivity analysis and modeling here, particularly for technology critical elements and their host minerals, which are central to the global economy transitioning to a more sustainable, decarbonized paradigm.

Ultrasound (US) has become a widely used imaging modality in clinical practice, characterized by its rapidly evolving technology, advantages, and unique challenges such as low imaging quality and high variability. There is a critical need to develop advanced automatic US image analysis methods to enhance diagnostic accuracy and objectivity. Vision transformer, a recent innovation in machine learning, has demonstrated significant potential in various research fields, including general image analysis and computer vision, due to its capacity to process large datasets and learn complex patterns. Its suitability for automatic US image analysis tasks, such as classification, detection, and segmentation, has been recognized. This review provides an introduction to vision transformer and discusses its applications in specific US image analysis tasks, while also addressing the open challenges and potential future trends in its application in medical US image analysis. Vision transformer has shown promise in enhancing the accuracy and efficiency of ultrasound image analysis and is expected to play an increasingly important role in the diagnosis and treatment of medical conditions using ultrasound imaging as technology progresses.

This review paper provides a comprehensive overview of machine vision pose measurement algorithms. The paper focuses on the state-of-the-art algorithms and their applications. The paper is structured as follows: The introduction in Section 1 provides a brief overview of the field of machine vision pose measurement. Section 2 describes the commonly used algorithms for machine vision pose measurement. Section 3 discusses the factors that affect the accuracy and reliability of machine vision pose measurement algorithms. Section 4 presents the applications of machine vision pose measurement in various fields. The paper provides specific examples of how machine vision pose measurement is used in each of these fields. Finally, Section 5 summarizes the paper and provides future research directions. The paper highlights the need for more robust and accurate algorithms that can handle varying lighting conditions and occlusion. It also suggests that the integration of machine learning techniques may improve the performance of machine vision pose measurement algorithms. Overall, this review paper provides a comprehensive overview of machine vision pose measurement algorithms, their applications, and the factors that affect their accuracy and reliability. It provides a valuable resource for researchers and practitioners working in the field of computer vision.

The Avian retina is far less known than that of mammals such as mouse and macaque, and detailed study is overdue. The chicken (Gallus gallus) has potential as a model, in part because research can build on developmental studies of the eye and nervous system. One can expect differences between bird and mammal retinas simply because whereas most mammals have three types of visual photoreceptor birds normally have six. Spectral pathways and colour vision are of particular interest, because filtering by oil droplets narrows cone spectral sensitivities and birds are probably tetrachromatic. The number of receptor inputs is reflected in the retinal circuitry. The chicken probably has four types of horizontal cell, there are at least 11 types of bipolar cell, often with bi- or tri-stratified axon terminals, and there is a high density of ganglion cells, which make complex connections in the inner plexiform layer. In addition, there is likely to be retinal specialisation, for example chicken photoreceptors and ganglion cells have separate peaks of cell density in the central and dorsal retina, which probably serve different types of behaviour.

Vertebrate color vision is evolutionarily ancient. Jawless fish evolved four main spectral types of cone photoreceptor, almost certainly complemented by retinal circuits to process chromatic opponent signals. Subsequent evolution of photoreceptors and visual pigments are now documented for many vertebrate lineages and species, giving insight into evolutionary variation and ecological adaptation of color vision. We look at organization of the photoreceptor mosaic and the functions different types of cone in teleost fish, primates, and birds and reptiles. By comparison less is known about the underlying neural processing. Here we outline the diversity of vertebrate color vision and summarize our understanding of how spectral information picked up by animal photoreceptor arrays is adapted to natural signals. We then turn to the question of how spectral information is processed in the retina. Here, the quite well known and comparatively ‘simple’ system of mammals such as mice and primates reveals some evolutionarily conserved features such as the mammalian Blue^ON system which compares short and long wavelength receptors signals. We then survey our current understanding of the more complex circuits of fish, amphibians, birds and reptiles. Together, these clades make up more than 90% of vertebrate species, yet we know disturbingly little about their neural circuits for colour vision beyond the photoreceptors. Here, long-standing work on goldfish, freshwater turtles and other species is being complemented by new insights gained from the experimentally amendable retina of zebrafish. From this body of work, one thing is clear: The retinal basis of colour vision in non-mammalian vertebrates is substantially richer compared to mammals: Diverse and complex spectral tunings are established at the level of the cone output via horizontal cell feedforward circuits. From here, zebrafish use cone-selective wiring in bipolar cells to set-up color opponent synaptic layers in the inner retina, which in turn lead a large diversity of color-opponent channels for transmission to the brain. However, while we are starting to build an understanding of the richness of spectral properties in some of these species’ retinal neurons, little is known about inner retinal connectivity and cell-type identify. To gain an understanding of their actual circuits, and thus to build a more generalised understanding of the vertebrate retinal basis of color vision, it will be paramount to expand ongoing efforts in deciphering the retinal circuits of non-mammalian models.

Primate vision is an active process that constructs a stable internal representation of the 3D world based on 2D sensory inputs that are inherently unstable due to incessant eye movements. We present here a mathematical framework for processing visual information for a biologically-mediated active vision stereo system with asymmetric conformal cameras. This model utilizes the geometric analysis on the Riemann sphere developed in the group-theoretic framework of the conformal camera, thus far only applicable in modeling monocular vision. The asymmetric conformal camera model constructed here includes the fovea’s asymmetric displacement on the retina and the eye’s natural crystalline lens tilt and decentration, as observed in ophthalmological diagnostics. We extend the group-theoretic framework underlying the conformal camera to the stereo system with asymmetric conformal cameras. Our numerical simulation shows that the 1 theoretical horopter curves in this stereo system are conics that well approximate the empirical longitudinal horopters of the primate vision system.

Time series forecasting has been a challenging area in the field of Artificial Intel-ligence. Various approaches such as linear Neural Networks, Recurrent Linear Neural Networks, Convolutional Neural Networks and recently Transformers have been attempted for the time series forecasting domain. Although, Trans-former-based architectures have been outstanding in the Natural Language Pro-cessing domain, especially in autoregressive language modeling, the initial at-tempts to use transformers in the time series arena have met with mixed success. One of the recent papers demonstrated that modeling the multi-variate time se-ries problem as independent channels on a transformer architecture produced lower mean square and mean absolute errors on benchmarks, however, another recent paper claimed that a simple linear neural network out-performs previous approaches including transformer-based designs. We investigate this paradox in detail comparing the linear Neural Network and Transformer based designs, provide insights to why a certain approach may be better for a particular type of problem. We also improve upon the recently proposed simple linear Neural Network based architecture by using dual pipelines with batch normalization and reversible instance normalization. Our enhanced architecture outperforms all existing architectures for time series forecasting on majority of the popular benchmarks.

Robotic odor source localization (OSL) is a technology that enables mobile robots or autonomous vehicles to find an odor source in unknown environments. An effective navigation algorithm that guides the robot to approach the odor source is the key to successfully locating the odor source. While traditional OSL approaches primarily utilize an Olfaction-only strategy, guiding robots to find the odor source by tracing emitted odor plumes, our work introduces a fusion navigation algorithm that combines both vision and olfaction-based techniques. This hybrid approach addresses challenges such as turbulent airflow, which disrupts olfaction sensing, and physical obstacles inside the search area, which may impede vision detection. In this work, we propose a hierarchical control mechanism that dynamically shifts the robot’s search behavior among four strategies: crosswind maneuver, Obstacle-avoid Navigation, Vision-based Navigation, and Olfaction-based Navigation. Our methodology includes a custom-trained deep-learning model for visual target detection and a moth-inspired algorithm for Olfaction-based navigation. To assess the effectiveness of our approach, we implemented the proposed algorithm on a mobile robot in a search environment with obstacles. Experimental results demonstrate that our Vision and Olfaction Fusion algorithm significantly outperforms Vision-only and Olfaction-only methods, reducing average search time by 54% and 30%, respectively.

Identification of plants is a challenging task which aims to identify the family, genus, and species level according to morphological features. Automated deep learning-based computer vision algorithms are widely used for identifying plants and can help users to narrow down the possibilities. However, numerous morphological similarities between and within species make the classification difficult. In this paper, we tested a custom convolution neural network (CNN) and vision transformer (ViT) based models using the PyTorch framework to classify plants. We used a large dataset of 88K and 16K images for classifying plants at genus and species levels respectively. Our results show that for classifying plants at the genus level, ViT models perform better compared to CNN-based models ResNet50 and ResNet-RS-420, and other state-of-the-art CNN-based models suggested in previous studies on a similar dataset. The ViT model achieved top accuracy of 83.3% for classifying plants at the genus level. ViT models also perform better for classifying plants at the species level compared to CNN-based models ResNet50 and ResNet-RS-420, with a top accuracy of 92.5%. We show that the correct set of augmentation techniques plays an important role in classification success.

The quality of yarn is essential in the control of the fabrics processes. There is some commercial equipment that measures the quality of yarn based on sensors, of different types, used for collecting data about some yarn characteristic parameters. The existing equipment, for the above-mentioned purpose, is characterized by its high size and cost, and for allowing the analysis of only few yarn quality parameters. Thus, this paper presents the development and results obtained with the design of a mechatronic prototype integrating a computer vision system that allows, among other parameters, the analysis and classification, in real time, of the hairs of the yarn using artificial intelligence techniques. The system also determines other characteristics inherent to the yarn quality analysis, such as: linear mass, diameter, volume, twist orientation, twist step, average mass deviation, coefficient of variation, hairiness coefficient, average hairiness deviation and standard hairiness deviation, as well as performs spectral analysis. A comparison of the obtained results with the designed system and a commercial equipment was performed validating the undertaken methodology.

Image classification in Remote Sensing and Geographic Information Systems (GIS) containing various land-cover classes is essential for efficient and sustainable land-use estimation, and other tasks like object detection, localization and segmentation. Deep Learning (DL) techniques have shown a tremendous potential in the GIS domain. While Convolutional Neural Networks (CNN) have dominated most of the image analysis domain, a new architecture called transformers have proved to be a unifying solution for several AI-based processing pipelines. Vision Transformers (ViT), a variant of transformers can have comparable and in some cases better accuracy than a CNN. However, they suffer from a significant drawback associated with an excessive use of training parameters. In this research we explore several modifications in the vision transformer architectures, especially MobileViT that can be optimized while boosting accuracy. To verify our proposed approach these new architectures are trained on four land-cover datasets AID, EuroSAT, UC-Merced, and WHU-RS19. Experiments reveal that combination of lightweight convolutional layers including ShuffleNet along with depthwise separable convolutions and average pooling can reduce the trainable parameters by 17.85% and yet achieve higher accuracy than the base MobileViT. It is also observed that utilizing a combination of convolution layers along with multi-headed self attention layers in MobileViT variants provide better performance in capturing local and global features unlike the standalone ViT architecture that utilizes almost 95% more parameters than the proposed MobileViT variant.

People with Down syndrome have more visual problems than general population. They experience a premature aging, and it would be expected they will also have an acceleration in worsening visual function. A prospective observational study which includes visual acuity, refractive error, accommodation, binocular and colour vision was performed to young adults with (n=69) and without (n=65) Down syndrome and to a senior group (n=55) without Down syndrome. Results showed significant differences in visual acuity between groups (p&lt;0.001) and it can be improved with a new prescription in 40% of the participants with Down syndrome. Regarding to accommodative state, no significant differences were found between groups of young people. Concerning binocular vision, 64.7% of strabismus was observed in the group with Down syndrome (p&lt;0.001). Visual abnormalities are significant in young adults with Down syndrome and are different from those of older people without Down syndrome, some of which can be improved by providing the optimal prescription as well as regular eye examinations.

Potholes on roads pose a major threat to motorists and autonomous vehicles. Driving over a pothole has the potential to cause serious damage to a vehicle, which in turn may result in fatal accidents. Currently, many pothole detection methods exist. However, these methods do not utilize deep learning techniques to detect a pothole in real-time, determine the location thereof and display its location on a map. The success of determining an effective pothole detection method, which includes the aforementioned deep learning techniques, is dependent on acquiring a large amount of data, including images of potholes. Once adequate data had been gathered, the images were processed and annotated. The next step was to determine which deep learning algorithms could be utilized. Three different models, including Faster R-CNN, SSD and YOLOv3 were trained on the custom dataset containing images of potholes to determine which network produces the best results for real-time detection. It was revealed that YOLOv3 produced the most accurate results and performed the best in real-time, with an average detection time of only 0.836s per image. The final results revealed that a real-time pothole detection system, integrated with a cloud and maps service, can be created to allow drivers to avoid potholes.

Introduction Color vision deficiency (CVD) constitutes one of the frequently observed eye disorders in all human populations. Color is a prominent sign utilized in the medical profession to study and identify histopathological specimens, lab instruments, and patient examination. Color deficiency affects the medical skills of students resulting in poor clinical examination and color appreciation. There is no effective screening of CVD at any level of the medical profession. Hence, this study was aimed to determine the prevalence of CVD among medical students. Materials and methods This was a cross-sectional study conducted from September 2019 to February 2020 over a period of six months in Karachi, Pakistan. All medical students aged 18-21 years of either gender enrolled in the first and second years of medical college were included in this study. The examination was performed during daylight. Ishihara plates were placed at a distance of 75 cm from the subject and tilted so that the plane of the paper lies perpendicular to the line of vision. Students were given five seconds to read the plate and one examiner was instructed to mark the checklist. A score of less than 12 out of 14 red/green test plates (not including the demonstration plate) was considered as a CVD. All statistical analysis was performed using Statistical Package for Social Sciences version 20.0 (Armonk, NY: IBM Corp). Results The mean age of the medical students was 19.61± 1.22 years. There were (n=123) 53.0% females and (n=111) 47.0% males. Most of the medical students (n=131, 56.0%) belonged to the upper-middle-class socioeconomic group. CVD was observed in (n=13) 6.0%of medical students. Age (p=0.001) and socioeconomic status (p=0.001) were the only demographic factors significantly associated with color deficiency. Conclusions Color deficiency, although an unnoticed concern, is fairly common among medical students. Medical students must be screened for CVD as this will enable them to be aware of their limitations in their future observational skills as a doctor and devise ways of overcoming them in clinical practice.

Autonomous aerial refueling technology is an effective solution to extend flight duration of unmanned aerial vehicles, and also a great challenge due to its high risk. For autonomous probe-and-drogue refueling tasks, relative navigation to provide relative position between the receiver aircraft and the refueling drogue is the first and essential step, and vision-based method is the most frequently used. A new monocular vision navigation sensor with image processing strategy consisting of the drogue detection method and the tracking method is developed for autonomous aerial refueling in this paper. In the drogue detection method, thresholding and mathematical morphology method are adopted to eliminate image interference, and contours extraction method is applied to obtain all contours, which are then subsequently checked to achieve target contour of drogue. In the tracking method, a rectangle of interest (ROI) of current frame image is determined by positioning results of last frame, and then processed by the previous drogue detection method. Finally, the proposed image processing strategy in monocular vision navigation sensor is validated using real flight images, which are captured from an autonomous aerial refueling testbed using a micro six-rotor aircraft as receiver aircraft.

UAV network operation enables gathering and fusion from disparate information sources for flight control in both manned and unmanned platforms. In this investigation, a novel procedure for detecting runways and horizons as well as enhancing surrounding terrain is introduced based on fusion of enhanced vision system (EVS) and synthetic vision system (SVS) images. EVS and SVS image fusion has yet to be implemented real-world situations due to signal misalignment. We address this through a registration step to align the EVS and SVS images. Four fusion rules combining discrete wavelet transform (DWT) sub-bands are formulated, implemented and evaluated. The resulting procedure is tested on real EVS-SVS image pairs and pairs containing simulated turbulence. Evaluations reveal that runways and horizons can be detected accurately even in poor visibility. Furthermore, it is demonstrated that different aspects of the EVS and SVS images can be emphasized by using different DWT fusion rules. The procedure is autonomous throughout landing, irrespective of weather. We believe the fusion architecture developed holds promise for incorporation into head-up displays (HUDs) and UAV remote displays to assist pilots landing aircraft in poor lighting and varying weather. The algorithm also provided a basis rule selection in other signal fusion applications.

With the emergence of autonomous functions in road vehicles, there has been an increased use of Advanced Driver Assistance Systems comprising various sensors to perform automated tasks. Light Detection and Ranging (LiDAR) is one of the most important types of optical sensor that detects the positions of obstacles, representing them as clusters of points in 3-dimensional space. LiDAR performance degrades significantly when driving in rain as raindrops adhere to the outer surface of the sensor assembly. The performance degradation behaviors include missing points and reduced reflectivity of the points. It was found that the extent of degradations is highly dependent on the interface material properties, which subsequently affects the shapes of the adherent droplets, causing different perturbations to the optical rays. A fundamental investigation is performed on the protective polycarbonate cover of the LiDAR assembly coated with four classes of materials – hydrophilic, almost-hydrophobic, hydrophobic, and superhydrophobic. Water droplets are controllably dispensed onto the cover to quantify the signal alteration due to each droplet of various sizes and shapes. To further understand the effects of droplet motion on LiDAR signals, sliding droplet conditions are simulated using numerical analysis and validated with physical optical tests using a 905 nm laser source and receiver to mimic the LiDAR detection mechanism. Comprehensive explanations are presented on LiDAR performance degradation in rain from both material and optical perspectives. These can aid component selection and the development of signal enhancing strategies for integrating LiDARs in vehicle designs to minimize the impact of rain.

Blood cell analysis is a crucial diagnostic process in medical practice. In particular, detecting white blood cells (WBCs) is essential for diagnosing of many diseases. The manual screening of blood films is a time-consuming and subjective process, which can lead to inconsistencies and errors. Therefore, automated detection of blood cells can improve the accuracy and efficiency of the screening process. In this study, an explainable Vision Transformer (ViT) model was proposed for the automatic detection of WBCs from blood films. The proposed model utilizes the self-attention mechanism to extract relevant features from the input images and leverages transfer learning by incorporating pre-trained model weights to improve its performance. The proposed model achieved a classification accuracy of 99.40% for five distinct types of WBCs and exhibited potential in reducing the time required for manual screening of blood films by pathologists. Upon examination of the misclassified test samples, it was observed that incorrect predictions were correlated with the presence or absence of granules in the cell samples. To validate this observation, the dataset was divided into two classes, namely Granulocytes and Agranulocytes, and a secondary training process was conducted. The resulting ViT model trained for binary classification achieved an accuracy of 99.70%, recall of 99.54%, precision of 99.32%, and F-1 score of 99.43% during the test phase. To ensure the reliability of the ViT model's multi-class classification of WBCs, the pixel areas that the model focuses on in its predictions are visualized through the Score-CAM algorithm.

The influence of the film thickness and the substrate’s refractive index on the surface mode at the superstrate is an important study step that may help clearing some of the misunderstandings surrounding their propagation mechanism. A single sub-wavelength slit perforating a thin metallic film is among the simplest nanostructure capable of launching Surface Plasmon Polaritons on its surrounding surface when excited by an incident field. Here, the impact of the substrate and the film thickness on surface waves is investigated. When the thickness of the film is comparable to its skin depth, SPP waves from the substrate penetrate the film and emerge from the superstrate, creating a superposition of two SPP waves, that leads to a beat interference envelope with well-defined loci which are the function of both the drive frequency and the dielectric constant of the substrate/superstrate. As the film thickness is reduced to the SPP’s penetration depth, surface waves from optically denser dielectric/metal interface would dominate, leading to volume plasmons that propagate inside the film at optical frequencies. Interference of periodic volume charge density with the incident field over the film creates charge bundles that are periodic in space and time.

Hand gestures may play an important role in medical applications for health care of elderly people, where providing a natural interaction for different requests can be executed by making specific gestures. In this study we explored three different scenarios using a Microsoft Kinect V2 depth sensor then evaluated the effectiveness of the outcomes. The first scenario utilized the default system embedded in the Kinect V2 sensor, which depth metadata gives 11 parameters related to the tracked body with five gestures for each hand. The second scenario used joint tracking provided by Kinect depth metadata and depth threshold together to enhance hand segmentation and efficiently recognize the number of fingers extended. The third scenario used a simple convolutional neural network with joint tracking by depth metadata to recognize five categories of gestures. In this study, deaf-mute elderly people execute five different hand gestures to indicate a specific request, such as needing water, meal, toilet, help and medicine. Then, the requests were sent to the care provider’s smartphone because elderly people could not execute any activity independently. The system transferred these requests as a message through the global system for mobile communication (GSM) using a microcontroller.

The successful 2020 launch and 2021 landing of the National Aeronautics and Space Administration’s (NASA) Perseverance Mars rover initiated the first phase of the NASA and European Space Agency (ESA) Mars Sample Return (MSR) campaign. The goal of the MSR campaign is to collect scientifically interesting samples from the Martian surface and return them to Earth for further study in terrestrial laboratories. The MSR campaign consists of three major spacecraft components to accomplish this objective: the Perseverance Mars rover, the Sample Retrieval Lander (SRL) and the Earth Return Orbiter (ERO). Onboard the ERO spacecraft is the Capture, Containment and Return System (CCRS). CCRS will capture, process and return to Earth the samples that have been collected after they are launched into Mars orbit by the Mars Ascent Vehicle (MAV), which is delivered to Mars onboard the SRL. To facilitate the processing of the orbiting sample (OS) by CCRS we have designed and developed a vision system to determine the OS capture orientation. The vision system is comprised of two cameras sensitive to the visible portion of the electromagnetic spectrum and two illumination modules constructed from broadband light emitting diodes (LED). Vision system laboratory tests and physics-based optical simulations predict CCRS ground processing will be able to correctly identify the OS post-capture orientation using only a single vision system image that is transmitted to Earth from Mars orbit.

As education continues to evolve in response to technological advancements, the concept of Education 5.0 has gained prominence. However, it is crucial to critically analyze the limitations and challenges of this model. This article presents a comprehensive examination of Education 5.0, identifies its drawbacks, and proposes a vision for Education 6.0. Through insightful case studies and discussions, this article aims to provide a nuanced perspective on the future of education.

Humankind has entered a new era wherein a main characteristic is the convergence of various technologies providing services exerting major impact upon all aspects of human activity, be it social interactions as well as interactions with the natural environment. Fixed networks are about to play a major role in this convergence, since they form, along with mobile networks, the backbone that provides access to a broad gamut of services, accessible from any point of the globe. It is for this reason that we introduce a forward-looking approach for fixed networks, particularly focused on Fixed 6th Generation (F6G) networks. First, we adopt a novel classification scheme for the main F6G services, comprising six categories. This classification is based on the key service requirements, namely latency, capacity and connectivity. F6G networks differ from those of previous generations (F1G-F5G) in that they concurrently support multiple key requirements. We then propose concrete steps towards transforming the main elements of fixed networks, such as optical transceivers, optical switches etc. such that they satisfy the new F6G service requirements. Our study categorizes the main networking paradigm of optical switching into two categories namely ultra-fast and ultra-high capacity switching, tailored to different service categories. With regard to the transceiver physical layer, we propose: a) use of all-optical processing to mitigate performance barriers of analog to digital and digital to analog converters (ADC/DAC); b) exploitation of optical multi-band transmission, space division-multiplexing and adoption of more efficient modulation formats.

Maze navigation using one or more robots has become a recurring challenge in scientific literature and real life practice, with fleets having to find faster and better ways to navigate environments such as a travel hub (e.g. airports) or to evacuate a disaster zone. Many methods have been used to solve this issue, including the implementation of a variety of sensors and other signal receiving systems. Most interestingly, camera-based techniques have increasingly become more popular in this kind of applications, given their robustness and scalability. In this paper, we have implemented an end-to-end strategy to address this scenario, allowing a robot to solve a maze in an autonomous way, by using computer vision and path planning. In addition, this robot shares the generated knowledge to another by means of communication protocols, having to adapt its mechanical characteristics to be able to solve the same challenge. The paper presents experimental validation of the four components of this solution, namely camera calibration, maze mapping, path planning and robot communication. Finally, we present the integration and functionality of these methods applied in a pair of NAO robots.

A human eye has about 120 million rod cells and 6 million cone cells. This huge number of light sensing cells inside a human eye will continuously produce a huge quantity of visual signals which flow into a human brain for daily processing. However, the real-time processing of these visual signals does not cause any fatigue to a human brain. This fact tells us the truth which is to say that human-like vision processes do not rely on complicated formulas to compute depth, displacement, and colors, etc. On the other hand, a human eye is like a PTZ camera. Here, PTZ stands for pan, tilt and zoom. We all know that in computer vision, each set of PTZ parameters (i.e., coefficients of pan, tilt and zoom) requires a dedicated calibration to determine a camera’s projection matrix. Since there is an infinite number of PTZ parameters which could be produced by a human eye, it is unlikely that a human brain stores an infinite number of calibration matrices for each human eye. Therefore, it is an interesting question for us to answer, which is to say whether simpler formulas of computing depth and displacement exist or not. Moreover, these formulas must be calibration friendly (i.e., easy process on the fly or on the go). In this paper, we disclose an important discovery of a new solution to 3D projection in a human-like binocular vision system. The purpose of doing 3D projection in binocular vision is to undertake forward and inverse transformations (or mappings) between coordinates in 2D digital images and coordinates in a 3D analogue scene. The formulas underlying the new solution are accurate, easily computable, easily tunable (i.e., to be calibrated on the fly or on the go) and could be easily implemented by a neural system (i.e., a network of neurons). Experimental results have validated the discovered formulas.

In recent years, vision-centric perception has played a crucial role in autonomous driving tasks, encompassing functions such as 3D detection, map construction, and motion forecasting. However, the deployment of vision-centric approaches in practical scenarios is hindered by substantial latency, often deviating significantly from the outcomes achieved through offline training. This disparity arises from the fact that conventional benchmarks for autonomous driving perception predominantly conduct offline evaluations, thereby largely overlooking the latency concerns prevalent in real-world deployment. While a few benchmarks have been proposed to address this limitation by introducing effective evaluation methods for online perception, they do not adequately consider the intricacies introduced by the complexity of input information streams. To address this gap, we propose the Autonomous-driving Streaming I/O (ASIO) benchmark, aiming to assess the streaming inputs characteristics and online performance of vision-centric perception in autonomous driving. To facilitate this evaluation across diverse streaming inputs, we initially establish a dataset based on the CARLA Leaderboard. In alignment with real-world deployment considerations, we further develop evaluation metrics based on information complexity specifically tailored for streaming inputs and streaming performance. Experimental results indicate significant variations in model performance and ranking under different major camera deployments, underscoring the necessity of thoroughly accounting for the influences of model latency and streaming inputs characteristics during real-world deployment. To enhance streaming performance consistently across distinct streaming inputs features, we introduce a backbone switcher based on the identified streaming inputs characteristics. Experimental validation demonstrates its efficacy in perpetually improving streaming performance across varying streaming inputs features.

Due to the influence of background conditions, lighting conditions, occlusion issues and the image resolution, how to extract robust person features is one of the difficulties in ReID research. Vision in Transformers (ViT) has achieved significant results in the field of computer vision. However, the existing problems still limit its application in ReID due to slow extraction of person features and difficulty in utilizing local features of people. To solve the mentioned problems, we utilize Pyramid Vision Transformer (PVT) as the backbone of feature extraction and propose a PVT-based ReID method in conjunction with other studies. Firstly, some improvements suitable for ReID are used on the PVT backbone, and we establish a basic model by using powerful methods verified on CNN-based ReID. Secondly, in an effort to further promote the robustness of the person features extracted by the PVT backbone, two new modules are designed. (1) The local feature clustering (LFC) is recommend to enhance the robustness of person features by calculating the distance between local features and global feature to select the most discrete local features and clustering them. (2) The side information embeddings (SIE) are used to encode non-visual information and send it into the network for training to reduce its impact on person features. Finally, the experiments show that PVTReID has achieved excellent results in ReID datasets and are 20% faster on average than CNN-based ReID methods.

Regular inspections during construction work verify that the work completed is consistent with the plans and specifications and ensure that it is within the planned time and budget. This requires frequent physical site observations to independently measure and verify the completion percentage of the construction progress performed over periods of time. The current computer vision-based (CV) techniques for the measurement of as-built elements, predominantly use 3D laser scanning or 3D Photogrammetry modelling to determine the geometrical properties of as-built elements on construction sites. Both techniques require data acquisition from several positions and angles to generate sufficient information about the element’s coordinates making the deployment of these techniques on dynamic construction project sites a challenging task. In this paper, we propose a pipeline for automating the measurement of as-built components using artificial intelligence (AI) and computer vision (CV) techniques. The pipeline requires a single image obtained with a stereo-camera system to measure the size of selected objects or as-built components. We demonstrate our approach by measuring the size of concrete walls and columns. The novelty of this work is attributed to the fully automated CV-based method for measuring any given element using a single image only. The proposed solution is suitable for use in measuring the sizes of as-built components of built assets. It has the potential to be further developed and integrated with BIM models for use on construction projects for progress monitoring.

This paper presents a two-dimensional mathematical model of compound eye vision. Such a model is useful for solving navigation issues for autonomous mobile robots on the ground plane. The model is inspired by the insect compound eye that consists of ommatidia, which are tiny independent photoreception units, each of which combines a cornea, lens, and rhabdom. The model describes the planar binocular compound eye vision, focusing on measuring distance and azimuth to a circular feature with an arbitrary size. The model provides a necessary and sufficient condition for the visibility of a circular feature by each ommatidium. On this basis, an algorithm is built for generating a training data set to create two deep neural networks (DNN): the first detects the distance, and the second detects the azimuth to a circular feature. The hyperparameter tuning and the configurations of both networks are described. Experimental results showed that the proposed method could effectively and accurately detect the distance and azimuth to objects.

Centimeter-level localization and rotation angle estimation of flatbed trucks are major problems in unmanned forklift automated loading scenes. To solve it, this study proposes a method for high-precision positioning and rotation angle estimation of flatbed trucks based on BeiDou and vision. First, an unmanned forklift equipped with a ToF camera and double antenna mobile receiver for BeiDou positioning collects depth images and localization data near the front and rear endpoints of the flatbed. Then DDRNet-23-slim was used to segment the flatbed from the depth image and extract the straight lines at the edges of the flatbed using the Hough transform and compute the set of intersection points of the lines. A neighborhood feature vector was designed to locate the endpoint of a flatbed from a set of intersection points by feature screening. Finally, the relative coordinates of the endpoints were converted to a customized forklift navigation coordinate system by BeiDou positioning, and rotation angle estimation was performed by the front and rear endpoints. Experiments showed that the endpoint positioning error was less than 3 cm and the rotation angle estimation error was less than 0.1°. The precision of the method meets the demand for automated flatbed truck loading by unmanned forklifts.

Deep Learning (DL) has made significant advances in computer vision with the advent of Vision Transformers (ViT). Unlike Convolutional Neural Networks (CNNs), ViTs use self-attention to extract both local and global features from image data, and then use residual connections to feed these features directly into a fully networked multilayer perceptron head. In hospitals, hematologists prepare peripheral blood smears (PBSs) and read them under a medical microscope to detect abnormalities in blood counts such as leukemia. However, this task is time-consuming and prone to human error. This study investigates the transfer learning process of Google ViT and ImageNet CNNs to automate the reading of PBSs. The study used two online PBS datasets, PBC and BCCD, and transferred them into balanced datasets to investigate the influence of data amount and noise immunity on both neural networks. The PBC results show that Google ViT is an excellent DL neural solution for data scarcity. The BCCD results show that Google ViT is superior to ImageNet CNNs in dealing with unclean, noisy image data because it is able to extract both global and local features and use residual connections, despite the additional time and computational overhead.

Dams are a critical infrastructure system for many communities, but they are also one of the most challenging to inspect. Dams are typically very large and complex structures, and the result is that inspections are often time-intensive and require expensive, specialized equipment and training to provide inspectors with comprehensive access to the structure. The scale and nature of dam inspections also introduces additional safety risks to the inspectors. Unmanned aerial vehicles (UAV) have the potential to address many of these challenges, particularly when used as a data acquisition platform for photogrammetric three-dimensional (3D) reconstruction and analysis, though the nature of both UAV and modern photogrammetric methods necessitates careful planning and coordination for integration. This paper presents a case study on one such integration at the Brighton Dam, a large-scale concrete gravity dam in Maryland, USA. A combination of multiple UAV platforms and multi-scale photogrammetry was used to create two comprehensive and high-resolution 3D point clouds of the dam and surrounding environment at intervals. These models were then assessed for their overall quality, as well as their ability to resolve flaws and defects that were artificially applied to the structure between inspection intervals. The results indicate that the integrated process is capable of generating models that accurately render a variety of defect types with sub-millimeter accuracy. Recommendations for mission planning and imaging specifications are provided as well.

In order to solve the labor-intensive and time-consuming problem in the process of measuring yak body ruler and weight in yak breeding industry in Qinghai Province, a non-contact method for measuring yak body ruler and weight was proposed in this experiment, and key technologies based on semantic segmentation, binocular ranging and neural network algorithm were studied to boost the development of yak breeding industry in Qinghai Province. Main conclusions: (1) Study yak foreground image extraction, and implement yak foreground image extraction model based on U-net algorithm; select 2263 yak images for experiment, and verify that the accuracy of the model in yak image extraction is over 97%. (2) Develop an algorithm for estimating yak body ruler based on binocular vision, and use the extraction algorithm of yak body ruler related measurement points combined with depth image to estimate yak body ruler. The final test shows that the average estimation error of body height and body oblique length is 2.6%, and the average estimation error of chest depth is 5.94%. (3) Study the yak weight prediction model; select the body height, body oblique length and chest depth obtained by binocular vision to estimate the yak weight; use two algorithms to establish the yak weight prediction model, and verify that the average estimation error of the model for yak weight is 10.7% and 13.01% respectively.

Это исследование сосредоточено на разработке системы искусственного зрения для гибкого дельта-робота-манипулятора и ее интеграции с межмашинной связью для оптимизации взаимодействия устройств в реальном времени. Эта интеграция направлена ​​на увеличение скорости роботизированной системы и улучшение ее общей производительности. Предлагаемое сочетание системы искусственного зрения с межмашинной связью позволяет обнаруживать и распознавать цели с высокой точностью в режиме реального времени в ограниченном пространстве, предназначенном для позиционирования, дальнейшей локализации и выполнения производственных процессов, таких как сборка или сортировка деталей. . В данном исследовании RGB-изображения используются в качестве входных данных для алгоритма MASK-R-CNN, а результаты обрабатываются в соответствии с особенностями прототипа дельта-манипулятора робота. Данные, полученные от MASK-R-CNN, адаптированы для использования в системе управления дельта-роботом с учетом ее уникальных характеристик и требований к позиционированию. Технология M2M позволяет манипулятору робота быстро реагировать на изменения, например, на перемещение объектов или изменение их положения, что имеет решающее значение для задач сортировки и упаковки. Система была протестирована в условиях, близких к реальным, чтобы оценить ее производительность и надежность.

Deep learning heavily relies on statistical correlations to drive artificial intelligence (AI) innovations, particularly in computer vision applications like autonomous driving and robotics. However, despite providing a solid foundation for deep learning, these statistical correlations can be vulnerable to unforeseen and uncontrolled factors. The lack of prior knowledge guidance can result in spurious correlations, introducing confounding factors and affecting the model's robustness. To address this challenge, recent research efforts have focused on integrating causal theory into deep learning methodologies. By modelling the inherent and unbiased causal structure, causal theory can potentially mitigate the impact of spurious correlations effectively. Hence, this paper explores the basics of causal methodologies in image classification.

Artificial intelligence’s rapid advancement has enabled various applications, including intelligent video surveillance systems, assisted living, and human-computer interaction. These applications often require one core task: video-based human action recognition. Research in human video-based human action recognition is vast and ongoing, making it difficult to assess the full scope of available methods and current trends. This survey provides an in-depth exploration of the vision-based human action recognition field, comprehensively offering the available techniques and their evolution, highlighting the cutting-edge ideas driving its development. We also analyze the most used keywords in research papers over the past years to identify trends and predict possible future directions. Hence, this concise survey helps researchers understand the breadth of existing approaches, evaluate current research trends, and stay up-to-date on potential developments.

The primary distribution systems are comprised of power lines delivering power to utility feeders from substations. The inspection and maintenance of damaged and broken power system insulators are of paramount importance for continuous power supply and public safety. hence, to identify any faults and defects in advance a periodic inspection of power line insulators and other components be ensured beforehand. To automate the process and reduce operational cost and risk Unmanned Aerial Vehicles (UAVs) are being extensively utilized. As they present a safer and efficient way to examine the power system insulators and their components without closing the power distribution system ensuring continuous supply to the end-users. To achieve these objectives in this work a novel dataset is designed by capturing real images using UAVs and manually generated images collected to overcome the data insufficiency problem. Deep Laplacian pyramids based super-resolution network is implemented to reconstruct high-resolution training images. To improve the visibility of low light images a low light image enhancement technique is used for the robust exposure correction of the training images. Using computer vision-based object detection techniques to identify faults and classify them according to classes they belong. A different fine-tuning strategy is implemented for fine-tuning the object detection model to increase detection accuracy for the specific faulty insulators. To improve the faults detection several flight path strategies are proposed for efficient inspection. Such strategies overcome the shuttering effect of insulators along with providing a less complex, time, and energy-efficient approach for capturing video stream of the power system components. Performance of different object detection models is presented for selecting the suitable one for fine-tuning on the specific faulty insulator dataset. Our proposed approach gives a less complex and more efficient flight strategy along with better results. For defect detection, our proposed method achieved an F1-score of 0.81 and 0.77 on two different datasets. Our approach is based on real aerial inspection of in-service porcelain insulators by extensive evaluation of several video sequences showing robust faults recognition and diagnostic capabilities. Our approach is demonstrated on data acquired by a drone in Swat Pakistan.

This work presents the development and implementation of a distributed navigation system based on computer vision. The autonomous system consists of a wheeled mobile robot with an integrated colour camera. The robot navigates through a laboratory scenario where the track and several traffic signals must be detected and recognized by using the images acquired with its on-board camera. The images are sent to a computer server that processes them and calculates the corresponding speeds of the robot using a cascade of trained classifiers. These speeds are sent back to the robot, which acts to carry out the corresponding manoeuvre. The classifier cascade should be trained before experimentation with two sets of positive and negative images. The number of images in these sets should be considered to limit the training stage time and avoid overtraining the system.

Salamanders have been habitual residents of research laboratories for more than a century, and their history in science is tightly interwoven with vision research. Nevertheless, many vision scientists – even those working with salamanders – may be unaware of how much our knowledge about vision, and particularly the retina, has been shaped by studying salamanders. In this review, we take a tour through the salamander history in vision science, highlighting the main contributions of salamanders to our understanding of the vertebrate retina. We further point out specificities of the salamander visual system and discuss the perspectives of this animal system for future vision research.

This paper presents a system that merges computer vision and surface electromyography techniques to carry out grasping tasks. To perform this, the vision-driven system is used to compute pre-grasping poses of the robotic system based on the analysis of tridimensional object features. Then, the human operator can correct the pre-grasping pose of the robot using surface electromyographic signals from the forearm during wrist flexion and extension. Weak wrist flexions and extensions allow a fine adjustment of the robotic system to grasp the object and finally, when the operator considers that the grasping position is optimal, a strong flexion is performed to initiate the grasping of the object. The system has been tested with several subjects to check its performance showing a grasping accuracy of around 95% of the attempted grasps which increases by around a 9% the grasping accuracy of previous experiments in which electromyographic control was not implemented.

Some traditional robots are based on offline programming reciprocal motion, and with the continuous upgrading of vision technology, more and more tasks are replaced by machine vision. For the current problem of insufficient accuracy of robot target localization based on binocular vision, and an improved random sampling consistency algorithm is proposed to complete parallel robot target localization and grasping under the guidance For the current problem of insufficient accuracy of robot target localization based on binocular vision, an improved random sampling consistency algorithm is proposed to complete parallel robot target localization and grasping under the guidance of multi Firstly, the RANSAC algorithm is improved based on the SURF algorithm; then the parallax gradient method is applied to iterate the matched point pairs several times to further optimize the data; then the 3D reconstruction is completed by the program technique; finally the obtained data is finally the obtained data is input into the robot arm and the camera internal and external parameters are obtained by the calibration method so that the robot can accurately locate and The experiments show that the improved algorithm has advantages in recognition accuracy and grasping success rate under multi- The experiments show that the improved algorithm has advantages in recognition accuracy and grasping success rate under multi-vision system.

The use of visual signals in horticulture has attracted significant attention and encompassed a wide range of data types such as 2D images, videos, hyperspectral images, and 3D point clouds. These visual signals have proven to be valuable in developing cutting-edge computer vision systems for various applications in horticulture, enabling plant growth monitoring, pest and disease detection, quality and yield estimation, and automated harvesting. However, unlike other sectors, developing deep learning computer vision systems for horticulture encounters unique challenges due to the limited availability of high-quality training and evaluation datasets necessary for deep learning models. This paper investigates the current status of vision systems and available data in order to identify the high-quality data requirements specific to horticultural applications. We analyse the impact of the quality of visual signals on the information content and features that can be extracted from these signals. To address the identified data quality requirements, we explore the usage of a deep learning-based super-resolution model for generative quality enhancement of visual signals. Furthermore, we discuss how these can be applied to meet the growing requirements around data quality for learning-based vision systems. We also present a detailed analysis of the competitive quality generated by the proposed solution compared to cost-intensive hardware-based alternatives. This work aims to guide the development of efficient computer vision models in horticulture by overcoming existing data challenges and paving a pathway forward for contemporary data acquisition.

It's challenging to achieve robust lane detection depending on single frame when considering complicated scenarios. In order to detect more credible lane markings by using sequential frames, a novel approach to fusing vision and Inertial Measurement Unit (IMU) is proposed in this paper. The hough space is employed as the space where lane markings are stored and it's calculated by three steps. Firstly, a basic hough space is extracted by Hough Transform and primary line segments are extracted from it. In order to measure the possibility about line segments belong to lane markings, a CNNs based classifier is introduced to transform the basic hough space into a probabilistic space by using the networks outputs. However, this probabilistic hough space based on single frame is easily disturbed. In the third step, a filtering process is employed to smooth the probabilistic hough space by using sequential information. Pose information provided by IMU is applied to align hough spaces extracted at different times to each other. The final hough space is used to eliminate line segments with low possibility and output those with high confidence as the result. Experiments demonstrate that the proposed approach has achieved a good performance.

Background: The laryngeal mask airway Vision Mask (LMA VM) is a supraglottic airway device (SAD) with vision guidance system. The ideal head and neck position for direct laryngoscopy is known, but the ideal position for placing a LMA is not. The objective of this study is to evaluate and compare the optimal position for placement of a video laryngeal mask airway. Methods: This was a prospective observational, transversal and analytical study of 72 consecutive patients. In the same patient, laryngeal vision was first assessed with the head and neck in the sniffing position and then with the head in the neutral position. Procedures were filmed and performed by the same investigator. Assessment of the laryngeal view was performed using two classifications: modified Cormack-Lehane classification and Brimacombe classification. Device placement was considered adequate when the Cormack-Lehane rating was scored from 1 to 2 and the Brimacombe rating was from 2 to 4. Results: 72 patients were included in this study. In the assessment of the glottis using the Cormack Lehane classification for fiberoptic view, laryngeal visibility was adequate in 64 (88.89%) patients in the neutral position and in 65 (90,28%) patients in the sniffing position (p>0,05). In the fiberoptic view of the glottis, assessed using the Brimacombe classification, laryngeal visibility was adequate in 68 (93%) patients in the neutral position and in 69 (95%) patients in the sniffing position, (p>0,05). There was no statistically significant difference in the rate of success between the sniffing position (70 patients, 97.22% success rate) and the neutral position (67 patients, 93.06% success rate) during the first insertion attempt. Two patients required a second attempt in the sniffing position, while five patients required a second attempt in the neutral position. Conclusion: An adequate sniffing position did not result in a better glottic view than neutral position, and the number and type of additional maneuvers were equal in both positions.

In the last decades we have experienced great social, cultural, and educational changes, spending more time performing tasks in near vision and less hours in outdoor activities, having more overexposure to digital screens, especially the youngest and increasingly from younger ages. It is common to see cases when performing tasks in near vision the posture or position of the head is not adequate, especially the youngest, being essential to have a correct posture of the head to avoid visual, muscular, or articular problems. We present a procedure to try to control the correct position of the head in real time when performing close-up activities. The aim is to detect the inclination of the head and to know if a bad position is adopted due to a visual problem or simply to inadequate visio-postural habits, warning us of the postural anomaly to correct it.

The appropriate maintenance of highway roads is critical for the safe operation of road networks and conserves maintenance costs. Multiple methods have been developed to investigate the surface of roads for various types of cracks and potholes, among other damage. Like road surface damage, the condition of expansion joints in concrete pavement is important to avoid unexpected hazardous situations. Thus, in this study, a new system is proposed for autonomous expansion joint monitoring using a vision-based system. The system consists of the following three key parts: (1) a camera-mounted vehicle, (2) indication marks on the expansion joints, and (3) a deep learning-based automatic evaluation algorithm. With paired marks indicating the expansion joints in a concrete pavement, they can be automatically detected. An inspection vehicle is equipped with an action camera that acquires images of the expansion joints in the road. You Only Look Once (YOLO) automatically detects the expansion joints with indication marks, which has a performance accuracy of 95%. The width of the detected expansion joint is calculated using an image processing algorithm. Based on the calculated width, the expansion joint is classified into the following two types: normal and dangerous. The obtained results demonstrate that the proposed system is very efficient in terms of speed and accuracy.

American Sign Language is a popular language for deaf individuals. Communication is made easier for these people through sign language. However, in a digital era like today, there is a need for these people to be able to communicate online, and even get help from technology to communicate in person with non sign language speakers. This research will present a program able to translate American sign language to plain English. This study aims to use the OpenCV library to recognize hand signals, also a trained model to identify images so that the program can then translate them to words and letters. The program uses a data set of over 2000 images which will be in this case the largest data set available. With over 90\% of accuracy it results in a basic computer program with the largest data set available that would make possible for users to communicate with a wide variety of words and expressions.

The contamination on the insulators may increase its surface conductivity and, as a consequence, electrical discharges occur more frequently, which can lead to interruptions in the power supply. To maintain reliability in the electrical distribution power system, components that have lost their insulating properties must be replaced. Identifying the components that need maintenance, is a difficult task as there are several levels of contamination that are hardly noticed during inspections. To improve the quality of inspections, this paper proposes to use the k-nearest neighbours (k-NN) to classify the levels of insulator contamination, based on the image of insulators at various levels of contamination simulated in the laboratory. Using computer vision features such as mean, variance, asymmetry, kurtosis, energy, and entropy are used for training the k-NN. To assess the robustness of the proposed approach, statistical analysis and a comparative assessment with well-consolidated algorithms such as decision tree, ensemble subspace, and support vector machine models are presented. The k-NN showed results of up to 85.17 % accuracy using the k-fold cross-validation method, with an average accuracy higher than 82 % for multi-classification of the contamination of the insulators, being superior to the compared models.

In the fashion field, the use of electroplated small metal parts such as studs, clips and buckles is widespread. The plate is often made of precious metal, such as gold or platinum. Due to the high cost of these materials, it is strategically relevant and of primary importance for manufacturers to avoid any waste by depositing only the strictly necessary amount of material. To this aim, Companies need to be aware of the overall number of items to be electroplated so that it is possible to properly set the parameters driving the galvanic process. Accordingly, the present paper describes a Machine Vision-based method able to automatically count small metal parts arranged on a galvanic frame. The devised method relies on the definition of a proper acquisition system and on the development of image processing-based routines. Such a system is then implemented on a counting machine is meant to be adopted in the galvanic industrial practice to properly define a suitable set or working parameters (such as current, voltage and deposition time) for the electroplating machine and, thereby, to assure the desired plate thickness from one side and to avoid material waste on the other.

Most of the existing calibration methods for binocular stereo vision sensor (BSVS) depend on high-accuracy target with feature points that are difficult to manufacture and costly. In complex light conditions, optical filters are used for BSVS, but they affect imaging quality. Hence, the use of a high-accuracy target with certain-sized feature points for calibration is not feasible under such complex conditions. To solve these problems, a calibration method based on unknown-sized elliptical stripe images is proposed. With known intrinsic parameters, the proposed method adopts the elliptical stripes located on the parallel planes as a medium to calibrate BSVS online. In comparison with the common calibration methods, the proposed method avoids utilizing high-accuracy target with certain-sized feature points. Therefore, the proposed method is not only easy to implement but is a realistic method for the calibration of BSVS with optical filter. Changing the size of elliptical curves projected on the target solves the difficulty of applying the proposed method in different fields of view and distances. Simulative and physical experiments are conducted to validate the efficiency of the proposed method. When the field of view is approximately 400 mm × 300 mm, the proposed method can reach a calibration accuracy of 0.03 mm, which is comparable with that of Zhang’s method.

Measuring and predicting Carbon Emission (CE) is important to enabling the main culprit of various urgent environmental issues including global warming. However, prior studies did not fully incorporate the impact of micro-level urban streetscapes, which might lead to biased prediction of urban CE. To fill the gap, we developed an effective framework to predict residential CE in urban areas from widely existing and publicly available street-view images (SVI) using machine learning. First, we used a semantic segmentation algorithm to classify more than 30 streetscape elements from SVI images to describe the built environment whose features might affect residential and transportation CE. Second, based on the streetscapes quantified, we trained a 10-fold cross-validation method with various machine learning models to predict the CE at the 1KM grid level using CE data from the PlanetData. We found first, built environment features such as sidewalks, roads, fences, buildings, and walls are significantly correlated with the residential CE. Second, the presence of buildings and subtle streetscape features (e.g., walls, fences) indicates higher-density residential areas which are related to more residential CE. Third, vegetation (e.g., trees and grass) are reversely related to residential CE. Our findings shed light on the feasibility of using a single and open data source (i.e., the SVI) to effectively model neighborhood-level CE for regions across diverse urban forms. Our framework is useful for urban planners to inform new town development and urban regeneration towards the low CE goals.

In the current paper, we present our work towards developing a solution combining computer vision and AI to support footrest design customization in the wheelchair industry. Wheelchairs and postural systems are complex and often user centric in the design process. Those products require a wide range of adjustments to adapt to the various anthropometries and disabilities of patients. Most commercial products, dedicated to severe disability, also include a series of additional elements, designed to keep the patient in a comfortable but “fixed” position. Such systems do not allow to “fix and maintain” the position of patient foot, especially for patients who have no control over their lower limbs. For that reason, it becomes essential to supply wheelchairs with specific elements to hold patient's shoe in place. Commercial foot supports are typically developed on standard sizes and do not always cover the entire population. In addition, those designs are based on standard shoes, thus they do not lend themselves well to adapting to special shoes or orthopedic shoes. Feet final position therefore becomes a key element in correct postural management. In this paper, we investigate the use of computer vision and AI to correctly define customization parameters of the footrest. The proposed design has been developed based on the specifications received from the Pro Medicare S.r.l orthopedic technicians. We present suitable algorithms, design principles and well defined components towards the implementation of our proof of concept. We also present the testing activities we have undertaken and the obtained performance results.

A 31-year-old male noticed blurred vision in his right eye for five days with no obvious predisposing causes, accompanied by mild dizziness. No obvious nodular lesions were found in the body. The patient’s binocular visual acuity was 20/20. Fundus photography showed the optic nerve swelling and radial superficial retinal hemorrhage of both eyes. Blood panel, urine routine, liver, and kidney function were all normal. Total cholesterol, triglycerides, high-density lipoprotein, and low-density lipoprotein were all in the normal limits. Head MRI showed a mass in the right temporal lobe, clear boundary, and multiple separations, which thinned and disappeared closer to the skull. The right temporal lobe and lateral ventricle were all compressed, with the midline structure shifted to the left. The patient was then transferred to Neurosurgery. During the operation, we observed the tumor had invaded the skull. The actual size of the tumor was 5.6 cm × 7.5 cm × 10.1 cm. Histology revealed foam cell accumulation in the mucous connective tissue of the right temporal lobe. The immunohistochemistry showed: CD34 (+), CD99 (+), EMA (−), GFAP (−), IDH-1 (−), Ki-67 (+) index about 10%, Oliga-2 (−), PR (−), S-100 (−), Vim (+), β-Catenin (+), CD1a (−), CD68 (+). Three months after the removal of the tumor, the visual acuity of both eyes was 20/20; The visual fields were normal, the optic disc edema and retinal hemorrhages had disappeared. MRI indicated the midline structure was back to normal.

Crack inspection in railway sleepers is crucial for ensuring rail safety and avoiding deadly accidents. Traditional methods for detecting cracks on railway sleepers are very time-consuming and lack efficiency. Therefore nowadays, researchers are paying attention to the vision-based algorithm, especially Deep Learning algorithms. In this work, we adopted the U-net for the first time for detecting cracks on a railway sleeper and proposed a modified U-net architecture named Dense U-net for segmenting the cracks. In the Dense U-net structure, we established several short connections between the encoder and decoder blocks, which enabled the architecture to obtain better pixel information flow. Thus, the model extracted the necessary information in more detail to predict the cracks. We collected images from railway sleepers, processed them in a dataset, and finally trained the model with the images. The model achieved an overall F1-score, precision, Recall, and IoU of 86.5% 88.53%, 84.63%, and 76.31% respectively. We compared our suggested model with the original U-net, and the results demonstrate that our model outperformed the U-net in both quantitative and qualitative results. Moreover, we considered the necessity of crack severity analysis and measured a few parameters of the cracks (e.g., length, maximum width, area, density). The engineers must know the severity of the cracks to have an idea about the most severe locations and take the necessary steps to repair the badly affected sleepers.

Understanding park events and their categorization offer pivotal insights into urban parks and their integral roles in cities. This study utilized images and event category data from the New York City Parks Events Listing database to train a Convolutional Neural Network (CNN) for image-based park event categorization. Different CNN models were tuned to complete this multi-label classification task, their performances compared. Preliminary results underscore the efficacy of deep learning in automating the event classification process, revealing the multifaceted activities within urban green spaces. The CNN showcased proficiency in discerning various event nuances, emphasizing the diverse recreational and cultural offerings of urban parks. Such categorization has potential applications in urban planning, aiding decision-making processes related to resource distribution, event coordination, and infrastructure enhancements tailored to specific park activities.

Obstructive Sleep Apnea (OSA) surgery is now a viable solution in selected patients and the “remodelling” palatopharyngeal surgery is the most common one. Recently it becomes less in-vasive with the introduction of Barbed Sutures (BS). An optimization of surgical technique is represented by Barbed pharyngoplasty (BP), that requires surgical precision and needs efficient and precise oropharyngeal visualization. Consequently, the lighting system is of pivotal im-portance in BP. The aim of this work is to describe the first experience on the use of a new light-ing system, called KlaroTM in BP for OSA. We evaluated the Klaro™ system in 15 consecutives BP for OSA in comparison with conventional headlamp illumination. The visualization of pala-topharyngeal muscle in the bottom of the tonsillar fossa, entry and exit needle, such as needle tip were statistically better with KlaroTM than headlamp illumination both for surgeon and resi-dent (p<0.05). No significant differences for the visualization of the posterior pharyngeal wall and uvula were reported. The KlaroTM lighting system allows a satisfied illumination of oral cavity and oropharynx in the majority of cases. We encourage to use of KlaroTM not only in BP for OSA, but also in all oral and pharyngeal surgeries, including tonsillectomy and oncological surgery.

We seek to elucidate an aspirational vision for the food system and explore whether the characteristics of such a system inadvertently set unattainable standards for rural, low wealth communities. We apply discourse analysis to the following qualitative datasets: (1) interviews with food experts and advocates, (2) scholarly and grey literature, (3) industry websites, and (4) email exchanges between food advocates. The analysis revealed eight aspirational food system discourses: Production, Distribution, and Infrastructure; Healthy, Organic, Local Food; Behavioral Health and Education; Sustainability; Finance and Investment; Huger Relief; Demand Side Preferences; Romanticized, Community Led Transformations. Study findings reveal that of eight discourses only three encompass the experiences of rural, low wealth residents. This aspirational food system may result in the disempowerment of the needs of rural, low wealth groups; a perpetuation of the failure of groups who will be unable to reach the aspirational food vision; silencing of discourses that might question those that play a role in the inequitable distribution of income while sanctioning discourses that focus on personal or community solutions; and the absence of other policy-based solutions that address issues located within the food system. Further research is needed to inform policies and programs to mitigate food insecurity in rural, low wealth populations.

We have an unprecedented ability to analyze and map the Earth’s surface, as deep learning technologies are applied to an abundance of Earth observation systems collecting images of the planet daily. In order to realize the potential of these data to improve conservation outcomes, simple, free, and effective methods are needed to enable a wide variety of stakeholders to derive actionable insights from these tools. In this paper we demonstrate simple methods and workflows using free, open computing resources to train well-studied convolutional neural networks and use these to delineate objects of interest in publicly available Earth observation images. With limited training datasets (<1000 observations), we used Google Earth Engine and Tensorflow to process Sentinel-2 and National Agricultural Imaging Program data, and use these to train U-Net and DeepLab models that delineate ground mounted solar arrays and parking lots in satellite imagery. The trained models achieved 81.5% intersection over union between predictions and ground-truth observations in validation images. These images were generated at different times and from different places from those upon which they were trained, indicating the ability of models to generalize outside of data on which they were trained. The two case studies we present illustrate how these methods can be used to inform and improve the development of renewable energy in a manner that is consistent with wildlife conservation.

In recent years, a range of problems under the broad umbrella of computer vision based analysis of ancient coins have been attracting an increasing amount of attention. Notwithstanding this research effort, the results achieved by the state of the art in published literature remain poor and far from sufficiently well performing for any practical purpose. In the present paper we present a series of contributions which we believe will benefit the interested community. We explain that the approach of visual matching of coins, universally adopted in existing published papers on the topic, is not of practical interest because the number of ancient coin types exceeds by far the number of those types which have been imaged, be it in digital form (e.g., online) or otherwise (traditional film, in print, etc.). Rather, we argue that the focus should be on understanding the semantic content of coins. Hence, we describe a novel approach—to first extract semantic concepts from real-world multimodal input and associate them with their corresponding coin images, and then to train a convolutional neural network to learn the appearance of these concepts. On a real-world data set, we demonstrate highly promising results, correctly identifying a range of visual elements on unseen coins with up to 84% accuracy.

(1) Background: the use of force by Public and Private Security Forces is currently an issue of great relevance because of the potential injuries that any excessive use of force by either the active or passive subjects or a deficit in the real mastery of the appropriate Physical Intervention Techniques (PIT) may cause. For this reason, certain traditionally used Physical Intervention Techniques have been questioned by scientific research studies and punished by justice. On the other hand, certain media have dealt with this matter in a biased and unfair manner by broadcasting videos where the use of force by police officer is displayed out of context. As a consequence, this problem has been brought under the spotlight, causing general uneasiness of the communities and rapidly spreading over social networks while favoring all sorts of parallel judgments. (2) Research method: A suit equipped with 19 Inertial Measurement Units (IMU) and a Biomechanics of Bodies software application for the Marras’ analysis of the data collected on trajectory, trunk twisting velocity, its sagittal angle, load, nature and severity of the injuries associated to the different intervention techniques that have been examined. (3) Results: according to the data registered, the implementation of Operational Tactical Procedures (OTP) reduces the probability of injuries and leads to a more satisfactory outcome. (4) Conclusions: the implementation of Operational Tactical Procedures, to-gether with the awareness on the risks associated to the excessive use of force by Public and Private Security Forces and Bodies, could reduce the risk of injuries suffered by both officers and citizens.

Light pen 3D vision coordinate measurement systems are increasingly widely used due to their advantages, such as small size, convenient carrying and wide applicability. The posture of the light pen is an important factor affecting accuracy. The pose domain of the pen needs to be given so that the measurement system has a suitable measurement range to obtain more qualified parameters. The advantage of the self-calibration method is that the entire self-calibration process can be completed at the measurement site without any auxiliary equipment. After the system camera calibration is completed, we take several pictures of the same measurement point with different poses to obtain the conversion matrix of the picture, and then use spherical fitting, the generalized inverse method of least squares, and the principle of position invariance within the pose domain range. The combined stylus tip center self-calibration method calculates the actual position of the light pen probe. The experimental results show that the absolute error is stable below 0.0737 mm and that the relative error is stable below 0.0025 mm. The experimental results verify the effectiveness of the method; the measurement accuracy of the system can meet the basic industrial measurement requirements.

This paper presents the process of designing, fabrication, assembling, programming and optimizing a prototype of a nonlinear mechatronic Ball-Plate System (BPS) as a laboratory platform for STEM engineer education. Due to the nonlinearity and complexity of BPS, task presents challenging issues, such as: 1) difficulties in controlling the stabilization of a given position point known as steady state error, 2) position resolution known as specific distance error and 3) adverse environmental effects - light shadow error, also discussed in this paper. The laboratory BPS prototype for education was designed, manufactured and installed at the Karlovac University of Applied Sciences at the Department of Mechanical Engineering, Study of mechatronics. The low-cost two degrees BPS system uses a USB HD camera for computer vision as feedback and two DC servomotors as actuators. Due to controlling problems, an advanced block diagram of control system is proposed and discussed. An open-source control system based on Python scripts that allows the use of ready-made functions from the library allows changing the color of the ball and the parameters of the PID controller, thus indirectly simplifying control system and directly the mathematical calculation. The authors will continue their research on this BPS mechatronic platform and control algorithms.

The first step in seeing is light absorption by photopigment molecules expressed in the photore-ceptors of the retina. There are two types of photoreceptors in the human retina that are respon-sible for image formation, rods and cones. Except at very low light levels when rods are active, all vision is based on cones. Cones mediate high acuity vision and color vision. Furthermore, they are critically important in the visual feedback mechanism that regulates refractive development of the eye during childhood. The human retina contains a mosaic of three cone types, short-wavelength (S), long-wavelength (L) and middle-wavelength (M); however, the vast major-ity (~94%) are L and M cones. The OPN1LW and OPN1MW genes, located on the X-chromosome at Xq28, encode the protein component of the light-sensitive photopigments. Here we review mechanism by which splicing defects in these genes cause vision disorders.

The UK economy is overly reliant on unsustainable production and consumption practices, depleting finite resources at rates that will increase production costs, business risk and economic instability. This over-consumption produces emissions and waste that cause climate change and environmental degradation, impacting on the wellbeing of people in the UK and beyond. The Resource Recovery from Waste programme (RRfW) promotes a transition towards waste and resource management in a circular economy that restores the environment, creates societal benefits and promotes clean growth by engaging relevant actors in the transition process. RRfW collaborates with academia, government, and industry to co-produce a shared vision and approach to realise such a transition. Reflecting insights from RRfW’s government engagement, this article presents a positive outlook for changing the UK economy and society. It envisions a long-term future for waste and resource management that maximises the value of materials by circulating them in the economy for as long as possible. Four themes and an approach are proposed, including recommendations for regulatory instruments and a stable policy framework. It recommends further collaborative research to capitalise on opportunities for economic growth, innovation and resilient infrastructure whilst contributing to quality jobs and welfare in all four UK nations.

While Twitter has been touted to provide up-to-date information about hazard events, the reliability of tweets is still a concern. Our previous publication extracted relevant tweets containing information about the 2013 Colorado flood event and its impacts. Using the relevant tweets, this research further examined the reliability (accuracy and trueness) of the tweets by examining the text and image content and comparing them to other publicly available data sources. Both manual identification of text information and automated (Google Cloud Vision API) extraction of images were implemented to balance accurate information verification and efficient processing time. The results showed that both the text and images contained useful information about damaged/flooded roads/street networks. This information will help emergency response coordination efforts and informed allocation of resources when enough tweets contain geocoordinates or locations/venue names. This research will help identify reliable crowdsourced risk information to enable near-real time emergency response through better use of crowdsourced risk communication platforms.

The ever-evolving ways attacker continues to im prove their phishing techniques to bypass existing state-of-the-art phishing detection methods pose a mountain of challenges to researchers in both industry and academia research due to the inability of current approaches to detect complex phishing attack. Thus, current anti-phishing methods remain vulnerable to complex phishing because of the increasingly sophistication tactics adopted by attacker coupled with the rate at which new tactics are being developed to evade detection. In this research, we proposed an adaptable framework that combines Deep learning and Randon Forest to read images, synthesize speech from deep-fake videos, and natural language processing at various predictions layered to significantly increase the performance of machine learning models for phishing attack detection.

Within environmental perception, automatic navigation and object detection, computer vision is a crucial and demanding field with many applications in modern industries, such as multi-target long-term visual tracking in automated production, defect detection, and driverless robotic vehicles with sensing ability. The performance of computer vision has greatly improved recently thanks to developments in deep learning algorithms and hardware computing capabilities, which has spawned the creation of a large number of related applications. This paper presents the results of a detailed review of over 50 papers published over the course of two decades (1999–2024), with a primary focus on the technical advancement of computer vision. To elucidate the foundational principles, an examination of typical visual algorithms based on traditional correlation filtering was initially conducted. Subsequently, a comprehensive overview of the most recent advancements in deep learning-based computer vision techniques was compiled. Furthermore, a comparative analysis between conventional and novel algorithms was undertaken to discuss the future trends and directions of computer vision. Lastly, the feasibility of employing visual SLAM (Simultaneous Localization and Mapping) algorithms in the context of autonomous vehicles with sensing capability was explored. Furthermore, we explored a thorough and efficient architecture for utilizing these techniques in autonomous robotic vehicles into unmanned green and low-carbon smart factories, underlining novel advances as well as potential prospects for future research.

This paper presents the development of an underwater crack detection system for structural integrity assessment of submerged structures, like offshore oil and gas installations, underwater pipelines, underwater foundations for bridges, dams etc. Focus is on use of machine learning based approaches. First a detailed literature review of state of the current methods for underwater surface crack detection is presented highlighting challenges and opportunities. An overview of image augmentation approach for creation of underwater optical effects is also presented. Experimental results using standard network based machine learning approach, used for surface crack detection in onshore environment, is presented. Series of Test cases are presented where existing networks performance are improved using augmented images for underwater conditions. The experimental results demonstrate the effectiveness and accuracy of the proposed system in detecting cracks in underwater structures. The system has the potential to improve the safety and reliability of underwater structures and prevent catastrophic failures.

Mobile Mapping System (MMS) plays a crucial role in generating high-precision 3D maps for various applications. However, the traditional MMS that uses tilted LiDAR (light detection and ranging) has limitations in capturing complete information of the environment. To overcome these limitations, we propose a panoramic vision-aided Cartographer simultaneous localization and mapping (SLAM) system for MMS, named "PVL-Cartographer". The proposed system integrates multiple sensors to achieve accurate and robust localization and mapping. It contains two sub-systems, early fusion and middle fusion. In the early fusion, range-maps are created from LiDAR points in a panoramic image space, facilitating the incorporation of visual features. The SLAM system works with both visual features with and without augmented ranges. In the middle fusion, a pose graph combines camera and LiDAR nodes, with IMU (Inertial Measurement Unit) data providing constraints between each node. Extensive experiments in challenging outdoor scenarios demonstrate the effectiveness of the proposed SLAM system in producing accurate results, even in conditions with limited features. Overall, our proposed PVL Cartographer system offers a robust and accurate solution for MMS localization and mapping.

Manual visual inspections typically conducted after an earthquake are high-risk, subjective, and time-consuming. Delays from inspections often exacerbate the social and economic impact of the disaster on affected communities. Rapid and autonomous inspection using images acquired from unmanned aerial vehicles offer the potential to reduce such delays. Indeed, a vast amount of re-search has been conducted toward developing automated vision-based methods to assess the health of infrastructure at the component and structure level. Most proposed methods typically rely on images of the damaged structure, but seldom consider how the images were acquired. To achieve autonomous inspections, methods must be evaluated in a comprehensive end-to-end manner, incorporating both data acquisition and data processing. In this paper, we leverage recent advances in computer generated imagery (CGI) to construct a 3D synthetic environment for simulation of post-earthquake inspections that allows for comprehensive evaluation and valida-tion of autonomous inspection strategies. A critical issue is how to simulate and subsequently render the damage in the structure after an earthquake. To this end, a high-fidelity nonlinear finite element model is incorporated in the synthetic environment to provide a representation of earthquake-induced damage; this finite element model, combined with photo-realistic rendering of the damage, is termed herein a physics-based graphics models (PBGM). The 3D synthetic en-vironment with PBGMs provide a comprehensive end-to-end approach for development and validation of autonomous post-earthquake strategies using UAVs, including: (i) simulation of path planning of virtual UAVs and image capture under different environmental conditions; (ii) au-tomatic labeling of captured images, potentially providing an infinite amount of data for training deep neural networks; (iii) availability of the ground truth damage state from the results of the finite-element simulation; and (iv) direct comparison of different approaches to autonomous as-sessments. Moreover, the synthetic data generated has the potential to be used to augment field datasets. To demonstrate the efficacy of PBGMs, models of reinforced concrete moment-frame buildings with masonry infill walls are examined. The 3D synthetic environment employing PBGMs is shown to provide an effective testbed for development and validation of autonomous vision-based post-earthquake inspections that can serve as an important building block for ad-vancing autonomous data to decision frameworks.

This study aimed to assess the feasibility of employing audio and vision technologies as an integrated monitoring system to monitor the health and behavior of pigs under different environmental conditions and to associate these factors. A total of 81 growing pigs ((Landrace x Largewhite) x Duroc) with distinct weight categories (10.47 ± 2.57 kg and 28.81 ± 5.03 kg) were distributed into two distinct housing conditions: Control (characterized by low NH3 levels and low stocking density) and Treatment (marked by elevated NH3 levels and varying stocking densities). Each house was installed with a SoundTalks monitor for automated daily evaluation of respiratory health status (ReHS), and a camera with a microphone to facilitate manual tracking of respiratory symptoms and behavioral patterns. Results showed that the Treatment group encountered significantly high room temperature, NH3 concentration, and carbon dioxide levels, resulting in compromised growth performance—a phenomenon further exacerbated in high stocking density conditions. Pigs within the treatment exhibited increases (p &lt; 0.05) in lateral and total lying behaviors, and incidences of ear and tail injuries, increases screaming frequency, conjunctivitis incidences, coughing frequency, elevated respiration rates, and a decrease in ReHS. The environmental conditions affect the behavior and health of the pigs. Moreover, the behavioral patterns of the pigs are associated with their health conditions. The SoundTalks system did not trigger any warnings during the experimental period. Nevertheless, trend analysis indicated a significant reduction in respiratory health in the treatment. In conclusion, this study underscores the efficacy of merging audio and visual technologies to holistically monitor pig health and behavior, enabling enhanced management strategies. Findings emphasize that monitoring the ReHS trend serves as a pivotal marker for identifying respiratory health problems, complementing the system's innate alarm functions.

Floods, recognized for their erratic behavior and devastating effects, are a significant threat as a natural disaster. In Brunei Darussalam, the impact of climate change is becoming increasingly evident through higher temperatures and an expected increase in annual rainfall (5.0mm per year from 2021 to 2050), highlighting the critical need for updated flood risk management techniques. In line with the climate resilience and adaptation objectives of WAWASAN 2035, this paper introduces an innovative approach—a cutting-edge flood risk management framework that utilizes the capabilities of big data analytics, sophisticated machine learning algorithms, and smart Internet of Things (IoT) sensors. Traditional methods, which rely on numerical and physical data modeling, often do not provide precise short-term flood forecasts. Our suggested framework uses machine learning to analyze real-time flood forecasting, sensor data and enhance warning systems, addressing the shortcomings of traditional approaches. The key advantage of this approach is its potential to drastically decrease flood-related damages, protect lives, and boost infrastructure resilience. This proposal is not only in aligns with Brunei's vision for a safe and climate-adaptable future but also marks a significant step forward in adopting innovative and sustainable flood risk management solutions amidst an evolving climate.

Abstract: This paper aimed to investigate the entrepreneurial intentions of female students in Saudi Arabia, utilizing the Theory of Planned Behavior (TPB) as the theoretical framework. Employing a quantitative research methodology, data was collected through a questionnaire administered to female students at Princess Nourah University. The results revealed a positive inclination towards entrepreneurship, with over 64% expressing a desire to pursue entrepreneurial ventures in the future. This optimistic trend among female students suggests a potential pool of future entrepreneurs. Interestingly, a small percentage (3.21%) categorically rejected entrepreneurship as a career option, indicating a relatively low level of disinterest in entrepreneurial pursuits. However, many respondents (32%) remained undecided, presenting a valuable opportunity for mentorship and support to cultivate their entrepreneurial intentions. These findings underscore the significance of providing guidance and education to encourage entrepreneurship among female students. The TPB analysis highlighted that attitudes and perceived behavioral control towards entrepreneurship were favorable among female students, indicating a positive mindset and belief in their ability to embark on entrepreneurial endeavors. However, societal norms still exert a negative influence on some student’s entrepreneurial intentions, suggesting a need to address cultural barriers that might hinder female students' willingness to pursue entrepreneurship. The study suggests enhancing female entrepreneurship through societal encouragement and support from personal networks. It highlights the importance of fostering entrepreneurial aspirations in female students. Crucially, the study underscores the role of universities in cultivating entrepreneurial intentions by proposing the implementation of entrepreneurship-focused curricula and the creation of university-based training units or incubators.

The emerging advancements in separation and classification of various biological matters (e.g., living cells and proteins) using magnetic levitation (MagLev) technology have proven to be effective for improving disease diagnostics. MagLev technique has the capacity to detect and separate useful diagnostic biomarkers from biocomplex environments (e.g., blood and plasma), minimizing the unpleasant daunting task of sample preparations and labeling procedures. Here, we demonstrate the capability of this technique combined with image analysis and machine learning approaches for discriminating the various types of multiple sclerosis (MS) as an important model disease. To arrive at a systematic expert system, we combined robust statistical analysis with machine learning to (1) detect and remove outliers from the raw MagLev image datasets; then (2) process the images and output a low dimensional representation of massive data without losing the main statistical features; and finally (3) predict the MS clinical disease type (Relapsing-Remitting, Primary–Progressive, or Secondary–Progressive) using a classifier. This is expected to improve MS diagnostics since the current practices rely solely on clinical observation and central nervous system imaging, making management approaches are often reactional and inefficient. Thus, there is a need to identify the disease type early on. MagLev is expected to improve MS diagnostics, thereby aiding in prognosis and guiding adequate treatment choices before the patient exhibits signs of permanent neurological deficits.

Ascending aorta aneurysm (AsAA) is a complex disease, currently defined an inflammatory disease. In the sporadic form, AsAA has, indeed, a complex physiopathology with a strong inflammatory basis, significantly modulated by genetic variants in innate/inflammatory genes, acting as independent risk factors and as largely evidenced in our recent studies performed during the last 10 years. Based on these premises, here, we want to revise the impact of reactive oxygen species (ROS) and oxidative stress on AsAA pathophysiology and consequently on the onset and progression of sporadic AsAA. This might consent to add other important pieces in the intricate puzzle of the pathophysiology of this disease with the translational aim to identify biomarkers and targets to apply in the complex management of AsAA, by facilitating the AsAA diagnosis currently based only on imaging evaluations, and the treatment exclusively founded on surgery approaches.

AVs suffer reduced maneuverability and performance due to the degradation in sensor performances in fog. Such degradation causes significant object detection errors essential for AVs' safety-critical conditions. For instance, YOLOv5 performs significantly well under favorable weather but suffers miss detections and false positives due to atmospheric scattering caused by fog particles. Existing deep object detection techniques often exhibit a high degree of accuracy. The drawback is being sluggish at object detection in fog. Object detection methods with fast detection speed have been obtained using deep learning at the expense of accuracy. The problem of the lack of balance between detection speed and accuracy in fog persist. This paper presents an improved YOLOv5-based multi-sensor fusion network that combines radar's object detection with a camera image bounding box. We transformed radar detection by mapping the radar detections into a two-dimensional image coordinate and projected the resultant radar image on the camera image. Using the attention mechanism, we emphasized and improved important feature representation used for object detection while reducing high-level feature information loss. We trained and tested our multi-sensor fusion network on clear and multi-fog weather datasets obtained from the CARLA simulator. Our result shows that the proposed method significantly enhances the detection of distant and small objects. Our small CR-YOLOnet model best strikes a balance between accuracy and speed with an accuracy of 0.849 at 69 fps.

A growing number of households benefit from the government subsidies to install renewable generation facilities such as PV panels, used to gain independence from the grid and provide cheap energy. In the Romanian electricity market, these prosumers can sell their generation surplus only at regulated prices, back to the grid. A way to increase the number of prosumers is to allow them to make higher profit by selling this surplus back into the local network. This would also be an advantage for the consumers, who could pay less for electricity exempt from network tariffs and benefitting from lower prices resulting from the competition between prosumers. One way of enabling this type of trade is to use peer-to-peer contracts traded in local markets, run at microgrid (μG) level. This paper presents a new trading platform based on smart peer-to-peer (P2P) contracts for prosumers energy surplus trading in a real local microgrid. Several trading scenarios are proposed, which give the possibility to perform trading based on participants’ locations, instantaneous active power demand, maximum daily energy demand and the principle of first come first served implemented in an anonymous blockchain trading ledger. The developed scheme is tested on a low-voltage (LV) microgrid model to check its feasibility of deployment in a real network. A comparative analysis between the proposed scenarios, regarding traded quatities and financial benefits is performed.

In this work, we show that a late fusion approach to multi-modality in sign language recognition improves the overall ability of the model in comparison to the singular approaches of Computer Vision (88.14%) and Leap Motion data classification (72.73%). With a large synchronous dataset of 18 BSL gestures collected from multiple subjects, two deep neural networks are benchmarked and compared to derive a best topology for each. The Vision model is implemented by a CNN and optimised MLP and the Leap Motion model is implemented by an evolutionary optimised deep MLP topology search. Next, the two best networks are fused for synchronised processing which results in a better overall result (94.44%) since complementary features are learnt in addition to the original task. The hypothesis is further supported by application of the three models to a set of completely unseen data where a multi-modality approach achieves the best results relative to the single sensor method. When transfer learning with the weights trained via BSL, all three models outperform standard random weight distribution when classifying ASL, and the best model overall for ASL classification was the transfer learning multi-modality approach which scored 82.55% accuracy.

Currently the majority of studies on vision-based measurement has been conducted under ideal environments so that an adequate measurement performance and accuracy is ensured. However, vision-based systems may face some adverse influencing factors such as illumination change and fog interference, which can affect the measurement accuracy. This paper develops a robust vision-based displacement measurement method which can handle the two common and important adverse factors given above and achieve sensitivity at the subpixel level. The proposed method leverages the advantage of high-resolution imaging incorporating spatial and temporal context aspects. To validate the feasibility, stability and robustness of the proposed method, a series of experiments was conducted on a two-span three-lane bridge in the laboratory. The illumination change and fog interference are simulated experimentally in the laboratory. The results of the proposed method are compared to conventional displacement sensor data and current vision-based method results. It is demonstrated that the proposed method gives better measurement results than the current ones under illumination change and fog interference.

Children with autism spectrum disorder (ASD) may have impaired vision from high refractive errors: near-sighted-myopia or far-sighted-hyperopia and aversion to spectacles or contact lenses. Refractive surgery can restore sharp vision and eliminate the need for spectacles or contact lenses. Restoration of sharp vision may improve ASD behaviors. Data were collated retrospectively for 267 children with refractive errors and neurodevelopmental disorders (NDD) diagnosed as ASD alone or NDD with ASD-like behaviors. Surgery was either laser photo-refractive keratectomy (PRK; 131 children), implantation of a phakic intra ocular lens (pIOL; 129 children) or removal of the crystalline lens and implantation of an IOL (refractive lens exchange, RLE; 21 children) under general anesthesia. Median age was 10.9 yrs. and median follow-up 3.1 yrs. Pre-operative refractive errors ranged from a mean +7.5 ± 0.9 D to -14.3. ± 4.8 D. Surgery corrected 87% to normal focal length (± 1 D). Visual acuity improved an average 0.6 logMAR. Social interactions and ASD behaviors improved in 55% (146/267) of the treated children (p &lt; .01), including school performance; motor skills; depth perception; repetitive or stereotyped movements; anxiety/fear; and attention. Refractive surgery improves both visual function and behaviors in the majority of highly near-sighted or far-sighted children with ASD.