This paper explores the application of machine learning techniques for automated object grasping. Current electronic prosthetics often require extensive training for users to gain fine motor control over the prosthetic fingers, hindering their usability and acceptance. To address this challenge, this paper proposes an automated method that leverages computer vision-based techniques and machine learning algorithms. In this study, three reinforcement learning algorithms, namely Soft Actor-Critic (SAC), Deep Q-Network (DQN), and Proximal Policy Optimization (PPO), are employed to train agents for automated grasping tasks. The results indicate that the SAC algorithm achieves the highest success rate of 99% among the three algorithms at just under 200,000 timesteps. This research also shows that object’s physical characteristics can affect the agent’s ability to learn an optimal policy. Moreover, the findings highlight the potential of the SAC algorithm in developing intelligent prosthetic hands with automatic object gripping capabilities.

Это исследование сосредоточено на разработке системы искусственного зрения для гибкого дельта-робота-манипулятора и ее интеграции с межмашинной связью для оптимизации взаимодействия устройств в реальном времени. Эта интеграция направлена ​​на увеличение скорости роботизированной системы и улучшение ее общей производительности. Предлагаемое сочетание системы искусственного зрения с межмашинной связью позволяет обнаруживать и распознавать цели с высокой точностью в режиме реального времени в ограниченном пространстве, предназначенном для позиционирования, дальнейшей локализации и выполнения производственных процессов, таких как сборка или сортировка деталей. . В данном исследовании RGB-изображения используются в качестве входных данных для алгоритма MASK-R-CNN, а результаты обрабатываются в соответствии с особенностями прототипа дельта-манипулятора робота. Данные, полученные от MASK-R-CNN, адаптированы для использования в системе управления дельта-роботом с учетом ее уникальных характеристик и требований к позиционированию. Технология M2M позволяет манипулятору робота быстро реагировать на изменения, например, на перемещение объектов или изменение их положения, что имеет решающее значение для задач сортировки и упаковки. Система была протестирована в условиях, близких к реальным, чтобы оценить ее производительность и надежность.

Soft robotic manipulators consisting of serially-stacked segments combine actuation and structure in an integrated design. This design can be miniaturised while providing suitable actuation for applications such as minimally invasive surgery and for inspections in confined environments. The control of these robots, however, remains challenging, due to the difficulty in accurately modelling the robots, in coping with their redundancies, and in solving their full inverse kinematics. In this work, we explore a hybrid approach to control serial soft robotic manipulators that combines machine learning (ML) to estimate the inverse kinematics with a closed-loop control to compensate the remaining errors. For the ML part, we compare various approaches, including both kernel-based learning and more general neural networks. We validate the selected ML model experimentally. For the closed-loop control part, we first explore Jacobian formulations using both synthetic models and numerical approximations from experimental data. We then implement integral control actions using both these Jacobians, and evaluate them experimentally. In an experimental validation, we demonstrate that the hybrid control approach achieves setpoint regulation in a robot with 6 inputs and 4 outputs.

This paper presents the design and analysis of a novel 3-degree-of-freedom (3-DOF) parallel ma-nipulator equipped with self-sensing Ni-Ti (Nitinol) actuators. The manipulator's architecture and mechanical design are elucidated, emphasizing the integration of Nitinol actuators. The self-sensing technique implemented in a previous work was extended to a 20 mm actuator length, and the actuator was used to design the 3 DOF manipulator. Kinematic analyses were conducted to eval-uate the manipulator's performance under various operating conditions. A dynamic model was implemented for the dynamic dimensioning of the actuators, which work synergistically with a bias spring. The manipulator was realized, and a control strategy was implemented. Experimental tests, although documenting some positioning accuracy issues, show the efficacy and potential applica-tions of the proposed manipulator in robotics and automation systems, highlighting the advantages of self-sensing Nitinol actuators in small parallel manipulator designs.

This paper addresses the effects of electric power quality on robotics operation. A general overview is reported to highlight the main characteristics of electric power quality and their effects on a powered system by considering an end-users viewpoint. Then, authors outline the influence of voltage dip effects by focusing at robotic grasping applications. A specific case of study is reported as referring to LARM Hand IV, a three-fingers robotic hand, which has been designed and built at LARM in Cassino. A dedicated test rig has been settled up for generating predefined voltage dips. Experimental tests are carried out for evaluating the effects of different types of voltage dips on the grasping of objects.

Detecting small objects in images poses significant challenges due to their limited pixel representation and the difficulty in extracting sufficient features, often leading to missed or false detections. To address these challenges and enhance detection accuracy, this paper presents an improved small object detection algorithm, CRL-YOLOv5. The proposed approach integrates the CBAM attention mechanism into the C3 module of the backbone network, which enhances the localization accuracy of small objects. Additionally, the Receptive Field Block (RFB) module is introduced to expand the model's receptive field, thereby fully leveraging contextual information. Furthermore, the network architecture is restructured to include an additional detection layer specifically for small objects, allowing for deeper feature extraction from shallow layers. When tested on the VisDrone2019 small object dataset, CRL-YOLOv5 achieved an mAP50 of 39.2%, representing a 5.4% improvement over the original YOLOv5, effectively boosting the detection precision for small objects in images.

The application of space robotic manipulators and heightened autonomy for ios represents a paramount pursuit for leading space agencies, given the substantial threat posed by space debris to operational satellites and forthcoming space endeavors. This work presents a guidance algorithm based on drl to solve for the space manipulator path-planning during the motion synchronization phase with the mission target. The goal is the trajectory generation and control of a spacecraft equipped with a 7-dof robotic manipulator, such that its end effector remains stationary with respect to the target point of capture. The ppo drl algorithm is used to optimize the manipulator’s guidance law, and the autonomous agent generates the desired joints rates of the robotic arm, which are then integrated and passed to a model-based feedback linearization controller. The agent is first trained to optimize its guidance policy and then tested extensively to validate the results against a simulated environment representing the motion synchronization scenario of an ios mission.

All types of sports are potential application scenarios for automatic and real-time visual object and event detection. In rink hockey, the popular roller quad skate variant of hockey team sports, it is of great interest to automatically track player’s movements and positions, player’s sticks and, also, making other judgments, such as being able to locate the ball. In this work, we introduce a real-time pipeline composed by an object detection model, created specifically for rink hockey games, followed by a knowledge-based event detection module. Even in the presence of occlusions and quick motions, our deep learning object detection model effectively identifies and tracks, in real-time, important visual elements such as: ball; players; sticks; referees; crowd; goalkeeper; and goal. Using a curated dataset composed by a collection of videos of rink hockey, comprising 2525 annotated frames, we trained and evaluated the algorithm performance and compare it to state of the art object detection techniques. Our object detection model, based on YOLOv7, presents a global accuracy of 80%, and presents a good performance in terms of accuracy and speed, according to our results, making it a good choice for rink hockey applications. In our initial tests, the event detection module successfully detected one important event type in rink hockey games, the occurrence of penalties.

With the increasing demand for security surveillance, assisted driving, and remote sensing, target detection networks with rich environmental perception capabilities and high detection accuracy have become a research hotspot. However, detection techniques based on single-modality images face limitations in environmental adaptability, as they are easily affected by lighting conditions, as well as obstacles such as smoke, rain, and vegetation, leading to information loss and failing to meet the required accuracy. To address these issues, we propose a target detection network—IV-YOLO, which integrates features from both visible and infrared images. We built a dual-branch fusion network based on YOLOv8 (You Only Look Once v8) that combines infrared and visible images for target detection. On this foundation, we designed a Bidirectional Pyramid Feature Fusion structure (Bi-Fusion) to fully integrate complementary features from different modalities, reducing detection errors caused by feature redundancy and extracting fine-grained features of small targets through dual-modal fusion. Additionally, we developed the Shuffle-SPP structure, which combines channel and spatial attention mechanisms to enhance focus on deep features and further aggregate upsampling, extracting richer features. To improve the model’s expressive power, we designed a loss function tailored for multi-scale target detection boxes, accelerating the network’s convergence during training. Experimental results show that the proposed IV-YOLO network achieves an average precision (mAP) of 74.6% on the UAV remote sensing dataset, 75.4% on the KAIST pedestrian dataset, and 84.8% on the FLIR dataset. While ensuring detection accuracy, our model significantly reduces computational load, making it well-suited to meet real-time requirements. This architecture is expected to find broad application in fields such as autonomous driving, public safety, and others.

This paper describes the development of a controller that enables trajectory control and vibration control. The controller performance was verified the using a 3D 2-link, flexible manipulator. On trajectory control using inverse kinematics, it was confirmed that the deflection due to its own weight deteriorated the track following performance. The vibration component of the resonance frequency of the flexible manipulator was generated, and the tip position accuracy is deteriorated. Using the results of control experiments based on the inverse kinematics, the system is identified and then created an inverse system for simultaneous control of trajectory control and vibration control. The target trajectories were the three joint angles. Finally, it was demonstrated through experiments on actual manipulator, that the system could sufficiently follow the ideal trajectory and suppress link vibrations.

Design process can be divided into stages of analysis and synthesis. This paper presents the application of the object-oriented technique to the synthesis as well as theoretical considerations concerning to design of gear size ranges. The synthesis consists in composition (aggregation) of single details into units – according to the rule: “from details up to general view”. The basics of the object-oriented synthesis were formulated. Furthermore, the consecutive stages of synthesis were formulated. The interactions between these stages were discussed. Some aspects were described in details e.g.: creation of interfaces for performance of the embodiment phase the designed artefact via CAD system drawing with specification (dimensions are still parametrically set). The final step of the procedure is creation of so called substantial (concrete) form of artifacts i.e. final assignment of dimensions which stored in the special data base. The final stage of the design process is issuing of technical documentation (technical drawings) created automatically via CAD system. The considerations are terminated by the list of advantages connected with the object-oriented approach to design (in comparison to the traditional way).

YOLOv8, as an efficient object detection method, can swiftly and precisely identify objects within images. However, traditional algorithms encounter difficulties when detecting small targets in remote sensing images, such as missing information, background noise, and interactions among multiple objects in complex scenes, which may affect performance. To tackle these challenges, we propose an enhanced algorithm optimized for detecting small objects in remote sensing images, named HP-YOLOv8. Firstly, we design the C2f-D-Mixer (C2f-DM) module as a replacement for the original C2f module. This module integrates both local and global information, significantly improving the ability to detect features of small objects. Secondly, we introduce a feature fusion technique based on attention mechanisms, named Bi-Level Routing Attention in Gated Feature Pyramid Network (BGFPN). This technique utilizes an efficient feature aggregation network and reparameterization technology to optimize information interaction between different scale feature maps, and through the Bi-level Routing Attention (BRA) mechanism, it effectively captures critical feature information of small target objects. Finally, we propose the Smooth Mean Perpendicular Distance Intersection over Union (SMPDIoU) loss function. The method comprehensively considers the shape and size of detection boxes, enhances the model's focus on the attributes of detection boxes and provides a more accurate bounding box regression loss calculation method. To demonstrate our approach's efficacy, we conduct comprehensive experiments across the RSOD, NWPU VHR-10, and VisDrone2019 datasets. The experimental results show that the HP-YOLOv8 achieves 95.11%, 93.05%, and 53.49% in the [email protected] metric, and 72.03%, 65.37%, and 38.91% in the more stringent [email protected]:0.95 metric, respectively.

As a typical visual positioning system, monocular ranging is widely used in various fields. However, when the distance increases, there is a greater error. YOLOv8 network has the advantages of fast recognition speed and high accuracy. This paper proposes a method by combining YOLOv8 network recognition with a monocular ranging method to achieve target localization and grasping for the NAO robots. By establishing a visual distance error compensation model and applying it to correct the estimation results of the monocular distance measurement model, the accuracy of the NAO robot's long-distance monocular visual positioning is improved. Additionally, a grasping control strategy based on pose interpolation is proposed. Throughout, the proposed method's advantage in measurement accuracy was confirmed via experiments, and the grasping strategy has been implemented to accurately grasp the target object.

This paper presents a system that merges computer vision and surface electromyography techniques to carry out grasping tasks. To perform this, the vision-driven system is used to compute pre-grasping poses of the robotic system based on the analysis of tridimensional object features. Then, the human operator can correct the pre-grasping pose of the robot using surface electromyographic signals from the forearm during wrist flexion and extension. Weak wrist flexions and extensions allow a fine adjustment of the robotic system to grasp the object and finally, when the operator considers that the grasping position is optimal, a strong flexion is performed to initiate the grasping of the object. The system has been tested with several subjects to check its performance showing a grasping accuracy of around 95% of the attempted grasps which increases by around a 9% the grasping accuracy of previous experiments in which electromyographic control was not implemented.

This paper presents experimental identification and vibration suppression of a flexible manipulator with non-collocated piezoelectric actuators and strain sensors using optimal multi-poles placement control. To precisely identify the system model, a reduced order transfer function with relocated zeros is proposed, and a first-order inertia element is added to the model to compensate the non-collocation. Comparisons show the identified model match closely with the experimental results both in the time and frequency domains, and a fit of 97.2% is achieved. Based on the identified model, a full-state multi-poles placement controller is designed, and the optimal locations of the closed loop poles are determined. The feasibility of the proposed controller is validated by simulations. Moreover, the controller is tested for different locations of the closed loop poles, and an excellent performance of the optimal locations of the closed loop poles is shown. Finally, the effectiveness of the proposed controller is demonstrated by experiments. Results show that the vibrations of the expected modes are significantly diminished. Besides, vibrations of the higher modes are also slightly suppressed. Accordingly, multi-mode vibrations of the manipulator are well attenuated, and the tip displacement converges quickly with the proposed method.

Design process can be divided into stages of analysis and synthesis. This paper presents the application of the object-oriented technique to the analysis as well as theoretical considerations concerning to design of gear size ranges. This analysis consists in decomposition of the designed artefact (a gear) according to the rule “from general to details view”. The basics of the object-oriented analysis were formulated. Furthermore, design phases and the objects related to theses phases were discussed. The following models have been considered: hierarchical model, entity-relationship model, data-flow model and object model. Analysis is additionally connected with interactions between particular design phases.

This paper proposes a contact force controller for a constrained flexible manipulator in three-dimensional motion. This controller used the conversion formula obtained empirically and experimental results showed the effectiveness of the proposed contact force controller. First, the manipulator was operated with the tip of the second link restrained, then, time response of the root strain, joint angles and contact force were used to derive the relational between the three quantities. The effectiveness of the relational expression was verified by conducting a target contact force tracking experiment by inputting the angle from the relational expression. The contact force control using the strain feedback method was proposed with the strain amount estimated from the target contact force as the target value, and its effectiveness was verified by experiments. From the results obtained, controller using the strain feedback method was designed for the purpose of controlling the contact force at the tip of a flexible manipulator with two links and three degrees of freedom that performs three-dimensional spatial motion, and its effectiveness was shown by comparison with the contact force feedback method.

Real-time object detection remains a pivotal topic in the realm of computer vision. Balancing the accuracy and speed of object detectors poses a formidable challenge for both academic researchers and industry practitioners. While recent transformer-based models have showncase the prowess of the attention mechanism, delivering remarkable performance improvements over CNNs, their computational demands can hinder their effectiveness in real-time detection tasks. In this paper, we elect to use YOLOX as our robust starting point and introduce a series of effective enhancements, culminating in a new high-performance detector named YOLOAX. To further exploit the power of the attention mechanism, we devise multi-dimensional attention-based modules that activate CNNs, emphasizing the most pertinent regions and bolstering the capacity to learn the most informative image representations from feature maps. Moreover, we introduce a novel leading label assignment strategy called STA, along with a groundbreaking loss function named GEIOU Loss, to further refine our detector's performance. We provide extensive ablation studies on the COCO and PASCAL VOC 2012 detection datasets to validate our proposed methods. Remarkably, our YOLOAX is trained solely on the MS-COCO dataset from scratch, without leveraging any prior knowledge, which achieves an impressive 54.2% AP on the COCO 2017 test set while maintaining a real-time speed of 72.3 fps, surpassing YOLOX by a significant margin of 3.0% AP. Our source code and pre-trained models are openly accessible at https://github.com/KejianXu/yoloax.

Few-shot object detection (FSOD) aims to address the challenge of requiring a substantial amount of annotations for training in conventional object detection, which is very labor-intensive. However, existing few-shot methods achieve high precision with the sacrifice of time-consuming for exhaustive fine-tuning, or take poor performance in novel-class adaptation. We presume the major reason is that the valuable correlation feature among different categories is insufficiently exploited, hindering the generalization of knowledge from base to novel categories for object detection. In this paper, we propose Few-Shot object detection via Correlation-RPN and Transformer Encoder-Decoder (CRTED), a novel training network to learn object-relevant features of inter-class correlation and intra-class compactness while suppressing object-agnostic features in the background with limited annotated samples. And we also introduce a 4-way tuple-contrast training strategy to positively activate the training progress of our object detector. Experiments over two few-shot benchmarks (Pascal VOC, MS-COCO) demonstrate that, our proposed CRTED without further fine-tuning can achieve comparable performance with current state-of-the-art fine-tuned works. The codes and pre-trained models will be released.

Some traditional robots are based on offline programming reciprocal motion, and with the continuous upgrading of vision technology, more and more tasks are replaced by machine vision. For the current problem of insufficient accuracy of robot target localization based on binocular vision, and an improved random sampling consistency algorithm is proposed to complete parallel robot target localization and grasping under the guidance For the current problem of insufficient accuracy of robot target localization based on binocular vision, an improved random sampling consistency algorithm is proposed to complete parallel robot target localization and grasping under the guidance of multi Firstly, the RANSAC algorithm is improved based on the SURF algorithm; then the parallax gradient method is applied to iterate the matched point pairs several times to further optimize the data; then the 3D reconstruction is completed by the program technique; finally the obtained data is finally the obtained data is input into the robot arm and the camera internal and external parameters are obtained by the calibration method so that the robot can accurately locate and The experiments show that the improved algorithm has advantages in recognition accuracy and grasping success rate under multi- The experiments show that the improved algorithm has advantages in recognition accuracy and grasping success rate under multi-vision system.

With the rapid development of space programs in various countries, the number of satellites in space is increasing, resulting in an increasingly complex space environment. Therefore, improving space object identification technology has become highly important. We proposes a method of applying deep learning to intelligent detection of space object. We utilize 49 authentic 3D satellite models including 16 scenarios to generate a dataset comprising 17,942 images, which contains over 500 actual satellite photos. Additionally, we acquired a substantial amount of annotated data using a semi-automatic labeling method, which resulted in significant labor cost savings, and obtained a total of 39,000 labels. We validate the feasibility of the dataset using YOLOv3 and YOLOv7 models. What's more, we optimize the YOLOv7 model by integrating deformable convolution RepPoint into the YOLOv7 backbone to obtain the YOLOv7-R model. Through training with these two models, experimental results show that YOLOv3 achieves an accuracy of 0.927, YOLOv7 reaches an accuracy of 0.964, and YOLOv7-R achieves the highest accuracy at 0.983. This provides an effective solution for intelligent space object detection.

With the development of artificial intelligence technology, manipulators, as an important part of the work of intelligent robots, can replace humans to perform various complex tasks. In recent years, there have been many studies on the remote control of manipulators using various control technologies. Starting from the manufacturing materials of flexible sensors used for manipulators, this paper introduces the base materials, sensing materials, and flexible electrode materials of flexible sensors, respectively, and summarizes the performance of flexible sensors made based on the characteristics of different materials. The basic principles of dipping and coating, lithography, inkjet printing, screen printing, 3D printing and so on are introduced from the perspective of flexible sensor manufacturing process. Some different functions of sensors achieved by different structural designs, such as: tensile cracking, microchannels, etc. are also introduced. Then, from the perspective of recognition accuracy of the manipulator, two kinds of control methods based on flexible sensor by data glove control and surface EMG control are classified and introduced, and the problems existing in three aspects of flexible sensor material preparation, manufacturing process and control series design are summarized. Finally, the possible future research directions in this field are suggested.

In recent years, autonomous robots have proven capable of solving tasks in complex environments. In particular, robot manipulations in activities of daily living (ADL) for service robots have been in wide use. However, manipulations such as loading a dishwasher or folding laundry are difficult to automate robustly. In addition, manipulations of grasping multiple objects in domestic environments present difficulty. To perform those applications better, we developed robotic systems based on shared autonomy by combining the cognitive skills of a human operator with autonomous robot behaviors. In this work, we present techniques for integration of a shared autonomy system for assistive mobile manipulation and new strategies to support users in the domestic environment. We demonstrate that the robot can grasp multiple objects with random size at known and unknown table heights. Specifically, we developed three strategies for manipulation. From experimental results, we observed that the first strategy has the highest success rate (70% for random objects) up to 70 cm table height. Two other strategies perform better for 80 cm to 100 cm table height. The success rate of the second and third strategies shows an average 63.3% and 73.3%, respectively, for grasping random objects. We also demonstrated these strategies using two intuitive interfaces, a visual interface in rviz and a voice user interface with speech recognition, which are suitable for elderly people. In addition, the robot can select strategies automatically in random scenarios, which make the robot intelligent and able to make decisions independently in the environment. We obtained interesting results showing that the robot adapts to the environmental variation automatically. After these experimental demonstrations, our robot shows the capabilities for employment in domestic environments to perform actual tasks.

Effectively mapping and monitoring rubber plantation is still changing. Previous studies have explored the potential of phenology features for rubber plantation mapping through a pixel-based approach (pixel-based phenology approach). However, in fragmented mountainous Xishuangbanna, it could lead to noises and low accuracy of resultant maps. In this study, we investigated the capability of an integrated approach by combining phenology information with an object-based approach (object-based phenology approach) to map rubber plantations in Xishuangbanna. Moderate Resolution Imaging Spectroradiometer (MODIS) data were firstly used to acquire the temporal profile and phenological features of rubber plantations and natural forests, which delineates the time windows of defoliation and foliation phases. Landsat images were then used to extract a phenology algorithm comparing three different approaches: pixel-based phenology, object-based phenology, and extended object-based phenology to separate rubber plantations and natural forests. The results showed that the two object-based approaches achieved higher accuracy than the pixel-based approach, having overall accuracies of 96.4%, 97.4%, and 95.5%, respectively. This study proved the reliability of a phenology-based rubber mapping in fragmented landscapes with a distinct dry/cool season using Landsat images. This study indicated that the object-based phenology approaches can effectively improve the accuracy of the resultant maps in fragmented landscapes.

Background: In recent years, computational aesthetics and neuroaesthetics have provided novel insights into understanding beauty. Building upon the findings of traditional aesthetics, this study aims to combine these two research methods to explore an interdisciplinary approach to studying aesthetics; Method: Abstract artworks were used as experimental materials. Based on traditional aesthetics and in combination, features of composition, tone, and texture were selected. Computational aesthetic methods were then employed to correspond these features to physical quantities: blank space, gray histogram, GLCM, LBP, and Gabor filters. An EEG experiment was carried out, in which participants conducted aesthetic evaluations of the experimental materials in different contexts (genuine, fake), and their EEG data was recorded to analyze the impact of various feature classes in the aesthetic evaluation process. Finally, a SVM was utilized to model the feature data, EEG data, context data, and subjective aesthetic evaluation data; Result: Behavioral data revealed that higher aesthetic ratings in the genuine context. EEG data indicated that genuine contexts elicited more negative deflections in the prefrontal lobes between 200-1000ms. Class II compositions demonstrated more positive deflections in the parietal lobes at 50-120ms, while Class I tones evoked more positive amplitudes in the occipital lobes at 200-300ms. Gabor features showed significant variations in the parieto-occipital area at an early stage. Class II LBP elicited a prefrontal negative wave with a larger amplitude. The results of the SVM models indicated that the model incorporating aesthetic subject and context data (ACC=0.76866) outperforms the model using only parameters of the aesthetic object (ACC=0.68657); Conclusion: A positive context tends to provide participants with a more positive aesthetic experience, but abstract artworks may not respond to this positivity. During aesthetic evaluation, the ERP data activated by different features show a trend from global to local. The SVM model based on multimodal data fusion effectively predicts aesthetics, further demonstrating the feasibility of the combined research approach of computational aesthetics and neuroaesthetics.

This paper proposes the application of force-projecting bilateral control to a master-follower teleoperation system with a pneumatic manipulator on the follower side, and evaluates its effectiveness. The proposed method directly projects the operating force on the master side to the driving force on the follower side, eliminating the need for both position control and external force detection on the follower side, thereby solving the problem of low rigidity and response delay of pneumatic manipulators and providing highly stable sensor-less force presentation against variable environments. In this study, dynamic response analyses of a 1-DOF master-follower system were performed by numerical simulation using a linear system model, followed by experimental verification by implementing an actual system with an external force estimator. The results showed that the proposed force-projecting bilateral control has significantly higher positioning rigidity and better force control stability than the conventional force-reflecting bilateral control. A theoretical consideration was also given using equivalent transformation of force transfer functions to provide evidence for the high stability.

Parallel manipulators with multiple end-effectors bring us interesting advantages over conventional parallel manipulators such as improved manipulability, workspace and avoidance of singularities. In this work the kinematics of a five-bar planar parallel manipulator equipped with two end-effectors is approached by means of the theory of screws. As an intermediate step the displacement analysis of the robot is also investigated. The input-output equations of velocity and acceleration are systematically obtained by resorting to reciprocal-screw theory. In that regard the Klein form of the Lie algebra se(3) of the Euclidean group SE(3) plays a central role. In order to exemplify the method of kinematic analysis, a case study is included. Furthermore, the numerical results obtained by means of the theory of screws are confirmed with the aid of special software like ADAMS.^TM

During the hand-eye calibration process of the manipulator, the Euclidean distance error of the calibration results cannot be calculated because the true values of the hand-eye conversion matrix cannot be obtained. In this paper, a new method of projection error analysis is presented. Error analysis is carried out by using a priori knowledge that the location of AR markers is fixed in the calibration process. The coordinates of the AR marker center point are reprojected to the pixel coordinate system, and then compared with the true pixel coordinates of the AR marker center point obtained by corner detection or manual labeling in order to obtain the Euclidean distance between the two coordinates as the basis for error analysis. Experimental results show that the proposed optimization method can greatly improve the accuracy of hand-eye calibration results.

(1) Background: Efficient detection and rectification of defects or post-processing manufacturing conditions such as sharp edges and burrs on metal components are crucial for quality control in precision manufacturing industries. (2) Methods: This paper describes a lab-scale integrated system for real-time and automated metal edge image detection using a customized YOLOv5 ma-chine vision algorithm. The YOLOv5 algorithm and model were developed and embedded in the NVIDIA Jetson Nano microprocessor. The YOLOv5 model can detect three different image types for classification i.e., normal, sharp, and burrs edge on aluminum workpiece blocks. An integrated system connects the NVIDIA Jetson Nano with an embedded YOLOv5 model to a Mitsubishi Electric Melfa RV-2F-1D1-S15 manipulator to perform selective automated chamfer-ing and grinding when certain condition defects are detected. (3) Results: The model demonstrates durable performance, achieving a mean average precision of 0.886 across defect classes with minimal misclassifications. The Mitsubishi Electric Melfa RV-2F-1D1-S15 manipulator received input from the machine vision system and performed an automated chamfering and grinding process accordingly; (4) Conclusions: By integrating camera, embedded deep learning in the microprocessor and manipulator, automated chamfering and grinding process in metal component shapes can be efficiently rectified. This tailored solution promises to improve productivity and consistency in metal manufacturing and remanufacturing.

We propose a deep reinforcement learning based manipulator path tracking method to solve the computationally difficult and non-unique problem of manipulator path tracking methods based on inverse kinematics. By transforming the path tracking task into a sequence decision problem, our method adopts an end-to-end learning method for closed-loop control and avoids the process of finding the inverse solution. We first explored the feasibility of the deep reinforcement learning method in the path tracking of the manipulator. After verifying the feasibility, the path tracking of the multi-degree-of-freedom(multi-DOF) manipulator was realized by combining the maximum entropy deep reinforcement learning algorithm. The experimental results show that our method has a good effect on the path tracking of the manipulator, which not only avoids the process of finding the inverse kinematics solution, but also requires no dynamic model. Therefore, we believe that our method has great significance in the study of manipulator path tracking.

The detection performance of small objects in remote sensing images has not been satisfactory compared to large objects, especially in low-resolution and noisy images. A generative adversarial network (GAN)-based model called enhanced super-resolution GAN (ESRGAN) showed remarkable image enhancement performance, but reconstructed images usually miss high-frequency edge information. Therefore, object detection performance showed degradation for small objects on recovered noisy and low-resolution remote sensing images. Inspired by the success of edge enhanced GAN (EEGAN) and ESRGAN, we applied a new edge-enhanced super-resolution GAN (EESRGAN) to improve the quality of remote sensing images and used different detector networks in an end-to-end manner where detector loss was backpropagated into the EESRGAN to improve the detection performance. We proposed an architecture with three components: ESRGAN, EEN, and Detection network. We used residual-in-residual dense blocks (RRDB) for both the ESRGAN and EEN, and for the detector network, we used a faster region-based convolutional network (FRCNN) (two-stage detector) and a single-shot multibox detector (SSD) (one stage detector). Extensive experiments on a public (car overhead with context) dataset and another self-assembled (oil and gas storage tank) satellite dataset showed superior performance of our method compared to the standalone state-of-the-art object detectors.

In this work is represented conceptual model of robot-manipulator for capture and holding no-cooperation client spacecraft, which has Payload Adapter interface PAS 1666 S, PAS 1194 C, PAS 1666 MVS, PAS 1184 VS, when there are dynamic errors of linear and angular position of client spacecraft in the interval +/-5 deg. per minute and +/-0.1 meters per minute respectively.

Graph query languages such as Cypher are widely adopted to match and retrieve data in a graph representation, due to their ability of retrieving and transforming information. Despite the most natural way to match and transform information is through rewriting rules, those are scarcely or partially adopted in graph query languages. Their inability of doing so has a major impact on the subsequent way the information is structured, as it might then appear more natural to provide major constraint over the data representation so to consequently constraint the way the information should be represented. On the other hand, recent works are starting to move towards an opposite direction, as the provision of a truly general semistructured model (GSM) allows to both represent all the available data formats (Network-Based, Relational, and Semistructured) as well as support an holistic query language expressing all major queries in such languages. In this paper, we show that the usage of GSM enables the definition of a general rewriting mechanism which can be expressed in current graph query languages only at the cost of adhering the query to the specificity of the underlying data representation. We formalise the proposed query language in terms graph rewriting mechanisms described as a set of production rules $L\to R$ while providing restriction to the characterization of L, while extending it to support structural graph nesting operations, useful to aggregate similar information around an entry-point of interest. We discuss how GSM, by fully supporting index-based data representation, allows for a better physical model implementation leveraging the benefits of columnar database storages. Preliminary benchmarks shows the scalability of this proposed implementation in comparison with state-of-the-art implementations.

Aerial image classification has become popular and has attracted extensive research efforts in recent decades. The main challenge lies in its very high spatial resolution but relatively insufficient spectral information. To this end, spatial-spectral feature extraction is a popular strategy for classification. However, parameter determination for that feature extraction is usually time-consuming and depends excessively on experience. In this paper, an automatic spatial feature extraction approach based on image raster and segmental vector data cross-analysis is proposed for the classification of very high spatial resolution (VHSR) aerial imagery. First, multi-resolution segmentation is used to generate strongly homogeneous image objects and extract corresponding vectors. Then, to automatically explore the region of a ground target, two rules, which are derived from Tobler’s First Law of Geography (TFL) and a topological relationship of vector data, are integrated to constrain the extension of a region around a central object. Third, the shape and size of the extended region are described. A final classification map is achieved through a supervised classifier using shape, size, and spectral features. Experiments on three real aerial images of VHSR (0.1 to 0.32 m) are done to evaluate effectiveness and robustness of the proposed approach. Comparisons to state-of-the-art methods demonstrate the superiority of the proposed method in VHSR image classification.

Automatic control to any of robot manipulators, some kind of issues are being observed. A numerical method for solution generation to the inverse kinematics problem of redundant robotic manipulators is presented to obtain the smoothest algorithm as possible, leading to a robust iterative method. After the primary objective of the reachability of end-effectors to the target point is achieved, the aim is set to resolve the redundant degrees of freedom of redundant manipulator. This method is numerically stable since it converges to the correct answer with virtually any initial approximation, and it is not sensitive to the singular configurations of the manipulator. In addition, this technique is computationally effective and able to apply for serial manipulators with any DOF applications. A planar 3R-DOF serial link redundant manipulator is considered as exemplar problem for solving. Also, the continuum approach for resolving more complex structure with variable DoF is illustrated here and their brief applicability to support surgeries and adaptive use of artificial linkage moments is also calculated.

Indoor scene recognition and semantic information can be helpful for social robots. Recently, in the field of indoor scene recognition, researchers have incorporated object-level information and shown improved performances. This paper demonstrates that scene recognition can be performed solely using object-level information in line with these advances. A state-of-the-art object detection model was trained to detect objects typically found in indoor environments and then used to detect objects in scene data. These predicted objects were then used as features to predict room categories. This paper successfully combines approaches conventionally used in computer vision (YOLO) and Term Frequency-Inverse Document Frequency (TF-IDF). These approaches could be further helpful in the field of embodied research and dynamic scene classification, which we elaborate on.

Real time camouflaged object detection so far using CAMO or COD10K datset has been able to achieve mAP50 less than 64%. We present a fourier transfom and Milkyway filament extraction based method extracting shape and edges of camouflaged object, achieving 88%+ mAP50 while continuing to deliver real time detection using YOLOv8s based models. This allows for search and rescue of wilelife and humans in smoke, fog, natural disasters possible by combining low compute Yolov8s model on headup display for rescue workers such as firefighters, first reponders etc.

Recently, attention mechanisms have developed into an important tool for performance improvement of deep neural networks. In computer vision, attention mechanisms are generally divided into two main branches: spatial and channel attention. Both attention categories have their own advantages. The fusion of both attentions achieves higher performance, on the cost of the computational load. This paper introduces an innovative and lighter n-shifted sigmoid channel and spatial attention (CSA) module to reduce the computational cost and to improve the 3D scene relevant features selection. To validate the proposed attention module, 3D scene object detection in the deep Hough voting point sets is considered as the testing application. The proposed attention module with its piecewise n-shifted sigmoid activation function improves the network’s learning and generalization capacity which effectively predict bounding box parameters directly from 3D scenes and detect objects more accurately. This advantage is achieved by selectively attending to more relevant features of the input data. When used in the deep Hough voting point sets, the proposed attention module outperforms state-of-the-art 3D detection methods on the sizable SUNRGBD dataset. Experiments conducted showed an increase of 12.02 mean accuracy precision (mAP) when compared to the celebrated VoteNet (without attention). It also got 9.92 mAP higher compared to the MLVCNet, and 10.32 mAP higher than the Point Transformer. The proposed model not only decreases the sigmoid vanishing gradient problem but also brings out valuable features by fusing channel-wise and spatial information while improving accuracy results in 3D object detection.

Timely and accurate acquisition of information on distribution of the crop planting structure in Loess Plateau of eastern Gansu Province, one of the most important agricultural areas in western China, is crucial for promoting fine management of agriculture and ensuring food security. In this study, the Object-Based Image Classification (OBIC), the Random Forest (RF) and Convolutional Neural Network (CNN) models were employed to classify the crop planting structure of four representative test areas in Qingyang City in a precise manner. Firstly, different optimal segmentation scales for various crops were selected using the Estimation of Scale Parameter 2 (ESP2) tool and the Ratio of Mean Difference to Neighbors(ABS) to Standard Deviation (RMAS)model. The images were then segmented through multiresolution segmentation combined with the Canny Edge Detection algorithm. Secondly, the L1 regularized logistic regression model was utilized to select and optimize 39 spatial feature factors including spectral, textural, geometric, and index features, in conjunction with phenological factors. Lastly, under the multi-level classification framework, the Random Forest (RF) classifier and Convolutional Neural Network (CNN) model, combined with object-based multiresolution segmentation, was used to classify the crop planting structure. The findings show that: Thanks to the Canny Edge Detection algorithm, we can obtain a more complete boundary of the segmented objects and improve the separability. The optimal segmentation scales for corn, vegetables, and buckwheat were found to be 55, 70, and 35, respectively, while wheat and apple had optimal segmentation scales of 65. In addition to phenological characteristics, the number of selected spatial features for corn, vegetables, buckwheat, wheat, and apple were 9, 7, 16, 12, and 10, respectively. The CNN model demonstrated high consistency with the RF model in the classification results, but the accuracy of RF model is higher than that of CNN model on the whole. The overall accuracy of classification using RF model in four test areas registered 91.93%, 94.92%, 89.37% and 90.68%, respectively. This paper introduced crop phenological factors, effectively improving the extraction precision of shattered agricultural planting structure in the Loess Plateau of eastern Gansu Province. Its findings have important application value in crop monitoring, management, food security and other related fields.

Event-based vision is an emerging field of computer vision that offers unique properties such as asynchronous visual output, high temporal resolutions, and dependence on brightness changes to generate data. These properties can enable robust high-temporal-resolution object detection and tracking when combined with frame-based vision. In this paper, we present a hybrid, high-temporal-resolution, object detection and tracking approach, that combines learned and classical methods using synchronized images and event data. Off-the-shelf frame-based object detectors are used for initial object detection and classification. Then, event masks, generated per each detection, are used to enable inter-frame tracking at varying temporal resolutions using the event data. Detections are associated across time using a simple low-cost association metric. Moreover, we collect and label a traffic dataset using the hybrid sensor DAVIS 240c. This dataset is utilized for quantitative evaluation using state-of-the-art detection and tracking metrics. We provide ground truth bounding boxes and object IDs for each vehicle annotation. Further, we generate high-temporal-resolution ground truth data to analyze the tracking performance at different temporal rates. Our approach shows promising results with minimal performance deterioration at higher temporal resolutions (48 – 384 Hz) when compared with the baseline frame-based performance at 24 Hz.

In the context of Shared Autonomous Vehicles, the need to monitor the environment inside the car will be crucial. This article focuses on the application of deep learning algorithms to detect objects, namely lost/forgotten items to inform the passengers, and aggressive items to monitoring if violent actions may arise between passengers. For object detection algorithms was used public datasets (COCO and TAO) to train state-of-the-art algorithms, such as YOLOv5. For violent action detection was used the MoLa InCar dataset to train on state-of-the-art algorithms such as I3D, R(2+1)D, SlowFast, TSN and TSM. At the end an embedded automotive solution was used to demonstrate both methods running in real-time.

Recent progress in deep learning has led to accurate and efficient generic object detection networks. Training of highly reliable models depends on large datasets with highly textured and rich images. However, in real-world scenarios, the performance of the generic object detection system decreases when (i) occlusions hide the objects, (ii) objects are present in low-light images, or (iii) they are merged with background information. In this paper, we refer to all these situations as challenging environments. With the recent rapid development in generic object detection algorithms, notable progress has been observed in the field of object detection in challenging environments. However, there is no consolidated reference to cover state-of-the-art in this domain. To the best of our knowledge, this paper presents the first comprehensive overview, covering recent approaches that have tackled the problem of object detection in challenging environments. Furthermore, we present the quantitative and qualitative performance analysis of these approaches and discuss the currently available challenging datasets. Moreover, this paper investigates the performance of current state-of-the-art generic object detection algorithms by benchmarking results on the three well-known challenging datasets. Finally, we highlight several current shortcomings and outline future directions.

This paper presents an analysis of the sensitivity of controlling an autonomous surface object among a group of encountered objects to the inaccuracy of state control process data. For this purpose, a safe and optimal model of the control process was defined. An algorithm for determining the optimal and safe trajectory of an object, based on the multi-object game model, was developed; for comparative analysis, an algorithm for calculating only the optimal trajectory, not taking into account the maneuverability of other objects, was additionally developed. First, simulation-based studies of the algorithms enabled a comparative analysis of a number of different acceptable strategies for optimally shifting the trajectory of maneuvering objects from a single initial direction. Thereafter, the main goal of this paper was implemented: an analysis of the sensitivity characteristics of safe control, assessed with the risk of collision, both on the inaccuracy of navigation data and on the number of possible control strategies. Finally, final conclusions and a plan for further research on the subject of the paper were formulated.

Moving object detection plays a crucial role in various applications, particularly in traffic surveillance and collision warning systems. However, the high cost of training and slow detection pose significant challenges to the practicality and real-time performance of existing methods. These challenges hinder the practicality and real-time performance of existing methods. The need for a reliable and efficient moving object detection system prompts the search for cost-effective strategies. Enhancing detection speed without sacrificing accuracy is crucial for real-time applications. Overcoming these challenges is essential to advance the field of moving object detection and improve its applicability in various domains. This paper presents a comprehensive review of the literature on moving object detection, proposes novel strategies to overcome the challenges of high training costs and slow detection. The study emphasizes the importance of reliable speed monitoring systems and advancements in control systems to enhance driver assistance on urban highways. Each frame in the dataset undergoes YOLOv6 processing to detect and classify objects, generating bounding box predictions and class probabilities. Optical flow, specifically the Lucas-Kanade method, is then utilized to compute motion vectors between consecutive frames. These motion vectors facilitate object tracking across frames, enabling refined bounding box positions and improving overall object tracking accuracy. The results demonstrate the effectiveness of the proposed technique in reducing training costs, improving detection speed, and maintaining a high level of accuracy when compared to existing methods. The paper concludes by summarizing the findings and highlighting the potential of the proposed strategy for precise and reliable moving object recognition in real-world traffic scenarios

We propose a novel method for salient object detection in different images. Our method integrates spatial features for efficient and robust representation to capture meaningful information about the salient objects. We then train a conditional random field (CRF) using the integrated features. The trained CRF model is then used to detect salient objects during the online testing stage. We perform experiments on two standard datasets and compare the performance of our method with different reference methods. Our experiments show that our method outperforms the compared methods in terms of precision, recall, and F-Measure.

Flexible manipulators have been widely used in industrial production. However, due to the poor rigidity of the flexible manipulator, it is easy to generate vibration. It will reduce the working accuracy and service life of the flexible manipulator. It is necessary to suppress the vibration during the operation of the flexible manipulator. Based on the energy method and Hamilton principle, the partial differential equations of the flexible manipulator are established. Secondly, an improved radial basis function (RBF) neural network is combined with the fuzzy backstepping method to identify and suppress the random vibration during the operation of the flexible manipulator, and the Lyapunov function and control law are designed. Finally, Simulink was used to build a simulation platform, three different external disturbances were set up, and the effect of vibration suppression was observed through the change curves of the final velocity error and displacement error. Compared with RBF neural network boundary control method and RBF neural network inversion method, the simulation results show that the effect of RBF neural network fuzzy inversion method is better than the previous two control methods, the system convergence is faster, and the equilibrium position error is smaller.

This paper focuses on enhancing the object detection and decision-making capabilities of Autonomous Emergency Medical Response Systems (AEMRS). Using advanced sensors, Convolutional Neural Networks (CNN), and reinforcement learning, we propose a model that processes environmental data to identify obstacles and make optimal navigation decisions. The integration of these technologies aims to minimize response time and improve the efficiency of emergency medical services. The perception system utilizes radar, LiDAR, and camera inputs to create a comprehensive understanding of the environment. These data are processed through a series of CNN layers to detect and classify objects such as vehicles, pedestrians, and road signs. On the decision-making front, a Q-learning algorithm is employed to enable the ambulance to learn from its interactions with the environment, continuously improving its route planning and collision avoidance strategies. By combining these advanced AI techniques, the proposed AEMRS can significantly enhance the speed and reliability of emergency responses, ultimately saving more lives. This paper presents the design, implementation, and simulation results of the proposed system, demonstrating its potential to revolutionize emergency medical services.

3D object reconstruction from depth image streams using Kinect-style depth cameras has been extensively studied. In this paper, we propose an approach for accurate camera tracking and volumetric dense surface reconstruction assuming a known cuboid reference object is present in the scene. Our contribu¬tion is three-fold. (a) We maintain drift-free camera pose tracking by incorporating the 3D geometric constraints of the cuboid reference object into the image registration process. (b) We reformulate the problem of depth stream fusion as a binary classification problem, enabling high-fidelity surface reconstruction, especially in the con¬cave zones of objects. (c) We further present a surface denoising strategy to mitigate the topological inconsistency (e.g., holes and dangling triangles), which facilitates the generation of a noise-free triangle mesh. We extend our public dataset CU3D with several new image sequences, test our algorithm on these sequences and quantitatively compare them with other state-of-the-art algorithms. Both our dataset and our algorithm are available as open-source content at https://github.com/zhangxaochen/CuFusion for oth-er researchers to reproduce and verify our results.

Recognizing highly occluded objects is believed to arises from the interaction between the brain's vision and cognition controlling areas, although supporting neuroimaging data is currently limited. To explore the neural mechanism during this activity, we conducted an occlusion object recognition experiment using functional magnetic resonance imaging (fMRI). During magnet resonance examinations, 66 subjects engaged in object recognition tasks with three different occlusion degrees. Generalized linear model (GLM) analysis showed that the activation degree of occipital lobe (inferior occipital gyrus, middle occipital gyrus, and occipital fusiform gyrus) and dorsal anterior cingulate cortex (dACC) was related to the occlusion degree of the objects. Multivariate pattern analysis (MVPA) further unearthed a considerable surge in classification precision when dACC activation was incorporated as a feature. This suggested the combined role of dACC and occipital lobe in occluded object recognition tasks. Moreover, psychophysiological interaction (PPI) analysis disclosed that functional connectivity (FC) between the dACC and the occipital lobe was enhanced with increased occlusion, highlighting the necessity of FC between these two brain regions in effectively identifying exceedingly occluded objects. In conclusion, these findings contribute to understanding the neural mechanisms of highly occluded objects recognition, augmenting our appreciation of how the brain manages incomplete visual data.

Exact sequential state estimation of orbiting objects in space can be found by predicting the state using Fokker Planck Kolmogorov Equation (FPKE) and measurement correction using Bayes’ conditional/posterior Probability Density Function (PDF). Posterior PDF can be expressed as Gaussian density expanded in terms of Hermite polynomials named as Gram Charlier Series (GCS). This research is an extension of an earlier work on second order linearized solution to nonlinear Bayesian filtering using Taylor series and third order GCS expansion of posterior PDF. In this new extension, Bayes’ posterior PDF is approximated by a mixture of GCS functions for which the parameters are propagated using linear propagation theory. The update of weights of different components of GCS mixture model uses the FPKE error as feedback to adapt for the amplitude of different GCS components while solving a quadratic programming problem earlier used for Gaussian Mixture Model (GMM) PDF. Proposed filtering method is applied on tracking of space debris. The simulation results for the filter shows performance is moderately better than single GCS filter, Extended Kalman Filter (EKF) and Gaussian Sum Filter (GSF) under space debris’ highly uncertain initial conditions and sparse measurement availability.

Object segmentation is still considered a challenging problem in autonomous driving, particularly in consideration of real world conditions. Following this line of research, this paper approaches the problem of object segmentation using LiDAR-camera fusion and semi-supervised learning implemented in a fully-convolutional neural network. Our method is tested on real-world data acquired using our custom vehicle iseAuto shuttle. The data include all-weather scenarios, featuring night and rainy weather. In this work, it is shown that LiDAR-camera fusion with only a few annotated scenarios and semi-supervised learning, it is possible to achieve robust performance on real-world data in a multi-class object segmentation problem. The performance of our algorithm is measured in terms of intersection over union, precision, recall and area-under-the-curve average precision. Our network achieves 82% IoU in vehicle detection in day fair scenarios and 64% IoU in vehicle segmentation in night rain scenarios.

Autonomous driving systems are increasingly becoming a necessary trend towards building smart cities of the future. Numerous proposals have been presented in recent years to tackle particular aspects of the working pipeline towards creating a functional end-to-end system, such as object detection, tracking, path planning, sentiment or intent detection. Nevertheless, few efforts have been made to systematically compile all of these systems into a single proposal that effectively considers the real challenges these systems will have on the road, such as real-time computation, hardware capabilities, etc. This paper has reviewed various techniques towards proposing our own end-to-end autonomous vehicle system, considering the latest state on the art on computer vision, DSs, path planning, and parallelization.

The article’s goal is to overview challenges and problems on the way from the state of the art CUDA accelerated neural networks code to multi-GPU code. For this purpose, the authors describe the journey of porting the existing in the GitHub, fully-featured CUDA accelerated Darknet engine to OpenCL. The article presents lessons learned and the techniques that were put in place to make this port happen. There are few other implementations on the GitHub that leverage the OpenCL standard, and a few have tried to port Darknet as well. Darknet is a well known convolutional neural network (CNN) framework. The authors of this article investigated all aspects of the porting and achieved the fully-featured Darknet engine on OpenCL. The effort was focused not only on the classification with the use of YOLO1, YOLO2, and YOLO3 CNN models. They also covered other aspects, such as training neural networks, and benchmarks to look for the weak points in the implementation. The GPU computing code substantially improves Darknet computing time compared to the standard CPU version by using underused hardware in existing systems. If the system is OpenCL-based, then it is practically hardware independent. In this article, the authors report comparisons of the computation and training performance compared to the existing CUDA-based Darknet engine in the various computers, including single board computers, and, different CNN use-cases. The authors found that the OpenCL version could perform as fast as the CUDA version in the compute aspect, but it is slower in memory transfer between RAM (CPU memory) and VRAM (GPU memory). It depends on the quality of OpenCL implementation only. Moreover, loosening hardware requirements by the OpenCL Darknet can boost applications of DNN, especially in the energy-sensitive applications of Artificial Intelligence (AI) and Machine Learning (ML).

How infants engage with objects changes dramatically over the first year of life. While some infants exhibit a consistent hand preference for acquiring objects during this period, others have no identifiable preference. The goal of this study was to test whether lateralization confers an advantage in the development of early object skills. We examined whether lateralized infants show different rates of growth in how they interact with multiple objects as compared to infants without a hand preference. In a longitudinal design consisting of seven monthly visits from 6-12 months, 303 infants were assessed for hand preference and object management skill (i.e., holding up to three objects). Group-Based Trajectory Modeling (GBTM) identified three hand preference trajectory groups: Left, Right, and No Preference (NP). A Hierarchical Generalized Linear Model (HGLM) found that Left and Right infants differed in their linear and quadratic slopes and transitioned from holding one to two objects more quickly than NP infants. While all infants showed similar trends in object management skill across time, lateralized infants had an advantage. Further work is needed to determine if this early object skill advantage cascades to later more complex object handling.

Recent advancements in computer vision, especially deep learning models, have shown considerable promise in tasks related to plant image object detection. However, the efficiency of these deep learning models heavily relies on input image quality, with low-resolution images significantly hindering model performance. Therefore, reconstructing high-quality images through specific techniques will help extract features from plant images, thus improve model performance. In this study, we explored the value of super-resolution technology for improving object detection model performance on plant images. Firstly, we built a comprehensive dataset comprising 1030 high-resolution plant images, named the PlantSR dataset. Subsequently, we developed a super-resolution model using the PlantSR dataset and benchmarked it against several state-or-the-art models designed for general image super-resolution tasks. Our proposed model demonstrated superior performance on the PlantSR dataset, indicating its efficacy in enhancing the super-resolution of plant images. Furthermore, we explored the effect of super-resolution on two specific object detection tasks: apple counting and soybean seed counting. By incorporating super-resolution as a pre-processing step, we observed a significant reduction in mean absolute error. Specifically, on the YOLOv7 model employed for apple counting, the mean absolute error decreased from 13.085 to 5.71. Similarly, on the P2PNet-Soy model utilized for soybean seed counting, the mean absolute error decreased from 19.159 to 15.085. These findings underscore the substantial potential of super-resolution technology in improving the performance of object detection models for accurately detecting and counting specific plants from images. The source codes and associated datasets are available at https://github.com/SkyCol/PlantSR.

Object detection is important in many applications, such as autonomous driving. While 2D images are lack of depth information and are sensitive to environmental conditions, 3D point cloud can provide accurate depth information and a more descriptive environment. However, sparsity is always a challenge in single-frame point cloud object detection. This paper introduces a two-stage proposal-based feature fusion method for object detection using multiple frames. The proposed method, called proposal features fusion (PFF), utilizes a cosine-similarity approach to associate proposals from multiple frames and employs an attention weighted fusion module to merge features from these proposals. It allows for feature fusion specific to individual objects and offers lower computational complexity while achieving higher precision. The experimental results on the nuScenes dataset demonstrate the effectiveness of our approach, achieving a mAP of 46.7%, which is 1.3% higher than the state-of-the-art 3D object detection method.

Object-level Simultaneous Localization and Mapping (SLAM) has gained popularity in recent years since it can provide a means for intelligent robot-to-environment interactions. However, most of these methods assume that the distribution of the errors is gaussian. This assumption is not valid under many circumstances. Further, these methods use a delayed initialization of the objects in the map. During this delayed period, the solution relies on the motion model provided by an Inertial Measurement Unit (IMU). Unfortunately, the errors tend to accumulate quickly due to the dead-reckoning nature of these motion models. Finally, the current solutions depend on a set of salient features on the object’s surface and not the object’s shape. This research proposes an accurate object-level solution to the SLAM problem with a 4.1 to 13.1 cm error in the position (0.005 to 0.021 of the total path). The developed solution is based on Rao-blackwellized Particle Filtering (RBPF) that does not assume any predefined error distribution for the parameters. Further, the solution relies on the shape and thus can be used for objects that lack texture on their surface. Finally, the developed tightly coupled IMU/camera solution is based on an undelayed initialization of the objects in the map.

This paper aims at trying to answer the question of whether a low cost drone equipped with a regular camera can serve as a simple device to estimate the size of objects. Ad-ditionally, it assesses if the accuracy of measurement is good enough for using a drone for measurements, relying solely on GPS position and camera. A review of the literature pertaining to ground object measurements was conducted. The availability of such in-struments was evaluated in terms of purchase and rental costs, the number of instru-ments on the market, and the time to obtain them. The most common measurement methods were considered and their unit costs were reviewed. The cost of professional surveying and measuring equipment was compared to the possibility of using low-cost, non-commercial drones to measure objects and surfaces. The quality of the images ob-tained was compared with high-resolution satellite systems. Is an ordinary drone with a standard camera suitable for length measurement without professional measuring equipment? Should the results be considered only in the category of size estimation?

Research has been growing on object detection using semi-supervised methods in past few years. We examine the intersection of these two areas for floor-plan objects to promote the research objective of detecting more accurate objects with less labelled data. The floor-plan objects include different furniture items with multiple types of the same class, and this high inter-class similarity impacts the performance of prior methods. In this paper, we present Mask R-CNN based semi-supervised approach that provides pixel-to-pixel alignment to generate individual annotation masks for each class to mine the inter-class similarity. The semi-supervised approach has a student-teacher network that pulls information from the teacher network and feeds it to the student network. The teacher network uses unlabeled data to form pseudo-boxes, and the student network uses both unlabeled data with the pseudo boxes and labelled data as ground truth for training. It learns representations of furniture items by combining labelled and unlabeled data. On the Mask R-CNN detector with ResNet-101 backbone network, the proposed approach achieves mAP of 98.8%, 99.7%, and 99.8% with only 1%, 5% and 10% labelled data, respectively. Our experiment affirms the efficiency of the proposed approach as it outperforms the fully supervised counterpart using only 10% of the labels.

A detailed literature review is performed in this study to address solutions for the full-body design and control of an aerial manipulator. Deep Reinforcement Learning methods are growing to be utilized recently to cope with various uncertainties. The pros and cons of these theories will be explained as well as introducing the advantages of Fuzzy Reinforcement Learning methods. State-of-the-Art, possible challenges, potential approaches, and a summary of desired precision devices are discussed in this study.

Using the senses is essential to interact with objects in real-world environments. However, not all the senses are available when interacting with virtual objects in virtual environments. This paper presents a diamond methodology to fuse two technologies to represent the senses of sight and touch when interacting with a virtual object. The sense of sight is represented through augmented reality, and the sense of touch is represented through kinesthetic haptics. The diamond methodology is centered on the user experience and comprises five general stages: Experience design, Sensory representation, Development, Display, and Fusion. The first stage comes from the expected, proposed, or needed user experience. Then, each technology takes its homologous activities from the second to the fourth stage, diverging from each other along their development. Finally, the technologies converge to the fifth and final stage for fusion in the user experience. The diamond methodology was tested by generating a user's dual sensation when interacting with the elasticity of a tension virtual spring. The user can simultaneously perceive the visual and tactile change of the virtual spring during the interaction, representing the object's deformation. The experimental results demonstrated that an interactive experience can be felt and seen in augmented reality following the diamond methodology.

Skin image analysis using artificial intelligence (AI) has recently attracted significant research interest, particularly for analyzing skin images captured by mobile devices. Acne is one of the most common skin conditions with profound effects in severe cases. In this study, we developed an AI system called AcneDet for automatic acne object detection and acne severity grading using facial images captured by smartphones. AcneDet includes two models for conducting two tasks: (1) a Faster R-CNN-based deep learning model for the detection of acne lesion objects of four types including blackheads/whiteheads, papules/pustules, nodules/cysts, and acne scars; and (2) a LightGBM machine learning model for grading acne severity using the Investigator’s Global Assessment (IGA) scale. The output of the Faster R-CNN model, i.e., the counts of each acne type, were used as input for the LightGBM model for acne severity grading. A dataset consisting of 1,572 labeled facial images captured by both iOS and Android smartphones was used for training. The results show that the Faster R-CNN model achieves a mAP of 0.54 for acne object detection. The mean accuracy of acne severity grading by the LightGBM model is 0.85. With this study, we hope to contribute to the development of artificial intelligent systems that are able to help acne patients understand more about their conditions and support doctors in acne diagnosis.

RFID based technology innovated a new field of wireless sensing, which has been applied in posture recognition, object localization and the other sensing fields, the existing sensing methods often require tags to be attached to dynamic targets (because RFID signals are more sensitive to moving target), significantly limiting their applications. It is a challenging task to sensing a static target without tag attached in NLOS (Non-Line-of-Sight). We utilized RFID technologies to sense the static foreign objects in agricultural products, and taken metal, rock, rubber and clod as sensing targets that are common in agricultural. By deploying a tag matrices to create a sensing region, we observed the signal variations before and after the appearance of the targets in this sensing region, determined the targets’ positions and their types. Here, we buried the targets in the media of seedless cotton and wheat, and detected static targets with a non-contact method in the NLOS. Researches illustrated that by deploying appropriate tag matrices and adjusting the angle of a single RFID antenna, the matrices signals can be sensitive to the static targets’ positions and their properties,i.e. matrices signals vary with different targets and their positions. Specifically, we achieved a 100% success rate in locating metallic targets, while the success rate for clods was the lowest at 86%. We achieved a 100% recognition rate for the types of all the four objects.

For autonomous driving, perception is a primary and essential element that fundamentally deals with the insight into the ego vehicle’s environment through sensors. Perception is a challenging task suffering from dynamic objects and continuous environmental changes. The issue gets worse due to interrupting the quality of perception by adverse weather like snow, rain, fog, night light, sand storm, strong daylight, etc. In this work, we have tried to improve camera-based perception accuracy, such as autonomous driving-related object detection in adverse weather. We proposed the improvement of YOLOv8-based object detection in adverse weather through transfer learning using merged data from various harsh weather datasets. Two prosperous open-source datasets (ACDC and DAWN) and their merged dataset were used to detect primary objects on the road in harsh weather. A set of training weights were collected from training on the individual datasets, their merged version, and several subsets of those datasets according to their characteristics. A comparison between the training weights also occurred by evaluating the detection performance on the above-mentioned datasets and their subsets. The evaluation revealed that using custom datasets for training significantly improves the detection performance compared to the YOLOv8 base weights. And using more images through the feature-related data merging technique steadily increases the object detection performance.

Plant phenotype plays an important role in crop breeding and planting. Leaf phenotype is an important part of plant phenotype. In order to analyze the leaf phenotype, the target leaf is required to be segmented from the complex background image. In this paper, an automatic soybean leaf segmentation method based on object detection and interactive segmentation models is proposed. Firstly, the Libra R-CNN object detection algorithm is used to detect all soybean leaves in the image. Then, based on the idea that the target soybean leaf is located in the center of the image and the area is large, the detection bounding box of the target leaf is selected. In order not to destroy the segmentation result, the bounding box is optimized to completely enclose the whole leaf. Finally, according to the optimized bounding box, the prior channels of foreground and background are constructed using Gaussian model. The two channels together with the original image are as the input of the interactive object segmentation with inside-outside guidance model to segment the target soybean leaf. A large number of qualitative and quantitative experimental results show that the method has high segmentation accuracy and strong generalization capacity.

The task of determining the distance from one object to another is one of the important tasks solved in robotics systems. Conventional algorithms rely on an iterative process of predicting distance estimates, which results in an increased computational burden. Algorithms used in robotic systems should require minimal time costs, as well as be resistant to the presence of noise. To solve these problems, the paper proposes an algorithm for Kalman combination filtering with a Goldschmidt divisor and a median filter. Software simulation showed an increase in the accuracy of predicting the estimate of the developed algorithm in comparison with the traditional filtering algorithm, as well as an increase in the speed of the algorithm. The results obtained can be effectively applied in various computer vision systems.

In response to the problem of poor detection ability of object detection models for small-scale targets in intelligent transportation scenarios, a fusion method is proposed to enhance the features of small-scale targets, starting from feature utilization and fusion methods. The algorithm is based on the YOLOv4 tiny framework and enhances the utilization of shallow and mid level features on the basis of FPN, improving the detection accuracy of small and medium-sized targets; In view of the problem that the background of the intelligent traffic scene image is cluttered and there is more redundant information, the CBAM attention module is used to improve the attention of the model to the traffic target; To address the problem of data imbalance and prior bounding box adaptation in custom traffic datasets that expand traffic images in COCO and VOC, we propose a Copy Paste method with improved generation method and a K-means algorithm with improved distance measurement to enhance the model's detection ability for corresponding categories. Comparative experiments were conducted on a customized 260 thousand traffic dataset containing public traffic images, and the results showed that compared to YOLOv4 tiny, the proposed algorithm improved mAP by 4.9% while still ensuring the real-time performance of the model.

In recent years, research on adversarial attack techniques for remote sensing object detection (RSOD) has made great progress. Still, most of the research nowadays is on end-to-end attacks, which mainly design adversarial perturbations based on the prediction information of the object detectors (ODs) to achieve the attack. These methods do not discover the common vulnerabilities of the ODs and thus the transferability is weak. Based on this, this paper proposes a foreground feature approximation (FFA) method to generate adversarial examples (AEs) that discover the common vulnerabilities of the ODs by changing the feature information carried by the image itself to implement the attack. Specifically, firstly, the high-quality predictions are filtered as attacked objects using the detector, after which a hybrid image without any target is made, and the hybrid foreground is created based on the attacked targets. The images' shallow features are extracted using the backbone network, and the features of the input foreground are approximated towards the hybrid foreground to implement the attack. In contrast, the model predictions are used to assist in realizing the attack. In addition, we have found the effectiveness of FFA for targeted attacks, and replacing the hybrid foreground with the targeted foreground can realize targeted attacks. Extensive experiments with seven rotating ODs on the RSOD datasets DOTA and UCAS-AOD show that FFA achieves both targetless and targeted attacks with a high success rate and transferability.

Polyhymnia (33 Polyhymnia) is a main belt asteroid in our solar system with a diameter of around 54km. The density of asteroid 33 Polyhymnia, located in the main asteroid belt, is calculated to be 75g/cc. Researchers have speculated the possibility that Polyhymnia could be composed of high-density superheavy elements near atomic number 164. Here we propose that Polyhymnia could be an asteroid composed of degenerate Dark Matter (DM) and there could be many such asteroids in our solar system (this is following our earlier work suggesting Planet Nine could be such an object).

In the realm of autonomous vehicle environment perception, the primary objective of point cloud target detection is to swiftly and accurately identify three-dimensional objects from point cloud data. To meet this requirement, the prevalent network architecture employed in the industry is the voxel-based PointPillars model. Nonetheless, this model faces challenges in maintaining detection accuracy when objects are obscured or diminutive in size. In response to this issue, we introduce AGPNet, a novel model that seamlessly integrates four key modules: Data Augmentation, Dynamic Graph CNN, Pillar Feature Net, and Detection Head (SSD). The Data Augmentation module enhances the adaptability of point cloud data to complex and ever-changing real-world environments. The Dynamic Graph CNN module endows the network structure with geometric features, which encapsulate not only the point itself but also its adjacent points. The Pillar Feature Net module translates three-dimensional point cloud data into pseudo-image data through the utilization of voxels. Subsequently, the Detection Head (SSD) module leverages this pseudo-image data to conduct target detection of three-dimensional objects. Our experiments, conducted on the KITTI dataset, demonstrate that our proposed method boosts object detection accuracy by 6-7 percentage points compared to the PointPillars model, while maintaining similar detection times.

Stemming from the object overlap and undertraining from the few samples, the road dense object detection is confronted with the poor object identification performance and the inability to recognize edge objects. Based on this, one transfer learning-based YOLOv3 approach for identifying dense objects in the road has been proposed. Firstly, Darknet-53 network structure is adopted to obtain pre-trained YOLOv3 model, then the transfer training is introduced as the output layer for the special dataset of 2000 images containing vehicles; in the proposed model, one random function is adapted to intialize and optimize the weights of the transfer training model, which is seperately designed from the pre-trained YOLOv3; and the object detection classifier replaces the fully connected layer, which further improves the detection effect, the reduced size of the network model can further reduce the training and detection time, and can be better applied to actual scenarios. The experimental results demonstrate that the object detection accuracy of the presented approach is 87.75% for the Pascal VOC 2007 dataset, which is superior to the traditional YOLOv3 and the traditional YOLOv2 by 3.05% and 11.15%, respectively. Besides, the test was carried out using UA-DETRAC, a public road vehicle detection dataset, the object detection accuracy of the presented approach reaches 79.23% in detecting images, which is 4.13% better than the traditional YOLOv3, and compared with the existing relatively new object detection algorithm YOLOv5, the detection accuracy is 1.36% better. Moreover, the detection speed of the proposed YOLOv3 method reaches 31.2 Fps/s in detecting images, which is 7.6 Fps/s faster than the traditional YOLOv3, and compared with the existing relatively new object detection algorithm YOLOv5, the speed is 4.3 Fps/s faster; the proposed YOLOv3 performs 79.38Bn of floating point operations per second in detecting video, which obviously surpasses the traditional YOLOv3 and the newer object detection algorithm YOLOv5.

Since the conventional split-merge algorithm is sensitive to the object scale variance and splitting starting point, a piecewise split-merge polygon approximation method is proposed to extract the object contour features. Specifically, the contour corner is used as the starting point for the contour piecewise approximation to reduce the sensitivity of the contour segment on the starting point; then, the split-merge algorithm is used to implement the polygon approximation for each contour segments. Both the distance ratio and the arc length ratio instead of the distance error are used as the iterative stop condition to improve the robustness to the object scale variance. Both the angle and length as two features describe the shape of the contour polygon, and affect each other along the contour order relationship. Since they have a strong coupling relationship. To improve the description correction of the contour, these two features are combined to construct a Coupled Hidden Markov Model to detect the object by calculating the probability of the contour feature. The proposed algorithm is validated on ETHZ Shape Classes and INRIA Horses standard datasets. Compared with other contour-based object detection algorithms, the proposed algorithm reduces the complexity of contour description, improves the robustness of contour features to scale variance, and has a higher object detection rate.

This paper provides a methodology for the production of synthetic images for training neural networks to recognise shapes and objects. There are many scenarios in which it is difficult, expensive and even dangerous to produce a set of images that is satisfactory for the training of a neural network. The development of 3D modelling software has nowadays reached such a level of realism and ease of use that it seemed natural to explore this innovative path and to give an answer regarding the reliability of this method that bases the training of the neural network on synthetic images. The results obtained in the two proposed use cases, that of the recognition of a pictorial style and that of the recognition of migrants at sea, leads us to support the validity of the approach, provided that the work is conducted in a very scrupulous and rigorous manner, exploiting the full potential of the modelling software. The code produced, which automatically generates the transformations necessary for the data augmentation of each image, and the generation of random environmental conditions in the case of Blender and Unity3D software, is available under the GPL licence on GitHub. The results obtained lead us to affirm that through the good practices presented in the article, we have defined a simple, reliable, economic and safe method to feed the training phase of a neural network dedicated to the recognition of objects and features, to be applied to various contexts.

The ever-burgeoning growth of autonomous unmanned aerial vehicles (UAVs) has demonstrated a promising platform for utilization in real-world applications. In particular, UAV equipped with a vision system could be leveraged for surveillance applications. This paper proposes a learning-based UAV system for achieving autonomous surveillance, in which the UAV can be of assistance in autonomously detecting, tracking, and following a target object without human intervention. Specifically, we adopted the YOLOv4-Tiny algorithm for semantic object detection and then consolidated it with a 3D object pose estimation method and Kalman Filter to enhance the perception performance. In addition, a back-end UAV path planning for surveillance maneuver is integrated to complete the fully autonomous system. The perception module is assessed on a quadrotor UAV, while the whole system is validated through flight experiments. The experiment results verified the robustness, effectiveness, and reliability of the autonomous object tracking UAV system in performing surveillance tasks. The source code is released to the research community for future reference.

In this paper, a two-link manipulator system stability performance is designed and analyzed using Optimal control technique. The manipulator system is highly nonlinear and unstable. The system is modelled using Lagrangian equation and linearized in upward unstable position. The closed loop system is designed using optimal sliding mode controller. The system is compared with a known PID controller with an impulse applied and disturbance torques and a promising results has been obtained.

A major challenge of augmented and mixed reality applications is identifying the context and semantics of the real environment. Studies on object and action recognition were developed based on the improvement of machine learning techniques, allowing them to be annotated and recognized. This study aims to characterize current knowledge on the use of machine learning for recognizing objects and actions in augmented and mixed reality environments, increasing context awareness. Therefore, a systematic literature review of works related to these topics was made, using the Scopus and Web of Science knowledge bases. We searched articles and conference reviews or papers published between 2018 and 2022 and selected fifteen studies to be reviewed. The results indicate that there is a great demand for using machine learning to immersive technologies in factories, engineering, entertainment, education, health, among other application domains. However, these real-time interactive systems still have challenges and limitations to be solved, involving network communication, prediction time and the creation of a model that recognize objects and actions in broad contexts. Furthermore, additional research is needed to investigate how object and action recognition can increase context awareness in augmented reality applications.

Coupled Delft3D-object model has been developed to predict object’s mobility and burial on sandy seafloor. The Delft3D model is used to predict seabed environment such as currents, waves (peak period, significant wave height, wave direction), water level, sediment transport, and seabed change, which are taken as the forcing term to the object model consisting of three components: (a) object‘s physical parameters such as diameter, length, mass, and rolling moment, (b) dynamics of rolling cylinder around its major axis, and (c) empirical sediment scour model with re-exposure parameterization. The model is compared with the observational data collected from a field experiment from 21 April to 23 May 2013 off the coast of Panama City, Florida funded by the Department of Defense Strategic Environmental Research and Development Program. The experimental data contain both objects’ mobility using sector scanning and pencil beam sonars and simultaneous environmental time series data of the boundary layer hydrodynamics and sediment transport conditions. Comparison between modeled and observed data clearly show the model capability.

This paper aims at tackling with the task of fusion feature from images and its corresponding point clouds for 3D object detection in autonomous driving scenarios basing on AVOD, an Aggregate View Object Detection network. The proposed fusion algorithms fuse features targeted from Bird’s Eye View (BEV) LIDAR point clouds and its corresponding RGB images. Differs in existing fusion methods, which are simply the adoptions of concatenation module, element-wise sum module or element-wise mean module, our proposed fusion algorithms enhance the interaction between BEV feature maps and its corresponding images feature maps by designing a novel structure, where single level feature maps and another utilizes multilevel feature maps. Experiments show that our proposed fusion algorithm produces better results on 3D mAP and AHS with less speed loss comparing to existing fusion method used on the KITTI 3D object detection benchmark.

Detecting people and technical objects in various situations, such as natural disasters and warfare, is critical to search and rescue operations and the safety of the civilian. A fast and accurate detection for people and equipment can significantly increase the effectiveness of search and rescue missions and provide timely assistance to people. Computer vision and deep learning technologies play a key role in detecting the required objects due to their ability to analyse big volumes of visual data in real time. The performance of the neural networks such as YOLOv4-v8, Faster R-CNN, SSD, and EfficientDet has been analysed using COCO2017, SARD, SeaDronesSee, and VisDrone2019 datasets. Main criteria for comparison were mAP, Precision, Recall, F1-Score, and the ability of the neural network to work in real time. The most important metrics for evaluating the efficiency and performance of models for a given task are accuracy (mAP), F1-Score, and processing speed (FPS). These metrics allow us to evaluate both the accuracy of object recognition and the ability to use the models in real-world environments where high processing speed is important. Although different neural networks perform better on certain types of metrics, YOLO outperforms them on all metrics, showing the best results of mAP-0.88, F1 - 0.88, and FPS - 48, so the focus was on these models.

Multi-Object Tracking (MOT) is a key technology for Unmanned Aerial Vehicles (UAVs). Traditional tracking-by-detection methods firstly employ an object detector to retrieve targets in each image and then track them based on a matching algorithm. Recently, the popular multi-task learning methods has been dominating this area since they can detect targets and extract Re-Identification (Re-ID) features in a computationally efficient way. However, the detection task and the tracking task have conflicting requirements on image features, leading to the poor performance of the joint learning model compared to separate detection and tracking methods. The problem is more severe when it comes to UAV images due to the presence of irregular motion of large number of small targets. In this paper, we propose a balanced Joint Detection and Re-ID learning (JDR) network to address the MOT problem in UAV vision. To better handle the non-uniform motion of objects in UAV videos, the Set-Member Filter is applied which describes object state as a bounded set. An appearance matching cascade is then proposed based on target state set. Furthermore, a Motion-Mutation module is designed to address the challenges posed by the abrupt motion of UAV. Extensive experiments on the VisDrone-MOT2019 dataset demonstrate that our proposed model, termed as SMFMOT, outperforms state-of-the-arts by a large margin and achieves superior performance on the MOT tasks in UAV videos.

Key elements of Blue-Green Infrastructure are vegetation and stormwater storage. A combination of a bioretention cell with an underlying trench (BC-T) serving as a tree pit is often used in dense urban environments. An adequate ratio of drained area to bioretention cell area is a crucial design parameter. The ratio is derived from the hydrological balance; however, input data are often difficult to obtain or uncertain. The goal is to study the sensitivity of such data (tree water uptake and water holding capacities of soil filter and trench substrate) in the BC-T design. Sensitivity analysis is performed for the setup of a BC-T used in Prague, Czech Republic. A 10-year rainfall series (1 hour resolution) is used as an input. Data that are subject to the sensitivity analysis are changed for different trench exfiltration rates, and the effect on the size of the drained area is studied. At low trench exfiltration rates (1.8 mm.h-1), both the water holding capacity of the trench substrate and potential tree water uptake have a significant influence (more than a 20% change in the size of the drained area) and cannot be neglected. At good exfiltration rates (more than 18 mm.h-1) or when the trench is equipped with an underdrain, all studied parameters can be neglected. However, it is recommended to reduce the size of the drained area by 10-20%.

Oriented object detection is a challenging task in scene text detection and remote sensing image analysis, which has attracted extensive attention in recent years with the development of deep learning. Currently, mainstream oriented object detectors are based on preset anchor boxes. This method increases the computational load of the network and cause a large amount of anchor box redundancy. To solve this problem, we propose anchor-free oriented object detection based on the Gaussian centerness(AOGC), a single-stage anchor-free detection method. Our method uses contextual attention FPN(CAFPN) to obtain the contextual information of the target. Then we design a label assignment method for oriented objects. Finally, we develop a Gaussian kernel-based centerness branch, which can effectively determine the significance of different anchors. AOGC achieves mAP of 74.30% on the DOTA-1.0 datasets and 89.80% on the HRSC2016 datasets, respectively. AOGC exhibits superior performance to other methods in oriented anchor-free object detection methods.

Traditional camera sensors rely on human eyes for observation. However, the human eye 1 is prone to fatigue when observing targets of different sizes for a long time in complex scenes, and 2 human cognition is limited, which often leads to judgment errors and greatly reduces the efficiency. 3 Target recognition technology is an important technology to judge the target category in camera 4 sensor. In order to solve this problem, a small size target detection algorithm for special scenarios was 5 proposed by this paper. Its advantage is that this algorithm not only has higher precision for small 6 size target detection, but also can ensure that the detection accuracy of each size is not lower than the 7 existing algorithm. In this paper, a new down-sampling method was proposed, which could better 8 preserve the context feature information. The feature fusion network was improved to effectively 9 combine shallow information and deep information. A new network structure was proposed to 10 effectively improve the detection accuracy of the model. In terms of accuracy, it is better than: YOLOX, 11 YOLOXR, YOLOv3, scaled YOLOv5, YOLOv7-Tiny and YOLOv8.Three authoritative public data sets 12 were used in this experiment: a) On Visdron data sets (small size targets), DC-YOLOv8 is 2.5% more 13 accurate than YOLOv8. b) On Tinyperson data sets (minimal size targets), DC-YOLOv8 is 1% more 14 accurate than YOLOv8. c) On PASCAL VOC2007 data sets (Normal size target), DC-YOLOv8 is 0.5% 15 more accurate than YOLOv8.

The object detection task is usually affected by complex backgrounds. In this paper, a new image object detection method is proposed, which can perform multi-feature selection on multi-scale feature maps. By this method, a bidirectional multi-scale feature fusion network is designed to fuse semantic features and shallow features to improve the detection effect of small objects in complex backgrounds. When the shallow features are transferred to the top layer, a bottom-up path is added to reduce the number of network layers experienced by the feature fusion network, reducing the loss of shallow features. In addition, a multi-feature selection module based on the attention mechanism is used to minimize the interference of useless information on subsequent classification and regression, allowing the network to adaptively focus on appropriate information for classification or regression to improve detection accuracy. Because the traditional five-parameter regression method has severe boundary problems when predicting objects with large aspect ratios, the proposed network treats angle prediction as a classification task. The experimental results on the DOTA dataset, the self-made DOTA-GF dataset and the HRSC 2016 dataset show that, compared with several popular object detection algorithms, the proposed method has certain advantages in detection accuracy.

In any document, graphical elements like tables, figures, and formulas contain essential information. The processing and interpretation of such information require specialized algorithms. Off-the-shelf OCR components cannot process this information reliably. Therefore, an essential step in document analysis pipelines is to detect these graphical components. It leads to a high-level conceptual understanding of the documents that makes digitization of documents viable. Since the advent of deep learning, the performance of deep learning-based object detection has improved many folds. In this work, we outline and summarize the deep learning approaches for detecting graphical page objects in the document images. Therefore, we discuss the most relevant deep learning-based approaches and state-of-the-art graphical page object detection in document images. This work provides a comprehensive understanding of the current state-of-the-art and related challenges. Furthermore, we discuss leading datasets along with the quantitative evaluation. Moreover, it discusses briefly the promising directions that can be utilized for further improvements.

Although the Slicing Method (SM) is effective for calculating the volume of point cloud objects (PCOs), it is restricted in terms of applicability and practicability because of a certain contingency and directional defects. The Co-Opposite-Direction Slicing Method (CODSM) proposed in this paper is an improved method for calculating PCO volume by increasing parallel (co-opposite-direction) observation and considering the two-way mean as the result. This method takes full advantage of the mutual offsetting of random errors and the compensation of systematic directional errors, which can effectively overcome (or mitigate) the effect of random errors and reduce the effect of systematic errors in SM. In this paper, two typical objects, a cone model and a stone lion base, are the examples for calculating PCO volume using CODSM. The results show that CODSM has all the inherent advantages of SM and effectively weakens the volatility of random errors and the directionality of systematic errors from SM. Therefore, CODSM is a robust configuration upgrade of SM.

Multi-object tracking (MOT) in airborne videos is a challenging problem due to the uncertain airborne vehicle motion, vibrations of the mounted camera, unreliable detections, size, appearance and motion of the moving objects as well as occlusions due to the interaction between the moving objects and with other static objects in the scene.To deal with these problems, this work proposes a four-stage Hierarchical Association framework for multiple object Tracking in Airborne video (HATA). The proposed framework combines data association-based tracking (DAT) methods and target tracking using a Compressive Tracking approach, to robustly track objects in complex airborne surveillance scenes. In each association stage, different sets of tracklets and detections are associated to efficiently handle local tracklet generation, local trajectory construction, global drifting tracklet correction and global fragmented tracklet linking. Experiments with challenging airborne video datasets show significant tracking improvement compared to existing state-of-art methods.

Recent advancements in Artificial Intelligence (AI), Deep Learning (DL), and computer vision have revolutionized various industrial processes through image classification and object detection. State-of-the-art Optical Character Recognition (OCR) and Object Detection (OD) technologies, such as YOLO and PaddleOCR, have emerged as powerful solutions for addressing challenges in recognizing textual and non-textual information on printed stickers. However, a well-established framework integrating these cutting-edge technologies for industrial applications still needs to be discovered. In this paper, we propose an innovative framework that combines advanced OCR and OD techniques to automate visual inspection processes in an industrial context. Our primary contribution is a comprehensive framework adept at detecting and recognizing textual and non-textual information on printed stickers within a company, harnessing the latest AI tools and technologies for sticker information recognition. Our experiments reveal an overall macro accuracy of 0.88 for the sticker OCR across three distinct patterns. Furthermore, the proposed system goes beyond traditional Printed Character Recognition (PCR) by extracting supplementary information, such as barcodes and QR codes present in the image, significantly streamlining industrial workflows and minimizing manual labor demands.

Lake Rawapening, Semarang Regency, Indonesia, has incorporated a holistic plan in its management practices. However, despite successful target achievements, some limitations remain that a review of its management plan is needed. This paper identifies and analyzes existing lake management strategies as a standard specifically in Lake Rawapening by exploring various literature, both legal frameworks and scholarly articles indexed in Google Scholar and published in Water by MDPI about lake management in many countries. There are two major types of lake management, namely pillar-based and object-based. While the former is the foundation of a conceptual paradigm that does not comprehensively consider the roles of finance and technology in the lake management, the latter indicates the objects to manage so as to create standards or benchmarks for the implementation of various programs. Overall, Lake Rawapening management should include more programs on erosion-sedimentation control and monitoring of operational performance using information systems.

The changing of land use and land cover (LULC) are both affected by climate and human activity and affect climate, biological diversity, and human well-being. Accurate and timely information about the LULC pattern and change is crucial for land management decision-making, ecosystem monitoring, and urban planning, especially in developing economies undergoing industrialization, urbanization, and globalization. Biodiversity degradation and urban expansion in eastern China are research hot-spots. However, the influence of LULC changes on the region remains largely unexplored. Here, an object-based and multi-temporal image analysis approach was developed to detect how LULC changes during 1985-2015 in the Tiaoxi watershed (Zhejiang province, eastern China) using Landsat TM and OLI data. The main objective of this study is to improve the accuracy of unsupervised change detection from object-based and multi-temporal images. To this end, a total of seven LULC maps are generated with multi-temporal images. A random stratified sample design was used for assessing change detection accuracy. The proposed method achieved an overall accuracy of 91.86%, 92.14%, 92.00%, and 93.86% for 2000, 2005, 2010, and 2015, respectively. Nevertheless, the proposed method, in conjunction with object-oriented and multi-temporal satellite images, offers a robust and flexible approach to LULC changes mapping that helps with emergency response and government management. Urbanization and agriculture efficiency are the main reasons for LULC changes in the region. We anticipate that this freely available data will improve the modeling for surface forcing, provide evidence of changes in LULC, and inform water-management decision-making.

Object detection often struggles with accurately identifying visually similar parts, a challenge commonly faced in industrial applications. To address this issue, we propose a clustering methodology based on the visual similarity of 3D object models. This approach is particularly effective when integrated with synthetic image generation, as both processes rely on 3D models. In a case study, we observed a 22 % increase in classification performance on a validation dataset when training an object detector on visually similar groups rather than on all classes, suggesting the potential of our method as a baseline for a multi-stage classification scheme.

In machining, there is a constant effort to achieve the expected roughness of the machined surface while maintaining the life of the cutting tool during its operation. The methods used for extending machinability characteristics can be applied due to cooling and lubrication. One of the latest, but not new, targeted cooling techniques have become cryogenic treatment, which uses substances that exhibit extremely low-temperature values of about 123 K. This is a very environmentally friendly technique compared to the current standardized cooling and lubricating fluids. The main task of such cooling is to change the properties of the workpiece so that it exhibits the properties of a brittle material. Bringing the workpiece structure in this way can result in easier material separation through the chip. In the article, the obtained test results can approximate the behavior of various materials during cryogenic cooling.

Pairs of potential and flow variables have long been established for interfacing object-oriented component models of physical systems. Recently, however, the use of triplets has been discovered for the purpose of robust modeling. New and powerful Modelica libraries have been developed such as the DLR ThermoFluid Stream library or the introduction of the Dialectic Mechanics library. Their use of triplets is entangled with a special modeling approach that uses Linear Implicit Equilibrium Dynamics. In this paper, we study the basic motivation of this approach, its benefits and drawbacks before we finally demonstrate how it beneficially impacts the generation of corresponding simulation code.

Abstract: Rationale. Object tracking has significance in many applications ranging from control of unmanned vehicles to autonomous monitoring of specific situations and events, especially when providing safety for patients with certain adverse conditions such as epileptic seizures. Conventional tracking methods face many challenges, such as the need for dedicated attached devices or tags, influence by high image noise, complex object movements, and intensive com-putational requirements. We have developed earlier computationally efficient algorithms for global optical flow reconstruction of group velocities that provide means for convulsive seizure detection and have potential applications in fall and apnea detection. Here, we address the chal-lenge of using the same calculated group velocities for object tracking in parallel. Methods. We propose a novel optical flow-based method for object tracking. It utilizes real-time image se-quences from the camera and directly reconstructs global motion-group parameters of the con-tent. These parameters can steer a rectangular region of interest surrounding the moving object to follow the target. The method successfully applies to multi-spectral data, further improving its effectiveness. Results. Experimental results on simulated tests and complex real-world data demonstrate the method's capabilities. The proposed optical flow reconstruction can provide accurate, robust, and faster results compared to current state-of-the-art approaches.

Drones have been used in a variety of scenarios such as atmospheric monitoring, fire rescue, agricultural irrigation, etc., in which accurate environmental perception is of crucial importance for both decision-making and control. Among the drone sensors, the RGB camera is indispensable for capturing rich visual information for vehicle navigation but encounters a grand challenge in high-dynamic-range scenes that occur frequently in real applications. Specifically, the recorded frames suffer from under-exposure and over-exposure simultaneously and degenerate the successive vision tasks. To solve the problem, we take object tracking as an example and leverage the superior response of event cameras over a large intensity range to propose an event-assisted object tracking algorithm that can achieve reliable tracking under large intensity variations. Specifically, we propose to pursue feature matching from dense event signals, and based on which to (i) design a UNet-based image enhancement algorithm to balance the RGB intensity with the help of neighboring frames in the time domain, and then (ii) construct a dual-input tracking model to track the moving objects from intensity balanced RGB video and event sequence. The proposed approach is comprehensively validated in both simulation and real experiments.

With increasing demand from unmanned driving and robotics, more attention has been paid to point cloud-based 3D object accurate detection technology. However, due to the sparseness and irregularity of the point cloud, the most critical problem is how to utilize the relevant features more efficiently. In this paper, we proposed a point-based object detection enhancement network to improve the detection accuracy in the 3D scenes understanding based on the distance features. Firstly, the distance features are extracted from the raw point sets and fused with the raw features about reflectivity of the point cloud to maximizing the use of information in point cloud. Secondly, we enhanced the distance features and raw features that we collectively refer to them as self-features of the key points in Set Abstraction (SA) layers with the self-attention mechanism, so that the foreground points can be better distinguished from the background points. Finally, we revised the group aggregation module in SA layers to enhance the feature aggregation effect of key points. We conducted experiments on the KITTI dataset and nuScenes dataset and the results show the enhancement method proposed in this paper has excellent performance.

Although deep learning has received extensive attention and achieved excellent performances in various of scenarios, it suffers from adversarial examples to some extent. Especially, physical attack poses more threats than digital attack. However, existing researches pay less attention to physical attack of object detection in remote sensing images (RSIs). In this work, we systematically analyze the universal adversarial patch attack for multi-scale objects in the remote sensing field. There are two challenges for adversarial attack in RSIs. On one hand, the number of objects in remote sensing images is more than that of natural images. Therefore, it is difficult for adversarial patch to show adversarial effect on all objects when attacking a detector of RSIs. On the other hand, the wide range of height of photography platform causes that the size of objects diverse a lot, which brings challenges for generating universal adversarial perturbation for multi-scale objects. To this end, we propose an adversarial attack method on object detection for remote sensing data. One of the key ideas of the proposed method is the novel optimization of adversarial patch. We aim to attack as many objects as possible by formulating a joint optimization problem. Besides, we raise a scale factor to generate a universal adversarial patch that adapts to multi-scale objects, which ensures the adversarial patch is valid for multi-scale objects in the real world. Extensive experiments demonstrate the superiority of our method against state-of-the-art methods on YOLO-v3 and YOLO-v5. In addition, we also validate the effectiveness of our method in real-world applications.

3D object detection is crucial for autonomous driving to understand the driving environment. Since the pooling operation causes information loss in the standard CNN, we have designed a wavelet multiresolution analysis-based 3D object detection network without a pooling operation. Additionally, instead of using a single filter like the standard convolution, we use the lower-frequency and higher-frequency coefficients as a filter. These filters capture more relevant parts than a single filter, enlarging the receptive field. The model comprises a discrete wavelet transform (DWT) and an inverse wavelet transform (IWT) with skip connections to encourage feature reuse for contrasting and expanding layers. The IWT enriches the feature representation by fully recovering the lost details during the downsampling operation. Element-wise summation is used for the skip connections to decrease the computational burden. We train the model for the Haar and Daubechies (Db4) wavelets. The two-level wavelet decomposition result shows that we can build a lightweight model without losing significant performance. The experimental results on the KITTI’s BEV and 3D evaluation benchmark show our model outperforms the Pointpillars base model by up to 14 \% while reducing the number of trainable parameters. Code will be released.

The video images captured at long range usually have low contrast floating objects of interest on a sea surface. A comparative experimental study of the statistical characteristics of reflections from floating objects and from the agitated sea surface showed the difference in the correlation and spectral characteristics of these reflections. The functioning of the recently proposed modified matched subspace detector (MMSD) is based on the separation of the observed data spectrum on two subspaces: relatively low and relatively high frequencies. In the literature the MMSD performance has been evaluated in generally and moreover using only a sea model (additive Gaussian background clutter). This paper extends the performance evaluating methodology for low contrast object detection and moreover using only the real sea dataset. This methodology assumes an object of low contrast if the mean and variance of the object and the surrounding background are the same. The paper assumes that the energy spectrum of the object and the sea are different. The paper investigates a scenario in which an artificially created model of a floating object with specified statistical parameters is placed on the surface of a real sea image. The paper compares the efficiency of the classical Matched Subspace Detector (MSD) and MMSD for detecting low-contrast objects on the sea surface. The article analyzes the dependence of the detection probability at a fixed false alarm probability on the difference between the statistical means and variances of a floating object and the surrounding sea.

Object detection is one of the most critical tasks in the field of Computer vision. This task comprises identifying and localizing an object in the image. Architectural floor plans represent the layout of buildings and apartments. The floor plans consist of walls, windows, stairs, and other furniture objects. While recognizing floor plan objects is straightforward for humans, automatically processing floor plans and recognizing objects is a challenging problem. In this work, we investigate the performance of the recently introduced Cascade Mask R-CNN network to solve object detection in floor plan images. Furthermore, we experimentally establish that deformable convolution works better than conventional convolutions in the proposed framework. Identifying objects in floor plan images is also challenging due to the variety of floor plans and different objects. We faced a problem in training our network because of the lack of publicly available datasets. Currently, available public datasets do not have enough images to train deep neural networks efficiently. We introduce SFPI, a novel synthetic floor plan dataset consisting of 10000 images to address this issue. Our proposed method conveniently surpasses the previous state-of-the-art results on the SESYD dataset and sets impressive baseline results on the proposed SFPI dataset. The dataset can be downloaded from SFPI Dataset Link. We believe that the novel dataset enables the researcher to enhance the research in this domain further.