Despite the long and extensive history of 3D technology, it has recently attracted the attention of researchers. This technology has become the center of interest of young people because of the real feelings and sensations it creates. People see their environment as 3D because of their eye structure. In this study, it is hypothesized that people lose their perception of depth during sleepy moments and that there is a sudden transition from 3D vision to 2D vision. Regarding these transitions, the EEG signal analysis method was used for deep and comprehensive analysis of 2D and 3D brain signals. In this study, a single-stream anaglyph video of random 2D and 3D segments was prepared. After watching this single video, the obtained EEG recordings were considered for two different analyses: the part involving the critical transition (transition-state) and the state analysis of only the 2D versus 3D or 3D versus 2D parts (steady-state). The main objective of this study is to see the behavioral changes of brain signals in 2D and 3D transitions. To clarify the impacts of the human brain’s power spectral density (PSD) in 2D-to-3D (2D_3D) and 3D-to-2D (3D_2D) transitions of anaglyph video, 9 visual healthy individuals were prepared for testing in this pioneering study. Spectrogram graphs based on Short Time Fourier transform (STFT) were considered to evaluate the power spectrum analysis in each EEG channel of transition or steady-state. Thus, in 2D and 3D transition scenarios, important channels representing EEG frequency bands and brain lobes will be identified. To classify the 2D and 3D transitions, the dominant bands and time intervals representing the maximum difference of PSD were selected. Afterward, effective features were selected by applying statistical methods such as standard deviation (SD), maximum (max), and Hjorth parameters to epochs indicating transition intervals. Ultimately, k-Nearest Neighbors (k-NN), Support Vector Machine (SVM), and Linear Discriminant Analysis (LDA) algorithms were applied to classify 2D_3D and 3D_2D transitions. The frontal, temporal, and partially parietal lobes show 2D_3D and 3D_2D transitions with a good classification success rate. Overall, it was found that Hjorth parameters and LDA algorithms have 71.11% and 77.78% classification success rates for transition and steady-state, respectively.

Depth-sensing technology has led to broad applications of inexpensive depth cameras that can capture human motion and scenes in 3D space. Background subtraction algorithms can be improved by fusing color and depth cues, thereby allowing many issues encountered in classical color segmentation to be solved. In this paper, we propose a new fusion method that combines depth and color information for foreground segmentation based on an advanced color-based algorithm. First, a background model and a depth model are developed. Then, based on these models, we propose a new updating strategy that can eliminate ghosting and black shadows almost completely. Extensive experiments have been performed to compare the proposed algorithm with other, conventional RGB-D algorithms. The experimental results suggest that our method extracts foregrounds with higher effectiveness and efficiency.

This research study focuses on addressing practical optimization challenges in audio-visual content using advanced computational intelligence methods, with a specific emphasis on privacy-preserving issues. The research will be presented as a proposal and can be conducted based on the provided ideas. Computational intelligence encompasses various approaches, including evolutionary algorithms, learning methods, fuzzy systems, and neural networks, which have become essential tools for tackling complex engineering optimization problems due to computational expenses, dimensional complexities, and interdisciplinary integration. The research objectives include a thorough investigation of optimization challenges in audio-visual content, the delineation of problem characteristics, and the development of relevant methodologies based on these specifications. The main goals of the study, titled "Advanced Computational Intelligence Assisted Less-Expensive Privacy-Preserving Optimization," encompass the development of a metamodel-based learning algorithm integrated with evolutionary computation for privacy-preserving optimization, less-expensive signal watermarking optimization using hybrid metamodeling and evolutionary algorithms, and a closed-loop robust intelligent PID control system applied in real-time dynamic signal watermarking. Additional objectives may be defined as the research progresses and further background review is conducted.

In recent decades, with the ever-growing scale of video data, near-duplicate videos continue to emerge. Data quality issue caused by near-duplicate videos is becoming more and more prominent, which has affected the application of normal videos. Although current studies on near-duplicate video detection can be helpful to uncover data quality issues for videos, they still lack a process of automatic merging for the video data represented by high-dimensional features, which are difficult to automatically clean the near-duplicate videos to improve data quality for video datasets. At present, there are few studies on near-duplicate video data cleaning. The existing studies have the sensitive problems of video data orderliness and clustering initial center under a condition that prior distribution is unknown, which seriously affect the accuracy of near-duplicate video data cleaning. To address the above issues, an automatic near-duplicate video data cleaning method based on a consistent feature hash ring is proposed in this paper. First, a residual network with convolutional block attention modules, a long short-term memory deep network, and an attention model are integrated to construct an RCLA deep network with the multi-headed attention mechanism to extract spatiotemporal features of video data. Then, a consistent feature hash ring is constructed, which can effectively alleviate the sensitivity of video data orderliness while providing a condition of near-duplicate video merging. To reduce the sensitivity of the initial cluster centers to results of near-duplicate video cleansing, an optimized feature distance-means clustering algorithm is constructed by utilizing a mountain peak function on a consistent feature hash ring, which can implement automatic cleaning of near-duplicate video data. Finally, experiments are conducted based on a commonly used dataset named CC_WEB_VIDEO and a coal mining video dataset. Compared with some existing works, simulation results demonstrate that the performance of the proposed method.

Primary ciliary dyskinesia (PCD) is an inherited disorder that impairs motile cilia, essential for respiratory health, with a reported prevalence of 1 in 16,309 within Hispanic populations. Despite having the RSPH4A [c.921+3_921+6del (intronic)] founder mutation in 70% of Puerto Rican patients, the characterization of the ciliary dysfunction remains unidentified due to the unavailability of advanced diagnostic modalities like High-Speed Video Microscopy Analysis (HSVA). Our study implemented HSVA for the first time on the island as a tool to better diagnose and characterize the RSPH4A [c.921+3_921+6del (intronic)] founder mutation in Puerto Rican patients. By applying HSVA, we analyzed the ciliary beat frequency (CBF) and pattern (CBP) in native Puerto Rican patients with PCD. Our results showed decreased CBF and a rotational CBP linked to the RSPH4A founder mutation in Puerto Ricans, presenting a novel diagnostic marker that could be implemented as an axillary test into the PCD diagnosis algorithm in Puerto Rico. The integration of HSVA technology in Puerto Rico substantially enhances the framework for PCD evaluation and diagnosis, facilitating prompt detection and early intervention for improved disease management. This initiative, demonstrating the potential of HSVA as an adjunctive test within the PCD diagnostic algorithm, could serve as a blueprint for analogous developments throughout Latin America.

This paper presents an approach to teacher identity heritage as result of the implementation of a research device created through Arts-based Research (ABR) methods, specifically with video elicitation and video essay used as research tools. Two main objectives were raised. The first one, to establish the real relevance of focusing performance on teacher identity. The second one, testing a new methodological proposal specifically designed for this purpose, but still useful in other contexts where heritage identity is as present as in teaching. The device, Body-camera, involves a process that allows new ways to understand the creation of identities using video to encourage the production of new meanings by visual and oral data. The participants were teachers in training during their internship period. Some notions about teachers' identity heritage were revealed, and also preserved, firstly, through personal perspectives by video elicitations and secondly, through collective perspectives by video essays. Both are video structures used in ABR which mix creative experience, memories, life experiences, relationships and links that shape the teachers’ professional identity.

Live video streaming has become one of the main multimedia trends in networks in recent years. Providing Quality of Service (QoS) during live transmissions becomes a challenge due to the stringent requirements for low latency and minimal interruptions. This scenario has led to a high dependence on cloud services, implying a widespread usage of Internet connections, which constrains contexts where an Internet connection is not available. Thus, alternatives such as Mobile Ad Hoc Networks (MANETs) emerge as potential communication techniques. These networks operate autonomously with mobile devices serving as nodes, without the need for coordinating centralized components. However, these characteristics lead to challenges to live-video streaming, such as dynamic node topologies or periods of disconnection. Considering these constraints, this paper investigates the application of Artificial Intelligence (AI)-based classification techniques to provide adaptive streaming in MANETs. For this, a software-driven architecture is proposed to route stream in offline MANETs, predicting the stability of individual links and compressing video frames accordingly. The proposal has been implemented and assessed in a laboratory context, analyzing the model performance and QoS metrics. As a result, the model is implemented in a decision forest algorithm, which provides 95.9% of accuracy. Also, obtained latency values become assumable for video streaming, manifesting a reliable response for routing and node movements.

This paper reviews the unilateral and bilateral, one- and two-dimensional Laplace transforms. The unilateral and bilateral Laplace transforms are compared in the one-dimensional case, leading to the formulation of the initial-condition theorem. This problem is solved with all generality in the one- and two-dimensional cases with the bilateral Laplace transform. General two-dimensional linear systems are introduced and the corresponding transfer function defined.

Video editing is a high-required job, for it requires skilled artists or workers equipped with plentiful physical strength and multidisciplinary knowledge, such as cinematography, aesthetics. Thus gradually, more and more researches focus on proposing semi-automatical and even fully automatical solutions to reduce workloads. Since those conventional methods are usually designed to follow some simple guidelines, they lack flexibility and capability to learn complex ones. Fortunately, the advances of computer vision and machine learning make up the shortages of traditional approaches and make AI editing feasible. There is no survey to conclude those emerging researches yet. This paper summaries the development history of automatic video editing, and especially the applications of AI in partial and full workflows. We emphasizes video editing and discuss related works from multiple aspects: modality, type of input videos, methology, optimization, dataset, and evaluation metric. Besides, we also summarize the progresses in image editing domain, i.e., style transferring, retargeting, and colorization, and seek for the possibility to transfer those techniques to video domain. Finally, we give a brief conclusion about this survey and explore some open problems.

In today’s digital media data communication over the internet increasing day by day. Therefore the data security becomes the most important issue over the internet. With the increase of data transmission, the number of intruders also increases. That’s the reason it is needed to transmit the data over the internet very securely. Steganography is a popular method in this field. This method hides the secret data with a cover medium in a way so that the intruders cannot predict the existence of the data. Here a steganography method is proposed which uses a video file as a cover medium. This method has five main steps. First, convert the video file into video frames. Then a particular frame is selected for embedded the secret data. Second, the Least Significant Bit (LSB) Coding technique is used with the double key security technique. Third, an 8 characters password verification process. Fourth, reverse the encrypted video. Fifth, signature verification process to verify the encryption and decryption process. These five steps are followed by both the encrypting and decrypting processes.

With end-to-end encryption for video streaming services becoming more popular, network administrators face new challenges in preserving network performance and user experience. Video ads may cause traffic congestion and poor Quality of Experience. Because of the natural variation in user interests and network situations, traditional algorithms for increasing QoE may face limitations. To solve this problem, we suggest a novel method that uses user facial emotion recognition to deduce QoE and study the effect of ads. We use open-access Face Emotion Recognition (FER) datasets and extract facial emotion information from actual observers to train machine learning models. Participants were requested to watch ad videos and provide feedback, which will be used for comparison, training, testing, and validation of our suggested technique. Our tests show that our approach beats the ITU-T P.1203 standard in terms of accuracy by 37.1%. Our method provides a hopeful answer to the problem of increasing user engagement and experience in video streaming services.

This study focuses on enhancing controllable fibrin-based hydrogels for tissue engineering, addressing existing weaknesses. By integrating a novel copolymer, we improve the foundation for cell-based angiogenesis with adaptable structural features. Tissue engineering often faces challenges like waste disposal and nutrient supply beyond the 200 µm diffusion limit. Angiogenesis breaks through this limitation, allowing the construction of larger constructs. Our innovative scaffold combination significantly boosts angiogenesis, resulting in longer branches and more capillary network junctions. The copolymer attached to fibrin fibers enables precise adjustment of hydrogel mechanical-dynamic properties for specific applications. Our material proves effective for angiogenesis, even under suppression factors like suramin. In our study, we prepared fibrin-based hydrogels with and without the copolymer PVP12400-co-GMA10mol%. Using a co-culture system of human umbilical vein endothelial cells (HUVEC) and mesenchymal stem cells (MSC), we analyzed angiogenetic behavior on and within the modified hydrogels. Capillary-like structures were reproducibly formed on different surfaces, demonstrating the general feasibility of three-dimensional endothelial cell networks in fibrin-based hydrogels. This highlights the biomaterial's suitability for in vitro pre-vascularization of biohybrid implants.

Magnetic quantum oscillations (MQO) are traditionally applied to investigate the electronic structure of metals. In layered quasi-two-dimensional (Q2D) materials the MQO have several qualitative features giving additional useful information, provided their theoretical description is developed. Within the framework of the Kubo formula and the self-consistent Born approximation, we reconsider the phase of beats in the amplitude of Shubnikov oscillations of interlayer conductivity in Q2D metals. We show that the phase shift of beats of the Shubnikov (conductivity) oscillations relative to the de Haas - van Alphen (magnetization) oscillations is larger than expected previously and, under certain conditions, can reach the value of π/2, as observed experimentally. We explain the phase inversion of MQO during the 3D - 2D crossover and predict the decrease of relative MQO amplitude of interlayer magnetoresistance in a strong magnetic field, larger than the beat frequency.

Low separation efficiency of photogenerated carriers and inefficient utilization of visible light limit the application of g-C3N4 nanosheets (CNNs) in the field of photocathodic protection (PCP). Therefore, this work considered indium zinc sulfide (ZnIn2S4, ZIS) as a visible photosensitizer and an electronic donor to promote its PCP performance. ZIS nanolayers with nano-leaf structures were fabricated on CNNs by a simple hydrothermal method. The synthesized 30% ZIS@CNNs composites significantly enhanced the PCP performance for 316 stainless steel (SS) compared with pure CNNs. Under visible light illumination, the 30% ZIS@CNNs photoelectrode exhibited the largest photoinduced current density of 17.30 μA cm−2 and a photoinduced potential drop of 0.37 V, which was approximately 4 and 7.5 times higher than that of pure CNNs, respectively. The improved protection performance may be attributed to the significant increase in visible light absorption and the great enhancement in the separation efficiency of

Two-dimensional layered coordination polymers based on the hetero-substituted 3-chloro-6-cyano-2,5-dihydroxybenzoquinone ligand, hereafter ClCNAn2- anilate, and LnIII ions (Tb and Eu) are reported. Compounds 1, 2, formulated as Ln2(ClCNAn)3(DMSO)6 (LnIII = Tb, 1; Eu, 2) and their related intermediates 1’ and 2’, formulated as Ln2(ClCNAn)3(H2O)x.yH2O (x+y likely = 12, Ln = Tb, 1’; and Eu, 2’) were prepared by a conventional one-pot reaction (the latter) and recrystallized from DMSO solvent (the former). Polyhydrated intermediates 1’ and 2’ show very similar XRPD patterns, while, despite their common stoichiometry, 1 and 2 are not isostructural. 1 consists of a 2D coordination framework of 3,6 topology, where [Tb(DMSO)3]3+ moieties are bridged by three bis-chelating ClCNAn2- ligands, forming distorted hexagons. Ultrathin nanosheets of 1 were obtained by exfoliation, via liquid assisted sonication method and characterized by atomic force microscopy, confirming the 2D nature of 1. The crystal structure of 2, still showing the presence of 2D sheets with “hexagonal” mesh and a common (3,6) connectivity, is based onto flat, non-corrugated slabs. Indeed, at a larger scale, the different “rectangular tiles” show a clear roofing in 1, which is totally absent in 2. The magnetic behavior of 1 very likely indicates depopulation of the highest crystal-field levels, as expected for TbIII compounds.

Superpixels are a representation of still images as pixel grids because of their more meaningful information compared with atomic pixels. However, their usefulness for video classification has been given little attention. In this paper, rather than using spatial RGB values as low-level features, we use optical flows mapped into hue-saturation-value (HSV) space to capture rich motion features over time. We introduce motion superpixels, which are superpixels generated from flow fields. After mapping flow fields into HSV space, independent superpixels are formed by iteration of seeded regions. Every grid of a motion superpixel is tracked over time using nearest neighbors in the histogram of flow (HOF) for consecutive flow fields. To define the temporal representation, the evolution of three features within the superpixel region, namely the HOF, HOG, and the center of superpixel mass are used as descriptors. The bag of features algorithm is used to quantify final features, and generalized histogram-kernel support vector machines are used as learning algorithms. We evaluate the proposed superpixel tracking on first-person videos and action sports videos.

The expansion of Open World Video Games (OWVGs) has seen the emergence of multiple new fictional worlds. This type of video game is characterized by total immersion in a world built for the players entertainment. What videogames developers want when players enter an OWVG is that they could feel like if they were open a door to an entirely new world and leave the real world behind. These virtual worlds manifest as a complement, an alternative, or the successor to the physical universe, and in some way continue the philosophical tradition of possible worlds begun by Leibniz. Accustomed to ‘surviving’ in hostile environments, millions of people continued to improve their skills in the midst of the COVID-19 pandemic while locked in their homes. Once the pandemic seems to start to be left behind, the paper analyzes the virtual worlds created by the video games and the relations between the pandemic and these fictional worlds.

We present a series of computer-assisted high resolution transmission electron (HRTEM) simulations to determine Moiré patters by induced twisting effects between slabs at rotational angles of 3°, 5°, 8°, and 16°, for molybdenum disulfide, graphene, tungsten disulfide, and tungsten selenide layered materials. In order to investigate the electronic structure, a series of numerical simulations using DFT methods was completed using CASTEP with a generalized gradient approximation to determine both band structure and density of states on honeycomb like new superlattices. Our results indicate metallic transitions when rotation approaches 8° with respect to each other for most of the two-dimensional systems that were analyzed.

Optical polarizers are essential components for the selection and manipulation of light polarization states in optical systems. Over the past decade, the rapid advancement of photonic technologies and devices has led to the development of a range of novel optical polarizers, opening avenues for many breakthroughs and expanding applications across diverse fields. Particularly, two-dimensional (2D) materials, known for their atomic thin film structures and unique optical properties, have become attractive for implementing optical polarizers with high performance and new features that were not achievable before. This paper reviews recent progress in 2D-material-based optical polarizers. First, an overview of key properties of various 2D materials for realizing optical polarizers is provided. Next, the state-of-the-art optical polarizers based on 2D materials, which are categorized into spatial-light devices, fiber devices, and integrated waveguide devices, are reviewed and compared. Finally, we discuss the current challenges of this field as well as the exciting opportunities for future technological advances.

With compact footprint, low energy consumption, high scalability, and mass producibility, chip-scale integrated devices are an indispensable part of modern technological change and development. Recent advances in two-dimensional (2D) layered materials with their unique structures and distinctive properties have motivated their on-chip integration, yielding a variety of functional devices with superior performance and new features. To realize integrated devices incorporating 2D materials, it requires a diverse range of device fabrication techniques, which are of fundamental importance to achieve good performance and high reproducibility. This paper reviews the state-of-art fabrication techniques for the on-chip integration of 2D materials. First, an overview of the material properties and on-chip applications of 2D materials is provided. Second, different approaches used for integrating 2D materials on chips are comprehensively reviewed, which are categorized into material synthesis, on-chip transfer, film patterning, and property tuning / modification. Third, the methods for integrating 2D van der Waals heterostructures are also discussed and summarized. Finally, the current challenges and future perspectives are highlighted.

The exfoliation of graphene has opened a new frontier in material science with a focus on 2D materials. The unique thermal, physical and chemical properties of these materials have made them one of the choicest candidates in novel mechanical and nano-electronic devices. Notably, 2D materials such as graphene, MoS2, WS2, h-BN, and Black Phosphorus have shown outstanding lowest frictional coefficients and wear rates, making them attractive materials for high-performance nano-lubricants and lubricating applications. The objective of this work is to provide a comprehensive overview of the most recent developments in the tribological potentials of 2D materials. At first, the essential physical, wear, and frictional characteristics of the 2D materials including their production techniques are discussed. Subsequently, the experimental explorations and theoretical simulations of the most common 2D materials are reviewed in regards to their tribological applications such as their use as solid lubricants and surface lubricant nano-additives. The effects of micro/nano textures on friction behavior are also reviewed. Finally, the current challenges in tribological applications of 2D materials and their prospects are discussed.

Sign language recognition technology can help people with hearing impairments to communicate with those who are hearing impaired. At present, with the rapid development of society, deep learning technology also provided certain technical support for sign language recognition work. In sign language recognition tasks, the use of traditional convolutional neural networks to extract spatio-temporal features from sign language videos suffers from insufficient feature extraction, resulting in low recognition rates. Nevertheless, video-based sign language datasets are very large and require a lot of computational resources for training and generalisation must be ensured, which poses a challenge for recognition. In this paper, we have presented a video-based sign language recognition method based on resnet and lstm. As the number of network layers increases, the ResNet network can effectively solve the granularity explosion problem and obtain better time series features. We use the Resnet convolutional network as the backbone model. At the initialisation stage, we obtain sign language features using ResNet; then, the learned feature space is used as the input of LSTM network to obtain long sequence features. The experimental results show that the accuracy of the above model is better than the mainstream model, and it can effectively extract the spatio-temporal features in sign language videos and improve the recognition rate of sign language actions.

In recent years, the scientific and technological developments led to an explosion of available videos on the web, increasing the necessity of fast and effective video analysis and summarization. Video summarization methods aim to generate a synopsis by selecting the most informative parts of the video content. The user’s personal preferences, often involved in the expected results, should be taken into account in the video summaries. In this paper, we provide the first comprehensive survey on personalized video summarization relevant to the techniques and datasets used. In this context, we classify and review personalized video summary techniques based on the type of personalized summary, on criteria, on the video domain, on the source of information, on the time of summarization, and on the machine learning technique. Depending on the type of methodology used by the personalized video summarization techniques for the summary production process, we classify the techniques into five major categories, which are feature-based video summarization, key frame selection, shot selection-based approach, video summarization using trajectory analysis, and personalized video summarization using clustering. We also compare personalized video summarization methods and present 37 datasets used to evaluate personalized video summarization methods. Finally, we analyze opportunities and challenges in the field and suggest innovative research lines.

The use of video in education has become ubiquitous as technological developments have markedly improved the ability and facility to create, deliver and view videos. The concomitant pedagogical transformation has created a sense of urgency regarding how video may be used to advance learning. Initial reviews have suggested only limited potential for the use of video in higher education. More recently, a systematic review of studies on the effect of video use on learning in higher education, published in the prestigious Review of Educational Research, found, overall, effects to be positive. In the present paper we critique this study and provide some needed clarity to the state of research on learning via video in higher education. We reveal significant gaps in the study methodology and write-up and use a cognitive processing lens to critically assess and reanalyse study data. We found results of this study to be only applicable to learning requiring lower-level cognitive processing and conclude, consistent with prior research, learning benefits remain limited.

Predicting anomalies in manufacturing assembly lines is crucial for reducing time and labor costs and improving processes. For instance, in rocket assembly, premature part failures can lead to significant financial losses and labor inefficiencies. With the abundance of sensor data in the Industry 4.0 era, machine learning (ML) offers potential for early anomaly detection. However, current ML methods for anomaly prediction have limitations, with F1-measure scores of only 50% and 66% for prediction and detection, respectively. This is due to challenges like the rarity of anomalous events, scarcity of high-fidelity simulation data (actual data is expensive), and the complex relationships between anomalies not easily captured by traditional ML approaches. Specifically, these challenges relate to two dimensions of anomaly prediction: predicting when anomalies will occur and understanding the dependencies between them. This paper introduces a new method called Robust and Interpretable 2D Anomaly Prediction (RI2AP) designed to address both dimensions effectively. RI2AP is demonstrated on a rocket assembly simulation, showing up to a 30-point improvement in F1 measure compared to current ML methods. This highlights its potential to enhance automated anomaly prediction in manufacturing. Additionally, RI2AP includes a novel interpretation mechanism inspired by a causal-influence framework, providing domain experts with valuable insights into sensor readings and their impact on predictions. Finally, the RI2AP model is deployed in a real manufacturing setting for assembling rocket parts. Results and insights from this deployment demonstrate the promise of RI2AP for anomaly prediction in manufacturing assembly pipelines.

Convolutional Neural Networks (CNNs) present drawbacks for modeling geometric transformations, such as scaling and rotation, caused by the convolution operation’s locality. Deformable convolution (DCON), a mechanism that substitutes standard convolution, increasing the receptive field to capture relevant features, is a promising approach to solve this drawback and improve the robustness of CNNs. However, the optimal way to replace the standard convolution with its deformable counterpart in a CNN model is unclear. In this study, we clarify this aseveration by conducting several experiments using deformable convolutions applied in the layers that conform a small four-layer CNN model. We also use deformable convolutions on the four-layers of several ResNet CNNs with depths 18, 34, 50, and 101. The models were tested in binary balanced classes with 2D data for image classification: Cats & Dogs, EyesPACS, Spyders & Chickens, and Shapes. After this testing, we evaluated DCON in 3D data for action recognition: UCF101 and Human2 (a dataset we compiled to control movement, clothing and background). The contribution of this research lies in a guideline to use DCON. It can be summarized as follows: if DCON is used on the first layers of the proposal of model (with simple features), the computational resources expressed as the quantity of Flops will tend to increase and produce bigger misclassification than the standard CNN. However, if the DCON is used at the end layers, the quantity of Flops used in the training and testing will decrease, and the classification accuracy will improve by up to 20% about the base model. Moreover, it gains robustness when using deformable convolutions because it can adapt to the region of interest. Also, the best kernel size of the DCON is three. It showed better results than size five. In the last case, the quantity of Flops increase quadratically, but their performance does not increase significantly. With these results, we propose a guideline to use the DCON and contribute to understanding the impact of DCON on the robustness of CNNs.

Huge-scale video surveillance systems have become essential in crime prevention and situation recording. Traditional surveillance systems relied on human monitoring of video streams, which often led to errors and difficulties in understanding events. Furthermore, locating specific scenes within recorded videos required extensive human investigation. To overcome these challenges of inefficiency, inconvenience, and potential risks, we propose an intelligent analysis scheme that utilizes abnormal behavior recognition and metadata retrieval algorithms to replace human monitoring. The proposed method consists of three stages: i) metadata generation through object detection and tracking, ii) abnormal behavior recognition, and iii) SQL-based metadata retrieval. By incorporating specific information such as object color and aspect ratio, our technique enhances the usability of retrieval. Moreover, our abnormal behavior recognition module demonstrates robust classification capabilities for activities such as pushing, violence, falling, and crossing barriers. The proposed method can be seamlessly deployed on both edge cameras and analysis servers, making it adaptable to various surveillance setups. This approach revolutionizes the traditional surveillance paradigm, enabling more efficient, reliable, and secure video monitoring and analysis.

We show that the entropy or information flow of a gravitational system constrains the dependence of gravitational force on radial distance r which for very large r is equivalent to gravity in two dimensions. This explains the "origin" of dark matter and provides a natural solution to the problem of flat rotation curves of galaxies at very large distances and a larger deflection angle for a gravitational lens.

Video quality assessment (VQA) plays an important role in video applications for quality evaluation and resource allocation. It aims to evaluate the video quality consistent with the human perception. In this letter, a hierarchical gradient similarity based VQA metric is proposed inspired by the structure of the primate visual cortex, in which visual information is processed through sequential visual areas. These areas are modeled with the corresponding measures to evaluate the overall perceptual quality. Experimental results on the LIVE database show that the proposed VQA metric significantly outperforms the state-of-the-art VQA metrics.

Informational (Shannon) measures of symmetry are introduced and analyzed for the patterns built of 1D and 2D shapes. The informational measure of symmetry Hsym (G) characterizes the an averaged uncertainty in the presence of symmetry elements from the group G in a given pattern; whereas the Shannon-like measure of symmetry Ωsym (G) quantifies averaged uncertainty of appearance of shapes possessing in total n elements of symmetry belonging to group G in a given pattern. Hsym(G1)=Ωsym(G1)=0 for the patterns built of irregular, non-symmetric shapes. Both of informational measures of symmetry are intensive parameters of the pattern and do not depend on the number of shapes, their size and area of the pattern. They are also insensitive to the long-range order inherent for the pattern. Informational measures of symmetry of fractal patterns are addressed. The mixed patterns including curves and shapes are considered. Time evolution of the Shannon measures of symmetry is treated. The close-packed and dispersed 2D patterns are analyzed.

In recent years, many algorithms based on end-to-end deep networks have been proposed to deal with the target detection problem of videos. However, the deep network models usually consume a lot of computing resources during the procedure of analysis of videos with complex dynamic backgrounds. In this paper, a new method of object detection based on information theory is presented. Firstly, each frame in a video is converted into an effective information map by using the Harris corner detection method. Secondly, the sensitive areas in the frame are extracted by using the context information and the effective information maps of the consecutive video frames. The sensitive areas in the video frame are the candidate areas where the target objects would be appeared at high probabilities. Thirdly, the information entropy features of each sensitive area are extracted to form the feature matrix, based on which, an SVM model is trained for selecting the target areas from the sensitive areas. Finally, the locations of the objects are detected based on the target areas in the video with a complex dynamic background. As a lightweight video detection framework, the method presented in this paper can save a lot of computing resources. Experimental results show that this method can achieve good results in the benchmark of CDnet 2014.

In this paper, we present a general version of polygonal fitting problem called Unconstrained Polygonal Fitting (UPF). Our goal is to represent a given 2D shape S with an N-vertex polygonal curve P with a known number of vertices, so that the Intersection over Union (IoU) metric between S and P is maximized without any assumption or prior knowledge of the object structure and the location of the N-vertices of P that can be placed anywhere in the 2D space. The search space of the UPF problem is a superset of the classical polygonal approximation (PA) problem, where the vertices are constrained to belong in the boundary of the given 2D shape. Therefore, the resulting solutions of the UPF may better approximate the given curve than the solutions of the PA problem. For a given number of vertices N, a Particle Swarm Optimization (PSO) method is used to maximize the IoU metric, which yields almost optimal solutions. Furthermore, the proposed method has also been implemented under the equal area principle so that the total area covered by P is equal to the area of the original 2D shape to measure how this constraint affects IoU metric. The quantitative results obtained on more than 2,800 2D shapes included in two standard datasets quantify the performance of the proposed methods and illustrate that their solutions outperform baselines from the literature.

As a rapidly expanding family of two-dimensional (2D) materials, MXenes have recently gained considerable attention due to their appealing properties. Here, by developing a solution-based coating method that enables transfer-free and layer-by-layer film coating, we investigate the layer-dependent nonlinear optical absorption of Ti₃C₂T_x films ‒ an important member of the MXene family. By using the Z-scan technique, we characterize the nonlinear absorption of the prepared MXene films consisting of different numbers of monolayers. The results show that there is a strong and layer-dependent nonlinear absorption behavior, transitioning from revisable saturable absorption (RSA) to saturable absorption (SA) as the layer number increases from 5 to 30. Notably, the nonlinear absorption coefficient β varies significantly within this range, changing from ~7.13 × 10² cm/GW to ~-2.69 × 10² cm/GW. We also characterize the power-dependent nonlinear absorption of the MXene films at various incident laser intensities, and a decreasing trend in β is observed for increasing laser intensity. These results reveal the intriguing layer-dependent nonlinear optical properties of 2D MXene films, highlighting their versatility and potential for implementing high-performance nonlinear photonic devices.

The optoelectronic properties of free standing monolayer (ML) hexagonal boron nitride (h-BN) is investigated for potential solar energy conversion applications using the Density Functional Theory (DFT) full potential linearized augmented plane wave (FP-LAPW) method. In addition, the bulk optical properties have also been calculated for the sake of comparison. The dielectric functions, optical conductivities and the optical constants are evaluated using the relaxed structures from electronic total energy pseudopotential calculations. The results reinforce previous research on h-BN DUV optoelectronics and demonstrate the suitability of its use as a component in deep ultraviolet (DUV) and energy conversion devices.

An ability of different molecular potentials to reproduce the properties of 2D molybdenum disulphide polymorphs is examined. Structural and mechanical properties, as well as phonon dispersion of the 2H, 1T and 1T’ single-layer MoS2 (SL MoS2) phases, were obtained using density functional theory (DFT) and molecular statics calculations (MS) with Stillinger-Weber, REBO, SNAP, and ReaxFF interatomic potentials. Quantitative systematic comparison and discussion of the results obtained are reported.

Dynamic adaptive video streaming over HTTP (DASH) plays a crucial role in video transmission across networks. Traditional adaptive bitrate (ABR) algorithms adjust the quality of video segments based on network conditions and buffer occupancy. However, these algorithms rely on fixed rules within a complex environment, making it challenging to achieve optimal decisions considering the overall context. In this paper, we propose a novel Deep Reinforcement Learning-based approach for streaming DASH, focusing on maintaining consistent perceived video quality throughout the streaming session to enhance user experience. Our approach optimizes the Quality of Experience (QoE) by dynamically controlling the quality distance factor between consecutive video segments. We evaluate this approach through a simulation model that encompasses diverse wireless network environments and various video sequences. Additionally, we compare our proposed approach with state-of-the-art methods. The experimental results demonstrate significant improvements in QoE, ensuring users enjoy stable, high-quality video streaming sessions.

In Mexico, the incorporation of deaf people into education has been lacking since only 14% of the deaf population in the age group between 3 and 29 years access education with the support of a hearing aid. Additionally, those who have been incorporated frequently face inappropriate educational strategies which poorly develop the use of Mexican Sign Language (MSL) and therefore academical success and opportunities for insertion in the workplace are difficult. This research explores a novel mexican sign language lexicon video dataset containing the dynamical gestures most frequently used by MSL. Each gesture consists of a set of different versions of videos under uncontrolled conditions. MX-ITESO-100 data set is composed of a lexicon of 100 gestures and 5,000 videos from three participants with different grammatical elements. Additionally, the data set is evaluated in a two-step neural network model with an accuracy greater than 99%. and thus serves as a benchmark for future training of machine learning models in computer vision systems. Finally, this research provides an inclusive environment within society and organizations in particular for people with hearing impairment.

Non-invasive heart rate (HR) monitoring is important in clinical settings as it plays a critical role in diagnosing a range of health conditions and assessing well-being. Presently, the gold standards for HR measurement are all based on sensors which require skin contact. Apart from inconvenience, contact sensors have proven problematic in certain scenarios – they cannot be used when mechanical isolation of the patient is imperative (burn victims, patients with shaky hands and feet), cause skin damage to premature babies in the ICU and increase the risk of spreading infections. Non-contact HR monitoring using a camera has been recently shown to be a viable alternative. It is now possible to record cardiac-synchronous blood volume variations from facial videos of human subjects under ambient lighting. These variations produce corresponding changes in skin reflectance which can be extracted as a raw reflectance photoplethysmography (rPPG) signal and processed to reveal HR. In this project, an algorithmic framework for webcam-based HR detection was successfully implemented in MATLAB. The investigation was based on 100 self-captured videos (dark-skinned subject) and 48 videos (from 12 subjects, all but one fair-skinned) obtained from COHFACE – an online database of facial videos and corresponding physiological signals. While the performance metrics (mean error, SNR) of the rPPG signals obtained from the self-captured videos were poor (best case mean error of 22%), they were good enough to demonstrate the success of the implementation. The poor results were primarily imputed to skin tone as rPPG SNR is known to be particularly low for dark tones. The results of the COHFACE videos were far superior, with mean error ranging from 3% to 15% (among 8 different rPPG signals) and 0% to 9% under ambient and dedicated lighting, respectively. This investigation sets the foundation for future research directed at optimizing rPPG performance metrics for dark-skinned subjects.

In this paper, we propose a robust video understanding model for activity recognition by learning the actor’s pair-wise correlations and relational reasoning, exploiting spatial and temporal information. In order to measure the similarity between the pair appearances and construct an actor relations map, the Zero Mean Normalized Cross-Correlation (ZNCC) and the Zero Mean Sum of Absolute Differences(ZSAD) is proposed to allow the Graph Convolution Network (GCN) to learn how to distinguish group actions. We recommend that MNASNet be used as the backbone to retrieve features. Experiments show a 38.50% and 23.7% reduction in training time in the 2-stage training process along with a 1.52% improvement in accuracy against traditional methods.

Exponential increase in mobile video delivery will continue with the demand for higher resolution, multi-view and large-scale multicast video services. Novel fifth generation (5G) 3GPP New Radio (NR) standard will bring a number of new opportunities for optimizing video delivery across both 5G core and radio access network. One of the promising approaches for video quality adaptation, throughput enhancement and erasure protection is the use of packet-level random linear network coding (RLNC). In this work, we discuss the integration of RLNC into the 5G NR standard, building upon the ideas and opportunities identified in 4G LTE. We explicitly identify and discuss in detail novel 5G NR features that provide support for RLNC-based video delivery in 5G, thus pointing out to the promising avenues for future research.

High Efficiency Video Coding (HEVC) uses an 8-point filter and a 7-point filter, which are based on the discrete cosine transform (DCT), for the 1/2-pixel and 1/4-pixel interpolations, respectively. In this paper, discrete sine transform (DST)-based interpolation filters (IF) are proposed. The first proposed DST-based IFs (DST-IFs) use 8-point and 7-point filters for the 1/2-pixel and 1/4-pixel interpolations, respectively. The final proposed DST-IFs use 12-point and 11-point filters for the 1/2-pixel and 1/4-pixel interpolations, respectively. These DST-IF methods are proposed to improve the motion-compensated prediction in HEVC. The 8-point and 7-point DST-IF methods showed average BD-rate reductions of 0.7% and 0.3% in the random access (RA) and low delay B (LDB) configurations, respectively. The 12-point and 11-point DST-IF methods showed average BD-rate reductions of 1.4% and 1.2% in the RA and LDB configurations for the Luma component, respectively.

Rectenna is the key component in radio-frequency circuits for receiving and converting electromagnetic waves into direct current. However, it is very challenging for the conventional semiconductor diode switches to rectify high-frequency signals for 6G telecommunication (>100 GHz), medical detection (>THz) and rectenna solar cells (optical frequencies). Such a major challenge can be resolved by replacing the conventional semiconductor diodes with tunneling diodes as the rectenna switches. In this work, metal-insulator-metal (MIM) tunneling diodes based on 2D insulating materials were designed, and their performance was evaluated using a comprehensive simulation approach which includes density-function-theory simulation of 2D insulator materials, modeling of the electrical characteristics of tunneling diodes, and circuit simulation for rectifiers. It is found that novel 2D insulators such as monolayer TiO2 can be obtained by oxidizing sulfur-metal layered materials. The MIM diodes based on such insulators exhibit fast tunneling and excellent current rectifying properties. Such tunneling diodes effectively convert the received high-frequency electromagnetic waves into direct current.

The efficiency of the MOND theory of Mordehai Milgrom might be unrelated to distance, but instead connected to flatness of galaxies and the fact that the large scale distribution of matter is essentially two-dimensional. A combination of the pushing gravity paradigm with essential flatness of large luminous matter clusters leads to an approximate MOND theory which would allow to avoid the dark matter hypothesis.

We calculate the sound velocity and the damping rate of the collective excitations of a 2D fermionic superfluid in a non-perturbative manner. Specifically, we focus on the Anderson-Bogoliubov excitations in the BEC-BCS crossover regime, as these modes have a soundlike dispersion at low momenta. The calculation is performed within the path integral formalism and the Gaussian pair fluctuation approximation. From the action functional, we obtain the propagator of the collective excitations and determine their dispersion relation by locating the poles of this propagator. We find that there is only one kind of collective excitation, which is stable at $T=0$ and has a sound velocity of $v_{F}/\sqrt{2}$ for all binding energies, i.e. throughout the BEC-BCS crossover. As the temperature is raised, the sound velocity decreases and the damping rate shows a non-monotonous behavior: after an initial increase, close to the critical temperature $T_{C}$ the damping rate decreases again. In general, higher binding energies provide higher damping rates. Finally, we calculate the response functions and propose that they can be used as another way to determine the sound velocity.

The need for cross-modal retrieval (CMR) among users is growing because of the swift advancements in computer vision and natural language processing. Promoting home operating systems is greatly aided by the openKylin home operating system. It is focused on enhancing the functionality of the operating system with safe and dependable operating technologies. Practical implications abound for integrating computer vision research into home operating systems. A multimodal retrieval approach based on openKylin is presented to improve the usability of text search graphs, audio, and video. The overview of pertinent domestic and international research is the main topic of this article. This technological advancement. It then offers details on the design, implementation procedure, and final implementation outcomes for demonstration. The works of natural operations show that this strategy has excellent accuracy and performance.

The falling cost of cameras, the advancement of AI based computer vision algorithms, and powerful hardware accelerators for deep learning have enabled wide-spread deployment of surveillance cameras with the ability to automatically analyze streaming video feeds to detect events of interest. While streaming video analytics is currently largely done in the cloud, edge computing has emerged as a pivotal component due to its advantages of low latency, reduced bandwidth, and enhanced privacy. However, a distinct gap persists between the state-of-the-art computer vision algorithms, and successful practical implementation of edge-based streaming video analytics systems. This paper presents a comprehensive review of more than 30 research papers published over the last 6 years on edge video analytics systems. The papers are analyzed across 17 distinct dimensions. Unlike prior reviews, we examine each system holistically, identifying their strengths and weaknesses in diverse implementations. Our findings suggest that certain critical topics necessary for the practical realization of edge video analytics systems are not sufficiently addressed in current research. Based on these observations, we propose research trajectories across short, medium, and long term horizons. Additionally, we explore trending topics in other computing areas that can significantly impact the field of edge video analytics.

With the proliferating of video surveillance system deployment and related applications, real-time video analysis is very critical to achieve intelligent monitoring, autonomous driving, etc. It is non-trivial to achieve high accuracy and low latency video stream analysis through the traditional cloud computing. In this paper, we propose a non-orthogonal multiple access (NOMA) based edge real-time video analysis framework with one edge server (ES) and multiple user equipments (UEs). A cost minimization problem composed of delay, energy and accuracy is formulated to improve the QoE of UEs. In order to efficiently solve this problem, we propose the joint video frame resolution scaling, task offloading, and resource allocation algorithm based on the Deep Q-Learning Network (JVFRS-TO-RA-DQN), which effectively overcomes the sparsity of the single-layer reward function and accelerates the training convergence speed. JVFRS-TO-RA-DQN consists of two DQN networks to reduce the curse of dimension, which respectively select the offloading and resource allocation action, the resolution scaling action. Experimental results show that JVFRS-TO-RA-DQN can effectively reduce the cost of transmission and computation, and have better performance in convergence compared to other baseline.

The purpose of this study was to detect mind-wandering experienced by pre-service teachers while learning video lecture on physics. The lecture was videotaped and consisted of a live lecture in a classroom. The lecture was about Gauss's law on physics. We investigated whether oculomotor data and eye movements could be used as a marker to indicate the learner’s mind-wandering. Each data was collected in a study in which 24 pre-service teachers (16 females and 8 males) reported self-caught mind-wandering while learning physics video lecture during30 minutes. A Tobii Pro Spectrum (sampling rate: 300Hz) was used to capture their eye-gaze during learning Gauss's law course video. After watching video lecture, we interviewed pre-service teachers about their mind-wandering experience. We first used the self-caught method to capture the mind-wandering timing of pre-service teachers while learning from video lectures. We detected more accurate mind-wandering segments by comparing fixation duration and saccade count. We investigated two types of oculomotor data (blink count, pupil size) and nine eye movements (average peak velocity of saccades; maximum peak velocity of saccades; standard deviation of peak velocity of saccades; average amplitude of saccades; maximum amplitude of saccades; total amplitude of saccades; saccade count/s; fixation duration; fixation dispersion). The result was that the blink count could not be used as a marker for mind-wandering during learning video lectures among them (oculomotor data and eye movements), unlike previous literatures. Based on the results of this study, we identified elements that can be used as mind-wandering markers while learning from video lectures that are similar to real classes, among the oculomotor data and eye movement mentioned in previous literatures. Also, we found that most participants focused on past thoughts and felt unpleasant after experiencing mind-wandering through interview analysis.

In the context of video background-foreground separation, we propose a compressive online Robust Principal Component Analysis (RPCA) with optical flow that separates recursively a sequence of video frames into foreground (sparse) and background (low-rank) components. This separation method can process per video frame from a small set of measurements, in contrast to conventional batch-based RPCA, which processes the full data. The proposed method also leverages multiple prior information by incorporating previously separated background and foreground frames in an n-l₁ minimization problem. Moreover, optical flow is utilized to estimate motions between the previous foreground frames and then compensate the motions to achieve higher quality prior foregrounds for improving the separation. Our method is tested on several video sequences in different scenarios for online background-foreground separation given compressive measurements. The visual and quantitative results show that the proposed method outperforms other existing methods.

Context: A clinical video telehealth (CVT) program was implemented improve access and quality of dementia care to patients and their caregivers in rural areas. The program was offered as part of an established dementia clinic/geriatric primary care clinic in collaboration with five community-based outpatient clinics (CBOC’s) affiliated with the Tennessee Valley Healthcare System (TVHS) in middle Tennessee. Telehealth support was provided by a physician – social worker team visit. Methods: Telehealth training and equipment were provided to clinic personnel, functioning part-time with other collateral clinical duties. Patients and caregivers were referred by primary care providers and had an average of 1 to 2 CVT encounters originating at their local CBOC lasting 20 to 30 minutes. Clinical characteristics and outcomes of patients and caregivers receiving CVT support were collected by retrospective electronic medical record (EMR) review. Results: Over a 3-year period 45 CVT encounters were performed on patient-caregiver pairs, followed for a mean of 15 (1-36) months. Some 80% patients had dementia confirmed and 89% of these had serious medical comorbidities, took an average of 8 medications, and resided at a distance of 103 (76-148) miles from the medical center. Dementia patients included 33% with late stage dementia, 25% received additional care from a mental health provider, 23% took antipsychotic medications, 19% transitioned to a higher level of care, and 19% expired an average of 10.2 months following consultation. Caregiver distress was present in 47% of family members. Consult recommendations included 64% community-based long-term care services and supports (LTSS), 36% medications, and 22% further diagnostic testing. Acceptance of the CVT encounter was 98%, with 8770 travel miles saved. Conclusion: CVT is well received and may be helpful in providing dementia care and supporting dementia caregivers to obtain LTSS for high-need older adults in rural areas.

Efficient heat management and control in optical devices, facilitated by advanced thermo-optic materials, is critical for many applications such as photovoltaics, thermal emitters, mode-locked lasers, and optical switches. Here, we investigate the thermo-optic properties of 2D graphene oxide (GO) films by precisely integrating them onto microring resonators (MRRs) with control over the film thicknesses and lengths. We characterize the refractive index, extinction coefficient, thermo-optic coefficient, and thermal conductivity of for the GO films with different layer numbers and degrees of reduction, including reversible reduction and enhanced optical bistability induced by photo-thermal effects. Experimental results show that the thermo-optic properties of 2D GO films vary widely with the degree of reduction, with significant polarization anisotropy, enabling efficient polarization sensitive devices. The versatile thermo-optic response of 2D GO substantially expands the scope of functionalities and devices that can be engineered, making it promising for a diverse range of thermo-optic applications.

Over the past two decades, covalent organic frameworks (COFs) have become the most widely studied porous crystalline materials. Its specific physical and chemical properties are determined by the arrangement of atoms (crystal structure). Therefore, the determination of its structure is arguably the most important characterization step for COFs. Although single crystal X-ray diffraction (SCXRD) is the most widely used method for structure determination, the size of COF crystals is too small, or their crystal quality is so poor that confirmation of their structure is limited to lattice fringes by transmission electron microscopy (TEM). At present, many 2D-COFs have clear PXRD patterns, but not all 2D-COFs can obtain specific lattice fringes. This severely hinders the development of the COF field. Here, we discover the lattice shrinkage behavior of COFs under electron beam irradiation by comparing the lattice fringes of 2D-COFs under different conditions. By comparing the lattice fringes of TAPT-TFPT COF at room temperature and under liquid nitrogen freezing conditions, we found that the lattice fringes are in good agreement with the Powder X-ray diffraction (PXRD) and theoretical values of COF (2.213 nm) under freezing conditions, however, the lattice fringe spacing is only 1.656 nm at room temperature. The discovery not only provides new insights into the TEM characterization of COFs, but also further expands the range of crystalline COF materials.

Spike shape and morphometric characteristics are among the key characteristics of cultivated cereals associated with their productivity. Identification of the genes controlling these traits requires morphometric data at harvesting and analysis of numerous plants, which could be automatically done using technologies of digital image analysis. A method for wheat spike morphometry utilizing 2D image analysis is proposed. Digital images are acquired in two variants: a spike on a table (one projection) or fixed with a clip (four projections). The method identifies spike and awns in the image and estimates their quantitative characteristics (area in image, length, width, circularity, etc.). Section model, quadrilaterals, and radial model are proposed for describing spike shape. Parameters of these models are used to predict spike shape type (spelt, normal, or compact) by machine learning. The mean error in spike density prediction for the images in one projection is 4.61 (~18%) versus 3.33 (~13%) for the parameters obtained using four projections.

Spike shape and morphometric characteristics are among the key characteristics of cultivated cereals associated with their productivity. Identification of the genes controlling these traits requires morphometric data harvesting and analysis for numerous plants, which is automatable using technologies of digital image analysis. A method for wheat spike morphometry utilizing 2D image analysis is proposed. Digital images are acquired in two variants: a spike on a table (one projection) or fixed with a clip (four projections). The method identifies spike and awns in the image and estimates their quantitative characteristics (area in image, length, width, circularity, etc.). Models of sections, quadrilaterals, and radial model are proposed for describing spike shape. Parameters of these models are used to predict spike shape type (spelt, normal, or compact) by machine learning. The mean error in spike density prediction for the images in one projection is 4.61 (~18%) versus 3.33 (~13%) for the parameters obtained using four projections. F1 measure in automated spike classification into three types is 0.78 using logistic regression (one projection) and 0.85 using random forest method (four projections). The proposed method is implemented in Java; examples of images and user guide are available at http://wheatdb.org/werecognizer.

The Voronoi entropy is a mathematical tool for quantitative characterization of the orderliness of points distributed on a surface. The tool is useful to study various surface self-assembly processes. We provide the historical background, from Kepler and Descartes to our days, and discuss topological properties of the Voronoi tessellation, upon which the entropy concept is based, and its scaling properties, known as the Lewis and Aboav-Weaire laws. The Voronoi entropy has been successfully applied to recently discovered self-assembled structures, such as patterned micro-porous polymer surfaces obtained by the breath figure method and levitating ordered water micro-droplet clusters.

Well-being is one of the pillars of positive psychology, which is known to have positive effects not only on the personal and professional lives of individuals, but also on teams and organizations. Understanding and promoting individual well-being is essential for staff health and long-term success, but current tools for assessing subjective well-being rely on time-consuming surveys and questionnaires, which limit the possibility of providing the real-time feedback needed to raise awareness and change individual behavior. This paper proposes a framework for understanding the process of non-verbal communication in teamwork, using video data to identify significant predictors of individual well-being in teamwork. It relies on video acquisition technologies and state-of-the-art artificial intelligence tools to extract individual, relative, and environmental characteristics from panoramic video. Statistical analysis is applied to each time series, leading to the generation of a dataset of 125 features, which are then linked to PERMA (Positive Emotion, Engagement, Relationships, Meaning, and Accomplishments) surveys developed in the context of positive psychology. Each pillar of the PERMA model is evaluated as a regression or classification problem using machine learning algorithms. Our approach was applied to a case study, where 80 students collaborated in 20 teams for a week on a team task in a face-to-face setting. This enabled us to formulate several hypotheses identifying factors influencing individual well-being in teamwork. These promising results point to interesting avenues for research, for instance fusing different media for the analysis of individual well-being in teamwork.

In industry 4.0 era, video applications such as surveillance visual systems, video conferencing, or video broadcasting have been playing a vital role. In these applications, for manipulating and tracking objects in decoded video, the quality of decoded video should be consistent because it largely affects to the performance of the machine analysis. To cope with this problem, we propose a novel perceptual video coding (PVC) solution in which a full reference quality metric named Video Multimethod Assessment Fusion (VMAF) is employed together with a deep convolutional neural network (CNN) to obtain the consistent quality while still achieving the high compression performance. First of all, to achieve the consistent quality requirement, we propose a CNN model with an expected VMAF as input to adaptively adjust the quantization parameters (QP) for each coding block. Afterwards, to increase the compression performance, a Lagrange coefficient of Rate-Distortion optimization (RDO) mechanism is adaptively computed under Rate-QP and Quality-QP models. Experimental results show that the proposed PVC has achieved two targets simultaneously: the quality of video sequence is kept consistently with an expected quality level and the bit rate saving of the proposed method is higher than traditional video coding standards and relevant benchmark, notably with around 10% bitrate saving in average.

Along with the popularity of the Internet, people are exposed to more and more ways of micro-videos, and a huge amount of micro-video data has emerged. micro-videos have gradually become the Internet content preferred by the public, and a large number of micro-video apps have also emerged, such as Tiktok and Kwai. Intelligent classification and mining of micro-videos can greatly enhance user experience, improve business operation efficiency and enhance user experience. Through deep intelligent analysis and mining of micro-videos, important information in micro-videos can be extracted to provide an important basis for beautifying videos, content appreciation, video recommendation, content search, etc. In the past, content understanding for short videos often used human work annotation, but in recent years, with the great success of deep convolutional neural networks in image recognition, short video content understanding based on this method has gradually developed. Nowadays, most recognition algorithms extract the feature representation of each frame independently and then fuse them. However, while extracting the feature representation, some low-level semantic features are lost, which makes the algorithm unable to accurately distinguish the category of the video. At present, the algorithm of micro-video recognition based on deep learning has surpassed the iDT algorithm, making these traditional methods fade out of people’s view. In this paper according to the micro-video classification task, a new network model is proposed to concatenate features of each modality into the overall features of various modalities through the network, and then fuse the various modal features with the attention mechanism to obtain the whole micro-video features, which will be used for classification. In order to verify the effectiveness of the algorithm proposed in this paper, experiments are conducted in the public dataset, and it is shown the effectiveness of our model.

Video super-resolution, which utilizes the relevant information of several low-resolution frames to generate high-resolution images, is a challenging task. One possible solution called sliding window method tries to divide the generation of high-resolution video sequences into independent sub-tasks, and only adjacent low-resolution images are used to estimate the high-resolution version of the central low-resolution image. Another popular method named recurrent algorithm proposes to utilize not only the low-resolution images but also the generated high-resolution images of previous frames to generate the high-resolution image. However, both methods have some unavoidable disadvantages. The former one usually leads to bad temporal consistency and requires higher computational cost while the latter method always can not make full use of information contained by optical flow or any other calculated features. Thus more investigations need to be done to explore the balance between these two methods. In this work, a bidirectional frame recurrent video super-resolution method is proposed. To be specific, a reverse training is proposed that the generated high-resolution frame is also utilized to help estimate the high-resolution version of the former frame. With the contribution of reverse training and the forward training, the idea of bidirectional recurrent method not only guarantees the temporal consistency but also make full use of the adjacent information due to the bidirectional training operation while the computational cost is acceptable. Experimental results demonstrate that the bidirectional super-resolution framework gives remarkable performance that it solves the time-related problems when the generated high-resolution image is impressive compared with recurrent-based video super-resolution method.

In this paper, we propose a novel approach of video skimming by exploiting the fusion of video temporal information and keyword information representation extracted from multi-model video information including audio, text and visual indices. In addition, we introduce the brand-safe filtering and sentiment analysis in order to only reserve the user-friendly content in the video skim. In the experiment by using the videos from YouTube-8M dataset, we have proved that the semantic conservation in the video skim from the proposed approach highly outperforms the approaches by only partial information of the video in conserving the semantic content of the video.

The operations of digitization, transmission and storage of medical data, particularly images require increasingly effective encoding methods not only in terms of compression ratio and flow of information but also in terms of visual quality. At first, there was DCT (discrete cosine transform) then DWT (discrete wavelet transform) and their associated standards in terms of coding and image compression. After that, the 2nd generation wavelets seeks to be positioned and confronted to the image and video coding methods currently used. It is in this context that we suggested a method combining bandelets and SPIHT (set partitioning in hierarchical trees) algorithm. There are two main reasons for our approach: the first lies in the nature of the bandelet transform to take advantage by capturing the geometrical complexity of the image structure. The second reason stems in the suitability of encoding the bandelet coefficients by the SPIHT encoder. Quality measurements shows that in some cases (for low bit rates) the performances of the proposed coding compete with the well-established ones and opens up new application prospects in the field of medical imaging.

3D cell cultures have improved the evaluation of drugs for cancer therapy, due to their high similarity to solid tumors. In melanoma, autophagy appears to show a dual role depending on the progression of the disease. p62 protein has been proposed for the evaluation of autophagic flux since its expression is an indicator of the state of autophagy. Pentoxifylline (PTX) and Norcantharidin (NCTD) are drugs that have been shown to have anticancer effects in various types of cancer. In this work, B16F1 mouse melanoma cell line was used, from which two-dimensional (2D) monolayer cultures and three-dimensional (3D) organoids were carried out using the hanging drop technique. The expression of p62 was determined by western blot and immunofluorescences. Our results indicate that pentoxifylline reduces p62 expression in both types of culture. While Norcantharidin increases its expression in 3D cultures at 24 h. Therefore, these drugs could have a potential therapeutic use for the regulation of autophagy in melanoma, depending on the state of evolution of the disease.

Compared to other 2D materials, MBenes are at an early stage in both experimental and theoretical approaches. However, the wide range of possible 2D structures leads to novel and challenging properties and their consequent applications. From all the possible stoichiometries, we have performed a theoretical study of orthorhombic and hexagonal M2B2 MBenes in the framework of the Density Functional Theory. We have found that both symmetries of Cr2B2, Fe2B2, and Zr2B2 show a metallic behavior and could be grown under certain conditions, as they are demonstrated to be dynamically stable. Moreover, the values of the magnetic moment, in specific ferromagnetic cases exceeding 2.5 μB/M2B2, make them suitable as robust 2D magnets. All our findings represent an important step in the understanding of MBenes and open several windows to future research in fields like energy conversion and storage, sensing, catalysis, biochemistry, or nanotechnology, among others.

This review focuses on Cu/TiO2 sequentially and Cu-TiO2 co-sputtered catalytic/photocatalytic surfaces leading to bacterial inactivation discussing their stability, synthesis, adhesion and antibacterial kinetics. The intervention of TiO2, Cu and the synergic effect of Cu and TiO2 on films prepared by a colloidal approach and other techniques is also reviewed leading to bacterial inactivation. Processes in aerobic media and anaerobic media leading to bacterial loss of viability on multidrug resistant (MDR) pathogens, Gram-negative (-) and Gram-positive(+) bacteria are described. Insight is provided for the interfacial charge transfer mechanism under solar irradiation occurring between TiO2 and Cu. surface properties of 2D TiO2/Cu and TiO2-Cu films are correlated with the bacterial inactivation kinetics observed in the dark and under light. The intervention of these antibacterial sputtered surfaces in health-care facilities leading to MRSA-isolates is described in the dark and under the actinic light. The synergic intervention of the Cu and TiO2 films leading to bacterial inactivation prepared by direct current magnetron sputtering (DCMS), pulsed direct current magnetron sputtering (DCMSP) and highly ionized pulse plasma magnetron sputtering (HIPIMS) is reported in a detailed way.

Elaborate sound design, including background music, ambient sounds (sounds describing the game world), and character sounds (sounds generated by the character’s actions), plays a pivotal role in modern videogames. However, the influence of these different types of sound on the player experience has not been extensively researched. This study examines the influence of these sound types on immersion, avatar identification, fun and perceived competence. In two experiments, participants played League of Legends in four different sound conditions. The first experiment revealed a non-significant trend in the effect of character sound on avatar identification. Ambient sounds, however, were limited in this experiment because the task restricted participants’ movement across the game map. Consequently, we adapted the task to allow for a wider variety of ambient sounds in the second experiment. Here, a significant impact of character sounds on immersion, avatar identification, and fun, was observed, as well as an interaction effect of character sounds and ambient sounds on fun. Furthermore, we observed a trend, though not statistically significant, suggesting that ambient sounds may influence the player’s sense of flow. These findings underline the distinct effects of different sound types and we discuss implications for the design of sound in video games.

The Covid-19 pandemic spreads in waves for a year and a half, despite significant worldwide efforts, the development of biochemical diagnostic methods and population vaccination. One of the reasons for the infection spread is the impossibility of early disease detection through biochemical diagnostics, since biochemical processes slowly develop in a body. At the same time, well known that behavioral characteristics of a person, measured based on reflex movements, are capable for inertialess assessment of psychophysiological parameters. Vibraimage technology is the method of head micromovements video processing by inter-frame difference accumulation and converting spatial and temporal characteristics of the inter-frame difference into behavioral and psychophysiological parameters. Here we shown that behavioral parameters measured by vibraimage changed during COVID-19 infection. The identification of changes signs in behavioral parameters detected by AI trained on patients and controls. The best diagnostic accuracy (higher 94%) obtained using instantaneous values of behavioral parameters measured with the following vibraimage settings: 10Hz frequency of basic measurements; 25 inter-frame difference accumulations and averaging the diagnostic results over period of at least 5 seconds. COVID-19 diagnoses by behavioral parameters showed earlier (5-7 days) detection of the disease compared to symptoms and positive results of biochemical RT-PCR testing. Proposed method for COVID-19 diagnosis indicates infected persons within 5 seconds video processing using standard television cameras (web, IP) and computers, allows mass testing/selftesting and will stop the pandemic spread. We assume that head micromovements analysis for diagnosis of various diseases is possible not only with the help of vibraimage technology. Further research of human head micromovement analysis will help stop the COVID-19 pandemic and will contribute to the development of new contactless and environmentally friendly methods for early diagnosis of diseases.

Video gamers can play to negate the psychological impact of stress (Pine et al., 2020), which may become problematic when users over-rely on the stress-relief potential of gaming. This study used a repeated-measures experimental design to investigate the relationships between stress, video gaming, and problematic video gaming behaviours in a convenience sample of 40 students at a UK university. Results indicated that positive affect increased and negative affect decreased, whilst a biological stress measure (Instantaneous Pulse Rate) also decreased after a short video gaming session (t(36) = 4.82, p < .001, d = 0.79). Results also suggest that video gaming can act as a short-term buffer against the physiological impact of stress. Further research should focus on testing individuals who have been tested for Gaming Disorder as opposed to a general population. Research could also utilise variations of the methodological framework used in this study to examine the intensity of a stress-relief effect under different social situations. The study’s findings in relation to published work are also discussed.

This paper presents a study of the 2D roughness profiles on a flat surface generated on a steel work piece, by ball nose end milling, with linear equidistant tool paths (pick-intervals). The milled surface exploration with a surface roughness tester (on pick and feed directions) produces usually 2D roughness profiles having periodical evolutions. These evolutions can be seen as time-dependent signals, describable as a sum of sinusoidal components (the wavelength of each component being regarded as a period). In order to detect a well approximated description of these components, two appropriate signal processing techniques are used in this work: first technique provides a direct mathematical (analytical) description and is based on computer aided curve (signal) fitting (more accurate), the second technique (providing an indirect and incomplete description) is based on the spectrum generated by fast Fourier transform (less accurate). This study can be seen as a way for a better understanding the interaction between the tool and the work piece or to achieve a mathematical description of the machined surface microgeometry in terms of roughness (e. g. its description being a collection of closely spaced 2D roughness profiles).

We experimentally demonstrate waveguide and microring resonator (MRR) polarizers by integrating 2D graphene oxide (GO) films onto silicon (Si) photonic devices. The 2D GO films with highly anisotropic light absorption are on-chip integrated with precise control over their thicknesses and sizes. Detailed measurements are performed for the fabricated devices with different GO film thicknesses, coating lengths, and Si waveguide widths. The results show that a maximum polarization-dependent loss (PDL) of ~17 dB is achieved for the hybrid waveguides, and the hybrid MRRs achieved a maximum polarization extinction ratio (PER) of ~10 dB. We also characterize the wavelength- and power-dependent response for these polarizers. The former demonstrates a broad operation bandwidth of over ~100 nm, and the latter verifies performance improvement enabled by photo-thermal changes in GO films. By fitting the experimental results with theoretical simulations, we find that the anisotropy in the loss of GO films dominates the polarization selectivity of these devices. These results highlight the strong potential of 2D GO films for realizing high-performance polarization selective devices in Si photonic platform.

Medical image segmentation is a critical step in various healthcare applications, aiding in diagnosis, treatment planning, and disease monitoring. In this study, we investigate the efficacy of a segmentation approach based on the 2D wavelet transform. Leveraging a dataset comprising 10 diverse medical images, we evaluate the performance of our segmentation method using three key metrics: accuracy, precision, and recall. Our findings demonstrate that the proposed approach enhances segmentation accuracy, offering promising results compared to existing methods. By harnessing the multi-resolution feature extraction capabilities of the 2D wavelet transform, our method achieves improved delineation of medical image structures, paving the way for more accurate and efficient healthcare interventions.

This study introduces an innovative optimization method to identify the optimal configuration of a sparse symmetric 2D array for applications in security, particularly multistatic imaging. Utilizing Genetic Algorithms (GA) in a sophisticated optimization process, the research focuses on achieving the most favorable antenna distribution while mitigating the common issue of secondary lobes in sparse arrays. The main objective is to determine the ideal configuration from specific design parameters, including hardware specifications such as number of radiating elements, minimum spacing, operating frequency range, and image separation distance. The study employs a cost function based on the the point spread function (PSF), the system response to a point source, with the goal of minimizing the secondary lobe levels and maximizing their separation from the main lobe. Advanced simulation algorithms based on Physical Optics (PO) are used to validate the presented methodology and results.

The increasing popularity of carbon-reinforced concrete (CRC) is attributed to its exceptional tensile properties, low density, no corrosion phenomenon, and remarkable flexibility, allowing it to be easily shaped into various forms. This research investigates the feasibility of using a special 2D Netzgitterträger (NetzGT) reinforcement system, featuring a net-shaped fabricated textile made of multiple diagonally offset rovings with overlapping edge strands, as a viable alternative to traditional steel reinforcement in concrete beams. This reinforcement is manufactured from carbon rovings with three different diagonal angles of 50⁰, 60⁰, and 70⁰ respectively. Laboratory experiments were conducted to assess the mechanical behavior of beams reinforced with the 2D NetzGT reinforcement. Bending and shear tests were performed on beams with varying numbers of overlapped edge roving and roving angles to evaluate the tensile capacity and failure characteristics of beams. The increase in the number of overlapped edge rovings led to a noticeable increase in the maximum tensile force. Tensile tests on strands were also performed with the increasing number of overlapped rovings to analyze their tensile strength. Additionally, single yarn pull-out tests were also conducted to examine the influence of the roving angle on the bond strength between the carbon textile roving and the concrete matrix

This paper presents a two-dimensional mathematical model of compound eye vision. Such a model is useful for solving navigation issues for autonomous mobile robots on the ground plane. The model is inspired by the insect compound eye that consists of ommatidia, which are tiny independent photoreception units, each of which combines a cornea, lens, and rhabdom. The model describes the planar binocular compound eye vision, focusing on measuring distance and azimuth to a circular feature with an arbitrary size. The model provides a necessary and sufficient condition for the visibility of a circular feature by each ommatidium. On this basis, an algorithm is built for generating a training data set to create two deep neural networks (DNN): the first detects the distance, and the second detects the azimuth to a circular feature. The hyperparameter tuning and the configurations of both networks are described. Experimental results showed that the proposed method could effectively and accurately detect the distance and azimuth to objects.

Background & Aims: Globally, liver diseases account for 2 million deaths per year. For those with advanced liver disease the only curative approach is liver transplantation. However, less than 10% of those in need get a liver transplant due to limited organ availability. To circumvent this challenge, there has been a great focus in generating a bioengineered liver. Despite its essential role in liver functions, a functional biliary system has not yet been developed. In this framework, exploration of epithelial cell self-organogenesis and microengineering-driven geometrical cell confinement allow to envision the bioengineering of a functional biomimetic intrahepatic biliary tract. Approach: Three-dimensional (3D) bile ducts were built in vitro by restricting cell adhesion to two-dimensional (2D) patterns to guide cell self-organization. Tree shapes mimicking the configuration of the human biliary system were micropatterned on glass slides, restricting cell attachment to these areas. Different tree geometries and culture conditions were explored to stimulate self-organogenesis of normal rat cholangiocytes (NRCs) used as a biliary cell model, either alone or in coculture with human umbilical endothelial cells (HUVECs). Results: Pre-seeding the micropatterns with HUVECs promoted luminogenesis with higher efficiency to yield functional branched biliary tubes. Lumen formation, apico-basal polarity, and preservation of the cholangiocyte phenotype were confirmed. Moreover, intact and functional biliary structures were detached from the micropatterns for further manipulation. Conclusion: This study presents physiologically relevant 3D biliary duct networks built in vitro from 2D micropatterns. This opens opportunities for investigating bile duct organogenesis, physiopathology, and drug testing.

Although wireless capsule endoscopy (WCE) detects small bowel diseases effectively, it has some limitations. For example, the reading process can be time-consuming due to the numerous images generated per case, and lesion detection accuracy may rely on the operators' skills and experiences. Hence, many researchers have recently developed deep learning-based methods to address these limitations. However, they tend to select only a portion of the images from a given WCE video and analyze each image individually. In this study, we note that more information can be extracted from the unused frames and temporal relations of sequential frames. Specifically, to increase the accuracy of lesion detection without depending on experts' frame selection skills, we suggest using whole video frames as the input to the deep-learning system. Thus, we propose a new Transformer-based neural encoder that takes the entire video as the input, exploiting the power of the Transformer to extract long-term global correlation within and between the input frames. Subsequently, we can capture the temporal context of the input frames and the attentional features within a frame. Tests on benchmark datasets of four WCE videos showed 95.1% sensitivity and 83.4% sensitivity. These results may significantly advance automated lesion detection techniques for WCE images. Our code is available at https://github.com/syupoh/VWCE-Net.git.

In this work, we propose a self-supervised multi-agent system that meets the online learning of clustering tasks for video behavior recognition spatio-temporal tasks. Encoding visual behavioral actions as discrete temporal sequence(DTS). Real-time clustering recognition task in a multi-agent system for continuous model building, training, and correction. Finally, we implemented a fully decentralized multi-agent system and completed its feasibility verification in a surveillance video application scenario on vehicle path clustering.

The increasing use of deep learning techniques to manipulate images and videos, commonly referred to as "deepfakes," is making more and more challenging to differentiate between real and fake content. While various deepfake detection systems have been developed, they often struggle to detect deepfakes in real-world situations. In particular, these methods are often unable to effectively distinguish images or videos when these are modified using novel techniques which have not been used in the training set. In this study, we carry out an analysis of different deep learning architectures in an attempt to understand which is more capable of better generalizing the concept of deepfake. According to our results, it appears that Convolutional Neural Networks (CNNs) seem to be more capable of storing specific anomalies and thus excel in cases of datasets with a limited number of elements and manipulation methodologies. The Vision Transformer, conversely, is more effective when trained with more varied datasets, achieving more outstanding generalization capabilities than the other methods analysed. Finally, the Swin Transformer appears to be a good alternative for using an attention-based method in a more limited data regime. All the analyzed architectures seem to have a different way to look at deepfakes but since in a real-world environment, the generalization capability is essential, based on the carried out experiments the Vision Transformer seems to provide superior performances.

This paper presents a robust method based on graph topology to find the topologically correct and consistent subset of inter-robot relative pose measurements for multi-robot map fusion. However, the absence of good prior gives a severe challenge to distinguish the inliers and outliers, and wrong loop closures can seriously corrupt the fused global map. Existing works mainly rely on the consistency of spatial dimension to select inter-robot measurements, which does not always hold. In this paper, we propose a fast inter-robot loop closure selection method that integrates the consistency and topology relationship of measurements, which both conform to the continuity characteristics of similar scenes and spatiotemporal consistency. The traditional high-dimensional consistency matrix is decomposed into the sub-matrix blocks corresponding to the overlapping trajectory area. Building on this logic, a clustering method involving topology correctness of inter-robot loop closures is introduced to split the entire measurement set into multiple clusters. We define the weight function to find the maximum cardinality subset with topologically correct and consistent, then convert the weight function to a maximum clique problem in the graph and solve it. We evaluate the performance of our method in a simulation and in a real-world experiment. Compared to state-of-the-art methods, the results show that our method can achieve competitive performance in accuracy while reducing computation time by 75%.

Hopfield Neural Networks (HNNs) are recurrent neural networks used to implement associative memory. Their main feature is their ability to pattern recognition, optimization, or image segmentation. However, sometimes it is not easy to provide the users with good explanations about the results obtained with them due to mainly the large number of changes in the state of neurons (and their weights) produced during a problem of machine learning. There are currently limited techniques to visualize, verbalize, or abstract HNNs. This paper outlines how we can construct automatic video generation systems to explain their execution. This work constitutes a novel approach to get explainable artificial intelligence systems in general and HNNs in particular building on the theory of data-to-text systems and software visualization approaches. We present a complete methodology to build these kinds of systems. Software architecture is also designed, implemented, and tested. Technical details about the implementation are also detailed and explained. Finally, we apply our approach for creating a complete explainer video about the execution of HNNs on a small recognition problem.

Advanced image processing will be crucial for emerging technologies such as autonomous driving, where the requirement to quickly recognize and classify objects under rapidly changing, poor visibility environments in real time will be needed. Photonic technologies will be key for next-generation signal and information processing, due to their wide bandwidths of 10’s of Terahertz and versatility. Here, we demonstrate broadband real time analog image and video processing with an ultrahigh bandwidth photonic processor that is highly versatile and reconfigurable. It is capable of massively parallel processing over 10,000 video signals simultaneously in real time, performing key functions needed for object recognition, such as edge enhancement and detection. Our system, based on a soliton crystal Kerr optical micro-comb with a 49GHz spacing with >90 wavelengths in the C-band, is highly versatile, performing different functions without changing the physical hardware. These results highlight the potential for photonic processing based on Kerr microcombs for chip-scale fully programmable high-speed real time video processing for next generation technologies.

It was once thought that high QoS (Quality of Service) performance solves recurrent problems of low-quality multimedia services. Since then, solutions have been proposed to ensure a high level of QoE (Quality of Experience). In this document, the authors attempt to outline their understanding of an accurate meaning of quality of multimedia services. Starting from QoS and passing through generalised QoE, the authors focus on aspects of subjective and objective quality modelling and optimisation of visual performance for TRV (Target Recognition Video) applications (such as video surveillance), outlining the path of ITU-T standardisation in this area. The authors revised the ITU-T Recommendation P.912 to reflect improved subjective test techniques developed since this Recommendation was approved. The authors also attempt to predict at least some existing errors of reasoning, which are likely to become evident for the industry in the next decade.

Dictionary Learning (DL) and Sparse Representation (SR) based Classifier have impacted greatly on the classification performance and has had good recognition rate on image data. In Video Semantic Analysis (VSA), the local structure of video data contains more vital discriminative information needed for classification. However, this has not been fully exploited by the current DL based approaches. Besides, similar coding findings are not being realized from video features with the same video category. Based on the issues stated afore, a novel learning algorithm, called Sparsity based Locality-Sensitive Discriminative Dictionary Learning(SLSDDL) for VSA is proposed in this paper. In the proposed algorithm, a discriminant loss function for the category based on sparse coding of the sparse coefficients is introduced into structure of Locality-Sensitive Dictionary Learning (LSDL) algorithm. Finally, the sparse coefficients for the testing video feature sample are solved by the optimized method of SLSDDL and the classification result for video semantic is obtained by minimizing the error between the original and reconstructed samples. The experiment results show that, the proposed SLSDDL significantly improves the performance of video semantic detection compared with the comparative state-of-the-art approaches. Moreover, the robustness to various diverse environments in video is also demonstrated, which proves the universality of the novel approach.

Gyroscopes are fascinating instruments with a history of about 200 years. When J.G.F. Bohnenberger presented his machine to his students in 1810 at the University of Tuebingen, Germany, nobody could have foreseen that this fascinating development would be used for complex orientation and positioning. At the University of Stuttgart, Germany, a collection of 160 exhibits is available and in transition for a sustainable future. Here, the systems are digitized in 2D, 2.5D and 3D and are made available for a world-wide community using OpenAccess platforms. The technologies being used are Computed Tomography, Computer Vision, Endoscopy and Photogrammetry. The workflows for combining voxel representations and colored point clouds are described, to create Digital Twins of the tangible assets. Advantages and disadvantages are discussed und work for near future is outlined in this new and challenging field of Tech Heritage digitization.

Image compression is a top priority today due to the need for faster encoding and decoding. To achieve this, the present study has proposed the use of Canonical Huffman Coding (CHC) as an entropy coder, which has a lower decoding time complexity than binary Huffman codes. For image compression, combining of the Discrete Wavelet Transform (DWT) and CHC with Principal Component Analysis (PCA) has been recommended. The lossy method has been introduced by using PCA, followed by DWT and CHC to enhance compression efficiency. By using DWT and CHC instead of PCA alone, the reconstructed image has been found to have a better peak signal-to-noise ratio (PSNR) value. This study has developed a hybrid compression model combining the advantages of DWT, CHC and PCA. With the increasing use of image data, better image compression techniques are necessary for efficient use of storage space. The proposed technique has achieved up to 60% compression while maintaining high visual quality. This method has also outperformed the currently available techniques in terms of both PSNR (in dB) and bit-per-pixel (bpp) scores. This approach has been tested on various color images, including Peppers 512×512 and Couple 256×256, showing improvement by 17 dB and 22 dB, respectively, while reducing bpp by 0.56 and 0.10, respectively. For grayscale images, i.e., Lena 512×512 and Boat 256×256, the proposed method has shown an improvement by 5 dB and 8 dB, respectively, with a decrease of 0.02 bpp in both cases.

The COVID-19 outbreak demonstrated the viability of various remote working solutions, telepresence robots (TPRs) being one of them. High-quality video transmission is one of the cornerstones of using such solutions, as most of the information about the environment is acquired through vision. This study aims to compare the camera capabilities of four models of popular telepresence robots using compact reduced LogMAR and Snellen optometry charts as well as text displayed on the projector screen. The symbols from the images are extracted using OCR (Optical Character Recognition) software and the results of the recognition are compared with the symbols on the charts. Double 3 TPR provides the best quality images of optometric charts, but the OCR results of measurements of the image on the projector do not show the clear advantage of one single model over the others. The results demonstrated by Temi 2 and Double 3 TPRs are generally better than the others, suggesting that these TPRs are more feasible to be used in teaching and learning scenarios.

Nowadays, the European Union and the governments of the different countries have focused on the development of the Sustainable Development Goals (SDG) and the 2030 agenda, something that has been translated into education itself. Video Games, Gamification, and Game Based Learning have become different strategies and tools to enhance the learning process and some of the growing approaches used by teachers to develop sustainable education in the classrooms. This research aims to analyze the characteristics to promote sustainability in education using games and technology, specifically its learning benefits for Higher Education. A systematic review of the literature was conducted following the PRISMA methodology. At first, 2025 documents were found which, after the filtering phases, the number of articles has been reduced to nine, which subsequently were analyzed in depth. The results indicated that among the benefits of the use of games mediated by technologies are the following: it favors education for sustainability and it promotes the educational inclusion and the work of various social skills such as collaborative and cooperative work. Also, showed an increase of the number of publications between 2019 and 2023, reflecting the growing interest in the topic. However, there are some research gap in this field.

Video segmentation is crucial in a variety of practical applications especially in computer visions. Most of recent works in video segmentation are focusing on Deep learning based video segmentation, there are rooms for improvement in respect of the evolutionary algorithms. This paper aims to propose the novel method to video segmentation by using the optimization of segmentation parameters based on ensemble-based random forest and gradient boosting decision tree. The experimental results show Pareto front of segmentation parameters (hue, brightness, luminance, and saturation). Our optimization model yields accuracy: 85% +/-8.85 % (micro average: 85.00 %), average class precision: 84.88%, and average class recall: 85%. We also show the video segmentation results based on our optimization method and compare our results with Kinect-based video segmentation.

Recognition of the human interaction on the unconstrained videos taken from cameras and remote sensing platforms like a drone is a challenging problem. This study presents a method to resolve issues of motion blur, poor quality of videos, occlusions, the difference in body structure or size, and high computation or memory requirement. This study contributes to the improvement of recognition of human interaction during disasters such as an earthquake and flood utilizing drone videos for rescue and emergency management. We used Support Vector Machine (SVM) to classify the high-level and stationary features obtained from Convolutional Neural Network (CNN) in key-frames from videos. We extracted conceptual features by employing CNN to recognize objects from first and last images from a video. The proposed method demonstrated the context of a scene, which is significant in determining the behaviour of human in the videos. In this method, we do not require person detection, tracking, and many instances of images. The proposed method was tested for the University of Central Florida (UCF Sports Action), Olympic Sports videos. These videos were taken from the ground platform. Besides, camera drone video was captured from Southwest Jiaotong University (SWJTU) Sports Centre and incorporated to test the developed method in this study. This study accomplished an acceptable performance with an accuracy of 90.42%, which has indicated improvement of more than 4.92% as compared to the existing methods.

Herein, we offer a numerical study on the devising of a unique 2D-heterostructure Photonic crystal (PC) that can split two orthogonally polarized light waves. The analysis is performed via a two-dimensional finite element method (2D-FEM) by utilizing COMSOL Multiphysics software. The device consists of two discrete designs of PC formation. The first PC formation is optimized so that it permits both TE and TM-polarization of light to transmit through it. Whereas the second PC formation possesses a Photonic Bandgap (PBG) only for TE-polarized light. These two formations are combined at an angle of 45 degrees, resulting in a reflection of self-collimated TE-polarized light at an angle of 90 degrees owing to the PBG present in the second PC formation. While permitting the self-collimated TM-polarized light wave to travel uninterrupted. The proposed device has a small footprint of ~10.5 μm2 offering low transmission loss and high polarization extinction ratio which makes it an ideal candidate to be employed as an on-chip polarization division multiplexing system.

Background: The laryngeal mask airway Vision Mask (LMA VM) is a supraglottic airway device (SAD) with vision guidance system. The ideal head and neck position for direct laryngoscopy is known, but the ideal position for placing a LMA is not. The objective of this study is to evaluate and compare the optimal position for placement of a video laryngeal mask airway. Methods: This was a prospective observational, transversal and analytical study of 72 consecutive patients. In the same patient, laryngeal vision was first assessed with the head and neck in the sniffing position and then with the head in the neutral position. Procedures were filmed and performed by the same investigator. Assessment of the laryngeal view was performed using two classifications: modified Cormack-Lehane classification and Brimacombe classification. Device placement was considered adequate when the Cormack-Lehane rating was scored from 1 to 2 and the Brimacombe rating was from 2 to 4. Results: 72 patients were included in this study. In the assessment of the glottis using the Cormack Lehane classification for fiberoptic view, laryngeal visibility was adequate in 64 (88.89%) patients in the neutral position and in 65 (90,28%) patients in the sniffing position (p>0,05). In the fiberoptic view of the glottis, assessed using the Brimacombe classification, laryngeal visibility was adequate in 68 (93%) patients in the neutral position and in 69 (95%) patients in the sniffing position, (p>0,05). There was no statistically significant difference in the rate of success between the sniffing position (70 patients, 97.22% success rate) and the neutral position (67 patients, 93.06% success rate) during the first insertion attempt. Two patients required a second attempt in the sniffing position, while five patients required a second attempt in the neutral position. Conclusion: An adequate sniffing position did not result in a better glottic view than neutral position, and the number and type of additional maneuvers were equal in both positions.

Owing to the expansion of non-face-to-face activities, security issues in video conferencing systems are becoming more critical. In this paper, we focus on the end-to-end encryption (E2EE) function among security services of video conferencing systems. First, the E2EE-related protocols of Zoom and Secure Frame (SFrame), which are representative video conferencing systems, are thoroughly investigated, and the two systems are compared and analyzed overall. Next, the E2EE protocol in the Government Public Key Infrastructure (GPKI)-based video conferencing system, in which the user authentication mechanism is fundamentally different from those used in private sector systems, such as Zoom or SFrame, will be considered. In particular, among E2EE-related protocols, we propose a detailed mechanism in which the post-quantum cryptography (PQC) key encapsulation mechanism (KEM) is applied to the user key exchange process. As the session key is not disclosed to the central server even in futuristic quantum computers, the mechanism to which the PQC KEM method proposed in this study is applied satisfies the E2EE security requirements and can be applied to domestic GPKI-based systems. It is expected to contribute in strengthening the safety of the next-generation video conferencing system.

Irrational use or misuse of antibiotics, particularly by outpatients, increases antibiotic resistance. A lack of public knowledge about ‘Responsible use of antibiotics’ and ‘How to obtain antibiotics’ is a major cause of this. This study aimed to assess the effectiveness of an educational video about antibiotics and antibiotics use to increase outpatient's knowledge in two public hospitals in East Java, Indonesia. A quasi-experimental research setting was used with a one-group pretest-posttest design, carried out from November 2018 to January 2019. The study population consisted of outpatients, to whom antibiotics were prescribed, in two public hospitals in East Java, Indonesia. Participants were selected using a purposive sampling technique; 98 outpatients at MZ General Hospital in S regency and 96 at SG General Hospital in L regency were included. A questionnaire was used to measure the respondents’ knowledge and consisted of five domains, i.e. definition of infections and antibiotics, obtaining the antibiotics, directions of use, storage instructions, antibiotic resistance. The knowledge test score was the total score of the Guttman scale (a dichotomy of ‘yes’ or ‘no’ answers). To determine the significance of the difference in knowledge before and after providing the educational video and in the knowledge score between hospitals, the (paired) Student’s t-test was applied. The educational videos significantly improved outpatients' knowledge, which increased with 41% in MZ General Hospital and 42% in SG General Hospital. An educational video is a useful method to improve the knowledge of the outpatients regarding antibiotics.

Short video addiction refers to a psychological dependency on short video applications, characterized by an intense attachment and an inability to control usage, leading to typical addiction symptoms. While its definition bears similarities to substance addiction, significant differences also exist. According to the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5), published in 2013, short video addiction has not yet been officially classified as an addiction disorder. To facilitate more in-depth and standardized research on short video addiction, it is essential to synthesize and organize existing studies on its theoretical foundations and mechanisms.

With the rapid development of technology and the advancement of Internet technology, various social networking platforms are gradually coming into people's view and occupying a higher and higher position. In the recommendation scenario, the user-item interaction naturally forms a bipartite heterogeneous graph structure and with the development of graph embedding and graph neural network technologies based on deep learning to process graph domain information, the combination of graph information and recommendation systems shows strong research potential and application prospects. The methodological improvement of the recommendation algorithm based on collaborative filtering takes advantage of the nature that user-items can form a bipartite graph in the recommendation scenario. The existing methods still have some shortcomings. The methods that only use weights or convolutional recurrent neural networks to implicitly model different historical behaviors lack explicit modeling of video switching relationships in serialized behaviors. The user's interest is changing all the time, so it is not possible to recommend based on the user's history, and it is necessary to consider both the long-term and short-term interest of the user according to the video content in order to achieve accurate recommendation of short videos. In this paper, we design a recommendation model based on graph neural network, which models users' long-term and short-term interests by two vector propagation methods, respectively.

This paper is devoted to an accurate determination of the London dispersive and polar free energy of adsorption, the two Lewis acid γs+ and base γs- components of polar surface energy γsAB of 2D single-crystalline and polycrystalline covalent organic frameworks such as TAPPy-TPA-COFs. Inverse gas chromatography (IGC) at infinite dilution was used to quantify the different surface parameters of the different materials. From IGC measurements, one determined the net retention time of the adsorption of n-alkanes and several polar solvents on single-crystalline and polycrystalline covalent organic frameworks. The free surface Gibbs energy of adsorption was obtained for the various organic molecules at different temperatures from their net retention volume values. The separation between the London dispersive energy and the polar energy of adsorbed molecules was carried out by using a new thermodynamic parameter PSX chosen as new indicator variable and taken into account the deformation polarizability and the harmonic mean of the ionization energies of solvents and solid materials, derived from London dispersion equation. The obtained results are very promising for the accurate determination of the surface thermodynamic parameters of adsorption of organic solvents on solid surfaces.

In this paper, an intelligent blind guide system based on 2D LiDAR and RGB-D camera sensing is proposed, and the system is mounted on the smart cane. The intelligent guide system relies on 2D LiDAR, RGB-D camera, IMU, GPS, Jetson nano B01, STM32 and other hardware. The main advantage of the intelligent guide system proposed by us is that the distance between the smart cane and obstacles can be measured by 2D LiDAR based on Cartographer algorithm, thus achieving Simultaneous localization and mapping (SLAM). At the same time, through the improved yolov5 algorithm, pedestrians, vehicles, pedestrian crosswalks, traffic lights, warning posts, stone piers, tactile paving and other objects in front of the visually impaired can be quickly and effectively identified. Laser SLAM and improved yolov5 obstacle identification tests were carried out inside a teaching building on the campus of Hainan Normal University and on a pedestrian crossing on Longkun South Road in Haikou City, Hainan Province. The results show that the intelligent guide system developed by us can drive the wheels and omnidirectional wheels at the bottom of the smart cane, and give the smart cane a self-leading blind guide function like a "guide dog", which can effectively guide the visually impaired to avoid obstacles and reach the predetermined destination, and can quickly and effectively identify the obstacles on the way out. The laser SLAM speed of this system is 25~31FPS, which can realize the short-distance obstacle avoidance and navigation function both in indoor and outdoor envionments. The improved yolov5 helps to identify 86 types of objects, the recognition rate for pedestrian crosswalks and for vehicles are 84.6% and 71.8%, respectively; the overall recognition rate for 86 types of objects is 61.2%, and the obstacle recognition rate of the intelligent guide system is 25-26FPS.

In recent years, with the development of social media, people are more and more inclined to upload text, pictures and videos on the platform to express their personal emotions, thus the number of short videos is increasing and becoming the first choice for people to socialize. Unlike the traditional way, people can convey their personal emotions and opinions through media other than words, such as video images, etc. for external information. Therefore, the expression and analysis of emotions is not only through text, but also through the analysis of emotional needs in images and videos, and the research scholars have customized products for individual users. Compared with pure text content, video information can more intuitively express users' happiness, anger and sorrow, thus short video-related applications have gained more and more popularity among Internet users in recent years. However, not all short videos on social networking sites can accurately express users' emotions, and related text information can more accurately assist sentiment analysis and thus improve accuracy. However, short video sentiment analysis based on video frame images is inaccurate in some scenarios, such as when expressing tears of joy, the sentiment expressed by the user's facial expression and voice are different, which will cause errors in the analysis of sentiment. As a result, researchers began to consider multimodal sentiment analysis to reduce the impact of the above scenarios on short video sentiment analysis. This paper focuses on proposing a sentiment analysis method for short videos. We first propose a residual attention model to make full use of the information in audio to classify the emotions contained in them. Then the text information in the dataset is classified by feature extraction. The key to extract features from text information is not only to retain the semantic information of the text, but also to explore the potential emotional information in the text, so as to ensure the integrity of the text information features. The experiments show that the sentiment analysis model proposed in this paper is more superior than the baselines.

Aiming at the problems that large amount of video monitoring image data in underground coal mines leads to difficulties in transmission and storage, compressed sensing theory is introduced to encode and decode video images, and a new distributed video coding scheme is proposed. In order to obtain more sparse representation and more general applicability, a block-based adaptive sparse base scheme is proposed. For the acquisition of side information, fixed weight is usually used to synthesize side information and the correlation between different image blocks is neglected, a block-based classification weighted side information generation scheme is proposed. Experimental results show that the block-based classification codec scheme can make full use of inter-frame correlation. Under the appropriate sampling rate, the PSNR value of video reconstruction increases, which effectively improves the quality of video frame reconstruction.

On-chip integration of two-dimensional (2D) materials with unique structures and distinctive properties endow integrated devices with new functionalities and improved performance. With a high flexibility in modifying its properties and a strong compatibility with various integrated platforms, graphene oxide (GO) becomes an attractive 2D material for implementing functional hybrid integrated devices. Here, we demonstrate novel functionalities that go beyond the capabilities of conventional photonic integrated circuits, by harnessing the photo-thermal effects in 2D GO films integrated onto them. These include all-optical control and switching, optical power limiting, and non-reciprocal light transmission. The 2D layered GO films are on-chip integrated with precise control of their thicknesses and sizes. Benefitting from the broadband response of 2D GO films, all the three functionalities feature a very wide operational bandwidth. By fitting the experimental results with theory, we also extract the changes in material properties induced by the photo-thermal effects, which reveal interesting insights about 2D GO films. These results highlight the versatility of 2D GO films in implementing functional integrated photonic devices for a range of applications.

All-optical signal processing based on nonlinear optical devices is promising for ultrafast information processing in optical communication systems. Recent advances in two-dimensional (2D) layered materials with unique structures and distinctive properties have opened up new avenues for nonlinear optics and the fabrication of related devices with high performance. This paper reviews the recent advances in research on third-order optical nonlinearities of 2D materials, focusing on all-optical processing applications in the optical telecommunications band near 1550 nm. First, we provide an overview of the material properties of different 2D materials. Next, we review different methods for characterizing the third-order optical nonlinearities of 2D materials, including the Z-scan technique, third-harmonic generation (THG) measurement, and hybrid device characterization, together with a summary of the measured n₂ values in the telecommunications band. Finally, the current challenges and future perspectives are discussed.