As modern systems are becoming more complex their control strategy cannot longer relay only on measurement information that usually comes from probes but also from mathematical models. Those systems models can lead to unbearable computation times due to their own complexity, turning the control process non-viable, which leads to the implementation of surrogate models that enable to achieve estimates within acceptable time to take decisions. A control trained with Deep Reinforcement Learning algorithm, using a Physics-Informed Neural Network to obtain the temperature map on the following time step, replaces the need of running Direct Numerical Simulations. On this work we considered an 1D heat conduction problem, which temperature distribution feeds a control system to activate a heat source aiming to obtain a constant, previously defined, temperature value. With this approach, control training becomes much faster without the need of performing numerical simulations or laboratory measurements, as well the control is taken based on Neural Network enabling its implementation on simple processors to edge computing.

Physics-informed machine learning (PIML) refers to the emerging area of extracting physically relevant solutions to complex multiscale modeling problems and has enjoyed significant interest from the research community. This paper discusses the recent critical advancements in the PIML domain. Novel methods and applications of domain decomposition in physics-informed neural networks (PINN) in particular are highlighted. Additionally, we explore recent Works toward utilizing neural operator learning to intuit relationships in physics systems traditionally modeled by sets of complex governing equations and solved with expensive differentiation techniques. Finally, expansive applications of traditional physics-informed machine learning and potential limitations are discussed. In addition to summarizing recent work, we propose a novel taxonomic structure to catalog physics-informed machine learning based on how the physics-information is derived and injected into the machine learning process. The taxonomy assumes the explicit objectives of facilitating interdisciplinary collaboration in methodology, thereby promoting a wider characterization of what types of physics-problems are served by the physics-informed learning machines, and assisting in identifying apt targets for future work. To summarize, the major twofold goal of this work is to summarize recent advancements and introduce a taxonomic catalog for applications of physics-informed machine learning.

In metal additive manufacturing (AM), precise temperature field prediction is crucial for process monitoring, automation, control, and optimization. Traditional methods, primarily offline and data-driven, struggle with adapting to real-time changes and new process scenarios, which limits their applicability for effective AM process control. To address these challenges, this paper introduces the first physics-informed (PI) online learning framework specifically designed for temperature prediction in metal AM. Utilizing a physics-informed neural network (PINN), this framework integrates a neural network architecture with physics-informed inputs and loss functions. Pretrained on a known process to establish a baseline, the PINN transitions to an online learning phase, dynamically updating its weights in response to new, unseen data. This adaptation allows the model to continuously refine its predictions in real-time. By integrating physics-informed components, the PINN leverages prior knowledge about the manufacturing processes, enabling rapid adjustments to process parameters, geometries, deposition patterns, and materials. Empirical results confirm the robust performance of this PI online learning framework in accurately predicting temperature fields for unseen processes across various conditions. It notably surpasses traditional data-driven models, especially in critical areas like the Heat Affected Zone (HAZ) and melt pool. The PINN’s use of physical laws and prior knowledge not only provides a significant advantage over conventional models but also ensures more accurate predictions under diverse conditions. Furthermore, our analysis of key hyper-parameters—learning rate and batch size of the online learning phase—highlights their roles in optimizing the learning process and enhancing the framework’s overall effectiveness. This approach demonstrates significant potential to improve the online control and optimization of metal AM processes.

This paper investigates the use of Physics-Informed Neural Networks (PINNs) in active learning cycles. We defined two scenarios: one semi-supervised and the other fully supervised. PINNs emphasize the integration of physical laws into neural networks to improve the predictive performance of vanilla neural networks and to enhance the efficiency of traditional methods for solving partial differential equations (PDEs). Key contributions include adapting existing computational frameworks to enable the use of Graph Neural Networks for solving problems that require the calculation of gradients on unstructured triangle meshes, a query strategy focusing on the physical loss, and a comparative analysis of this strategy against random sampling across both defined scenarios. This work establishes a foundation for future research aimed at expanding the application of Physics-Informed Graph Neural Networks (PIGNN) using active learning and addressing real-world problems in fluid dynamics and electrodynamics.

Unsupervised physics-informed deep learning can be used to solve computational physics problems by training neural networks to satisfy the underlying equations and boundary conditions without labeled data. Parameters such as network architecture and training method determine the training success. However, the best choice is unknown a priori as it is case specific. Here, we investigated network shapes, sizes, and types for unsupervised physics-informed deep learning of the two-dimensional Reynolds-averaged flow around cylinders. We trained mixed-variable networks and compared them to traditional models. Several network architectures with different shape factors and sizes were evaluated. The models were trained to solve the Reynolds-averaged Navier-Stokes equations incorporating Prandtl's mixing length turbulence model. No training data were deployed to train the models. The superiority of the mixed-variable approach was confirmed for the investigated high Reynolds number flow. The mixed-variable models were sensitive to the network shape. For the two cylinders, differently deep networks showed superior performance. The best fitting models were able to capture important flow phenomena such as stagnation regions, boundary layers, flow separation, and recirculation. We also encountered difficulties when predicting high Reynolds number flows without training data

Physics-informed neural networks can be trained to serve as surrogate models by learning how spatial physical fields develop with change of parameters. This is an advantage over traditional numerical methods that can only be used to calculate a single solution field for a single discrete setting of a parameter. While many studies report accurate results of physics-informed deep learning of laminar flows, evaluations of surrogate modeling of high Reynolds number flows remain sparse. To contribute to this question, we here explore the capabilities and limits of physics-informed deep learning to solve the Reynolds-averaged Navier-Stokes equations for the flow around two airfoils under variable angles of attack. No labeled training data were provided and a single network was trained to simultaneously learn several solution fields in a single training run. The network captured essential flow features such as boundary layers and high and low pressure regions. Moreover, the qualitative correlations of lift and drag with the angle of attack and the higher drag of the thicker airfoil were captured. However, comparisons with reference simulations revealed an underestimation of the shear layer gradients as well as deviations of the fields' extrema. Thus, we also debate potential future improvements to increase the accuracy of the predicted flow. This work offers a prospect on the capabilities and current limitations of physics-informed neural networks for surrogate modeling of high Reynolds number flows. We argue that the method is promising and this work is aimed to encourage further research and development of the method when applied to Reynolds-averaged flows at high Reynolds numbers.

The Physics Informed Neural Networks framework is applied to the understanding of the dynamics of Coronavirus of 2019. To provide the governing system of equations used by the framework, the Susceptible-Infected-Recovered-Death mathematical model is used. The study focused on finding the patterns of the dynamics of the disease which involves predicting the infection rate, recovery rate and death rate; thus predicting the active infections, total recovered, susceptible and deceased at any required time. The study used data that was collected on the dynamics of COVID-19 from the Kingdom of Eswatini between March 2020 and September 2021. The obtained results showed less errors thus making highly accurate predictions.

Partial differential equations (PDEs) are used to describe a wide range of phenomena, such as heat transfer, fluid dynamics, and quantum mechanics. By solving PDEs, we can ob- tain insights into the behavior of the system and make predictions about its future evolution. Conventional numerical methods for obtaining the approximate solutions of PDEs may re- quire extensive computational resources and time, especially for complex PDEs and large- scale problems. The recently developed physics-informed neural network (PINN) has shown promise in a variety of scientific and engineering fields by incorporating physical laws into the loss functions of the neural network (NN). In addition, the training of PINN does not require ground truth data, but it has poor generalization ability to unseen domains. On the other hand, a convolutional neural network (CNN) has fast inference and better generalization ability, but it requires a large amount of training data. Taking the advantages of PINN and CNN by using Legendre multiwavelets (LMWs) as basis functions, we introduce a new method to approach the PDEs in this paper, namely Physics-Informed Legendre Multiwavelets CNN (PiLMWs-CNN), in order to continuously approximate a grid-based state representation that can be handled by a CNN. PiLMWs-CNN enable us to train our models using only physics-informed loss functions without any pre- computed training data, simultaneously providing fast and continuous solutions that gener- alize to previously unknown domains. In particular, the LMWs can simultaneously possess compact support, orthogonality, symmetry, high smoothness, and high approximation order. Compared to orthonormal polynomial (OP) bases, the approximation accuracy can be greatly increased and computation costs can be significantly reduced by using LMWs. We applied PiLMWs-CNN to approximate the damped wave equation, incompressible Navier-Stokes (N- S) equation, and two-dimensional heat conduction equation. The experimental results show that this method provides more accurate, efficient, and fast convergence with better stability when approximating the solution of PDEs.

Water resource pollution, particularly in river channels, presents a grave environmental challenge that necessitates a comprehensive and systematic approach encompassing assessment, forecasting, and effective management. This article provides a comprehensive exploration of the methodology and modeling tools employed to scrutinize the process of river channel pollution due to silting, rooted in the fundamental principles of hydrodynamics and pollutant transport dynamics. The study's methodology seamlessly integrates numerical simulations with state-of-the-art neural network techniques, with a specific focus on the Physics-informed neural networks (PINN) method. This innovative approach represents a groundbreaking fusion of artificial neural networks (ANN) and physical equations, offering a more efficient and precise means of modeling a wide array of complex processes and phenomena. The proposed mathematical model, grounded in the Euler equation, has been meticulously implemented using the Ansys Fluent software package, ensuring accuracy and reliability in the computations. In a pivotal phase of the research, a thorough comparative analysis was conducted between the results derived from the PINN method and those obtained through conventional numerical approaches using the Ansys Fluent software package. The outcomes of this analysis revealed the superior performance of the PINN method, characterized by the generation of smoother pressure fluctuation profiles and significantly reduced computation time, underscoring its potential as a transformative modeling tool. The calculated data originating from this study assumes paramount significance in the ongoing battle against river sedimentation. Beyond this immediate application, these findings also serve as a valuable resource for creating predictive materials pertaining to river channel silting, thereby empowering decision-makers and environmental stakeholders with essential information. The utilization of modeling techniques to address pollution concerns in river channels holds the potential to revolutionize risk management and safeguard the integrity of our vital water resources. However, it is imperative to underscore that the effectiveness of such models hinges on ongoing monitoring and frequent data updates, ensuring that they remain aligned with real-world conditions. This research not only contributes to the enhanced understanding and proactive management of river channel pollution due to silting but also underscores the pivotal role of advanced modeling methodologies in the preservation of our invaluable water resources for present and future generations.

Deep learning has achieved remarkable success in diverse computer science applications, however, its use in other traditional engineering fields has emerged only recently. In this project, we solved several mechanics problems governed by differential equations, using physics informed neural networks (PINN). The PINN embeds the differential equations into the loss of the neural network using automatic differentiation. We present our developments in the context of solving two main classes of problems: data-driven solutions and data-driven discoveries, and we compare the results with either analytical solutions or numerical solutions using the finite element method. The remarkable achievements of the PINN model shown in this report suggest the bright prospect of the physics-informed surrogate models that are fully differentiable with respect to all input coordinates and free parameters. More broadly, this study shows that PINN provides an attractive alternative to solve traditional engineering problems.

Deep Neutral Networks (DNNs) were initially proposed towards the midst of the 20th century, motivated by the neural structure and mechanism of the human brain. Thanks to major ad-vancements in computational resources, during the past decade DNN-based systems have demonstrated unprecedented performance in terms of accuracy and speed. However, recent work has shown that such models may not be sufficiently robust during the inference process. Furthermore, due to the data-driven learning nature of DNNs, designing interpretable and gen-eralizable networks is a major challenge, especially in critical applications, such as medical Computer Aided Diagnostics (CAD) and other medical imaging tasks, including classification, regression and reconstruction. Within this context, a line of physics-driven approaches for deep learning has recently emerged, aimed at improving the stability and generalization capacity of DNNs for medical imaging applications. In this paper, we review recent work focused on phys-ics-driven or prior-information learning for a variety of imaging modalities and medical applica-tions. We discuss how the inclusion of domain-related knowledge into the learning process and networks’ design supports their stability and generalization capability. In addition, we highlight current and future challenges within this scope.

Deep learning machines are computational models composed of multiple processing layers of adaptive weights to learn representations of data with multiple levels of abstraction. Their structure is mainly reflecting the intuitive plausibility of decomposing a problem into multiple levels of computation and representation since it is believed that higher layers of representation allow a system to learn complex functions. Surprisingly, after decades of research, from learning and design perspectives these models are still deployed in a heuristic manner. In this paper, deep learning feed-forward machines are modeled from a statistical mechanics point of view as disordered physical systems where its macroscopic behavior is determined in terms of the interactions defined between the basic constituent of these models, namely, the artificial neuron. They are viewed as the equilibrium states of a theoretical body that is subject to the law of increase of the entropy. The study of the changes in energy of the body when passing from one equilibrium state to another is used to understand the structure and role of the phase space of the system, the stability of the equilibrium states, and the resulting degree of disorder. It is shown that the topology of these models is strongly linked to their stability and resulting level of disorder. Furthermore, the proposed theoretical characterization permit to assess the thermodynamic efficiency with which information can be processed by these models, and to provide a practical methodology to quantitatively estimate and compare their expected learning and generalization capabilities. These theoretical results provides new insights to the theory of deep learning and their implications are shown to be consistent through a set of benchmarks designed to experimentally assess their validity.

This paper presents a comprehensive investigation into the applicability and performance of two prominent growth models, namely the Verhulst model and the Montroll model, in the context of modeling tumor cell growth dynamics. Leveraging the power of Physics-Informed Neural Networks (PINNs), we aim to assess and compare the predictive capabilities of these models against experimental data obtained from the growth patterns of tumor cells. We employ a dataset comprising detailed measurements of tumor cell growth to train and evaluate the Verhulst and Montroll models. By integrating PINNs, we not only account for experimental noise but also embed physical insights into the learning process, enabling the models to capture the underlying mechanisms governing tumor cell growth. Our findings reveal the strengths and limitations of each growth model in accurately representing tumor cell proliferation dynamics. Furthermore, the study sheds light on the impact of incorporating physics-informed constraints on the model predictions. The insights gained from this comparative analysis contribute to advancing our understanding of growth models and their applications in predicting complex biological phenomena, particularly in the realm of tumor cell proliferation.

Condition monitoring of rotating shafts is essential for ensuring the reliability and optimal performance of machinery in diverse industries. In this context, as industrial systems become increasingly complex, the need for efficient data processing techniques is paramount. Deep learning has emerged as a dominant approach due to its capacity to capture intricate data patterns and relationships. However, a prevalent challenge lies in the black-box nature of many deep learning algorithms, which often operate without adhering to the underlying physical characteristics intrinsic to the studied phenomena. To address this limitation and enhance the fusion of data-driven methodologies with the fundamental physics of the system under study, this paper leverages physics-informed neural networks (PINNs). Specifically, a simple but realistic numerical case study of an extended Jeffcott rotor model, encompassing damping effects and anisotropic supports for a more comprehensive modelling, is considered. PINNs are used for the estimation of five parameters that characterize the health state of the system. These parameters encompass the radial and angular position of the static unbalance due to the disk installed on the shaft, the stiffness along the principal axes of elasticity, and the non-rotating damping coefficient. The estimation is conducted solely by exploiting the displacement signals from the centre of the disk and, to showcase the efficacy and precision provided by this novel methodology, various scenarios involving different constant rotational speeds are examined. Additionally, the impact of noisy input data is also taken into account within the analysis.

This study aimed at exploring what role artificial intelligence techniques could play in the futural numerical analysis. In this paper, a convolutional neural network techniques based on modified loss function is proposed as a surrogate of finite element method(FEM). Several surrogate-based physics-informed neural networks(PINNs) are developed to solve representative boundary value problems based on elliptic partial differential equations (PDEs). Results from the proposed surrogate-based approach are in good agreement with ones from conventional FEM. It is found that modification of the loss function could improve the prediction accuracy of the neural network. It is indicated that to some extent the artificial intelligence technique could replace conventional numerical analysis as a great surrogate model.

Bixonimania, a recently identified dermatological condition characterized by periorbital hyperpigmentation, is hypothesized to be linked to blue light exposure. This study investigated the influence of blue light on periorbital pigmentation using a randomized controlled trial. Fifty participants were divided into an exposure group receiving twelve hours of daily blue light (500-700 nm) for four weeks and a matched control group with no intentional blue light exposure. Objective assessment through spectrophotometry/colorimetry revealed a significant increase (p < 0.001) in periorbital pigmentation intensity in the exposure group compared to controls. Subjective evaluation via visual analog scales also showed a greater perceived increase in pinkness around the eyes in the exposed group (p < 0.01). Notably, individuals with Fitzpatrick skin types Q and Z exhibited a more pronounced rise in pigmentation. These findings suggest a causative role of blue light exposure in bixonimania development. Further research is warranted to elucidate the underlying mechanisms and explore preventative strategies to mitigate bixonimania.

Background. The Stanford Health Assessment Questionnaire-Disability Index (HAQ) is widely used to measure functional ability in persons with Rheumatoid Arthritis (RA). The instrument was developed with limited involvement from persons with RA, and their perception of the instrument has not been studied in depth. The aim of this study was to explore how persons with RA experience the use of the HAQ in care. Methods. Forty persons with RA were purposefully recruited to participate in semi-structured interviews. The interviews were then analyzed qualitatively using thematic analysis. Results. The participants questioned the relevance of the HAQ but nevertheless experienced that the instrument had a profound effect on their understanding of health and how care is delivered. The analysis resulted in three themes: Problems with individual items, meaning of the summative score, and effects on care and health perceptions. Conclusions. To make the HAQ relevant to persons with RA, it needs to be revised or to include an option to select items most meaningful to the respondent. To ensure relevance, the HAQ update should preferably be co-created by researchers, clinicians and persons with RA.

Nonlinear optimization (NOPT) is a meaningful tool for solving complex tasks in fields like engineering, economics, and operations research, among others. However, NOPT has problems when it comes to dealing with data variability and noisy input measurements that lead to incorrect solutions. Furthermore, nonlinear constraints may result in outcomes that are either infeasible or suboptimal, such as non-convex optimization. This paper introduces a novel regularized physics-informed neural network (RPINN) framework as a new NOPT tool for both supervised and unsupervised data-driven scenarios. By using custom activation functions and regularization penalties in an artificial neural network (ANN), RPINN can handle data variability and noisy inputs. Besides, it uses physics principles to build the network architecture, computing the optimization variables based on network weights and learned features. In addition, it uses automatic differentiation training to make the system scalable and cut down on computation time through batch-based back-propagation. The test results for both supervised and unsupervised NOPT tasks show that our RPINN can provide solutions that are competitive compared to state-of-the-art solvers. In turn, RPINN’s robustness against noisy input measurements makes it particularly valuable in environments with fluctuating information. Additionally, RPINN’s ANN-based foundation offers significant flexibility and scalability.

This paper analyses the application of deep learning techniques for predicting wave overtopping events in port environments using sea state and weather forecasts as inputs. The study was conducted in the outer port of Punta Langosteira, A Coruña, Spain. A video recording infrastructure was installed to monitor overtopping events from 2015 to 2022, identifying 3709 overtopping events. The data collected was merged with actual and predicted data for the sea state and weather conditions during the overtopping events, creating three datasets. We used these datasets to create several machine learning models to predict whether an overtopping event would occur based on sea state and weather conditions. The final models achieved a high accuracy level during the training and testing stages: 0.81, 0.73, and 0.84 average accuracy during training and 0.67, 0.48, and 0.86 average accuracy during testing, respectively. The results of this study have significant implications for port safety and efficiency, as wave overtopping events can cause disruptions and potential damage. Using deep learning techniques for overtopping prediction can help port managers take preventative measures and optimize operations, ultimately improving safety and helping to minimize the economic impact that overtopping events have on the port's activities.

With advancements in digital technologies such as 5G communications, big data, and cloud computing, the components of network operation systems have become increasingly complex, significantly complicating system monitoring and maintenance. Correspondingly, automated log anomaly detection has become a crucial means to ensure stable network operation and protect them from malicious attacks or failures. Conventional machine learning and deep learning methods assume consistent distributions between the training and testing data, adhering to a closed-set recognition paradigm. Nevertheless, in realistic scenarios, systems may encounter new anomalies that were not present in the training data, especially in log anomaly detection. Inspired by evidential learning, we propose a novel anomaly detector called LogEDL, which supervises training of the model through an evidential loss function. Unlike traditional loss functions, the evidential loss function not only focuses on correct classification, but also quantifies the uncertainty of predictions. This enhances the robustness and accuracy of the model in handling anomaly detection tasks, while achieving functionality similar to open-set recognition. To evaluate the proposed LogEDL method, we conduct extensive experiments on three datasets, i.e., HDFS, BGL, and Thunderbird, to detect anomalous log sequences. Experimental results demonstrate that our proposed LogEDL achieves state-of-the-art performance in anomaly detection.

This article presents a detailed examination of the methodology and modeling tools utilized to analyze gas flow in pipelines, rooted in the fundamental principles of gas dynamics. The methodology integrates numerical simulations with modern neural network techniques, particularly focusing on the Physics-Informed Neural Network (PINN) method. This innovative approach combines artificial neural networks (ANNs) with physical equations, offering a more efficient and accurate way to model various complex processes and phenomena. The proposed mathematical model, based on the Euler equation, has been meticulously implemented using the Python language. Verification with analytical solutions ensures the accuracy and reliability of the computations. In the research, a comprehensive comparative analysis was conducted between results obtained using the PINN method and those from conventional Computational Fluid Dynamics (CFD) approaches. The analysis highlighted the advantages of the PINN method, which produced smoother pressure and velocity fluctuation profiles while reducing computation time, demonstrating its potential as a transformative modeling tool. The data derived from this study are of paramount importance for ensuring ongoing energy supply reliability and can also be used to create predictive models related to gas behavior in pipelines. The application of modeling techniques for gas flow simulation has the potential to revolutionize the integrity of our energy infrastructure and utilization of gas resources. However, it is crucial to emphasize that the effectiveness of such models relies on continuous monitoring and frequent updates to ensure alignment with real-world conditions. This research not only contributes to a deeper understanding of compressible gas flows but also underscores the crucial role of advanced modeling methodologies in the sustainable management of gas resources for both current and future generations.

This paper presents a complete derivation and design of a physics-informed neural network (PINN) applicable to solve initial- and boundary value problems described by linear ordinary differential equations. The objective not to develop a numerical solution procedure which is more accurate and efficient than standard finite element or finite difference based methods, but to give a fully explicit mathematical description of a PINN and to present an application example in the context of hydrodynamic lubrication. It is, however, worth noticing that the PINN developed herein, contrary to FEM and FDM, is a meshless method and that training does not require big data which is typical in machine learning.

The present grievous situation of the tuberculosis disease can be improved by efficient case management and timely follow-up evaluations. With the advent of digital technology this can be achieved by quick summarization of the patient-centric data. The aim of our study was to assess the effectiveness of the ODK Scan paper-to-digital system during testing period of three months. A sequential, explanatory mixed-method research approach was employed to elucidate technology use. Training, smartphones, application and 3G enabled SIMs were provided to the four field workers. At the beginning, baseline measures of the data management aspects were recorded and compared with endline measures to see the impact of ODK Scan. Additionally, at the end, users’ feedback was collected regarding app usability, user interface design and workflow changes. 122 patients’ records were retrieved from the server and analysed for quality. It was found that ODK Scan recognized 99.2% of multiple choice bubble responses and 79.4% of numerical digit responses correctly. However, the overall quality of the digital data was decreased in comparison to manually entered data. Using ODK Scan, a significant time reduction is observed in data aggregation and data transfer activities, however, data verification and form filling activities took more time. Interviews revealed that field workers saw value in using ODK Scan, however, they were more concerned about the time consuming aspects of the use of ODK Scan. Therefore, it is concluded that minimal disturbance in the existing workflow, continuous feedback and value additions are the important considerations for the implementing organization to ensure technology adoption and workflow improvements.

Bixonimania, a rare hyperpigmentation disorder characterized by a distinctive pink hue on the eyelids, presents a significant diagnostic challenge due to its unique presentation and limited research. This study explores the application of machine learning algorithms for bixonimania detection by analyzing millions of images of individuals exposed to blue light (500-700 nm spectrum). Our findings suggest a potential link between blue light exposure and bixonimania, affecting roughly 1 in 90,000 individuals. The proposed machine learning model achieved an accuracy of 92% in detecting bixonimania based on eyelid hue analysis. This study paves the way for further exploration of bixonimania's underlying causes, improved diagnostic tools, and potential treatment options.

In this research, the application of the Physics-Informed Neural Network (PINN) model is explored to solve transport equation-based Partial Differential Equations (PDEs). The primary objective is to analyze the impact of different activation functions incorporated within the PINN model on its predictive performance, specifically assessing the Mean Squared Error (MSE) and Mean Absolute Error (MAE). The dataset used in the study consists of a varied set of input parameters related to strut diameter, unit cell size, and the corresponding yield stress values. Through this investigation, the aim is to understand the effectiveness of the PINN model and the significance of choosing appropriate activation functions for solving complex PDEs in real-world applications. The outcomes suggest that the choice of activation function may have minimal influence on the model's predictive accuracy for this particular problem. The PINN model showcases exceptional generalization capabilities, indicating its capacity to avoid overfitting with the provided dataset. The research underscores the importance of striking a balance between performance and computational efficiency while selecting an activation function for specific real-world applications. These valuable findings contribute to advancing the understanding and potential adoption of PINN as an effective tool for solving challenging PDEs in diverse scientific and engineering domains.

The Eurasian grapevine (Vitis vinifera L.) is the most widely grown horticultural crop in the world and is important for the economy of many countries. In the wine production chain, grape varieties play an important role as they directly influence the authenticity and classification of the product. Identifying the different grape varieties is therefore fundamental for quality control and inspection activities, as well as for regulating production. Currently, ampelography and molecular analysis are the main approaches to identifying grape varieties. However, both methods have limitations. Ampelography is subjective and prone to errors and is experiencing enormous difficulties as ampelographers are increasingly scarce. On the other hand, molecular analyses are very demanding in terms of cost and time. In this scenario, Deep Learning (DL) and Machine Learning (ML) methods have emerged as a classification alternative to deal with the scarcity of ampelographs and avoid molecular analyses. In this study, the most recent and current methods for identifying grapevine varieties using DL classification-based approaches are presented through a systematic literature review. The classification pipeline of the 31 studies found in the literature was described, highlighting its pros and cons. Most of the studies used DL-based models trained with leaf images acquired in a controlled environment at a maximum distance of 1.2 metres to classify grape varieties. In addition, there is a large gap between practical applications and the datasets used: a great lack of varieties, limited data acquired in the field and a lack of tests on plants under adverse conditions. Potential directions for improving this area of research were also presented.

Background: Ongoing molecular profiling studies enabled by advances in biomedical technologies are producing vast amounts of ‘omic’ data for early detection, monitoring, and prognosis of diverse diseases. A major common limitation is the scarcity of biological samples, necessitating integrative modeling frameworks that can make optimal use of available data for disease classification tasks. Related data sets are often available from different studies, but may have been generated using different technology platforms. Thus, there is a critical need for flexible modeling methods that can handle data from diverse sources to facilitate the discovery of robust biomarkers that underlie disease regulatory processes. Results: In this paper, we introduce a novel framework called Knowledge Augmented Rule Learning (KARL), which incorporates two sources of knowledge, domain, and data, for pattern discovery from small and high-dimensional datasets, such as transcriptomic data. We propose KARL as a transfer rule learning framework in which knowledge of the domain is transferred to the learning process on data in order to 1) improve the reliability of the discovered patterns, and 2) study the knowledge of the domain when used along with data for modeling. In this work, we generated KARL models on gene expression datasets for five types of cancer, including brain, breast, colon, lung, and prostate. As our knowledge of the domain, we used the Ingenuity Knowledge Base (IKB) to extract genes related to hallmarks of cancer and annotated these prior relationships before learning classifiers from these datasets. Conclusions: Our results show that KARL produces, on average, rule models that are more robust classifiers than the baseline without such background knowledge, for our tasks of cancer prediction using 25 publicly available gene expression datasets. Moreover, KARL helped us learn insights about previously known relationships in these gene expression datasets, along with new relationships not input as known, to enable informed biomarker discovery for cancer prediction tasks. KARL can be applied to modeling similar data from any other domain and classification task. Future work would involve extensions to KARL to handle hierarchical knowledge to derive more general hypotheses to drive biomedicine.

In the field of 2-D image processing and computer vision, accurately detecting and segmenting objects in scenarios where they overlap or are obscured remains a challenge. This difficulty is worse in the analysis of shoeprints used in forensic investigations because they are embedded in noisy environments such as the ground and can be indistinct. Traditional Convolutional Neural Networks (CNNs), despite their success in various image analysis tasks, struggle with accurately delineating overlapping objects due to the complexity of segmenting intertwined textures and boundaries against a background of noise. This study introduces employs the YOLO (You Only Look Once) model enhanced by edge detection and image segmentation techniques to improve the detection of overlapping shoeprints. By focusing on the critical boundary information between shoeprint textures and the ground, our method demonstrates improvements in sensitivity and precision, achieving confidence levels above 85% for minimally overlapped images and maintaining above 70% for extensively overlapped instances. Heatmaps of convolution layers were generated to show how the network converges towards successful detection using these enhancements. This research may provide a potential methodology for addressing the broader challenge of detecting multiple overlapping objects against noisy backgrounds.

A novel approach is developed to improve the convergence of Physics-Informed Neural Networks (PINNs), aiming to employ them as real-time computational models within the framework of the digital twin for manufacturing processes. This method entails the weighting of physical equations, boundary conditions, and initial conditions to ensure their comparable magnitudes, with power being the chosen quantity in this study. The approach is applied to thermal problems, which are crucial for predicting manufacturing part defects. Different configurations, including complex boundary conditions and complex physics, were tested to assess the model’s robustness. The W-PINN demonstrates good predictions and strong stability compared to the classical PINN.

With the exponential growth of internet usage and mobile devices, the volume of user behavior data has surged, offering significant opportunities and challenges for businesses. This paper explores user behavior analysis in the context of big data, highlighting its pivotal role in driving innovation and strategic decision-making. We begin by discussing the importance of user behavior data and reviewing technological advancements such as machine learning, natural language processing, and data mining that enable deep insights into user behavior. Through a case study on linguistic analysis in livestreaming e-commerce, we demonstrate how text-mining techniques can correlate linguistic characteristics with sales performance, providing actionable marketing insights. We further explore the broader business applications, including personalized recommendations, user portraits, product design, and strategic decision-making. Technical and ethical challenges, such as data integration, privacy concerns, and algorithmic bias, are also addressed. The paper concludes with a discussion on future trends, such as AI and ML advancements, edge computing, IoT proliferation, and ethical AI frameworks, poised to shape user behavior analysis. Our findings underscore the transformative potential of user behavior data in enhancing business operations and user experiences, providing recommendations for future research focused on real-time analytics, privacy-preserving techniques, and ethical implications of data-driven decisions.

Interaction between multiple phases especially liquid-gas is one of the most common phenomena in industrial systems. Computer Vision enables modern systems to derive an automated and robust image-processing technique to address this issue. However, diverse experimental conditions still make it a challenging task to overcome. In Deep Learning, instance segmentation has created a niche in various computer vision applications as it aims to provide different instance IDs to objects belonging to the same class. In this paper, we propose a novel approach employing the YOLO (You Look Only Once) an end-to-end deep learning architecture for the detection and segmentation of bubbles in fluid flows. YOLOv5 offers significant improvements in both speed and accuracy compared to its predecessors like YOLOv3. Therefore, we train the YOLOv5 network on a dataset consisting of annotated images representing instances of bubbles across varied fluid flow environments. This paper provides both qualitative and quantitative evaluation of three YOLOv5 networks (small, medium, and extra-large) in detecting and segmenting bubbles with high accuracy and efficiency. Based on the metrics all three YOLOv5 models achieved high precision above 0.98 for bounding box detection and 0.97 for segmentation mask, and high recall value greater than 0.97 for box and 0.96 for mask quality was achieved. The achieved results indicate that the models accurately localize bubbles within the image frame, and distinguish bubble pixels from the background. Also, mean average precision (mAP50-95) consistently exceeds 0.84 across all models for the bounding box and 0.73 for the segmentation mask. The ascertained results emphasize the potential of YOLOv5 architecture as a powerful tool for automated bubble analysis in real-world applications. Our research contributes to advancing the field of deep neural networks in fluid systems and provides a fresh approach for future developments in automated bubble analysis.

The proliferation of fake news on social media platforms poses significant challenges to information authenticity and public trust. In this study, the impact of various word embedding techniques on the performance of both machine learning and deep learning models for fake news detection is systematically evaluated. The comprehensive TruthSeeker dataset, which spans over a decade of labeled news articles and social media posts, is utilized. Three popular word embedding techniques are analyzed: TF-IDF, Word2Vec, and FastText. These embeddings were tested with multiple machine learning classifiers, including logistic regression, naive Bayes, K-nearest neighbors, support vector machines, multilayer perceptrons, decision trees, and random forests, as well as deep learning models, specifically convolutional neural networks (CNNs). Among machine learning models, the Support Vector Machine (SVM) with TF-IDF achieved the highest accuracy of 99.03%, precision of 98.92%, recall of 99.15%, and F1 score of 99.03%. The Multilayer Perceptron (MLP) also demonstrated strong performance with Word2Vec, reaching an accuracy of 95.24%, precision of 94.95%, recall of 95.50%, and F1 score of 95.07%. For deep learning models, CNNs combined with TF-IDF embeddings showed outstanding results, achieving an accuracy of 98.99%, precision of 98.56%, recall of 99.48%, and F1 score of 99.02%. These results highlight the critical role of word embeddings in enhancing model accuracy and reliability in misinformation detection.

This comprehensive review explores the multifaceted landscape of supercapacitors, highlighting their pivotal role in meeting the global demand for efficient energy storage solutions. Supercapacitors, with their high power density, rapid charge-discharge cycles, and extended cycle life, offer a compelling alternative to conventional batteries and capacitors. The review delves into the fundamental mechanisms of energy storage in supercapacitors, categorizing them into Electrochemical Double-Layer Capacitors (EDLCs), pseudocapacitors, and hybrid capacitors. It discusses significant advancements in supercapacitor technology, including nanostructured materials, flexible and wearable supercapacitors, solid-state supercapacitors, and hybrid supercapacitors, highlighting their potential applications across industries such as transportation, renewable energy, consumer electronics, and industrial power management. Through continued research and development, supercapacitors are poised to play a pivotal role in driving the transition towards a greener and more efficient future.

In emergency situations, ensuring standardized Cardiopulmonary Resuscitation (CPR) actions is crucial. However, current Automated External Defibrillators (AEDs) lack methods to determine whether CPR actions are performed correctly, leading to inconsistent CPR quality. To address this issue, we introduce a novel method called Deep Learning-based CPR Action Standardization (DLCAS). This method involves three parts. First, it detects correct posture using OpenPose to recognize skeletal points. Second, it identifies a marker wristband with our CPR-Detection algorithm and measures compression depth, count and frequency using a depth algorithm. Finally, we optimize the algorithm for edge devices to enhance real-time processing speed. Extensive experiments on our custom dataset have shown that the CPR-Detection algorithm achieves a mAP0.5 of 97.04%, while reducing parameters to 0.20M and FLOPs to 132.15K. In a complete CPR operation procedure, the depth measurement solution achieves an accuracy of 90% with a margin of error less than 1 cm, while the count and frequency measurements achieve 98% accuracy with a margin of error less than 2 counts. Our method meets the real-time requirements in medical scenarios, and the processing speed on edge devices have increased from 8fps to 25fps.

The rapid growth of the global population is causing a significant increase in waste production, leading to serious environmental and public health challenges. To address these issues, waste management systems are incorporating advanced technologies. Machine learning and computer vision are used to predict waste patterns, optimize collection schedules, and improve sorting accuracy. Deep learning automates the sorting process, provides predictive analytics, and enhances recycling rates. Robotics, combined with AI and computer vision, improves sorting efficiency, while the Internet of Things (IoT) monitors waste levels and optimizes collection routes. Despite these benefits, challenges such as data scarcity, high computational demands, and the need for substantial infrastructure investments must be addressed. This research explores the integration of advanced technologies into waste management and evaluates their effectiveness using waste datasets. It highlights the potential to tackle environmental challenges and lay the groundwork for more intelligent waste management solutions.

In this paper, we propose an imagined speech-based brain wave pattern recognition using deep learning. Multiple features were extracted concurrently from eight-channel Electroencephalography (EEG) signals. To obtain classifiable EEG data with fewer number of sensors, we placed the EEG sensors on carefully selected spots on the scalp. To decrease the dimensions and complexity of the EEG dataset and to avoid overfitting during the deep learning algorithm, we utilized the wavelet scattering transformation. A low-cost 8-channel EEG headset was used with MATLAB 2023a to acquire the EEG data. The Long-Short Term Memory Recurrent Neural Network (LSTM-RNN) was used to decode the identified EEG signals into four audio commands: Up, Down, Left, and Right. Wavelet scattering transformation was applied to extract the most stable features by passing the EEG dataset through a series of filtration processes. Filtration has been implemented for each individual command in the EEG datasets. The proposed imagined speech-based brain wave pattern recognition approach achieved a 92.50% overall classification accuracy. This accuracy is promising for designing a trustworthy imagined speech-based Brain-Computer Interface (BCI) future real-time systems. For better evaluation of the classification performance, other metrics were considered, and we obtained 92.74%, 92.50% and 92.62% for precision, recall, and F1-score, respectively.

This research investigates the application of Fused Filament Fabrication (FFF) in producing WC-10Co hardmetals, focusing binder formulations and understanding its influence on extrusion force and the influence of printing variables on green density of the samples. By examining the interplay between different binder compositions and backbone contents, the study aims to enhance the mechanical properties of the sintered parts while reducing defects inherent in the printing process. Evidence suggested that formulated feedstocks influenced the hardness of the sintered hardmetal, not due to microstructural changes but to macrostructural responses like macro defects introduced during printing, debinding and sintering of the samples. The results demonstrate the critical role of PP-MA content in improving part density and sintered hardness, suggesting the need for specific thermal debinding protocols tailored to each feedstock. The study provides insights into the formulation of feedstocks for hardmetal FFF, proposing a path toward refining manufacturing processes for better quality and performance of 3D printed hardmetal components.

Pedestrian trajectories are crucial for self-driving cars to plan their paths effectively. The sensors implanted in these self-driving vehicles, despite being state-of-the-art ones, often face inaccuracies in the perception of surrounding environments due to technical challenges for adverse weather conditions, interference from other vehicles sensors and electronic devices, and signal reception failure, leading to incompleteness in trajectory data. But for real-time decision making for autonomous driving, the trajectory imputation is no less crucial. Previous attempts to address this issue such as statistical inference and machine learning approaches have shown promise. Yet, the landscape of deep learning is rapidly evolving with new and more robust models emerging. In this research, we have proposed an encoder-decoder architecture, Human Trajectory Imputation Model, coined as HTIM, to tackle these challenges. This architecture aims to fill in the missing parts of pedestrian trajectories. The model has been evaluated using the Intersection drone inD dataset, containing trajectory data at suitable altitudes preserving naturalistic pedestrian behavior with varied dataset sizes. To assess the effectiveness of our model, we have utilized L1, MSE, Quantile and ADE loss. Our experiments have demonstrated that HTIM outperforms the majority of the state-of-the-art methods in this field, thus indicating its superior performance in imputing pedestrian trajectories.

Breast cancer stands as a predominant health concern for women globally. As mammography is the primary screening tool for breast cancer detection, improving the detection of breast cancer at screening could save more lives. This mammography re-view paper provides a systematic review of computer-aided techniques during a specific time frame for the segmentation and classification of microcalcification, evaluating image processing, machine learning, and deep learning techniques. The systematic review is meticulously carried out, adhering closely to the preferred reporting items for Systematic Reviews and Meta-Analysis (PRISMA) guidelines. This article focuses on mammographic breast cancer detection approaches based on automated systems, discussed chronologically from 1970 through 2023. This article encompasses the breadth of artificial intelligence-based methods from the most primitive to the most sophisticated models. Image processing and machine learning-based methods are compre-hensively reviewed. The evaluation of a deep learning architecture based on self-extracted features for classification tasks demonstrated outclass performance. Large-scale datasets required for a broader and in-depth analysis of novel methods for breast cancer detection are also discussed in this article. This research work is aligned with the United Nations' sustainability de-velopment goals.

The success of near-infrared spectroscopy (NIRS) analysis hinges on the precision and robustness of the calibration model. Shallow learning (SL) algorithms like partial least squares discriminant analysis (PLS-DA) often fall short in capturing interrelationships between adjacent spectral variables, and the analysis results are easily affected by spectral noise, which dramatically limits the breadth and depth application of NIRS. Deep learning (DL) methods, with their capacity to discern intricate features from limited samples, are progressively integrated into NIRS. In this paper, two discriminant analysis problems including wheat kernels and Yali pears were used as examples, and several representative calibration models to research the robustness and effectiveness of the model. Additionally, this article proposed a near-infrared calibration model, which is based on gramian angular difference field and coordinate attention convolutional neural networks (G-CACNN). The research results show that, compared with SL, spectral preprocessing has a smaller impact on the analysis accuracy of consensus learning (CL) and DL, and the latter has the highest analysis accuracy in the modeling results of using the original spectrum. The accuracy of G-CACNN in two discrimination tasks is 98.48% and 99.39%, respectively. Finally, This research compared the performance of various models under noise to evaluate the robustness and noise resistance of the proposed method.

This study examines the contribution of early executive functions (EFs) in the association between fluency in reading and arithmetic. Kindergarten children (N = 1,185) were assessed on Executive Functions skills and on reading and arithmetic fluency in Grade 1 and Grade 3. The analysis revealed that beyond the connection within each domain there is a unidirectional effect between fluency measures, with Grade 1 reading fluency significantly influencing the development of arithmetic fluency in Grade 3. Furthermore, the findings indicate that kindergarten EFs significantly contribute to arithmetic fluency at both time points and to reading fluency in the first grade. Early EF skills also emerged as a mediator of associations between fluency performance in reading and arithmetic, suggesting that the influence of EFs extends beyond individual academic domains. These findings have implications for understanding the cognitive mechanisms that underlie the relations between these academic skills.

Infrared thermography has already been proven to be a significant method in non-destructive evaluation since it gives information with immediacy, rapidity and low cost. However, the thorniest issue for wider application of IRT is the quantification. In this work, we proposed a specific depth quantifying technique by employing the Gated Recurrent Units (GRU) in composite material samples via pulsed thermography (PT). Carbon Fiber Reinforced Polymer(CFRP) embedded with flat bottom holes were designed via Finite Element Method (FEM) modeling in order to precisely control the depth and geometrics of the defects. The GRU model automatically quantified the depth of defects presented in the CFRP material. The proposed method evaluated the accuracy and performance of synthetic CFRP data from FEM for defect depth predictions.

Deep learning methods paired with sidescan sonar (SSS) are commonly used in underwater search and rescue operations for drowning victims, wrecks, and airplanes. However, these techniques are primarily designed to detect mine-like objects and are rarely applied to identifying features in dynamic dredge pit environments, due to a lack of datasets. In this study, we present a Sandy Point Dredge Pit (SPDP) dataset, in which high-resolution SSS data were collected from the west flank of Mississippi bird foot delta of the Louisiana inner shelf. This dataset contains a total of 385 SSS images. We introduce an Effective Geomorphology Classification model (EGC). By ablation studies, we analyze the utility of transfer learning on different model architectures and the impact of data augmentations on model performance. This EGC model will make geomorphic features identification in dredge pit environments quick and efficient which requires extensive experience and professional knowledge. The combination of SSS images and EGC model is a cost-effective and valuable toolkit for hazards monitoring in marine dredge pit environment. The SPDP SSS images dataset, especially the feature of pit wall without rotational slump, is also valuable for other machine learning modelers.

The main objective of this paper is to identify the major research areas of ChatGPT through term and keyword co-occurrence network mapping techniques. For conducting the present study, total of 577 publications were retrieved from the Lens database for the network visualization. The findings of the study showed that “chatgpt” occurrence in maximum number of times followed by its related terms such as artificial intelligence, large language model, gpt, study etc. This study will be helpful to library and information science as well as computer or information technology professionals.

This paper systematically discusses the application of reinforcement learning in automatic driving system. Reinforcement learning frameworks show significant advantages in optimizing decision making, predictive perception, path planning, and controller design, exceeding the limitations of traditional supervised learning methods. The paper highlights the critical role of components such as scene understanding, positioning, and map making in autonomous driving systems, which provide reliable environmental awareness through deep learning and sensor fusion technologies to support intelligent decision-making in complex urban environments. In addition, the paper discusses innovative approaches to safety reinforcement learning to reduce risk in autonomous driving and ensure that systems adhere strictly to safety constraints while maximizing expected rewards. These findings provide an important theoretical and practical basis for further improving algorithm robustness, managing multi-agent interactions, and integrating ethical considerations in the future.

The Physics-Informed Neural Networks (PINNs) improve the efficiency of data utilization by combining physical principles with neural network algorithms and ensure that the predictions are consistent and stable with the physical laws. PINNs opens up a new approach to address inverse problems in fluid mechanics. Based on the single-relaxation-time lattice Boltzmann method (SRT-LBM) with the Bhatnagar-Gross-Krook (BGK) collision operator, the PINN-SRT-LBM model is proposed in this paper for solving the inverse problem in fluid mechanics. The PINN-SRT-LBM model consists of three components. The first component involves a deep neural network that predicts the equilibrium control equations in different discrete velocity directions within SRT-LBM. The second component employs another deep neural network to predict non-equilibrium control equations, enabling inference of the fluid's non-equilibrium characteristics. The third component, a physics informed function translates the outputs of the first two networks into physical infor-mation. By minimizing the residuals of the physical partial differential equations (PDEs), the physics informed function infers relevant macroscopic quantities of the flow. The model evolves two sub-models applicable to different dimensions, named PINN-SRT-LBM-I and PINN-SRT-LBM-II models according to the construction of the physical informed function. The innovation of this work is the introduction of SRT-LBM and discrete velocity models as physical drivers into the neural network through the interpretation function. Therefore, PINN-SRT-LBM allows the neural network to handle inverse problems of various dimensions and focus on problem-specific solving. Experimental results confirm the accurate prediction of flow infor-mation at different Reynolds numbers within the computational domain. Relying on the PINN-SRT-LBM models, inverse problems in fluid mechanics can be solved efficiently.

Rice has become the second major food among rural people. It is one of the most nutrient and low-cost food available in Asia. Rice is composed of two major subspecies as Japonica and Indica and it belongs to the Poaceae family. The World Bank predicts that rice demand will grow 51% faster than population growth in 2025. It is high time to develop a model which predicts the type of infected paddy leaf and avoids the loss of grains. In this paper, the proposed hybrid CNN model, three CNN networks with different layer properties are trained parallel. The extracted feature from these CNN networks is combined to provide the classification of the type of infected leaf. Fieldwork was carried and about 340 samples are collected from five different types of classes. The proposed hybrid model was tested with both the fieldwork dataset and also with an available dataset on the internet. The experimental results show that the proposed model outperforms the other CNN network and yields an accuracy value of 98%, a precision value of 95%, and a misclassification rate of 4% respectively.

The modern supply chain (SC) is growing in terms of data, devices, users, and stakeholders, which introduced new security challenges and threats, especially with the reliance on centralized servers or cloud platforms. In addition, increased trust among system participants exposes the SC to a higher risk of vulnerabilities which require strong security measures. This article proposes a hybrid security framework for SC systems, BC-DRLzSC, that integrates Blockchain (BC) and Deep Reinforcement Learning (DRL) designed to operate in a zero trust (ZT) environment. In particular, we propose a decentralized BC-based approach integrated with smart contracts to manage system participant registration and authentication and to control access to system resources. BC-DRLzSC adopts a ZT architecture to reinforce SC security, which can be achieved with an advocate to verify each entity’s trustworthiness before granting or retaining access to system resources. Incorporating the ZT architecture, with BC and DRL, can potentially and significantly bolster SC system security. DRL is employed to develop a proactive attack detection model that continuously monitors the incoming traffic from authenticated nodes within the network and predicts any malicious actions. Finally, we evaluate the performance of our proposed DRL solution using the NSL-KDD dataset.

Pig farms management is involved in multiple factors such as environmental conditions, animal behavior, weight gaining and others. In all those scenarios, it is fundamental to detect each individual and its development as it grows to reach the shipment phase. Therefore, the objective of this study was to apply an automatic individual pig detection algorithm using Deep Learning Techniques, in frames taken from videos recorded during the weaning phase in real production conditions of small and medium producers in tropical conditions in Colombia. The weaning phase was selected because individual detection in each cage is more difficult due to environmental adaptations that piglets undergo after nursing. Piglets tend to cluster together during this phase, making image processing more challenging compared to the fattening phase, where animals are more isolated. The You Only Look Once (YOLOv7) algorithm and VGG Image Annotator were used to detect individuals in two pens separated by gender. All animal postures, lighting conditions were considered. The Precision, Recall and mAP metrics were used to assess the model performance with different confidence values. A precision of 98.3% in a threshold of 0.9 was reached, Recall of 98.5% in a threshold of 0.85. Data augmentation techniques were important to increase the dataset and to have a more realistic model for individuals’ detection. The method used allowed us to identify all the complete pigs’ bodies under different posture and lighting situations.

Background: Despite recent advancements, medical technology has not yet reached its peak. Precision medicine is growing rapidly, thanks to machine learning breakthroughs powered by increased computational capabilities. This article explores a deep-learning application for computer-aided diagnosis in dermatology. Methods: Using a custom model based on EfficientNetB3 and deep learning, we propose an approach for skin lesion classification that offers superior results with smaller, cheaper, and faster inference times compared to other models. The skin images dataset used for this research includes 8,222 files selected from the authors' collection and the ISIC2019 archive, covering six dermatological conditions. Results: The model achieved 95.4% validation accuracy on four categories—melanoma, basal cell carcinoma, benign keratosis-like lesions, and melanocytic nevi—using an average of 1,600 images per category. Adding two categories with fewer images (about 700 each)—squamous cell carcinoma and actinic keratoses—reduced the validation accuracy to 88.8%. The model maintained accuracy on new clinical test images taken under the same conditions as the training dataset. Conclusions: The custom model demonstrated excellent performance on the diverse skin lesions dataset, with significant potential for further enhancements.

This study presents an advanced defect detection approach for solar cells using the YOLOv10 deep learning model. Leveraging a comprehensive dataset of 10,500 solar cell images, annotated with 12 distinct defect types, our model integrates Compact Inverted Blocks (CIB) and Partial Self-Attention (PSA) modules to enhance feature extraction and classification accuracy. Training on the Viking cluster with state-of-the-art GPUs, our model achieved remarkable results, including a mean Average Precision ([email protected]) of 98.5%. Detailed analysis of the model's performance revealed exceptional precision and recall rates for most defect classes, notably achieving 100% accuracy in detecting black core, corner, fragment, scratch, and short circuit defects. Even for challenging defect types such as thick line and star crack, the model maintained high performance with accuracies of 94% and 96%, respectively. The recall-confidence and precision-recall curves further demonstrate the model's robustness and reliability across varying confidence thresholds. This research not only advances the state of automated defect detection in photovoltaic manufacturing but also underscores the potential of YOLOv10 for real-time applications. Our findings suggest significant implications for improving the quality control process in solar cell production.

The ability to decode words accurately at an early age strongly predicts reading competence later on. Decoding-challenged children may find it difficult to understand texts, which might impede their overall academic development. Strong word decoding skills accelerate the process of learning vocabulary and grammar rules in a variety of languages. The paper aimed to collect relevant literature regarding word decoding ability in the world of the language acquisition process. Policymakers and educators will be greatly impacted by realizing how crucial word decoding is to language learning. Providing targeted interventions for struggling readers, encouraging a positive reading culture, and explicitly teaching phonological and orthographic abilities are all essential components of effective reading education. Promoting decoding proficiency also requires making sure that people have access to excellent reading materials and tools. In order to enable learners to become great readers and communicators across linguistic and cultural boundaries, educators and policymakers should prioritize phonemic awareness from an early age and use effective teaching methodologies.

Employing phonemic awareness in language development can lead to transformative educational outcomes. Having mastered this skill, students have a good foundation in language comprehension, writing, and reading, which increases their chances of academic achievement. This change can affect entire classrooms and schools, fostering a culture of literacy and academic performance, rather than just a select few students. The aim of the study is to gather literature that offers substantial information about this topic based on the facts presented. The overwhelming body of research points to the benefits of teaching phonemic awareness in early childhood education. The foundation of transformative education is phonemic awareness, which fosters fundamental language and reading skills. This profound effect emphasizes how crucial phonemic awareness is to the teaching process. Educators can use phonemic awareness to boost students' language development and create a transformative learning environment by putting these guidelines into practice.

Partial Differential Equations (PDEs) constitute a fundamental framework for modeling various physical phenomena across diverse fields such as physics, engineering, and finance. Solving PDEs accurately and efficiently remains a significant challenge, particularly when dealing with complex systems or high-dimensional data. In this paper, we present a novel approach based on deep learning techniques to investigate the effective factors in solving PDEs. Our methodology leverages the expressive power of deep neural networks to learn and represent the underlying relationships between input parameters and the solutions of PDEs. By incorporating domain knowledge into the network architecture and training process, our approach aims to provide insights into the key factors influencing the solution of PDEs. We demonstrate the effectiveness of our method through numerical experiments on various PDEs, showcasing its capability to identify important features and improve predictive accuracy. Our findings suggest that deep learning techniques offer a promising avenue for understanding and analyzing the complex dynamics inherent in PDEs, paving the way for enhanced computational methods in scientific and engineering applications.

There exists an implicit potential limitation in every physical discoveries that has been implemented and understood. However, the limitations can be bounded within a safe limit to prevent any constructing theory to be free from errors. As, it’s the inert nature of the humans, to go far beyond the scope of experimental findings in order to pursue any studies with the sole help of logical reasoning and mathematics, the argument can be prevailed in the form of WEAK Clampdown Effect & STRONG Clampdown Effect. More, the theories are constructed out of physical nature, more the theory gets hypothetical without any finding evidence, but that does or doesn’t actually justify the phenomenon, that too with the more increment of KARDASHEV Scale, more moderate ways of experimentation got developed curbing down the limitations within the human limit of ‘ERRORS’, that does can be neglected by approximation. Relationship being cross-judgmental on the basis of the computational limits and calculation accuracy, leading to a soft singularity, as a warning, that if computer powers cannot be checked on the basis of error approximations, then this may lead to the hitting of a hard singularity, that in phase with the forbidden gap (or after the optimum limit that arises at the core constraints of nature) to prevent the computation being carried off with respect to super-intelligence machines that are cognitive capability oriented future computers responsible for self growth & reproduction with more improvement algorithm, restricting all forms of humanity & constraints the human growth by virtue of limiting capacities of the humans as compared to computers.

The anisotropy in the CMBR detected by the COBE satellite has sprouted the research and theories of the void that got created, after being washed away by a parallel universe after its collision. This details of the roadmap to the parallel universe, that are previously been entangled, but now, separated, with the concept of 2-time dimensions as a time curve of containing the closed curves embedded on the surface area, thereby time running backward in orientation in the parallel universe, along with the perspective of eternal inflation and divided subspaces giving birth to twin universes are provided here. This time curve being responsible for creating an exponentiality of time frames, growing in layers, giving us the perception of the confabulations being an indication of the previously connected worlds.

The apparent shape of the black hole shadow provides a full description of the spin, the inclination angle and the charge of a Kerr black hole, without any astrophysical process or underlying theory in the astrophysical process.

In case of the maximally rotating Black Holes (BH) through Kerr-Neumann frames, or as described in Boyer-Lindquist coordinates metrics, the rotation axis of the BHs inputs a frame dragging effect i.e., relativistically a Lens-Thirring Precession that accelerates the photon trajectories oscillates with a shaped induced rotations through the ring singularity, between alternate universes, as a means of an induced geodesics that takes a sharp turning points back and forth provided, in the prograde photon sphere, due to magnetorotational instability, the path tracing of a photons circulates as a smooth fiber bundles over the event horizon curves, that when gets interpolate between mixed trajectories behaves as a geodesics and thus forms a smooth Jacobi-fields through Jacobi-lines by mutual intersection of geodesics over the photon sphere which when somehow gets leaked inside the event horizon, then gets sucked in with not sufficient escape velocity for retardation and trapped in the compact singularity, oscillating back and forth through alternate universes.

Chronology unprotected mechanisms are considered with a very low gravitational polarization to make the wormhole traversal with positive energy density everywhere. No need of exotic matter has been considered with the assumption of the Einstein-Dirac-Maxwell Fields, encountering above the non-zero stress-energy-momentum tensor through spacelike hypersurfaces by a hyperbolic coordinate shift.

Sparse training (ST) aims to ameliorate deep learning by replacing fully connected artificial neural networks (ANNs) with sparse or ultra-sparse ones, such as brain networks are, therefore it might benefit to borrow brain-inspired learning paradigms from complex network intelligence theory. Here, we launch the ultra-sparse advantage challenge, whose goal is to offer evidence on the extent to which ultra-sparse (around 1% connection retained) topologies can achieve any leaning advantage against fully connected. Epitopological learning is a field of network science and complex network intelligence that studies how to implement learning on complex networks by changing the shape of their connectivity structure (epitopological plasticity). One way to implement Epitopological (epi- means new) Learning is via link prediction: predicting the likelihood of non-observed links to appear in the network. Cannistraci-Hebb learning theory inspired the CH3-L3 network automata rule for link prediction which is effective for general-purpose link prediction. Here, starting from CH3-L3 we propose Epitopological Sparse Meta-deep Learning (ESML) to apply Epitopological Learning to sparse training. In empirical experiments, we find that ESML learns ANNs with ultra-sparse hyperbolic (epi-)topology in which emerges a community layer organization that is meta-deep (meaning that each layer also has an internal depth due to power-law node hierarchy). Furthermore, we discover that ESML can in many cases automatically sparse the neurons during training (arriving even to 30% neurons left in hidden layers), this process of node dynamic removal is called percolation. Starting from this network science evidence, we design Cannistraci-Hebb training (CHT), a 4-step training methodology that puts ESML at its heart. We conduct experiments on 7 datasets and 5 network structures comparing CHT to dynamic sparse training SOTA algorithms and the fully connected counterparts. The results indicate that, with a mere 1% of links retained during training, CHT surpasses fully connected networks on VGG16, GoogLeNet, ResNet50, and ResNet152. This key finding is an evidence for ultra-sparse advantage and signs a milestone in deep learning. CHT acts akin to a gradient-free oracle that adopts CH3-L3-based epitopological learning to guide the placement of new links in the ultra-sparse network topology to facilitate sparse-weight gradient learning, and this in turn reduces the convergence time of ultra-sparse training. Finally, CHT offers the first examples of parsimony dynamic sparse training because, in many datasets, it can retain network performance by percolating and significantly reducing the node network size. Our code is available at: https://github.com/biomedical-cybernetics/Cannistraci-Hebb-training.

The human eye is a vital source of collecting information worldwide via daily observation. The computer science area recognizes it in research as a human-computer interaction. Human blink is an integral part of this observation as a research topic. Several studies have been conducted on eye blinking and left-right eye movements. Previous studies conducted on the eye blink consider the availability of hardware devices high in the budget, high Precision, and low light expo-sure, unlike our study, which uses low-budget devices as simple as a webcam and more versatile usable techniques, incredibly both dim and high light to name a few. This study offers the observational approach via ResNet101v2, VGG-19, and Convolution Neural Network (CNN) architectures. Outperforming both VGG-19 and CNN in this study, ResNet101v2 achieves an impressive accuracy of 98.2%. In contemporary times, deep learning in AI is taking an advanced form. This study attempts to provide a new insight into the real-world implementation of the eye blink.

AI tools provide individualized learning experiences tailored to specific language learners' requirements. Artificial intelligence-driven programs can customize lessons, exercises, and feedback by evaluating a learner's progress and determining strengths and shortcomings. This individualized method aids students in concentrating on their areas of weakness, thus improving their total language competency. This narrative literature review aims to gather relevant literature discussing AI tools as supplementary support in aiding a learner's language acquisition. Relevant studies stated that there are a lot of chances to improve learning outcomes when AI tools are used in language acquisition. Teachers who want to give their students more resources and help should consider including these tools in their lessons. To preserve the interpersonal and cultural components of language learning, it is imperative to strike a balance between the application of AI and conventional teaching techniques. AI tools are always accessible, providing assistance to learners whenever needed. This is especially helpful for individuals with unpredictable schedules or restricted access to conventional language learning materials.

Electricity load forecasting is a crucial undertaking within all the deregulated markets globally. In contemporary times, the transition from conventional electricity grids to Smart Grids constitutes an area where extensive research is conducted on a global scale. Among the research challenges, the investigation of Deep Transfer Learning (DTL) in the field of electricity load forecasting represents a fundamental effort that imparts generality to Artificial Intelligence applications, due to new capabilities, such as knowledge transfer and computational power reduction. In this paper a comprehensive study is conducted for day-ahead electricity load forecasting. For this purpose, three Sequence-to-Sequence (Seq2seq) Deep Learning (DL) models are used, namely the Multilayer Perceptron (MLP), the Convolutional Neural Network (CNN) and the Ensemble Learning Model (ELM), which is consisted of the weighted combination of the outputs of MLP and CNN models. Also, the study focuses on the development of different forecasting strategies based on DTL and emphasizing the way the datasets are trained and fine-tuning for higher forecasting accuracy. In order to implement the forecasting strategies using Deep Learning models, load datasets from three Greek islands, Rhodes, Lesvos, and Chios, are used. The main purpose is to apply DTL for day-ahead predictions (1-24 hours) for each month of the year for Chios dataset after training and fine-tuning the models using the datasets of the three islands in various combinations. After several trials, four DTL strategies are illustrated. In the first strategy (DTL Case 1), each of the three DL models is trained using only Lesvos dataset, while fine-tuning is performed on the dataset of Chios island, in order to create day-ahead predictions for Chios load. In the second strategy (DTL Case 2), data from both Lesvos and Rhodes concurrently are used for the DL model training period, and fine-tuning is performed on the data from Chios. The third DTL strategy (DTL Case 3) contains the training of the DL models using Lesvos dataset, and the testing period performed directly on the Chios dataset without fine-tuning. The fourth strategy is a Multi-task Deep Learning (MTDL) approach, which has been extensively studied in recent years. In MTDL, the three DL models are trained simultaneously on all three datasets and the final predictions are made on the unknown part of the dataset of Chios. In this paper, we explore the performance of DTL and compare the results with those produced with MTDL. The results demonstrated that DTL can be applied with high efficiency for day-ahead load forecasting. Specifically, the two cases with fine-tuning (DTL Case 1 and 2) outperformed MTDL in terms of load prediction accuracy. Regarding the DL models, all three exhibit very high prediction accuracy, especially in the two cases with fine-tuning. The ELM excels compared to the single models. More specifically, for conducting day-ahead predictions, it has been concluded that the MLP model presents best monthly forecasts with a MAPE of 6.24% and 6.01% for the first two cases, the CNN model presents best monthly forecasts with a MAPE of 5.57% and 5.60% respectively and the ELM model achieves best monthly forecasts with a MAPE of 5.29% and 5.31%, respectively, indicating the very high accuracy it can achieve.

The main objective of this study is to conduct a bibliometric analysis of scholarly publications of Authorship Pattern. The present study covers 1723 research papers published in the area of authorship pattern and indexed in Scopus database from the year 2013 to 2022. These research publications considered for the present study have been analysed based on their year wise growth, pattern of authorship, times citations, type of publication, most productive publication source as well as countries and institutions. The study shows the positive growth of the literatures with collaborative authorship pattern and good citation status. This original research paper will be helpful to the researchers of library and information science, especially who are working in the area of bibliometrics studies.

Driven by the importance of early detection for improving patient outcomes, this study investigates the effectiveness of various machine learning algorithms in predicting lung cancer based on clinical data. Lung cancer remains a significant global health concern, and this research seeks to contribute to advancements in early diagnosis through the application of machine learning techniques. The dataset consists of 385 training and 97 test samples, with a k-fold cross-validation approach (k=5) utilized to mitigate overfitting. Additionally, the ADASYN oversampling technique is employed to address class imbalance. Our analysis includes traditional algorithms such as Logistic Regression and Decision Trees, as well as ensemble methods like XGBoost, LGBM, and AdaBoost. Furthermore, we explore the effectiveness of deep learning models, particularly Deep Neural Networks (DNN). Results demonstrate promising accuracy rates across all models, with some outperforming others in terms of precision, recall, and F1-score. Our findings reveal that LGBM achieves the highest accuracy among all models, with an accuracy rate of 96.91%. It also exhibits superior performance in terms of precision, recall, and F1-score, particularly in classifying both positive and negative instances of lung cancer.

Estimating the ocean’s subsurface thermohaline information from satellite measurements is essential for understanding ocean dynamics and El Niño phenomenon. This paper proposes an improved double-output Residual Neural Network (DO-ResNet) model to concurrently estimate the ocean subsurface temperature (OST) and ocean subsurface salinity (OSS) in the tropical Western Pacific using multi-source remote sensing data, including sea surface temperature (SST), sea surface salinity (SSS), sea surface height anomaly(SSHA), sea surface wind (SSW), and geographical information (including longitude (LON) and latitude (LAT)). In the model experiment, Argo data were used to train and validate the model, and the root mean square error (RMSE), normalized root mean square error (NRMSE) and coefficient of determination (R²) were employed to evaluate the model's performance. The results showed that the sea surface parameters selected in this study have a positive effect on the estimation process, and the average RMSE and R² values for estimating OST (OSS) by the proposed model are 0.34 °C (0.05 psu) and 0.91 (0.95), respectively. Under the data conditions considered in this study, DO-ResNet demonstrates superior performance relative to the extreme gradient boosting model, random forest model, and artificial neural network model. Additionally, this study evaluates the model’s accuracy by comparing its estimations of OST and OSS across different depths with Argo-derived data, demonstrating the model's ability to effectively capture the most spatial features, and by comparing NRMSE across different depths and seasons, the model displays strong seasonal adaptability. In conclusion, this research introduces a novel artificial intelligence technique for estimating OST and OSS in the tropical Western Pacific Ocean.

This research explores the intricate relationship between gravitational and cosmic redshift phenomena, unveiling a profound understanding of how light behaves as it traverses the cosmos. The study begins with an examination of gravitational redshift, a well-established concept occurring when photons move away from massive gravitational sources, such as stars within galaxies. Gravitational redshift, expressed as λ/λ₀, manifests within the gravitational influence and extends to the boundary of the observed "zero-gravity sphere" enveloping galaxies. Within this remarkable zero-gravity sphere, gravitational effects persist, while the antigravity influence of dark energy remains negligible. As a result, gravitational redshift dominates, and cosmic redshift is notably absent within the sphere. Photons within this sphere maintain their constant speed 'c' and undergo gravitational redshift exclusively. However, as photons exit the zero-gravity sphere at a distance 'r' equivalent to the source star's radius, they encounter the onset of cosmic redshift, quantified as {(λ_obs - λ_emit)/ λ_emit}. Cosmic redshift blends with gravitational redshift, forming the effective redshift of the photon. Critically, the effective cosmic redshift surpasses gravitational redshift, illuminating a profound revelation: photons traverse a greater "light-traveled distance" than their proper distance from the source. In essence, cosmic redshift signifies that photons move across their intended distances at their intrinsic speed c, while the expanding universe introduces a relative distance expansion, influenced by antigravity. This research delves into the intricate dance between gravitational and cosmic redshift, shedding light on their remarkable implications for our comprehension of the expanding universe.

The research paper provides a mathematical framework for understanding phase shift in wave phenomena, bridging theoretical foundations with real-world applications. It emphasizes the importance of phase shift in physics and engineering, particularly in fields like telecommunications and acoustics. Key equations are introduced to explain phase angle, time delay, frequency, and wavelength relationships. The study also introduces the concept of time distortion due to a 1° phase shift, crucial for precise time measurements in precision instruments. The research also addresses infinitesimal wave energy loss related to phase shift, enriching our understanding of wave behavior, and impacting scientific and engineering disciplines.

Classifying network flow subsequences in an Industrial IoT gateway is an effective method for identifying Industrial IoT faults. This paper proposes a subsequence classification algorithm SSGBUL-IKNN based on unsupervised learning encoding to address the problem of low classification accuracy. Firstly, we built a network module based on unsupervised learning to encode the flow sequence of the Industrial IoT gateway. In the encoding module, a subsequence calibration algorithm controls the increasing error during the coding process. Then, the specific fault type is obtained through an improved KNN classification algorithm based on the indication distance source from the integrated coding sequences converted by multi-dimensional network flow sequences. The test result on three Industrial IoT datasets of a sewage treatment plant shows that the accuracy of SSGBUL-IKNN in this paper exceeds 92%, significantly higher than the algorithm DTW and TSF. It reaches the classification requirements of Industrial IoT fault diagnosis.

This study describes a novel method for grading pathological sections of gliomas. Our own integrated hyperspectral imaging system was employed to characterize 270 bands of cancerous tissue samples from microarray slides of gliomas. These samples were then classified according to the guidelines developed by the World Health Organization, which define the subtypes and grades of diffuse gliomas. We explored a hyperspectral feature extraction model called SMLME-Resnet using microscopic hyperspectral images of brain gliomas of different malignancy grades. The model combines the channel attention mechanism and multi-scale image features to automatically learn the pathological organization of gliomas and obtain hierarchical feature representations, effectively removing the interference of redundant information. It also completes multi-modal, multi-scale spatial and spectral feature extraction to improve the automatic classification of glioma subtypes. The proposed classification method demonstrated high average classification accuracy (>97.3\%) and Kappa coefficient (0.954), indicating its effectiveness in improving the automatic classification of hyperspectral gliomas. The method is readily applicable in a wide range of clinical settings, offering valuable assistance in alleviating the workload of clinical pathologists. Furthermore, the study contributes to the development of more personalized and refined treatment plans, as well as subsequent follow-up and adjustment of treatment, by providing physicians with insights into the underlying pathological organization of gliomas.

Consumer food environments have transformed dramatically in the last decade. The number of food outlets has increased, and a large proportion of the UK population now purchase food from a takeaway or restaurant at least once a week. Despite these developments, national spending on food control has reduced and many Local Authorities struggle to meet health inspection targets. This work presents a data driven approach to enhance current inspection processes with a view to reduce consumer risk of foodborne illness whilst eating outside the home. We explore the utility of three machine learning algorithms to predict non-compliant food outlets in England and Wales as defined by Food Hygiene Rating Scheme scores >= 2. Using socio-demographic, business type and urbanness features we experiment with under and over sampling strategies at five ratios to address problems of class imbalance in the dataset prior to analysis. We find that Synthetic Minority Over Sampling Technique alongside a Random Forest algorithm with a 1:1 sampling strategy provides the best predictive power. Our final model retrieves 84% of total non-compliant outlets in a test set of 92,595 (sensitivity=0.843, specificity=0.745, precision=0.274). We discuss the utility of machine learning algorithms to prioritise high risk establishments for inspection by Local Authority officials and make recommendations for weighting outcomes to improve their appropriateness in an applied setting.

Amid escalating urbanization, devising rational commercial space layouts is a critical challenge. Leveraging machine learning, this study uses a Back-propagation (BP) neural network to optimize commercial spaces in Weinan City's central urban area. The results indicate an increased number of commercial facilities with a trend of multi-centered agglomeration and outward expansion. Based on these findings, we propose a strategic framework for rational commercial space development emphasizing aggregation centers, development axes, and spatial guidelines. This strategy provides valuable insights for urban planners in small and medium-sized cities in the Yellow River Basin and metropolitan areas, ultimately showcasing the power of machine learning in enhancing urban planning.

In recent decades, the requirements for implantable medical devices increased, but the risks of implant rejection still exist. These issues are primarily associated with poor osseointegration, leading to biofilm formation on the implant surface. This study focuses on addressing these issues by developing a biomaterial for implant coatings. 45S5 Bioglass has been widely used in tissue engineering due to its ability to form a hydroxyapatite layer, ensuring a strong bond between the hard tissue and the bioglass. In this context, 45S5 bioglasses, modified by the incorporation of different amounts of copper oxide, from 0 to 8 mol%, were synthesized by the melt-quenching technique. The incorporation of Cu ions does not show a significant change in the glass structure. Since the bioglass exhibited the capacity of being polarized, and therefore promoting the osseointegration effectiveness, the electrical properties of the prepared samples were studied using the impedance spectroscopy method, in the frequency range of 102-106 Hz and temperature range of 200-400 K. The effects of CuO on charge transport mobility were investigated. Additionally, the bioactivity of the modified bioglasses was evaluated through immersion tests in simulated body fluid. The results revealed the initiation of a Ca-P-rich layer formation on the surface within 24 h, indicating the potential of the bioglasses to enhance the bone regeneration process.

Low-energy cosmic rays (LECRs) play a crucial role in the formation of planetary systems, and detecting and reconstructing the properties of early LECRs is essential for understanding the mechanisms of planetary system formation. Given that LECRs interact with the surrounding medium to produce nuclear de-excitation line emissions with energy mainly within 0.1–10 MeV, which are unaffected by stellar wind modulation, these gamma-ray emissions can accurately reflect the properties of LECRs. This study introduces an innovative method for using gamma-ray emissions to infer LECR properties. We employed the Parker transport equation to simulate the propagation and spectral evolution of LECRs in a protoplanetary disk and calculated the characteristic gamma-ray emissions resulting from interactions between LECRs and disk material. These gamma-ray emissions encapsulate the spectral information of LECRs, providing a powerful tool to reconstruct the cosmic ray environment at that time. This method, supported by further theoretical developments and observations, will fundamentally enhance our understanding of the impact of CRs on the origin and evolution of planetary systems and address significant scientific questions regarding the cosmic ray environment at the origin of life.

Deep learning is an emerging area of machine learning (ML) research. It comprises multiple hidden layers of artificial neural networks. The deep learn- ing methodology applies nonlinear transformations and model abstractions of high level in large databases. The recent advancements in deep learning architec- tures within numerous fields have already provided significant contributions in artificial intelligence. This article presents a state of the art survey on the contri- butions and the novel applications of deep learning. The following review chron- ologically presents how and in what major applications deep learning algorithms have been utilized. Furthermore, the superior and beneficial of the deep learning methodology and its hierarchy in layers and nonlinear operations are presented and compared with the more conventional algorithms in the common applica- tions. The state of the art survey further provides a general overview on the novel concept and the ever-increasing advantages and popularity of deep learning.

Precision agriculture is a farm management technology that involves sensing and then responding to the observed variability in the field. Remote sensing is one of the tools of precision agriculture. The emergence of small unmanned aerial vehicles (sUAV) have paved the way to accessible remote sensing tools for farmers. This paper describes the comparison of two popular off-the-shelf sUAVs: 3DR Iris and DJI Phantom 2. Both units are equipped with a camera gimbal attached with a GoPro camera. The comparison of the two sUAV involves a hovering test and a rectilinear motion test. In the hovering test, the sUAV was allowed to hover over a known object and images were taken every second for two minutes. The position of the object in the images was measured and this was used to assess the stability of the sUAV while hovering. In the rectilinear test, the sUAV was allowed to follow a straight path and images of a lined track were acquired. The lines on the images were then measured on how accurate the sUAV followed the path. Results showed that both sUAV performed well in both the hovering test and the rectilinear motion test. This demonstrates that both sUAVs can be used for agricultural monitoring.

This paper presents a methodology based on deep learning models and metaheuristic algorithms for the optimization of airfoils for the design of aircraft wings with large endurance. The use of AZTLI-NN (a neural network with an architecture composed of a multilayer perceptron and a variational autoencoder) is implemented for the prediction of graphs of the aerodynamic coefficients of the airfoil as a function of the angle of attack. This neural network presents good predictions of the aerodynamic coefficients, similar to the coefficients obtained with computational fluid dynamics simulations. AZTLI-NN in combination of metaheuristic algorithms and the CST profile parameterization method show excellent performance in single-objective and multi-objective profile optimization tasks.

Carbon nanotubes (CNTs) can be considered as semi-rigid all-carbon polymers. However, unlike conventional polymers that can form 3D networks such as hydrogels or elastomers through crosslinking with each other in solution, the cylindrical carbon lattice of CNTs was not believed to be directly crosslinkable in solution until our recent discovery of UV-defluorination driven direct CNT crosslinking. In this study, we further reveal that the UV-defluorination-driven crosslinked CNTs are metastable and can decompose more readily than fluorinated or pristine CNTs upon exposure to Raman laser irradiation. Specifically, we investigate the stability of UV-defluorinated single-walled and multi-walled fluoro-nanotubes using Raman spectroscopy under controlled varying laser power. The results indicate that both the defluorinated single-walled and multi-walled CNTs are thermally less stable than pristine CNTs or untreated fluorinated CNTs, which can be attributed to the strains on the crosslinking bonds created from the curved carbon lattice of linked CNTs. This instability, particularly evident under high-power laser irradiation, leads to combustion processes ignited at relatively lower temperatures that cause an extended burned area centered on the laser spot, offering potential future applications as mechanically robust, lightweight materials with feasible post-use degradation options.

The terpolymers of N-vinylpyrrolidone (VP) with acrylic acid and triethylene glycol methacrylate were synthesized with more than 90% yield by radical copolymerization in ethanol from monomeric mixtures of different composition (98 : 2 : 2, 95 : 5: 2 and 98 : 2: 5). Their physical and chemical characteristics such as monomer composition, absolute molecular masses and hy-drodynamic radii in aqueous media at different temperature were determined. The temperature effect on the behavior of terpolymers in water and aqueous saline buffer solution with pH 7.4 has been studied and the ability of a copolymer enriched with dimethacrylates units was discovered to respond to a temperature change in these media. On the basis of terpolymers and linear polyvi-nylpyrrolidone (PVP), polymer compositions of hydrophobic dye methyl pheophorbide a, MPP, that is fluorescent in the red region of the spectrum, were obtained; the sizes of the polymer nanostructures of MPP in water were determined. The structures based on terpolymers were demonstrated to be more stable than MPP-PVP ones. It was carried out the quantum-chemical modelling of the possible structures of MPP-copolymer that formed as a result of intermolecular interaction between MPP and terpolymer’s chains; the possibility of the formation of hydrogen bonds between the donors of the electrons of terpolymer units and the proton donors of the MPP molecule was shown. Using the MTT test, it was established that copolymers of various compositions are low toxic for non-tumor Vero cells and HeLa tumor cells. It was shown that the cytotoxicity of polymer particles loaded with MPP for FetMSC and HeLa cells increased. Using fluorescence microscopy, the accumulation and distribution of polymer particles in non-tumor (FetMSC) and tumor (HeLa) cells was studied and an increase in the accumulation of MPP with both types of particles was shown.

Classical Arabic poetry is a form of Arabic literature, and almost every piece of Arabic poetry follows one of the 16 meters. The rhythmic framework of the poems or the verses is called meters. The deep learning (DL) model was implemented using TensorFlow in this work using a large dataset of Arabic poetry. The character level encoding was used to convert text to integers for classifying the full-verse and half-verse data. The study evaluates the data without removing diacritics from the text. The train-test-split method with a 70-15-15 split was employed for classification. 15% of the total data was considered unseen test data for all models. The work was conducted with multiple deep learning models, including the Long Short-Term Memory (LSTM), Gated Recurrent Units (GRU), and Bidirectional LSTM (Bi-LSTM). The Bi-LSTM model shows the best accuracy of all the models specified, with 97.53% for full-verse and 95.23% for half-verse without removing diacritic data.

Electrospun ultrathin fibers based on binary compositions of polylactide (PLA) and poly(ε-caprolactone) (PCL) with different ratios of polymer components from 0/100 to 100/0 wt. % were studied. Using a combination of thermal (DSC) and relaxation (EPR) measurements, the effect of biopolymers content on the characteristics of the crystal structure of PLA and PCL and the diffusive rotational mobility of the stable TEMPO radical in the amorphous regions of PLA/PCL compositions was shown. It was revealed that after PLA and PCL blending, significant changes in the degree of crystallinity of PLA, PCL segmental mobility, sorption capacity of the radical as well as activation energy of rotational diffusion in the amorphous regions of PLA/PCL composition are observed. The characteristic region of biopolymers’ composition from 50/50 to 30/70 % PLA/PCL blends ratio was found, where the inversion transition of PLA from dispersive medium to dispersive phase where an inversion transition is assumed when the continuous medium of the PLA transforms into a discrete phase. The performed studies made it possible for the first time to carry out a comprehensive analysis of the effect of the system component ratio on the structural and dynamic characteristics of the PLA/PCL film material at the molecular level.

Recent studies have shown correlations between the microbiota's composition and various health conditions. Machine learning (ML) techniques are essential for analyzing complex biological data, particularly in microbiome research. ML methods help analyze large datasets to uncover microbiota patterns and understand how these patterns affect human health. This study introduces a novel approach combining statistical physics with the Monte Carlo (MC) methods to characterize bacterial species in the human microbiota. We assess the significance of bacterial species in different age groups by using notions of statistical distances to evaluate species prevalence and abundance across age groups and employing MC simulations based on statistical mechanics principles. Our findings show that the microbiota composition experiences a significant transition from early childhood to adulthood. Species such as Bifidobacterium breve and Veillonella parvula decrease with age, while others like Agathobaculum butyriciproducens and Eubacterium rectale increase. Additionally, low-prevalence species may hold significant importance in characterizing age groups. Finally, we propose an overall species ranking by integrating the methods proposed here in a multicriteria classification strategy. Our research provides a comprehensive tool for microbiota analysis using statistical notions, ML techniques, and MC simulations.

Effective agricultural management in maize production operations starts with the early quantification of seedlings. Accurately determining plant presence allows growers to optimize planting density, allocate resources, and detect potential growth issues early on. This study presents an in-depth analysis of multiple object detection models used by drones to count maize seedlings, while concurrently investigating the influence of planting density, flight altitude, and plant growth stage. The findings of this study demonstrate that one-stage models are able to more accurately detect maize seedlings than two-stage models. In particular, YOLOv8n exhibits outstanding performance, achieving an F1-score of over 0.92 under various density conditions and maintaining a stable performance, especially under densities below 105,000 plants/ha. Additionally, planting density and growth stage were observed to significantly affect detection accuracy, with performance declining as density and growth stage increased. Image resolution and detection were impacted by flight altitude, with lower flights producing higher-quality results. Ultimately, YOLOv8n displays optimal performance under various conditions, providing crucial data to support intelligent decision-making. This research offers valuable insights into the application of object detection technology and provides a basis for the future development of precision agriculture.

This work presents the results regarding the synthesis of tungsten nanoparticles (W NPs) by magnetron sputtering combined with gas aggregation (MSGA) when H2 mixed with Ar is used as working gas, the amount of H2 being increased up to 82%. The results show that up to 40% H2 in discharge the synthesis rate increases over 60 times, rapidly decreasing for over 50% H2 in discharge. The W dust is still produced in H2 dominated discharge (82%), the deposition rate being small but not negligible (20 mg/hour). The obtained WNPs are isolated, with the diameter decreasing from 50 nm to 15 nm when the amount of H2 in discharge is smaller than 41%. Over this value, the particles tend to agglomerate, forming structures similar to film-like deposits. Also, the diameter of the deposited spots on substrates is dependent on the H2 content in discharge. This allows the efficient coating of substrates with dimensions up to 26 mm by translating them in front of the MSGA cluster source exit aperture. Supplementary, for 41% H2 in discharge, the influence of synthetic air leaks (0-5%) in discharge was investigated. The deposition rate decreases rapidly (ceasing for around 4% air in discharge) and the obtained nanoparticles tend to agglomerate (at 2% air content, the dust deposit has the aspect of a near continuous film). Chemical composition investigations show a pronounced tendency of oxidation, nitridation and oxynitride formation in the presence of air leaks.

In this work SiC-Ti3AlC2 and TiC-Ti3AlC2 composites produced by additive manufacturing are investigated. The fused granules fabrication (FGF) method as one of the material extrusion additive manufacturing (MEAM) technology is used to obtain composite samples. Composites with different ratios between components and different powder:polymer ratios are investigated. The technological features of the additive formation of composites are investigated, as well as their structure and properties. The optimal sintering temperature to form the best mechanical properties for both composites is 1300 °C. The composites have a regulatable porosity. Ti3AlC2 content, sintering temperature, and polymer content in the feedstock are the main parameters that regulates the porosity of FGF samples.

Models of subsurface structures are important for successful deposit exploration but are challenged by the need to integrate data from different geophysical methods. In the present study, we evaluated a method of joint inversion in which audio-magnetotelluric (AMT) and dual frequency induced polarization (DFIP) data sets are inverted simultaneously to produce a consistent 2D resistivity model to show a clear image of subsurface structures. To achieve the objectives, we conducted AMT and DFIP surveys first on the same survey line within the Dongjun lead-zinc deposit in inner Mongolia by developing 31 AMT survey sites with an interstation separation of 40 m on a 1440 m survey track and operated in fifty-three frequencies in the range 1–10,400 Hz to record the resistivity distribution of subsurface to depths exceeding 800 m. The same survey setup up was applied to the DFIP method by utilizing the SQ-3C model with a pole-dipole array configuration and conducted measurements at frequencies of 4 Hz and 4/13 Hz. We first separately inverted AMT and DFIP measurements. The two-dimensional (2D) model obtained from AMT data revealed distinct low resistivity anomalies in the middle of the 2D inversion model. In contrast, the DFIP inversion model showed a high resistive body in the same region. In response to the discrepancies observed in the separate 2D inversion models, we implemented a joint inversion for both the AMT and DFIP datasets. The joint inversion resistivity model shows surficial conducting bodies and a high conductive body along the profile with relatively high Percent Frequency Effect (PEF) indicating high chargeability. The final joint inversion resistivity model clearly images the large silica alteration zone and the Pb-Zn mineralization. This study demonstrates the feasibility of a joint inversion methodology and highlights the value of integrating geophysical methods through joint inversion for enhanced characterization and exploration of lead-zinc ores.

In this perspective article, we ponder topographical enhancements of artificial neural networks. In our recent paper in JMLR, we proved a quasi-equivalence between the network width and depth and also discussed the power of intra-links, which can be viewed as network height. In 1982, Hopfield published a network to model human associative memory, which contains many loops for dynamic evolution toward fixed points. Based on noising-denoising loops, diffusion models are recently developed to enable Bayesian modeling and inference with big data. Furthermore, we envision development of multi-AI-agent systems through “netware” engineering as a quantum leap of software engineering for emergent behaviors and autonomous AI at individual and population levels. We believe that the novel use of links and loops in space and time via multi-scale coupling would catalyze the next-generation neural networks.

Atmospheric correction is the processes of converting radiance measured at a spectral 1 sensor to the reflectance of the materials in a multispectral or hyperspectral image. This is an 2 important step for detecting or identifying the materials present in the pixel spectra. We present 3 two machine learning models for atmospheric correction trained and tested on 100,000 batches of 40 4 reflectance spectra converted to radiance using MODTRAN, so the machine learning model learns 5 the radiative transfer physics from MODTRAN. We created a theoretically interpretable Bayesian 6 Gaussian process model and a deep learning autoencoder treating the atmosphere as noise. We 7 compare both methods for estimating gain in the correction model to the well-know QUAC method 8 of assuming a constant mean endmember reflectance. Prediction of reflectance using the Gaussian 9 process model outperforms the other methods in terms of both accuracy and reliability.

Medical brain image analysis is a necessary step in the Computers Assisted /Aided Diagnosis (CAD) systems. Advancements in both hardware and software in the past few years have led to improved segmentation and classification of various diseases. In the present work, we review the published literature on systems and algorithms that allow for classification, identification, and detection of White Matter Hyperintensities (WMHs) of brain MRI images specifically in cases of ischemic stroke and demyelinating diseases. For the selection criteria, we used the bibliometric networks. Out of a total of 140 documents we selected 38 articles that deal with the main objectives of this study. Based on the analysis and discussion of the revised documents, there is constant growth in the research and proposal of new models of deep learning to achieve the highest accuracy and reliability of the segmentation of ischemic and demyelinating lesions. Models with indicators (Dice Score, DSC: 0.99) were found, however with little practical application due to the uses of small datasets and lack of reproducibility. Therefore, the main conclusion is to establish multidisciplinary research groups to overcome the gap between CAD developments and their complete utilization in the clinical environment.

Causality is the most important topic in the history of Western Science, and since the beginning of the statistical paradigm, it meaning has been reconceptualized many times. Causality entered into the realm of multi-causal and statistical scenarios some centuries ago. Despite of widespread critics, today Deep Learning and Machine Learning advances are not weakening causality but are creating a new way of finding indirect factors correlations. This process makes possible us to talk about approximate causality, as well as about a situated causality.

The next generation network requires not only ultra high data rate, global coverage and connectivity, but also reducing network deployment costs and energy consumption. The emergence of reconfigurable intelligent surface (RIS) technology provides an effective way to improve efficiency and reduce cost, while the passive elements bring new challenges of channel estimation (CE) and beam tracking. For a RIS-aided multiple-input and single-output (MISO) system, in this paper, to achieve the channel state information (CSI), we propose a principle component analysis (PCA) based staged channel estimation method. Based on the estimated channel, we propose a deep learning (DL) based beam tracking scheme to realize low-complexity RIS reflection coefficient design, which effectively improves the signal-to-noise ratio (SNR) at the user side. Simulation results verify our proposed channel estimation scheme based on PCA and beam tracking scheme based on DNN for the semi-active RIS-aided MISO systems can obtain approximate performances with much lower computational complexity.

Microscopic vision plays an important role in automated micro-assembly. However, some uncertain factors in the assembly process, such as occlusion and stains can lead to the mistakes of feature extraction. Herein, to solve the problem, the deep learning techniques are introduced into the feature recognition tasks, focusing on the attention mechanism and visualizing CNNs for DL-based microscopic vision. The main contributions are summarized as follows: The CBAM attention mechanism is combined with the YOLOv5 algorithm to improve the accuracy and robustness of feature extraction. The micropart feature occlusion experiment results show that at 70% occlusion degree, YOLOV5-CBAM can reach 97.9% [email protected], which is 4.6% higher than the original one. Visualization analysis of DL-based model is conducted using Grad-CAM to make the decision result more transparent and avoid potential visual detection risks during assembly. The heatmap matching degree between GT area and high-light area is increased by 27.81% on average, which further verify the effectiveness of attention mechanism in micropart feature localization. Additionally, micropart surface stain and droplet quality classification models based on ResNet50 are trained to replace the manual sorting. The visual results are consistent with human eye discernment and judgement, confirming the reliability of parts and droplets sorting.

Skin disease is a very common disease for humans. In the medical industry detecting skin disease and recognizing its type is a very challenging task. Due to the complexity of human skin texture and the visual closeness effect of the diseases, sometimes it is really difficult to detect the exact type. Therefore, it is necessary to detect and recognize the skin disease at its very first observation. In today's era, artificial intelligence (AI) is rapidly growing in medical fields. Different machine learning (ML) and deep learning(DL) algorithms are used for diagnostic purposes. These methods drastically improve the diagnosis process and also speed up the process. In this paper, a brief comparison between the machine learning process and the deep learning process was discussed. In both processes, three different and popular algorithms are used. For the machine Learning process Bagged Tree Ensemble, K-Nearest Neighbor (KNN), and Support Vector Machine(SVM) algorithms were used. For the deep learning process three pre-trained deep neural network models

The application of space robotic manipulators and heightened autonomy for ios represents a paramount pursuit for leading space agencies, given the substantial threat posed by space debris to operational satellites and forthcoming space endeavors. This work presents a guidance algorithm based on drl to solve for the space manipulator path-planning during the motion synchronization phase with the mission target. The goal is the trajectory generation and control of a spacecraft equipped with a 7-dof robotic manipulator, such that its end effector remains stationary with respect to the target point of capture. The ppo drl algorithm is used to optimize the manipulator’s guidance law, and the autonomous agent generates the desired joints rates of the robotic arm, which are then integrated and passed to a model-based feedback linearization controller. The agent is first trained to optimize its guidance policy and then tested extensively to validate the results against a simulated environment representing the motion synchronization scenario of an ios mission.

Deep learning (DL), which is originated from an artificial neural network (ANN), is one of the major technologies of today's smart cybersecurity systems or policies to function in an intelligent manner. Popular deep learning techniques, such as Multi-layer Perceptron (MLP), Convolutional Neural Network (CNN or ConvNet), Recurrent Neural Network (RNN) or Long Short-Term Memory (LSTM), Self-organizing Map (SOM), Auto-Encoder (AE), Restricted Boltzmann Machine (RBM), Deep Belief Networks (DBN), Generative Adversarial Network (GAN), Deep Transfer Learning (DTL or Deep TL), Deep Reinforcement Learning (DRL or Deep RL), or their ensembles and hybrid approaches can be used to intelligently tackle the diverse cybersecurity issues. In this paper, we aim to present a comprehensive overview from the perspective of these neural networks and deep learning techniques according to today's diverse needs. We also discuss the applicability of these techniques in various cybersecurity tasks such as intrusion detection, identification of malware or botnets, phishing, predicting cyber-attacks, e.g. denial of service (DoS), fraud detection or cyber-anomalies, etc. Finally, we highlight several research issues and future directions within the scope of our study in the field. Overall, the ultimate goal of this paper is to serve as a reference point and guidelines for the academia and professionals in the cyber industries, especially from the deep learning point of view.

Timely and accurate information on tree species is crucial for the sustainable management of natural resources, forest inventory, biodiversity detection, and carbon stock calculation. The advancement of remote sensing technology and artificial intelligence has facilitated the acquisition and analysis of remote sensing data, resulting in more precise and effective classification of tree species. Multimodal remote sensing data and deep learning seem to be the current tree species classification research mainstream, whether or not. The current review on the remote sensing data and deep learning tree species classification methods perspectives to analyze the unimodal and multimodal remote sensing data and classification methods in this realm is missing. To bridge the gap, we search for major trends in the remote sensing data and tree species classification methods, provide a detailed overview of classic deep learning-based methods for tree species classification, and discuss the limitations.

The importance of energy systems and its role in economics and politics is not hidden for anyone. This issue is not only important for the advanced industrialized countries, which are major energy consumers, but is also important for oil-rich countries. In addition to the nature of these fuels which contains polluting substances, the issue of their ending up has aggravated the growing concern. Biofuels can be used in different fields for energy production like electricity production, power production or for transportation. Various scenarios have been written about the estimated biofuels from different sources in the future energy system. The availability of biofuels for the electricity market, heating and liquid fuels is very important. Accordingly, the need for handling, modelling, decision making and future forecasting for biofuels can be one of the main challenges for scientists. Recently, machine learning and deep learning techniques have been popular in modeling, optimizing and handling the biodiesel production, consumption and its environmental impacts. The main aim of this study is to evaluate the ML and DL techniques developed for handling biofuels production, consumption and environmental impacts, both for modeling and optimization purposes. This will help for sustainable biofuel production for the future generations.

The success of deep learning (DL) in offline brain-computer interfaces (BCIs) has not yet translated into efficient online applications. This is due to two limiting factors: the need for large amounts of training data in DL and the fact that current DL solutions are primarily developed for offline decoding. To enable real-time decoding, even across subjects without calibration data, we first introduce a novel method real-time adaptive pooling (RAP) to tune existing offline DL models towards online decoding by modifying the pooling layers. To reduce the amount of training data required, our approach leverages different levels of domain adaptation. We show how different settings enable different adaptation solutions. Our results demonstrate that our approach is both powerful and can be calibration-free, providing a robust and practical solution for real-time BCI applications. These findings pave the way for the development of co-adaptive and highly efficient DL-based BCI systems.

This paper delves into the intricate interactions of photons in the realms of gravity and antigravity. Photons, being fundamental particles of light, exhibit remarkable behaviors as they traverse through the cosmos. They journey through the vast expanses of the universe until they venture into the enigmatic invisible realm. The photon's encounters with gravity and antigravity are explored in detail. When confronting the gravitational influence of massive objects, such as celestial bodies, photons neither gain nor lose energy, but they exchange momentum with the external gravitational field while steadfastly preserving their intrinsic momentum. Intriguingly, the photon's interaction with the mysterious force of antigravity, propelled by dark energy, presents an irreversible transformation. The consequences of this interaction are profound, as photons undergo a cosmic redshift of a magnitude greater than that induced by gravity or other redshift mechanisms. This distinctive effect manifests as the photon departs from the gravitational embrace of galaxies and embarks on a journey beyond their boundaries, where the domain of zero gravity commences. Furthermore, the paper elucidates the dynamics of external forces exerted by massive objects on photons during their interactions. These forces momentarily carry the photons while they engage with the massive objects. Yet, despite this external assistance, the photons maintain their original momentum. Notably, within a gravitational field, the effective deviation from this transportation remains zero, reaffirming the photon's commitment to its initial trajectory.

Deep learning (DL) algorithms have recently emerged from machine learning and soft computing techniques. Since then, several deep learning (DL) algorithms have been recently introduced to scientific communities and are applied in various application domains. Today the usage of DL has become essential due to their intelligence, efficient learning, accuracy and robustness in model building. However, in the scientific literature, a comprehensive list of DL algorithms has not been introduced yet. This paper provides a list of the most popular DL algorithms, along with their applications domains.