In the context of improving aircraft safety, this study focuses on the development and evaluation of a graphene-based ice detection system using an environmental chamber. The research is driven by the need for more accurate and efficient ice detection methods, crucial in mitigating in-flight icing hazards. The methodology employed involves testing flat graphene-based sensors in a controlled environment, simulating a variety of climatic conditions that could be experienced in an aircraft during its entire flight. The environmental chamber enabled precise manipulation of temperature and humidity levels, thereby providing a realistic and comprehensive test bed for sensor performance evaluation. The results were significant, revealing the graphene sensors’ heightened sensitivity and rapid response to the subtle changes in environmental conditions, especially the critical phase transition from water to ice. This sensitivity is the key to detecting ice formation at its onset, a critical requirement for aviation safety. The study concludes that graphene-based sensors, tested under varied and controlled atmospheric conditions, exhibit a remarkable potential in enhancing ice detection systems for aircraft. Their lightweight, efficient and highly responsive nature makes them a superior alternative to traditional ice detection technologies, paving the way for more advanced and reliable aircraft safety solutions.

The neural crest, a unique cell population originating from the primitive neural field, has a multi-systemic and structural contribution to vertebrate development. At the cephalic level, the neural crest generates most of the skeletal tissues encasing the developing forebrain and provides the prosencephalon with functional vasculature and meninges. Over the last decade, we have demonstrated that the cephalic neural crest (CNC) exerts an autonomous and prominent control on forebrain and sense organs development. The present paper reviews the primary mechanisms by which CNC can orchestrate vertebrate encephalization. Demonstrating the role of the CNC as an exogenous source of patterning for the forebrain provides a novel conceptual framework with profound implications for understanding neurodevelopment. From a biomedical standpoint, these data suggest that the spectrum of neurocristopathies is broader than expected and that some neurological disorders may stem from CNC dysfunctions.

Periodontitis is microbial infection affecting periodontium, the tooth supporting structure and affects >743 million people worldwide. Neural crest-derived stem cells (NCSCs) hold the promise to regenerate the damaged periodontium. These cells have been identified within adult adipose tissue, periodontal ligament, and palatal tissue. Typical enzymatic isolation protocols are expensive, time consuming and often not clinically compliant. Enzyme-free, mechanical dissociation has been suggested as an alternative method of generating cell suspensions required for cell separation and subsequent expansion ex vivo. In our study, samples of rat skeletal muscle tissue were used to appraise the suitability of a novel mincing method of mechanical dissociation against enzymatic digestion with collagenase and dispase. Skeletal muscle is readily available and has been shown to contain NCSC populations. We used a Rigenera-Human Brain Wave^® prototype mincer to produce a suspension of skeletal muscle-derived cells modeling NCSCs. We have compared the resulting cell cultures produced via mechanical dissociation and enzymatic dissociation, producing single cell suspensions suitable for Magnetic Cell Sorting (MACs) and Fluorescence-activated cell sorting (FACS). Despite the Countess Automated Cytometry data demonstrating that cell suspensions produced by mechanical dissociation (n=24) contain on average 26.8 times as many viable cells as enzymatic cell suspensions (n=18), enzymatic suspensions produced more successful cell cultures. Spheroids and subsequently adherent cells formed from 4 enzymatic cell suspensions (44.4%) vs. 1 mechanical cell suspension (8.3%). Enzymatic digestion protocols formed spheroids faster and more plentifully than mechanical cell suspensions. Adherent cells and spheroids isolated via both methods appear morphologically similarly to NCSCs from our previous studies.

A recent study from our lab revealed that inhibition of cyclooxygenase-2 exclusively reduces the level of PGE2 amongst the prostanoids and hamper the normal development of several structures, strikingly the cranial vault, in chick embryos. In order to unearth the mechanism behind the deviant development of cranial features, the expression pattern of various factors that are known to influence the cranial neural crest cell (CNCC) migration were checked in chick embryo after inhibiting the COX-2 activity using etoricoxib. The compromised level of cell adhesion molecules and their upstream regulators, namely CDH1, CDH2, MSX1, and TGF-β, observed in the etoricoxib treated embryos indicate that COX-2, through its downstream effector PGE2, regulates the expression of these factors perhaps to aid the migration of CNCC. The histological features and levels of FoxD3 as well as PCNA further consolidates the role of COX-2 in migration and survival of CNCC in developing embryo. The results of the current study indicate that the COX-2 plays a pivotal role in orchestrating the proliferation and migration of CNCC during embryonic development of chick.

Bone growth plate abnormalities and skull shape defects are seen in hypophosphatasia, a heritable disorder in humans that occurs due to deficiency of Tissue Nonspecific Alkaline Phosphatase (TNAP, Alpl) enzyme activity. Abnormal development of the cranial base growth plates (synchondroses) and abnormal skull shapes have also been demonstrated in global TNAP-/- mice. To distinguish local vs. systemic effects of TNAP on skull development, we utilized P0-Cre to knockout TNAP only in cranial neural crest derived tissues using TNAP flox mice. Here we show that TNAP deficiency in cranial neural crest leads to leads to skull shape defects and deficient growth of the intersphenoid synchondrosis (ISS). ISS chondrocyte abnormalities included increased proliferation in resting and proliferative zones with decreased apoptosis in hypertrophic zones. ColX expression is increased, indicative of premature differentiation in the absence of TNAP. Sox9 expression is increased in both resting and prehypertrophic zones of mutant mice. Expression of PTHrP and IHH were also increased. Finally, cranial base organ culture revealed that inorganic phosphate (Pi) and pyrophosphate (PPi) have specific effects on cell signaling and phenotype changes in the ISS. Together, these results demonstrate that TNAP expression in growth plate chondrocytes is essential for normal development, and that the mechanism likely involves Sox9, PTHrP, IHH and PPi.

The informational synthesis of neural structures, processes, parameters and characteristics that allow a unified description and modeling as neural machines of natural and artificial neural systems is presented. The general informational parameters as the global quantitative measure of the neural systems computing potential as absolute and relative neural power were proposed. Neural information organizing and processing follows the way in which nature manages neural information by developing functions, functionalities and circuits related to different internal or peripheral components and also to the whole system through a non-deterministic memorization, fragmentation and aggregation of afferent and efferent information, deep neural information processing representing multiple alternations of fragmentation and aggregation stages. The relevant neural characteristics were integrated into a neural machine type model that incorporates unitary also peripheral or interface components as the central ones. The proposed approach allows overcoming the technical constraints in artificial computational implementations of neural information processes and also provides a more relevant description of natural ones.

ABSTRACT Purpose: Tongue image analysis for disease diagnosis is an ancient traditional non-invasive diagnosis technique widely used by traditional medicine practitioners. Deep Learning based multi-label disease detection models offer tremendous potential to clinical decision support systems, by facilitating preliminary diagnosis. Methods: In this work, we propose a multi-label disease detection pipeline, where in observation and analysis of tongue images captured and received via smartphones assist in predicting the health status of an individual. All images are voluntarily given by subjects consulting collaborating physicians. Images thus acquired are first and foremost classified either into a diseased or a normal category by a 5-fold cross-validation algorithm using a convolution neural network (MobileNetV2) model for binary classification. Once the diseased label is predicted, the image is used to diagnose multiple diseases using the prediction algorithm based on DenseNet121. Results: Average accuracy of 93 % was achieved in classifying diseased from normal healthy tongue by detection model with MobileNetV2 architecture. Multilabel disease classification produced more than 90% accurate results for the seven class labels considered. Conclusion: AI based image analysis shows promising results and an extensive dataset could provide further improvements to this approach. Rather than employing high-cost sophisticated image capturing setup, experimenting with smartphone images opens opportunity to provide preliminary health status to individuals on smartphone prior to further line of treatment and diagnosis.

We propose a neural-network-based watermarking method that introduces the quantized activation function that approximates the quantization of JPEG compression. Many neural-network-based watermarking methods have been proposed. Conventional methods have acquired robustness against various attacks by introducing an attack simulation layer between the embedding network and the extraction network. The quantization process of JPEG compression was replaced by the noise addition process in the attack layer of the conventional methods. In this paper, we propose a quantized activation function that can simulate the JPEG quantization standard as it is in order to improve the robustness against the JPEG compression. Our quantized activation function consists of several hyperbolic tangent functions and is applied as an activation function for neural networks. Our network was introduced in the attack layer of ReDMark proposed by Ahmadi et al. to compare it with their method. That is, the embedding and extraction networks had the same structure. We compared the usual JPEG compressed images and the images applying the quantized activation function. The results showed that a network with quantized activation functions can approximate JPEG compression with high accuracy. We also compared the bit error rate (BER) of estimated watermarks generated by our network with those generated by ReDMark. We found that our network was able to produce estimated watermarks with lower BERs than those of ReDMark. Therefore, our network outperformed the conventional method with respect to image quality and BER.

This paper proposed an optimal tracking control scheme through adaptive dynamic programming(ADP) for a class of partially unknown discrete-time nonlinear systems based on radial basis function neural network(RBF-NN). In order to acquire the unknown system dynamics, we use two RBF-NNs, the one is used to construct the identifier, and the another is used to directly approximate the steady-state control input, where a novel adaptive law is proposed to update neural network weights. While the optimal feedback control and the cost function are derived via feedforward neural networks approximating, it is proposed to regulate the tracking error, the critic network and the actor network are then trained online to obtain the solution of the associated Hamilton–Jacobi–Bellman (HJB) equation being built under the ADP framework. Simulations verify the effectiveness of the optimal tracking control technique using the neural networks.

Nowadays the dynamism induced by the constant change of strategic decisions on the markets produces an extra difficulty in the management of an organization. The strategic decisions made by managers can become obsolete in a short period of time. One of the major difficulties in managing a commercial organization is to predict, with some precision degree, the impact some strategic decisions have on the financial results. Business Intelligence (BI) is an area widely used to help managers to make strategic decisions. But the methods used, behind the scenes, to achieve the conclusions are kept secret by BI company-based services. Modelling the environment can be a good option to study the impact of an action, provided by a strategic decision, in a real environment. A good model should give an approximate result of an action applied to a previous state of the environment. Artificial Neural Networks (ANNs) are proven to be excellent in modeling environments with some level of data noise. The same strategic action can have different results in different organizations. A tool that allows an evaluation of a strategic action applied to an environment should have a major importance in the management scope. Modeling the environment should save time and money for the organization to improve the performance of the strategic plan. If one evaluates the state of the environment after a strategic action being applied, it can be possible to mitigate the risk of failure of the strategic plan. As we will be able to verify, it is possible to use ANNs to model strategic environments that should allow the prediction of sales and operating results by the used strategies with some precision, although the level of success will be directly related with the user’s necessity.

Amid escalating urbanization, devising rational commercial space layouts is a critical challenge. Leveraging machine learning, this study uses a Back-propagation (BP) neural network to optimize commercial spaces in Weinan City's central urban area. The results indicate an increased number of commercial facilities with a trend of multi-centered agglomeration and outward expansion. Based on these findings, we propose a strategic framework for rational commercial space development emphasizing aggregation centers, development axes, and spatial guidelines. This strategy provides valuable insights for urban planners in small and medium-sized cities in the Yellow River Basin and metropolitan areas, ultimately showcasing the power of machine learning in enhancing urban planning.

Tinnitus is a common phantom auditory percept, believed to be related to plastic changes in the brain due to hearing loss. However, tinnitus can also occur in absence of any clinical hearing loss. Then, since there is no hearing loss, the mechanisms that drive plastic changes remain largely enigmatic. Previous studies showed subtle differences in sound-evoked brain activity associated with tinnitus in subjects with tinnitus and otherwise, normal hearing, but the results are not consistent across studies. Here, we aim to investigate those differences using monaural rather than binaural stimuli. Sound-evoked responses were measured using functional magnetic resonance imaging (MRI) in participants with and without tinnitus. All participants had clinically normal audiograms. The stimuli were pure tones with frequencies between 353 and 8000 Hz, presented monaurally. A Principal Component Analysis (PCA) of the response in the auditory cortex revealed no difference in tonotopic organization, which confirmed earlier studies. A GLM analysis showed hyperactivity in the lateral areas of the bilateral auditory cortex. Consistent with the tonotopic map, this hyperactivity mainly occurred in response to low stimulus frequencies. This may be related to hyperacusis, which was associated with tinnitus found in the parahippocampus. This may reflect an interference between tinnitus and spatial orientation.

Amid the swift progression of the global automobile industry, the aspiration for lightweight vehicle design has surfaced as a crucial approach to boost fuel efficiency and curtail environmental impact. The objective of this study revolves around achieving holistic optimization of vehicle structure via detailed scrutiny of vehicle process characteristics, amalgamated with a Back Propagation neural network (BPNN) optimized by a genetic algorithm (GA) and a topology optimization (TO) method.The process initiates with an examination of the vehicle's technical characteristics, succeeded by an optimization protocol that couples GA with BPNN. This exhaustive optimization procedure derives the best-fit values of design parameters and identifies the globally optimal lightweight design approach. Subsequently, a comprehensive structural optimization is actualized by modifying the topological distribution of the structure.A simulation experiment of the conceptual car body beam skeleton is conducted as a conclusive step, and the anti-collision capacity of the car body beam skeleton is assessed by measuring deformation intrusion. The findings reveal that in the vehicle topology optimization, a comparative analysis of pre and post-optimization results indicates an improved topological density across diverse sections. The topological density of the vehicle's frontal structure escalates from 0.75 to 0.8. Following optimization, the stiffness assessment records a marginal increase (within the range of 0.02–0.05), implying that the lightweight design does not compromise the general rigidity of the structure.The optimized body structure manifests superior crashworthiness in the crash test: the deformation intrusion diminishes by 27% in front-end collisions. In side impacts, the deformation and intrusion at critical points are reduced by 13.15% to 10% respectively. The comprehensive method proposed herein proves to be an efficient strategy to actualize the lightweight design of vehicles.

The application of artificial intelligence to point-of-care testing (POCT) disease detection has become a hot research field, in which breath detection which detects the patient's exhaled VOCs combined with sensor arrays of Convolutional Neural Network (CNN) algorithms as a new lung cancer detection is attracting more researchers' attention. However, due to low accuracy, high complexity computation and large number of parameters make the CNN algorithms difficult transplant to the embedded system of POCT devices. A lightweight neural network (LTNet) in this work is proposed to deal with this problem, and meanwhile, achieve high-precision classification of acetone and ethanol gases, which are respiratory markers for lung cancer patients. Compared to currently popular lightweight CNN models such as EfficientNet, LTNet has fewer parameters (32K) and its training weight size is only 0.155 MB. LTNet achieved an overall classification accuracy of 99.06% and 99.14% in the own mixed gas dataset and the University of California (UCI) dataset, which are both higher than that of the five existing models’, and it also offers the shortest training (844.38s and 584.67s) and inference time (23s and 14s) in the same validation set. Compared to the existing CNN models, LTNet is more suitable for resource-limited POCT devices.

This paper proposes two max-pooling engines, named the RTB-MAXP engine and the CMB-MAXP engine, with a scalable window size parameter for FPGA-based convolutional neural network (CNN) implementation. The max-pooling operation for the CNN can be decomposed into two stages, i.e., a horizontal axis max-pooling operation and a vertical axis max-pooling operation. These two one-dimensional max-pooling operations are performed by tracking the rank of the values within the window in the RTB-MAXP engine and cascading the maximum operations of the values in CMB-MAXP engine. Both the RBM-MAXP engine and the CMB-MAXP engine were implemented using VHSIC Hardware Description Language (VHDL) and verified by simulations. They have been employed for and tested in our CNN accelerator targeting at the CNN model YOLOv4-CSP-S-Leaky for object detection.

The coastline in the Ca Mau and the Kien Giang provinces of the Vietnamese Mekong Delta has been severely eroded in recent decades. Pile-Rock Breakwaters (PRBW) are one of the most widely adopted structures for controlling shoreline erosion in this region. These structures are effective for wave energy dissipation, stimulating sediment accumulation, and facilitating the restoration of mangrove forests. These breakwaters are generally considered to be best-engineering practice however there is currently insufficient scientific evidence with regard to specific structural design aspects. This can lead to PRBW structures being compromised when deployed in the field. This study uses a physical model of a PRBW in a laboratory to investigate several design parameters, including crest width and working states (i.e. submerged, transition, and emerged), and investigates their relationship with the wave transmission coefficient, wave reflection coefficient, and wave energy dissipation. To investigate these relationships further, empirical formulas were derived for PRBWs under different sea states and crest widths to aid the design process. The results showed that PRBW width had a significant influence on the wave energy coefficients. The findings revealed that the crest width of the breakwater is inversely proportional to the wave transmission coefficient (K_t) under the emerged state. The crest width is also proportional to the wave reduction efficiency and wave energy dissipation in both working states (i.e., submerged and emerged states). The front wave disturbance coefficient (K_f) was found to be proportional to the wave reflection coefficient, and the wave height in front of the structure was found to increase by up to 1.4 times in the emerged state. The wave reflection coefficient requires special consideration to reduce the toe erosion in the structure. Lastly, empirical equations including linear and non-linear formulas were compared with previous studies for different classes of breakwaters. These empirical equations will be useful for understanding the wave transmission efficiency of PRBWs. The findings of this study provide important guidance for PRBW design in the coastal area of the Mekong Delta.

Parkinson’s Disease (PD) is a neurodegenerative and progressive disease that impacts the nerve cells in the brain and varies from person to person. The exact cause of PD is still unknown, and the diagnosis of PD does not include a specific objective test with certainty. Although deep learning has made great progress in medical neuroimaging analysis, these methods are very susceptible to biases present in neuroimaging datasets. An innovative decorrelated deep learning technique is introduced to mitigate class bias and scanner bias while simultaneously focusing on finding distinguishing characteristics in resting-state functional MRI (rs-fMRI) data, which assist in recognizing the PD with good accuracy. The decorrelation function reduces the non-linear correlation between features and bias in order to learn bias-invariant features. The Parkinson’s Progression Markers Initiative (PPMI) dataset, referred to as a single scanner imbalanced dataset in this study used to validate our method. The imbalanced dataset problem affects the performance of the deep learning framework by overfitting to the majority class. To resolve this problem, we propose a new Decorrelated Convolutional Neural Networks (DcCNN) framework by applying decorrelation-based optimization to Convolutional Neural Networks(CNN). An analysis of evaluation metrics comparisons shows that integrating the decorrelation function boosts the performance of PD recognition by removing class bias. Specifically, our DcCNN model performs significantly better than existing traditional approaches to tackle the imbalance problem. Finally, the same framework can be extended to create scanner invariant features without significantly impacting the performance of a model. The obtained dataset is a multi-scanner dataset which leads to scanner bias due to the differences in acquisition protocols and scanners. The multi-scanner dataset is a combination of two datasets, namely PPMI and FTLDNI - frontotemporal lobar degeneration neuroimaging initiative (NIFD) dataset. The results of t-distributed stochastic neighbor embedding (t-SNE) and scanner classification accuracy of our proposed Feature Extraction-DcCNN (FE-DcCNN) model validated the effective removal of scanner bias. Our method achieves an average accuracy of 77.80% on a multi-scanner dataset for differentiating PD from healthy control, which is superior to the DcCNN model trained on a single scanner imbalanced dataset.

The therapeutic, attenuative, and morphological effects of proprietary neural stem cell-derived extracellular vesicles (NSC EVs, AB126) produced by Aruna Bio, Inc. were assessed in a range of in vitro and in vivo models of stroke. We emphasize that modulation of neuroinflammation is a key target and suggest further studies to advance our understanding of the mechanisms of action and ultimately how best to dose and monitor the benefits of AB126 in stroke patients.

There are several challenges on how to attain energy efficiency while maintaining balance among factors affecting energy consumption such as power rating and temperature setpoints of cooling units, room temperature and humidity, and indoor air quality (IAQ). A real-time energy and IAQ monitoring system were installed in an educational building to profile the operational power consumption of inverter-based air condition unit (ACU) installed in each room. Polynomial curve and neural fitting regression analysis were applied to the real-time power consumption, indoor temperature and humidity, and carbon dioxide (CO2) level data. The derived models were able to provide the stabilizing indoor thermal and air conditions of the room to reach steady state ACU power consumption. These collected data and calculated parameters can be used to define rules in automating control of cooling appliances for an efficient energy utilization. The regression approaches, using real-time data, have determined the influence of indoor heat conditions and carbon dioxide levels on ACU power consumption. These parameters were utilized to establish consistent values for temperature, humidity, and carbon dioxide levels under stable settings of inverter-based air conditioning units.

Antimony (Sb) has gained significance as a critical raw material (CRM) within the European Union (EU) due to its strategic importance in various industrial sectors, particularly in the textile industry for flame retardants and as a component of Sb-based semiconductor materials. Moreover, Sb is emerging as a potential alternative for anodes used in lithium-ion batteries, a key element in the Energy transition. This study focused on exploring the feasibility of identifying and quantifying Sb mineralizations through the spectral signature of soils using reflectance spectroscopy, a non-invasive remote sensing technique, and by employing deep learning algorithms such as Convolutional Neural Networks (CNNs). Common signal preprocessing techniques were applied to the spectral data, and the soils were analyzed by Inductively Coupled Plasma Mass Spectrometry (ICP-MS). Despite achieving high R-squared values, the study faces a significant challenge of generalization of the model to new data. Despite the limitations, this study provides valuable insights into potential strategies for future research in this field.

Accurate classification of objects in 3D point clouds is a significant problem in several applications, such as autonomous navigation and augmented/virtual reality scenarios, which has become a research hot spot. In this paper, we presented a deep learning strategy for 3D object classification in augmented reality. The proposed approach is a combination of the GRU and LSTM. LSTM networks learn longer dependencies well, but due to the number of gates, it takes longer to train; on the other hand, GRU networks have a weaker performance than LSTM, but their training speed is much higher than GRU, which is The speed is due to its fewer gates. The proposed approach used the combination of speed and accuracy of these two networks. The proposed approach achieved an accuracy of 0.99 in the 4,499,0641 points dataset, which includes eight classes (unlabeled, man-made terrain, natural terrain, high vegetation, low vegetation, buildings, hardscape, scanning artifacts, cars). Meanwhile, the traditional machine learning approaches could achieve a maximum accuracy of 0.9489 in the best case.

Functional connectivity (FC) is a potential candidate that can increase the performance of brain-computer interfaces (BCIs) in the elderly because of its compensatory role in neural circuits. However, it is difficult to decode FC by current machine learning techniques because of a lack of its physiological understanding. To investigate the suitability of FC in BCI for the elderly, we propose the decoding of lower- and higher-order FCs using a convolutional neural network (CNN) in six cognitive-motor tasks. The layer-wise relevance propagation (LRP) method describes how age-related changes in FCs impact BCI applications for the elderly compared to younger adults. Seventeen younger (24.5±2.7 years) and twelve older (72.5±3.2 years) adults were recruited to perform tasks related to hand-force control with or without mental calculation. CNN yielded a six-class classification accuracy of 75.3% in the elderly, exceeding the 70.7% accuracy for the younger adults. In the elderly, the proposed method increases the classification accuracy by 88.3% compared to the filter-bank common spatial pattern (FBCSP). LRP results revealed that both lower- and higher-order FCs were dominantly overactivated in the prefrontal lobe depending on task type. These findings suggest a promising application of multi-order FC with deep learning on BCI systems for the elderly.

Deep Learning (DL) oriented document processing is widely used in different fields for extraction, recognition, and classification processes from raw corpora of data. The article examines the application of deep learning approaches, based on different neural network methods, including Gated Recurrent Unit (GRU), Long Short-Term Memory (LSTM), and Convolutional Neural Networks (CNN). The compared models were combined with two different word embedding techniques, namely: Bidirectional Encoder Representations from Transformers BERT and Gensim Word2Vec. The models are designed to evaluate the performance of architectures based on neural network techniques for the classification of CVs of Moroccan engineering students at ENSAK(National School of Applied Sciences of Kenitra, Ibn Tofail University). The used dataset included resumes collected from engineering students at ENSAK in 2023 for a project on the employability of Moroccan engineers in which new approaches were applied, especially machine learning, deep learning, and big data. Accordingly, 867 resumes were collected from five specialties of study (Electrical Engineering, Networks and Systems Telecommunications, Computer Engineering, Automotive Mechatronics Engineering, Industrial Engineering). The results revealed good performance of the proposed models based on the BERT embedding approach compared to models based on the Gensim Word2Vec embedding approach. Accordingly, the CNN-GRU/Bert model achieved slightly better accuracy with 0.9251 compared to other hybrid models.

Optical artificial neural networks (ONNs) — analog computing hardware tailored for machine learning [1,2] — have significant potential for ultra-high computing speed and energy efficiency [3]. We propose a new approach to architectures for ONNs based on integrated Kerr micro-comb sources [4] that is programmable, highly scalable and capable of reaching ultra-high speeds. We experimentally demonstrate the building block of the ONN — a single neuron perceptron — by mapping synapses onto 49 wavelengths of a micro-comb to achieve a high single-unit throughput of 11.9 Giga-FLOPS at 8 bits per FLOP, corresponding to 95.2 Gbps. We test the perceptron on simple standard benchmark datasets — handwritten-digit recognition and cancer-cell detection — achieving over 90% and 85% accuracy, respectively. This performance is a direct result of the record small wavelength spacing (49GHz) for a coherent integrated microcomb source, which results in an unprecedented number of wavelengths for neuromorphic optics. Finally, we propose an approach to scaling the perceptron to a deep learning network using the same single micro-comb device and standard off-the-shelf telecommunications technology, for high-throughput operation involving full matrix multiplication for applications such as real-time massive data processing for unmanned vehicle and aircraft tracking.

This study addresses the critical challenge of Speech Enhancement (SE) in noisy environments, where the deployment of Deep Neural Networksolutions on microcontrollers is hindered by their extensive computational demands. Focusing on this gap, our research introduces a novel SE method optimized for MCUs, employing a 2-layer GRU model that capitalizes on perceptual speech properties and innovative training methodologies. By incorporating self-reference signals and a dual strategy of compression and recovery based on the Mel scale, we develop an efficient model tailored for low-latency applications. Our GRU-2L-128 model demonstrates a significant reduction in size and computational requirements, achieving a 14.2× decrease in model size and a 409.1× reduction in operations compared to traditional DNN methods like DCCRN, without compromising performance. This advancement offers a promising solution for enhancing speech intelligibility in resource-constrained devices, marking a pivotal step in SE research and application.

Characterization of cancer cells and neural stem cells indicates that tumorigenicity and pluripotency are coupled cell properties determined by neural stemness, and tumorigenesis represents a process of progressive loss of original cell identity and gain of neural stemness. This reminds of a most fundamental process required for the development of the nervous system and body axis during embryogenesis, i.e., embryonic neural induction. Neural induction is that, in response to extracellular signals that are secreted by the Spemann-Mangold organizer in amphibians or the node in mammals and inhibit epidermal fate in ectoderm, the ectodermal cells lose their epidermal fate and assume the neural default fate and consequently, turn into neuroectodermal cells. They further differentiate into the nervous system and also some non-neural cells via interaction with adjacent tissues. Failure in neural induction leads to failure of embryogenesis, and ectopic neural induction due to ectopic organizer or node activity or activation of embryonic neural genes causes a formation of secondary body axis or a conjoined twin. During tumorigenesis, cells progressively lose their original cell identity and gain of neural stemness, and consequently, gain of tumorigenicity and pluripotency, due to various intra-/extracellular insults in cells of a postnatal animal. Tumorigenic cells can be induced to differentiation into normal cells and integrate into normal embryonic development within an embryo. However, they form tumors and cannot integrate into animal tissues/organs in a postnatal animal because of lack of embryonic inducing signals. Combination of studies of developmental and cancer biology indicates that neural induction drives embryogenesis in gastrulating embryos but a similar process drives tumorigenesis in a postnatal animal. Tumorigenicity is the manifestation of aberrant occurrence of pluripotent state in a postnatal animal. Pluripotency and tumorigenicity are both but different manifestations of neural stemness in pre- and postnatal stage, respectively, of animal life. The unique property of neural stemness is derived from the evolutionary advantage of neural genes and the neural-biased state of the last common unicellular ancestors of metazoan. Based on these findings, I discuss about some confusion in cancer research, propose to distinguish the causality and associations and discriminate causal and supporting factors involved in tumorigenesis, and suggest revisiting the focus of cancer research.

The main purpose of this article is to identify brain diseases such as Alzheimer's and Parkinson's in an intelligent way using Python software and processing the function of neurons in the neural network areas of the brain, which are classified into different components, and the data is based on the information obtained from FMRI images using algorithms artificial intelligence can intelligently diagnose the type of disease. Therefore, by using spatial clustering based on the deep learning method with noise algorithm (DBSCAN), fMRI brain image and fMRI brain surface complexity are classified, and then image preprocessing will be applied to fMRI images by using artificial intelligence neural networks (ANN) algorithm. became. Then, by using the ANN algorithm and Deep CNN topology of the brain neural network, the type of disease in the brain can be diagnosed by simulating the performance of an artificial neural network (ANN) in Python software. Deep machine learning-based methods, especially algorithms based on neural networks, have shown great success in medical image analysis for various tasks including brain tumor detection, segmentation, and classification, and Alzheimer's and epilepsy. In this research, we propose an integrated model based on a convolutional neural network for simultaneous recognition and classification of brain diseases for intelligent diagnosis of tumors and epilepsy. The average accuracy obtained from our proposed model is 97.89 percent accuracy and 91.66 percent specificity.

The main sources of intrinsic noise in excitable cells at the microcircuit and network levels are the stochastic characteristics of ion channel gating and activation of the synaptic conductance. Studies using in vivo, in vitro, and in silico methods to examine the effects of synaptic background activity were not adequately investigated in non-neuronal excitatory cells, where neurotransmitter-based innervation also occurs. We created a mathematical model to replicate the background synaptic noise dynamics in a non-neuronal cell. We utilized the stochastic Ornstein-Uhlenbeck process to represent excitatory synaptic conductance, which was incorporated into a whole-cell model to produce spontaneous and evoked cellular electrical activities. The single-cell model includes many biophysically detailed ion channels represented by a set of ordinary differential equations in Hodgkin-Huxley and Markov formalisms. This paradigm effectively induced irregular spontaneous depolarizations (SDs) and spontaneous action potential (sAP) resembling in vitro-like electrical activity in the cells. The input resistance decreased by multiple factors, and the spontaneous action potential firing rate elevated. The potential to reach the action potential threshold is altered. Background synaptic activity can alter the input/output characteristics of non-neuronal excitatory cells. Suppressing these baseline activities would facilitate the discovery of new pharmaceutical targets for different clinical diseases.

The inhibition of alpha-glucosidase and alpha-amylase is one of clinic strategies for remedy the type II diabetes. Herbal medicines are reported to alleviate hyperglycemia. However, the constituents from those sources whether are targeted to the alpha-glucosidase and alpha-amylase still unexplored. This study attempted to select the compounds for efficacy of hypoglycemia via cellular and mouse levels. The results illustrated that the cytotoxicity in all tested compounds at various concentrations except the concentration of 16-hydroxy-cleroda-3,13-dine-16,15-olide (HCD) at 30 µM were not significant difference (p > 0.05) when compared with the untreated control. Acarbose (reference drug), Antroquinonol, Catechin, Quercetin, Actinodaphnine, Curcumin, HCD, Docosanol, Tetracosanol, Berberine, and Rutin could effectively inhibit the alpha-glucosidase activity of Caco-2 cells when compared with the control (maltose). The compounds (Curcumin, HCD, Tetracosanol, Antroquinonol, Berberine, Catechin, Actinodaphnine, and Rutin) could reduce blood sugar level at 30 min in tested mice. The effects of tested compounds on area under curve (AUC) were significant (p < 0.05) among Acarbose, Tetracosanol, Antroquinonol, Catechin, Actinodaphnine, and Rutin along with Berberine and Quercetin. In in vitro (alpha-glucosidase) with in vivo (alpha-amylase) experiments suggest that bioactive compounds can be a potential inhibitor candidate of alpha-glucosidase and alpha-amylase for the alleviation of type II diabetes.

In this paper we derive a unified perspective for Optimal Transport (OT) theory and Mean Field Control (MFC) theory to analyse the learning process for Neural Networks algorithms in a high-dimensional framework. We consider Mean Field Neural Networks in the context of MFC theory, specifically the mean field formulation of OT theory that allows the development of highly efficient algorithms while providing a powerful tool in the context of explainable Artificial Intelligence.

Substances that can modify the androgen receptor pathway in humans and animals are entering the environment and food chain with the proven ability to disrupt hormonal systems and leading to toxicity and adverse effects on reproduction, brain development, and prostate cancer, among others. State-of-the-art databases with experimental data of human, chimp, and rat effects by chemicals have been used to build machine learning classifiers and regressors and evaluate these on independent sets. Different featurizations, algorithms, and protein structures lead to dif- ferent results, with deep neural networks (DNNs) on user-defined physicochemically-relevant features developed for this work outperforming graph convolutional, random forest, and large featurizations. The results show that these user-provided structure-, ligand-, and statistically-based features and specific DNNs provided the best results as determined by AUC (0.87), MCC (0.47), and other metrics and by their interpretability and chemical meaning of the descriptors/features. In addition, the same features in the DNN method performed better than in a multivariate logistic model: validation MCC = 0.468 and training MCC = 0.868 for the present work compared to evalu- ation set MCC = 0.2036 and training set MCC = 0.5364 for the multivariate logistic regression on the full, unbalanced set. Techniques of this type may improve AR and toxicity description and predic- tion, improving assessment and design of compounds. Source code and data are available at https://github.com/AlfonsoTGarcia-Sosa/ML

Tumorigenesis is a complex biological phenomenon that includes extensive genetic and phenotypic heterogeneities and complicated regulatory mechanisms. In the recent few years, our studies demonstrate that tumor-initiating cells are similar to neural stem/progenitor cells in regulatory networks, tumorigenicity and pluripotent differentiation potential. In the review, I will make further discussion on these observations and propose a rule of cell biology by integrating these findings with evidence from developmental biology, tumor biology and evolution, which suggests that neural stemness underlies two coupled cell properties, tumorigenicity and pluripotent differentiation potential. Tumorigenicity and phenotypic heterogeneity in tumor is a result of acquirement of neural stemness in cells. The neural stemness property of tumor-initiating cells can hopefully integrate different concepts/hypotheses underlying tumorigenesis. Neural stem cells/neural progenitors and tumor-initiating cells share regulatory networks; both exhibit neural stemness, tumorigenicity and differentiation potential; both are dependent on expression or activation of ancestral genes (the atavistic effect); both rely primarily on aerobic glycolytic metabolism; both can differentiate into various cells or tissues that are derived from three germ layers, resembling severely disorganized or more severely degenerated process of embryonic development; both are enriched in long genes with more splice variants that provide more plastic scaffolds for cell differentiation, etc. The property of neural stemness might be a key point to understand tumorigenesis and pluripotent differentiation potential, and possibly explain certain pathological observations in tumors that have been inexplicable. Therefore, behind the complexity of tumorigenesis might be a general rule of cell biology, i.e., neural stemness represents the ground state of cell tumorigenicity and pluripotent differentiation potential.

Convolutional Neural Networks (CNNs) are often criticized for their lack of transparency, acting as 'black boxes' in decision-making, a challenge compounded by class imbalance in ECG datasets, which limits their clinical application. This study introduces a CNN-based ECG signal classification model that enhances interpretability and addresses class imbalance through the Synthetic Minority Over-sampling Technique (SMOTE). The model also integrates Uniform Manifold Approximation and Projection (UMAP) for dimensionality reduction and SHAP value analysis, facilitating the visualization of decision boundaries and the assessment of feature contributions. Our evaluation using the MIT-BIH Arrhythmia Database highlights the model's high performance, with accuracy and precision nearing 1.00 for Normal ECG (NOR), Left Bundle Branch Block (LBBB), Right Bundle Branch Block (RBBB), and Ventricular Premature Beat (PVC) in the six-class task. In the ten-class task, the model demonstrated robustness, particularly with an accuracy of 0.9846, precision of 0.9783, recall of 0.9736, and F1 score of 0.9760 in Pacemaker Fusion Beat (PFHB), supported by an AUC of 0.9999 and AP of 0.9885. These results underscore the model's efficacy in cardiac rhythm recognition and resilience to class imbalance. Future research will explore sophisticated model architectures and feature extraction methods to enhance the model's generalization and clinical applicability for early heart disease diagnosis and personalized treatment.

Equality and incomparability multi-label ranking have not been introduced to learning before. This paper proposes new native ranker neural network to address the problem of multi-label ranking including incomparable preference orders using a new activation and error functions and new architecture. Preference Neural Network PNN solves the multi-label ranking problem, where labels may have indifference preference orders or subgroups which are equally ranked. PNN is a nondeep, multiple-value neuron, single middle layer and one or more output layers network. PNN uses a novel positive smooth staircase (PSS) or smooth staircase (SS) activation function and represents preference orders and Spearman ranking correlation as objective functions. It is introduced in two types, Type A is traditional NN architecture and Type B uses expanding architecture by introducing new type of hidden neuron has multiple activation function in middle layer and duplicated output layers to reinforce the ranking by increasing the number of weights. PNN accepts single data instance as inputs and output neurons represent the number of labels and output value represents the preference value. PNN is evaluated using a new preference mining data set that contains repeated label values which have not experimented on before. SS and PS speed-up the learning and PNN outperforms five previously proposed methods for strict label ranking in terms of accurate results with high computational efficiency.

Long-Term Potentiation(LTP) and Long-Term Depression(LTD) are two major forms of synaptic plasticity, which are also two well-know functional and unit activities involved in high advanced central neural system(CNS) activities, like memory. But we still know little about how the advanced CNS activities are organized in the brain and in the level of organism. Based on the current understanding and experimental evidence of neurology, we propose the term “Information Circulation” to summarize the current understandings for advanced CNS activities, and we define it as separately input neural signals finally converge in different levels of CNS and interact with each other, then neural information are circulated and processed in different levels of CNS to give out orders for next body actions. This review provides a detailed description for the functional organizations of advanced CNS activities in the term of Information Circulation. This article outlines the receiving of outside stimulation and transmission of neural information, especially transmission and procession of visual bioelectrical signals, then we described neural circuits of Information Circulation in advanced CNS activities, the corresponding specificity and dynamic properties of neural circuits, different sensation linkages, and neural synchronization for information circulation to produce consciousness in CNS. In conclusion, Information Circulation is defined as an important signature involved in advanced CNS activities.

This work has its origin in intuitive physical and statistical considerations. The problem of optimizing an artificial neural network is treated as a physical system, composed of a conservative vector force field. The derived scalar potential is a measure of the potential energy of the network, a function of the distance between predictions and targets. Starting from some analogies with wave mechanics, the description of the sys-tem is justified with an eigenvalue equation that is a variant of the Schr˜odinger equation, in which the potential is defined by the mutual information between inputs and targets. The weights and parameters of the network, as well as those of the state function, are varied so as to minimize energy, using an equivalent of the variational theorem of wave mechanics. The minimum energy thus obtained implies the principle of minimum mutual information (MinMI). We also propose a definition of the potential work produced by the force field to bring a network from an arbitrary probability distribution to the potential-constrained system, which allows to establish a measure of the complexity of the system. At the end of the discussion we expose a recursive procedure that allows to refine the state function and bypass some initial assumptions, as well as a discussion of some topics in quantum mechanics applied to the formalism, such as the uncertainty principle and the temporal evolution of the system. Results demonstrate how the minimization of energy effectively leads to a decrease in the average error between network predictions and targets.

Much evidence suggests a correlation between degeneration and mitochondrial impairment. Typical cases of degeneration can also be observed in physiological phenomena (aging) as well as in neurological neurodegenerative diseases and cancer. All these pathologies have as a common denominator the dyshomeostasis of mitochondrial bioenergy. Even neurodegenerative diseases show a bioenergetics imbalance in their pathogenesis or progression. Huntington's chorea and Parkinson's disease are both neurodegenerative diseases, but while Huntington's disease is a genetic, and progressive disease with early manifestation and severe penetrance, Parkinson's disease is a pathology with a multifactorial aspect. Indeed, there are different types of Parkinson/Parkinsonism. Many forms are early onset diseases linked to gene mutation, others can appear in young adults and senescent only post-injury, and a final group is idiopathic. Huntington's was defined as a hyperkinetic disorder, while Parkinson's is a hypokinetic disorder; but in the middle, there are a lot of similarities as well as neuronal excitability, the loss of striatal function, psychiatric comorbidity, etc. In the review, we would embrace the theories that both diseases start and develop in light of mitochondrial dysfunction. These dysfunctions act on energy metabolism and reduce the vitality of neurons in many different brain areas.

Much evidence suggests a correlation between degeneration and mitochondrial impairment. Typical cases of degeneration can also be observed in physiological phenomena (aging) as well as in neurological neurodegenerative diseases and cancer. All these pathologies have as a common denominator the dyshomeostasis of mitochondrial bioenergy. Even neurodegenerative diseases show a bioenergetics imbalance in their pathogenesis or progression. Huntington's chorea and Parkinson's disease are both neurodegenerative diseases, but while Huntington's disease is a genetic, and progressive disease with early manifestation and severe penetrance, Parkinson's disease is a pathology with a multifactorial aspect. Indeed, there are different types of Parkinson/Parkinsonism. Many forms are early onset diseases linked to gene mutation, others can appear in young adults and senescent only post-injury, and a final group is idiopathic. Huntington's was defined as a hyperkinetic disorder, while Parkinson's is a hypokinetic disorder; but in the middle, there are a lot of similarities as well as neuronal excitability, the loss of striatal function, psychiatric comorbidity, etc. In the review, we would embrace the theories that both diseases start and develop in light of mitochondrial dysfunction. These dysfunctions act on energy metabolism and reduce the vitality of neurons in many different brain areas.

This comprehensive review delves into the cognitive neuroscience of hypnosis and variations in hypnotizability by examining research employing functional magnetic resonance imaging (fMRI), positron emission tomography (PET), and electroencephalography (EEG) methods. Key focus areas include functional brain imaging correlations in hypnosis, EEG band oscillations as indicators of hypnotic states, alterations in EEG functional connectivity during hypnosis and wakefulness, drawing critical conclusions, and suggesting future research directions. The reviewed functional connectivity findings support the notion that disruptions in the functional integration between different components of the executive control network during hypnosis may correspond to altered subjective appraisals of the agency during the hypnotic response, as per dissociated and cold control theories of hypnosis. Building upon existing EEG results, a promising exploration avenue involves investigating how frontal lobes' integrated functioning with other cortical regions influences hypnosis and individual differences in hypnotizability during both waking and hypnotic states. Future studies investigating the effects of hypnosis on brain function should prioritize examining distinctive activation patterns across various neural networks. A practical approach entails simultaneously analyzing the causal relationships in functional connectivity linked to cognitive, physiological, and behavioral responses.

Coconut is an important multipurpose crop wherein different stages of its maturity are used for different products. Traditional approach of its classification use sound formed by tapping the fruit, and the tapper will base its judgment through the sound he heard. The procedure was highly subjective and attempts had been made by other researchers to automate and classify the adulthood of the coconut objectively. Nowadays, deep learning techniques are being utilized to solve classification problems. One such method is Convolutional Neural Network (CNN) that takes raw pixel data, learns to extract features, and ultimately classifies the input. In this study, a portable device was developed that takes audio signals generated from tapping the fruit mechanically. This audio clip was converted to spectrogram and was used as input to a LeNet CNN architecture. We argue that CNN classifier has improved accuracy compared to the non-deep learning system. Our evaluation confirmed that the use of CNN had improved the accuracy of classifying coconut by about 15%.

Neural-objective and image optimization approaches for drilling fluid rheology automation are crucial for drilling engineering optimization. A myriad of intelligent computational models are employed to predict and monitor the parameters of mud rheology and filter cake permeability posture using an artificial neural network feedforward (ANN-FF) function, a non-ANN-FF function, an image processing tool, and a model optimization tool. 498 datasets of synthetic-based mud (SBM) flat rheology from a drilling mud laboratory at Nazarbayev University were imported into a user-friendly MATLAB application using image processing and nftool. Apart from the Google TensorFlow Sequential API DNN architecture used, a Levenberg-Marquardt training algorithm with input sigmoid hidden neurons 10, 12, and 18 coupled with a linear output layer was also used to predict the SBM flow index. OBM and SBM filter cakes were processed for void spaces; however, a model study was extrapolated to maximize filtration volume Vf. The study’s findings show that the ANN-FF model employed for rheological property monitoring and prediction had higher steady and exponential levels of accuracy and a correlation coefficient of 0.96-0.99. More so, SBM and OBM image processing presented an area of void spaces of 1790M2 and 1739M2, respectively. The porosity and permeability postures of both SBM and OBM resulted in a significant void space capable of maximizing the flow index. In addition, the single-objective modelling based on a genetic algorithm did validate the experimental rheological data for flow index or filtration volume Vf optimization; the study resulted in the finding that the constrained physics-informed objective function hindered maximizing oil recovery and instead predicted possible formation damage. It is empirical to note that automating flow predictions with neural, objective, and image functions has presented an alternative novel method for non-programmers using MATLAB and Google Colabs that is capable of enhancing mud rheological parameters, drilling efficiency, and hydrocarbon recovery.

In recent years, Neural networks are increasingly deployed in various fields to learn complex patterns and make accurate predictions. However, designing an effective neural network model is a challenging task that requires careful consideration of various factors, including architecture, optimization method, and regularization technique. This paper aims to comprehensively overview the state-of-the-art artificial neural network (ANN) generation and highlight key challenges and opportunities in machine learning applications. It provides a critical analysis of current neural network model design methodologies, focusing on the strengths and weaknesses of different approaches. Also, it explores the use of different learning approaches, including convolutional neural networks (CNN), deep neural networks (DNN), and recurrent neural networks (RNN) in image recognition, natural language processing, and time series analysis. Besides, it discusses the benefits of choosing the ideal values for the different components of ANN, such as the number of Input/output layers, hidden layers number, activation function type, epochs number, and model type selection, which help improve the model performance and generalization. Furthermore, it identifies some common pitfalls and limitations of existing design methodologies, such as overfitting, lack of interpretability, and computational complexity. Finally, it proposes some directions for future research, such as developing more efficient and interpretable neural network architectures, improving the scalability of training algorithms, and exploring the potential of new paradigms, such as Spiking Neural Networks, quantum neural networks, and neuromorphic computing.

A convolutional neural network (CNN) is sometimes understood as a black box in the sense that while it can approximate any function, studying its structure will not give us any insights into the nature of the function being approximated. In other terms, the discriminative ability does not reveal much about the latent representation of a network. This research aims to establish a framework for interpreting the CNNs by profiling them in terms of interpretable visual concepts and verifying them by means of Integrated Gradient. We also ask the question, "Do different input classes have a relationship or are they unrelated?" For instance, could there be an overlapping set of highly active neurons to identify different classes? Could there be a set of neurons that are useful for one input class whereas misleading for a different one? Intuition answers these questions positively, implying the existence of a structured set of neurons inclined to a particular class. Knowing this structure has significant values; it provides a principled way for identifying redundancies across the classes. Here the interpretability profiling has been done by evaluating the correspondence between individual hidden neurons and a set of human-understandable visual semantic concepts. We also propose an integrated gradient-based class-specific relevance mapping approach that takes the spatial position of the region of interest in the input image. Our relevance score verifies the interpretability scores in terms of neurons tuned to a particular concept/class. Further, we perform network ablation and measure the performance of the network based on our approach.

Geospatial Information Systems (GIS) can provide a great environment for using machine learning algorithm for spatial data such as satellite images. Integrating this functionality with artificial intelligence algorithms for analyzing spatial data enables us to predict challenging disasters such as deforestation. Deforestation as an environmental problems has been recorded the most serious threat to environmental diversity and one of the main components of land-use change. In this paper, we investigate spatial distribution of deforestation using artificial neural networks and satellite imagery. We modeled deforestation process using various factors in determining the relationship between deforestation and environmental and socioeconomic factors. Hence, for this purpose, the proximity to roads and habitats, fragmentation of the forest, height from sea level, slope, and soil type are considered in the model. In this research, we modeled land cover changes (forests) to predict deforestation using an artificial neural network due to its significant potential for the development of nonlinear complex models. The procedure involves image registration and error correction, image classification, preparing deforestation maps, determining layers, and designing a multi-layer neural network to predict deforestation. The satellite images for this study are of a region in Hong Kong which are captured from 2012 to 2016. The results of the study demonstrate that neural networks approach for predicting deforestation can be utilized and its outcomes show the areas that destroyed during the research period.

Decision tree algorithms have been among the most popular algorithms for interpretable (transparent) machine learning since the early 1980s. On the other hand, deep learning methods have boosted the capacity of machine learning algorithms and are now being used for non-trivial applications in various applied domains. But training a fully-connected deep feed-forward network by gradient-descent backpropagation is slow and requires arbitrary choices regarding the number of hidden units and layers. In this paper, we propose near-optimal neural regression trees, intending to make it much faster than deep feed-forward networks and for which it is not essential to specify the number of hidden units in the hidden layers of the neural network in advance. The key idea is to construct a decision tree and then simulate the decision tree with a neural network. This work aims to build a mathematical formulation of neural trees and gain the complementary benefits of both sparse optimal decision trees and neural trees. We propose near-optimal sparse neural trees (NSNT) that is shown to be asymptotically consistent and robust in nature. Additionally, the proposed NSNT model obtain a fast rate of convergence which is near-optimal up to some logarithmic factor. We comprehensively benchmark the proposed method on a sample of 80 datasets (40 classification datasets and 40 regression datasets) from the UCI machine learning repository. We establish that the proposed method is likely to outperform the current state-of-the-art methods (random forest, XGBoost, optimal classification tree, and near-optimal nonlinear trees) for the majority of the datasets.

The event camera generates an event stream based on changes in brightness, retaining only the characteristics of moving objects, addresses the high power consumption associated with using high-frame-rate cameras for high-speed eye tracking tasks. However, the asynchronous incremental nature of event camera output has not been fully utilized, and there are also issues related to missing event datasets. Combining the temporal information encoding and state-preserving properties of spiking neural network (SNN) with event camera, a near-range eye tracking algorithm is proposed as well as a novel event-based dataset for validation and evaluation. According to experimental results, the proposed solution outperforms artificial neural network (ANN) algorithms, while computational time remains only 12.5\% of that of traditional SNN algorithms. Furthermore, the proposed algorithm allows for self-adjustment of time resolution, with a maximum achievable resolution of 0.081ms, enhancing tracking stability while maintaining accuracy.

The article presents an innovative method for synthesizing radiation patterns efficiently by 1 combining the Taguchi method and neural networks, while validating the results on a 10-element 2 antenna array. The Taguchi method aims to minimize product and process variability, while neural 3 networks are used to model the relationship between antenna design parameters and radiation 4 pattern characteristics. This approach utilizes Taguchi parameters as inputs for the neural network, 5 which is then trained on a dataset generated by the Taguchi method. After training, the network is 6 validated using a real 10-element antenna array. Analytical results demonstrate that this method 7 enables efficient synthesis of radiation patterns with a significant reduction in computation time 8 compared to traditional approaches. Furthermore, validation on the antenna array confirms the 9 accuracy and robustness of the approach, showing a high correlation between predicted performances 10 by the neural network model and actual measurements on the antenna array.In summary, our article 11 highlights that the combined use of the Taguchi method and neural networks, with validation on a 12 real antenna array, offers a promising approach for efficient synthesis of antenna radiation patterns. 13 This approach combines speed, accuracy, and reliability in antenna system design.

In the realm of computer vision, semantic segmentation is the task of recognizing objects in images at the pixel level. This is done by performing a classification of each pixel. The task is complex and requires sophisticated skills and knowledge about the context to identify objects’ boundaries. The importance of semantic segmentation in many domains is undisputed. In medical diagnostics, it simplifies the early detection of pathologies, thus mitigating the possible consequences. In this work, we provide a review of the literature on deep ensemble learning models for polyp segmentation and we develop new ensembles based on convolutional neural networks and transformers. The development of an effective ensemble entails ensuring diversity between its components. To this end, we combine different models (HarDNet-MSEG, Polyp-PVT, and HSNet) trained with different data augmentation techniques, optimization methods, and learning rates, which we experimentally demonstrate to be useful to form a better ensemble. Most importantly, we introduce a new method to obtain the segmentation mask which is more suitable for combining transformers in an ensemble. In our extensive experimental evaluation, the proposed ensembles exhibit state-of-the-art performance.

Recent progress in microfabrication technique allowed the rapid development of neural implants. They are getting categorized as effective tools for clinical practice, especially to treat traumatic and neurodegenerative disorders. Microelectrode arrays already have been used in numerous neural interface devices. Basically, almost all neural implants have been developed based on BCI (Brain Computer Interface) system. When BCI system falls under invasive technique, it is referred as BMI or Brain Machine Interface. BMIs hold promises for neurorehabilitation of motor and sensory function, cognitive state evaluation and treatment of neurological chaos. A directed overview of the field of neural implants is discussed in this article. The aim of this review is to give a brief introduction of neural prosthetics as well as their exciting applications in treating neurological disorders and a deep discussion on their functionality are mentioned. BCI system and their different types, their functionality, their pros and cons, how other neural implants developed, and their present status have been covered. Different possibilities and possible future of deep brain stimulation (DBS), Neuralink, motor and sensory neural prosthetics are further discussed.

The fault diagnosis of safety critical systems such as wind turbine installations includes extremely challenging aspects that motivate the research issues considered in this paper. In fact, the prompt detection and the reliable diagnosis of faults in their earlier occurrence represent the key point especially for offshore installations. For these plants, operation and maintenance procedures in harsh environments would inevitably increase the cost of the energy production. Therefore, this work investigates fault diagnosis solutions that are considered in a viable way and used as advanced techniques for condition monitoring of dynamic processes. To this end, the work proposes the design of fault diagnosis strategies that exploit the estimation of the fault by means of data--driven approaches. This solution leads to the development of effective methods allowing the management of partially unknown information of the system dynamics, while coping with measurement errors, the model--reality mismatch and other disturbance effects. In mode detail, the proposed data--driven methodologies exploit fuzzy systems and neural networks in order to estimate the nonlinear dynamic relations between the input and output measurements of the considered process and the faults. To this end, the fuzzy and neural network structures are integrated with auto--regressive with exogenous input descriptions, thus making them able to approximate unknown nonlinear dynamic functions with arbitrary degree of accuracy. Once these models are estimated from the input and output data measurement acquired from the considered dynamic process, the capabilities of their fault diagnosis capabilities are validated by using a high--fidelity benchmark that simulates the healthy and the faulty behaviour of a wind turbine system. Moreover, at this stage the benchmark is also useful to analyse the robustness and the reliability characteristics of the developed tools in the presence of model--reality mismatch and modelling error effects featured by the wind turbine simulator. On the other hand, a hardware--in--the--loop tool is finally implemented for testing and comparing the performance of the developed fault diagnosis strategies in a more realistic environment and with respect to different fault diagnosis approaches.

Motivated by the way animals react in nature, we introduce a fully-connected neural-network model, which incorporates the external pattern presented to the system as a fundamental tool of the recognition process. In this new scenario, in the absence of this external field, memories are not attractors inside basins of attraction, as in usual attractor neural networks, although basins may be created according to the external pattern, thus allowing storing a much larger number of memories. The key point consists in calibrating the influence of the external pattern such as to cancel the noise generated by those memories not correlated with the external pattern.We illustrate how this proposal works by including this new contribution in the standard Hopfield model, showing a significant increase in its recognition capacity (typically by a factor $10^{2}$). As an additional feature of this model, we show its ability to react promptly to changes in the external environment, a crucial attribute of living beings. This procedure can be applied to a wide variety of neural-network models to increase considerably their recognition and reaction capabilities.

An application of deep convolutional neural network and recurrence plot for financial market movement prediction is presented. Though it is challenging and subjective to interpret its information, the pattern formed by a recurrence plot provide a useful insight into the dy- namical system. We used a recurrence plot of seven financial time series to train a deep neural network for financial market movement predic- tion. Our approach is tested on our dataset and achieved an average of 53.25% classification accuracy. The result suggests that a well trained deep convolutional neural network can learn a recurrence plot and pre- dict a financial market direction.

With the increase of the Artificial Neural Network (ANN), machine learning has taken a forceful twist in recent times. One of the most spectacular kinds of ANN design is the Convolutional Neural Network (CNN). The Convolutional Neural Network (CNN) is a technology that mixes artificial neural networks and up to date deep learning strategies. In deep learning, Convolutional Neural Network is at the center of spectacular advances. This artificial neural network has been applied to several image recognition tasks for decades and attracted the eye of the researchers of the many countries in recent years as the CNN has shown promising performances in several computer vision and machine learning tasks. This paper describes the underlying architecture and various applications of Convolutional Neural Network.

Alzheimer's disease (AD) is a progressive and evolving neurodegenerative disease with an insidious onset that can lead to memory loss and cognitive impairment. There is no effective treatment for this disease. However, early diagnosis plays an important role in treatment planning to slow down its progression, as treatment has the greatest impact in the early stages of the disease. Neurological images obtained through different imaging techniques provide powerful information and help diagnose the disease. With the wide application of deep learning techniques in disease diagnosis, especially the prominence of Convolutional Neural Networks (CNNs) in computer vision and image processing, more and more studies are proposing the use of this algorithm for the diagnosis of AD. In this paper, we first systematically introduce the impact of AD on people, detailing the biomarkers, early clinical symptoms, and risk factors of this disease. Secondly, it goes on to detail the development of CNNs, their form, and methods to help diagnose AD. It is proposed that CNNs can help diagnose AD by analyzing medical imaging data, particularly structural brain scans such as magnetic resonance imaging (MRI) and functional scans such as positron emission tomography (PET). Finally, it is concluded that CNNs are of great importance for the diagnosis of AD and that they are likely to play an increasingly important role in the early detection of the disease, the understanding of disease mechanisms, and ultimately, in the development of effective AD therapies and interventions. CNNs are playing an increasingly important role in the Their potential impact on healthcare emphasizes the importance of continued research and innovation in neural networks and medical imaging.

Image denoising has been one of the important problems in the field of computer vision, and it has a wide range of practical value in many applications, such as medical image processing, image enhancement, and computational photography. Traditional image denoising methods are usually based on hand-designed features and filters, but these methods perform poorly under complex noise and image structures. In recent years, the rapid development of neural network technology has revolutionized the image-denoising task. This paper introduces the knowledge about neural networks and image denoising, explores the impact of neural networks on image denoising, and how is it possible to denoise images by neural networks. It also summarises other image-denoising methods and finally points out the challenges and problems faced by image-denoising at present. Some possible new development directions are proposed to provide new solutions for image-denoising researchers and to promote the development of the field.

Numerous approaches address over-fitting in neural networks: by imposing a penalty on the parameters of the network (L1, L2, etc); by changing the network stochastically (drop-out, Gaussian noise, etc.); or by transforming the input data (batch normalization, etc.). In contrast, we aim to ensure that a minimum amount of supporting evidence is present when fitting the model parameters to the training data. This, at the single neuron level, is equivalent to ensuring that both sides of the separating hyperplane (for a standard artificial neuron) have a minimum number of data points — noting that these points need not belong to the same class for the inner layers. We firstly benchmark the results of this approach on the standard Fashion-MINST dataset, comparing it to various regularization techniques. Interestingly, we note that by nudging each neuron to divide, at least in part, its input data, the resulting networks make use of each neuron, avoiding a hyperplane completely on one side of its input data (which is equivalent to a constant into the next layers). To illustrate this point, we study the prevalence of saturated nodes throughout training, showing that neurons are activated more frequently and earlier in training when using this regularization approach. A direct consequence of the improved neuron activation is that deep networks are now easier to train. This is crucially important when the network topology is not known a priori and fitting often remains stuck in a suboptimal local minima. We demonstrate this property by training a network of increasing depth (and constant width): most regularization approaches will result in increasingly frequent training failures (over different random seeds) whilst the proposed evidence-based regularization significantly outperforms in its ability to train deep networks.

Recent biotechnological innovations make feasible the new paradigm of creating biological neural circuits de novo. With advances in protein, cell and tissue engineering techniques, as well as cellular reprogramming methods, we are entering an era where the construction of neural circuits can open completely new ways for studying nervous systems and for treating nervous system disorders. I explore here three technologies, namely cellular engraftment, neuronal reprogramming and transsynaptic molecule engineering, and delineate how they are being used in a variety of basic research and translational medicine contexts. In basic neuroscience, neural circuit construction methods are enabling ways to study causality in neural development (e.g. neural precursor differentiation and migration) and circuit function (e.g. excitation/inhibition balance, neural population dynamics). In translational neuroscience, they are providing opportunities for the targeted correction of circuit malfunction in brain disorders, both psychiatric (e.g. schizophrenia) and neurological (e.g. Parkinson’s, Huntington’s and Alzheimer’s disease, as well as epilepsy). I discuss the challenges that these methods currently face, such as targeting specificity and cell survival, and outline future paths and opportunities to realize the full potential of technologies for creating new biological neural circuits.

Neural decoding from spiking activity is an essential tool for understanding the information encoded in population neurons, especially in applications like brain-computer interface (BCI). Various quantitative methods have been proposed and have shown superiorities under different scenarios respectively. From the machine learning perspective, the decoding task is to map the high-dimensional spatial &amp; temporal neuronal activity to the low-dimensional physical quantities (e.g., velocity, position). Because of the complex interactions and the abundant dynamics among neural circuits, good decoding algorithms usually have the capability of capturing flexible spatiotemporal structures embedded in the input feature space. Recently, the Transformer-based models are widely used in processing natural languages and images due to its superior performances in handling long-range and global dependencies. Hence, in this work we examine the potential applications of Transformers in neural decoding and introduce two Transformer-based models. Besides adapting the Transformer to neuronal data, we also propose a data augmentation method for overcoming the data shortage issue. We test our models on three experimental datasets and their performances are comparable to the previous state-of-the-art (SOTA) RNN-based methods. In addition, Transformer-based models show increased decoding performances when the input sequences are longer, while LSTM-based models deteriorate quickly. Our research suggests that Transformer-based models are important additions to the existing neural decoding solutions, especially for large datasets with long temporal dependencies.

Activation Functions are crucial parts of the Deep Learning Artificial Neural Networks. From the Biological point of view, a neuron is just a node with many inputs and one output. A neural network consists of many interconnected neurons. It is a “simple” device that receives data at the input and provides a response. The function of neurons is to process and transmit information; the neuron is the basic unit in the nervous system. Carly Vandergriendt (2018) stated the human brain at birth consists of an estimated 100 billion Neurons. The ability of a machine to mimic human intelligence is called Machine Learning. Deep Learning Artificial Neural Networks was designed to work like a human brain with the aid of arbitrary choice of Non-linear Activation Functions. Currently, there is no rule of thumb on the choice of Activation Functions, “Try out different things and see what combinations lead to the best performance”, however, sincerely; the choice of Activation Functions should not be Trial and error. Jamilu (2019) proposed that Activation Functions shall be emanated from AI-ML-Purified Data Set and its choice shall satisfy Jameel’s ANNAF Stochastic and or Deterministic Criterion. The objectives of this paper are to propose instances where Deep Learning Artificial Neural Networks are SUPERINTELLIGENT. Using Jameel’s ANNAF Stochastic and or Deterministic Criterion, the paper proposed four classes where Deep Learning Artificial Neural Networks are Superintelligent namely; Stochastic Superintelligent, Deterministic Superintelligent, and Stochastic-Deterministic 1^st and 2^nd Levels Superintelligence. Also, a Normal Probabilistic-Deterministic case was proposed.

Cognitive neuroscience is the study of how the human brain functions on tasks like decision making, language, perception and reasoning. Deep learning is a class of machine learning algorithms that use neural networks. They are designed to model the responses of neurons in the human brain. Learning can be supervised or unsupervised. Ngram token models are used extensively in language prediction. Ngrams are probabilistic models that are used in predicting the next word or token. They are a statistical model of word sequences or tokens and are called Language Models or Lms. Ngrams are essential in creating language prediction models. We are exploring a broader sandbox ecosystems enabling for AI. Specifically, around Deep learning applications on unstructured content form on the web.

This review explores the complex interrelationships between emotion, attention, and behavior, drawing upon empirical evidence from psychological, neuroscientific, and clinical studies. It delves into the neural mechanisms that underlie these interactions, with a focus on key brain regions such as the prefrontal cortex and amygdala. Clinical cases involving stroke and attention-deficit/hyperactivity disorder (ADHD) are examined to illustrate the real-world implications of these cognitive interactions. The review also discusses the impact of effective emotion regulation strategies and the role of attention as a cognitive mechanism that influences both emotion and behavior. Neuroimaging studies, particularly functional MRI, are highlighted for their role in providing a deeper understanding of these intricate relationships. The review concludes by emphasizing the importance of this triadic relationship in adaptive functioning and its broader implications for mental health, interpersonal relationships, and quality of life.

Next-generation cancer and oncology research needs to take full advantage of the multi-modal structured, or graph, information, with the graph datatypes ranging from molecular structures to spatially resolved imaging and digital pathology to biological networks to knowledge graphs. Graph Neural Networks (GNNs) efficiently combine the graph structure representations with the high predictive performance of deep learning, especially on the large multi-modal datasets. In this review article, we survey the landscape of recent (2020-present) GNN applications in the context of cancer and oncology research, and delineate six currently predominant research areas. Subsequently, we identify the most promising directions for future research. We compare GNNs with graphical models and "non-structured" deep learning, and devise the guidelines for cancer and oncology researchers or physician-scientists asking the question of whether they should adopt the GNN methodology in their research pipelines.

Oleuropein (OLE), a main constituent of olive, displays a pleiotropic beneficial dynamic in health and disease, based mainly on its antioxidant and hypolipidemic properties, and its capacity to protect myocardium during ischemia. Furthermore, OLE activates peroxisome proliferator-activated receptor (PPARα) in neurons and astrocytes, providing neuroprotection against noxious biological reactions that are induced following cerebral ischemia. Current study investigated the effect of OLE in the regulation of various neural plasticity indices, emphasizing the role of PPARα. For this purpose, 129/Sv wild-type (WT) and Pparα-null mice were treated with OLE for three weeks. The present findings revealed that chronic treatment with OLE up-regulated the brain-derived neurotrophic factor (BDNF) and its receptor TrkB in the prefrontal cortex (PFC) of mice via activation of ERK1/2, AKT and PKA/CREB signaling pathways. No similar effects were observed in the hippocampus. The OLE-induced effects on BDNF and TrkB appear to be mediated by PPARα, because no similar alterations were observed in the PFC of Pparα-null mice. Notably, OLE did not affect the neurotrophic factors NT3 and NT4/5 in both brain tissues. Fenofibrate though, a selective PPARα agonist, up-regulated BDNF and NT3 in the PFC of mice, whereas the drug induced NT4/5 in both brain sites tested. Interestingly, OLE provided neuroprotection in differentiated human SH-SY5Y cells against β-amyloid and H2O2 toxicity independently from PPARα activation. In conclusion, OLE and similar drugs acting either as PPARα agonists or via PPARα independent mechanisms could improve synaptic function/plasticity mainly in the PFC and to a lesser extent in the hippocampus, thus beneficially affecting cognitive functions.

Adult neural stem and progenitor cells (NSPCs) contribute to learning, memory, maintenance of homeostasis, energy metabolism and many other essential processes. They are highly heterogeneous populations that require input from a regionally distinct microenvironment including a mix of neurons, oligodendrocytes, astrocytes, ependymal cells, NG2+ glia, vasculature, cerebrospinal fluid (CSF), and others. The diversity of NSPCs is present in all three major parts of the CNS, i.e., the brain, spinal cord, and retina. Intrinsic and extrinsic signals, e.g., neurotrophic and growth factors, master transcription factors, and mechanical properties of the extracellular matrix (ECM), collectively regulate activities and characteristics of NSPCs: quiescence/survival, proliferation, migration, differentiation, and integration. This review discusses the heterogeneous NSPC populations in the normal physiology and highlights their potentials and roles in injured/diseased states for regenerative medicine.

The industry is increasingly relying on fish for toxicity assessment. However, current guidelines for toxicity assessment focus on teratogenicity and mortality. From an ecotoxicological point of view, however, these endpoints may not reflect the “full picture” of possible deleterious effects that can nonetheless result in decreased fitness and/or inability to adapt to a changing environment, affecting whole populations. Therefore, assessing sublethal effects add relevant data covering different aspects of toxicity at different levels of analysis. Impacts of toxicants on neurobehavioral function have the potential to affect many different life-history traits, and are easier to assess in the laboratory than in the wild. We propose that carefully-controlled laboratory experiments on different behavioral domains – including anxiety, aggression, and exploration – can increase our understanding of the ecotoxicological impacts of contaminants, since these domains are related to traits such as defense, sociality, and reproduction, directly impacting life-history traits. The effects of selected contaminants on these tests are reviewed, focusing on larval and adult zebrafish, showing that these behavioral domains are highly sensitive to small concentrations of these substances. These strategies suggest a way forward on ecotoxicological research using fish.

Interhemispheric and frontoparietal functional connectivity have been reported to increase during explicit information processing. However, it is unclear how and when interhemispheric and frontoparietal functional connectivity interact during explicit semantic processing. Here, we tested the neural coupling hypothesis that explicit semantic processing promotes neural activity in the nondominant right hemispheric areas owing to synchronization with enhanced frontoparietal functional connectivity at later processing stages. We analyzed electroencephalogram data obtained using a semantic priming paradigm, which comprised visual priming and target words successively presented under direct or indirect attention to semantic association. Scalp potential analysis demonstrated that the explicit processing of congruent targets reduced negative event-related potentials, as previously reported. Current source density analysis showed that explicit semantic processing activated the right temporal area during later temporal intervals. Subsequent dynamic functional connectivity and neural coupling analyses revealed that explicit semantic processing increased the correlation between right temporal source activities and frontoparietal functional connectivity in later temporal intervals. These findings indicate that explicit semantic processing increases neural coupling between the interhemispheric and frontoparietal functional connectivity during later processing stages.

This paper presents a novel approach for the recognition of multiple sclerosis (MS) using wavelet entropy and a Particle Swarm Optimization (PSO)-based neural network. MS is a complex neurological disorder with diverse clinical manifestations, often challenging to diagnose accurately. In this study, we leverage wavelet entropy (WE) as a feature extraction method to capture intricate patterns within brain imaging data. These extracted features are then employed to train a neural network model optimized through PSO to enhance classification accuracy. Experimental results on a dataset comprising MS and healthy control subjects demonstrate the effectiveness of our proposed approach, viz., WE-PSONN, which achieves a sensitivity of 91.95±1.15, a specificity of 92.36±0.88, a precision of 92.28±0.88, an accuracy of 92.16±0.90. The combination of advanced signal processing techniques and machine learning optimization holds promise for improving the early diagnosis and management of MS, offering potential benefits to both patients and healthcare providers.

Identification of plants is a challenging task which aims to identify the family, genus, and species level according to morphological features. Automated deep learning-based computer vision algorithms are widely used for identifying plants and can help users to narrow down the possibilities. However, numerous morphological similarities between and within species make the classification difficult. In this paper, we tested a custom convolution neural network (CNN) and vision transformer (ViT) based models using the PyTorch framework to classify plants. We used a large dataset of 88K and 16K images for classifying plants at genus and species levels respectively. Our results show that for classifying plants at the genus level, ViT models perform better compared to CNN-based models ResNet50 and ResNet-RS-420, and other state-of-the-art CNN-based models suggested in previous studies on a similar dataset. The ViT model achieved top accuracy of 83.3% for classifying plants at the genus level. ViT models also perform better for classifying plants at the species level compared to CNN-based models ResNet50 and ResNet-RS-420, with a top accuracy of 92.5%. We show that the correct set of augmentation techniques plays an important role in classification success.

A chronically stable electrode material with low impedance for recording neural activity and high charge-injection capacity for functional electro-stimulation is desirable for the fabrication of implantable microelectrode arrays that aims to restore impaired or lost neurological functions in humans. For this purpose, we have investigated the electrochemical properties of sputtered ruthenium oxide (RuOx) electrode coatings, deposited on planar microelectrode arrays, using an inorganic model of interstitial fluid (model-ISF) at 37o C as the electrolyte. Through a combination of cyclic voltammetry (CV) and electrochemical impedance spectroscopy (EIS) modelling study we have established the contribution of faradaic reaction as the major charge-injection contributor within the safe neural stimulation potential window of 0.6 V vs Ag|AgCl. We have also established the reversibility of the charge-injection process for sputtered RuOx film by applying constant charge-per-phase current stimulations at different pulse widths and by comparing the magnitudes of leading and trailing access voltages during voltage transient measurements. Finally, the impedance of the sputtered RuOx film was found to be reasonably comparable in both its oxidized and reduced states, although electronic contribution from capacitive double-layer was found to be slightly higher for the completely oxidized film around 0.6 V than its reduced counterpart around -0.6V.

With the exponential growth of machine learning and development of Artificial Neural Network (ANNs) in recent years, there is great opportunity to leverage this approach and accelarate bio-logical discoveries through applications on the analysis of bioinformatics data. Various types of datasets including for example protein or gene interaction networks, molecular structures and cellular signalling pathways, have already been used for machine learning by training ANNs for inference and pattern classification. However, unlike regular data structures that are commonly used in the computer science and engineering fields, bioinformatics datasets present challenges that require unique algorithmic approaches. The recent development of the geometric and deep learning approach within the machine learning field, is very promising towards accelerating analysis complex bioinformatics datasets. The principles of ANNs and their importance for bio-informatics machine learning is demonstrated herein, through presentation of the undelying mathematical and statistical foundations from group theory, symmetry, linear algebra. Further-more, the structure and functions of ANN algorithms that form the core principles of artificial intelligence are explained, in relation to the bioinformatics data domain. Overall, the manuscript provides guidance for researchers to understand the principles required for practicing machine learning and artificial intelligence, with the special considerations towards bioinformatics applications.

While modeling data in reality, uncertainties in both data (aleatoric) and model (epistemic) are not necessarily Gaussian. The uncertainties could appear with multimodality or any other particular forms which need to be captured. Gaussian mixture models (GMMs) are powerful tools that allow us to capture those features from a unknown density with a peculiar shape. Inspired by Fourier expansion, we propose a GMM model structure to decompose arbitrary unknown densities and prove the property of convergence. A simple learning method is introduced to learn GMMs through sampled datasets. We applied GMMs as well as our learning method to two classic neural network applications. The first one is learning encoder output of autoencoder as GMMs for handwritten digits images generation. The another one is learning gram matrices as GMMs for style-transfer algorithm. Comparing with the classic Expectation maximization (EM) algorithm, our method does not involve complex formulations and is capable of achieving applicable accuracy.

Intracortical microelectrodes that can be implanted have the ability to capture fast-changing neuron action potentials in the living brain. Despite this potential, many obstacles must still be overcome for reliable, long-term, high-quality recordings and accurate analysis of brain activity. These challenges include improving recording quality, enhancing recording stability, increasing recording capacity, and adding multi-functional features. One potential approach to enhance implantable microelectrodes involves the advancement of materials, refinement of implantation methodologies, and augmentation of the number of sites for recording. However, these challenges are still being actively researched, and advancements in microelectrode technology are underway. The difficulties with implantable microelectrodes are evaluated, and solutions are presented from different perspectives. The latest advancements in microelectrode technology are reviewed and condensed, and future possibilities are explored.

The accurate prediction of molecular properties such as lipophilicity and aqueous solubility are of great importance and pose challenges in several stages of the drug discovery pipeline. Machine learning methods like graph-based neural networks (GNNs) have shown exceptionally good performance in predicting these properties. In this work, we introduce a novel GNN architecture, called directed edge graph isomorphism network (D-GIN). It is composed of two distinct sub-architectures (D-MPNN, GIN) and achieves an improvement in accuracy over its sub-architectures employing various learning, and featurization strategies. We argue that combining models with different key aspects help make graph neural networks deeper and simultaneously increase their predictive power. Furthermore, we address current limitations in assessment of deep-learning models, namely, comparison of single training run performance metrics, and offer a more robust solution.

Autonomous image recognition has numerous potential applications in the field of planetary science and geology. For instance, having the ability to classify images of rocks would allow geologists to have immediate feedback without having to bring back samples to the laboratory. Also, planetary rovers could classify rocks in remote places and even in other planets without needing human intervention. Shu et al. classified 9 different types of rock images using a Support Vector Machine (SVM) with the image features extracted autonomously. Through this method, the authors achieved a test accuracy of 96.71%. In this research, Convolutional Neural Networks(CNN) have been used to classify the same set of rock images. Results show that a 3-layer network obtains an average accuracy of 99.60% across 10 trials on the test set. A version of Self-taught Learning was also implemented to prove the generalizability of the features extracted by the CNN. Finally, one model has been chosen to be deployed on a mobile device to demonstrate practicality and portability. The deployed model achieves a perfect classification accuracy on the test set, while taking only 0.068 seconds to make a prediction, equivalent to about 14 frames per second.

Objectives: In order to solve the problem that most of the existing research focuses on the binary tactile attributes of objects,which ignores the tactile attribute strength and category recognition,an attribute strength and category recognition method based on convolutional neural network matrix-label is proposed. Methods:Firstly,in the data preparation stage,we preprocess the raw data and determine the matrix labels to build the haptic dataset.Secondly,in the feature extraction stage,we fuse the haptic data of two fingers and use the convolutional neural network to extract the attribute strength features.Finally,in the attribute strength and category recognition stage,all channel haptic data is fused to predict the attribute strength and category.Results:We compared with the multi-label convolutional neural network method in terms of elastic strength,hardness strength and category,and compared the attribute strength recognition capabilities of the two methods using novel objects outside the haptic dataset.The results show that the accuracy of the last 20 iterations of the matrix-label method has an average elastic strength of 96.73%,hardness strength of 97.34%,and category of 96.67%.The performance is better.When the Euclidean distance between the prediction of the novel object and the real label is less than 1,the accuracy of the elastic strength is best to reach 100%,and the hardness strength is best to reach 100%.The performance is better. Conclusions:The effectiveness of the method has been verified.Comparing with the convolutional neural network method,our method can effectively recognize the attribute strength and category of objects.

This work describes and compares the backpropagation algorithm with the Extended Kalman filter, a second-order training method which can be applied to the problem of learning neural network parameters and is known to converge in only a few iterations. The algorithms are compared with respect to their effectiveness and speed of convergence using simulated data for both, a regression and a classification task.

Although Shannon mutual information has been widely used, its effective calculation is often difficult for many practical problems, including those in neural population coding. Asymptotic formulas based on Fisher information sometimes provide accurate approximations to the mutual information but this approach is restricted to continuous variables because the calculation of Fisher information requires derivatives with respect to the encoded variables. In this paper, we consider information-theoretic bounds and approximations of the mutual information based on Kullback--Leibler divergence and Rényi divergence. We propose several information metrics to approximate Shannon mutual information in the context of neural population coding. While our asymptotic formulas all work for discrete variables, one of them has consistent performance and high accuracy regardless of whether the encoded variables are discrete or continuous. We performed numerical simulations and confirmed that our approximation formulas were highly accurate for approximating the mutual information between the stimuli and the responses of a large neural population. These approximation formulas may potentially bring convenience to the applications of information theory to many practical and theoretical problems.

The detection of seismic events at regional and teleseismic distances is critical to Nuclear Treaty Monitoring. Traditionally, detecting regional and teleseismic events has required the use of an expensive multi-instrument seismic array; however in this work, we present DeepPick, a novel seismic detection algorithm capable of array-like performance from a single trace. We achieve this directly, by training our single-trace detector against labeled events from an array catalog, and by utilizing a deep temporal convolutional neural network. The training data consists of all arrivals in the International Seismological Centre Catalog for seven seismic arrays over a five year window from 1 Jan 2010 to 1 Jan 2015, yielding a total training set of 608,362 detections. The test set consists of the same seven arrays over a one year window from 1 Jan 2015 to 1 Jan 2016. We report our results by training the algorithm on six of the arrays and testing it on the seventh, so as to demonstrate the transportability and generalization of the technique to new stations. Detection performance against this test set is outstanding. Fixing a type-I error rate of 1%, the algorithm achieves an overall recall rate of 73% on the 141,095 array beam picks in the test set, yielding 102,394 correct detections. This is more than 4 times the 23,259 detections found in the analyst-reviewed single-trace catalogs over the same period, and represents an 8dB improvement in detector sensitivity over current methods. These results demonstrate the potential of our algorithm to significantly enhance the effectiveness of the global treaty monitoring network.

Network Embedding (NE) is an important method to learn the representations of network via a low-dimensional space. Conventional NE models focus on capturing the structure information and semantic information of vertices while neglecting such information for edges. In this work, we propose a novel NE model named BimoNet to capture both the structure and semantic information of edges. BimoNet is composed of two parts, i.e., the bi-mode embedding part and the deep neural network part. For bi-mode embedding part, the first mode named add-mode is used to express the entity-shared features of edges and the second mode named subtract-mode is employed to represent the entity-specific features of edges. These features actually reflect the semantic information. For deep neural network part, we firstly regard the edges in a network as nodes, and the vertices as links, which will not change the overall structure of the whole network. Then we take the nodes' adjacent matrix as the input of the deep neural network as it can obtain similar representations for nodes with similar structure. Afterwards, by jointly optimizing the objective function of these two parts, BimoNet could preserve both the semantic and structure information of edges. In experiments, we evaluate BimoNet on three real-world datasets and task of relation extraction, and BimoNet is demonstrated to outperform state-of-the-art baseline models consistently and significantly.

This paper investigates the dynamic properties of artificial neural networks using differential equations and explores the influence of parameters on stability and neural oscillations. By analyzing the equilibrium point of the differential equations, we identify conditions for asymptotic stability and criteria for oscillation in artificial neural networks. Furthermore, we demonstrate how adjusting synaptic weights between neurons can effectively control stability and oscillation. The proposed model offers potential insights into the malfunctioning mechanisms of biological neural networks implicated in neurological disorders like Parkinson's disease tremors and epilepsy seizures, which are characterized by abnormal oscillations.

Using machine learning or deep learning to solve the problem of garbage recognition and classification is an important application in computer vision, but due to the incomplete establishment of garbage datasets and the poor performance of complex network models on smart terminal devices, the existing garbage classification models The effect is not good.This paper presents a waste classification and identification method base on transfer learning and lightweight neural network. By migrating the lightweight neural network MobileNetV2 and rebuild it, The reconstructed network is used for feature extraction, and the extracted features are introduced into the SVM to realize the identification of 6 types of garbage. The model was trained and verified by using 2527 pieces of garbage labeled data in the TrashNet dataset, which ultimately resulted in a classification accuracy of 98.4% of the method, which proves that the method can effectively improve the classification accuracy and time and overcome the problem of weak data and less labeling. The over-fitting phenomenon encountered by small data sets in deep learning makes the model robust.

This concept paper gives a narrative about intelligence from insects to the human brain, showing where evolution may have been influenced by the structures in these simpler organisms. The ideas also come from the author's own cognitive model, where a number of algorithms have been developed over time and the precursor structures should be codable to some level. Through developing and trying to implement the design, ideas like separating the data from the function have become architecturally appropriate and there have been several opportunities to make the system more orthogonal. Similarly for the human brain, neural structures may work in-sync with the neural functions, or may be slightly separate from them. Each section discusses one of the neural assemblies with a potential functional result, that cover ideas such as timing or scheduling, structural intelligence and neural binding. Another aspect of self-representation or expression is interesting and may help the brain to realise higher-level functionality based on these lower-level processes.

Convolutional neural network (CNN), a class of artificial neural network (ANN) is attracting interests of researchers in all research domain. CNN was invented for computer vision. They have also shown to be useful for semantic parsing, sentence modeling and other natural language processing related tasks. Here in this paper we discuss the basics of CNN models and their scope to provide a reference/baseline to the researchers interested in using CNN models in their research.

Graph neural networks (GNNs) build on the success of deep learning models by extending them for use in graph spaces. Transfer learning has proven extremely successful for traditional deep learning problems: resulting in faster training and improved performance. Despite the increasing interest in GNNs and their use cases, there is little research on their transferability. This research demonstrates that transfer learning is effective with GNNs, and describes how source tasks and the choice of GNN impact the ability to learn generalisable knowledge. We perform experiments using real-world and synthetic data within the contexts of node classification and graph classification. To this end, we also provide a general methodology for transfer learning experimentation and present a novel algorithm for generating synthetic graph classification tasks. We compare the performance of GCN, GraphSAGE and GIN across both the synthetic and real-world datasets. Our results demonstrate empirically that GNNs with inductive operations yield statistically significantly improved transfer. Further we show that similarity in community structure between source and target tasks support statistically significant improvements in transfer over and above the use of only the node attributes.

: In the last years, materializations of neuromorphic circuits based on nanophotonic arrangements have been proposed, which contain complete optical circuits, laser, photodetectors, photonic crystals, optical fibers, flat waveguides, and other passive optical elements of nanostructured materials, which eliminate the time of simultaneous processing of big groups of data, taking advantage of the quantum perspective and thus highly increasing the potentials of contemporary intelligent computational systems. This article is an effort to record and study the research that has been conducted concerning the methods of development and materialization of neuromorphic circuits of Neural Networks of nanophotonic arrangements. In particular, an investigative study of the methods of developing nanophotonic neuromorphic processors, their originality in neuronic architectural structure, their training methods and their optimization has been realized along with the study of special issues such as optical activation functions and cost functions.

Precision agriculture is a technology used by farmers to help food sustainability amidst growing population. One of the tools of precision agriculture is yield monitoring, which helps a farmer manage his production. Yield monitoring is usually done during harvest, however it could also be done early in the growing season. Early prediction of yield, specifically for fruit trees, aids the farmer in the marketing of their product and assists in managing production logistics such as labor requirement and storage needs. In this study, a machine vision system is developed to estimate fruit yield early in the season. The machine vision system uses a color camera to capture images of fruit trees during the full bloom period. An image segmentation algorithm based on an artificial neural network was developed to recognize and count the blossoms on the tree. The artificial neural network segmentation algorithm uses color information and position as input. The resulting correlation between the blossom count and the actual number of fruits on the tree shows the potential of this method to be used for early prediction of fruit yield.

Accurate electricity price forecasting has become a substantial requirement since the liberalization of the electricity markets. Due to the challenging nature of the electricity prices, which includes high volatility, sharp price spikes and seasonality, various types of electricity price forecasting models still compete and can not outperform each other consistently. Neural Networks have been successfully used in machine learning problems and Recurrent Neural Networks (RNNs) have been proposed to address time-dependent learning problems. In particular, Long Short Term Memory and Gated Recurrent Units (GRU) are tailor-made for time series price estimation. In this paper, we propose to use Gated Recurrent Units as a new technique for electricity price forecasting. We have trained a variety of algorithms with rolling 3-year window and compared the results with the RNNs. In our experiments, 3-layered GRUs outperformed all other neural network structures and state of the art statistical techniques in a statistically significant manner in the Turkish day-ahead market.

Although adults and children differ in self-versus-other perception, the developmental perspective on this discriminative ability is missing. We compared neural activation of self-vs-others in 39 participants of 4 different age groups (4 yo. to adulthood). Two brain regions, the MCC and right postcentral gyrus, exhibited respectively non-linear and gradual gains in discriminative abilities for self-vs-others stimuli. These regions play critical roles in self-referential processing, empathy, and social cognition. Nine brain regions showed linear increase for others-vs-self stimuli. These regions are associated with multisensory processing, somatosensory skills, complex visual stimuli, self-awareness, empathy, theory of mind, and social recognition. Understanding the neural basis of self-vs-others discrimination during development can inform when and how social contexts support learning processes during childhood and adolescence.

Predicting the prices of cryptocurrency owing to its volatility, instability, and other factors has been challenging; investors and traders especially in Nigeria have been on a constant look for a more reliable way of knowing market trends and prices and while there has been so many research conducted using deep learning, the results for which has fall short of what investors could called a strong predictor. This research reviewed the results of many works that had been done and proposed two types of recurrent neural network (RNNs) namely Long Short-Term Memory and Gated Recurrent Unit (GRU) for predicting the future prices of two of the most common crypto assets namely Bitcoin (BTC) and Ethereum (ETH), these two were selected based on their popularity, the volume traded and their market capitalization. The experiment was conducted in a GPU Jupyter Notebook environment and the performance of our experiment was evaluated on a test set using root mean square error (RMSE) and based on its values, the LSTM presented a better performance with rsme scores of 654.66, and 80.30 respectively for BTC and ETH as compared to GRU. The paper proceeds further to compare the results of this experiment with other related works and we discovered that its performance is a great improvement.

Epilepsy is a neurological disorder that affects approximately 1% of the world's population. To diagnose and estimate the occurrence of epilepsy, the analysis of recorded brain activity is performed by a neurologist, which is not only time-consuming and tedious but also occasionally accompanied by human error. Therefore, in recent decades, researchers have aimed to unravel an approach for designing and building an automated method for diagnosing and estimating the occurrence of epilepsy. Accordingly, the present study proposed two new-fangled ways based on brain signals and a convolutional neural network (CNN). Moreover, this research implements a CNN with a sequential three-layer structure. Numerous experiments were performed, and the accuracy of estimating epilepsy using the developed methods was achieved at 95% without feedback and 97% with feedback. The proposed methods were proven to be more accurate than the previous techniques and can be employed as a physician's assistant once entering the field of operation.

Deep learning (DL), which is originated from an artificial neural network (ANN), is one of the major technologies of today's smart cybersecurity systems or policies to function in an intelligent manner. Popular deep learning techniques, such as Multi-layer Perceptron (MLP), Convolutional Neural Network (CNN or ConvNet), Recurrent Neural Network (RNN) or Long Short-Term Memory (LSTM), Self-organizing Map (SOM), Auto-Encoder (AE), Restricted Boltzmann Machine (RBM), Deep Belief Networks (DBN), Generative Adversarial Network (GAN), Deep Transfer Learning (DTL or Deep TL), Deep Reinforcement Learning (DRL or Deep RL), or their ensembles and hybrid approaches can be used to intelligently tackle the diverse cybersecurity issues. In this paper, we aim to present a comprehensive overview from the perspective of these neural networks and deep learning techniques according to today's diverse needs. We also discuss the applicability of these techniques in various cybersecurity tasks such as intrusion detection, identification of malware or botnets, phishing, predicting cyber-attacks, e.g. denial of service (DoS), fraud detection or cyber-anomalies, etc. Finally, we highlight several research issues and future directions within the scope of our study in the field. Overall, the ultimate goal of this paper is to serve as a reference point and guidelines for the academia and professionals in the cyber industries, especially from the deep learning point of view.

Deep learning has achieved remarkable success in diverse computer science applications, however, its use in other traditional engineering fields has emerged only recently. In this project, we solved several mechanics problems governed by differential equations, using physics informed neural networks (PINN). The PINN embeds the differential equations into the loss of the neural network using automatic differentiation. We present our developments in the context of solving two main classes of problems: data-driven solutions and data-driven discoveries, and we compare the results with either analytical solutions or numerical solutions using the finite element method. The remarkable achievements of the PINN model shown in this report suggest the bright prospect of the physics-informed surrogate models that are fully differentiable with respect to all input coordinates and free parameters. More broadly, this study shows that PINN provides an attractive alternative to solve traditional engineering problems.

In this paper, a framework for simultaneous tracking and recognizing drone targets using a low-cost and small-sized millimeter-wave radar is presented. The radar collects the reflected signals of multiple targets in the field of view including drone and non-drone targets. The analysis of the received signals allows multiple targets to be distinguished because of the different reflection patterns. The proposed framework consists of four processes including signal processing, cloud points clustering, target tracking, and target recognition. Signal processing translates the raw signals into spare cloud points. These points are merged into several clusters, each representing a single target. Target tracking estimates the new locations of each detected target. A novel convolutional neural network model is developed for drone and/or non-drone targets feature extraction and recognition. For performance evaluation, a dataset collected with an IWR6843ISK mmWave sensor by Texas Instruments is used for training and testing the convolutional neural network. The proposed recognition model achieves an accuracy of 98.4% for one target and 98.1% for two targets.

In this essay, I revisit Neural Networks (NNs) through the lens of evolutionary dynamics. From the two most important features of NNs, I recover the two most general equations of evolutionary dynamics. These two equations may thus serve as a connection between NNs and a body of knowledge that has been built over multiple centuries and has found application across a vast range of disciplines. This connection may therefore also help explain why NNs with the two features in question are applicable across a much broader range of domains than initially envisioned.

Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) persists throughout the world with over 65 million registered cases of survivors with post-COVID-19 sequelae, also known as LongCOVID-19 (LongC). LongC survivors exhibit various symptoms that span multiple organ systems, including the nervous system. To search for neurological biomarkers of LongC, we investigated the soluble proteins present in the plasma and the proteins associated with plasma neuronal-enriched extracellular vesicles (nEVs) in 33 LongC patients with neurological impairment (nLongC), 12 COVID-19 survivors without any LongC symptoms (Cov), and 28 pre-COVID-19 healthy controls (HC). COVID-19 positive participants were infected from 2020-2022, not hospitalized, and were vaccinated or unvaccinated before infection. IL-1b was significantly increased in both nLongC and Cov and IL-8 elevated in only nLongC. Both brain-derived neurotropic factor and cortisol were significantly elevated in nLongC and Cov compared to HC. nEVs from people with nLongC had significantly elevated protein markers of neuronal dysfunction, including amyloid beta 42, pTau181 and TDP-43. This study shows chronic peripheral inflammation with increased stress after COVID-19 infection. Additionally, differentially expressed nEV neurodegenerative proteins were identified in people recovering from COVID-19 regardless of persistent symptoms.

Applications of gradient method for nonlinear optimization in development of Gradient Neural Network (GNN) and Zhang Neural Network (ZNN) are investigated. Particularly, the solution of the matrix equation AXB=D which changes over time is studied using the novel GNN model, termed as GGNN(A,B,D). The GGNN model is developed applying GNN dynamics on the gradient of the error matrix used in the development of the GNN model. The convergence analysis shows that the neural state matrix of the GGNN(A,B,D) design converges asymptotically to the solution of the matrix equation AXB=D, for any initial state matrix. It is also shown that the convergence result is the least square solution which is defined depending on the selected initial matrix. A hybridization of GGNN with analogous modification GZNN of the ZNN dynamics is considered. The Simulink implementation of presented GGNN models is carried out on the set of real matrices.

This report gives a comprehensive summary of two problems about graph convolutional networks (GCNs): over-smoothing and heterophily challenges, and outlines future directions to explore.

Creating self-learning algorithms, developing deep neural networks and improving other methods that "learn" for various areas of human activity is the main goal of the theory of machine learning. It helps to replace the human with a machine, aiming to increase the quality of production. The theory of artificial neural networks, which already have replaced the humans in problems of detection of moving objects, recognition of images or sounds, time series prediction, big data analysis and numerical methods remains the most dispersed branch of the theory of machine learning. Certainly, for each area of human activity it is necessary to select appropriate neural network architectures, methods of data processing and some novel tools from applied mathematics. But the universal problem for all these neural networks with specific data is the achieving the highest accuracy in short time. Such problem can be resolved by increasing sizes of architectures and improving data preprocessing, where the accuracy rises with the training time. But there is a possibility to increase the accuracy without time growing, applying optimization methods. In this survey we demonstrate existing optimization algorithms of all types, which can be used in neural networks. There are presented modifications of basic optimization algorithms, such as stochastic gradient descent, adaptive moment estimation, Newton and quasi-Newton optimization methods. But the most recent optimization algorithms are related to information geometry, for Fisher-Rao and Bregman metrics. This approach in optimization extended the theory of classic neural networks to quantum and complex-valued neural networks, due to geometric and probabilistic tools. There are provided applications of all introduced optimization algorithms, what delighted many kinds of neural networks, which can be improved by including any advanced approaches in minimization of the loss function. Afterwards, we demonstrated ways of developing optimization algorithms in further researches, engaging neural networks with progressive architectures. Classical gradient based optimizers can be replaced by fractional order, bilevel and, even, gradient free optimization methods. There is a possibility to add such analogues in graph, spiking, complex-valued, quantum and wavelet neural networks. Besides the usual problems of image recognition, time series prediction, object detection, there are many are other tasks for modern theory of machine learning, such as solving problem of quantum computations, partial differential and integro-differential equations, stochastic processes and Brownian motion, making decisions and computer algebra.

Creating intelligent systems capable of recognizing emotions is a difficult task, especially when looking at emotions in animals. This paper describes the process of designing a “proof of concept” system to recognize emotions in horses. This system is formed by two elements, a detector and a model. The detector is a fast region-based convolutional neural network that detects horses in an image. The model is a convolutional neural network that predicts the emotions of those horses. These two elements were trained with multiple images of horses until they achieved high accuracy in their tasks. 400 images of horses were collected and labeled to train both the detector and the model while 80 were used to validate the system. Once the two components were validated, they were combined into a testable system that would detect equine emotions based on established behavioral ethograms indicating emotional affect through head, neck, ear, muzzle and eye position. The system showed an accuracy of between 69% and 74% on the validation set, demonstrating that it is possible to predict emotions in animals using autonomous intelligent systems. Such a system has multiple applications including further studies in the growing field of animal emotions as well as in the veterinary field to determine the physical welfare of horses or other livestock.

Neural networks present the characteristics that the results are strongly dependent on the training data, the weight initialisation, and the hyper-parameters chosen. The determination of the distribution of a statistical estimator, as the Mean Squared Error (MSE) or the accuracy, is fundamental to evaluate the performance of a neural network model (NNM). For many machine learning models, as linear regression, it is possible to analytically obtain information as variance or confidence intervals on the results. Neural networks present the difficulty of being not analytically tractable due to their complexity. Therefore, it is impossible to easily estimate distributions of statistical estimators. When estimating the global performance of an NNM by estimating the MSE in a regression problem, for example, it is important to know the variance of the MSE. Bootstrap is one of the most important resampling techniques to estimate averages and variances, between other properties, of statistical estimators. In this tutorial, the application of two resampling (including bootstrap) techniques to the evaluation of neural networks’ performance is explained from both a theoretical and practical point of view. Pseudo-code of the algorithms is provided to facilitate their implementation. Computational aspects, as the training time, are discussed since resampling techniques always require to run simulations many thousands of times and, therefore, are computationally intensive. A specific version of the bootstrap algorithm is presented that allows the estimation of the distribution of a statistical estimator when dealing with an NNM in a computationally effective way. Finally, algorithms are compared on synthetically generated data to demonstrate their performance.