Natural language Processing (NLP) has significantly transformed in the last decade, especially in the field of Language Modeling. Large Language Models (LLMs) have achieved SOTA performances on Natural Language Understanding (NLU) and Natural Language Generation (NLG) tasks by learning language representation in self-supervised ways. This paper provides a comprehensive survey to capture the progression of advances in Language Models. In this paper, we examine the different aspects of Language Models, which started with a few million parameters but have reached the size of a trillion in a very short time. We also look at how these LLMs transitioned from task-specific to task-independent to task-and-language-independent architectures. This paper extensively discusses different pre-training objectives, benchmarks, and transfer learning methods used in LLMs. It also examines different fine-tuning and In-Context learning techniques used in downstream tasks. It also explores how LLMs can perform well across many domains and datasets if sufficiently trained on a large and diverse dataset. Next, it discusses how, over time, the availability of cheap computational power and large datasets have improved LLM’s capabilities and raised new challenges. As part of our study, we also inspect LLMs from the lens of scalability to see how their performance is affected by the model’s depth, width, and data size. Lastly, we provide an empirical comparison of existing trends and techniques and a comprehensive analysis of where the field of LLM currently stand.

LLMs are a compressed repository of a vast corpus of valuable information on which they are trained. Therefore, this work hypothesizes that LLMs such as Llama, Orca, Falcon, and Mistral can be used for misinformation detection by making them cross-check new information with the repository on which they are trained. Accordingly, this paper describes the findings from the investigation of the abilities of LLMs in detecting misinformation on multiple datasets. The results are interpreted using explainable AI techniques such as LIME, SHAP, and Integrated Gradients. The LLMs themselves are also asked to explain their classification. These complementary approaches aid in better understanding the inner workings of misinformation detection using LLMs and lead to conclusions about their effectiveness at the task.

In recent years, large language models have demonstrated remarkable performance across various natural language processing (NLP) tasks. However, deploying these models for real-world applications often requires efficient inference solutions to handle the computational demands. In this paper, we explore the utilization of CPUs for accelerating the inference of large language models. Specifically, we introduce a parallelized approach to enhance throughput by 1) Exploiting the parallel processing capabilities of modern CPU architectures, 2) Batching the inference request. Our evaluation shows the accelerated inference engine gives an 18-22x improvement in the generated token per sec. The improvement is more with longer sequence and larger models. In addition to this, we can also run multiple workers in the same machine with NUMA node isolation to further improvement in tokens/s. Table 2, we have received 4x additional improvement with 4 workers. This would also make Gen-AI based products and companies’ environment friendly, our estimates shows that CPU usage for Inference could reduce the power consumption of LLMs by 48.9% (1252 W for A100 with AMD EPYC 7V13 vs 613 W for Intel® Xeon® Gold 6538N) while providing production ready throughput & latency.

This paper explores the application of Large Language Models (LLMs), such as GPT-3 and GPT-4, in generating cybersecurity policies and strategies to mitigate ransomware threats, including data theft ransomware. We discuss the strengths and limitations of LLMs for ransomware defense and provide recommendations for effectively leveraging LLMs while ensuring ethical compliance. The key contributions include a quantitative evaluation of LLM-generated policies, an examination of the legal and ethical implications, and an analysis of how LLMs can enhance ransomware resilience when applied judiciously.

This paper proposes the utilization of large language models as recommendations systems for museums. Since the aforementioned models lack the notion of context, they can’t work with temporal information that is often present in recommendations for cultural environments (e.g. special exhibitions or events). In this respect, the current work aims at enhancing the capabilities of large language models through a fine-tuning process that incorporates contextual information and user instructions. The resulting models are expected to be capable of providing personalized recommendations, aligned with user preferences and desires. More specifically, Generative Pre-trained Transformer 4, a knowledge-based large language model is fine-tuned and turned into a context-ware recommendation system, adapting its suggestions based on user input and specific contextual factors such as location, time of visit, and other relevant parameters. The effectiveness of the proposed approach is evaluated through certain user studies, which ensure an improved user experience and engagement within the museum environment.

Although learning analytics (LA) holds great potential to improve teaching and learning, LA research and practice are currently riddled with limitations that impact every stage of the LA life cycle. The present paper offers an overview of these challenges before proposing strategies to overcome them and exploring how the recent innovations brought forth by language models can improve LA research and practice. In particular, we encourage the empowerment of teachers during LA development, as this would strengthen the theoretical foundation of LA solutions and increase their interpretability and usability. Furthermore, we provide examples of how process data can be used to understand learning processes and generate more interpretable LA insights. Furthermore, we explore how LLMs could come into play in LA to generate interpretable insights, timely and actionable feedback, increase personalization, and support teachers’ tasks more broadly.

Musyakalah is one of the Arabic linguistic styles included under the category of majaz. This style is commonly used in Al-Quran. The Indonesian translation of Al-Quran is a case where many of the figures of speech are translated literally, thereby causing serious semantic problems. Thus, the research problem of this is formulated with the following questions: 1) How many musyakalah ayahs are there in Al-Quran?; 2) How are the musyakalah ayahs translated, literally (harfiyya) or interpretatively (tafsiriyya)?; 3) How many ayahs are translated literally and how many are translated interpretatively?; and 4) Which translated musyakalah ayahs have the potential to raise semantic and theological problems? The corpus in this research consists of all musyakalah ayahs in Al-Quran and their translation to Indonesian published by the Department of Religious Affairs of Indonesia. The research adopted a descriptive-semantic method. The findings of this research are: 1) There are only eleven ayahs in Al-Quran using musyakalah style, namely: Alhasyr ayah 19, Ali Imran ayah 54, Annaml ayah 50, Alanfal ayah 30, Asysyura ayah 40, Albaqarah ayah 15, Almaidah 116, Aljatsiah ayah 34, Attaubah ayah 79, Annisa ayah 142, and Albaqarah 194; 2) The musyakalah ayahs translated literally are: Aljatsiah 34, Almaidah 116, Asysura 40, Annaml 50, and Alhasyr 19, whereas the musyakalah ayahs translated interpretatively are Albaqarah 194, Annisa 142, Attaubah 79, Albaqarah 15, Alanfal 30, and Ali Imran 54; 3) Of the eleven musyakalah ayahs, only Alhasyr ayah 19 that is translated correctly and does not have the potential of creating misinterpretation. Meanwhile, the interpretation of the other four ayahs can potentially cause misinterpretation or are against the basic principles of Islam. The six remaining ayahs are translated interpretatively and thus do not have the potential to be misinterpreted; 4) The findings suggest that musyakalah ayahs are more appropriately translated interpretatively. Therefore, the following is recommended: 1) Considering the different characteristics of Arabic and Indonesian languages, studies on Al-Quran translation into Indonesian should continuously be carried out; 2) In order to avoid misinterpretation, it is better that the translation of musyakalah ayahs uses tafsiriyya (interpretative) approach; 3) The harfiyya (literal) and tafsiriyya (interpretative) approaches should be developed for other styles beside musyakalah..

As modern technologies, particularly home assistant devices, become more integrated into our daily lives, they are also making their way into the domain of energy management within our homes. Homeowners, now acting as prosumers, have access to detailed information in 15-minute or even 5-minute intervals, including weather forecasts, outputs from Renewable Energy Sources (RES)-based systems, appliance schedules and the current energy balance, which details any deficits or surpluses along with their quantities and the predicted prices on the Local Energy Market (LEM). The goal for these prosumers is to reduce costs while ensuring their home’s comfort levels are maintained. However, given the complexity and the rapid decision-making required in managing this information, the need for a supportive system is evident. This is particularly true given the routine nature of these decisions, highlighting the potential for a system that provides personalized recommendations to optimize energy consumption, whether that involves adjusting the load or engaging in transactions with the LEM. In this context, we propose a recommendation system powered by Large Language Models (LLM), Scikit-llm and Zero-Shot Classifiers, designed to evaluate specific scenarios and offer tailored advice for prosumers based on the available data at any given moment. Two scenarios for a prosumer of 5.9 kW are assessed using candidate labels, such as Decrease, Increase, Sell and Buy.

Cognitive Warfare (CogWar) is another form of warfare where the goal is to exploit cognition facets to disrupt, undermine, influence or modify human decisions. Famous examples include “Operation Gidlock” meddling with the US 2016 election, and CogWar campaigns assisting the annexation of Crimea. As Large Language Model(LLM)-based applications expand, reaching more users and their cognitive states, stealth Malicious Cognitive Behavioral Tactics (MCBT) can be embedded in trusted application sessions to systematically profile, then alter, each individual’s cognition over time. Successful MCBT can create more cases like Snowden, mass shootings, or January6. This short-form paper discusses a novel MCBT threat model, a novel kill chain, and an on-going prototype for demonstration.

Background: People with Down syndrome (DS) have a trisomy of chromosome 21 and marked deficits in verbal memory but relatively preserved visuospatial perception. Verbal memories are related to semantic knowledge. Little is known about the organization of semantic knowledge in people with DS, which was the aim of this study. Aims: The extent of false memory in people with DS was examined. Possible differences in the number of false memories induced by nominal and verbal themes were examined. Methods and Procedures: In the study phase, ten word lists with semantically related associates were presented. In the recognition phase, participants made judgments on whether each word had been represented previously as semantically related lures, old words, and semantically unrelated new words. Outcomes and Results: Differences in the processing of nominal and verbal theme-related lures were observed among people with DS. When processing nominal theme-related lures, people with DS showed delayed false positives. When processing verbal theme-related lures, people with DS showed no differences compared to controls. Similar patterns have been observed in people with DS when processing nominal theme-related associates and verbal theme-related associates. People with DS have delayed recognition of associates. When processing unrelated words, they showed significantly higher false positives than controls for both nominal and verbal eliciting themes. Further analyses of the themes revealed differences in false positives across syntactic categories among groups. Conclusions and Implications: People with DS showed a delayed recognition of associates and deviance in recognizing unrelated words in the nominal and verbal theme categories. People with DS were delayed in terms of nouns, but deviated with verbs in associated and unrelated words. Additionally, people with DS showed distinct patterns in processing five nominal lures and three verbal lures, suggesting that they formed false memories differently based on distinct syntactic categories. Thus, it was concluded that people with DS develop a deviant semantic structure. Category-based interventions for people with DS should be implemented in order to improve their semantic knowledge through lexical connections.

Obsessive-Compulsive Disorder (OCD) is a mental health condition marked by recurrent intrusive thoughts or sensations that compel individuals to perform repetitive behaviors or mental acts. Obsessions and compulsions significantly disrupt daily life and cause considerable distress. Early identification and intervention improve long-term outcomes. This study aimed to evaluate the ability of four advanced artificial intelligence models (ChatGPT-3.5, ChatGPT-4, Claude, and Bard) to accurately recognize OCD compared to human professionals and to assess recommended therapies and stigma attributions. This study was conducted during March 2024 utilizing 12 vi-gnettes. Each vignette depicted a client, either a young adult or a middle-aged male or female, attending an initial therapy session. Each vignette was evaluated ten times, resulting in 480 evaluations. The results were compared with those of a human sample of 514 psychotherapists, as reported by Canavan. Significant differences were found. AI models demonstrated higher OCD recognition rates and confidence levels than human professionals and showed 100% confidence in recognition, compared to 87% among psychotherapists. AI models also recommended evi-dence-based interventions more frequently, with ChatGPT-3.5 and Claude at 100%, ChatGPT-4 at 90%, and Bard at 60%, compared to 61.9% among psychotherapists. Additionally, AI models ex-hibited significantly lower stigma and danger estimations, though both AI and psychotherapists demonstrated high willingness to treat the described cases. The findings suggest that AI models surpass human professionals in recognizing OCD and recommending evidence-based treatments while also demonstrating lower stigma. These results highlight the potential of AI tools to enhance OCD diagnosis and treatment in clinical settings.

Bio-molecular reagents like antibodies required in experimental biology are expensive and their effectiveness, among other things, is critical to the success of the experiment. Although such resources are sometimes donated by one investigator to another through personal communication between the two, there is no previous study to our knowledge on the extent of such donations, nor a central platform that directs resource seekers to donors. In this paper, we describe, to our knowledge, a first attempt at building a web-portal titled Bio-Resource Exchange that attempts to bridge this gap between resource seekers and donors in the domain of experimental biology. Users on this portal can request for or donate antibodies, cell-lines and DNA Constructs. This resource could also serve as a crowd-sourced database of resources for experimental biology. Further, in order to index donations outside of our portal, we mined scientific articles to find instances of donations of antibodies and attempted to extract information about these donations at the finest granularity. Specifically, we extracted the name of the donor, his/her affiliation and the name of the antibody for every donation by parsing the acknowledgements sections of articles. To extract annotations at this level, we propose two approaches – a rule based algorithm and a bootstrapped relation learning algorithm. The algorithms extracted donor names, affiliations and antibody names with average accuracies of 57% and 62% respectively. We also created a dataset of 50 expert-annotated acknowledgements sections that will serve as a gold standard dataset to evaluate extraction algorithms in the future. Contact: [email protected], [email protected] Database URL: http://tonks.dbmi.pitt.edu/brx Supplementary information: Supplementary data are available at Database online.

Backgrounds: The field of Artificial Intelligence (AI) has seen a major shift in recent years due to the development of new Machine Learning (ML) models such as Generative Pre-trained Transformer (GPT) and AI which are progressively becoming part our everyday lives. GPT has achieved previously unheard-of levels of accuracy in most computerized language processing tasks and their chat-based variations. Aim: The aim of this study was to investigate the problem-solving abilities of ChatGPT using two sets of verbal insight problems, with a known performance level established by a sample of human participants. Material and Methods: A total of 30 problems labelled as “practice problems” and “transfer problems”, as listed by Ansburg and Dominowski (2000), were administered to ChatGPT. The answers provided by ChatGPT received a score of "0" for each problem answered incorrectly and a score of "1" for each correct response, as per the correct solution specified in Ansburg and Dominowski's (2000) study. The highest score that could be attributed to both the practice and transfer problems was 15 out of 15. In order to compare ChatGPT performance to the performance to that of human subjects, the solution rate for each problem (based on a sample of 20 subjects) was used, as indicated by Ansburg and Dominowski (2000). Results: The study highlighted that ChatGPT can be trained in out-of-the-box thinking and demonstrated potential in solving verbal insight problems. The global performance of ChatGPT equalled the most probable outcome for the human sample in both practice problems and transfer problems as well as upon their combination. Additionally, ChatGPT answer combinations were among the 5% of most probable outcomes for the human sample both when considering practice problems and pooled problem sets. These findings demonstrate that ChatGPT performance on both set of problems was in line with the mean rate of success of human subjects, indicating that it performed reasonably well. Conclusions: The use of transformer architecture and self-attention in ChatGPT may have helped to prioritize inputs while predicting, contributing to its potential in verbal insight problem-solving. ChatGPT has shown potential in solving insight problems, thus highlighting the importance of incorporating AI in psychological research. However, it is acknowledged that open challenges still exist. Indeed, further research is needed to fully understand the capabilities and limitations of AI in insight problem-solving.

With the rapid growth of large language models (LLMs), there is increasing demand for memory and computation in LLMs. Recent efforts on post-training pruning of LLMs aim to reduce the model size and computation requirements, yet the performance is still sub-optimal. In this paper, we present a plug-and-play solution for post-training pruning of LLMs. The proposed solution has two innovative components: 1) Relative Importance and Activations (RIA), a new pruning metric that jointly considers the weight and activations efficiently on LLMs; and 2) Channel Permutation, a new approach to maximally preserve important weights under N:M sparsity. The two proposed components can be readily combined to further enhance the N:M semi-structured pruning of LLMs. Our empirical experiments show that RIA alone can already surpass all existing post-training pruning methods on prevalent LLMs, e.g., LLaMA ranging from 7B to 65B. Furthermore, N:M semi-structured pruning with channel permutation can even outperform the original LLaMA2-70B on zero-shot tasks, together with practical speed-up on specific hardware. Our code is available at: https://github.com/biomedical-cybernetics/Relative-importance-and-activation-pruning

Tactics, Techniques, and Procedures (TTPs) constitute the most valuable aspect of Cyber Threat Intelligence (CTI). However, TTPs are often implicit in unstructured text, necessitating manual analysis by field experts. Automating the classification of TTPs from unstructured text is a crucial task in contemporary research. MITRE ATT&CK serves as the de facto standard for studying TTPs. Existing research constructs classification datasets based on its procedural examples for tactics and techniques. However, due to a significant proportion of small sample categories, a long-tail phenomenon exists, leading to a highly imbalanced sample distribution. Consequently, more research concentrates on categories with relatively abundant samples. This paper proposes a method that combines ChatGPT data augmentation with Instruction Supervised Fine-Tuning of open large language models. This approach offers a solution for TTPs classification in few-shot learning scenarios, achieving coverage of 625 technical categories. The Precision, Recall, and F1 scores reach 86.2%, 89.9%, and 87.3%, respectively.

This study presents a novel approach to enhance Large Language Models (LLMs) like Alpaca by dynamically integrating real-time information. This method addresses the issue of content hallucination and data relevancy by automatically collecting and integrating current data from credible sources into model prompts. Experiments show a significant improvement in accuracy and a decrease in content hallucination, with a manageable increase in response time. The research underscores the potential of real-time data integration in making LLMs more accurate and contextually relevant, setting a foundation for future advancements in dynamic data processing in AI.

(1) Background: Artificial Intelligence (AI) models have shown potential in various educational contexts. However, their utility in explaining complex biological phenomena, such as Intrinsically Disordered Proteins (IDPs), requires further exploration. This study empirically evaluated the performance of various Large Language Models (LLMs) in the educational domain of IDPs. (2) Methods: Four LLMs, GPT-3.5, GPT-4, GPT-4 with Browsing, and Google Bard (PaLM 2), were assessed using a set of IDP-related questions. An expert evaluated their responses across five categories: accuracy, relevance, depth of understanding, clarity, and overall quality. Descriptive statistics, ANOVA, and Tukey's honesty significant difference tests were utilized for analysis. (3) Results: The GPT-4 model consistently outperformed the others across all evaluation categories. Although GPT-4 and GPT-3.5 were not statistically significantly different in performance (p>0.05), GPT-4 was preferred as the best response in 13 out of 15 instances. The AI models with browsing capabilities, GPT-4 with Browsing and Google Bard (PaLM 2) displayed lower performance metrics across the board with statistically significant differences (p<0.0001). (4) Conclusion: Our findings underscore the potential of AI models, particularly LLMs such as GPT-4, in enhancing scientific education, especially in complex domains such as IDPs. Continued innovation and collaboration among AI developers, educators, and researchers are essential to fully harness the potential of AI for enriching scientific education.

The increased complexity of modern systems is calling for an integrated and comprehensive approach to system design and development and in particular, a shift towards Model-Based Systems Engineering (MBSE) approaches for system design. The requirements that serve as the foundation for these intricate systems are still primarily expressed in Natural Language (NL), which can contain ambiguities and inconsistencies that hinder their direct translation into models. The colossal developments in the field of Natural Language Processing (NLP) in general and Large Language Models (LLMs) in particular can serve as an enabler for the conversion of NL requirements into semi-machine-readable requirements. This is expected to facilitate their standardization and use in a model-based environment. This paper discusses a two-fold strategy for converting NL requirements into semi-machine-readable requirements using language models. The first approach involves creating a requirements table by extracting information from free-form NL requirements. The second approach is an agile methodology that facilitates the identification of boilerplate templates for different types of requirements based on observed linguistic patterns. For this study, three different LLMs were utilized. Two of these models were fine-tuned versions of Bidirectional Encoder Representations from Transformers (BERT), specifically aeroBERT-NER and aeroBERT-Classifier, which were trained on annotated aerospace corpora. Another LLM, called flair/chunk-english, was utilized to identify sentence chunks present in NL requirements. All three language models were utilized together to achieve the standardization of requirements. To demonstrate the effectiveness of the methodologies, requirements from Parts 23 and 25 of Title 14 Code of Federal Regulations (CFRs) were employed, and a total of two, five, and three boilerplate templates were identified for design, functional, and performance requirements, respectively.

The accurate diagnosis and effective treatment of mental health disorders such as depression remain challenging owing to the complex underlying causes and varied symptomatology. Traditional information extraction methods struggle to adapt to evolving diagnostic criteria such as the Diagnostic and Statistical Manual of Mental Disorders fifth edition (DSM-5) and to contextualize rich patient data effectively. This study proposes a novel approach for enhancing information extraction from mental health data by integrating medical knowledge graphs and large language models (LLMs). Our method leverages the structured organization of knowledge graphs specifically designed for the rich domain of mental health combined with the powerful predictive capabilities and zero-shot learning abilities of LLMs. This research enhances the quality of knowledge graphs through entity linking and demonstrates superiority over traditional information extraction techniques, making a significant contribution to the field of mental health. It enables a more fine-grained analysis of the data and the development of new applications. Our approach redefines the manner in which mental health data are extracted and utilized. By integrating these insights with existing healthcare applications, the groundwork is laid for the development of real-time patient monitoring systems. The performance evaluation of this knowledge graph highlights its effectiveness and reliability, indicating significant advancements in automating medical data processing and depression management.

Virtual assistants (VAs) have gained widespread popularity across a wide range of applications, and the integration of Large Language Models (LLMs) such as ChatGPT has opened up new possibilities for developing even more sophisticated VAs. However, this integration poses new ethical issues and challenges that must be carefully considered, particularly as these systems are increasingly used in public services: transfer of personal data, decision-making transparency, potential biases, and privacy risks. This paper, an extension of the work presented at IberSPEECH 2022, analyzes the current regulatory framework for AI-based VAs in Europe and delves into ethical issues in depth, examining potential benefits and drawbacks of integrating LLMs with VAs. Based on the analysis, this paper argues that the development and use of VAs powered by LLMs should be guided by a set of ethical principles that prioritize transparency, fairness, and harm prevention. The paper presents specific guidelines for the ethical use and development of this technology, including recommendations for data privacy, bias mitigation, and user control. By implementing these guidelines, the potential benefits of VAs powered by LLMs can be fully realized while minimizing the risks of harm and ensuring that ethical considerations are at the forefront of the development process.

Transmission of values and religious concepts to children is one of the most important issues in the third millennium and it has drawn varied and different views among experts and scholars in the world. Research specialized in religious literature for children and adolescents create new capacities in the presentation of religious concepts to the group. Plans have been considered to transfer values and religious concepts in the curricula of primary school children in the group in Iran. It is one of the topics that the authors note to the introduction of the minutiae of religion in the first three elementary grades. In this study, the collection and analysis methods providing content related to the minutiae of religion in reading books the first till third sections of the years 2013-2015. In addition, the plan includes aspects of other branches of religion in these books on information collected from text books that collected and classified. The result is that "definitely good and forbidding the evil" and "prayer" have the highest frequency of applications in the selected books. Further branches made of branches of religion in these books, represents the values of religious, moral and social as well.

This paper examines the potential of large language models, specifically ChatGPT, BingChat, and Bard, in enhancing the work of teachers in various educational settings. These models, powered by cutting-edge artificial intelligence, offer a wide range of applications that can aid educators in curriculum development, personalized instruction, student engagement, and administrative tasks. By harnessing the capabilities of these language models, teachers can not only streamline their workload but also improve the overall quality of education. This paper explores the ways in which these models can empower educators and revolutionize teaching practices.

The study aimed to determine the effect of heat stress (HS) on reproductive parameters [calving to first service (CTFS) and first service conception rate (FSCR)] and general physiological responses [rectal temperature (RT) and respiratory rate (RR)] in tropical Holstein Friesian dairy cows raised in Ratchaburi province, Thailand. Cows were divided into a moderate HS (n = 22) and a mild HS (n = 22) group. Cycling cows were detected and injected with PGF2α at the beginning of the experimental period. Reproductive and physiological parameters were recorded. The average temperature humidity indices experienced by the cows were 80.67 ± 0.79 and 77.81 ± 1.09 for the moderate and mild HS groups, respectively. Cows showed significantly lower RT and RR in the mild (38.47 ± 0.21°C and 41.04 ± 4.55 bpm, respectively) than in the moderate HS group (38.87 ± 0.15°C and 51.17 ± 10.52 bpm). Under mild HS, cows showed a better response to injection of PGF2α than those under moderate HS. The percentage of cows that ovulated after being induced by PGF2α and showed estrus signs was higher in the mild than the moderate HS groups (54.55% versus 18.18%). Furthermore, the FSCR of cows under mild HS tended to be higher than in the moderate HS group (54.55 % and 42.11%, respectively), while the average CTFS interval was significantly shorter under mild than moderate HS (69.47 ± 18.18 and 84.60 ± 27.68, respectively). These results indicate that HS impairs reproductive performance in cross-bred Holstein cows, especially in moderate HS conditions.

Structured science summaries or research contributions using properties or dimensions beyond traditional keywords enhances science findability. Current methods, such as those used by the Open Research Knowledge Graph (ORKG), involve manually curating properties to describe research papers' contributions in a structured manner, but this is labor-intensive and inconsistent between the domain expert human curators. We propose using Large Language Models (LLMs) to automatically suggest these properties. However, it's essential to assess the readiness of LLMs like GPT-3.5, Llama 2, and Mistral for this task before application. Our study performs a comprehensive comparative analysis between ORKG's manually curated properties and those generated by the aforementioned state-of-the-art LLMs. We evaluate LLM performance through four unique perspectives: semantic alignment and deviation with ORKG properties, fine-grained properties mapping accuracy, SciNCL embeddings-based cosine similarity, and expert surveys comparing manual annotations with LLM outputs. These evaluations occur within a multidisciplinary science setting. Overall, LLMs show potential as recommendation systems for structuring science, but further finetuning is recommended to improve their alignment with scientific tasks and mimicry of human expertise.

The pursuit of Artificial Intelligence (AI) that emulates human cognitive processes is a cornerstone of ethical AI development, ensuring that emerging technologies can integrate seamlessly into societal frameworks requiring nuanced understanding and decision-making. Zero-Shot Instance Retrieval (ZSIR) stands at the forefront of this endeavour, potentially providing a robust platform for AI systems, particularly large visual language models, to demonstrate and refine cognition-aligned learning without the need for direct experience. In this paper, we critically evaluate current cognition alignment methodologies within traditional zero-shot learning paradigms, using visual attributes and word embedding generated by large AI models. We propose a unified similarity function that quantifies the cognitive alignment level, bridging the gap between AI processes and human-like understanding. Through extensive experimentation, our findings illustrate that this similarity function can effectively mirror the visual-semantic gap, steering the model towards enhanced performance in zero-shot instance retrieval. This work not only benchmarks the cognition alignment of AI, but also sets a new precedent for the development of visual language models attuned to the complexities of human cognition.}

Estimating Visual Quality of Street Space (VQoSS) is pivotal for urban design, environmental sustainability, civic engagement, etc. Recent advancements, notably in deep learning, have enabled large-scale analysis. However, traditional deep learning approaches are hampered by extensive data annotation requirements and limited adaptability across diverse VQoSS tasks. Multimodal Large Language Models (MLLMs) have recently demonstrated proficiency in various computer vision tasks, positioning them as promising tools for automated VQoSS assessment. In this paper, we pioneer the application of MLLMs to VQoSS change estimation, with our empirical findings affirming their effectiveness. In addition, we introduce Street Quality GPT (SQ-GPT), a model that distills knowledge from the current most powerful but inaccessible (not free) GPT-4, requiring no human efforts. SQ-GPT approaches GPT-4’s performance and is viable for large-scale VQoSS change estimation. In a case study of Nanjin, we showcase the practicality of SQ-GPT and knowledge distillation pipeline. Our work promises to be a valuable asset for future urban studies research.

This study aimed to investigate the appearance and frequencies of the booroola polymorphism of the bone morphogenetic protein receptor 1b (BMPR1B) gene (FecB) and the embrapa polymorphism of the growth differentiation factor 9 (GDF9) gene (FecGE) in sheep in Thailand. A total of 454 cross-bred sheep blood samples were collected from four provinces in Thailand during August 2022 to July 2023. The polymerase chain reaction-restriction fragment length polymorphism (PCR-RFLP) method was used to identify the FecB and FecGE genotype. The history of ewe birth types was collected from the owners to analyze the association between Fecundity (Fec) genotypes and the history of birth types. The genotypic frequencies of FecB for homozygous genotype (B/B), heterozygous genotype (+/B) and wild-type (+/+) were 0.22%, 1.54%, and 98.24%, respectively. Meanwhile, the genotypic frequencies of FecGE for homozygous genotype (E/E), heterozygous genotype (+/E), and wildtype (+/+) were 0.00%, 2.42%, and 97.58%, respectively. Furthermore, three ewes exhibited both FecB and FecGE genotypes. Fisher’s exact test revealed that the possessor of FecB genotype was associated with multiple births (p<0.01). Both FecB and FecGE mutations were identified in crossbred sheep in Thailand. Sheep containing FecB allele is a better candidate to be selected to improve the prolificacy of crossbred sheep in Thailand.

Generative large language models (LLMs), e.g., ChatGPT, have demonstrated remarkable proficiency across several NLP tasks such as machine translation, question answering, text summarization, and natural language understanding. Recent research has shown that utilizing ChatGPT for assessing the quality of machine translation (MT) achieves state-of-the-art performance at the system level but performs poorly at the segment level. To further improve the performance of LLMs on MT quality assessment, we conducted an investigation into several prompting methods. Our results indicate that by combining Chain-of-Thoughts and Error Analysis, a new prompting method called Error Analysis Prompting, LLMs like ChatGPT can \textit{generate human-like MT evaluations at both the system and segment level}. Additionally, we discovered some limitations of ChatGPT as an MT evaluator, such as unstable scoring and biases when provided with multiple translations in a single query. Our findings aim to provide a preliminary experience for appropriately evaluating translation quality on ChatGPT while offering a variety of tricks in designing prompts for in-context learning. We anticipate that this report will shed new light on advancing the field of translation evaluation with LLMs by enhancing both the accuracy and reliability of metrics. The project can be found at https://github.com/Coldmist-Lu/ErrorAnalysis_Prompt.

This Special Issue of Humanities comes at a time when the viability of the humanities are challenged on numerous fronts. On the one hand, the humanities face material threats as the politics of austerity continues throughout Europe and the United States, diminishing public support and making profit margin and “job creation” the primary measure of value or the basis of state university funding decisions. On the other, the humanities face conceptual, theoretical and ethical challenges, as the emergence of post-racial and post-humanist discourses signal what Foucault called “a change in the fundamental arrangements of knowledge.” The defining boundaries of constructs such as “race” and “human” have been radically called into question, challenging us to rethink the classificatory systems that found hierarchical relationships between, for example, the “fully human” and sub-human or non-human others. Despite dominant nations’ professed commitment to a universal human rights paradigm, racialized identities are still often the targets of disenfranchisement and dehumanization, while the exploitation and destruction of the natural world continues in the name of “progress” and profits.

The proliferation of deep learning in natural language processing (NLP) has led to the development and release of innovative technologies capable of understanding and generating human language with remarkable proficiency. Atinuke, a Transformer-based neural network, optimises performance across various language tasks by utilising a unique configuration. The architecture interweaves layers for processing sequential data with attention mechanisms to draw meaningful affinities between inputs and outputs. Due to the configuration of its topology and hyperparameter tuning, it can emulate human-like language by extracting features and learning complex mappings. Atinuke is modular, extensible, and integrates seamlessly with existing machine learning pipelines. Advanced matrix operations like softmax, embeddings, and multi-head attention enable nuanced handling of textual, acoustic, and visual signals. By unifying modern deep learning techniques with software design principles and mathematical theory, the system achieves state-of-the-art results on natural language tasks whilst remaining interpretable and robust.

ChatGPT, a Large Language Model (LLM) utilizing Natural Language Processing (NLP), has caused concerns about its impact on job sectors, including cybersecurity. In this study, we assessed ChatGPT’s impacts in non-managerial cybersecurity roles using the NICE Framework and Technological Displacement theory. We also explored its potential in passing top cybersecurity certification exams. Findings revealed ChatGPT’s promise in streamlining some jobs, especially those requiring memorization. Moreover, we highlighted ChatGPT’s challenges and limitations, such as ethical implications, LLM limitations, and Artificial Intelligence (AI) security. The study suggests that LLMs like ChatGPT could transform the cybersecurity landscape, causing job losses, skill obsolescence, labor market shifts, and mixed socioeconomic impacts. We recommend a shift in focus from memorization to critical thinking, and collaboration between LLM developers and cybersecurity professionals.

The predominance of English and Latin-based large language models (LLMs) has led to a notable deficit in native Arabic LLMs. This discrepancy is accentuated by the prevalent inclusion of English tokens in existing Arabic models, detracting from their efficacy in processing native Arabic's intricate morphology and syntax. Consequently, there is a theoretical and practical imperative for developing LLMs predominantly focused on Arabic linguistic elements. To address this gap, this paper proposes ArabianGPT, a series of transformer-based models within the ArabianLLM suite designed explicitly for Arabic. These models, including ArabianGPT-0.1B and ArabianGPT-0.3B, vary in size and complexity, aligning with the nuanced linguistic characteristics of Arabic. The AraNizer tokenizer, integral to these models, addresses the unique morphological aspects of Arabic script, ensuring more accurate text processing. Empirical results from fine-tuning the models on tasks like sentiment analysis and summarization demonstrate significant improvements. For sentiment analysis, the fine-tuned ArabianGPT-0.1B model achieved a remarkable accuracy of 95%, a substantial increase from the base model's 56%. Similarly, in summarization tasks, fine-tuned models showed enhanced F1 scores, indicating improved precision and recall in generating concise summaries. Comparative analysis of fine-tuned ArabianGPT models against their base versions across various benchmarks reveals nuanced differences in performance, with fine-tuning positively impacting specific tasks like question answering and summarization. These findings underscore the efficacy of fine-tuning in aligning ArabianGPT models more closely with specific NLP tasks, highlighting the potential of tailored transformer architectures in advancing Arabic NLP.

Current neural network models can demonstrate reasonable-looking behavior, considered by some developers and researchers human-like. For example, a large language model GPT-3 is susceptible to human-like cognitive biases. Yet there is no data of such models solving emotional intelligence (EI) tasks. They are connected to the abilities that has been previously considered as specifically human EI is an important aspect of human communication. The ability to understand and respond to emotional cues is essential for effective communication. Therefore, it is crucial to determine the ways AI models such as ChatGPT demonstrate EI. The present research aims to measure the EI of GPT-4, a large language model trained by OpenAI. Russian version of the Mayer–Salovey–Caruzo Emotional Intelligence Test sections B, C, D, F, G and H were used in this research. High points were obtained in Understanding emotions scale and Strategic EI. Mean points are obtained in Managing emotions scale. Low and less reliable values are obtained in Using emotions to facilitate thought scale. Thus, GPT-4 seems already capable of identifying emotions in text and describing techniques for managing them. However, complex cases and irregular situations requiring emotions qualitative analysis would be a hard task for GPT-4.

The dominance of social media has added to the channels of bullying to perpetrators. Unfortunately, cyberbullying (CB) is the most prevalent phenomenon in today’s cyber world and is a severe threat to the mental and physical health of citizens. This opens the need to develop a robust system to prevent bullying content from online forums, blogs, and social media platforms to manage the impact in our society. Several machine learning (ML) algorithms have been proposed for this purpose. However, their performances are not consistent due to high class imbalance issue and generalisation. In recent years, large language models (LLM) like BERT and RoBERTa have achieved state of the art (SOTA) results in several natural language processing (NLP) tasks. Unfortunately, the LLMs have not been applied extensively. In our paper, we explored the use of these models for cyberbullying (CB) detection. We have prepared a new dataset (D2) from existing studies (Formspring and Twitter). Our experimental results for dataset D1 and D2 showed RoBERTa outperformed other models.

Despite the growing capabilities of large language models, concerns exist about the biases they develop. In this paper, we propose a novel, automated mechanism for debiasing through specified dataset augmentation in the lens of bias producers that can be useful in a variety of industries, especially ones that are “restricted” and have limited data. We consider that bias can occur due to intrinsic model architecture and dataset quality. The two aspects are evaluated using two different metrics we created. We show that our dataset augmentation algorithm reduces bias as measured by our metrics.

Large language models (LLMs) excel in providing natural language responses that sound authoritative, reflect knowledge of the context area, and can present from a range of varied perspectives. Agent Based Models and Simulation consist of simulated agents that interact within a simulated environment to explore societal, social, and ethical, among other, problems. Agents generate large volumes of data over time and discerning useful and relevant content is an onerous task. LLMs can help in communicating agents’ perspectives on key events by providing natural language narratives. However, these narratives need to be factual, transparent, and reproducible. To this end, we present a structured narrative prompt for sending queries to LLMs. Chi-square tests and Fisher’s Exact tests are applied to assess statistically significant difference in sentiment scores of the narrative messages between simulation generated narratives, ChatGPT-generated narratives, and real tweets. The narrative prompt structure effectively yields narratives with the desired components from ChatGPT. This structure is expected to be extensible across LLMs. In 14 out of 44 categories, ChatGPT generated narratives which has sentiment scores that were not discernibly different, in terms of statistical significance (alpha level of 0.05), from the sentiment expressed in real tweets. Three outcomes are provided: (1) a list of benefits and challenges for LLMs in narrative generation; (2) a structured prompt for requesting narratives of a LLM based on simulated agents’ information; and (3) an assessment of statistical significance in the sentiment prevalence of the generated narratives compared to real tweets. This indicates significant promise in the utilization of LLMs for helping to connect simulated agent’s experiences with real people.

Pre-trained Language Models (PTLM) have remarkable and successful performance in solving lots of NLP tasks nowadays. And previous researchers have created many SOTA models and these models are included in many long surveys(Qiu et al., 2020). So, we would like to conduct a simple and short survey on this topic to help researchers understand the sketch of PTLM more quickly and comprehensively. In this short survey, we would provide a simple but comprehensive review of techniques, benchmarks, and methodologies in PTLM. And we would also introduce the applications evaluation of PTLM in this simple survey.

An artificial intelligence (AI)-based conversational large language model (LLM) was launched in November 2022 namely, “ChatGPT”. Despite the wide array of potential applications of LLMs in healthcare education, research and practice, several valid concerns were raised. The current systematic review aimed to investigate the possible utility of ChatGPT and to highlight its limitations in healthcare education, research and practice. Using the PRIMSA guidelines, a systematic search was conducted to retrieve English records in PubMed/MEDLINE and Google Scholar under the term “ChatGPT”. Eligibility criteria included the published research or preprints of any type that discussed ChatGPT in the context of healthcare education, research and practice. A total of 280 records were identified, and following full screening, a total of 60 records were eligible for inclusion. Benefits/applications of ChatGPT were cited in 51/60 (85.0%) records with the most common being the utility in scientific writing followed by benefits in healthcare research (efficient analysis of massive datasets, code generation and rapid concise literature reviews besides utility in drug discovery and development). Benefits in healthcare practice included cost saving, documentation, personalized medicine and improved health literacy. Concerns/possible risks of ChatGPT use were expressed in 58/60 (96.7%) records with the most common being the ethical issues including the risk of bias, plagiarism, copyright issues, transparency issues, legal issues, lack of originality, incorrect responses, limited knowledge, and inaccurate citations. Despite the promising applications of ChatGPT which can result in paradigm shifts in healthcare education, research and practice, the embrace of this application should be done with extreme caution. Specific applications of ChatGPT in health education include the promising utility in personalized learning tools and shift towards more focus on critical thinking and problem-based learning. In healthcare practice, ChatGPT can be valuable for streamlining the workflow and refining personalized medicine. Saving time for the focus on experimental design and enhancing research equity and versatility are the benefits in scientific research. Regarding authorship in scientific articles, as it currently stands, ChatGPT does not qualify to be listed as an author unless the ICJME/COPE guidelines are revised and amended. An initiative involving all stakeholders involved in healthcare education, research and practice is urgently needed to set a code of ethics and conduct on the responsible practices involving ChatGPT among other LLMs.

In this study, the on-going research into the improvement of micro-gas turbine propulsion system performance and the suitability for application as propulsion systems for small tactical UAVs (<600 kg) is investigated. The study is focused around the concept of converting existing micro turbojet engines to turbofan with the use of a continuously variable gearbox, thus maintaining a single spool configuration and relative design simplicity. This is an effort to reduce the initial engine development cost, whilst improving propulsive performance. The BMT 120 KS micro turbojet engine is selected for performance evaluation of the conversion process using gas turbine performance software, GasTurb13. The preliminary design of a matched low-pressure compressor (LPC) for the proposed engine is then performed using meanline calculation methods. According to the analysis carried out, an improvement in the converted micro gas turbine engine performance in terms of thrust and specific fuel consumption is achieved. Furthermore, with the introduction of a CVT gearbox, fan speed operation may be adjusted independently of the core, allowing increased thrust generation or better fuel consumption. Therefore, enabling a wider gamut of operating conditions and enhances the performance and scope of tactical UAV.

Perceived peer support is a critical factor in the academic adjustment of higher vocational college students. While previous studies have explored this relationship, few studies have delved into the underlying mechanisms. This study surveyed 9782 students from 35 higher vocational colleges in 13 provinces and cities in China to explore the relationship and mechanisms between perceived peer support and academic adjustment. Drawing on Conservation of Resources theory and Social Support Resource theory, the findings revealed that perceived peer support not only directly predicted the academic adjustment of higher vocational college students, but also indirectly through the independent mediating effect of academic hope and professional identity, as well as the chain-mediating effect of academic hope to professional identity. Additionally, students from vocational high schools showed a more significant increase in academic hope due to perceived peer support compared to those from general high schools, highlighting the moderating effect of educational background. The study provided a new theoretical perspective for understanding the complex mechanisms of academic adjustment in students and offers valuable guidance for educational practice, emphasizing the importance of fostering perceived peer support, academic hope, and professional identity in higher vocational education.

The growing dependence on large language models (LLM)s highlights the urgent need to deepen trust in these technologies. Regular, rigorous validation of their expertise, especially in nuanced and intricate scenarios, is essential to ensure their readiness for clinical applications. Our study pioneers the exploration of LLM utility in the field of cardiology. We stand at the cusp of a transformative era where mature AI and LLMs, notably ChatGPT, GPT-4, and Google Bard, are poised to influence healthcare significantly. Recently, we put three available LLMs, OpenAI's ChatGPT-3.5, GPT-4.0, and Google's Bard, to the test against a significant Polish medical special-ization licensing exam (PES). The exams cover the scope of completed specialist training, focusing on diagnostic and therapeutic procedures, excluding invasive medical procedures and interven-tions. In our analysis, GPT-4 consistently outperformed the others, ranking first, with and Google Bard and ChatGPT- 3.5 following, respectively. The performance metrics underscore GPT-4's no-table potential in medical applications. Given a score improvement of over 23.5 % between two AI models released just four months apart, clinicians must stay informed and up-to-date about these rapidly evolving tools and their potential applications to clinical practice. Our results provide a snapshot of the current capabilities of these models, highlighting the nuanced performance dif-ferences when confronted with identical questions

In the rapidly advancing field of Artificial Intelligence (AI), this study presents a critical evaluation of the resilience and cybersecurity efficacy of leading AI models, including ChatGPT-4, Bard, Claude, and Microsoft Copilot. Central to this research is the use of innovative adversarial prompts designed to rigorously test the content moderation capabilities of these AI systems. The study introduces new types of adversarial tests and the Response Quality Score (RQS), a metric specifically developed to assess the nuances of AI responses. Additionally, the research spotlights FreedomGPT, an AI tool engineered to optimize the alignment between user intent and AI interpretation. The empirical results from this investigation are pivotal for assessing the current robustness and security of AI models. They highlight the necessity for ongoing development and meticulous testing to bolster AI defenses against an array of adversarial challenges. Importantly, the study also delves into the ethical and societal implications associated with employing advanced 'jailbreak' techniques in AI testing. The findings are significant for understanding AI vulnerabilities and formulating strategies to enhance the reliability and ethical soundness of AI technologies, paving the way for safer and more secure AI applications.

With the increasing use of cloud-based services for training and deploying machine learning models, data privacy has become a major concern. This is particularly important for natural language processing (NLP) models, which often process sensitive information such as personal communications and confidential documents. In this study, we propose a method for training NLP models on encrypted text data to mitigate data privacy concerns while maintaining similar performance to models trained on non-encrypted data. We demonstrate our method using two different architectures, namely Doc2Vec+XGBoost and Doc2Vec+LSTM, and evaluate the models on the 20 Newsgroups dataset. Our results indicate that both encrypted and non-encrypted models achieve comparable performance, suggesting that our encryption method is effective in preserving data privacy without sacrificing model accuracy. In order to replicate our experiments, we have provided a Colab notebook at the following address: https://t.ly/lR-TP

The Dph1•Dph2 heterodimer from yeast is a radical SAM (RS) enzyme that generates the 3-amino-3-carboxy-propyl (ACP) precursor for diphthamide, a clinically relevant modification on eukaryotic elongation factor 2 (eEF2). ACP formation requires SAM cleavage and atypical Cys-bound Fe-S clusters in each Dph1 and Dph2 subunit. Intriguingly, the first Cys residue in each motif locates next to another, ill-defined cysteine that we show in-here is conserved across eukaryotes. As judged from structural modeling, the orientation of these tandem cysteine motifs (TCM) suggests a candidate Fe-S cluster ligand role. Hence, we generated by site-directed DPH1 and DPH2 mutagenesis, Dph1•Dph2 variants with cysteines from each TCM replaced individually or in combination by serines. Assays diagnostic for diphthamide formation in vivo reveal that while single substitutions in the TCM of Dph2 cause mild defects, double mutations almost entirely inactivate the RS enzyme. Based on enhanced Dph1 and Dph2 subunit instability in response to cycloheximide chases, the variants with Cys substitutions in their cofactor motifs are particularly prone to protein degradation. In sum, we identify a fourth functionally cooperative Cys residue within the Fe-S motif of Dph2 and show that the Cys-based cofactor binding motifs in Dph1 and Dph2 are critical for the structural integrity of the dimeric RS enzyme in vivo.

Speech recognition, or automatic speech recognition (ASR), is a technology designed to convert spoken language into text using software. However, conventional ASR methods involve several distinct components, including language, acoustic, and pronunciation models with dictionaries. This modular approach can be time-consuming and may influence performance. In this study, we propose a method that streamlines the speech recognition process by incorporating a unified recurrent neural network (RNN) architecture. Our architecture integrates a convolutional neural network (CNN) with an RNN and employs a connectionist temporal classification (CTC) loss function. Key experiments were carried out using a dataset comprising 576,656 valid sentences, using erosion techniques. Evaluation of the model performance, measured by the word error rate (WER) metric, demonstrated remarkable results, achieving a WER of 2%. This approach has significant implications for the realm of speech recognition, as it alleviates the need for labor-intensive dictionary creation, enhancing the efficiency and accuracy of ASR systems, and making them more applicable to real-world scenarios. For future enhancements, we recommend the inclusion of dialectal and spontaneous data in the dataset to broaden the model's adaptability. Additionally, fine-tuning the model for specific tasks can optimize its performance for targeted objectives or domains, further enhancing its effectiveness in those areas.

Accurate crop diseases classification is crucial for ensuring food security and enhancing agricultural productivity. However, existing crop disease classification algorithms primarily focus on a single image modality and typically require a large number of samples. Our research counters these issues by using pre-trained Vision-Language Models (VLMs), which enhances multimodal synergy for better crop disease classification than traditional unimodal approaches. Firstly, we apply the multimodal model Qwen-VL to generate meticulous textual descriptions for representative disease images selected through clustering from the training set, which will serve as prompt text for generating classifier weights. Compared to using solely the language model for prompt text generation, this approach better captures and conveys fine-grained and image-specific information, thereby enhancing prompt quality. Secondly, we integrate the cross-attention and the SE (Squeeze-and-Excitation) attention into the training-free mode VLCD (Vision-Language model for Crop Diseases classification) and the training-required mode VLCD-T (VLCD-Training) respectively for prompt text processing, enhancing classifier weights by emphasizing key text features. Experimental outcomes conclusively prove our method’s heightened classification effectiveness in few-shot crop disease scenarios, tackling data limitations and intricate disease recognition issues. It offers a pragmatic tool for agricultural pathology and reinforces the smart farming surveillance infrastructure.

Kinetic modeling is an essential tool in systems biology research, enabling the quantitative analysis of biological systems and predicting their behavior. However, the development of kinetic models is a complex and time-consuming process. In this article, we propose a novel approach called KinModGPT, which generates kinetic models directly from natural language text. KinModGPT employs GPT-3 as a natural language interpreter and Tellurium as an SBML generator. We demonstrate the effectiveness of KinModGPT in creating SBML models from complex natural language descriptions of biochemical reactions. KinModGPT successfully generates valid SBML models from a range of natural language model descriptions of metabolic pathways, protein-protein interaction networks, and heat shock response. This article demonstrates the potential of KinModGPT in kinetic modeling automation.

The article obtains large deviation asymptotic for sub-critical communication networks modelled as signal-interference-noise-ratio(SINR) random networks. To achieve this, we define the empirical power measure and the empirical connectivity measure, as well as prove joint large deviation principles(LDPs) for the two empirical measures on two different scales. Using the joint LDPs, we prove an Asymptotic equipartition property(AEP) for wireless telecommunication Networks modelled as the subcritical SINR random networks. Further, we prove a Local Large deviation principle(LLDP) for the sub-critical SINR random network. From the LLDPs, we prove the large deviation principle, and a classical McMillan Theorem for the stochastic SINR model processes. Note that, the LDPs for the empirical measures of this stochastic SINR random network model were derived on spaces of measures equipped with the $\tau-$ topology, and the LLDPs were deduced in the space of SINR model process without any topological limitations. We motivate the study by describing a possible anomaly detection test for SINR random networks.

Humans have a unique cognitive ability known as relational abstraction, which allows us to identify logical rules and patterns beyond basic perceptual characteristics. This ability represents a key difference between how humans and other animals learn and interact with the world. With current large language models rivaling human intelligence in many regards, we investigated whether relational abstraction was an emergent chat completion capacity in various models. We find that despite their impressive language processing skills, all tested language models failed the relational match-to-sample (RMTS) test, a benchmark for assessing relational abstraction. These results challenge the assumption that advanced language skills inherently confer the capacity for complex relational reasoning. The paper highlights the need for a broader evaluation of AI cognitive abilities, emphasizing that language proficiency alone may not be indicative of certain higher-order cognitive processes thought to be supported by language.

To conduct high-precision and high-resolution numerical simulation of complex flow structures in turbomachinery, a high-order finite volume weighted essentially non-oscillatory (WENO) scheme for the large eddy simulation (LES) is improved and embedded into the three-dimensional viscous unsteady CFD solver NUAA-Turbo. Firstly, the spectral characteristics and unsteady convergence of the improved WENO scheme are studied. Compared with the classical WENO scheme, the improved WENO scheme has better dissipation and dispersion characteristics and faster convergence speed. Then, the coefficient CW of the Wall-Adapting Local Eddy-viscosity (WALE) model is calibrated by decaying homogeneous isotropic turbulence (DHIT) test case. Finally, the scheme is applied to conduct high-precision LES calculations of turbulent boundary layer flow, supersonic compression corner flow, and low-pressure turbine cascade separation flow. The numerical simulation results show that this WENO scheme has excellent shock wave capture ability and turbulence resolution and can capture more flow field details with less mesh size, greatly reducing the computational cost and laying a foundation for large-scale engineering application of LES.

In recent times, BERT based transformer models have become an inseparable part of the 'tech stack' of text processing models. Similar progress is being observed in the speech domain with a multitude of models observing state-of-the-art results by using audio transformer models to encode speech. This begs the question of what are these audio transformer models learning. Moreover, although the standard methodology is to choose the last layer embedding for any downstream task, but is it the optimal choice? We try to answer these questions for the two recent audio transformer models, Mockingjay and wave2vec2.0. We compare them on a comprehensive set of language delivery and structure features including audio, fluency and pronunciation features. Additionally, we probe the audio models' understanding of textual surface, syntax, and semantic features and compare them to BERT. We do this over exhaustive settings for native, non-native, synthetic, read and spontaneous speech datasets

Large language model (LLM) is a representation of a major advancement in AI, and has been used in multiple natural language processing tasks. Nevertheless, in different business scenarios, LLM requires fine-tuning by engineers to achieve satisfactory performance, and the cost of achieving target performance and fine-tuning may not match. Based on the Baidu STI dataset, we study the upper bound of the performance that classical information retrieval methods can achieve under a specific business, and compare it with the cost and performance of the participating team based on LLM. This paper gives an insight into the potential of classical computational linguistics algorithms, and which can help decision-makers make reasonable choices for LLM and low-cost methods in business R&D.

The development of plant-based meat analogues has become a significant challenge for the food industry in recent years due to the increasing demand for sustainable and healthier proteins in the context of a global protein transition. Plant-based meat analogues imitate the visual, textural, and chemical properties of traditional meat products and are required to closely resemble meat to appeal to consumers. In addition, consumers demand natural, clean-label, and nutritional and healthy products. To address these challenges, the food industry must develop highly healthy, nutritious, and E-number-free meat analogue products. Understanding the functionality of each ingredient and its role in the food matrix is crucial to being a key player in the innovation of the meat analogues market. This review provides updated information on the primary ingredients utilized for the development of plant-based burger meat alternatives and their functionality. The key components of meat analogue burgers are outlined, including plant proteins, binding agents, fats and oils, flavorings, colorings, preservatives, fortificants, and clean-label considerations.

This paper presents our approaches for the SMM4H’24 Shared Task 5 on the binary classification of English tweets reporting children’s medical disorders. Our first approach involves fine-tuning a single RoBERTa-large model, while the second approach entails ensembling the results of three fine-tuned BERTweet-large models. We demonstrate that although both approaches exhibit identical performance on validation data, the BERTweet-large ensemble excels on test data. Our best-performing system achieves an F1-score of 0.938 on test data, outperforming the benchmark classifier by 1.18%.

Buildings have started to play a critical role in the stability and resilience of modern smart grids, leading to a refocusing of large scale energy management strategies from the supply side to the consumer side. When the buildings integrate local renewable energy generation in the form of renewable energy resources they become prosumers and this reflects into additional complexity into the operation of the interconnected complex energy systems. A class of methods of modelling the energy consumption patterns of the building have recently emerged as black-box input-output approaches with the ability to capture underlying consumption trends. These make use and require large quantities of quality data produces by non-deterministic processes underlying the energy consumption. We present an application of a class of neural networks, namely deep learning techniques for time series sequence modelling with the goal of accurate and reliable building energy load forecasting. The Recurrent Neural Network implementation uses Long Short-Term Memory layers in increasing density of nodes to quantify prediction accuracy. The case study is illustrated on four university buildings from temperate climates over one year of operation using a reference benchmarking dataset that allows replicable results. The obtained results are discussed in terms of accuracy metrics and computational and network architecture aspects and are considered suitable for further used in future in situ energy management at the building and neighbourhood levels.

A variable annuity is a popular life insurance product that comes with financial guarantees. Using Monte Carlo simulation to value a large variable annuity portfolio is extremely time-consuming. Metamodeling approaches have been proposed in the literature to speed up the valuation process. In metamodeling, a metamodel is first fitted to a small number of variable annuity contracts and then used to predict the values of all other contracts. However, metamodels that have been investigated in the literature are sophisticated predictive models. In this paper, we investigate the use of linear regression models with interaction effects for the valuation of large variable annuity portfolios. Our numerical results show that linear regression models with interactions are able to produce accurate predictions and can be useful additions to the toolbox of metamodels that insurance companies can use to speed up the valuation of large VA portfolios.

In this paper, we studied the problem of early detection of natural phenomena associated with the formation of severe floods and the possibility of constant monitoring of their occurrence. The test object for the study was severe floods on the Crimean Peninsula, which occurred due to heavy rainfall in the summer of 2021. Based on the selected satellite and other data related to this period, an analysis carried out and key atmospheric objects identified, according to the proposed algorithm for their identification and grouping. Based on the results of the work, a positive conclusion made on the issue of their use to identify the likelihood of natural disasters that could lead to floods. In addition, the authors proposed to develop a portal for collecting and processing a large amount of satellite data related to flood prevention and monitoring the development of such processes, and stressed the need to create it.

The attitude dynamics and orbit dynamics of large rigid space structures are coupled with each other under gravity gradient, which may affect the stability of the large rigid space structures. In this paper, the gravity gradient stability of a large rigid space structure is studied under both small and large disturbances. Based on the rigid body dynamics and orbit dynamics, an accurate dynamic model without any linearization of the large rigid space structure is established via the natural coordinate formulation (NCF), which is able to describe the large overall motions of the structures. By using the generalized-α algorithm, the gravity gradient stability of the large rigid space structure is simulated and analyzed via various examples, including the influence of large disturbance angles, the positions at the stabilization and unstabilization regions. Finally, the relationship between spinning stability and gravity gradient stability is also investigated via a large spinning space structure.

In this paper, we first discuss the research status and application progress of the finite element method and the smoothed particle method. By analyzing the advantages of the smoothed particle method and the finite element method, a new coupling algorithm, namely FEM-SPH algorithm, is proposed. By the method of comparison, it shows that finite element method and SPH method in the simulation of large deformation problems each have advantages and disadvantages, the finite element method smoothed particle coupling algorithm is effective to achieve the performance of high computational efficiency and can naturally simulate large deformation problems across. In the process of calculation, the large deformation unit can be freely into an algorithm to facilitate the calculation accuracy and efficiency of three methods of numerical simulation. Through the study found, FEM-SPH algorithm not only overcome the defect of smooth particle tensile instability, but also overcomes the problem of low efficiency of finite element computation. To further test the FEM-SPH algorithm has advantages in the practical engineering, we have carried out the actual test to the example of the super high speed collision, concluded that, since the target of most of the computational domain is always finite element, smoothed particle focused only in contact with the projectile and target of local area, particle number is not much, the whole calculation process just ten minutes, computational efficiency has been greatly improved, at the same time in the simulation of large deformation, the advantage is very obvious .This provides a criterion for the actual project, depending on the specific material deformation mode and choose a more appropriate conversion algorithm.

Software systems are often maintained by a group of experienced software developers, in order to ensure that faults which may bring the system down are less likely. Large turnover in organizations such as CERN makes it important to think of ways of onboarding newcomers on a technical project rapidly. This paper focuses on optimizing the way that people get up-to-speed on the business logic and technologies used on the project, using a knowledge-imbued large language model that is enhanced using domain-specific knowledge from the group or team’s internal documentation.

This paper explores the role of open-source large language models in IoT cybersecurity world. The threats of malicious activity on the Internet and the loss of private information are very real and lead to serious consequences. The purpose of this paper is to investigate how open source-large language models can help to defend against the growing threat of cyber-crimes. We conducted our experiments in two directions. The first one is a security assistant that helps with cybersecurity best practices advices. The second one is a how large language model can simulate a vulnerable IoT system. For both types of experiments, the interactive mode of operation of the language model is used. In the context of the cybersecurity research, a major advantage of the locally installed open-sourced large language models is that they do not share sensitive data with a remote system in a cloud. The paper concludes by discussing the potential impact of open-source large language models on cybersecurity research and recommends future research directions.

Fluctuations of protein three-dimensional structures and large-scale conformational transitions are crucial for the biological function of proteins and their complexes. Experimental studies of such phenomena remain very challenging and therefore molecular modeling can be a good alternative or a valuable supporting tool for the investigation of large molecular systems and long-time events. In this mini-review, we present two alternative approaches to the coarse-grained (CG) modeling of dynamic properties of protein systems. We discuss two CG representations of polypeptide chains used for Monte Carlo dynamics simulations of protein local dynamics and conformational transitions and, on other hand, highly simplified structure-based Elastic Network Models of protein flexibility. In contrast to classical Molecular Dynamics the modeling strategies discussed here allow quite accurate modeling of much larger systems and longer time dynamic phenomena. We briefly describe the main features of these models and outline some of their applications, including modeling of near-native structure fluctuations, sampling of large regions of the protein conformational space, or possible support for the structure prediction of large proteins and their complexes.

The increasing availability of longitudinal data (repeated numerical observations of same units at different times) requires the development of flexible techniques to automatically detect common errors in such data. Besides obvious and easily identifiable cases, such as missing or out-of-range data, large longitudinal dataset often present problems not easily traceable by the techniques used for generic datasets. In particular, elusive and baffling problems are i) inversion of one or more values from one unit to another; ii) anomalous jumps in the series of values, iii) errors in the timing of the values due to a recalculation operated by the data providers to compensate previous errors. This work proposes a statistical-mathematical approach based on a system of indicators that is able to capture the complexity of the described problems by working at the formal level, regardless of the specific meaning of the data. The proposed approach identifies suspect erroneous data and is applicable in a variety of contexts. We implement this approach in a relevant database of European Higher Education institutions (ETER) by analyzing Total academic staff, that is one of the most important variables, used in empirical analysis as proxy of size and also considered by policy makers at European level.

Sixteen crossbred rabbits (New Zealand white x Thai native breed) were randomly divided into two groups of eight to determine the effects of daily oral administration of crude extracts from the butterfly pea (Clitoria ternatea L.) from weaning (at 35 days) to slaughter (at 90 days). Effects on phagocytic activity of blood polymorphoneuclear leukocytes, serum biochemistry, meat quality, muscular lipid peroxidation, apparent digestibility, and gut histology were studied. The results revealed that the phagocytic function of circulating leukocytes (75 and 90 days) and alveolar macrophages (90 days) did not differ between the two groups. At slaughter, treated rabbits had lower blood urea nitrogen concentrations and higher liver weight than control rabbits (p &lt; 0.05). After chilling at 4°C for 24 hours, lower meat pH and alteration of meat color (a brighter, less yellow, Hue angle and color saturation) were observed in the treated group (p &lt; 0.05). Furthermore, lipid peroxidation (measured at 3, 5 and 7 storage days) in the meat of treated rabbits was lower than in controls (p &lt; 0.05). Apparent digestibility (analyzed at 46 days for four days) revealed improved organic matter and ether extracts in the treated group (p &lt; 0.05), whereas gut histology was unaffected. In conclusion, butterfly pea extract supplementation did not affect phagocytic function but led to a modification in meat color, delayed lipid peroxidation, and improved digestibility.

The abilities of quantitative description of noise are restricted due to its origin and only the statistical and spectral analysis methods can be applied while an exact time evolution cannot be defined or predicted. It emphasizes the challenges faced in many applications including communication systems where noise can play, on one hand, a vital role impacting signal-to-noise ratio but possessing, on the other hand, unique properties such as infinite entropy (infinite information capacity), exponentially decaying correlation function and so on. Despite the deterministic nature of chaotic systems, the predictability of chaotic signals is limited for a short time window putting them close to random noise. In this article, we propose and experimentally verify an approach to achieve Gaussian-distributed chaotic signals by processing the outputs of chaotic systems. The mathematical criteria, on which the main idea of the study is based on, is the Central Limit Theorem which states that the sum of a large number of independent random variables with similar variances approaches a Gaussian distribution. The study involves more than 40 mostly three-dimensional continuous-time chaotic systems (Chua’s, Lorenz’s, Sprott’s, memristor-based, etc.) whose output signals are analyzed according to criteria that encompass the probability density functions of a chaotic signal itself and its envelope and phase, statistical and entropy-based metrics such as skewness, kurtosis, and entropy power. We found that two chaotic signals of Chua’s and Lorenz’s systems exhibited superior performance across the chosen metrics. Furthermore, our focus extended to determining the minimum number of independent chaotic signals necessary to yield a Gaussian-distributed combined signal. The analytic and experimental results indicate that the sum of at least three non-Gaussian chaotic signals closely approximates Gaussian distribution. It allows generation of reproducible Gaussian-distributed deterministic chaos by modeling simple chaotic systems.

The conformity assessment of products or a measured value with the given standards is carried out based on the global risk of producers and consumers calculation. A product may conform to specifications but be falsely rejected as non-conforming. This is about the producer's risk. If a product doesn't meet the requirements but is falsely accepted as conforming, that poses a risk to the consumer. The conventional approach to risk assessment, which yields only a single numerical value for the global risk of producers and consumers, is naturally extended, and utilized for assessing risk in measurement models with linear regression. The outcomes of the two-dimensional extension, along a moderate scale, are the parabolas with an opening upwards. Risk surfaces were obtained through three-dimensional extension over the area limited by the moderate scale and guard band axes. Four models with different ranges of tolerance intervals were used to test this innovative method of risk assessment in linear regression. The corresponding standard measurement uncertainties are determined by applying a simplified measurement model with the use of comprehensive data on the measurement performance and by determining measurement uncertainty derived from consideration of the functional relationship obtained by linear regression analysis. Models that utilize information from linear regression analysis to determine measurement uncertainty are biased towards risks at the edges of the moderate scale. Testing the model's performances with metrics related to the confusion matrix, such as the F1 score, further substantiated this assertion. The diagnostic odds ratio has been proven to be extremely effective in identifying the curve along the guard band axis, along which the global risks of producers and consumers are at their lowest.

Tao and Ming (name) or Tao and Yan (language or speech) is an inseparable pair of important concepts in traditional Chinese language philosophy. In LaoTze’s opinion, Tao could not be spoken out, and language or speech could not reach Tao’s essence. Yan and Tao are separated from each other, and they are paradoxical. All the confusion derives from Yan regardless of how delicate they are. Tao can be expressed in words, but it will never be expressed through common languages. In this article, Tao is regarded as a human being’s thoughts or intentions and is even considered to be the origin of the real world. Language can express people’s thought, although it has some limitations. There exist some contradictions between the real word and the world expressed in words. To enable people to better understand the existence of the real world from multiple perspectives at the language or linguistic level without being constrained by words, this article studies LaoTze’s linguistic philosophy reflected in his opinion on the relationship between Tao and Yan and makes a comparative analysis of modern Western language philosophers’ stand on language (or speech) and existence.

With the development of organizational biology and forced from the EU Cosmetic Regulation (EU/1223/2009) with the complete ban of animal testing for cosmetic purposes, 3D skin models have been widely developed due to their similar physiological structure and metabolic function to native human tissue. 3D skin models for in vitro cosmetic evaluation are still promising alternative methods for evaluating phototoxicity, corrosivity and irritation. These models have been used for early screening and later validation of toxicity and efficacy evaluation by many well-known cosmetic companies. 3D skin models have become an important tool in cosmetic evaluation research. This article reviews the development of 3D skin models and their application in cosmetic evaluation. An outlook on the current application and future technological development directions in the cosmetic field is also presented.

The assortment of low-cost 3D printers for “in-practice” use, e.g., for clear aligner therapies, is ever increasing. To address concerns about the accuracy of orthodontic models produced on such printers when cost efficient modes of 3D printing are employed, this study examined the effect of print model body type and print angulation on accuracy. Six printing-configuration groups were included: 2 model types (solid or hollow shell) combined with 3 print angles (0°, 70°, or 90°) with 10 models/group; all models were printed with 100-µm layer thickness using a digital light processing-based 3-dimensional printer. Eleven selected structures and distances were measured on the printed models with a digital microscope and compared to the same measures on a digitized master model. The clinically-acceptability range was set at ±0.25 mm difference from the master model for single tooth measurements (intra-tooth) and ±0.5 mm for cross-arch measurements (inter-tooth). For individual measurements across all models, 98% fell within clinical acceptability. For mean measurements within each model group, only canine height for the shell-0° model had a mean difference (0.26 mm ± 0.03) outside the clinically acceptable range for intra-tooth measurements. Standard deviations for all intra-tooth measurements were within 0.07 mm. While none of the mean inter-tooth measurements exceeded the acceptability range, the standard deviations were larger (0.04 to 0.30 mm). Accuracy of orthodontic models for clear aligner therapies was not impacted beyond the clinically acceptable range when altering model body type and print angulation to improve efficiency of 3D printing. These findings suggest greater flexibility of the practitioner to alter print settings to address time and cost efficiency in various clinical scenarios and still maintain clinically acceptable model accuracy.

Subgrid scale models for unresolved turbulent fluxes are investigated with a focus on combustion for space propulsion applications. An extension to the gradient model is proposed, introducing a dependency on the local burning regime. The dynamic behavior of the model's coefficients is investigated, and scaling laws are studied. The discussed models are validated using a DNS database of a high-pressure turbulent fuel-rich methane-oxygen diffusion flame. The operating point and turbulence characteristics are selected to resemble those of modern combustors for space propulsion applications to support the future usage of the devised model in this context.

Large lithium-ion batteries (LIBs) in electric vehicles and energy storage systems demonstrate different performance and lifetime compared to small LIB cells, owing to the size effects generated by the electrical configuration and property imbalance. However, the calculation time for performing life predictions with three-dimensional (3D) cell models is undesirably long. In this paper, a lumped cell model with equivalent resistances (LER cell model) is proposed as a reduced order model of the 3D cell model, which enables accurate and fast life predictions of large LIBs. The developed LER cell model is validated via the comparisons with results of the 3D cell models by simulating a 20-Ah commercial pouch cell (NCM/graphite) and the experimental values. In addition, the LER cell models are applied to different cell types and sizes, such as a 20-Ah cylindrical cell and a 60-Ah pouch cell.

Biofuels and biochemicals play significant roles in the transition towards a fossil-free society. However, large-scale biorefineries are not yet cost-competitive with their fossil-fuel counterparts, and it is important to identify biorefinery concepts with high economic performance. For evaluating early-stage biorefinery concepts, one needs to consider not only the technical performance and process costs but also the economic performance of the full supply chain and the impacts on feedstock and product markets. This article presents and demonstrates a conceptual interdisciplinary framework that can constitute the basis for evaluations of the full supply-chain performance of biorefinery concepts. This framework considers the competition for biomass across sectors, assumes exogenous end-use product demand, and incorporates various geographical and technical constraints. The framework is demonstrated empirically through a case study of a sawmill-integrated biorefinery producing liquefied biomethane from forestry and forest industry residues. The case study results illustrate that acknowledging biomass market effects in the supply chain evaluation implies changes in both biomass prices and the allocation of biomass across sectors. The proposed framework should facilitate the identification of biorefinery concepts with a high economic performance which are robust to feedstock price changes caused by the increase in biomass demand.

As Artificial Intelligence (AI) technology, particularly Machine Learning algorithms, becomes increasingly ubiquitous, our abilities to understand and interpret AI and machine learning algorithms are becoming increasingly desirable. Visualization has been used as a common tool to view and understand complex machine learning processes. In this paper, we will focus on developing a general framework for the visualization of machine learning models as a scalar valued multi-dimensional function to help users understand how the models behave over different viewing spaces. We first give a formal definition of the visualization problem. Interpolation-based morphing and subspace sampling techniques are applied to generate various renderings through projections and cross-sections of the model space as 3D surfaces or heatmap images. This method will be applied to two real-world datasets and applications: the diagnosis of Alzheimer's Disease (AD) using a human brain networks dataset and a real-world benchmark dataset for predicting home credit default risks. The visualizations show that different machine learning algorithms can behave quite differently under different conditions.

Underwater visual detection technology plays a pivotal role in fields such as marine exploration. With the increasing demand for underwater monitoring, the quest for efficient and reliable methods for underwater target recognition has become particularly significant. To address this requirement, this study developed an innovative underwater object detection architecture based on YOLOv8, named YOLOv8-MU, aimed at significantly enhancing detection accuracy.By integrating the LarK module proposed in UniRepLKNet to optimize the backbone network, YOLOv8-MU aims to achieve a larger receptive field without increasing the model’s depth. Further, this research introduces C2fSTR, an innovative method that combines Swin Transformer with the C2f module. Additionally, we have incorporated the SPPFCSPC_EMA module, which combines Cross-Stage Partial Fast Spatial Pyramid Pooling (SPPFCSPC) with attention mechanisms, significantly improving the detection accuracy and robustness of various biological targets. Moreover, by introducing a fusion block based on DAMO-YOLO into the neck of the model, we further enhanced the model’s capability in multi-scale feature extraction. Finally, the adoption of the MPDIoU loss function, designed around vertex distance, effectively tackles the challenges of localization accuracy and boundary clarity in underwater organism detection. Experimental results on the URPC2019 dataset demonstrate that the YOLOv8-MU model achieved an [email protected] of 78.4%, marking improvements of 5.6%, 1.1%, and 4.0% over YOLOv5s, YOLOv7, and YOLOv8n respectively, indicating the leading performance (SOTA) of this method. On the other hand, further evaluation on the URPC2020 dataset confirmed the generalization capability of the YOLOv8-MU architecture, with its [email protected] reaching 80.4%, surpassing various models including YOLOv5x and YOLOv8n, showcasing the wide applicability of our proposed improved model architecture.

External hoof characteristics, balance, and conformation have been extensively studied in horses; however, mules remain understudied in these aspects. This study evaluated the size, shape, and symmetry of untrimmed and unshod forelimb hooves, compared the symmetry between forelimb hooves and stratified external forelimb hoof measurements based on the body condition score of mules raised in the foothill plains of northern Thailand. The forelimb hooves of 38 mules were photographed and 33 parameters, including angular and linear measurements, were analyzed. Despite the absence of shoeing and trimming, these mules exhibited optimal left-right forelimb hoof symmetry, with no significant (p < 0.05) differences in: outer wall length and inner wall length (OWL - IWL); sole length and sole width (SLS - SW); dorsal hoof wall length and heel length (DHWL - HL); and frog length and frog width (FL - FW). However, significant (p < 0.05) differences were observed within each body condition score group for forelimb hoof measurements for DHWL, IWL, heel separation (HS), heel bulb distance (HBD), SW, FW, and FL. These findings provide valuable insights into mule welfare and management, contributing to understanding of the interplay between overall health and hoof conformation in the study area.

In an era marked by rapid technological progress and global dynamics, the Neo-Language Acquisition and Learning Theory challenges conventional language acquisition paradigms through its conceptualization of 'Grit: The Unyielding Will to Connect,' emphasizing determination, motivation, and adaptability as the primary drivers of language learning, transcending age-related constraints and critical periods. This theory also underscores 'Self-Preservation: Language as the Canvas of Reality,' as language plays a pivotal role in preserving and conveying our individual and collective experiences. Recent global events have underscored the theory's relevance, prompting a reevaluation of language education in response to changing circumstances. Moreover, 'Techno-Training: Language Acquisition and Learning in the Digital Age' is integral to the theory, as it recognizes the influence of technology on modern language education. Beyond traditional methods, these three reshape our fundamental understanding of said theory. Drawing from historical evidence, psychological principles, and contemporary applications, they supported the conceptualization of the theory itself. Overall, the Neo-Language Acquisition and Learning Theory revolutionizes language education, spotlighting the power of motivation, determination, and adaptability to navigate the evolving landscape of language learning and acquisition.

This article develops duality principles and numerical results for a large class of non-convex variational models. The main results are based on fundamental tools of convex analysis, duality theory and calculus of variations. More specifically the approach is established for a class of non-convex functionals similar as those found in some models in phase transition. Finally, in the last section we present a concerning numerical example and the respective software.

Decision-making is a complex process of selecting an option from the given choices by analyzing the background information like risk, loss, and gain within the alternative options presented. It has been observed in earlier studies that people are prompt to make less rational decisions when choices are given in a language less known to them. Therefore, to understand the effect of languages on decision-making, we have questioned native Hindi speakers in French and English. French being the foreign language, and English as their second language. Thus, this effect of a non-native language brings to light the important role that the native language plays routinely in judgment and decision-making. In this paper, we developed a Neuropsychological assessment to decipher the effects on decision-making between choices when given in foreign language and second language in comparison with the native language of an individual, which is termed as foreign language effect(Fle). We have explored various possible situations to understand the foreign language effect(Fle) in decision-making and does this change translates when the decision is to be made in the second language. Our study concludes that the Foreign language is least affected by the intuitive biases, followed by the second language, and the native language is most affected by it.

This research investigates the potential application of generative language models, especially ChatGPT, in aviation safety analysis as a means to enhance the efficiency of safety analyses and accelerate the time it takes to process incident reports. In particular, ChatGPT was leveraged to generate incident synopses from narratives, which were subsequently compared with ground truth synopses from the Aviation Safety Reporting System (ASRS) dataset. The comparison was facilitated by using embeddings from Large Language Models (LLMs), with aeroBERT demonstrating the highest similarity due to its aerospace-specific fine-tuning. A positive correlation was observed between synopsis length and their cosine similarity. In a subsequent phase, human factor issues involved in incidents as identified by ChatGPT were compared to human factor issues identified by safety analysts. A concurrence rate of 61% was found, with ChatGPT demonstrating a cautious approach towards attributing human factor issues. Finally, the model was used to attribute incidents to relevant parties. As no dedicated ground truth column existed for this task, a manual evaluation was conducted. ChatGPT attributed the majority of incidents to the Flight Crew, ATC, Ground Personnel, and Maintenance. This study opens new avenues for leveraging AI in aviation safety analysis.

Predicting human trajectories poses a significant challenge due to the complex interplay of pedestrian behavior, which is influenced by environmental layout and interpersonal dynamics. This complexity is further compounded by variations in scene density. To address this, we introduce a novel dataset from the Festival of Lights in Lyon 2022, characterized by a wide range of densities (0.2-2.2 ped/m2). Our analysis demonstrates that density-based classification of data can significantly enhance the accuracy of predictive algorithms. We propose an innovative two-stage processing approach, surpassing current state-of-the-art methods in performance. Additionally, we utilize a collision-based error metric to better account for collisions in trajectory predictions. Our findings indicate that the effectiveness of this error metric is density-dependent, offering prediction insights. This study not only advances our understanding of human trajectory prediction in dense environments but also presents a methodological framework for integrating density considerations into predictive modeling, thereby improving algorithmic performance and collision avoidance.

The multiphase motors due to their reliability find new areas of application in the industry and transportation. Developing of any system with multiphase motors at first requires elaborate model of the system, define control mode and controllers. The model of control system for the six-phase drive is based on its conventional d-q mathematical model and indirect field-oriented control. Simulink model of six-phase drive with indirect field-oriented control and simulated with two types PID and PID fuzzy controllers. The simulation results, reflecting step response and provided speed reference law as well as load application at constant speed, are presented and analyzed. Fuzzy controller with 49 rules is considered and applied. Six-phase electric drive with field-oriented control at well-tuned PID controller has good step response specifications: settling time 0.13 s at starting without load, step response has no overshoot, small about 1 % short time decrease of speed at load of 5 Nm application. The system employing PID fuzzy controller shows slightly better results in response to torque application: the decrease in speed 1 % is eliminated in shorter time. Simulation results indicate the robustness of both systems with six-phase drive to disturbance and provide high quality transient specifications at determined reference speed.

This article develops dual variational formulations for a large class of models in variational optimization. The results are established through basic tools of functional analysis, convex analysis and duality theory. The main duality principle is developed as an application to a Ginzburg-Landau type system in superconductivity in the absence of a magnetic field. In the first sections, we develop new general dual convex variational formulations, more specifically, dual formulations with a large region of convexity around the critical points which are suitable for the non-convex optimization for a large class of models in physics and engineering. Finally, in the last section we present some numerical results concerning the generalized method of lines applied to a Ginzburg-Landau type equation.

Surface water distribution extracted from remote sensing data has been used in water resource assessment, coastal management, and environmental change studies. Traditional manual methods for extracting water bodies cannot satisfy the requirements for mass processing of remote sensing data; therefore, accurate automated extraction of such water bodies has remained a challenge. The histogram bimodal method (HBM) is a frequently used objective tool for threshold selection in image segmentation. The threshold is determined by seeking twin peaks, and the valley values between them; however, automatically calculating the threshold is difficult because complex surfaces and image noise which lead to not perfect twin peaks (single or multiple peaks). We developed an operational automated water extraction method, the modified histogram bimodal method (MHBM). The MHBM defines the threshold range of water extraction through mass static data; therefore, it does not require the identification of twin histogram peaks. It then seeks the minimum values in the threshold range to achieve automated threshold. We calibrated the MHBM for many lakes in China using Landsat 8 Operational Land Imager (OLI) images, for which the relative error (RE) and squared correlation coefficient (R2) for threshold accuracy were found to be 2.1% and 0.96, respectively. The RE and root-mean-square error (RMSE) for the area accuracy of MHBM were 0.59% and 7.4 km2. The results show that the MHBM could easily be applied to mass time-series remote sensing data to calculate water thresholds within water index images and successfully extract the spatial distribution of large water bodies automatically.

Electricity price forecasting has become a crucial element for both private and public decision-making. This importance has been growing since the wave of deregulation and liberalization of energy sector worldwide late 1990s. Given these facts, this paper tries to come up with a precise and flexible forecasting model for the wholesale electricity price for the Italian power market on an hourly basis. We utilize artificial intelligence models such as neural networks and bagged regression trees that are rarely used to forecast electricity prices. After model calibration, our final model is bagged regression trees with exogenous variables. The selected model outperformed neural network and bagged regression with single price used in this paper, it also outperformed other statistical and non-statistical models used in other studies. We also confirm some theoretical specifications of the model. As a policy implication, this model might be used by energy traders, transmission system operators and energy regulators for an enhanced decision-making process.

In this study, we investigated the features of co-infection with SARS-CoV-2 and nonpathogenic strain LEV8 of coxsackievirus A7 or enterovirus A71 for Vero E6 cells and Syrian hamsters. The investigation of co-infection with SARS-СoV-2 and LEV-8 or EV-A71 in the cell model was shown that a competitive inhibitory effect for these viruses were especially significant against SARS-CoV-2. Pre-infection with enteroviruses in animals caused more than a 100-fold decrease in the levels of SARS-CoV-2 virus replication in the respiratory tracts and more rapid clearance of the lower respiratory tract from infectious SARS-CoV-2. Co-infection with SARS-CoV-2 and LEV-8 or EV-A71 also reduced the severity of clinical manifestations of the SARS-CoV-2 infection for animals. Additionally, the histological data illustrated that co-infection with nonpathogenic coxsackievirus decreased the level of pathological changes by SARS-CoV-2 in the lungs. Research into the chemokine/cytokine profile demonstrated that the studied enteroviruses efficiently triggered this part of antiviral immune response, which can be associated with significant inhibition of SARS-CoV-2 infection. These results demonstrate that there exists a strong viral interference between the studied nonpathogenic strain of coxsackievirus A7 or enteroviruses A71 and SARS-CoV-2 pathogenic for humans in vitro and in vivo.

Molnupiravir, a prodrug known for its broad antiviral activity, demonstrated efficacy in animal models of Covid-19, prompting clinical trials where initial results indicated a significant effect against the disease. However, subsequent clinical studies did not confirm these findings, leading to the rejection of molnupiravir for permanent market authorization in many countries. This report critically assessed 19 studies published in 17 reports that investigated the efficacy of molnupiravir in animal models of Covid-19 with the purpose of determining how well the design of these models informed human studies. We found that the administered doses of molnupiravir in most studies involving animal Covid-19 models were disproportionately higher than the dose rec-ommended for human use. Specifically, when adjusted for body surface area, half of the doses of molnupiravir used in the animal studies were more than twice as high as the human dose. Addi-tionally, the drug was frequently given prophylactically or shortly after SARS-CoV-2 inoculation in these models, in contrast to clinical trials where such timing is not consistently achieved. Furthermore, the recommended five-day treatment duration for humans was exceeded in several animal studies. Collectively, we suggest that these design elements in the reported animal studies contributed to a bias favoring molnupiravir, and thus inflated expectations for its efficacy against Covid-19. Addressing these elements may offer avenues to enhance the clinical efficacy of mol-nupiravir for treatment of Covid-19 that include dose increment, early treatment, and admin-istration by inhalation along with use of molnupiravir in antiviral combination therapy.

Background: Assessing the impact of bone health clinical management in breast cancer (BC) patients receiving adjuvant endocrine therapy and designing a personalized clinical pathway to reduce bone loss, in an Italian research hospital. Methods: The primary endpoint was to assess (through the process improvement organizational method) the clinical pathway that post-surgical BC patients prescribed with endocrine therapy undergo to prevent bone loss. The secondary endpoint was to design a personalized clinical pathway for a prompt implementation of guidelines, to assess and possibly prescribe antiresorptive therapy. Results: During the first year of the new diagnostic therapeutic assistance pathway execution, an 60% increase in Dual-Energy X-ray Absorptiometry evaluations within 30 days and a 39.5% increase in antiresorptive therapy prescription within 90 days (since prescription of endocrine therapy) were shown, thus increasing patients’ compliance. Conclusion: Case managers and bone health specialists in this context can improve patients’ adherence to therapies and bone health, helping physicians to expand their collaboration.

Given the opportunities offered by foreign investment in energy infrastructure mostly by Chinese firms, the Government of Cambodia is giving high priority to developing hydropower resources for reducing energy poverty and powering economic growth. Using a “Political ecology of the Asian drivers” framework, this paper assesses China’s involvement in the development of large dams’ in Cambodia and its impacts on the access of natural resources such as water and energy by dam builders, local communities and the government. This analysis is based on 61 interviews and 10 focus group discussions with affected communities, institutional actors, Chinese dam builders and financiers in relation to the first large Chinese dam built in Cambodia, the Kamchay dam. Based on the results of the analysis this paper makes recommendations on how to improve the planning, implementation and governance of large dams to ensure that the dams’ benefits are shared more equally.

This study considers an application of the first-order Grey Markov Model to foresee the values of Italian power generation in relation to the available energy sources. The model is used to fit data from the Italian energy system from 2000 to 2022. The integration of Markovian error introduces a random element to the model, which is able now to capture inherent uncertainties and misalignments between the Grey model predictions and the real data. This application provides valuable insights for strategic planning in the energy sector and future developments. The results show good accuracy of the predictions, which provides powerful information for the effective implementation of energy policies concerning the evolution of energy demand in the country. Despite advancements, Italy’s 2032 energy mix will still significantly rely on fossil fuels, emphasizing the need for sustained efforts beyond 2032 to enhance sustainability.

A digital twin is a virtual representation that serves as the real-time digital counterpart of a physical object or system. Recent advancements have extended the concept of digital twins to humans, incorporating complex biological data such as DNA (Predictiv Care, Inc.) and immune system profiles. These sophisticated models go beyond mere pictorial representations, offering a more holistic digital reflection. However, a significant gap remains. The current human digital twin models are not capable of learning one’s preferences. In this pilot study, we introduce Diginality, a chatbot powered by HyperCLOVA X, a Large Language Model (LLM) developed by NAVER, Inc. Diginality, learns one’s preferences with custom training from data collected by interview-style questions on the user’s topic of interest. Our findings demonstrate that Diginality successfully answers one’s preferences, thereby adding a new dimension to the concept of human digital twins. This work represents a pioneering step towards creating a more comprehensive and psychologically nuanced human digital twin.

The speed-density or flow-density relationship is a fundamental aspect of traffic flow theory. Single-regime models often face challenges in consistently fitting empirical data under diverse traffic conditions. This paper addresses the inaccuracies of single-regime models, attributing them not only to their functional forms but also to data dispersion and sample selection bias. To mitigate these issues, the data is segmented into day and night periods, leading to the creation of separate models for each. Calibration results, conducted on data from two freeways, Tehran-Karaj and Tehran-Qom, reveal distinct challenges, with the former exhibiting high dispersion and the latter showing low dispersion. Surprisingly, single-regime models demonstrate notable effectiveness when applied to distinct day and night data. Further analysis, categorizing data into day and night, results in reduced errors (20-60% improvement in R-Square), emphasizing the potential for enhanced accuracy by considering distinct regimes. Overall, the study underscores the significance of regime-specific considerations for accurate traffic flow modeling. Upon thorough evaluation, the study highlights the superiority of the neural network Multi-layer Perceptron (MLP) over traditional models. The research discusses the implications of incorporating day and night parameters into the models, emphasizing their potential for accuracy enhancement.

Large-span post-tensioned (PT) beams play a crucial role in maximizing the benefits of post-tensioning techniques. Bonded and unbonded systems are prevalent, with the latter being more widespread in the United States. While bonded systems are advantageous for creating long spans when multiple tendons are grouped in ducts, limited literature exists on their demolition. In a case study, this paper addresses the unique challenge of demolishing large-span bonded post-tensioned beams due to a building's functional change. Emphasizing insights for engineers, it explores the use of cutting and dismantling methods, considering the presence of prestressed cables. The demolition process is distinctive due to the presence of numerous pre-stressed cables along the beams, necessitating a specialized and cautious cutting approach. This is accomplished through the use of a drilling technique that selectively distresses the tendons, ensuring they are not all affected simultaneously. An intriguing observation discussed in this paper pertains to the occurrence of horizontal cracks accompanied by loud sounds following the drilling process, offering insights from the design perspective of PT systems. The paper details an innovative method for safely demolishing large-span bonded PT beams, using ground-penetrating radar and computer models to navigate structural complexities and ensure nearby structures' safety.

The rapid advancement of technology has revolutionized language learning, introducing innovative methods that depart from traditional instructional approaches. This study employs a mixed-methods research design to examine the impact of chatbot-based language learning support, adaptive learning algorithms, and virtual reality language immersion on the language learning proficiency and self-regulated learning skills of English as a Foreign Language (EFL) learners. The research design includes quantitative analysis of language proficiency scores and qualitative exploration of learner experiences with the technological interventions. The theoretical implications of this study are rooted in constructivist and socio-cultural learning theories, which underpin the design and implementation of the technological interventions. The triangulation of qualitative and quantitative data revealed that the participants' positive perceptions of the effectiveness of chatbot-based language learning support were supported by the quantitative results, with the variable "chat-bot based support" demonstrating a substantial mean difference compared to other groups. This convergence of findings reinforces the positive influence of chatbot-based support on language learning outcomes and highlights the importance of integrating theoretical perspectives with empirical evidence to gain a comprehensive understanding of the impact of technological interventions on language learning outcomes for EFL learners. The study's findings provide insights into the potential of these technological interventions to optimize language learning outcomes for EFL learners and promote autonomous learning behaviors.

(1) Background: Attention Deficit Hyperactivity Disorder (ADHD) and Developmental Language Disorder (DLD) are neurodevelopmental disorders that affect various areas of chil-dren’s development, such as language. There is an emerging idea that ADHD is characterised by the presence of language difficulties, which could be explained by the high comorbidity between ADHD and DLD. The purpose of this study is to analyse the empirical evidence of language com-petence in children aged 6–17 years old, diagnosed with ADHD and/or DLD. (2) Method: Fifteen studies with experimental designs were identified from Scopus, PsycINFO and WoS databases, reporting on language skills in children diagnosed with ADHD and/or DLD. Studies relating ex-ecutive functioning to language skills in this target population were also included. (3) Results: The literature is heterogeneous and different components of language are also examined. Even though the results are contradictory they convincingly demonstrate that there are overlapping symptoms between ADHD and DLD, such as language skills and executive functions. (4) Conclusions: the differences in the samples limit the generalisability of the results. Therefore, this review highlights the importance of considering language skills when designing individualised interventions for the population with ADHD and DLD, both in comorbidity and in isolation.

When dealing with limited sample sizes or missing values in time series data, achieving high accuracy in forecasting becomes challenging. This challenge is particularly common in wind energy forecasting, where many wind farms lack complete data. In this paper, we employ the widely-used ARIMA (Autoregressive Integrated Moving Average) model for time series forecasting. To address the difficulties posed by limited sample sizes and missing values, we adopt a unique approach by utilizing multiple ARIMA models for different datasets. A key distinction from other multiple models methods for time series forecasting lies in each model within our approach using its own dataset, making the fusion process more intricate. To overcome this, we incorporate neural networks and two techniques for model fusion: direct fusion with a learning mechanism and compensation for missing data through training. For each ARIMA model, we introduce a noise estimation method to circumvent the white noise assumptions inherent in ARIMA models. Finally, we apply these methods to wind energy prediction, and our experimental results showcase a significant enhancement in forecasting accuracy.

Previously, we described a 19-base pair double-stranded RNA with 3'-trinucleotide overhangs, acting as immunostimulatory RNA (isRNA). This molecule demonstrated notable antiproliferative effects on cancer cells, inhibited tumor growth, and elicited immunostimulatory and antiviral responses by inducing cytokine and interferon production. Within this study, we compared the efficiency of lung fibrosis development, initiated in mice by BLM or LPS using different schemes of induction. Then we compared the effect of isRNA used in a preventive or therapeutic regimen on the development of fibrosis in selected BLM- and LPS-induced mouse models and showed that isRNA can be used in pathological conditions accompanied by the development of inflammation and the risk of fibrosis formation, without adverse side effects. Prophylactic regimen of isRNA application is beneficial for prevention of the development of pulmonary fibrosis.

Count data analysis presents unique challenges due to its discrete nature, often exhibiting excessive zeros and overdispersion. To address these complexities, count models, such as Poisson regression and Negative Binomial regression, have been developed, enabling modeling and prediction of count-based phenomena. Additionally, it’s important to notice that zero inflation, a phenomenon commonly observed in count data, requires specialized techniques for robust analysis. This article provides an overview of count data and count models, explores zero inflation, introduces Likelihood Ratio Tests, and explains how the Vuong Test can be used as a model selection criteria. Furthermore, we created a Vuong Test implementation from scratch using the Python programming language. This implementation enhances the accessibility and applicability of the Vuong Test in real-world scenarios, providing a valuable contribution to the academic community, since Python didn’t have an implementation of this statistical test.

Recent research has suggested that working memory training interventions may benefit children with Developmental Language Disorder (DLD). The current study investigated a short and engaging adaptive working memory intervention that targeted executive skills and aimed to improve both language comprehension and working memory abilities in children with DLD. Forty-seven 6- to 10-year-old children with DLD were randomly allocated to an executive working memory training intervention (n=24) or an active control group (n=23). A pre-test/intervention/post-test/9-month-follow-up design was used. Outcome measures included assessments of language (to evaluate far transfer of the training) and working memory (to evaluate near transfer of the training). Hierarchical multiple regression analyses controlling for pre-intervention performance and age found group to be a significant predictor of sentence comprehension and of performance on six untrained working memory measures at post-intervention and 9-month follow-up. Children in the intervention group showed significantly higher language comprehension and working memory scores at both time points than children in the active control group. The intervention programme showed potential to improve working memory and language comprehension in children with DLD and demonstrated several advantages: it involved short sessions over a short period; caused little disruption in the school day; and was enjoyed by children.

This paper is aimed at studying the temporal evolution of the surface displacements occurred over the past few years in the ocean-reclaimed platforms of the Shanghai megacity (China), which are mainly ascribable to consolidation processes of large dredger fills and alluvial deposits. With respect to previous analyses carried out over the same area, this work provides a joint multi-platform differential interferometry synthetic aperture radar (DInSAR) analysis, based on the application of the advanced Small BAseline Subset (SBAS) algorithm. This led us to retrieve long-term deformation time-series that are helpful for a better understanding of the on-going deformation phenomena. To this aim, we have exploited two sequences of SAR data collected by the ASAR/ENVISAT and by the COSMO-SkyMed (CSK) sensors, respectively, spanning the whole time period from 2007 to 2016. Unfortunately, the large time gap (of about three years) existing between the available ASAR/ENVISAT and CSK datasets gave rise to additional difficulties for their combination. Nevertheless, this problem has been faced by benefiting from the knowledge of a time-dependent model describing the temporal evolution of the expected deformations affecting the Shanghai ocean-reclaimed platforms.

A review of quantitative risk assessment (QRA) models of L. monocytogenes in produce was carried out, with the objective of appraising and contrasting the effectiveness of the control strategies placed along the food chains. Despite nine of the thirteen QRA models recovered focused on fresh or RTE leafy greens, none of them represented important factors or sources of contamination in the primary production, such as type of cultivation, water, fertilisers or irrigation method/practices. Cross-contamination at processing and during consumer’s handling was modelled using transfer rates, which were shown to moderately drive the final risk of listeriosis; highlighting therefore the importance of accurately representing the transfer coefficient parameters. Many QRA models coincided in the fact that temperature fluctuations at retail or temperature abuse at home were key factors contributing to increasing the risk of listeriosis. In addition to a primary module that could help assess current on-farm practices and potential control measures, future QRA models for minimally-processed produce should also contain a refined sanitisation module able to estimate the effectiveness of various sanitisers as a function of type, concentration and exposure time. Finally, L. monocytogenes growth in the products down the supply chain should be estimated by using realistic time-temperature trajectories, and validated microbial kinetic parameters, both of them currently available in the literature.