The paper aims to develop and test an algorithm for classifying Russian-language text reviews of patients’ experiences with medical facilities and physicians, extracted from social media. This is motivated by the limitations of conventional methods of surveying consumers to assess their satisfaction with the quality of services, which are being replaced by automatic processing of text data from social media. This approach enables to get more objective results due to the increased representativeness and independence of the sample of service consumers. The authors have tested machine learning methods using various neural network architectures. A hybrid method was developed to classify text reviews of medical facilities posted by patients on the two most popular physician review websites in Russia. Overall, more than 60,000 reviews were analysed. The main results are as follows: 1) the classification algorithm developed by the authors has a high efficiency, the best result being achieved by the GRU-based architecture (val_accuracy = 0.9271); 2) applying the named entity search method to text messages following their partitioning improved the classification efficiency for each of the classifiers based on artificial neural networks. To further enhance the classification quality, reviews need to be semantically partitioned by target and sentiment and the resulting fragments need to be analysed separately.

Dust storms play a crucial role in the climate system and the space environment of Mars and have a great impact on human’s Mars exploration activities. The Martian dust storms exhibit significant regional, seasonal and interannual variations due to various controlling factors such as the large-scale atmospheric circulation, varying solar radiation forcing, and Martial orbital and rotational motions and their coupling to the atmospheric dynamics. This paper focuses on the review of cur-rent understandings on Martian dust storms. This paper begins by elucidating the basic properties of dust storms, and their driving mechanisms and impacts on atmospheric dynamics, atmospheric electric property, space environment, topography, and Mars explorations. Then it introduces the observation methods on different platforms including orbiters and landers/rovers, and the da-tasets constructed based on these historical observations for Martian dust storms. Finally, we pro-posed the dust storm monitoring and forecasting for the upcoming Chinese Tianwen-3 Mars sam-pling returning mission. It concludes by depicting the future research topics to systematically un-derstand the Martian dust storms.

Open-vocabulary learning has recently gained prominence as a means to enable image segmentation for arbitrary categories based on textual descriptions. This advancement has extended the applicability of segmentation systems to a broader range of generally purpose scenarios. However, current methods often revolve around specialized architectures and parameters tailored to specific segmentation tasks, resulting in a fragmented landscape of segmentation models. In response to these challenges, we introduce OVAMTSeg, a versatile framework designed for Open-Vocabulary and Multitask Image Segmentation. OVAMTSeg harnesses adaptive prompt learning to empower the model to capture category-sensitive concepts, enhancing its robustness across diverse multi-task and scenario contexts. Text prompts are employed to effectively capture semantic and contextual features of the text, while cross-attention and cross-modal interactions enable the fusion of image and text features. Furthermore, a transformer-based decoder is incorporated for dense prediction. Extensive experimental results underscore the effectiveness of OVAMTSeg, showcasing its state-of-the-art performance and superior generalization capabilities across three segmentation tasks. Notable achievements include a 47.5 mIoU in referring expression segmentation, 51.6 mIoU on Pascal-VOC with four unseen classes, 46.6 mIoU on Pascal-Context in zero-shot segmentation, 65.9 mIoU on Pascal-5i, and 35.7 mIoU on COCO-20i datasets for one-shot segmentation.

Sentiment analysis has become an important tool for understanding public opinion across languages and domains. Recently, there has been an increase in the number of studies on sentiment analysis in low-resource languages such as Kazakh. This is important to ensure that modern text analysis technologies are accessible to all users, regardless of their language background. The aim of the study is to create a sentiment analysis model for analyzing texts in Kazakh. As part of this work, we aim to use fine-tuning techniques on our own dataset for already existing models, thus improving their accuracy and efficiency for analyzing Kazakh language texts. This paper presents a manually collected dataset "KazIntTelCom" from the city information service 2GIS, consisting of user reviews, manually annotated by the authors taking into account the polarity of sentiment (i.e. negative positive or neutral). This dataset was used to fine-tune two pre-trained multi-lingual Transformer-based sentiment analysis models taken from the HuggingFace platform. The distillBERT and XLM-RoBERTa models were used for tuning. Also, the models were tested on the dataset "KazSAnDRA". The results show that accurate tuning even on a relatively small dataset gives a significant increase in performance, which is confirmed by an increase in the accuracy index by 20%-30%. In addition, false misses and false detections are analyzed, which allows us to identify directions for further improvement of the models. The contribution of this work, in addition to the dataset, is the analysis of model errors, which will help future developers to make more accurate settings of hyperparameters of training for sentiment analysis in Kazakh. These results are important for natural language processing and their adaptation to low-resource languages, promoting more inclusive and equitable access to modern analytical tools. Thus, this study demonstrates the effectiveness of the Transformers architecture for sentiment analysis in Kazakh and opens new opportunities for further model improvement.

Fever control is essential in patients with severe traumatic brain injury (TBI). The efficacy of therapeutic hypothermia (TH) in severe TBI has been investigated over the last few decades; however, in contrast to experimental studies showing benefits, no evidence of efficacy has been demonstrated in clinical practice. In this review, the mechanisms and history of hypothermia were briefly outlined, while the results of major randomized controlled trials (RCTs) and meta-analyses investigating TH for adult TBI are introduced and discussed. The retrieved meta-analyses showed conflicting results, with a limited number of studies indicating benefits of TH. Some studies have shown benefits of long-term TH compared with short-term TH. Although TH is effective at lowering elevated intracranial pressure (ICP), reduced ICP does not lead to favorable outcomes. Low-quality RCTs overestimated the benefits of TH, while high-quality RCTs showed no difference or worse outcomes with TH. RCTs assessing standardized TH quality demonstrated the benefits of TH. As TBI has heterogeneous and complicated pathologies, applying a uniform treatment may not be ideal. A meta-analysis of young patients who underwent early cooling and hematoma removal showed better TH results. TH should not be abandoned, and its optimal should be advocated on an individual basis.

Nowadays genetic algorithm (GA) is greatly used in engineering pedagogy as an adaptive technique to learn and solve complex problems and issues. It is a meta-heuristic approach that is used to solve hybrid computation challenges. GA utilizes selection, crossover, and mutation operators to effectively manage the searching system strategy. This algorithm is derived from natural selection and genetics concepts. GA is an intelligent use of random search supported with historical data to contribute the search in an area of the improved outcome within a coverage framework. Such algorithms are widely used for maintaining high-quality reactions to optimize issues and problems investigation. These techniques are recognized to be somewhat of a statistical investigation process to search for a suitable solution or prevent an accurate strategy for challenges in optimization or searches. These techniques have been produced from natural selection or genetics principles. For random testing, historical information is provided with intelligent enslavement to continue moving the search out from the area of improved features for processing of the outcomes. It is a category of heuristics of evolutionary history using behavioral science-influenced methods like an annuity, gene, preference, or combination (sometimes refers to as hybridization). This method seemed to be a valuable tool to find solutions for problems optimization. In this paper, the author has explored the GAs, its role in engineering pedagogies, and the emerging areas where it is using, and its implementation.

This study explores the Experience Economy dimensions within fishing tourism, adopting a data science perspective by employing web crawling for extensive data gathering on reviewer profiles from TripAdvisor. Utilizing Natural Language Processing (NLP) techniques, it scrutinizes the relationship between Experience Economy dimensions and user profiling aspects. Findings reveal "Entertainment" as the predominant dimension in tourist reviews, followed by "Aesthetic," "Educational," and "Escapist." Particularly notable are the frequent co-occurrences of "Entertainment"-"Aesthetic" and "Educational"-"Entertainment" pairs. The practical implications underscore the potential socioeconomic benefits of fishing tourism for local communities and fishermen, emphasizing the necessity for governmental support in terms of infrastructure, leadership, legislation, and financial backing to foster sustainable development in this sector. Notably, this research stands as a pioneering effort in its focus on Experience Economy dimensions and user profiling within the context of fishing tourism, drawing data from business pages and user profiles.

This paper propose an original approach of achieving a Cymatics based visual perception of image-extracted text. In this context, an effective approach for automated text detection and recognition for the natural scene images is proposed. The incoming image is firstly enhanced by employing CLAHE and DWT. Afterwards, the text regions of the enhanced image are detected by employing the MSER feature detector. The non-text MSERs are removed by employing the geometrical and contour based filters. The remaining MSERs are grouped into words or phrases by finding out similarities between them. The text recognition is performed by employing an OCR function. The extracted text is sequentially analysed on character by character basis. Each character is converted into a methodical acoustic excitation. Finally, these excitations are converted into the systematic visual perceptions by using the phenomenon of Cymatics. The system functionality is tested with an experimental setup. For the case of studied natural scenes, the suggested approach achieves 80% precision in text localization and 53% precision in end-to-end text recognition. The devised system principle is novel and can be employed in various applications like visual art, encryption, education, integration of impaired people, etc.

This study explores the public library service evaluation domain through user-generated content on Google Maps, highlighting digital feedback's significant yet underexplored potential in understanding public library patronage across Taiwan's six major cities. Utilizing a mixed-methods research design, this study integrates Google Maps review content analysis with Social Network Analysis to delineate public perceptions and identify areas for service enhancement in public libraries. It innovatively leverages personal experiences extracted from over 60,000 Google Maps reviews to evaluate public library services in cities such as Taipei, New Taipei, Taoyuan, Taichung, Tainan, and Kaohsiung. The research taps into the National Library of Taiwan's National Library Statistics System to provide a robust analysis of library performance and user satisfaction, offering a novel perspective by emphasizing user-centric feedback from Google Maps as a primary data source. This approach provides quantitative data on library usage and geographic distribution and enriches our understanding of the qualitative experiences of library users. In analyzing the keywords from Google Maps reviews of public libraries, we categorize and interpret these under the three core LibQUAL+ dimensions—Affect of Service, Information Control, and Library as Place. The findings expose variances in perceived service quality among the cities, with Kaohsiung and Taichung receiving the highest accolades for service satisfaction. Simultaneously, the study identifies potential areas for improvement, particularly in cities with lower satisfaction ratings like Taipei. This personalized feedback illustrates the intimate relationship between public libraries and their communities, offering invaluable insights for policymakers and library management to enhance service delivery and user experience.

With the development of deep learning, several Graph Neural Networks (GNN)-based approaches have been utilized for text classification. However, GNNs encounter challenges in capturing contextual text information within a document sequence. To address this, a novel text classification model RB-GAT is proposed by combining RoBERTa-BiGRU embedding and a multi-head Graph ATtention Network (GAT). First, the pre-trained RoBERTa model is exploited to learn word and text embeddings in different contexts. Second, the Bidirectional Gated Recurrent Unit (BiGRU) is employed to capture long-term dependencies and bidirectional sentence information from the text context. Next, the multi-head graph attention network is applied to analyze this information, which serves as a node feature for the document. Finally, the classification results are generated through a Softmax layer. Experimental results on three benchmark datasets demonstrate that our method can achieve an accuracy of 71.48%, 98.45%, and 80.32% on Ohsumed, R8, and MR, which is superior to the existing nine text classification approaches.

In an era where the proliferation of large language models blurs the lines between human and machine-generated content, discerning text authenticity is paramount. This study investigates transformer-based language models—BERT, RoBERTa, and DistilBERT—in distinguishing human-written from machine-generated text. By leveraging a comprehensive corpus, including human-written text from sources such as Wikipedia, WikiHow, various news articles in different languages, and texts generated by OpenAI's GPT-2, we conduct rigorous comparative experiments. Our findings highlight the superior effectiveness of ensemble learning models over single classifiers in this critical task. This research underscores the versatility and efficacy of transformer-based methodologies for a wide range of natural language processing applications, significantly advancing text authenticity detection systems. The results demonstrate competitive performance, with the transformer-based method achieving an F-score score of 0.83 with RoBERTa-large (monolingual) and 0.70 with DistilBERT-base-uncased (multilingual).

The classification and summarization of online reviews using machine learning and deep learningbased approaches are the subject of this systematic literature review. Consumers, companies, and researchers can now find vital information from online reviews. Automatically categorizing and summarizing these reviews can offer useful information and facilitate decision-making. The purpose of this study is to offer a thorough overview of the current methodology, approaches, and developments in this area. The review concentrates on machine learning-based methods for categorization and summarizing tasks, highlighting their advantages, drawbacks, and new developments. This systematic review provides insights into the most recent methodologies and indicates prospective directions for further investigation by synthesizing the data from a wide range of pertinent research publications

Sentiment analysis plays a crucial role in understanding customer feedback, guiding product development, and informing business decisions. This paper introduces term sentiment entropy (TSE), a novel weighting method that leverages the distribution of sentiment labels associated with words to enhance text classification accuracy. TSE complements traditional TF-IDF techniques by capturing the nuances of sentiment variation across different contexts. Experiments across diverse public datasets demonstrate TSE's potential to improve sentiment analysis performance, especially in capturing subtle sentiment shifts and adapting to specific domains. While computational cost and label quality pose challenges, TSE offers a promising avenue for refining sentiment analysis and opening new research frontiers.

Currently, the COVID‐19 has directly affected the millions of humans lives. The symptoms of the disease involving fever, malaise, chest infection, and breathing difficulties, were identified, and its existence is continuously becoming restructured. The World Health Organization (WHO) had mentioned the wide diagnostics test besides COVID-19 that would also assist medical facilities to recognize infectious diseases as well as currently focusing efficiently on preventing and afterward defeating this viral disease. The infection is usually transmitted among human beings in direct contact, greatest through the liquid bubbles generated through cough, sneeze, or speaking. This paper reviews the COVID 19 pandemic, its history, current updates, contact tracing applications, and use of emerging technologies like the Internet of Things (IoT) and Blockchain for stopping the spreading and provide service online to the patient from a distance.

The reviews usefulness has been the aim of several research studies. However, results regarding the significance of usefulness determinants are often contradicting, thus decreasing the accuracy of reviews’ helpfulness estimation. Also, bias in user reviews attributed to differences e.g. in gender, nationality, etc., may result into misleading judgments thus diminishing reviews’ usefulness. Research is needed for sentiment analysis algorithms that incorporate bias embedded in reviews, thus improving their usefulness, readability, credibility, etc. This study utilizes fuzzy relations and fuzzy synthetic evaluation (FSE) in order to calculate reviews’ usefulness by incorporating users’ biases as expressed in terms of reviews’ articulacy and sentiment polarity. It selected and analysed 95.678 hotel user reviews from Tripadvisor, for five nationalities. The findings indicate that there are differences among nationalities. The British are most consistent in their judgments expressed in titles and review documents. The British and the Greek review titles suffice to convey any negative sentiments. The Dutch use fewer words in their reviews than the other nationalities. This study suggests that fuzzy logic captures subjectivity which is often found in reviews, and it can be used to quantify users’ behavioral differences, calculate reviews usefulness, and provide the means for developing more accurate voting systems.

In 2020, students of Pakistan had to adapt to the online environment for the very first time. This study aims to analyze the perceptions of medical, dental, and allied health students about online education in Pakistan. A descriptive, cross-sectional study was done to assess the level of acceptance of undergraduate students. A pre-validated questionnaire regarding demographics, past-experience of e-learning, advantages disadvantages of e-learning, and general perception of students towards e-learning was distributed. Descriptive statistics were computed for demographics, Mann-Witney-U test was used to compare the differences of perceptions between pre-clinical year and clinical years students. Kruskal-Wallis test was applied to compare the results of three specialties of students. Chi-square was used to compare overall category-wise positive and negative responses of students. 1200 students participated in the study. The major advantage identified by all students was the ‘comfortable environment’ in which they studied online. The major disadvantage selected by preclinical year students was ‘anxiety due to social isolation’ and that chosen by clinical year students was ‘lack of patient interaction’. Overall, 72% of students had a negative perception of e-learning. Student-teacher training, student counselling sessions, and innovative techniques need to be introduced to enhance student engagement and reduce pandemic stress.

The existing segmentation-based scene text detection methods mostly need complicated post-processing, and the post-processing operation is separated from the training process, which greatly reduces the detection performance. The previous method, DBNet successfully simplified post-processing and integrated the post-processing into a segmentation network. However, the training process of the model took a long time for 1200 epochs and the sensitivity to texts of various scales was lacking, leading to some text instances being missed. Considering the above two problems, we design the text detection Network with Binarization of Hyperbolic Tangent(HTBNet). First of all, we propose Binarization of Hyperbolic Tangent (HTB), optimized along with which, the segmentation network can expedite the initial convergent speed by reducing the amount of epochs from 1200 to 600. Because features of different channels in the same scale feature map focus on the information of different regions in the image, to better represent the important features of all objects in the image, we devise the Multi-Scale Channel Attention(MSCA). Meanwhile considering that multi-scale objects in the image cannot be simultaneously detected, we propose a novel module named Fused Module with Channel and Spatial(FMCS), which can fuse the multi-scale feature maps from channel and spatial dimension. Finally we adopt cross entropy as the loss function, which measures the difference between predicted values and ground truths. The experimental results show that HTBNet compared with lightweight models has achieved competitive performance and speed on Total-Text(F-measure:86.0%, FPS:30) and MSRA-TD500 (F-measure:87.5%, FPS:30).

Objective: To carry out a bibliometric analysis study of systematic reviews and meta-analyses in dentistry, divided into different thematic areas. Material and method: A search was conducted in the Science Citation Index-Expanded on the core collection of Web of Science, they were selected from the area of Dentistry and Oral Surgery and Medicine categories, the data was downloaded on April 20, 2022 and The 100 most cited articles from each of the thematic areas were selected. Results: An increase in this type of articles was observed in the last decade in the areas of pediatric and medical dentistry and oral pathology. The thematic area that received the most citations was periodontics. The two authors with the most citations are Zwahlen, Marcel and Pjetursson, Bjarni Eluar. The countries that receive the most citations are European, along with the USA and China. The topics that are most published in this type of article deal with Cancer with 50 publications, caries treatment with 25 and fluoridation with 1. The entities that finance this type of articles the most are private companies (26.76%). Conclusions: Together with an exponential increase in the number of publications in dentistry, there has been an increase in the number of publications in systematic reviews. The areas publishing the most articles and having the most citations are Periodontics and Implantology, despite the fact that the most studied topic is cancer.

The detection and recognition of tables in image-based documents is a challenging and essential task for automated data extraction and anal- ysis. This paper introduces a methodology that utilizes Convolutional Neural Networks (CNNs) to address this problem. By harnessing the ro- bust visual recognition abilities of CNNs, the proposed method effectively detects and extracts tables from image-based documents. Additionally, an Encoder-Dual Decoder (EDD) architecture is employed to extract the textual content from table cells, enabling the transformation of visual data into structured, machine-readable formats. This structured data is then further processed using a Vector Space Model (VSM)-based language modeling technique for query-based table retrieval. The methodology’s accuracy is assessed by analyzing the spatial relationships between the extracted cells and comparing them against a pre-defined table structure. The results provide an evidence to the effectiveness of the proposed ap- proach, with an impressive 85% accuracy rate and a corresponding error rate of 15%. This accurate extraction and recognition of tables from image-based documents can significantly enhance applications in data analysis, information retrieval, and knowledge extraction.

Electronic health records (EHRs) are becoming a vital source of data for healthcare quality improvement, research, and operations. However, much of the most valuable information contained in EHRs remains buried in unstructured text. The field of clinical text mining has advanced rapidly in recent years, transitioning from rule-based approaches to machine learning and, more recently, deep learning. With new methods come new challenges, however, especially for those new to the field. This review provides an overview of clinical text mining for those who are encountering it for the first time (e.g. physician researchers, operational analytics teams, machine learning scientists from other domains). While not a comprehensive survey, it describes the state of the art, with a particular focus on new tasks and methods developed over the past few years. It also identifies key barriers between these remarkable technical advances and the practical realities of implementation at health systems and in industry.

Background: Calcaneal fractures are the most frequent traumatic injuries of the hindfoot and can cause severe disability with social and economic sequelae; since 1980 an increasing number of studies and new technologies have led to an improvement in their management and complications but treatment is still controversial. The purpose of the study to review the secondary scientific literature looking for the optimal management of calcaneal fracture; Methods: through the PubMed MEDLINE database, 4856 articles were identified; only meta-analyses and systematic reviews were included in the study. Results: 59 reviews with more than 10,000 calcaneus fractures were examined and results were divided into various topics; the majority of articles agree on the superiority of surgical versus conservative treatment; minimally invasive access to the sinus tarsi shows better results and fewer complications than traditional extended lateral access; reduction and osteosynthesis with percutaneous and/or minimally invasive techniques seem to provide better outcomes if compared to open treatments. Conclusions: The management of calcaneus fractures requires an individualized planning based on the functional demands of the patient, the type of fracture and associated injuries. New technologies and further studies may still improve the management of these lesions.

Numerous goods and services are now offered through online platforms due to the recent growth of online transactions like e-commerce. Users have trouble locating the product that best suits them from the numerous products available in online shopping. Many studies in deep learning-based recommender systems (RSs) have focused on the intricate relationships between the attributes of users and items. Deep learning techniques have used consumer or item-related traits to improve the quality of personalized recommender systems in many areas, such as tourism, news, and e-commerce. Various companies, primarily e-commerce, utilize sentiment analysis to enhance product quality and effectively navigate today's business environment. Customer feedback regarding a product is gathered through sentiment analysis, which uses contextual data to split it into separate polarities. The explosive rise of the e-commerce industry has resulted in a large body of literature on e-commerce from different perspectives. Researchers have made an effort to categorize the recommended future possibilities for e-commerce study as the field has grown. There are several challenges in e-commerce, such as fake reviews, frequency of user reviews, advertisement click fraud, and code-mixing. In this review, we introduce an overview of the preliminary design for e-commerce. Second, the concept of deep learning, e-commerce, and sentiment analysis are discussed. Third, we represent different versions of the commercial dataset. Finally, we explain various difficulties facing RS and future research directions.

Text mining is a technological trend often highlighted in the continuous exchange of information through interconnected media. Its applicability goes beyond private organizations, as the public sector also requires it to treat textual information regarding services offered. Within this scenario, public security emerges as a prominent user of text mining that seeks to ensure the construction of data and knowledgebases to support decision-making about law enforcement actions to ensure citizen welfare. The primary objectives of this article are: (i) to develop a survey to identify text mining applications, techniques, opportunities, and challenges in public security, and (ii) to outline research directions concerning these topics and provide insights so that interested researchers can develop new studies. The literature was searched within four databases: Scopus, IEEE Xplore, ACM Digital Library, and Web of Science. A filtering process was applied to extract the works most aligned with the target theme, resulting in the selection of 194 of the most relevant works for a literature review. There were identified nineteen key applications of text mining related to public security and the most recurrent techniques and technologies reported between 2014 to 2021, supporting outlining three axes for future directions: one with possible expansion of objectives for new research; another on changes and adaptations in scopes for the methodological context; and the last one on expansions and changes in application scenarios based on the literature.

Google play store allow the user to download a mobile application (app) and user get inspired by the rating and reviews of the mobile app. A recent study analyzes that user preferences, user opinion for improvement, user sentiment about particular feature and detail with descriptions of experiences are very useful for an application developer. However, many application reviews are very large and difficult to process manually. Star rating is given of the whole application and the developer cannot analyze the single feature. In this research, we have scrapped 282,231 user reviews through different data scraping techniques. We have applied the text classification on these user reviews. We have applied different algorithms and find the precision, accuracy, F1 score and recall. In evaluated results, we have to also find the best algorithm.

Transmission of values and religious concepts to children is one of the most important issues in the third millennium and it has drawn varied and different views among experts and scholars in the world. Research specialized in religious literature for children and adolescents create new capacities in the presentation of religious concepts to the group. Plans have been considered to transfer values and religious concepts in the curricula of primary school children in the group in Iran. It is one of the topics that the authors note to the introduction of the minutiae of religion in the first three elementary grades. In this study, the collection and analysis methods providing content related to the minutiae of religion in reading books the first till third sections of the years 2013-2015. In addition, the plan includes aspects of other branches of religion in these books on information collected from text books that collected and classified. The result is that "definitely good and forbidding the evil" and "prayer" have the highest frequency of applications in the selected books. Further branches made of branches of religion in these books, represents the values of religious, moral and social as well.

Recent state-of-the-art scene text recognition methods have primarily focused on horizontal text in images. However, in several Asian countries, including China, large amounts of text in signs, books, and TV commercials are vertically directed. Because the horizontal and vertical texts exhibit different characteristics, developing an algorithm that can simultaneously recognize both types of text in real environments is necessary. To address this problem, we adopted the direction encoding mask (DEM) and selective attention network (SAN) methods based on supervised learning. DEM contains directional information to compensate in cases that lack text direction; therefore, our network is trained using this information to handle the vertical text. The SAN method is designed to work individually for both types of text. To train the network to recognize both types of text and to evaluate the effectiveness of the designed model, we prepared a new synthetic vertical text dataset and collected an actual vertical text dataset (VTD142) from the Web. Using these datasets, we proved that our proposed model can accurately recognize both vertical and horizontal text and can achieve state-of-the-art results in experiments using benchmark datasets, including the street view test (SVT), IIIT-5k, and ICDAR. Although our model is relatively simple as compared to its predecessors, it maintains the accuracy and is trained in an end-to-end manner.

In dementia, particularly Alzheimer's Disease (AD), communication challenges are evident, especially in vocabulary and pragmatic aspects. Affected individuals often use vague, non-specific words, and their speech lacks informative nouns and verbs, leading to imprecise communication. However, aspects like sentence structure, phonology, and articulation are believed to remain intact until later stages, though this view is debated in the research community. The rise of Large Language Models (LLMs) has made significant strides in various domains, including sentiment analysis and question-answering. These advancements have been applied to dementia research, with studies using LLMs to analyze textual data. Some research incorporates pauses in text to enhance performance, while others utilize transfer learning techniques. However, limited datasets for dementia detection pose challenges in training LLMs. Our research presents a novel approach to measuring the impact of in-text encoding strategies by embedding special characters within the text to enhance model performance and incorporating sequences and summaries of their frequency. Our best model achieves 0.88 and 0.86 in f1-score and accuracy, respectively, whereas the baseline has 0.42 and 0.56 in f1-score and accuracy.

Large Language Models (LLMs) have proved significant proficiency when comes to code generation especially in Structured Query Language (SQL) for databases and recent successful Text-to-SQL method involves fine-tuning pre-trained LLMs for SQL generation tasks. Transforming natural language text into SQL queries, has been attempted to solve with various learning techniques including Few-shot learning[1], fine tuning. In this paper we propose Supervised fine-tuning (SFT) as a better alternative for learning technique for text-to-SQL generation task using Code-Llama that pushes state of art accuracy on spider test suite to 89.6% on dev set which represent first instance of surpassing the earlier best-in-class with 5.5% higher score and 86.8% of exact match accuracy on dev set. Furthermore, we demonstrate that properly prompted LLM along with SFT provides far fewer hallucinations and much more robust LLM that can be used as a general tool for any text-to-SQL generation use case.

Now when the whole world is still under COVID-19 pandemic, many schools have transferred the teaching from physical classroom to online platforms. It is highly important for schools and online learning platforms to investigate the feedback to get valuable insights about online teaching process so that both platforms and teachers are able to learn which aspect they can improve to achieve better teaching performance. But handling reviews expressed by students would be a pretty laborious work if they were handled manually as well as it is unrealistic to handle large-scale feedback from e-learning platform. In order to address this problem, both machine learning algorithms and deep learning models are used in recent research to automatically process students' review getting the opinion, sentiment and attitudes expressed by the students. Such studies may play a crucial role in improving various interactive online learning platforms by incorporating automatic analysis of feedback. Therefore, we conduct an overview study of sentiment analysis in educational field presented in recent research, to help people grasp an overall understanding of the sentiment analysis research. Besides, according to the literature review, we identify three future directions that researchers can focus on in automatically feedback processing: high-level entity extraction, multi-lingual sentiment analysis, and handling of figurative language.

The fact is quite transparent that almost everybody around the world is using android apps. Half of the population of this planet is associated with messaging, social media, gaming, and browsers. This online marketplace provides free and paid access to users. On the Google Play store, users are encouraged to download countless of applications belonging to predefined categories. In this research paper, we have scrapped thousands of users reviews and app ratings. We have scrapped 148 apps’ reviews from 14 categories. We have collected 506259 reviews from Google play store and subsequently checked the semantics of reviews about some applications form users to determine whether reviews are positive, negative, or neutral. We have evaluated the results by using different machine learning algorithms like Naïve Bayes, Random Forest, and Logistic Regression algorithm. we have calculated Term Frequency (TF) and Inverse Document Frequency (IDF) with different parameters like accuracy, precision, recall, and F1 and compared the statistical result of these algorithms. We have visualized these statistical results in the form of a bar chart. In this paper, the analysis of each algorithm is performed one by one, and the results have been compared. Eventually, We've discovered that Logistic Regression is the best algorithm for a review-analysis of all Google play store. We have proved that Logistic Regression gets the speed of precision, accuracy, recall, and F1 in both after preprocessing and data collection of this dataset.

The large quantity of information retrieved from communities, public data repositories, web pages, or data mining can be sparsed and poorly classified. This work shows how to employ unsupervised classification algorithms such as K-means proper to classify user reviews into their closest category, forming a balanced data set. Moreover, we found that the text vectorization technique significantly impacts the clustering formation, comparing TF-IDF and Word2Vec. The value for mapping a cluster with movie genre was 81.34% ± 20.48 of the cases when the TF-IDF was applied, whereas Word2Vec only yielded a 53.51% ± 24.1. In addition, we highlight the impact of the removal of stop-words. Thus, we detected that pre-compiled lists are not the best method to remove stop-words before clustering because there is much ambiguity, centroids are poorly separated, and only 57% of clusters could match a movie genre. Thus, our proposed approach achieved a 94% of accuracy. After analyzing the classifiers’ results, we appreciated a similar effect when divided by the stop-words method removal. Statistically significant changes were observed, especially in precision metric and Jaccard scores in both classifiers, using custom-generated stop lists rather than pre-compiled ones. Reclassifying sparse data is strongly recommended as using custom-generated stop lists.

Background: Antimicrobial Stewardship Programs (ASP) were introduced in healthcare as a public health priority to promote appropriate prescribing of antimicrobials, reduce antimicrobials adverse events as well as control challenges of antimicrobial resistance. To deliver aimed outcome objectives, ASPs involve multiple implementation measures. A review of systematic review was conducted to evaluate ASPs process and outcome measures. Guided by PRISMA frames, published systematic reviews (SR) focusing on ASPs restricted to secondary healthcare were evaluated over the past 10 years by examining major and primary databases involving all age groups. Out of 265 identified SR studies, 63 met inclusion criteria, the majority were conducted in European and North American regions. All age groups were examined in the studies but mainly conducted in adults when compared to children and infants . Both ASPs process and outcomes measures were examined equally and simultaneously through 25 different concepts, dominated by efficacy , antimicrobial resistance , and economic impact while information technology as well as role of pharmacy and behavioural factors were equally examined . The main broad conclusions from the review , that across the globe, ASPs demonstrated effectiveness, proved efficacy, and confirmed efficiency while focused evaluation advocate that developed countries should target medium and small sized hospitals while developing countries should continue rolling ASPs in their healthcare facilities . Additionally , the future of ASPs should focus on embracing evolving information technology to bridge gaps in knowledge, alter attitude and enhance decision making .

In recent years, e-commerce platforms have replaced conventional marketplaces. People are rapidly adopting internet shopping due to the convenience of making purchases from the comfort of their homes. Online review sites allow customers to share their thoughts on products and services. Customers and businesses are increasingly relying on online reviews to assess and improve the quality of products. Existing literature uses Natural language processing (NLP) to analyze customer reviews for different applications. Due to the growing importance of NLP for online customer reviews, this study attempts to provide a taxonomy of NLP applications based on existing literature. This study also examined emerging methods, data sources, and research challenges by reviewing 154 publications from 2013 to 2023 that explore state-of-the-art approaches for diverse applications. Based on existing research, the taxonomy of applications divides literature into five categories: sentiment analysis, review analysis, customer feedback and satisfaction, user profiling, and marketing and reputation management. It is interesting to note that the majority of existing research relies on Amazon user reviews. Additionally, recent research has encouraged the use of advanced techniques like Bidirectional Encoder Representations from Transformers (BERT), Long Short-Term Memory (LSTM), and ensemble classifiers. The rising number of articles published each year indicates increasing interest of researchers and continued growth. This survey additionally addresses open issues, providing future directions in online customer review analysis.

(1) Background: Existing research has demonstrated the potential of mHealth apps in improving the caregiving outcomes of stroke. Since several apps were published in commercially available app stores without explaining their design and evaluation processes, it is necessary to identify the usability and user experience issues to promote long-term adherence and usage; (2) Methods: User reviews were extracted from the 47 previously identified apps that support stroke caregiving needs using a python-scraper. The reviews were pre-processed and filtered using python scripts. The final corpus was classified based on usability and user experience dimensions to highlight issues within the app; (3) Results: A total of 162,095 were extracted from the two app stores. After filtration, 15,818 reviews were included and classified based on the usability and user experience dimensions. Findings highlight critical issues related to the errors/effectiveness, efficiency and support that contribute to decreased satisfaction, emotion and frustration in using the app; (4) Conclusion: The study identified several usability and user experience issues due to the inability of the app developers to understand the needs of the user. Further, the study describes the inclusion of a participatory design approach to promote an improved understanding of user needs; therefore, limiting any issues and ensuring continued use.

Background: Many randomized controlled trials (RCTs) and systematic reviews (SRs) on acupuncture treatment for post-acute stroke dysphagia have been published. Due to conflicting results an overview of SRs to summarize and assess the quality of this evidence to determine whether acupuncture is effective for this disease was conducted. Methods: Seven databases were searched for SRs and/or Meta-analysis of RCTs and quasi-RCTs on acupuncture for post-acute stroke dysphagia. Two authors independently identified SRs and meta-analyses, collected data to assess the quality of included SRs and meta analyses according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) and the revised Assessment of Multiple Systematic Reviews (AMSTAR 2). Results: 31 SRs were identified. Quality of 22 SRs was critically low, 5 SRs were low, and 4 Cochrane SRs were moderate when evaluated by AMSTAR2. 17 SRs reported 85.2-96.3% items of PRISMA. Five SRs included explanatory RCTs, 16 SRs included pragmatic RCTs, and 10 SRs included both. Conclusion: Currently evidence on the effectiveness of acupuncture on post-acute stroke dysphagia is low quality. Type of study appeared to have no direct influence on the result, but the primary outcome measures showed a relationship with the quality of SRs. High quality trials with large sample sizes should be the focus of future research. PROSPERO REGISTRATION NUMBER: CRD42019134163

YouTube is a very popular social media platform in today’s digital landscape. The primary focus of this study is to explore the underlying sentiment in user comments on food-related videos on YouTube, specifically within two pivotal food product categories: Plant-Based and Hedonic. Our research involved labelling comments using sentiment lexicons such as TextBlob and VADER. Furthermore, the sentiments of the comments were classified using advanced Machine Learning (ML) algorithms, namely Support Vector Machine (SVM), Multinomial Naive Bayes, Random Forest, Logistic Regression, and XGBoost. The evaluation of these models encompassed key macro average metrics, including accuracy, precision, recall, and f1-score. Results from VADER showcased a high accuracy level, with SVM achieving 93% accuracy in the plant-based dataset and 96% in the hedonic dataset. In addition to sentiment analysis, we delved into user interactions within the two datasets, measuring crucial metrics such as views, likes, comments, and engagement rate. The findings illuminate significantly higher levels of views, likes, and comments in the hedonic food dataset, but the plant-based dataset maintains a superior overall engagement rate.

Conventional text style transfer (TST) methodologies primarily utilize style classifiers to segregate the content and stylistic elements of text for effective style transformation. Despite the pivotal role of these classifiers, their influence on TST techniques remains largely unexplored. This study embarks on a detailed exploration of the limitations inherent in style classifiers within current TST frameworks. We reveal that these classifiers often inadequately comprehend sentence syntax, leading to diminished performance in TST models. In response, we introduce the Syntax-Enhanced Style Transfer (SEST) model, a groundbreaking approach incorporating a syntax-sensitive style classifier. This classifier ensures that the extracted style representations robustly encapsulate syntax nuances, enhancing TST effectiveness. Rigorous evaluations across diverse TST benchmarks demonstrate that SEST significantly surpasses contemporary models in performance. Additionally, our case studies highlight SEST's proficiency in producing syntactically coherent sentences that aptly retain original content.

Embedding representation models characterize each word as a vector of numbers with a fixed length. These models have been used in tasks involving text classification, such as recommen- dation and question-answer systems. Semantic relationships are words with a relationship between them providing a complete idea to a text. Therefore, it is hypothesized that an embedding model involving semantic relationships will provide better performance for tasks that use them. This paper presents three embedding models based on semantic relations extracted fromWikipedia to classify texts. The synonym, hyponym, and hyperonym semantic relationships were the ones considered in this work since previous experiments have shown that they are the ones that provide the most semantic knowledge. Lexical-syntactic patterns present in the literature were implemented and subsequently applied to the Wikipedia corpus to obtain the semantic relationships present in it. Several semantic relationships are used in different models: synonymy, hyponym-hyperonym, and a combination of the first two. A convolutional neural network was trained for text classification to evaluate the performance of each model. The results obtained were evaluated with the metrics of precision, accuracy, recall, and F1-measure. The best values obtained with the second model were accuracy of 0.79 for the 20-Newsgroup corpus. F1-measure and recall of 0.87 respectively for the Reuters corpus.

This overview study set out to compare and synthesise the findings of review studies conducted on predicting student academic performance (SAP) in higher education using educational data mining (EDM) methods, EDM algorithms and EDM tools from 2013 to June 2020. It conducted multiple searches for suitable and relevant peer-reviewed articles on two online search engines, on nine online databases, and on two online academic social networks. It, then, selected 26 eligible articles from 2,050 articles. Some of the findings of this overview study are worth mentioning. First, only 2 studies explicitly stated their precise sample sizes with maths and science as the two most mentioned subject areas. Second, 16 review studies had purposes related to either EDM techniques, EDM methods, EDM models, or EDM algorithms employed to predict SAP and student success in the higher education sector. Third, there are six commonly used typologies of input variables reported by 26 review studies, of which student demographics was the most commonly utilised variable for predicting SAP. Fourth and last, seven common EDM algorithms employed for predicting SAP were identified, of which Decision Tree emerged both as the most used algorithm and as the algorithm with the highest prediction accuracy rate for predicting SAP.

Only languages with abundant resources are given the opportunity to build speech recognition systems, whereas low resource languages are disregarded. This project attempts to create a system that can normally convert speech to text in the Myanmar (Burmese) language, a language part of low resource languages. The Burmese language is extremely intricate and is made up of vowels, consonants, tones, and stress. There are 10 numbers, 12 vowels, and 33 letters in the Myanmar alphabet. Deep learning allows for the evolution of numerous algorithms while eradicating ignorance and even low-resource languages may be turned into speech-to-text systems with a small quantity of data. The procedures required to construct a successful speech recognition system that can assist both the corporate sector and society will be covered in this project, including data collecting, preprocessing, modeling, prototyping, assessment, and ultimately deployment.

The herd effect is a common phenomenon in social society. The detection of this phenomenon is of great significance in many tasks based on social network analysis such as recommendation. However, the research on social network and natural language processing seldom focuses on this issue. In this paper, we propose an unsupervised data mining method to detect herding in social networks. Taking shopping review as an example, our algorithm can identify other reviews which are affected by some previous reviews and detect a herd effect chain. From the overall perspective, the cross effects of all views form the herd effect graph. This algorithm can be widely used in various social network analysis methods through graph structure, which provides new useful features for many tasks.

The growth rate in academic and scientific publications increased very fast. Researchers must choose a good representative and significant literature in publications, which has become challenging worldwide. Usually, the paper citation number indicates this paper's potential influence and importance. However, this standard metric of citation numbers cannot be used as a measurement to judge the popularity and significance of the recently published papers. To address this challenge, this paper presents an effective prediction method called FutureCite to predict the future citation level of research articles. FutureCite combines machine learning with text and graph mining techniques, leveraging their abilities in classification, datasets in-depth analysis, and feature extraction. FutureCite aims to predict future citation levels of research articles applying a multilabel classification approach. FutureCite can extract significant semantic features and capture the interconnection relationships found in scientific articles during feature extraction using textual content, citation networks, and metadata as feature resources. Our goal is to contribute to the advancement of substantial effective approaches impacting the citation counts in scientific publications by enhancing the precision of future citations. We conducted several experiments using a comprehensive publication dataset to evaluate our method and determine the impact of using a variety of machine learning algorithms. FutureCite demonstrated its robustness and efficiency and showed promising results based on different evaluation metrics. Using the FutureCite model has significant implications in improving the researchers' ability to determine targeted literature for their research and better understand the potential impact of research publications.

Text-based CAPTCHA remains the most widely adopted security scheme, which is the first barrier to securing websites. Deep learning methods, especially Convolutional Neural Networks (CNNs) are the mainstream approach for text-CAPTCHA recognition, which are widely used in CAPTCHA vulnerability assessment and data collection. However, verification code recognizers are mostly deployed on the CPU platform as part of a web crawler and security assessment, they are required to have both low complexity and high recognition accuracy. Due to the specifically designed anti-attack mechanisms like noise, interference, geometric deformation, twisting, rotation, and character adhesion in text CAPTCHAs, some characters are difficult to efficiently identify with high accuracy in these complex CAPTCHA images. This paper proposed a recognition model named Adaptive-CAPTCHA with a CRNN module and trainable and configurable filtering networks, which effectively handle the interference and learn the correlation between characters in CAPTCHAs to enhance recognition accuracy. Experimental results on two datasets of different complexity show that compared with the baseline model Deep-CAPTCHA, the number of parameters of our proposed model is reduced by about 70% and the recognition accuracy is improved by more than 10 percentage points in the two datasets. In addition, the proposed model has a faster training convergence speed.

Topic discovery is finding the main idea of large amounts of textual data. It indicates the recurring topics in the documents, allowing an overview of the texts. Current topic discovery models receive the texts, with or without pre-processing of Natural Language Processing. The processing consists of stopwords removal, text cleaning and normalization (lowercase conversion). A topic discovery model that receives texts with or without processing generates general topics since the input data is many uncategorized texts. The general topics do not offer a detailed overview of the input texts, and manual text categorization is a time-consuming and tedious task. Accordingly, it is necessary to integrate an automatic text classification task in the topic discovery process to obtain specific topics with their top words that contain relevant relationships based on belonging to a class. Text classification performs a word analysis that makes up a document to decide what class or category is being identified; then, integrating the text classification before a topic discovery process will provide latent topics depicted by top words with a high coherence in each topic based on the previously obtained classes. Therefore, this paper exposes a approach that integrates text classification into topic discovery from large amounts of English textual data, such as 20-Newsgroup and Reuters corpora. The text classification is accomplished with a Convolutional Neural Network(CNN) incorporating three embedding models based on semantic relationships. The topic discovery over categorized texts is realized with Latent Dirichlet Analysis(LDA), Probabilistic Latent Semantic Analysis(PLSA), and Latent Semantic Analysis(LSA) algorithms. An evaluation process was performed based on the normalized topic coherence metric. The 20-Newsgroup corpus was classified, and twenty topics with ten top words were discovered for each class, obtaining 0.1723 normalized topic coherence when applying LDA, 0.1622 with LSA, and 0.1716 with PLSA. The Reuters corpus was also classified, obtaining 0.1441 normalized topic coherence when applying the LDA algorithm to obtain 20 topics for each class.

Long unpunctuated texts containing complex linguistic sentences are a stumbling block to processing any low-resource languages. Thus, approaches that attempt to segment lengthy texts with no proper punctuation into simple candidate sentences are a vitally important preprocessing task in many hard-to-solve NLP applications. In this paper, we propose (PDTS) a punctuation detection approach for segmenting Arabic text, built on top of a multilingual BERT-based model and some generic linguistic rules. Furthermore, we showcase how PDTS can be effectively employed as a text tokenizer for unpunctuated documents (i.e., mimicking the transcribed audio-to-text documents). Experimental findings across two evaluation protocols (involving an ablation study and a human-based judgment) demonstrate that PDTS is practically effective in both performance quality and computational cost.

Identifying or authenticating a computer user are necessary steps to keep systems secure on the network and to prevent fraudulent users from accessing accounts. Keystroke dynamics authentication can be used as an additional authentication method. Keystroke dynamics involves in-depth analysis of how you type on the keyboard, analysis of how long a key is pressed or the time between two consecutive keys. This field has seen a continuous growth in scientific research. In the last five years alone, about 10,000 scientific researches in this field have been published. One of the main problems facing researchers is the small number of public data sets that include how users type on the keyboard. This paper aims to provide researchers with a data set that includes how to type free text on the keyboard by 80 users. The data were collected in a single session via a web platform. The dataset contains 410,633 key-events collected in a total time interval of almost 24 hours. In similar research, most datasets are with texts written by users in English. The language in which the users wrote for this research is Romanian. This paper also provides an extensive analysis of the data set collected and presents relevant information for the analysis of the data set in future research.

This article presents a dataset of tweets in the Urdu language. There are 1,140,824 tweets in the dataset, collected from Twitter for September and October 2020. This large-scale corpus of tweets is generated by performing pre-processing which includes removing columns containing user information, retweet’s count, followers information, duplicate tweets, removing unnecessary punctuation, links, symbols, and spaces, and finally extracting emojis if present in the tweet text. In the final dataset each tweet record contains columns for tweet id, text, and emoji extracted from the text with a sentiment score. Emojis are extracted to validate Machine Learning models used for the multilingual sentiment and behavior analysis. These are extracted using a Python script that searches for an emoji from the list of 751 most frequently used emojis. If an emoji is present in the text, a column with the emoji description and sentiment score is added.

In this paper, we provide a study on the effects of applying classical clustering algorithms, such as k-Means to free text recommender systems. A typical recommender system may face problems when the number of items from a database goes from a few items to hundreds of items. Currently, one of the most prominent techniques to scale the database is applying clustering, however clustering may have a negative impact on the accuracy of the system when applied without taking into consideration the underlying items. In this work, we build a conceptual text recommender system and use k-Means to partition its search space into different groups. We study how the variation of the number of clusters affects its performance in the light of two performance measurements: recommendation time and precision. We also analyze if this clustering is affected by the representation of text we use. All the techniques used in this study uses word-embeddings to represent the document. One of the main findings of this work is that using clustering we can improve the recommendation time in up to almost 30 times without affecting much off its initial accuracy. Another interesting finding is that the increment of the number of clusters is not directly translated into linear performance.

Objective: to create a set of eligibility criteria for the use of MHT in non-gynecological cancer patients. Methods: We searched all articles published in peer-reviewed journals up to March 2021. The PICOS standards were used and the selection criteria as follows: menopausal women of any age with non-gynecological and non-breast cancer receiving HMT, any MHT preparation (oestrogens alone or combined with a progestogen, tibolone or tissue selective oestrogen complex) or any route of administration (oral, transdermal, vaginal or intra-nasal), recurrence and mortality, randomized controlled trials, and related extension studies or follow-up reports. Results: Women colorectal cancer survivors who use MHT have a lower risk of death from any cause than those survivors who do not use MHT. Women Skin Melanoma Survivors Using MHT Have Longer Survival than Non-MHT Survivors. There is no evidence that women lung cancer survivors who use MHT have a different survival rates than those survivors who do not use MHT. Conclusion: MHT is safe in women who have suffered from colorectal, lung or skin melanoma cancers The study was registered at www.prospero.org (CRD42020166658)

(1) Workplace nutrition interventions have garnered attention as a pivotal component of employee well-being and organizational productivity. However, the effectiveness of various intervention types remains inconclusive. This review aims to systematically evaluate the efficacy of cognitive, behavioral, and mixed nutrition interventions in the workplace, considering the nuances of intervention design, setting, and target demographics. (2) A comprehensive umbrella review was conducted, categorizing existing literature into person-oriented and environmental strategies. This review was prepared in line with the Joanna Briggs Institute methodology for umbrella reviews and the preferred reporting items for systematic reviews and meta-analyses reporting standard. (3) The analysis revealed a lack of definitive evidence supporting the universal effectiveness of any single intervention type. Nonetheless, behavioral and mixed interventions demonstrated more favorable outcomes compared to purely cognitive strategies. Factors such as intervention design, workplace setting, and target group characteristics were identified as significant determinants of intervention success. (4) The review emphasizes the imperative for additional investigations that utilize evidence-based approaches to formulate sound guidelines for efficacious nutrition interventions in occupational settings. This review functions as a foundational framework for guiding both scholarly research and the pragmatic execution of nutrition programs in the workplace.

We have previously reported on the diachronical changes in the narrative structure of research articles (RAs) and review manuscripts, using corpora of abstracts from MEDLINE. The present study investigates 5 linguistic dimensions (D1-5) of the text, following Biber’s well established Multimensional Analysis, on the same corpora, to assess how writing practices have changed in these two biomedical literature sub-genres over the years. Our analysis encompassed a sample of more than 1.2 million subtracts from manuscripts that were published over the course of more than 30 years. Both RAs and reviews have reinforced their informational, emotionally detached tone (D1), and have progressively refrained from the use of narrative devices (D2), while increasing their context-independent content (D3). Both RAs and reviews have displayed low levels of overt persuasion (D4), while steering away from abstract content to focus on a more marked author agency and identity adfirmation. When the linguistic features that underly these 5 dimensions are compared, it becomes apparent that RAs and review papers have often changed quite independently, both usually converging to standardized stylistic canons.

To keep its business reliable, Google is concerned to ensure quality of apps on the store. One crucial aspect concerning quality is security. Security is achieved through Google Play protect and anti-malware solutions. However, they are not totally efficient since they rely on application features and application execution threads. Google provides additional elements to enable consumers to collectively evaluate applications providing their experiences via reviews or showing their satisfaction through rating. The latter is more informal and hides details of rating whereas the former is textually expressive but requires further processing to understand opinions behind. Literature lacks approaches which mine reviews through sentiment analysis to extract useful information to improve security aspects of provided applications. This work goes in this direction and in a fine-grained way, investigates in terms of confidentiality, integrity, availability and authentication (CIAA). While assuming that reviews are reliable and not fake, the proposed approach determines review polarities based on CIAA-related keywords. We rely on the popular classifier Naive Bayes to classify reviews into positive, negative and neutral sentiment. We then provide an aggregation model to fusion different polarities to obtain application global and CIAA reputations. Quantitative experiments have been conducted on 13 applications including e-banking, live messaging and anti-malware apps with a total of 1050 security-related reviews and 7.835.322 functionality-related reviews. Results show that 23% of applications (03 apps) have a reputation greater than 0.5 with an accent on integrity, authentication and availability, while the remaining 77% has a polarity under 0.5. Developers should make lot of efforts in security while developing codes and that more efforts should be made to improve confidentiality reputation. Results also show that applications with good functionality-related reputation generally offer bad security-related reputation. This situation means that even if the number of security reviews is low, it does not mean that security aspect is not a consumer preoccupation. Unlike, developers put much more time to test whether applications works without errors even if they include possible security vulnerabilities. A quantitative comparison against well-known rating systems reveals effectiveness and robustness of CIAA-RepDroid to repute apps in terms of security. CIAA-RepDroid can be associated to existing rating solutions to recommend developers exact CIAA aspects to improve within source codes.

This study investigates the effects of ambient illumination and negatively polarized text color on visual fatigue, exploring the issue of visual fatigue when using visual display terminals in low-illumination environments. The research methodology utilized an experimental design to collect data on changes in pupil accommodation and blink rate through an eye tracker. Partici-pants completed a reading task while exposed to various text colors and ambient light conditions to evaluate visual fatigue and cognitive performance. The study's findings suggest that text color significantly affects visual fatigue, with red text causing the highest level of visual fatigue and yellow text causing the lowest level of visual fatigue. Improvements in ambient lighting reduce visual fatigue, but the degree of improvement varies depending on the text color. Additionally, cognitive performance is better when using yellow and white text but worse when using red text. Yellow text is the most effective choice for reducing visual fatigue under negative polarity. In-creasing ambient lighting can also improve visual fatigue in low-illumination conditions. These findings will offer valuable guidance for designing visual terminal device interfaces, especially for low-illumination or night environments, to minimize visual fatigue and improve the user ex-perience.

The purpose of this study is to ​​explore the use of a custom Transformer model in brain-computer interfaces (BCIs) that translate the neural activity present when an individual with limited verbal and fine-motor skills attempts to handwrite. As found in previous studies, Transformers have performed better than recurrent neural networks (RNNs) in translation tasks which are similar to its usage here in decoding neural signals into intended handwritten text. Due to the known benefits of a Transformer, the hypothesis was that the Transformer would show promise in the context of a BCI through the recorded metrics. The neural signals of a tetraplegic individual, when they attempted to handwrite, were provided by existing research. Four trials were conducted using data with or without augmentation which the model used when training to separately minimize training loss and validation loss. When comparing the results of a BCI with the implementation of a Transformer model with the original RNN BCI (the original data source), the Transformer model performed less favorably across all four trials. Although the results do not indicate that the Transformer model currently outperforms an RNN BCI, it is important to note that further testing of the model's capabilities (such as training it with a larger and more preferable dataset and/or for longer, comparing training times between the RNN and Transformer, and/or seeing how the Transformer is improved with an offline autocorrect feature) is necessary before determining whether Transformers can enhance communication in this manner.

This paper considers the reasonability of using GSDMM as a method for clustering short texts - titles and abstracts of publications 2021-2023 of MDPI journals on sustainable energy topics. The paper proposes an approach to identifying relevant research topics based on the use of the Python script Yake!, the Krovetz streamer, the GSDMM algorithm, and short text annotations. It is emphasized that researchers prefer to rely on specific publications rather than keywords when searching for information on a topic of interest. The bibliometric records of sustainable energy publications from 2021 to 2023 in Sustainability (Energy Sustainability section — 1,926 search results) and Energies (Sustainable Energy section — 994 search results) were used as data for analysis. The GSDMM algorithm was used to cluster the texts, and Yake! to extract the keywords for the GSDMM algorithm's vocabulary. This article summarizes topics found in 9 clusters, including general sustainable energy issues, biomass recycling, region-specific issues, building energy use, economic growth and investment, numerical flow modeling, generation cost optimization, heat to energy conversion, weather-related risks, and false data attacks.

(1) Background: Burnout syndrome results from chronic stress in the work-place. The COVID-19 pandemic has imposed a heavy workload on health professionals, doctors and nurses to respond to first-line health care during the first two years of an emergency caused by this virus. The aim of this study was to evaluate the prevalence of burnout in healthcare personnel, doctors and nurses during the COVID-19 pandemic. (2) Methods: This was a review of reviews on the prevalence of professional burnout syndrome in healthcare personnel, doctors and nurses before or during the COVID-19 pandemic, without language restrictions or missing data from the Cochrane Library electronic databases. In total, 48,657 articles were obtained from Pub-Med/MEDLINE and the Web of Science. (3) Results: After completing the examination, 20 articles were included in the review. Of these articles, 7% included nurses in their study population, 72% interviewed doctors from different specialties, and the remaining 21% reported personnel data. Healthcare as a whole: In total, 624 articles with 233,087 participants were included. Regarding the prevalence by subscale, a PD of 33% (95% CI; 33%- 34%), an AE of 37% (95% CI; 37%- 37%) and a PR of 29% (95% CI) were found. %; 29% and 29%). ; (4) Conclusions: The incidences of DP and AE are high, and that of RP is low. These findings demonstrate the high prevalence of burnout according to subscale. Burnout is a problem of great magnitude, and as such, interventions must be implemented immediately at the individual and group levels by institutions and health systems.

In recent years, online review system attracts attention to assess seller-customer relations in the world of e-commerce. To address the quality concern of online review, especially incentivized ones, this study evaluates credibility and consistency based on reviews’ volume, length, and content to distinguish the impact of incentives on customer review behavior, improving review quality, and purchase decision-making. Software product reviews collected from software review websites, including Capterra, Software Advice, and GetApp undergo Exploratory Data Analysis (EDA) to reveal critical features such as cost, support, usability, and product features. The indirect impact of companies’ size, direct impact of users’ experience, and different impacts of changing situations during years on the incentive reviews’ volume are major findings of sentiment analysis. A/B testing results show a minimal to no impact of such reviews on purchasing decisions, highlighting discrepancies in credibility and consistency in volume, length, and content. Employing advanced techniques like Sentence-BERT (SBERT) and TF-IDF, the study explores semantic differences in reviews to improve recommendation systems for a more customized shopping experience. This approach seeks to establish a framework that discerns between review types and their effect on customer behavior. The findings contribute to developing more sophisticated and consistent e-commerce solutions, emphasizing the importance of authentic and reliable online reviews in influencing consumer choices.

Nowadays, an analysis of virtual media to predict society’s reaction to any events or processes is a task of great relevance. Especially it concerns meaningful information on healthcare problems. Internet sources contain a large amount of pharmacologically meaningful information useful for pharmacovigilance purposes and repurposing drug use. An analysis of such a scale of information demands developing the methods that require the creation of a corpus with labeled relations among entities. Before, there have been no such Russian language datasets. This paper considers the first Russian language dataset where labeled entity pairs are divided into multiple contexts within a single text (by used drugs, by different users, by the cases of use, etc.), and a method based on the XLM-RoBERTa language model, previously trained on medical texts to evaluate the state-of-the-art accuracy for the task of indication of the four types of relationships among entities: ADR–Drugname, Drugname–Diseasename, Drugname–SourceInfoDrug, Diseasename–Indication. As shown based on the presented dataset from the Russian Drug Review Corpus, the developed method achieves the F1-score of 81.2% (obtained using cross-validation and averaged for the four types of relationships), which is 7.8% higher than the basic classifiers.

In the realm of the five-category classification endeavor, there has been limited exploration into applied techniques for classifying Arabic text. These methods have primarily leaned on singletask learning, incorporating manually crafted features that lack robust sentence representations. Recently, the Transformer paradigm has emerged as a highly promising alternative. However, when these models are trained using single-task learning, they often face challenges in achieving outstanding performance and generating robust latent feature representations, especially when dealing with small datasets. This issue is particularly pronounced in the context of the Arabic dialect, which has a scarcity of available resources. Given these constraints, this study introduces an innovative approach to dissecting sentiment in Arabic text. This approach combines Inductive Transfer (INT) with the Transformer paradigm to augment the adaptability of the model and refine the representation of sentences. By employing self-attention SE-A and feed-forward sub-layers as a shared Transformer encoder for both the five-category and three-category Arabic text classification tasks, this proposed model adeptly discerns sentiment in Arabic dialect sentences. The empirical findings underscore the commendable performance of the proposed model, as demonstrated in assessments of the Hotel Arabic-Reviews Dataset, the Book Reviews Arabic Dataset, and the LARB dataset.

With the increasing use of cloud-based services for training and deploying machine learning models, data privacy has become a major concern. This is particularly important for natural language processing (NLP) models, which often process sensitive information such as personal communications and confidential documents. In this study, we propose a method for training NLP models on encrypted text data to mitigate data privacy concerns while maintaining similar performance to models trained on non-encrypted data. We demonstrate our method using two different architectures, namely Doc2Vec+XGBoost and Doc2Vec+LSTM, and evaluate the models on the 20 Newsgroups dataset. Our results indicate that both encrypted and non-encrypted models achieve comparable performance, suggesting that our encryption method is effective in preserving data privacy without sacrificing model accuracy. In order to replicate our experiments, we have provided a Colab notebook at the following address: https://t.ly/lR-TP

Recent advances in deep learning technology have led to increased interest in text-to-image technology, which enables computers to create images from text by simulating the human process of forming mental images. The GAN-based text-to-image technology involves the extraction of features from input text, which are combined with noise and then used as input to a GAN that generates images that are similar to the original images through competition between the generator and discriminator. Although generating images from English text is a mature area of research, text-to-image technology based on multilingualism, such as Korean, is still in its early stages of development. Webtoon is a digital comic format that allows comics to be viewed online. The creation process for webtoons is divided into story planning, content/sketching, coloring, and background drawing. Since each stage of webtoon production requires human intervention, it is both time-consuming and expensive. As a result, deep learning technologies such as automatic coloring and automatic line drawing are being used to reduce human involvement. However, there is a shortage of technology that can assist authors with story creation in webtoon production. Therefore, this study proposes a multilingual text-to-image model capable of generating webtoon images when presented with multilingual input text. The proposed model employs Multilingual BERT to extract feature vectors for multiple languages, and trains a DCGAN in conjunction with the images. The experimental results demonstrate that the model can generate images that are similar to the original images when presented with multilingual input text after training.

Plagiarism means taking another person’s work and not giving any credit to them for it. Plagiarism is one of the most serious problems in academia and among researchers. Even though there are multiple tools available to detect plagiarism in a document but most of them are domain-specific and designed to work in English texts, but plagiarism is not limited to a single language only. Bengali is the most widely spoken language of Bangladesh and the second most spoken language in India with 300 million native speakers and 37 million second-language speakers. Plagiarism detection requires a large corpus for comparison. Bengali Literature has a history of 1300 years. Hence most Bengali Literature books are not yet digitalized properly. As there was no such corpus present for our purpose so we have collected Bengali Literature books from the National Digital Library of India and with a comprehensive methodology extracted texts from it and constructed our corpus. Our experimental results find out average accuracy between 72.10 % - 79.89 % in text extraction using OCR. Levenshtein Distance algorithm is used for determining Plagiarism. We have built a web application for end-user and successfully tested it for Plagiarism detection in Bengali texts. In future, we aim to construct a corpus with more books for more accurate detection.

Simple measures often couldn’t count a deep complexity. In the case of semantic complexity, conventional readability formulas share a common style, a common sort of achievements and a common borders of limitation: These formulas lack a semantics-aware approach and as a result, a precise measurement of semantic complexity couldn’t be done. In this paper, we introduce DASTEX, a novel semantics-aware complexity measure for semantic complexity of text. By DASTEX, a new layer of complexity analysis are opened for NLP, cognitive and computational tasks. This measure benefits from an intuitionistic underlying formal model which consider semantic as a lattice of intuitions. This yields to a well-defined definition for semantic of a text and its complexity. DASTEX is a practical analysis method upon this formal model. So a complete suite of idea, model and method are prepared to result in a simple but yet deep measure for semantic complexity of text. The evaluation of the proposed approach is done by 4 Experiments. The results show DASTEX is capable of measuring the semantic complexity of text in 6 application-tasks.

Statistics modules are included in most university degrees, independent of the degree area. They have an important role in preparing students for the real world. The overall goal of this paper is to identify the common statistical issues students face during the transition from secondary education to tertiary education. Drawing upon data from the University College Dublin (UCD) Math Support Center (MSC) and Universidad Rey Juan Carlos (URJC), our approach aims to optimize learning experiences while advancing sustainability objectives. In this paper, we conducted a categorization of statistical concepts taught in university (based on URJC). Using this categorization, UCD MSC tutor comments were categorized and validated, and subsequently descriptive analyses and text mining were used on the UCD MSC comments to achieve a deeper understanding of the statistical issues. Building on this study, we plan to develop a suite of evidence-based sustainable educational applications and games to support undergraduate students internationally in first-and second-year statistical modules. Our findings on students’ main statistical issues contribute to the cultivation of lasting statistical literacy among students. This research advances the sustainability agenda within statistical education.

Subway construction is often in a complex natural and human-machine operating environment, and that complicated setting leads to subway construction more prone to safety accidents, which can cause substantial casualties and monetary losses. Thus, it is necessary to investigate the safety risks of subway construction. The existing literature on the identification and assessment of subway construction safety risks(SCSR) is susceptible to the influence of subjective factors. Moreover, although existing studies have explored the interrelationships between different risks, these studies usually analyze the interrelationships of single risks, lack the study of risk chain transfer relationships, and fail to find out the key path of risk transfer. Therefore, this paper innovatively combines text mining, association rules and complex networks to deep mine subway construction safety incident reports and explore risk transfer process. Firstly, it uses text mining technology to identify subway construction safety risk; Then, association rules are introduced to explore the causal relationships among safety risk; Finally, the key safety risk and important transfer paths of subway construction safety accidents (SCSA) are obtained based on the complex network model. Research results show that (a) improper safety management, unimplemented safety subject responsibilities, violation of operation rules, non-perfect safety responsibilities system and insufficient safety education and training are the key safety risk in SCSA; (b) two shorter key risk transfer paths in the subway construction safety network can be obtained: insufficient safety education and training→lower safety awareness→violation of operation rules→safety accidents; insufficient safety checks or hidden trouble investigations→violation of operation rules→safety accidents; (c) in the process of risk transfer, the risk can be controlled by controlling the key nodes or cutting off the transfer path. The results of the study provide new ideas and methods for SCSR identification and influence element mining, which help safety managers propose accurate subway construction safety risk control measures.

Retweet prediction is an important task related to different problems such as information spreading analysis, the automatic detection of fake news, social media monitoring, etc. In this study we explore the possibilities of retweet prediction based on heterogeneous data sources. In order to classify the tweet according to the amount of retweets, we combine features extracted from the multilayer network and the text. More specifically, we introduce a multilayer framework that proposes the multilayer network representation of Twitter. This formalism captures different users' actions and complex relationships as well as other key properties of communication on Twitter. We select a set of local network measures from each layer and construct a set of multilayer network features. In addition, we adopt a BERT-based language model, namely Cro-CoV-cseBERT to capture high-level semantics and structure of tweets as a set of text features. Then, we train six machine learning (ML) algorithms: random forest, multilayer perceptron, light gradient boosting machine, category embedding model, neural oblivious decision ensembles and attentive interpretable tabular learning model in the task of retweet prediction. We compare the performance of all six algorithms in three different setups (i) using only text features, (ii) using only multilayer network features and (iii) using both sets of features. We evaluate all setups in terms of standard evaluation measures i.e. precision, recall, F1-score and accuracy. For this task, we first prepare and use an empirical dataset of 199,431 tweets in the Croatian language posted during the period between January 1, 2020 and May 31, 2021. Our results indicate that by integrating multilayer network features with text features the prediction model would perform better than using just one set of features.

The number of long-term cancer survivors increases continually. Understanding their needs is crucial to ensure an adequate follow-up. The aim of our study was to summarize the current literature concerning needs and what in-fluences these needs. A Scoping review of systematic reviews was conducted according to the recommendations of the Joanna Briggs Institute (JBI). Four electronic databases were searched. Of 414 retrieved papers, 11 met the eligi-bility criteria. Needs were aggregated into six domains (health-related information, health system, mental, practical, relationship and physical) and 15 categories. The lack of adequate information and the lack of access and/or conti-nuity of supportive care were the most prominent needs. Female gender, younger age, a low level of family and/or social support, and higher educational level were identified as risk factors. Employment and relationship status can affect the needs both in a positive or negative way. The weeks or months after the end of the treatments are partic-ularly critical and needs can be emphasized during this period. Cancer survivors could also leave positive changes. The variety of needs affects the quality of life of cancer survivors. The current Swiss healthcare system is not de-signed to support these people. Needs assessments should be systematically provided to ensure a better awareness on the part of health professionals and to allow an individual, holistic, and integrated follow-up.

Background and Objectives: Previous studies revealed anti-angiogenic, antiproliferative and anti-inflammatory effects of Vitamin D on cancer cells. Although this body of evidence supported the correlation of high Vitamin D levels with reduced incidence rates for various malignancies, contradictory results were reported regarding non-melanoma skin cancer (NMSC). Aim of this overview was to summarize the available evidence from the existing pool of systematic reviews and meta-analyses, focusing on Vitamin D serum status, dietary intake, and Vitamin D receptor (VDR) polymorphisms in correlation to NMSC incidence. Materials and Methods: A literature search in electronic databases was conducted from inception to January 2023. Inclusion criteria were systematic reviews and meta-analyses published in peer-reviewed journals, evaluating Vitamin D serum levels, dietary and/or supplementary intake, or VDR gene polymorphisms, and reporting data on NMSC. Results: A total of 10 studies were included in the data analysis models. A positive association between Vitamin D serum levels and NMSC is highlighted. However, dietary/supplementation of Vitamin D doesn’t exhibit a likewise strong linkage to NMSC. Despite the contradictory findings, VDR polymorphisms may play a crucial role in the intricate NMSC pathogenesis. Conclusions: This umbrella review showed that high Vitamin D levels are associated with increased NMSC incidence, potentially due to its direct correlation with increased sun exposure. Further research on VDR polymorphisms is suggested to explore their true effect size on NMSC risk.

In today's business world, many companies have realized that consumer feedback evaluations play a crucial part in shaping the company's future activities. The hotel and tourism industries are well-known examples where the user feedback has become crucial. Even though most accommodations want their clients to express their opinions about their services, these reviews are nevertheless carefully reviewed by them. This manual approach is time demanding and error prone, the level of expertise of the individual analyzing the evaluations determines the quality of the manual analysis. This research focuses on the development of a tool-based support system that analyzes text-based customer evaluations and then highlights the maintenance issues identified in the reviews, removing the need to manually evaluate and analyze the customer reviews. The process includes data preparation, sentiment analysis, and a fully trained deep learning model to extract critical insights. Using sentiment analysis techniques after data preprocessing and trained deep learning model, an accuracy of 96\% was achieved, and this paper discusses how this technology helps to meet the needs of accommodation management by completing activities efficiently. This might save management time and helps to save money without losing clients, allowing them to enhance their additional sales.

Text summarization remains a challenging task in the Natural Language Processing field despite the plethora of applications in enterprises and daily life. One of the common use cases is the summarization of web pages which has the potential to provide an overview of web pages to devices with limited features. In fact, despite the increasing penetration rate of mobile devices in rural areas, the bulk of those devices offer limited features in addition to the fact that these areas are covered with limited connectivity such as the GSM network. Summarizing web pages into SMS becomes, therefore, an important task to provide information to limited devices. This work introduces WATS-SMS, a T5-based French Wikipedia Abstractive Text Summarizer for SMS. It is built through a transfer learning approach. The T5 English pre-trained model is used to generate a French text summarization model by retraining the model on 25,000 Wikipedia pages then compared with different approaches in the literature. The objective is twofold: (1) to check the assumption made in the literature that abstractive models provide better results compared to extractive ones; and (2) to evaluate the performance of our model compared to other existing abstractive models. A score based on ROUGE metrics gave us a value of 52% for articles with length up to 500 characters against 34.2% for transformer-ED and 12.7% for seq-2seq-attention; and a value of 77% for articles with larger size against 37% for transformers-DMCA. Moreover, an architecture including a software SMS-gateway has been developed to allow owners of mobile devices with limited features to send requests and to receive summaries through the GSM network.

Text fields in electronic medical records (EMR) contain information on important factors that influence health outcomes, however, they are underutilized in clinical decision making due to their unstructured nature. We analyzed 6,497 inpatient surgical cases with 719,308 free text notes from Le Bonheur Children’s Hospital EMR. We used a text mining approach on preoperative notes to obtain the text-based risk score algorithm as predictive of death within 30 days of surgery. We studied the additional performance obtained by including text-based risk score as a predictor of death along with other structured data based clinical risk factors. The C-statistic of a logistic regression model with 5-fold cross-validation significantly improved from 0.76 to 0.92 when text-based risk scores were included in addition to structured data. We conclude that preoperative free text notes in EMR include significant information that can predict adverse surgery outcomes.

Electronic text stylometry is a collection of forensics methods that analyze the writing styles of input electronic texts in order to extract information about authors of the input electronic texts. Such extracted information could be the identity of the authors, or aspects of the authors, such as their gender, age group, ethnicity, etc. This survey paper presents the following contributions: 1) A description of all stylometry problems in probability terms, under a unified notation. To the best of our knowledge, this is the most comprehensive definition to date. 2) A survey of key methods, with a particular attention to data representation (or feature extraction) methods. 3) An evaluation of 23,760 feature extraction methods, which is the most comprehensive evaluation of feature extraction methods in the literature of stylometry to date. The importance of this evaluation is two fold. First, identifying the relative effectiveness of the features (since, currently, many are not evaluated jointly; e.g. syntactic n-grams are not evaluated against k-skip n-grams, and so forth). Second, thanks to our generalizations, we could evaluate novel grams, such as what we name compound grams. 4) The release of our associated Python feature extraction library, namely Fextractor. Essentially, the library generalizes all existing n-gram based feature extraction methods under the "at least l-frequent, dir-directed, k-skipped n-grams'', and allows grams to be diversely defined, including definitions that are based on high-level grammatical aspects, such as POS tags, as well as lower-level ones, such as distribution of function words, word shapes, etc. This makes the library, by far, the most extensive in this domain to date. 5) The construction, evaluation, and release of the first dataset for Emirati social media text. This evaluation represents the first evaluation of author identification against Emirati social media texts. Interestingly, we find that, when using our models and feature extraction library (Fextractor), authors could be identified significantly more accurately than what is reported with similarly sized datasets. The dataset also contains sub-datasets that represent other languages (Dutch, English, Greek and Spanish), and our findings are consistent across them.

In this paper, we present a novel approach for text independent phone-to-audio alignment based on phoneme recognition, representation learning and knowledge transfer. Our method leverages a self-supervised model (wav2vec2) fine-tuned for phoneme recognition using a Connectionist Temporal Classification (CTC) loss, a dimension reduction model and a frame-level phoneme classifier trained thanks to forced-alignment labels (using Montreal Forced Aligner) to produce multi-lingual phonetic representations, thus requiring minimal additional training. We evaluate our model using synthetic native data from the TIMIT dataset and the SCRIBE dataset for American and British English, respectively. Our proposed model outperforms the state-of-the-art (charsiu) in statistical metrics and has applications in language learning and speech processing systems. We leave experiments on other languages for future work but the design of the system makes it easily adaptable to other languages.

Text classification is one of the most important task in natural language processing, In this research, we carried out several experimental research on three (3) of the most popular Text classification NLP classifier in Convolutional Neural Network (CNN), Multinomial Naive Bayes (MNB), and Support Vector Machine (SVN). In the presence of enough training data, Deep Learning CNN works best in all parameters for evaluation with 77% accuracy, followed by SVM with accuracy of 76%, and multinomial Bayes with least performance of 69% accuracy. CNN has the best performance in the presence of large enough training dataset because of the presence of filter/ kernels which help to indentify patterns in text data regardless of their position in the sentence. We repeated the training again with just one-third of our data, at this point SVM comes with the best performance, the performance of CNN noticeably drops but still better than Multinomial Naive Bayes, the reason why SVM works best when we reduce the training data was because of its ability to look for a hyper-plane that creates a boundary between different classes of data so as to properly classify them, so we believed that getting the hyper-plane was more efficient when we reduce the dataset, hence reason for the good performance. Multinomial Naive Bayes have the least performance which we attributed to its assumption of independency between the features which sometimes does not hold true. We concluded that availability of data should be an important factor when choosing classifier for Natural Language Processing Text Classification task. CNN should be use in the presence of enough dataset, and SVM should be use when data is not enough. Multinomial Naive Bayes must not be trusted with state of the art NLP task due to its assumption of independency between the features.

Highly-skilled migrants and refugees finding employment in low-skill vocations, despite professional qualifications and educational background, has become a global tendency, mainly due to the language barrier. Employment prospects for displaced communities are mostly decided by their knowledge of the sublanguage of the vocational domain they are interested in working. Common vocational domains include agriculture, cooking, crafting, construction, and hospitality. The increasing amount of user-generated content in wikis and social networks provides a valuable source of data for data mining, Natural Language Processing and machine learning applications. This paper extends the contribution of the authors’ previous research on automatic vocational domain identification by further analyzing the results of the machine learning experiments with the domain-specific textual data set, considering 2 research directions: a. predictions analysis and b. data balancing. Wrong predictions analysis and the features that contributed to misclassification, along with correct predictions analysis and the features that were the most dominant, contributed to the identification of a primary set of terms for the vocational domains. Data balancing techniques were applied on the data set to observe their impact on the performance of the classification model. A novel 4-step methodology is proposed in this paper for the first time, consisting of successive applications of SMOTE oversampling on imbalanced data. Data oversampling obtains better results than data undersampling in imbalanced data sets, while hybrid approaches perform reasonably well.

Mining and analysis of the Big Data of Twitter conversations have been of significant interest to the scientific community in the fields of healthcare, epidemiology, big data, data science, computer science, and their related areas, as can be seen from several works in the last few years that focused on sentiment analysis and other forms of text analysis of Tweets related to Ebola, E-Coli, Dengue, Human papillomavirus (HPV), Middle East Respiratory Syndrome (MERS), Measles, Zika virus, H1N1, influenza-like illness, swine flu, flu, Cholera, Listeriosis, cancer, Liver Disease, Inflammatory Bowel Disease, kidney disease, lupus, Parkinson's, Diphtheria, and West Nile virus. The recent outbreaks of COVID-19 and MPox have served as "catalysts" for Twitter usage related to seeking and sharing information, views, opinions, and sentiments involving both these viruses. While there have been a few works published in the last few months that focused on performing sentiment analysis of Tweets related to either COVID-19 or MPox, none of the prior works in this field thus far involved analysis of Tweets focusing on both COVID-19 and MPox at the same time. With an aim to address this research gap, a total of 61,862 Tweets that focused on Mpox and COVID-19 simultaneously, posted between May 7, 2022, to March 3, 2023, were studied to perform sentiment analysis and text analysis. The findings of this study are manifold. First, the results of sentiment analysis show that almost half the Tweets (the actual percentage is 46.88%) had a negative sentiment. It was followed by Tweets that had a positive sentiment (31.97%) and Tweets that had a neutral sentiment (21.14%). Second, this paper presents the top 50 hashtags that were used in these Tweets. Third, it presents the top 100 most frequently used words that are featured in these Tweets. The findings of text analysis show that some of the commonly used words involved directly referring to either or both viruses. In addition to this, the presence of words such as "Polio", "Biden", "Ukraine", "HIV", "climate", and "Ebola" in the list of the top 100 most frequent words indicate that topics of conversations on Twitter in the context of COVID-19 and MPox also included a high level of interest related to other viruses, President Biden, and Ukraine. Finally, a comprehensive comparative study that involves a comparison of this work with 49 prior works in this field is presented to uphold the scientific contributions and relevance of the same.

Painting style and creativity are fundamental to art, defining a work’s uniqueness and expression. They embody an artist’s personality, convey emotions, establish identity, and shape audience perception, adding depth and value to the work. Recently, diffusion models have gained popularity in art design, animation, and gaming, especially in original painting creation, poster design, and visual identity development. Traditional creative processes, while demanding unique imagination and creativity, often face challenges such as slow innovation, high reliance on manual efforts, high costs, and limitations in scalability. Consequently, exploring painting-style creative design through deep learning has emerged as a promising trend. In this paper, we introduce a novel network architecture, the Painting-Style Design Assistant Network (PDANet), for style transformation. To support this, we curated the Painting-42 dataset, comprising 4,055 works by 42 renowned Chinese painters. PDANet leverages this dataset to capture the aesthetic intricacies of Chinese painting, offering rich design references. Furthermore, we propose a lightweight Identity-Net for large-scale text-to-image (T2I) models, which aligns internal knowledge with external control signals, thereby enhancing the capabilities of existing T2I models. The trainable Identity-Net feeds image prompts into the U-Net encoder to generate diverse and stable images. Both quantitative and qualitative analyses demonstrate that our approach outperforms current methods, delivering high-quality generated content with wide-ranging applicability.

For highly time-constrained very short-term investors, reading and extracting valuable information from financial news poses significant challenges. The wide range of topics covered in these news articles further compounds the difficulties for investors. The diverse content adds complexity and uncertainty to the text, making it arduous for very short-term investors to swiftly and accurately extract valuable insights. Variations in authors, media sources, and cultural backgrounds also introduce additional complexities. Hence, performing a bull-bear semantic analysis of financial news using text mining technologies can alleviate the volume, time, and energy pressures on very short-term investors while enhancing the efficiency and accuracy of their investment decisions. This study proposes labeling bull-bear words from a futures corpus detection method that extracts valuable information from financial news, allowing investors to understand market trends quickly. Generative AI models are trained to provide real-time bull-bear advice, aiding investors in adapting to market changes and devising effective trading strategies. Experimental results show the effectiveness of various models, with Random Forest and SVMs achieving an impressive 80% accuracy rate. MLP and Deep learning models also perform well. By leveraging these models, the study reduces the time spent reading financial articles, enabling faster decision-making and increasing the likelihood of investment success. Future research can explore the application of this method in other domains and enhance model design for improved predictive capabilities and practicality.

In today's business world, many companies have realized that consumer feedback evaluations play a crucial part in shaping the company's future activities. The hotel and tourism industries are well-known examples where the user feedback has become crucial. Even though most accommodations want their clients to express their opinions about their services, these reviews are nevertheless carefully reviewed by them. This manual approach is time demanding and error prone, the level of expertise of the individual analyzing the evaluations determines the quality of the manual analysis. This research focuses on the development of a tool-based support system that analyzes text-based customer evaluations and then highlights the maintenance issues identified in the reviews, removing the need to manually evaluate and analyze the customer reviews. The process includes data preparation, sentiment analysis, and a fully trained deep learning model to extract critical insights. Using sentiment analysis techniques after data preprocessing and trained deep learning model, an accuracy of 96% was achieved, and this paper discusses how this technology helps to meet the needs of accommodation management by completing activities efficiently. This might save management time and helps to save money without losing clients, allowing them to enhance their additional sales.

As RPG has high sales and profits, lots of developers have supplied various RPG to market but it changed to mass production type with sensational advertising, low quality and excessive charging and similar contents which affects game market and users’ game play experience. The author of this paper studied ways to improve mobile RPG by collecting and analyzing users’ reviews using crawling on Google Play Store. The author of this paper used topic modeling that uses text mining technique and LDA (Latent Dirichlet Allocation) to extract meaningful information from collected big data and visualized it. Inferring users’ reviews, figuring out opinions objectively and seeking ways to improve games are helpful in improving mobile RPG that can be played continuously.

In the present, the growth of digitization and worldwide communications make OCR systems of exotic languages a very important task. In this paper, we attempt to develop an OCR system for one of these exotic languages with a unique script, Amharic. Motivated by the recent success of the Attention mechanism in Neural Machine Translation (NMT), we extend the attention mechanism for Amharic text-image recognition. The proposed model consists of CNNs and attention embedded recurrent encoder-decoder networks that are integrated following the configuration of the seq2seq framework. The attention network parameters are trained in an end-to-end fashion and the context vector is injected, with the previously predicted output, at each time steps of decoding. Unlike the existing OCR model that minimizes the CTC objective function, the new model minimizes the categorical cross-entropy loss. The performance of the proposed attention-based model is evaluated against the test dataset from the ADOCR database which consists of both printed and synthetically generated Amharic text-line images and achieved promising results with a CER of 1.54% and 1.17% respectively.

Topological Data Analysis (TDA) refers to a collection of methods that find the structure of shapes in data. Although recently, TDA methods have been used in many areas of data mining, it has not been widely applied to text mining tasks. In most text processing algorithms, the order in which different entities appear or co-appear is being lost. Assuming these lost orders are informative features of the data, TDA may play a significant role in the resulted gap on text processing state of the art. Once provided, the topology of different entities through a textural document may reveal some additive information regarding the document that is not reflected in any other features from traditional text processing methods. In this paper, we introduce a novel approach that hires TDA in text processing in order to capture and use the topology of different same-type entities in textural documents. First, we will show how to extract some topological signatures in the text using persistent homology-i.e., a TDA tool that captures topological signature of data cloud. Then we will show how to utilize these signatures for text classification.

Ontology is a formalized representation of the problem area (PrA). Representation of the PrA in the form of an domain ontology is often used in the process of development of intelligent software systems and used as a knowledge base. The process of building an ontology is complex and requires an expert in the PrA. A large number of researchers are working to solve this problem. The basis of our approach is the use of a pipeline of different linguistic methods of text analysis. The set of rules developed by us is used to build an ontology based on the content analysis of a text resource. This article describes the method of building a domain ontology based on the linguistic analysis of content of text resources, presents an example of the proposed approach, and also presents the architecture of our pipeline.

This study explores advanced feature engineering and semantic enrichment methods to enhance text classification, focusing on detecting figurative language in tweets. The novel features introduced, Syno\_Lower\_Mean and Syn\_Mean, measure the use of uncommon synonyms and the mean frequency of synonyms, capturing semantic richness crucial for detecting figurative expressions. Using resources like SenticNet and Framester, we enrich our feature set with sentiment and frame semantic information. Our approach includes extensive data preprocessing, sophisticated feature selection, and implementing various classification models, such as SVM, KNN, Logistic Regression, Decision Trees, Random Forest, BERT, and LSTM networks. We rigorously evaluate each model's performance to assess the effectiveness of our features and enrichment methods. Putting emphasis on model explainability, we use decision tree analysis, feature importance analysis, and the TREPAN algorithm to approximate SVM decisions. Although we focus on figurative language detection, our methods have broader implications for various NLP text classification tasks. Our findings demonstrate significant improvements in classification accuracy and interpretability through innovative feature design and dataset enrichment.

In the dynamic field of mental health care, the nuanced application of Artificial Intelligence (AI) through Natural Language Processing (NLP) and Automatic Speech Recognition (ASR) is a pivotal innovation in patient empowerment and service optimization. This study introduces a distinctive online therapy platform that capitalizes on the synergy of NLP and ASR to offer unprecedented levels of interactive and personalized therapeutic interventions. The architecture of our system is meticulously detailed, featuring an ASR component with an impressive Word Error Rate (WER) of 14% when trained on the diverse French subsets of the Mozilla Common Voice dataset, complemented by a high-precision NLP framework skilled in processing and responding to user inputs. The evaluation of our system highlights its efficacy in enhancing therapy sessions and user satisfaction, with an emphasis on the qualitative aspects of user feedback. The paper addresses challenges such as dataset representativeness and language model refinement and articulates the strategic solutions employed to overcome them. The paper concludes with forward-looking perspectives on AI's role in mental health services, advocating for the creation of sophisticated, language-specific datasets and models to satisfy the increasing demands of online therapy, reflecting a growing commitment of patients in the management of their therapy. This research underscores the transformative impact of AI in advancing mental health care into the digital age, representing a significant evolution over existing methodologies.

This study aims to understand the global environment of COVID-19 management and guide future policy directions after the pandemic crisis. To this end, we analyzed a series of the World Economic Forum’s COVID-19 response reports through text mining and network analysis. These reports, written by experts in diverse fields, discuss multidimensional changes in socioeconomic situations, various problems created by those changes, and strategies to respond to national crises. Based on 3,897 refined words drawn from a morphological analysis of 26 reports (as of the end of 2020), this study analyzes the frequency of words, the relationships among words, the importance of specific documents, and the connection centrality through text mining. In addition, network analysis helps develop strategies for sustainable response to and management of national crises through identifying clusters of words with a similar structural equivalence.

The rising prevalence of autism internationally has been accompanied with an increased appreciation of the poorer mental health experienced by people with this condition and also of their family care-givers. In particular higher incidences of anxiety and depression are reported in high income nations and these conditions are likely to be under-recognised and under-reported in lower resourced regions or countries. Mainstream mental health services seem to be ill-equipped to respond adequately to the needs of autistic persons and their care-givers. This scoping review of 30 recently published literature reviews covering over 1,000 journal articles, summarises the insights and strategies that have been shown to promote the mental health and emotional wellbeing of autistic persons. In particular, a focus on family-centred, community-based supports is needed that aim to enhance social communication, extend social connections and promote an individual’s self-esteem, self-determination and social motivation. These low-cost interventions are especially pertinent in low resourced settings but they can be used internationally to prevent mental illness and assist in the treatment of anxiety and depression in autistic persons and their family carers. The priority is to focus on primary care responses with cross-sectoral working rather than investing in high-cost psychiatric provision.

While Twitter has been touted to provide up-to-date information about hazard events, the reliability of tweets is still a concern. Our previous publication extracted relevant tweets containing information about the 2013 Colorado flood event and its impacts. Using the relevant tweets, this research further examined the reliability (accuracy and trueness) of the tweets by examining the text and image content and comparing them to other publicly available data sources. Both manual identification of text information and automated (Google Cloud Vision API) extraction of images were implemented to balance accurate information verification and efficient processing time. The results showed that both the text and images contained useful information about damaged/flooded roads/street networks. This information will help emergency response coordination efforts and informed allocation of resources when enough tweets contain geocoordinates or locations/venue names. This research will help identify reliable crowdsourced risk information to enable near-real time emergency response through better use of crowdsourced risk communication platforms.

This study investigates the effectiveness of a text summarization method applied to open-ended student evaluations at the Hellenic Open University, aiming to improve the analysis of qualitative feedback from online educational surveys. To address the challenges of processing large volumes of student feedback, an automated summarization technique utilizing advancements in Natural Language Processing (NLP) and text mining is proposed. Using the TextRank and the Walktrap algorithms, student comments on positive aspects, study challenges, and improvement suggestions were analyzed. The analysis revealed that while some students expressed satisfaction with tutor-student interactions and the organization of educational material, there were also negative comments about outdated content in some modules and scheduling issues. The findings highlight the importance of qualitative feedback for education quality, providing actionable insights for improving curricula and teaching effectiveness. This research responds to the growing need for effective qualitative data analysis in higher education and contributes to ongoing discussions about student satisfaction in distance learning environments. By effectively summarizing open-ended responses, university staff can better understand student experiences and make informed decisions to enhance the educational process.

The use of artificial intelligence in natural language processing (NLP) has significantly contributed to the advancement of natural language applications such as sentimental analysis, topic modeling, text classification, chatbots, and spam filtering. With a large amount of text generated each day from different sources such as webpages, blogs, emails, social media, and articles, one of the most common tasks in natural language processing is the classification of a text corpus. This is important in many institutions for planning, decision-making, and archives of their projects. Many algorithms exist to automate text classification operations but the most intriguing of them is that which also learns these operations automatically. In this study, we present a new model to infer and learn from data using probabilistic logic and apply it to text classification. This model, called GenCo, is a multi-input single-output (MISO) learning model that uses a collaboration of partial classifications to generate the desired output. It provides a heterogeneity measure to explain its classification results and enables the reduction of the curse of dimensionality in text classification. The classification results are compared with those of conventional text classification models, and it shows that our proposed model has a higher classification performance than conventional models.

The spread of the Coronavirus pandemic has been accompanied by an infodemic. The false information that is embedded in the infodemic affects people’s ability to have access to safety information and follow proper procedures to mitigate the risks. This research aims to target the falsehood part of the infodemic, which prominently proliferates in news articles and false medical publications. Here, we present NeoNet, a novel supervised machine learning text mining algorithm that analyzes the content of a document (news article, a medical publication) and assigns a label to it. The algorithm is trained by TFIDF bigram features which contribute a network training model. The algorithm is tested on two different real-world datasets from the CBC news network and Covid-19 publications. In five different fold comparisons, the algorithm predicted a label of an article with a precision of 97-99 %. When compared with prominent algorithms such as Neural Networks, SVM, and Random Forests NeoNet surpassed them. The analysis highlighted the promise of NeoNet in detecting disputed online contents which may contribute negatively to the COVID-19 pandemic.

Text annotation is an essential element of the natural language processing approaches. The manual annotation process performed by humans has several drawbacks, such as subjectivity, slowness, fatigue, and possibly carelessness. In addition, annotators may annotate ambiguous data. So, we developed the concept of automated annotation to get the best annotations using several machine-learning approaches. The proposed approach is based on an ensemble algorithm of meta-learners and meta-vectorizer techniques. The approach employs a semi-supervised learning technique for automated annotation, aimed at detecting hate speech. This involves leveraging various machine learning algorithms, including Support Vector Machine (SVM), Decision Tree (DT), K-Nearest Neighbors (KNN), and Naive Bayes (NB), in conjunction with Word2Vec and TF-IDF text extraction methods. The annotation process is performed using 13,169 Indonesian YouTube comments data. The proposed model used a Stemming approach using data from Sastrawi and also new data of 2,245 words. Semi-supervised learning uses 5%, 10%, and 20% of labeled data as compared to performing labeling based on 80% of the datasets. In semi-supervised learning, the model learns from the labeled data, which provides explicit information, and the unlabeled data, which offers implicit insights. This hybrid approach enables the model to generalize and make informed predictions even when limited labeled data is available, ultimately enhancing its ability to handle real-world scenarios with scarce annotated information. In addition, the proposed method uses a variety of thresholds for matching words labeled with hate speech ranging from 0.6, 0.7, 0.8, and 0.9. The experiment showed that the KNN-Word2ec model has the best accuracy value of 96.9% with a scenario of 5%:80%:0.9. However, several other methods have also accuracy above 90%, such as SVM and DT based on both text extraction methods in several test scenarios.

Using traditional methods based on detection rules written by human security experts, there is a significant challenge in accurately detecting many network threats that are increasingly becoming sophisticated. In order to deal with the limitation of the traditional methods, network threat detection techniques utilizing artificial intelligence technologies such as machine learning are being extensively studied. Research has also been conducted on analyzing various string patterns in network packet payloads through natural language processing techniques to detect attack intent. However, due to the nature of packet payloads containing binary data as well as text data, a new approach is needed that goes beyond typical natural language processing techniques. In this paper, we study a token extraction method optimized for payloads using n-gram and byte pair encoding techniques. Furthermore, we generate embedding vectors that can understand the context of the packet payload using algorithms such as Word2Vec and FastText. We also compute the embedding of various header data associated with packets, such as IP addresses and ports. Given the combination of these features, we ensemble a text 1D-CNN and a multi-head attention network in a novel fashion. We validated the effectiveness of our classification technique with the CICIDS2017 open dataset and over half a million data collected by The Education Cyber Security Center (ECSC) currently operating in South Korea. The proposed model showed remarkable progress compared to previous studies, demonstrating a highly accurate classification performance with an F1-Score of 0.998. Our model can also preprocess and classify 150,000 network threats per minute to help security agents in the field divert their time to analyzing more complex attack patterns.

This study examined the eye movement patterns of 317 elementary students across reading conditions (audio-assisted reading (AR) and reading-only (R)) and text types (fiction and non-fiction), and identified eye movement parameters that predict their literal comprehension (LC) and inferential comprehension (IC). Participants, randomly assigned to either reading condition and either text type, answered questions assessing their LC and IC. Average fixation duration (AFD), total fixation duration (TFD), and scanpath length were used as eye movement parameters. There were main effects of age on all parameters and interaction effects between age and reading condition on TFD and scanpath length. Controlling for age, TFD had a positive impact on LC of both text types in the AR, while under the R, it affected negatively on IC of both text types. Longer scanpaths predicted IC of fiction in the AR, LC and IC of non-fiction under the AR, and LC of non-fiction within the R. AFD influenced negatively on IC of fiction in the AR, LC and IC of non-fiction in the AR, and LC of non-fiction under the R. These eye movement patterns and predictors indicate children employ different reading strategies based on reading modality and text type.

Introduction: The transcranial direct current stimulation (tDCS) is a promising technique for brain modulation after cerebrovascular accident (CVA). This treatment modality has been previously studied in the recovery of patients. The aim of this review is to analyze the evidence in the ap-plication of tDCS in the recovery of gait disturbance in stroke patients. Methods: This review was conducted according to the recommendations of the PRISMA statement. Three different elec-tronic databases were searched for relevant results: PubMed, Scopus, and Cochrane. We included reviews and meta-analyses that only considered randomized controlled trials (RCTs) that inves-tigated the effects of transcranial direct electrical stimulation, in combination or not with other physiotherapy treatment, on gait recovery. Results: Thirteen studies with a total of 195 RCTs were included. Data on population, outcome measures, protocols and outcomes were extracted. The Amstar-2 scale and the GRADE system of certainty of evidence were used. Only one study re-ceived high certainty of evidence, 5 received low certainty of evidence and 7 received critically low certainty of evidence. Conclusions: Although the tDCS produces positive changes in gait recovery in spatio-temporal parameters, mobility, endurance, strength and motor function, there is insuf-ficient evidence to recommend this treatment.

Background: Gliomas, including the most severe form known as glioblastomas, are primary brain tumors arising from glial cells, with significant impact on adults, particularly men aged 45 to 70. Recent advancements in the WHO classification now correlate genetic markers with glioma phenotypes, enhancing diagnostic precision and therapeutic strategies. Aims and Methods: This scoping review aims to evaluate the current state of deep learning (DL) applications in the genetic characterization of adult gliomas, addressing the potential of these technologies for a reliable virtual biopsy. Results: We reviewed 17 studies, analyzing the evolution of DL algorithms from fully convolutional networks to more advanced architectures (ResNet and DenseNet). The methods involved various validation techniques, including k-fold cross-validation and external dataset validation. Conclusions: Our findings highlight significant variability in reported performance, largely due to small, homogeneous datasets and inconsistent validation methods. Despite promising results, particularly in predicting individual genetic traits, the lack of robust external validation limits the generalizability of these models. Future efforts should focus on developing larger, more diverse datasets and integrating multidisciplinary collaboration to enhance model reliability. This review underscores the potential of DL in advancing glioma characterization, paving the way for more precise, non-invasive diagnostic tools.

Reading is one of the essential processes during the maturation of an individual. It is estimated that 5-10% of school-age children are affected by dyslexia, the reading disorder characterised by difficulties in the accuracy or fluency of word recognition. There are many studies which have reported that colour overlays and background could improve the reading process, especially in children with reading disorders. As dyslexia has neurobiological origins, the aim of the present research was to understand the relationship between physiological parameters and colour modifications in the text and background during reading in children with and without dyslexia. We have measured differences in electroencephalography (EEG), heart rate variability (HRV), electrodermal activities (EDA), and eye movement of the 36 school-age children (18 with dyslexia and 18 of control group) during the reading performance in 13 combinations of background and overlay colours during the reading task. Our findings showed that the dyslexic children have longer reading duration, fixation count, fixation duration average, fixation duration total, and longer saccade count, saccade duration total, and saccade duration average while reading on white and coloured background/overlay. It was found that the turquoise, turquoise O, and yellow colours are beneficial for dyslexic readers, as they achieved the shortest time duration during the reading tasks when these colours were used. Also, dyslexic children have higher values of beta and the whole range of EEG while reading in particular colour (purple), as well as increasing theta range while reading on the purple overlay colour. We have observed no significant differences between HRV parameters on white colour, except for single colours (purple, turquoise overlay and yellow overlay) where the control group showed higher values for Mean HR, while dyslexic children scored higher with Mean RR. Regarding EDA measure we have found systematically lower values in children with dyslexia in comparison to the control group. Based on present results we can conclude that both colours (warm and cold background/overlays) are beneficial for both groups of readers and all sensor modalities could be used to better understand the neurophysiological origins in dyslexic children.

Limiting training data in low-resource languages is a barrier to Natural Language Processing (NLP). Regardless, languages with thousands of users worldwide require improved NLP capabilities. The Table-to-Text task—typically develops natural language descriptions using data tables, tests model reasoning abilities—although it is especially tough in multi-language settings. System output frequently lack credit to their underlying data. Intermediate planning strategies—which include Question-Answer (QA) blueprints—improving summarization tasks by presenting related QA pair prior to verbalization. Therefore, this study analyses whether QA blueprints improve multilingual Table-to-Text output attribution. An enlarged multilingual dataset, encompassing African languages, contains QA blueprints that were produced and filtered heuristically. This dataset is used to fine-tune sequence-to-sequence model (transformers)—both with and without blueprints. Two configurations are evaluated—English reference blueprints with language target verbalization and modified blueprints. These results show that English-only models benefit from blueprints, whereas multi language models cannot. Errors in machine-translating blueprints provide challenges, as do models that rely on their generated blueprints.

The research presents the Methodology of Improving the Accuracy in Text Classification in Light of Modelling the Latent Semantic Relations (LSR). The aim of this Methodology is to find the ways of eliminating the Limitations of Discriminant and Probabilistic methods for LSR revealing and customizing the Text Classification Process to the more accurate recognition of the text tonality. This aim should be achieved by using the knowledge about the text’s Hierarchical Semantic Context in the form of Corpora-based Hierarchical Sentiment Dictionary. The main scientific contribution of this research is the following set of approaches to improve the qualitative characteristics of Text Classification process: combination of the Discriminant and Probabilistic methods allowing to decrease the influences of the Limitations of these methods on the LSR revealing process; considering each document as a complex structure allowing to estimate documents integrally by separated classification of topically completed textual component (paragraphs); taking into account the features of Argumentative type of documents (Reviews) allowing to use the author’s subjective evaluation of text tonality for development the Text Classification methodology. Tonality, expressed by the Review’s author, has a significant, but not critical, effect on the qualitative indicators of Sentiment Recognition.

The growing adoption of electric propulsion systems in Maritime Autonomous Surface Ships (MASS) necessitates advancements in shipboard electronics for safe, efficient, and reliable operation. These advancements are crucial for tasks like real-time sensor data processing, control algorithms for autonomous navigation, and robust decision-making capabilities. This study investigates research trends in MASS using bibliographic analysis to inform policy and future research directions in this evolving field. We analyze 3,363 MASS-related articles from the Web of Science database, employing co-occurrence word analysis and latent Dirichlet allocation (LDA) topic modeling. Findings reveal a rapidly growing field dominated by image recognition research. Keywords like "datum," "image," and "detection" suggest a focus on collecting and analyzing marine data, particularly with deep learning for synthetic aperture radar imagery. LDA confirms this, with "Image analysis and classification research" as the leading topic. The study also identifies national and organizational leaders in MASS research. However, research on Arctic routes lags behind other areas. This work provides valuable insights for policymakers and researchers, promoting a deeper understanding of MASS and informing future policy and research agendas for the integration of electric propulsion systems in the maritime industry.