Cross Lingual Information Retrieval

In this paper we explore some of the most important areas of information retrieval. In particular, Crosslingual
Information Retrieval (CLIR) and Multilingual Information Retrieval (MLIR). CLIR deals with
asking questions in one language and retrieving documents in different language. MLIR deals with asking
questions in one or more languages and retrieving documents in one or more different languages. With an
increasingly globalized economy, the ability to find information in other languages is becoming a necessity.
We also presented the evaluation initiatives of information retrieval domain. Finally we have presented the
overall review of the research works in Indian and Foreign languages.

This paper proposes a novel approach for multilingual query processing, wherein we propose a phonetic distance based measure, for searching proper name data in Indian language scripts. The systems allows query in a language of user's choice. A cross-lingual search is conducted with the query being in one language and the documents being searched for, in another. Grapheme-to-phoneme converters are used to convert the user's query into an intermediate language-independent common ground (CG) representation. A dynamic time warping algorithm, wherein the substitution cost is based on a weighted phonetic distance measure, is used to match and rank the query results. In turn, a phoneme-to-grapheme converter is used to convert the search results in CG representation to the user's query language. We also discuss in detail the various issues particular to cross-lingual search on proper name data and address the same using the proposed approach.

Internet is a humongous repository of information which is majorly in English. To make this information accessible to all the people irrespective of their know-how of English, the notion of Cross Lingual Information Access (CLIA) has been introduced. We discuss here work on CLIA systems for Indian languages and describe Setu - a CLIA system for English-Hindi developed at CDAC Mumbai. We also analyze the Indian perspective in this context, discussing relevant issues faced by the existing systems. We focus mainly on issues arising due to ambiguities at different stages of CLIA and the quality of machine translation, a vital component in CLIA. We also try to look at opportunities for such systems and the road ahead.

The CEA LIST/LIC2M laboratory participated in ImageCLEF 2006 to perform experiments on merging strategies to integrate the results obtained from the cross-language text retrieval system and the content-based image retrieval (CBIR) system that are developed in our lab, using a simple merging strategy similar to the one used in previous ImageCLEF campaigns [1]. We use text and visual information from the queries: the title provided for the text retrieval system, and the example images for the CBIR system. Both systems are general-domain systems and are used independently on each part of the query. Then, a posteriori merging strategies are applied on the results provided by each system.

Abstract. In this paper, we report our effort at the standardization, design and partial implementation of a multilingual dictionary in the context of three large scale projects, viz., (i) Cross Lingual Information Retrieval, (ii) English to Indian Language Machine Translation, and (iii) Indian Language ...

In this paper we will discuss dictionary-based cross-language information retrieval (CLIR) methods, and report recent findings and problems. We will consider three language pairs for CLIR: Finnish to English, English to Finnish, Swedish to English. We show that Finnish and Swedish have special features, eg, the frequency of homography and a high frequency of compound words that affect retrieval effectiveness. Especially correct word form normalization and compound splitting are essential. We report findings concerning the ...

Purpose
This study aims to identify, collect and critical review the research literature on Multilingual Digital Libraries in English language from 1997 to 2012.

Design/methodology/approach
The present literature review has followed the rules of systematic review. In particular, the identified relevant papers were categorized based on their expressed aim on two core themes, that of system-centered and user-centered studies. The assigned papers were further analyzed and six sub-themes emerged for the system-centered studies and four for the user-centered studies. Additional categorization was also provided according to type of publication.

Findings
The literature concerning Multilingual Digital Libraries is vast and mainly focuses on two aspects the “System” and the “Users”. The majority of papers tried to meet the challenges raised for enabling multilingual information retrieval in Digital Libraries. Unfortunately, these efforts undertaken by a small number of researchers or research groups apparently working in isolation and therefore resulting in the development of numerous different tools and techniques. Relatively few studies have focused on the user and aimed to explore users' behavior and expectations when interacting with Multilingual Digital Libraries. As a result, further research is needed to reach to some tangible and usable findings.

Originality/value
This literature review captures the diversity of the research conducted regarding multilingual information access and retrieval in Digital Libraries. It organizes the vast literature in comprehensive themes and sub-themes enabling easy access to specific information.

Limitations
This study reviews only papers in English due to language restrictions from 1997 to 2012.

As our global knowledge environment changes and the information to be found in scholarly journals becomes increasingly available in digital format, it is necessary to employ more and more sophisticated search and retrieval procedures to mine this knowledge. We have large holes in our globally accessible knowledge base as traditional web-crawlers cannot collect and assess all of the serially produced papers, articles and journals that exist. Many search engines only touch the surface and they cannot harvest potentially valuable information in the silos of the “deep web”. More comprehensive data mining is therefore essential if we are to effectively tap the knowledge often hidden in scholarly journals and databases. Data-mining models are being developed which aim to search all the global knowledge being produced--an essential goal that will aid in sharing and therefore accelerating global knowledge diffusion. Deep Web Technologies and World Wide Science.org are examples of ongoing ef...

Abstract. In this paper, we report our effort at the standardization, design and partial implementation of a multilingual dictionary in the context of three large scale projects, viz., (i) Cross Lingual Information Retrieval, (ii) English to Indian Language Machine Translation, and (iii) Indian Language ...

This paper presents the experiments carried out at Jadavpur University as part of participation in the CLEF 2007 ad-hoc bilingual task. This is our first participation in the CLEF evaluation task and we have considered Bengali, Hindi and Telugu as query languages for the retrieval from English document collection. We have discussed our Bengali, Hindi and Telugu to English CLIR system as part of the ad-hoc bilingual task, English IR system for the ad-hoc monolingual task and the associated experiments at CLEF. Query construction was manual for Telugu-English ad-hoc bilingual task, while it was automatic for all other tasks.

At the NTCIR-4 workshop, Justsystem Corporation and Clairvoyance Corporation collaborated in participating in the Cross-Language Retrieval Task (CLIR). We submitted results to the sub-tracks of SLIR and BLIR. For the SLIR track, we submitted Chinese, English, and Japanese monolingual runs. For the BLIR track, we submitted Japanese-English and Chinese-English runs. The major goal of our participation is to evaluate performance and robustness of our recently developed commercial-grade CLIR systems for English, Japanese, and Chinese.

This  research  encompasses  the  construction  of  a  multilingual  lexical  database  for  cross -lingual information  retrieval  in  the  Indonesian  legal  domain.  Multilingual  lexical  database  featuring  lexically and  legally  grounded  conceptual  representation  can  fit  the cross-lingual  information  retrieval.  Lexical database  use
Ontology  Web  Language  (OWL)representation  language.  This  representation  is  useful  to provide application developers a high-quality resource and to promote interoperability.

Abstract. In this paper, we report our effort at the standardization, design and partial implementation of a multilingual dictionary in the context of three large scale projects, viz., (i) Cross Lingual Information Retrieval, (ii) English to Indian Language Machine Translation, and (iii) Indian Language ...

The goal of the MEANING project (IST-2001-34460) is to develop tools for the automatic acquisition of lexical knowledge that will help Word Sense Disambiguation (WSD). The acquired lexical knowledge from various sources and various languages is stored in the Multilingual Central Repository (MCR) (Atserias et al 04), which is based on the design of the EuroWordNet database. The MCR holds wordnets in various languages (English, Spanish, Italian, Catalan and Basque), which are interconnected via an Inter-LingualIndex (ILI). In addition, the MCR holds a number of ontologies and domain labels related to all concepts. During the MEANING project, the MCR has been enriched in various cycles. This paper describes the integration and evaluation of the MCR in a commercial classification and (cross-lingual) information retrieval system, developed by Irion Technologies. We carried out a series of task-based evaluations on English and Spanish news collections, for which indexes were built with an...

Abstract. In this paper, we report our effort at the standardization, design and partial implementation of a multilingual dictionary in the context of three large scale projects, viz., (i) Cross Lingual Information Retrieval, (ii) English to Indian Language Machine Translation, and (iii) Indian Language ...

Abstract. In this paper, we report our effort at the standardization, design and partial implementation of a multilingual dictionary in the context of three large scale projects, viz., (i) Cross Lingual Information Retrieval, (ii) English to Indian Language Machine Translation, and (iii) Indian Language ...