Identification (biology)

Language identification

World Wide Web

Philosophy

Artificial intelligence

Natural language

Natural language processing

Information retrieval

Data science

Key (lock)

Open research

Computer security

Computer science

Linguistics

Notation

Botany

Biology

Journal of Artificial Intelligence Research

&#x0D; &#x0D; &#x0D; Language identification (“LI”) is the problem of determining the natural language that a document or part thereof is written in. Automatic LI has been extensively researched for over fifty years. Today, LI is a key part of many text processing pipelines, as text processing techniques generally assume that the language of the input text is known. Research in this area has recently been especially active. This article provides a brief history of LI research, and an extensive survey of the features and methods used in the LI literature. We describe the features and methods using a unified notation, to make the relationships between methods clearer. We discuss evaluation methods, applications of LI, as well as off-the-shelfLI systems that do not require training by the end user. Finally, we identify open issues, survey the work to date on each issue, and propose future directions for research in LI.&#x0D; &#x0D; &#x0D;

Automatic Language Identification in Texts: A Survey