Preprocessing Text Data

Related field is Information Retrieval. A good online introductory textbook is Christopher D. Manning, Prabhakar Raghavan and Hinrich Schütze, Introduction to Information Retrieval, Cambridge University Press. 2008.

Features

• Bag of words model
• TF-IDF and the vector space model
• Word Embeddings
• Skip-gram Model
• Negative Sampling

Important Papers

• A Neural Network for Machine Translation, at Production Scale
• Google Multilingual Neural Machine Translation System: Enabling Zero-Shot Translation | Video Lecture
• Efficient Estimation of Word Representations in Vector Space
• Distributed Representations of Words and Phrases and their Compositionality
• GloVe: Global Vectors for Word Representation

Software Packages

• ElasticSearch which is also part of the popular ELK stack
• NLTK
• word2vec
• wordnet
• textblob
• flair