Foundation NLP

Basic nlp

1. Benchmarking tokenizers for optimalprocessing speed

2. Using nltk with gensim

3. Multiclass text classification with svm/nb/mean w2v/d2v - tutorial with code and notebook.

4. Basic pipeline for keyword extraction

5. DL for text classification

   1. Logistic regression with word ngrams

   2. Logistic regression with character ngrams

   3. Logistic regression with word and character ngrams

   4. Recurrent neural network (bidirectional GRU) without pre-trained embeddings

   5. Recurrent neural network (bidirectional GRU) with GloVe pre-trained embeddings

   6. Multi channel Convolutional Neural Network

   7. RNN (Bidirectional GRU) + CNN model

6. LexNLP - glorified regex extractor

Chunking

1. Coding Chunkers as Taggers: IO, BIO, BMEWO, and BMEWO+

NLP for hackers tutorials

1. How to convert between verb/noun/adjective/adverb forms using Wordnet

2. Complete guide for training your own Part-Of-Speech Tagger - using Penn Treebank tagset. Using nltk or stanford pos taggers, creating features from actual words (manual stemming, etc0 using the tags as labels, on a random forest, thus creating a classifier for POS on our own. Not entirely sure why we need to create a classifier from a “classifier”.

3. Word net introduction - POS, lemmatize, synon, antonym, hypernym, hyponym

4. Sentence similarity using wordnet - using synonyms cumsum for comparison. Today replaced with w2v mean sentence similarity.

5. Stemmers vs lemmatizers - stemmers are faster, lemmatizers are POS / dictionary based, slower, converting to base form.

6. Chunking - shallow parsing, compared to deep, similar to NER

7. NER - using nltk chunking as a labeller for a classifier, training one of our own. Using IOB features as well as others to create a new ner classifier which should be better than the original by using additional features. Aso uses a new english dataset GMB.

8. Building nlp pipelines, functions coroutines etc..

9. Training ner using generators

10. Metrics, tp/fp/recall/precision/micro/weighted/macro f1

11. Tf-idf

12. Nltk for beginners

13. Nlp corpora corpuses

14. bow/bigrams

15. Textrank

16. Word cloud

17. Topic modelling using gensim, lsa, lsi, lda,hdp

18. Spacy full tutorial

19. POS using CRF

Synonyms

1. Python Module to get Meanings, Synonyms and what not for a given word using vocabulary (also a comparison against word net) https://vocabulary.readthedocs.io/en/…

For a given word, using Vocabulary, you can get its

• Meaning

• Synonyms

• Antonyms

• Part of speech : whether the word is a noun, interjection or an adverb et el

• Translate : Translate a phrase from a source language to the desired language.

• Usage example : a quick example on how to use the word in a sentence

• Pronunciation

• Hyphenation : shows the particular stress points(if any)

Swiss army knife libraries

1. textacy is a Python library for performing a variety of natural language processing (NLP) tasks, built on the high-performance spacy library. With the fundamentals — tokenization, part-of-speech tagging, dependency parsing, etc. — delegated to another library, textacy focuses on the tasks that come before and follow after.

Collocation

1. What is collocation? - “the habitual juxtaposition of a particular word with another word or words with a frequency greater than chance.”Medium tutorial, quite good, comparing freq/t-test/pmi/chi2 with github code

2. A website dedicated to collocations, methods, references, metrics.

3. Text analysis for sentiment, doing feature selection a tutorial with chi2(IG?), part 2 with bi-gram collocation in ntlk

4. Text2vec in R - has ideas on how to use collocations, for downstream tasks, LDA, W2V, etc. also explains about PMI and other metrics, note that gensim metric is unsupervised and probablistic.

5. NLTK on collocations

6. A blog post about keeping or removing stopwords for collocation, usefull but no firm conclusion. Imo we should remove it before

7. A blog post with code of using nltk-based collocation

8. Small code for using nltk collocation

9. Another code / score example for nltk collocation

10. Jupyter notebook on manually finding collocation - not useful

11. Paper: Ngram2Vec - Github We introduce ngrams into four representation methods. The experimental results demonstrate ngrams’ effectiveness for learning improved word representations. In addition, we find that the trained ngram embeddings are able to reflect their semantic meanings and syntactic patterns. To alleviate the costs brought by ngrams, we propose a novel way of building co-occurrence matrix, enabling the ngram-based models to run on cheap hardware

12. Youtube on bigrams, collocation, mutual info and collocation

Language detection

1. Using google lang detect - 55 languages af, ar, bg, bn, ca, cs, cy, da, de, el, en, es, et, fa, fi, fr, gu, he, hi, hr, hu, id, it, ja, kn, ko, lt, lv, mk, ml, mr, ne, nl, no, pa, pl, pt, ro, ru, sk, sl, so, sq, sv, sw, ta, te, th, tl, tr, uk, ur, vi, zh-cn, zh-tw

Stemming

How to measure a stemmer?

1. References [1 2(apr11) 3(Index compression factor ICF) 4 5]

Phrase modelling

1. Phrase Modeling - using gensim and spacy

Phrase modeling is another approach to learning combinations of tokens that together represent meaningful multi-word concepts. We can develop phrase models by looping over the the words in our reviews and looking for words that co-occur (i.e., appear one after another) together much more frequently than you would expect them to by random chance. The formula our phrase models will use to determine whether two tokens AA and BB constitute a phrase is:

count(A B)−countmincount(A)∗count(B)∗N>threshold

1. SO on PE.

Document classification

1. Using hierarchical attention network

Hebrew NLP tools

1. HebMorph last update 7y ago

2. Hebmorph elastic search Hebmorph blog post, and other blog posts, youtube

3. Awesome hebrew nlp git, git

4. Hebrew-nlp service docs the features (morphological analysis, normalization etc), git

5. Apache solr stop words (dead)

6. SO on hebrew analyzer/stemming, here too

7. Neural sentiment benchmark using two algorithms, for character and word level lstm/gru - the paper

8. Hebrew word embeddings

9. Paper for rich morphological datasets for comparison - rivlin

Semantic roles:

1. http://language.worldofcomputing.net/semantics/semantic-roles.html