nlp-course

Курс по автоматической обработке текстов.

Stars
7

email: [email protected]

telegram: @king_menin

1 (21 ) : . , . Sequence labeling , , POS-, . . .
2 (28 ) . .
3 (12 ) . . .
4 (26 ) . . .

21

 : [git:sem1](https://github.com/king-menin/nlp-course/tree/master/sem%201)

1: intro.pdf

2: morphology.pdf, sem1.ipynb, : hw1.ipynb

Python:

  • nltk; nltk Python3
import nltk
nltk.download('stopwords')
nltk.download('punkt')
  • pymorphy2
  • matplotlib
  • pandas
  • sklearn

28

 : [git:sem2](https://github.com/king-menin/nlp-course/tree/master/sem%202)

3: topic modeling.pdf, topic modeling.ipynb ( , ) topic modeling.ipynb

4: classification.pdf, classification.ipynb ( , ) classification.ipynb, data-train.txt, : hw2.ipynb

Python:

  • nltk; nltk Python3
import nltk
nltk.download('stopwords')
nltk.download('punkt')
  • pymorphy2
  • matplotlib
  • pandas
  • sklearn
  • pymystem3
  • python-rake
  • wordcloud
  • gensim
  • pyLDAvis
  • fasttext ( fastText)

12

 : [ru.vec](https://www.dropbox.com/s/0x7oxso6x93efzj/ru.tar.gz), [all.txt](https://www.dropbox.com/s/ksm21a8y6lgl511/all.txt.zip?dl=0)

5: distributive semantic.pdf, ds.ipynb

Python:

  • gensim
  • pydsm
  • pyemd
  • matplotlib
  • sklearn
  • numpy

26

 : [ru.vec](https://www.dropbox.com/s/0x7oxso6x93efzj/ru.tar.gz), [dinos.txt](https://www.dropbox.com/s/e0v7ex10s5kfu0y/dinos.txt?dl=0), [articles_lemmatized_noSW.csv](https://www.dropbox.com/sh/513tgmhz2ollna5/AAB6W-J3zwKDxKHSUnhjaYINa?dl=0&preview=articles_lemmatized_noSW.csv)

6: neural networks on nlp.pdf, 4_RU_FNN_CNN.ipynb, 5_LM.ipynb

Python:

  • gensim
  • matplotlib
  • sklearn
  • keras
  • pandas

hw3-4.ipynb

( , )

  • Manning, Christopher D., and Hinrich Schtze. Foundations of statistical natural language processing. Vol. 999. Cambridge: MIT press, 1999.
  • Martin, James H., and Daniel Jurafsky. "Speech and language processing." International Edition 710 (2000): 25.
  • Cohen, Shay. "Bayesian analysis in natural language processing." Synthesis Lectures on Human Language Technologies 9, no. 2 (2016): 1-274.
  • Goldberg, Yoav. "Neural Network Methods for Natural Language Processing." Synthesis Lectures on Human Language Technologies 10, no. 1 (2017): 1-309.