[WIP] Portuguese Natural Language Processing with Python

This reporsitoy keeps an ongoing e-book about Natural Language Processing wiih Python with a focus on Portuguese Language (mainly Portugal and Brazil varieties) .

The main goal for this e-book is to show how to use python and the several libraries available to process the Portuguese language.

Outline

0. Preface

1. Python for Natural Language Processing

• Why Python?
• Python 2 vs Python 3
• Encodings
• Best Practices

2. NLP Resources for Portuguese

• Lexicons
  • Setiment Analysis
    • OpLexicon
    • LIWC
    • SentiLex
    • Priberam Subjective Lexicon
• Gazetters
  • DBPedia
  • Other lists
• Dicionaries
  • Unitex
  • Open Dictionary
  • Wiki Dictionary
• Thesauri
  • TEP
  • Open Thesaurus
  • Onto.PT
• Wordnets
  • WordNet.BR
  • WordNet.PT
  • Onto.PT
  • Open WordNet-PT
  • MultiWordNet
• Corpora
  • PoS
    • MacMorpho
  • Parsing
    • Floresta Sinta(c)tica
  • Sentiment Analysis
    • Priberam Fine-Grained Opinion Corpus
    • ReLi

3. Language Statistics

• Frequency Distribution
• Lexical Variety
• Zipf's law
• Luhn cut
• String distance
• Fuzzy matching

4. NLP Processing

• Speech Recognition
• Language Detection
• Sentence Tokenization
• Word Tokenization
• Morphological Analysis
• Part of Speech Tagging
• Parsing
• Named Entity Recognition
• Semantic Analysis

5. NLP Taks and Applications

• Speller
• Grammar checker
• Term Extraction
• Text Classification
• Topic Detection
• Automatic Summarization
• Word-sense -Disambiguation
• Machine Tranlation
• Sentiment Analysis

6. Natural Language Generation

• Random-text Generation

7. NLP Classification

Representations

• Bag-of-words
• Language Model
• Word Embeddings

Classifiers

• SVM
• CRF
• Random-forest

8. Information Extraction

9. Data Mining

10. Information Retrieval

Appendix

Python Libraries for NLP

• chardet, unidecode
• PyEnchant, hunspell
• stemming
• Soundex, Metaphone
• Fuzzywuzzy, jellyfish
• brasil.vocab, certografia
• Whoosh, cwb-python, Pattern, Newspaper
• NLTK, TextBlob, MontyLingua, spaCy, PyNLPl, polyglot, PyPLN
• nlpnet, MBSP
• gensim
• sumy, textteaser, TextRank
• MITIE, RAKE
• scikit-learn, CRFsuite

Author

Pedro Paulo Balage pedrobalage.com