pos-tagging

Natural Language Processing for the next decade. Tokenization, Part-of-Speech Tagging, Named Entity Recognition, Syntactic & Semantic Dependency Parsing, Document Classification

Gathers machine learning and Tensorflow deep learning models for NLP problems, 1.13 < Tensorflow < 2.0

Underthesea - Vietnamese NLP Toolkit

Persian NLP Toolkit

Developer friendly Natural Language Processing ✨

Jcseg is a light weight NLP framework developed with Java. Provide CJK and English segmentation based on MMSEG algorithm, With also keywords extraction, key sentence extraction, summary extraction implemented based on TEXTRANK algorithm. Jcseg had a build-in http server and search modules for lucene,solr,elasticsearch,opensearch

Self-contained Japanese Morphological Analyzer written in pure Go

A Japanese Tokenizer for Business

PhoBERT: Pre-trained language models for Vietnamese (EMNLP-2020 Findings)

A Vietnamese natural language processing toolkit (NAACL 2018)

Natural Language Toolkit for Malaysian language, https://malaya.readthedocs.io/

A suite of Arabic natural language processing tools developed by the CAMeL Lab at New York University Abu Dhabi.

CogComp's Natural Language Processing Libraries and Demos: Modules include lemmatizer, ner, pos, prep-srl, quantifier, question type, relation-extraction, similarity, temporal normalizer, tokenizer, transliteration, verb-sense, and more.

API of Articut 中文斷詞 (兼具語意詞性標記)：「斷詞」又稱「分詞」，是中文資訊處理的基礎。Articut 不用機器學習，不需資料模型，只用現代白話中文語法規則，即能達到 SIGHAN 2005 F1-measure 94% 以上，Recall 96% 以上的成績。

Python version of Sudachi, a Japanese tokenizer.

A neural network architecture for NLP tasks, using cython for fast performance. Currently, it can perform POS tagging, SRL and dependency parsing.

A Japanese tokenizer based on recurrent neural networks

Juman++ (a Morphological Analyzer Toolkit)

Sudachi in Rust 🦀 and new generation of SudachiPy

Empower Sequence Labeling with Task-Aware Neural Language Model | a PyTorch Tutorial to Sequence Labeling