Repository navigation
unigram
- Website
- Wikipedia
Telegram for Windows
Build unigram and bigram language models, implement Laplace smoothing and use the models to compute the perplexity of test corpora.
Next Word Prediction using n-gram Probabilistic Model with various Smoothing Techniques
Fast and versatile tokenizer for language models, compatible with SentencePiece, Tokenizers, Tiktoken and more. Supports BPE, Unigram and WordPiece tokenization in JavaScript, Python and Rust.
The Unigram website build with React and Bootstrap.
NLP tutorials and guidelines to learn efficiently
Telegram bot that generates random messages using a Markov chain, now for Node.js
All AUT's principles and applications of artificial intelligence course projects.
Python Web Crawler implementing Iterative Deepening Depth Search
UNB Fall-2018 NLP Assignments 💬
We have implemened an NLP Project to recognize the correct poets. In the project, we have used the bigram, unigram and backoff model for smoothing.
Performance evaluation of sentiment classification on movie reviews
COMP6721: Introduction to Artificial Intelligence Assignments (GOFAI, Machine Learning, NLP)
Academic project centered around n-grams and their application in developing a spelling corrector with contextual awareness.
Unigram Tokenization realization from scratch