ngram-language-model

There are 5 repositories under ngram-language-model topic.

• bennyschmidt / next-token-prediction

  Next-token prediction in JavaScript — build fast language and diffusion models.

  aiautocompleteautocompletiondiffusion-modelslanguage-modelsllmmarkov-chainnext-token-predictionngram-language-modelngramspixel-predictionword-prediction
  Language:JavaScript 119

• joshualoehr / ngram-language-model

  Python implementation of an N-gram language model with Laplace smoothing and sentence generation.

  ngram-language-modelngramperplexitynlplanguage-modelpythonlaplace-smoothingngramslanguage-modelssmoothing-methods
  Language:Python 76

• StarlangSoftware / NGram-Py

  Ngrams with Basic Smoothings

  ngram-language-modelngramsmoothing-methodsgood-turing-smoothinglaplace-smoothing
  Language:Python 20

• jermp / tongrams_estimation

  A C++ library implementing fast language models estimation using the 1-Sort algorithm.

  ngramsngram-language-model
  Language:C++ 16

• KhaledAshrafH / Auto-Filling-Text

  This project is an auto-filling text program implemented in Python using N-gram models. The program suggests the next word based on the input given by the user. It utilizes N-gram models, specifically Trigrams and Bigrams, to generate predictions.

  auto-completeauto-complete-textauto-fillingbigram-modelbigramsn-gramn-gramsnatural-language-processingnews-articlesngramngram-analysisngram-language-modelngram-modelngramsnlptkintertkinter-guitrigramtrigram-modeltrigrams
  Language:Python 13

• Priyansh2 / Spelling-and-Grammatical-Error-Correction

  Built a system from scratch in Python which can detect spelling and grammatical errors in a word and sentence respectively using N-gram based Smoothed-Language Model, Levenshtein Distance, Hidden Markov Model and Naive Bayes Classifier.

  ngram-language-modelsmoothing-methodshmm-viterbi-algorithmhmmnaive-bayesmachine-learningnlplevenshtein-distancegrammatical-error-detectionspellchecker
  Language:Jupyter Notebook 13

• touhi99 / N-gram-Language-model

  Programming for NLP Project - Implement a basic n-gram language model and generate sentence using beam search

  ngram-language-modelngrambeam-searchperplexity
  Language:Python 13

• remnestal / fakenews

  Markov model for generating fake headlines :pencil2:

  markov-chainngram-language-modelpython3
  Language:Python 12

• 2654400439 / emoji_text_translator

  A general emoji-text translator which translates emoji-text to chinese

  bert-modelemojingram-language-modeltranslation
  Language:Python 6

• StarlangSoftware / NGram-CPP

  Ngrams with Basic Smoothings

  ngram-language-modelngramsmoothing-methodsgood-turing-smoothinglaplace-smoothinginterpolated-knesser-ney
  Language:C++ 6

• burhanharoon / N-Gram-Language-Model

  It's a python based n-gram langauage model which calculates bigrams, probability and smooth probability (laplace) of a sentence using bi-gram and perplexity of the model.

  ngramsngram-language-modelpythonbigramsbigram-modelnlpperplexityprobabilistic-modelshacktoberfesthacktoberfest2022
  Language:Python 5

• nikhil-iyer-97 / Language-Identifier

  Language identification toolkit for identifying what language a document is writen in

  language-identificationnltknatural-language-processingngram-language-modelcorpus-linguistics
  Language:Python 5

• levindoneto / lanGen

  N-Gram language model that learns n-gram probabilities from a given corpus and generates new sentences from it based on the conditional probabilities from the generated words and phrases.

  language-modellingn-gramsgeneratornatural-language-processingngram-language-modelcorpus-processing
  Language:Python 4

• pharo-ai / NgramModel

  Ngram language model implemented in Pharo

  language-modelnatural-language-processingngram-language-modelngramspharostatistics
  Language:Smalltalk 4

• StarlangSoftware / NGram

  Ngrams with Basic Smoothings

  ngram-language-modelngramsmoothing-methodsgood-turing-smoothinglaplace-smoothing
  Language:Java 4

• StarlangSoftware / NGram-CS

  Ngrams with Basic Smoothings

  ngram-language-modelngramsmoothing-methodsgood-turing-smoothinglaplace-smoothing
  Language:C# 4

• eddieir / Language_identifier

  Language identifier with using ngram language model

  nltknlppython3ngramngram-language-model
  Language:Python 3

• MohammadJavadArdestani / NLP-persian-poet-identification

  NLP-persian-poet-identification

  nlpngram-language-modelbigram-modelunigram-modelbackoff-model
  Language:Python 3

• al-becker / StatisticalGrammarChecker

  Part of a semester project this grammarchecker uses a n-gram language model to detect grammatical errors and a bert model is used to generate suggestions.

  grammarcheckerbert-modelngram-language-model
  Language:Python 2

• mbauwens / clin32-entropy

  This demo accompanies the poster presentation "Limitations of the entropy measure in n-gram language modelling".

  entropyngram-language-modelnlp
  Language:Jupyter Notebook 2

• trinhtuanvubk / finetune-wav2vec2

  dockerfine-tuningngram-language-modelspeech-recognitionwav2vec2wav2vec2-base-960h
  Language:Python 2

• wmentor / qgram

  N-gram Go library

  gogolanggolang-librarygo-libraryquadrigramngramsngram-analysisngram-modelngram-language-modelngram-extraction
  Language:Go 2

• alinamuliak / N-gramTextPrediction

  Prediction of the following words using N-gram technique.

  ngram-language-modelc-plus-plusnlpnext-word-predictionhpc
  Language:C++ 1

• camilleg / sim-audio-sfe

  Simulated Audio Situation Frame Evaluation (SASFE) for Lorelei

  scraperngram-language-model
  Language:Python 1

• j-ahmadkhan / Text-Stylometry-Analyser

  This software is an implementation of Author's stylometric change detection algorithm. It can be used in text forensics.

  stylometrystylometric-featuresstylometric-techniquesopennlp-modelsngram-language-modelngram-analysis
  Language:C# 1

• jonnyli1125 / piemanese-translator

  Webspeak to English statistical + neural hybrid machine translation model.

  ngram-language-modelmachine-translationsimilarity-learning
  Language:Jupyter Notebook 1

• kiarashrahmani / Word-Prediction-Using-Ngrams

  A simple NLP project for word prediction using N-grams.

  ngram-language-modelngramsnlppythonwordprediction
  Language:Jupyter Notebook 1

• mohansaidinesh / Language-Detection

  Automatically identifying the language of a given text or document

  accuracycnndeep-learninglanguagedetectionmachine-learningnaive-bayes-classifierngram-language-modelnlpstatistical-models
  Language:Jupyter Notebook 1

• sindhura-pv / Authorship-Identification-and-Text-Generation

  Prediction using a Ngram language model the probability that a given text is the work of a certain author. Also generates a text similar to the work of a given author

  natural-language-processingngram-language-modeltext-generationauthor-identification
  Language:Python 1

• SpydazWebAI-NLP / BasicLanguageModelling2023

  Basic Language Models , Bag of Words, Ngram Models Etc NLP modelling and associated tasks

  bagofwordslanguage-modellanguage-modelingmodelling-frameworkngram-language-modelngram-modelngramsautogradembedding-matrixneural-networksnlpnlp-machine-learningvb-netvisual-basic
  Language:Visual Basic .NET 1

• SpydazWebAI-NLP / SpydazWebAI_NLP_Models

  Word/Image/Audio Embedding models, Tokenizer models, Ngram language models, MatrixModels, Corpus building, Vocabulary Building, Language modelling

  audio2vecbayesian-inferencebpecooccurrenceembeddingsimage2veclatent-dirichlet-allocationmatrixminhash-lsh-algorithmmutual-informationngram-language-modeltokenizationtokenizervocabulary-builderword2vecword2word-matrixwordgramswordpeicewordpiece-tokenization
  Language:Visual Basic .NET 1

• StarlangSoftware / NGram-Cy

  Ngrams with Basic Smoothings

  ngramngram-language-modellaplace-smoothinggood-turing-smoothingsmoothing-methods
  Language:Cython 1

• StarlangSoftware / NGram-Js

  Ngrams with basic smoothing.

  ngramngram-language-modellaplace-smoothinggood-turing-smoothingsmoothing-methods
  Language:TypeScript 1

• thinkingTEA / repoTEA

  This repository contains the group projects undertaken during the course "Text Engineering and Analytics" taught by Prof. Ion Androutsopoulos in the context of Msc. in Data Science at Athens University of Economics and Business.

  jupyter-notebooktext-engineeringtext-analyticsneural-networkstext-classificationpos-taggingngram-language-modelkneser-ney-smoothingpythonkeras-neural-networks
  Language:Jupyter Notebook 1

• avijay24 / NgramModelfromScratch

  Implemented a collection of Ngram language models on brown corpus from scratch

  advanced-text-analysisbrown-corpusngram-language-modeltext-analysis
  Language:Jupyter Notebook

• marina-sam14 / Context-Aware-Spelling-Corrector

  Academic project centered around n-grams and their application in developing a spelling corrector with contextual awareness.

  bigramlevenshtein-distancenatural-language-processingngram-language-modelngramsnlpspelling-correctiontrigramunigram
  Language:Jupyter Notebook