summarization

There are 39 repositories under summarization topic.

haystack
deepset-ai / haystack
:mag: LLM orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conversational agent chatbots.
ai bert chatgpt generative-ai gpt-3 information-retrieval language-model large-language-models machine-learning nlp python pytorch question-answering semantic-search squad summarization transformers
Language:Python 13864
miso-belica / sumy
Module for automatic summarization of text documents and HTML pages.
python lsa textteaser html-page summarizer pagerank-algorithm reduction text-extraction html-extraction html-extractor sumy summarization summary nlp
Language:Python 3430
pytextrank
DerwenAI / pytextrank
Python implementation of TextRank algorithms ("textgraphs") for phrase extraction
textrank summarization natural-language-processing nlp machine-learning graph-algorithms spacy spacy-extension natural-language textgraphs python
Language:Python 2107
RL4LMs
allenai / RL4LMs
A modular RL library to fine-tune language models to human preferences
dialogue-generation language-modeling machine-translation natural-language-processing nlp reinforcement-learning summarization table-to-text text-generation
Language:Python 2098
mesolitica / NLP-Models-Tensorflow
Gathers machine learning and Tensorflow deep learning models for NLP problems, 1.13 < Tensorflow < 2.0
nlp machine-learning deep-learning lstm attention lstm-seq2seq-tf neural-machine-translation optical-character-recognition dnc-seq2seq pos-tagging summarization embedded luong-api chatbot speech-to-text language-detection
Language:Jupyter Notebook 1775
chiphuyen / sotawhat
Returns latest research results by crawling arxiv papers and summarizing abstracts. Helps you stay afloat with so many new papers everyday.
script python arxiv summarization research-tool
Language:Python 1324
summanlp / textrank
TextRank implementation for Python 3.
textrank summarization keywords python nlp natural-language-processing text-summarization
Language:Python 1229
xcfcode / Summarization-Papers
Summarization Papers
nlp summarization text-generation natural-language-processing chatgpt pretrained-language-model
Language:TeX 973
fastRAG
IntelLabs / fastRAG
Efficient Retrieval Augmentation and Generation Framework
nlp benchmark colbert information-retrieval semantic-search sentence-transformers summarization transformers diffusion knowledge-graph multi-modal question-answering generative-ai llm
Language:Python 935
atulkum / pointer_summarizer
pytorch implementation of "Get To The Point: Summarization with Pointer-Generator Networks"
nlp deep-learning attention-mechanism summarization pointer-networks pytorch-implmention seq2seq-attn
Language:Python 896
jsksxs360 / How-to-use-Transformers
Transformers 库快速入门教程
bert classification natural-language-processing ner nlp prompt pytorch qa sentiment-classification summarization transformer transformers translation
Language:Python 697
georgian-io / LLM-Finetuning-Toolkit
Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.
classification fine-tuning finetuning large-language-models nlp nlp-machine-learning summarization falcon flan-t5 llama2 lora qlora redpajama ablation-study llm-test mistral-7b unit-testing zephyr
Language:Python 677
namuan / dr-doc-search
Converse with book - Built with GPT-3
gpt3 langchain nlp-machine-learning python summarization
Language:Python 600
JuliaStats / StatsBase.jl
Basic statistics for Julia
julia statistics summarization statistical-models
Language:Julia 565
udibr / headlines
Automatically generate headlines to short articles
keras nlp generation summarization rnn
Language:Jupyter Notebook 526
KoBART
SKT-AI / KoBART
Korean BART
summarization language-model korean-nlp
Language:Python 437
TransformerSum
HHousen / TransformerSum
Models to perform neural summarization (extractive and abstractive) using machine learning transformers and a tool to convert abstractive summarization datasets to the extractive task.
automatic-summarization machine-learning extractive-summarization bert roberta distilbert albert summarization transformer-models pytorch-lightning summarization-dataset text-summarization
Language:Python 425
santhoshkolloju / Abstractive-Summarization-With-Transfer-Learning
Abstractive summarisation using Bert as encoder and Transformer Decoder
bert summarization abstractive-summarization abstractive-text-summarization bert-model transformer transfer-learning nlp nlg
Language:Python 403
Shivanandroy / simpleT5
simpleT5 is built on top of PyTorch-lightning⚡️ and Transformers🤗 that lets you quickly train your T5 models.
classification fine-tuning finetune pytorch simplet5 summarization t5 t5-model training transformers translation
Language:Python 380
ymfa / seq2seq-summarizer
Pointer-generator reinforced seq2seq summarization in PyTorch
pytorch seq2seq attention-mechanism pointer-network reinforcement-learning abstractive-summarization coverage-mechanism attention coverage summarizer summarization
Language:Python 356
artitw / text2text
Text2Text: Crosslingual NLP/G toolkit
nlp question-generation natural-language-processing natural-language-generation data-augmentation translator cross-lingual multi-lingual question-answering transformers levenshtein-distance embeddings backtranslation search tf-idf tokenizer information-retrieval summarization chatgpt llm
Language:Python 274
generative-ai-cdk-constructs
awslabs / generative-ai-cdk-constructs
AWS Generative AI CDK Constructs are sample implementations of AWS CDK for common generative AI patterns.
aws-cdk generative-ai aws langchain retrieval-augmented-generation llm question-answering-system sagemaker summarization amazon-bedrock appsync huggingface opensearch step-functions agent content-generation knowledge-base
Language:TypeScript 274
Alex-Fabbri / Multi-News
Large-scale multi-document summarization dataset and code
multi-document-summarization multi-news summarization
Language:Python 260
nlpodyssey / cybertron
Cybertron: the home planet of the Transformers in Go
bart bert machine-translation question-answering zero-shot-classification bert-as-service transformers huggingface text-classification named-entity-recognition summarization text-categorization text-similarity translation deep-learning machine-learning natural-language-processing nlp
Language:Go 258
onnxt5
abelriboulot / onnxt5
Summarization, translation, sentiment-analysis, text-generation and more at blazing speed using a T5 version implemented in ONNX.
nlp nlp-machine-learning onnx onnxruntime transformer transformers inference summarization translation text-generation text-classification sentiment-analysis
Language:Python 245
bheinzerling / pyrouge
A Python wrapper for the ROUGE summarization evaluation package
rouge summarization evaluation-metrics nlp
Language:Python 245
DavidBelicza / PHP-Science-TextRank
:zap: :elephant: TextRank (resource-efficient and low-cost automatic text summarisation) for PHP
ai airtificialintelligence algorithm php science search summarization textrank
Language:PHP 240
j-min / Adversarial_Video_Summary
Unofficial PyTorch Implementation of SUM-GAN from "Unsupervised Video Summarization with Adversarial LSTM Networks" (CVPR 2017)
video summarization gan vae pytorch
Language:Python 237
summarizepaper / summarizepaper
An AI-powered arXiv paper summarization website with a virtual assistant for answering questions.
ai arxiv arxiv-papers chatgpt django gpt3 langchain llm openai python question-answering research-paper research-tool summarization summarization-platform summarizepaper
Language:Python 229
kubestellar
kubestellar / kubestellar
KubeStellar - a flexible solution for challenges associated with multi-cluster configuration management for edge, multi-cloud, and hybrid cloud
placement scheduling synching deployment edge gitops kubernetes rollout status summarization edge-mc kubestellar
Language:Go 228
Hellisotherpeople / CX_DB8
a contextual, biasable, word-or-sentence-or-paragraph extractive summarizer powered by the latest in text embeddings (Bert, Universal Sentence Encoder, Flair)
contextual-summarization cuda debate-evidence embeddings extractive-summarization flair python semantic-search semantic-summarization summarization summarizer token-level-summarization universal-sentence-encoder
Language:Python 221
crabcamp / lexrank
LexRank algorithm for text summarization
lex rank lexrank algorithm text summary summarization summarizer markov-chains
Language:Python 220
shreyaskarnik / DistiLlama
Chrome Extension to Summarize or Chat with Web Pages/Local Documents Using locally running LLMs. Keep all of your data and conversations private. 🔐
chrome-extension llama2 llms local-llm ollama summarization retrieval-augmented-generation langchain mistral-7b readability privacy-preserving-computing private zephyr
Language:TypeScript 209
DavidBelicza / TextRank
:wink: :cyclone: :strawberry: TextRank implementation in Golang with extendable features (summarization, phrase extraction) and multithreading (goroutine).
go golang textrank summarization token sentence-classification phrase-extraction pagerank
Language:Go 196
pltrdy / files2rouge
Calculating ROUGE score between two files (line-by-line)
natural-language-processing nlp rouge rouge-metric summarization
Language:Perl 191
IlyaGusev / summarus
Models for automatic abstractive summarization
summarization deep-learning machine-learning nlp pytorch
Language:Python 165