jroakes

Python

All Algorithms implemented in Python

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

blackhat-python3

Source code for the book "Black Hat Python" by Justin Seitz. The code has been fully converted to Python 3, reformatted to comply with PEP8 standards and refactored to eliminate dependency issues involving the implementation of deprecated libraries.

grover

Code for Defending Against Neural Fake News, https://rowanzellers.com/grover/

nlu

1 line for thousands of State of The Art NLP models in hundreds of languages The fastest and most accurate way to solve text problems.

TransformerSum

Models to perform neural summarization (extractive and abstractive) using machine learning transformers and a tool to convert abstractive summarization datasets to the extractive task.

finetune-gpt2xl

Guide: Finetune GPT2-XL (1.5 Billion Parameters) and finetune GPT-NEO (2.7 B) on a single GPU with Huggingface Transformers using DeepSpeed

dliss-tutorial

Tutorial for International Summer School on Deep Learning, 2019

summarus

Models for automatic abstractive summarization

transformer-lm

Transformer language model (GPT-2) with sentencepiece tokenizer

dialogue-generation

Generating responses with pretrained XLNet and GPT-2 in PyTorch.

LeafNATS

Learning Framework for Neural Abstractive Text Summarization

awesome-text-summarization

Text summarization starting from scratch.

mkultra

Prompt tuning toolkit for GPT-2 and GPT-Neo

tech-seo-crawler

Build a small, 3 domain internet using Github pages and Wikipedia and construct a crawler to crawl, render, and index.

HMNet-End-to-End-Abstractive-Summarization-for-Meetings

"End-to-End Abstractive Summarization for Meetings" paper - Unofficial PyTorch Implementation

t-vae

Transformer Variational Autoencoder experiment

GA3toGA4

A Python tool for formatting GA4 data to match and be backfilled with historical GA3 data in BigQuery.

DSS-VAE

Generating Sentences from Disentangled Syntactic and Semantic Spaces

bert2bert-summarization

Abstractive summarization using Bert2Bert framework.

WikiCatSum

Abstractive Multi-Document Summarisation, generating Wikipedia lead sections for specific domains. Exploiting target summaries content structure. Specific categories from WikiSum dataset.

transformers-trainers

Tools for training pytorch language models

data-pipeline

Build a data pipeline using Google BigQuery, dbt, Google Sheets, and Supermetrics. It helps you create a monthly reporting toolkit that pulls in data from a variety of marketing channels.

Electra_with_tensorflow

This is an implementation of electra according to the paper {ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators}

kg_img_monitor

Script to take a list of brand queries and monitor the image found on the KG daily.

Query-Biased-Multi-Document-Abstractive-Summarisation

Implementation for multi-document query-based abstractive summarisation

Roks

Conversational AI

sustain-seq2seq

This repo is a playground for seq2seq models with PyTorch

subdomain-hijacking-scripts

kwmatrix