Manas-Embold

Megatron-LM

Ongoing research training transformer models at scale

mesh-transformer-jax

Model parallel transformers in JAX and Haiku

GLM

GLM (General Language Model)

BIG-bench

Beyond the Imitation Game collaborative benchmark for measuring and extrapolating the capabilities of language models

copilot-clone

VSCode extension for code suggestion

Project_CodeNet

This repository is to support contributions for tools for the Project CodeNet dataset hosted in DAX

OCTIS

OCTIS: Comparing Topic Models is Simple! A python package to optimize and evaluate topic models (accepted at EACL2021 demo track)

ProphetNet

A research project for natural language generation, containing the official implementations by MSRA NLC team.

fastT5

⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.

KENLG-Reading

Author: Wenhao Yu (wyu1@nd.edu). ACM Computing Survey'22. Reading list for knowledge-enhanced text generation, with a survey.

pash

PaSh: Light-touch Data-Parallel Shell Processing

vulnerablecode

A free and open vulnerabilities database and the packages they impact. And the tools to aggregate and correlate these vulnerabilities. Sponsored by NLnet https://nlnet.nl/project/vulnerabilitydatabase/ for https://www.aboutcode.org/ Chat at https://gitter.im/aboutcode-org/vulnerablecode Docs at https://vulnerablecode.readthedocs.org/

commit-autosuggestions

A tool that AI automatically recommends commit messages.

python-graphs

A static analysis library for computing graph representations of Python programs suitable for use with graph neural networks.

CodeTrans

Pretrained Language Models for Source code

gitDigger

compacter

FUNDED_NISL

FUNDED is a novel learning framework for building vulnerability detection models.

D2A

This repository is to support contributions for tools and new data entries for the D2A dataset hosted in DAX

porting

Helper scripts and notes that were used while porting various nlp models

Logram

Efficient Log Parsing Using n-Gram Dictionaries

CodeBERT

CodeBERT

BigDataCourse

Materials for the Advanced Data Analysis Techniques with Apache Spark mini-course

CCSD-benchmark-for-code-summarization

This repo is the benchmark for source code summarization on C language

vscode-codecomplete

This repo contains all of the code for my Youtube series on how to create a VSCode extension for autocompleting code using Deep Learning!

tourniquet

A Python library for easy and fast program transformation/repair

PyART

DataSet and source code for PyART

Duets

Duets is a dataset of 395 open-source Maven-based libraries and 2,874 clients https://ieeexplore.ieee.org/abstract/document/9463096

Gpu-bandwidth-benchmark

A test to see the speed of transfer of tensors from cpu to gpu in pytorch with 2 cuda streams

T5_Replication_Package