honglu2875

hironaka

A utility package for Hironaka game of local resolution of singularities

thing

Catch your tensors in one program and quietly send to another live python session.

mistral_jax

Mistral model in JAX

_diff_model

documenting scripts and workflows for diff model training

fmlang_env

Toy gym env related to formal languages.

hironaka-experiments

Document the experiments of hironaka project

_ft_dockerfile

Algorithm-Distillation-RLHF

ArchitextRL

aria

capabilities

Blazon Capabilities SDK

composer

Train neural networks up to 7x faster

deep_cfg

examples

Fast and flexible reference benchmarks

go

Implement RL (MCTS) on Go.

gpt-neox

An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.

hironaka_v2

This is a clean redo using only JAX and we reconstruct a simpler design.

honglu2875

Config files for my GitHub profile.

honkhonk

honk honk honk honk, honk honk!

honx

honx honx!

jag

Just Another deep learninG framework

jaxformer

Minimal library to train LLMs on TPU in JAX with pjit().

llama

Inference code for LLaMA models

llama.cpp

Port of Facebook's LLaMA model in C/C++

lm-evaluation-harness

A framework for few-shot evaluation of autoregressive language models.

slightly-faster-gpt

A slightly faster GPT-J than Huggingface

test_github_action

tweets

janky twitter replacement

yarn

YaRN: Efficient Context Window Extension of Large Language Models

yarn-patch

This repo exposes simple APIs to patch the YaRN technique to the rotary embeddings of a given Hugging Face model.