imyutaro

DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

semantic-kernel

Integrate cutting-edge LLM technology quickly and easily into your apps

reflex

🕸️ Web apps in pure Python 🐍

candle

Minimalist ML framework for Rust

mage-ai

🧙 Build, run, and manage data pipelines for integrating and transforming data.

bandit

Bandit is a tool designed to find common security issues in Python code.

OpenMetadata

OpenMetadata is a unified metadata platform for data discovery, data observability, and data governance powered by a central metadata repository, in-depth column level lineage, and seamless team collaboration.

mountpoint-s3

A simple, high-throughput file client for mounting an Amazon S3 bucket as a local file system.

YouPlot

A command line tool that draw plots on the terminal.

Awesome-LLMOps

An awesome & curated list of best LLMOps tools for developers

flit

Simplified packaging of Python modules

setup-python

Set up your GitHub Actions workflow with a specific version of Python

data-engineering-wiki

The best place to learn data engineering. Built and maintained by the data engineering community.

MOSS-RLHF

MOSS-RLHF

streamsync

No-code in the front, Python in the back. An open-source framework for creating data apps.

GPyOpt

Gaussian Process Optimization using GPy

japanese-addresses

全国の町丁目レベル（277,191件）の住所データのオープンデータ

scipy2023-deeplearning

Long-Context

This repository contains code and tooling for the Abacus.AI LLM Context Expansion project. Also included are evaluation scripts and benchmark tasks that evaluate a model’s information retrieval capabilities with context expansion. We also include key experimental results and instructions for reproducing and building on them.

matplotlib-venn

Area-weighted venn-diagrams for Python/matplotlib

MetaGym

Collection of Reinforcement Learning / Meta Reinforcement Learning Environments.

sveltris

Piece together any framework with Svelte (like Tetris)

wasminspect

An interactive debugger for WebAssembly

datavault4dbt

Scalefree's dbt package for a Data Vault 2.0 implementation congruent to the original Data Vault 2.0 definition by Dan Linstedt including the Staging Area, DV2.0 main entities, PITs and Snapshot Tables.

HojiChar

The robust text processing pipeline framework enabling customizable, efficient, and metric-logged text preprocessing.

pams

PAMS: Platform for Artificial Market Simulations

timesy

A social technical note application for developers

understanding_deep_generative_models_with_generalized_empirical_likelihood

QAmeleon

QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning PaLM with only five examples per language. We use the synthetic data to finetune downstream QA models leading to improved accuracy in comparison to English-only and translation-based baselines.

instruction_ja

Japanese instruction data (日本語指示データ)