alup

TinyLlama

The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.

ollama

Get up and running with Llama 3, Mistral, Gemma, and other large language models.

sagemaker-ssh-helper

A helper library to connect into Amazon SageMaker with AWS Systems Manager and SSH (Secure Shell)

usearch

Fast Open-Source Search & Clustering engine × for Vectors & 🔜 Strings × in C++, C, Python, JavaScript, Rust, Java, Objective-C, Swift, C#, GoLang, and Wolfram 🔍

quaterion

Blazing fast framework for fine-tuning similarity learning models

datatrove

Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.

pytorch-starspace

PyTorch implementation of StarSpace as described in "StarSpace: Embed All The Things!" by Ledell Wu, Adam Fisch, Sumit Chopra, Keith Adams, Antoine Bordes and Jason Weston

shapemaker

An end-to-end template for AWS Sagemaker projects aiming for maximum flexibility

sagemaker-custom-project-templates

LLMs-from-scratch

Implementing a ChatGPT-like LLM in PyTorch from scratch, step by step

cloud-ml-examples

A collection of Machine Learning examples to get started with deploying RAPIDS in the Cloud

splade

SPLADE: sparse neural search (SIGIR21, SIGIR22)

mrab-regex

gpt-2

Code for the paper "Language Models are Unsupervised Multitask Learners"

chunkdot

Multi-threaded matrix multiplication and cosine similarity calculations for dense and sparse matrices. Appropriate for calculating the K most similar items for a large number of items by chunking the item matrix representation (embeddings) and using Numba to accelerate the calculations.

sagemaker-feature-store-real-time-recommendations

Build a real-time recommendation engine for an e-commerce website leveraging SageMaker Feature Store as a core component of the solution.

sagemaker-studio-custom-image-samples

This repository contains examples of Docker images that can be used as custom images for KernelGateway Apps in SageMaker Studio

amazon-sagemaker-notebook-instance-lifecycle-config-samples

A collection of sample scripts to customize Amazon SageMaker Notebook Instances using Lifecycle Configurations

sagemaker-xgboost-container

This is the Docker container based on open source framework XGBoost (https://xgboost.readthedocs.io/en/latest/) to allow customers use their own XGBoost scripts in SageMaker.

category_encoders

A library of sklearn compatible categorical variable encoders

aws-sdk-pandas

pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

rich

Rich is a Python library for rich text and beautiful formatting in the terminal.

Vim

:star: Vim for Visual Studio Code

amazon-sagemaker-local-mode

Amazon SageMaker Local Mode Examples

kedro

Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.

metarank

A low code Machine Learning personalized ranking service for articles, listings, search results, recommendations that boosts user engagement. A friendly Learn-to-Rank engine

sagemaker-scikit-learn-container

Support code for building and running Amazon SageMaker compatible Docker containers based on the open source framework Scikit-learn (http://scikit-learn.org/stable/)

sagemaker-python-sdk

A library for training and deploying machine learning models on Amazon SageMaker

sample-apps

Repository of sample applications for https://vespa.ai, the open big data serving engine

pyserini

Pyserini is a Python toolkit for reproducible information retrieval research with sparse and dense representations.