Welcome to my AI GENERATED list of interesting repositories in the fields of Generative AI, Artificial Intelligence, and Data Science. As an AI Engineer & Product Development Specialist in these areas, I've compiled this list to help developers, researchers, and enthusiasts stay up-to-date with the latest advancements and tools.
This GitHub landing page is automatically updated every day by AI to showcase my latest interests and discoveries in the fields of AI, Machine Learning, and Data Science.
Here's how it works:
- Automated Updates: The repository list you see below is automatically updated daily using GitHub Actions that I've set up to run the AI pipeline.
- Starred Repositories: The content is based on my GitHub starred repositories, reflecting my current interests and valuable finds in the tech world.
- AI-Powered Organization: An AI model (GPT-4o) is used to categorize and organize the repositories, ensuring that the list remains well-structured and informative.
- Minimal Manual Intervention: Once set up, this page requires little to no manual updating. All I need to do is star a new repo and it will automatically be categorized and added to this document. When I remove a repo from my starred list, the AI automatically removes it from this page.
Why use AI for this?: The key thing that the LLM-based solution is doing is dynamically deciding what categories should exist on this and how to group my starred repos into those categories. It also reassesses and changes the categories and groupings over time as the starred repos change. It does all of this without the need for me to decide in advance what categories it should consider or to pre-train the model on categories. Implementing this algorithm is extremely simple compared to implementing a solution with a more traditional ML/AI approach that doesn't have the NLP reasoning capabilities of an LLM.
- Generative AI
- Artificial Intelligence
- Data Science
- MLOps & AI Infrastructure
- Agentic Frameworks
- Other
- How to Implement This Landing Page On Your Own GitHub
- 🌟 Contributing
- 📄 License
- create-llama - The easiest way to get started with LlamaIndex.
- User-Centric-RAG-Using-Llamaindex-Multi-Agent-System-and-Qdrant - Customize the RAG application with user preferences over LLMs, Embeddings, Search types, and Reranking Models.
- llama-stack - Model components of the Llama Stack APIs.
- LLMs-from-scratch - Implementing a ChatGPT-like LLM in PyTorch from scratch, step by step.
- dynamic-few-shot-llamaindex-workflow - None.
- finetune-Qwen2-VL - None.
- LitServe - Lightning-fast serving engine for any AI model of any size. Flexible. Easy. Enterprise-scale.
- LibreChat - Enhanced ChatGPT Clone with multiple model integrations and security features.
- danswer - Gen-AI Chat for Teams, designed to leverage unique team knowledge.
- llm-answer-engine - Build a Perplexity-Inspired Answer Engine using various modern technologies.
- pandas-ai - Chat with your database (SQL, CSV, pandas, polars, mongodb, noSQL, etc). PandasAI makes data analysis conversational using LLMs (GPT 3.5 / 4, Anthropic, VertexAI) and RAG.
- MLOps-Basics - None.
- Agent-S - Agent S: an open agentic framework that uses computers like a human.
- TapeAgents - A framework facilitating all stages of the LLM Agent development lifecycle.
- example-agents - Examples of AI Agents that can be built on SwarmZero.
- autogen - A programming framework for agentic AI 🤖.
- GENAI-CareerAssistant-Multiagent - GenAI career assistant.
- openai/swarm - Educational framework exploring ergonomic, lightweight multi-agent orchestration.
- Auto_Jobs_Applier_AIHawk - Auto_Jobs_Applier_AIHawk is a tool that automates the jobs application process.
- insanely-fast-whisper - None.
- crawl4ai - Open-source LLM Friendly Web Crawler & Scrapper.
- qa-mdt - SOTA Text-to-music (TTM) Generation (OpenMusic).
- Pyramid-Flow - Code of Pyramidal Flow Matching for Efficient Video Generative Modeling.
- UltimateTab - Enhanced, ads-free and fast responsive interface to browse guitar tabs scraped from Ultimate Guitar.
- fabric - An open-source framework for augmenting humans using AI.
- niledatabase/niledatabase - PostgreSQL reengineered for multi-tenant apps.
- openai_realtime_client - A simple client and utils for interacting with OpenAI's Realtime API in Python.
- Prompt_Engineering - A collection of tutorials and implementations for Prompt Engineering techniques.
- weave - Weave is a toolkit for developing AI-powered applications.
This project automatically updates the README with your GitHub starred repositories using a Python script and GitHub Actions.
# 1. Clone the repository:
git clone https://github.com/your-username/github-genai-list.git
cd github-genai-list
# 2. Set up your environment:
# Ensure you have Python 3.x installed. You can check your version with:
python --version
# 3. Install dependencies:
# First, make sure pip is up-to-date:
python -m pip install --upgrade pip
# Then install the required dependencies:
pip install -r requirements.txt
# 4. Set up GitHub secrets:
# Go to your GitHub repository settings, and under Secrets and variables > Actions, create the following secrets:
# GITHUB_TOKEN: Your personal access token for GitHub API.
# OPENAI_API_KEY: Your API key for OpenAI (if applicable for LLM updates).
# PAT: A GitHub Personal Access Token with appropriate permissions
# 5. Update the script:
# In the update_readme.py script located in the scripts/ directory, replace "YourGitHubUsername" with your actual GitHub username.
# 6. Configure the GitHub Action:
# The workflow is already set up in .github/workflows/update-readme.yml.
# It runs daily at midnight (UTC) or can be triggered manually via the GitHub Actions tab.
# 7. Running locally (optional):
# You can also run the script manually to test it locally:
python scripts/update_readme.py
# 8. Commit and push changes:
git add .
git commit -m "Updated project structure"
git push origin main
# 9. Customize the README:
# You can modify the README.md template to fit your personal brand and interests.
# The GitHub Action will automatically update it with your latest starred repositories daily.Note: This landing page uses OpenAI's GPT-4o model. Make sure you comply with OpenAI's use-case policies and monitor your API usage to manage costs.
Feel free to open a pull request if you have any suggestions for additions or improvements to this list. Let's collaborate to keep this resource up-to-date and valuable for the community!
This project is licensed under the MIT License - see the LICENSE.md file for details.
📊 Last edited: October 20, 2024
🔗 Connect with me on LinkedIn