zhangisland

MetaGPT

🌟 The Multi-Agent Framework: First AI Software Company, Towards Natural Language Programming

awesome-ai-agents

A list of AI autonomous agents

RD-Agent

Research and development (R&D) is crucial for the enhancement of industrial productivity, especially in the AI era, where the core aspects of R&D are mainly focused on data and models. We are committed to automating these high-value generic R&D processes through our open source R&D automation tool RD-Agent, which lets AI drive data-driven AI.

baml

BAML is a language that helps you get structured data from LLMs, with the best DX possible. Works with all languages. Check out the promptfiddle.com playground

awesome-large-multimodal-agents

WindowsAgentArena

Windows Agent Arena (WAA) 🪟 is a scalable OS platform for testing and benchmarking of multi-modal AI agents.

CLIP

CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an image

MiniCPM-V

MiniCPM-V 2.6: A GPT-4V Level MLLM for Single Image, Multi Image and Video on Your Phone

GroundingDINO

[ECCV 2024] Official implementation of the paper "Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection"

screen_annotation

The Screen Annotation dataset consists of pairs of mobile screenshots and their annotations. The annotations are in text format, and describe the UI elements present on the screen: their type, location, OCR text and a short description. It has been introduced in the paper `ScreenAI: A Vision-Language Model for UI and Infographics Understanding`.

UIED

An accurate GUI element detection approach based on old-fashioned CV algorithms [Upgraded on 5/July/2021]

jax

Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more

intercode

[NeurIPS 2023 D&B] Code repository for InterCode benchmark https://arxiv.org/abs/2306.14898

SwissArmyTransformer

SwissArmyTransformer is a flexible and powerful library to develop your own Transformer variants.

llama3

The official Meta Llama 3 GitHub site

playwright

Playwright is a framework for Web Testing and Automation. It allows testing Chromium, Firefox and WebKit with a single API.

UFO

A UI-Focused Agent for Windows OS Interaction.

MobileAgent

Mobile-Agent: The Powerful Mobile Device Operation Assistant Family

IoA

An open-source framework for collaborative AI agents, enabling diverse, distributed agents to team up and tackle complex tasks through internet-like connectivity.

langroid

Harness LLMs with Multi-Agent Programming

autogen

A programming framework for agentic AI 🤖

MM-REACT

Official repo for MM-REACT

netron

Visualizer for neural network, deep learning and machine learning models

openai-python

The official Python library for the OpenAI API

AutoGPTQ

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

Qwen

The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.

CogVLM

a state-of-the-art-level open visual language model | 多模态预训练模型

generative_agents

Generative Agents: Interactive Simulacra of Human Behavior

AutoAct

[ACL 2024] AUTOACT: Automatic Agent Learning from Scratch for QA via Self-Planning

Data-Copilot

Data-Copilot: Bridging Billions of Data and Humans with Autonomous Workflow