endliang

crawlee-python

Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.

Python3WebSpider

Source File of My Book related to WebSpider

TweetFeed

TweetFeed collects Indicators of Compromise (IOCs) shared by the infosec community at Twitter. Here you will find malicious URLs, domains, IPs, and SHA256/MD5 hashes.

OpenDevin

🐚 OpenDevin: Code Less, Make More

AutoGPT

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

awesome-open-gpt

Collection of Open Source Projects Related to GPT，GPT相关开源项目合集🚀、精选🔥🔥

nas-tools

NAS媒体库管理工具

ChatDev

Create Customized Software using Natural Language Idea (through LLM-powered Multi-Agent Collaboration)

awesome-ml-for-cybersecurity

:octocat: Machine Learning for Cyber Security

malicious-URL-detection

本科毕设：URL恶意性检测，基于字符串本身进行特征提取，基于sklearn库的机器学习模型进行分类（附实验数据于data文件夹）

grok-1

Grok open release

Supershell

Supershell C2 远控平台，基于反向SSH隧道获取完全交互式Shell

404StarLink

404StarLink - 推荐优质、有意义、有趣、坚持维护的安全开源项目

Github-Monitor

Github Sensitive Information Leakage Monitor(Github信息泄漏监控系统)

ghauri

An advanced cross-platform tool that automates the process of detecting and exploiting SQL injection security flaws

HackBrowserData

Extract and decrypt browser data, supporting multiple data types, runnable on various operating systems (macOS, Windows, Linux).

app-env-docker

基于 Docker 的真实应用测试环境

SecGPT

SecGPT网络安全大模型

github-cve-monitor

实时监控github上新增的cve、自定义关键字、安全工具更新、大佬仓库监控，并多渠道推送通知

NucleiTP

自动整合全网Nuclei的漏洞POC，实时同步更新最新POC！

WeChatFerry

微信机器人底层框架，可接入Gemini、ChatGPT、ChatGLM、讯飞星火、Tigerbot等大模型。WeChat Robot Hook.

PyWxDump

获取微信账号信息(昵称/账号/手机/邮箱/数据库密钥/wxid)；PC微信数据库读取、解密脚本；聊天记录查看工具；聊天记录导出为html(包含语音图片)。支持多账户信息获取，支持所有微信版本。

WeChatMsg

提取微信聊天记录，将其导出成HTML、Word、Excel文档永久保存，对聊天记录进行分析生成年度聊天报告，用聊天数据训练专属于个人的AI聊天助手

Java-Rce-Echo

Java RCE 回显测试代码

cnvd_spider

监测cnvd漏洞信息

Goby

Skywork

Skywork series models are pre-trained on 3.2TB of high-quality multilingual (mainly Chinese and English) and code data. We have open-sourced the model, training data, evaluation data, evaluation methods, etc. 天工系列模型在3.2TB高质量多语言和代码数据上进行预训练。我们开源了模型参数，训练数据，评估数据，评估方法。

ChatGLM3

ChatGLM3 series: Open Bilingual Chat LLMs | 开源双语对话语言模型

jar-analyzer

Jar Analyzer - 一个JAR包分析工具，批量分析JAR包搜索，方法调用关系搜索，字符串搜索，Spring组件分析，CFG分析，JVM Stack Frame分析，远程分析Tomcat，进阶表达式搜索，自定义SQL查询，字节码查看，字节码指令级的动态调试分析，反编译JAR包一键导出，一键提取序列化数据恶意代码

ja4

JA4+ is a suite of network fingerprinting standards