neptun-software / data-scraper

A webscraper for teaching a LLM to be an expert in devops.

Neptun Webscraper

Install it from PyPI

pip install neptun_webscraper

Usage

from neptun_webscraper import BaseClass
from neptun_webscraper import base_function

BaseClass().base_method()
base_function()

python -m neptun_webscraper

neptun_webscraper

Docker Hub Scraper

python -m neptun_webscraper dockerhub --query=python

Quay IO Scraper

python -m neptun_webscraper quay --query=python

Development

Create a virtualenv

make virtualenv
source .venv/bin/activ

Format the code

make fmt

Lint the code

make lint

Contributing

More commands are in the Makefile.

Read the CONTRIBUTING.md file.