WesGtoX / cialdnb

A command line application to extract data from websites.

CIALdnb

About  |   Overview  |   Technology  |   Getting Started  |   Roadmap  |   License

About the Project

CIALdnb is a command line application, which through a list of URL's, extracts the logo data, all the phone numbers on the page, and the link of the visited website.

Overview

• CHANGELOG

Technology

This project was developed with the following technologies:

• Python
• Scrapy
• Docker

Getting Started

Prerequisites

• Docker
• Python (Only if you are going to run via Python)

1. Clone the repository:

git clone https://github.com/WesGtoX/cialdnb.git
cd cialdnb

Install and Run via Docker

2. Build the docker image:

docker build . -t run_cialdnb

3. Run:

cat websites.txt | docker run -i run_cialdnb

4. Can also be run via Makefile:

make build
make run

Install and run via Python

2. Install the dependencies:

python -m venv .venv
source .venv/bin/activate
pip install -r requirements.txt

3. Run:

cat websites.txt | python -m run_cialdnb

Roadmap

See the open issues for a list of proposed features (and known issues).

License

Distributed under the MIT License. See LICENSE for more information.

---

Made with ♥ by Wesley Mendes 👋