denisecase / datafun-05-sql

datafun-05-sql

This project partially completes the requirements for datafun-05-spec.

Organization

The existing script assumes we will create and use two subfolders:

• data - to hold the .csv data files
• sql - to hold the .sql SQL scripts with commands for creating tables, etc.

Python Standard Library

The project uses these packages from the Python Standard Library:

• pathlib - to work with folders and files
• sqlite3 - to work with a Sqlite file-based database

If you want to avoid using a project virtual enviroment, it is possible to use the csv module from the Python Standard Library to read csv files.

External Packages & Project Virtual Environment

To work with csv files using a bit cleaner code, we choose to use pandas, an external library, not part of the Python Standard Library. Therefore, this project requires a project virtual environment, which we recommend creating in the .venv folder.

Note: Installing pandas also requires installing pyarrow, so we will install both when managing our project virtual environment.

Suggested Commands - Windows

The following commands can be used in Windows PowerShell. Run one at a time, wait for each to finish.

Create a virtual environment.

py -m venv .venv

Activate the virtual environment.

.venv\Scripts\Activate

Install pandas and pyarrow.

py -m pip install pandas pyarrow

Run the Python script.

py book_manager.py

Suggested Commands - Mac/Linux

The following commands can be used in Mac/Linux zsh or bash shell. Run one at a time, wait for each to finish.

Create a virtual environment.

python3 -m venv .venv

Activate the virtual environment.

source .venv/bin/activate

Install pandas and pyarrow.

python3 -m pip install pandas pyarrow

Run the Python script.

python3 book_manager.py

Optional: Install Packages Using requirements.txt

If you like, you can use a requirements.txt file for your dependencies. This is helpful in projects when we have several external packages to install and it can be good practice.

To do so, first create a file named requirements.txt in the root folder of your repository, and provide the following contents, one package per line (starting in the very left column):

pandas
pyarrow

If using Windows PowerShell, install into your active project virtual environment with this command:

py -m pip install -r requirements.txt

If using Mac or Linux, install into your active project virtual environment with this command:

python3 -m pip install -r requirements.txt