dennybiasiolli / compare-datasets

Playground repo to compare csv files

Compare Datasets

Documentation for the pandas.DataFrame.compare method: https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.DataFrame.compare.html

Setup

Python version

Tested with Python 3.12

python3 -m venv venv
source venv/bin/activate
pip install --upgrade pip

pip install --upgrade pipenv
pipenv sync
# or without pipenv
pip install -r requirements.txt

Rust version

Tested with Rust 1.76

cargo build --release

Usage

Python version

pipenv run python compare_datasets.py [path/file1.csv] [path/file2.csv] [id_key_name]

or without pipenv

python compare_datasets.py [path/file1.csv] [path/file2.csv] [id_key_name]

Example:

pipenv run python compare_datasets.py data/example1.csv data/example2.csv PassengerId
# or
python compare_datasets.py data/example1.csv data/example2.csv PassengerId

Rust version

cargo run [path/file1.csv] [path/file2.csv]

or with the compiled binary

target/release/compare-datasets [path/file1.csv] [path/file2.csv]

Example:

cargo run data/example1.csv data/example2.csv
# or
target/release/compare-datasets data/example1.csv data/example2.csv