modin

There are 1 repository under modin topic.

• modin-project / modin

  Modin: Scale your Pandas workflows by changing a single line of code

  analyticsdata-sciencedataframedatasciencedistributedmodinpandaspythonsql
  Language:Python 9905
• aws-sdk-pandas

  aws / aws-sdk-pandas

  pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

  pythonawspandasapache-arrowapache-parquetdata-engineeringetldata-scienceredshiftathenalambdaaws-lambdaaws-glueemramazon-athenaglue-catalogmysqlamazon-sagemaker-notebookmodinray
  Language:Python 3935

• jmcarpenter2 / swifter

  A package which efficiently applies any function to a pandas dataframe or series in the fastest available manner

  daskmodinpandaspandas-dataframeparallel-computingparallelization
  Language:Python 2541

• narwhals-dev / narwhals

  Lightweight and extensible compatibility layer between dataframe libraries!

  cudfdaskduckdbibismodinpandaspolarspyarrowvaex
  Language:Python 607

• ray-project / xgboost_ray

  Distributed XGBoost on Ray

  daskdata-sciencekagglemachine-learningmodinxgboost
  Language:Python 144

• drshahizan / Python-big-data

  Python and Pandas are known to have issues around scalability and efficiency. You will learn how to use libraries such as Modin, Dask, Ray, Vaex etc to overcome the problems faced by Pandas.

  daskdata-sciencemodinpandasrayvaex
  Language:Jupyter Notebook 127

• intel / hdk

  A low-level execution library for analytic data processing.

  sqlgpuqueryanalyticsquery-enginemodinpandasdata-sciencemachine-learningquery-buildercpuheterogeneous-parallel-programming
  Language:C++ 31
• kedro-dataframe-dropin

  mzjp2 / kedro-dataframe-dropin

  A Kedro plugin that provides pandas dropin replacements for the pandas datasets (e.g modin and cuDF)

  kedro-pluginkedro-catalograpidsaimodindatagpu-acceleration
  Language:Python 12
• udsb

  unum-cloud / udsb

  Unlimited Data-Science Benchmarks for Numeric, Tabular and Graph Workloads

  numpyapache-arrowarrowcublascudfcugraphdaskmodinnetworkxpandassqlite
  Language:Jupyter Notebook 9

• gandalf1819 / NYCOpenData-Profiling-Analysis

  Open Data Profiling, Quality and Analysis on NYC OpenData dataset with semantic profiling using fuzzy ratio, Levenshtein distance and regex

  data-profilingnyc-opendatanyc-311-datasetbig-datapysparkhdfsmodindaskdask-distributedpandasfuzzy-logicregular-expressionsfuzzywuzzylevenshtein-distance
  Language:Jupyter Notebook 6

• PratikDavidson / intel-oneAPI-LLM

  oneAPI Hackathon: The LLM Challenge

  bert-fine-tuninghuggingfacehuggingface-transformersintelitexkeras-tensorflowmodinoneapistreamlit-webapp
  Language:Jupyter Notebook 5

• bhattbhavesh91 / modin-example

  Simple example on how Modin can peed up your Pandas workflows by changing a single line of code

  modinpandaspandas-dataframepython
  Language:Jupyter Notebook 1

• c-susan / datasci_2_manipulation

  HHA507 / Data Science / Assignment 2 / Data Manipulation

  data-cleaningdata-transformationjupyter-notebookmodinnumpypandaspolars
  Language:Jupyter Notebook 1

• hariprasath-v / Intel_oneAPI_Hackerearth_Predict-the-quality-of-freshwater

  Build a machine model to predict whether the freshwater is safe to drink or not.Based on the measures like pH, TDS, etc.

  catboostclassificationexploratory-data-analysisf1scorelightgbmmodinonedalpandaspython3shapashxgboost
  Language:HTML 1
• Movie-Recommendation-Rating-Prediction

  jacobceles / Movie-Recommendation-Rating-Prediction

  Using the MovieLens dataset with Surprise to compare different algorithms for rating prediction, and also create a movie recommendation system on top of it.

  machine-learningmovie-recommendationpythonrating-predictionsurprise-librarysurprise-pythonmodin
  Language:Jupyter Notebook 1

• oneapi-src / ai-structured-data-generation

  AI Starter Kit to generate structured synthetic data using Intel® Distribution of Modin

  machine-learningmodin
  Language:Python 1

• SebastianMahecha / data_engineering

  Generate data, load and download parquets to GCP and compare performance between Pandas, Polars and Modin with Python

  data-egcpmodinpandaspolarspython
  Language:Python 1

• AAWorks / options-pricing

  Global Markets Options Pricing

  binomial-pricingblack-scholes-mertondeep-q-networkdqnmakemodinmonte-carlo-simulationopenai-gympandaspolygon-apistreamlittf-agents
  Language:Python 0

• adrianmarino / recommendation-system-approaches

  Recommendation system approaches

  recommender-systemdeep-learningsparkkerastensorflowmovielensraymodin
  Language:Jupyter Notebook 0

• comprakash / delta-transformation-pipeline

  A transformation pipeline for Delta Lake using AWS SDK for Pandas

  aws-sdk-pandasdelta-lakedelta-rsetlkubernetesmodinrays3transformationkuberay
  Language:Python 0

• Helzheng123 / datasci_2_manipulation

  Delve deeper into data manipulation using Python's prominent libraries. Explore the functionalities of Pandas and get a glimpse of alternatives like Polars, Dask, and Modin.

  data-cleaningdata-transformationmodinpandaspolarspython
  Language:Jupyter Notebook

• ivanbgd / bioinf_demo

  A Bioinformatics demo in Python working with FASTQ files and using the Modin library

  bioinformaticscomputational-biologymodinpythonpython3biopythonfastqlarger-than-memorytrie
  Language:Python

• murattkiran / File-ingestion-and-schema-validation

  daskmodinschema-validationfile-ingestion
  Language:Jupyter Notebook

• prehensilecode / sge_accounting_stats

  Simple stats on SGE accounting data

  data-analysishpcmodinpandaspythonsge
  Language:Jupyter Notebook