big-data-analytics

There are 59 repositories under big-data-analytics topic.

• ydataai / ydata-profiling

  1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.

  big-data-analyticsdata-analysisdata-explorationdata-profilingdata-qualitydata-sciencedeep-learningedaexplorationexploratory-data-analysishacktoberfesthtml-reportjupyterjupyter-notebookmachine-learningpandaspandas-dataframepandas-profilingpythonstatistics
  Language:Python 12266

• ICT-BDA / EasyML

  Easy Machine Learning is a general-purpose dataflow-based system for easing the process of applying machine learning algorithms to real world tasks.

  big-data-analyticslearning-platformmachine-learningmachine-learning-platformmachine-learning-studio
  Language:Java 1972
• vue-data-board

  dongsuo / vue-data-board

  A Data Analysis Board in Vue.

  vuedata-analysis-boarddragelement-uivisualizationechartsdataboarddata-visualizationdata-analysisno-codebig-data-analyticsbibusiness-intelligence
  Language:Vue 1311

• mahmoudparsian / pyspark-tutorial

  PySpark-Tutorial provides basic algorithms using PySpark

  big-databig-data-analyticsdata-algorithmspysparksparkspark-dataframesspark-rdd
  Language:Jupyter Notebook 1147
• v6d

  v6d-io / v6d

  vineyard (v6d): an in-memory immutable data manager. (Project under CNCF, TAG-Storage)

  big-data-analyticscloud-nativecncfdistributeddistributed-compdistributed-systemsgraph-analyticsin-memory-storageshared-memorysig-storagetag-storage
  Language:C++ 819

• MrXujiang / v6.dooring.public

  可视化大屏解决方案, 提供一套可视化编辑引擎, 助力个人或企业轻松定制自己的可视化大屏应用.

  antvbig-databig-data-analyticsbigdatadooringlow-codelowcodenodejsreactwebgl2
  Language:TypeScript 447

• metatron-app / metatron-discovery

  Powerful & Easy way for big data discovery

  business-intelligencebig-data-analyticsapache-druidself-servicedruiddata-visualizationdata-analyticsdashboardsql-editorchart
  Language:TypeScript 439

• lithops-cloud / lithops

  A multi-cloud framework for big data analytics and embarrassingly parallel jobs, that provides an universal API for building parallel applications in the cloud ☁️🚀

  pythonbig-datadata-processingmulticloudbig-data-analyticsserverlessdistributedobject-storageparallelkubernetesmultiprocessingcloud-computingserverless-computingserverless-functions
  Language:Python 311

• rouyang2017 / SISSO

  A data-driven method combining symbolic regression and compressed sensing for accurate & interpretable models.

  big-data-analyticscompressed-sensingmachine-learningmaterial-sciencesymbolic-regression
  Language:Fortran 227

• Ashish7129 / Graph_Sampling

  Graph Sampling is a python package containing various approaches which samples the original graph according to different sample sizes.

  big-databig-data-analyticsbreadth-first-searchdata-mininggraphsinductionnetworknetwork-analysisnetwork-sciencenetworkxpythonrandom-walksamplesamplingsocial-network-analysissubgraph
  Language:Python 159

• archivesunleashed / aut

  The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.

  sparkhadoopwebarchivesanalysisapache-sparkscaladigital-humanitiespysparkdataframebig-data-analyticspython3big-datanetwork-graphingtext-extraction
  Language:Scala 135

• Thomas-George-T / Movies-Analytics-in-Spark-and-Scala

  Data cleaning, pre-processing, and Analytics on a million movies using Spark and Scala.

  sparkspark-sqlrddshell-scriptbig-datadataframesmovielens-data-analysisbig-data-analyticsbig-data-projectsspark-programsscalamovielens-datasetanalyticscase-studyspark-dataframesspark-rddhadoopspark-scalamovies
  Language:Scala 96

• FTiniNadhirah / Coursera-and-EdX-courses-answers

  This is about learning courses in Coursera. All the answers given written by myself

  courseracoursera-machine-learningcoursera-data-sciencesoftware-engineeringcomputer-sciencejava-developerdata-sciencebig-databig-data-analyticsprogramming-exerciseharvard-university
  Language:HTML 91

• panstacks / pandata

  The Pandata scalable open-source analysis stack

  big-data-analyticsdata-sciencedistributed-computinghigh-performancepythonvisualization
  65

• drshahizan / BDM

  Course covers big data fundamentals, processes, technologies, platform ecosystem, and management for practical application development.

  big-databig-data-analyticsbig-data-architecturebig-data-processing
  Language:Jupyter Notebook 50

• maniram-yadav / Big_DataHadoop_Projects

  Big data projects implemented by Maniram yadav

  big-data-analyticsbig-data-projectsflumehadoophadoop-hdfshadoop-mapreducehdfshivemapreducepigpig-latinsparksqoop
  Language:PigLatin 49

• u2i / egis

  Egis - a handy Ruby interface for AWS Athena

  aws-athenaawsruby-gembig-databig-data-analyticsruby
  Language:Ruby 41

• tatsuiman / rpot2

  Real-time Packet Observation Tool

  intelligencethreat-huntingpcap-analyzerelkbig-data-analyticsvirtualizationnetwork-security-monitoringmalware-researchyara
  Language:Bro 39

• ingef / conquery

  Visual, interactive queries against big databases

  big-databig-data-analyticsjava
  Language:Java 36
• leo-cdp-free-edition

  trieu / leo-cdp-free-edition

  The binary build of LEO CDP Free Edition for training purposes

  customer-data-platformcustomer-analyticsleo-cdpbig-data-analyticsdataismcdpdata-analysisarangodbsurvey-analysisbig-data
  Language:HTML 29

• jackkolokasis / teraheap

  TeraHeap: Reducing Memory Pressure in Managed Big Data Frameworks

  big-data-analyticsgarbage-collectionjvmmanaged-runtimesmemory-managementnvmnvme-ssdpmemstorage
  28

• XuanyouLiu / US-Real-Estate-Analysis

  US Real Estate Rental Price Analysis

  big-data-analyticsjupyter-notebookreal-estatemachine-learning
  Language:Jupyter Notebook 28

• airflow-plugins / pandora-plugin

  Plugin offering views, operators, sensors, and more developed at Pandora Media.

  apache-airflowbig-data-analyticsdatadata-scienceairflow-plugin
  Language:Python 26

• arakat-community / arakat

  ARAKAT - Big Data Analysis and Business Intelligence Application Development Platform

  big-data-analyticsbusiness-intelligencedata-pipelinespredictive-maintenancedockerdocker-swarmcloud-native-applicationsdistributed-systems
  Language:Python 26

• GMAP / DSPBench

  a suite of benchmark applications for distributed data stream processing systems

  bigdatabig-databig-data-analyticsstream-processingdata-streamspark-streamingstormapache-stormapache-sparkapache-flinkevaluationexperiments
  Language:Java 26
• eskimo

  eskimo-sh / eskimo

  Eskimo is a state of the art Big Data Infrastructure and Management Web Console to build, manage and operate Big Data 2.0 Analytics clusters on Kubernetes. This is the git repository of Eskimo Community Edition.

  bigdatabig-data-platformbig-databig-data-projectsbig-data-analyticsbig-data-processingwebconsolecluster-managementsparkelasticsearchkafkaglusterglusterfszeppelincerebrokibanaflinkkuberneteskubernetes-clusterkubernetes-setup
  Language:Java 25
• pyspark-on-aws-emr

  Wittline / pyspark-on-aws-emr

  The goal of this project is to offer an AWS EMR template using Spot Fleet and On-Demand Instances that you can use quickly. Just focus on writing pyspark code.

  awsemr-clusteraws-emrpythonsparkpysparkbig-data-analyticsbig-datadataengineeringwordcloud-generatorec2-spotec2-spot-instances
  Language:Python 25

• scalytics / SDE

  Scalytics Connect development environment, pre-build

  big-data-analyticsfederated-learningprivacy-enhancing-technologiesprivacy-protectionrheemsparkplatform-agnosticdatamanagement
  Language:Jupyter Notebook 22

• suzumura / graph500

  World championship code for Graph500

  benchmarkbfsbfs-algorithmbig-data-analyticsbig-data-platformbigdatagraphgraph500papersupercomputer
  Language:C 21

• onefact / american-community-survey

  American Community Survey data on people and households

  acsamericanamerican-community-surveybig-databig-data-analyticscensuscensus-datacommunitydata-engineeringdbtjavascriptobservableobservable-plotobservablehqsurveytypescript
  Language:Jupyter Notebook 18

• Azure / AzureKusto

  R interface to Azure Data Explorer, aka Kusto

  razure-data-explorerkustobig-data-analyticsazureazure-sdk-r
  Language:R 17

• K-G-PRAJWAL / Big-Data-Engineering

  big-datadata-engineeringsqldatabase-managementpythonbig-data-analytics
  Language:PLpgSQL 17

• AWS-Big-Data-Projects / Iot-and-Big-Data-Application-using-aws-and-apache-kafka

  Iot,Big Data Analytics using Apache-kafka,spark and other aws services

  iotbig-data-analyticsawsapache-sparkapache-kafkasqlaws-kinesis
  Language:Python 16

• Dammonoit / Student-performance-analysis-using-Big-data

  This project analyses and correlates student performance with different attributes. Then at last, it determines most suitable algorithm from bunch of them.

  student-performance-analysisbig-data-analyticsdata-miningalgorithm-analysis
  Language:Python 15
• YiraBot-Crawler

  OwenOrcan / YiraBot-Crawler

  YiraBot: Simplifying Web Scraping for All. A user-friendly tool for developers and enthusiasts, offering command-line ease and Python integration. Ideal for research, SEO, and data collection.

  beginner-friendlybig-data-analyticscommand-line-tooldata-extractiondata-mininghtml-parsermachine-learningopen-sourcepython3seo-analysistext-extractionweb-crawlersweb-scrapingrobots-txtsitemap-parsercontributions-welcomegood-first-issuescrapingseotools
  Language:Python 15

• klugem / watchdog

  Workflow management system for the automated and distributed analysis of large-scale experimental data.

  bioinformatics-pipelineworkflow-management-systembioinformaticsrna-seq-analysiscluster-computingbig-data-analytics
  Language:Java 13