large-dataset

There are 1 repository under large-dataset topic.

disk.frame
DiskFrame / disk.frame
Fast Disk-Based Parallelized Data Manipulation Framework for Larger-than-RAM Data
data data-science large-dataset manipulation-data medium-data r
Language:R 593
fair-acc / chart-fx
A scientific charting library focused on performance optimised real-time data visualisation at 25 Hz update rates for data sets with a few 10 thousand up to 5 million data points.
chart-fx java charting-libraries javafx data-visualisation scientific-visualization large-dataset hacktoberfest
Language:Java 478
sharmaroshan / Fraud-Detection-in-Online-Transactions
Detecting Frauds in Online Transactions using Anamoly Detection Techniques Such as Over Sampling and Under-Sampling as the ratio of Frauds is less than 0.00005 thus, simply applying Classification Algorithm may result in Overfitting
machine-learning data-analysis anamoly-detection sampling query data-visualization classification deep-learning under-sampling over-sampling auprc confusion-matrix large-dataset finance data-analytics classification-report
Language:Jupyter Notebook 65
extjfx / extjfx
JavaFX extensions
chart fxml javafx large-dataset logarithmic-scale zoom
Language:Java 61
sileod / Discovery
Mining Discourse Markers for Unsupervised Sentence Representation Learning
discourse-analysis sentence-embeddings deep-learning infersent discourse-markers pdtb dataset natural-language-processing natural-language-understanding natural-language-inference discourse-parsing large-dataset unsupervised-learning discourse-connectives pretrained-model
Language:Jupyter Notebook 59
Esri / large-network-analysis-tools
Tools and code samples for solving large network analysis problems in ArcGIS Pro
network-analysis python large-dataset arcpy nax origin-destination
Language:Python 58
zzw922cn / TensorFlow-Input-Pipeline
TensorFlow Input Pipeline Examples based on multi-thread and FIFOQueue
tensorflow fifo-queue multi-threading input-pipeline mini-batch tfrecords large-dataset small-dataset
Language:Python 52
privefl / bigreadr
R package to read large text files based on splitting + data.table::fread
r-package read-csv large-dataset
Language:R 42
kyegomez / EXA-1
An EXA-Scale repository of Multi-Modality AI resources from papers and models, to foundational libraries!
artificial-intelligence gpt4 kosmos multimodal multimodality pytorch dataset jax large-dataset large-language-models multimodal-data pytorch-implementation triton
Language:Jupyter Notebook 41
matteodelabre / saxophone
Fast and lightweight event-driven streaming XML parser in pure JavaScript
sax javascript parser xml large-dataset
Language:JavaScript 35
Imtiazkarimik23 / SPEC5G
This repository contains the code and data of the paper titled "SPEC5G: A Dataset for 5G Cellular Network Protocol Analysis" published at AACL 2023.
5g large-dataset large-language-models
Language:Jupyter Notebook 23
ec-jrc / Thalassa
Large Scale Sea level visualizations of unstructured mesh data
hvplot datashader unstructured-meshes large-dataset
Language:Python 17
MaxHalford / tuna
:fish: A streaming ETL for fish
golang go machine-learning feature-extraction online-algorithms large-dataset stream stream-processing etl
Language:Go 13
guypeer8 / csv-streamer
💧A stream based csv aggregator for limiting RAM usage while processing large data sets.
csv stream nodejs sqlite large-dataset zlib gzip
Language:JavaScript 8
vunguyentuan / react-virtual-slider
Virtual Slider/Carousel for React
carousel large-dataset performance react slider virtual
Language:JavaScript 8
hto / redis-large-hset-del
Large HSET keys delete on Redis.
hset redis large-dataset large hscan del delete remove
Language:Go 7
zglu / ivis
IVIS is a chart editor for interactive visualisation, based on jQuery and HighCharts. Chart types include dot/scatter, 2D scatter, line, bar/column, pie, and heat map. It's powerful when analysing large data sets.
interactive rnaseq large-dataset visualisation plotting
Language:JavaScript 7
gjcampbell / ooffice
Some components for internal, line of business angular apps
angular2 angular tree virtualized virtualizer large-dataset performance
Language:TypeScript 6
davidssmith / RawArray.jl
Raw array (RA) file format for simple, robust, and user-friendly N-dimensional array storage
bytes complex-numbers data-science file-format julia large-dataset large-files ra-format rawarray scientific-computing storage
Language:Julia 5
imdeepmind / AmazonReview-LanguageGenerationDataset
Processed Amazon Review Dataset for Language Generation (Character Level)
machine-learning deep-learning nlp language-model language-datasets large-dataset python language-generation-dataset
Language:Python 5
JakobLS / 100-million-rows-with-spark
Is it feasable to train a model on 100 million ratings using nothing more than a common laptop? Let's find out.
data-exploration feature-engineering large-dataset pyspark pyspark-machine-learning
Language:Jupyter Notebook 5
JJChenCharly / OrthoSLC
OrthoSLC: A pipeline to get Orthologous Genes using Reciprocal Best Blast Hit (RBBH) Single Linkage Clustering, indenpendent of relational database management system
reciprocal-blast-hits single-linkage-clustering core-genome microbe-subspecies lightweight pre-compiled independent-of-mysql bioinformatics dereplication jupyter-notebook cpp-callable-binary convenient-installation large-dataset large-scale pan-genome genomics
Language:Jupyter Notebook 5
tejas-gokhale / music_reco_deep_learning
Project for CMU 15-780 Graduate Artificial Intelligence
deep-learning recommender-system music million-song-dataset large-dataset
Language:Python 5
open-panda
data-preservation-programs / open-panda
A platform for the world's largest open datasets, stored on a decentralized network
data-science datasets filecoin ipfs large-dataset
Language:Vue 4
DevExpress-Examples / winforms-grid-load-refresh-detail-data-from-database
Dynamically load and refresh detail data (master-detail).
dotnet xtragrid-suite winforms data-grid database grid large-dataset master-detail refresh-data windows-forms
Language:Visual Basic .NET 4
vjgpt / Home-Credit-Default-Risk
Objective of this competition is to use historical loan application data to predict whether or not an applicant will be able to repay a loan.
banking credit-risk gradient-boosting large-dataset lightgbm loan
Language:Jupyter Notebook 4
bugthesystem / cerebro
Finding The Median In Large Sets Of Numbers Split Across N Servers using zeromq and nodejs (experimental)
zeromq experimental nodejs large-dataset median average distributed
Language:JavaScript 3
ChelseaGH / KSL-Guide
KSL-Guide: A Large-scale Korean Sign Language Dataset Including Interrogative Sentences for Guiding the Deaf and Hard-of-Hearing, FG, 2021
dataset korean-translation large-dataset large-scale-dataset sign-language sign-language-recognition
3
mofesolapaul / tableau
Experiment in a bid to produce a custom-design table for presenting large data
devcrib es6-modules jquery-plugin large-dataset node-module planet-nest scss spreadsheet tables
Language:HTML 3
samridhishree / Machine-Learning-for-Large-Datasets
Machine Learning models for large datasets
autodiff autograd big-data bigml document-classification guinea-pig guineapig hadoop hadoop-mapreduce large-dataset lda lda-gibbs-sampling mapreduce parameter-server sparse-sgd
Language:Gnuplot 3
jblasch / ECE428___K-L_Tool
VLSI with CAD: Python program which accepts file input and determines the minimum cutset
vlsi cad python2 cutset-networks graph-theory kernighan-lin network-partitions structured-programming-approach heuristics heuristic-algorithm heuristic-optimization large-dataset
2
JoetheManHowie / NUSCAN
All the code required to reproduce the results in our paper "Scaling Up Structural Clustering to Large Probabilistic Graphs Using Lyapunov Central Limit Theorem"
clustering-algorithm large-dataset probability
Language:C++ 2
Lizhecheng02 / Kaggle-LLM-Detect_AI_Generated_Text
Detect whether the text is AI-generated by training a new tokenizer and combining it with tree classification models or by training language models on a large dataset of human & AI-generated texts.
ai-generated bpe classification large-dataset llm tokenizer ensemble wordpiece
Language:Jupyter Notebook 2
m-wells / AlignedBinaryFormat.jl
Memory-mapping made easy.
julia julia-language julia-package julialang save load file-format memory-mapping serialization input-output large-dataset
Language:Julia 2
ThomasByr / BioInfo-genome
🧬 large scale genes data analysis software
bioinformatics large-dataset python-3-10
Language:Python 2
Gautamaggrawal / Realtime-logging
A realtime web based watching solution, akin to UNIX's tail -f command, employs Django Channels for real-time monitoring. It obviates page refreshes, efficiently streams updates, supports multiple connections, and shows the last 10 lines of the log.
django django-channels large-dataset logging realtime websocke
Language:Python 1

large-dataset

DiskFrame / disk.frame

fair-acc / chart-fx

sharmaroshan / Fraud-Detection-in-Online-Transactions

extjfx / extjfx

sileod / Discovery

Esri / large-network-analysis-tools

zzw922cn / TensorFlow-Input-Pipeline

privefl / bigreadr

kyegomez / EXA-1

matteodelabre / saxophone

Imtiazkarimik23 / SPEC5G

ec-jrc / Thalassa

MaxHalford / tuna

guypeer8 / csv-streamer

vunguyentuan / react-virtual-slider

hto / redis-large-hset-del

zglu / ivis

gjcampbell / ooffice

davidssmith / RawArray.jl

imdeepmind / AmazonReview-LanguageGenerationDataset

JakobLS / 100-million-rows-with-spark

JJChenCharly / OrthoSLC

tejas-gokhale / music_reco_deep_learning

data-preservation-programs / open-panda

DevExpress-Examples / winforms-grid-load-refresh-detail-data-from-database

vjgpt / Home-Credit-Default-Risk

bugthesystem / cerebro

ChelseaGH / KSL-Guide

mofesolapaul / tableau

samridhishree / Machine-Learning-for-Large-Datasets

jblasch / ECE428___K-L_Tool

JoetheManHowie / NUSCAN

Lizhecheng02 / Kaggle-LLM-Detect_AI_Generated_Text

m-wells / AlignedBinaryFormat.jl

ThomasByr / BioInfo-genome

Gautamaggrawal / Realtime-logging