batch-processing

There are 12 repositories under batch-processing topic.

NaiboWang / EasySpider
A visual no-code/code-free web crawler/spider易采集：一个可视化浏览器自动化测试/数据采集/爬虫软件，可以无代码图形化的设计和执行爬虫任务。别名：ServiceWrapper面向Web应用的智能化服务封装系统。
code-free crawler gui layman spider parameters web www input-parameters frontend html batch-processing batch-script visual visualization visualprogramming scraper data-collection rpa robotics
Language:JavaScript 21266
argoproj / argo-workflows
Workflow Engine for Kubernetes
workflow kubernetes argo dag knative airflow machine-learning argo-workflows workflow-engine hacktoberfest cloud-native cncf k8s gitops mlops batch-processing data-engineering pipelines
Language:Go 14264
spring-projects / spring-batch
Spring Batch is a framework for writing batch applications using Java and Spring
batch batch-processing java spring
Language:Java 2590
pathwaycom / pathway
Pathway is a high-throughput, low-latency data processing framework that handles live data & streaming for you. Made with ❤️ for Python & ML/AI developers.
batch-processing kafka pathway python streaming machine-learning-algorithms real-time
Language:Python 1696
faast.js
faastjs / faast.js
Serverless batch computing made simple.
batch batch-processing faas javascript library serverless typescript
Language:TypeScript 1473
bbottema / simple-java-mail
Simple API, Complex Emails (Jakarta Mail smtp wrapper)
java java-mail outlook batch-processing smime dkim dmarc high-performance spring-support conversion cli-support builder-api proxy configurable email smtp jakarta-mail javamail oauth2 smtp-client
Language:Java 1171
hazelcast-jet
hazelcast / hazelcast-jet
Distributed Stream and Batch Processing
java big-data stream-processing batch-processing event-processing low-latency kafka cdc hacktoberfest
Language:Java 1089
spring-cloud / spring-cloud-dataflow
A microservices-based Streaming and Batch data processing in Cloud Foundry and Kubernetes
microservices-architecture orchestration stream-processing batch-processing predictive-analytics cloud-native datapipelines
Language:Java 1066
PicView
Ruben2776 / PicView
Fast, free and customizable image viewer for Windows 10 and 11.
image-viewer wpf convert-images picture-viewer image-gallery desktop-app webp csharp windows dotnet image-effects image-filters comics-reader base64-image compress-images batch-processing heif jpeg-xl jxl raw-image
Language:C# 855
alessandrofrancesconi / gimp-plugin-bimp
BIMP. Batch Image Manipulation Plugin for GIMP.
gimp batch-processing c image-manipulation plugin
Language:C 827
iusztinpaul / energy-forecasting
🌀 𝗧𝗵𝗲 𝗙𝘂𝗹𝗹 𝗦𝘁𝗮𝗰𝗸 𝟳-𝗦𝘁𝗲𝗽𝘀 𝗠𝗟𝗢𝗽𝘀 𝗙𝗿𝗮𝗺𝗲𝘄𝗼𝗿𝗸 | 𝗟𝗲𝗮𝗿𝗻 𝗠𝗟𝗘 & 𝗠𝗟𝗢𝗽𝘀 for free by designing, building and deploying an end-to-end ML batch system ~ 𝘴𝘰𝘶𝘳𝘤𝘦 𝘤𝘰𝘥𝘦 + 2.5 𝘩𝘰𝘶𝘳𝘴 𝘰𝘧 𝘳𝘦𝘢𝘥𝘪𝘯𝘨 & 𝘷𝘪𝘥𝘦𝘰 𝘮𝘢𝘵𝘦𝘳𝘪𝘢𝘭𝘴
airflow batch-processing feature-store github-actions mlops python cicd docker fastapi gcp great-expectations hopsworks ml-monitoring poetry sktime streamlit weights-and-biases 3-pipeline-design model-registry data-versioning
Language:Python 783
bacalhau-project / bacalhau
Compute over Data framework for public, transparent, and optionally verifiable computation
p2p distributed iot bioinformatics-pipeline data-analysis data-engineering data-science decentralized video-processing batch-processing gene-sequencing logging-framework orchestration-framework insulators decentralized-computing ai-art ai-data-collection ai-pipeline
Language:Go 602
j-easy / easy-batch
The simple, stupid batch framework for Java
java batch-processing batch
Language:Java 599
guillermo-navas-palencia / optbinning
Optimal binning: monotonic binning with constraints. Support batch & stream optimal binning. Scorecard modelling and counterfactual explanations.
python binning woe optimization woebinning stream streaming-data batch-processing scorecard credit-scoring mdlp counterfactual-explanations
Language:Python 415
spring-cloud / spring-cloud-task
Short lived microservices with Spring Batch
microservices batch-processing short-lived-microservices
Language:Java 413
reidmorrison / rocketjob
Ruby's missing background and batch processing system
batch batch-processing batch-job batch-file batch-framework mongodb sidekiq delayed-jobs resque encryption compression mongoid
Language:Ruby 289
krita-batch-exporter
GDQuest / krita-batch-exporter
A Free Krita plugin to batch export layers and groups with maximum flexibility. Scale, trim, export multiple copies of your layers...
krita krita-plugin exporter batch-processing image-processing game-development graphic-design
Language:Python 286
streamnative / pulsar-flink
Elastic data processing with Apache Pulsar and Apache Flink
apache-pulsar apache-flink data-processing batch-processing stream-processing flink flink-connector schema-registry schema sql flink-stream-processing catalog pulsar
Language:Java 279
Azure / batch-shipyard
Simplify HPC and Batch workloads on Azure
azure-batch docker hpc mpi gpu infiniband rdma azure batch-processing nfs glusterfs azure-functions containers singularity windows-containers serverless slurm
Language:Python 276
tintinweb / ida-batch_decompile
*Decompile All the Things* - IDA Batch Decompile plugin and script for Hex-Ray's IDA Pro that adds the ability to batch decompile multiple files and their imports with additional annotations (xref, stack var size) to the pseudocode .c file
ida decompile ida-plugin batch-processing ida-batch-decompile reverse-engineering
Language:Python 270
bvn-architecture / RevitBatchProcessor
Fully automated batch processing of Revit files with your own Python or Dynamo task scripts!
revit batch-processing revit-files python revit-addins revit-batch-processing dynamo revit-api revit-batch-processor
Language:Python 268
lilydjwg / pssh
Parallel SSH Tools
pssh ssh parallel-processing batch-processing
Language:Python 264
avilum / linqit
Extend python lists operations using .NET's LINQ syntax for clean and fast coding.
python python3 metadata metaprogramming syntax robustness development-tools powerful linq csharp efficiency clean clean-code awesome filters pythonic dotnet batch-processing lazy-loading
Language:Python 245
nilenso / goose
The Next-Level background job processing library for Clojure
clojure redis asynchronous background-processing batch-processing rabbitmq scheduler
Language:Clojure 240
btargac / excel-parser-processor
Automate downloads from Excel files in seconds. Simply does the tedious, repetitive operations for rows of Excel files and reports the results. It downloads files from URL(s) in column A, if a new filename is provided at column B it will rename before saving. It will even create sub folders if column C is filled with a valid folder name.
excel electron electronjs nodejs downloader batch-processing batch download batch-download excel-import excel-parse exceldownload excel-download excel-based rename subfolder autodownloader filedownloader imagedownloader
Language:JavaScript 216
heathbm / BatchPool
The one-stop generic task batching and management library
csharp dotnet dotnet-core task batch batch-processing task-manager task-runner async semaphore c-sharp
Language:C# 181
apple / batch-processing-gateway
The gateway component to make Spark on K8s much easier for Spark users.
batch-processing k8s kubernetes spark
Language:Java 167
NaiboWang / Bilibili-XMLSubtitle-to-ASS
可视化Bilibili本地视频XML弹幕转换ASS字幕转换器
ass batch-processing bilibili danmu decrypt gui potplayer subtitle up-to-date video visualization xml rename-folder batch-processor batch-script
Language:Python 156
jberet / jsr352
Implementation of Jakarta Batch Specification and API
batch batch-processing jakarta java
Language:Java 121
asakusafw / asakusafw
Asakusa Framework
asakusa-framework batch batch-processing java hadoop mapreduce data-flow framework big-data
Language:Java 116
pszemraj / textsum
CLI & Python API to easily summarize text-based files with transformers
summarization summary text text-to-text-transformer transformer transformers batch-processing pipeline inference inference-api
Language:Python 110
streamnative / pulsar-spark
Spark Connector to read and write with Pulsar
apache-pulsar apache-spark spark structured-streaming spark-sql data-processing data-science batch-processing stream-processing flink
Language:Scala 109
Refefer / Dampr
Python Data Processing library
dataflow batch-processing mapreduce machine-learning
Language:Python 102
dejonghe / aws-batch-example
Example use of AWS batch
aws batch python lambda workflow batch-processing aws-lambda aws-batch scheduled-jobs cloudformation lambda-functions docker
Language:Python 101
Ding-Kyoma / EasyTrans-mac
PDF 批量翻译，翻译后的PDF格式基本不变。导出PDF和Docx。优化并精简了来自于QPromise 的 EasyTrans。优化了通过百度翻译API稳定进行长翻译！
batch-processing en2zh pdf-translation
Language:Python 101
viney-shih / goroutines
It is an efficient, flexible, and lightweight goroutine pool. It provides an easy way to deal with concurrent tasks with limited resource.
go pool goroutines goroutine-pool batch batch-processing golang
Language:Go 96

batch-processing

NaiboWang / EasySpider

argoproj / argo-workflows

spring-projects / spring-batch

pathwaycom / pathway

faastjs / faast.js

bbottema / simple-java-mail

hazelcast / hazelcast-jet

spring-cloud / spring-cloud-dataflow

Ruben2776 / PicView

alessandrofrancesconi / gimp-plugin-bimp

iusztinpaul / energy-forecasting

bacalhau-project / bacalhau

j-easy / easy-batch

guillermo-navas-palencia / optbinning

spring-cloud / spring-cloud-task

reidmorrison / rocketjob

GDQuest / krita-batch-exporter

streamnative / pulsar-flink

Azure / batch-shipyard

tintinweb / ida-batch_decompile

bvn-architecture / RevitBatchProcessor

lilydjwg / pssh

avilum / linqit

nilenso / goose

btargac / excel-parser-processor

heathbm / BatchPool

apple / batch-processing-gateway

NaiboWang / Bilibili-XMLSubtitle-to-ASS

jberet / jsr352

asakusafw / asakusafw

pszemraj / textsum

streamnative / pulsar-spark

Refefer / Dampr

dejonghe / aws-batch-example

Ding-Kyoma / EasyTrans-mac

viney-shih / goroutines