aws-kinesis-firehose
There are 2 repositories under aws-kinesis-firehose topic.
amazon-archives / aws-vpc-flow-log-appender
Sample code to append additional information (e.g. Security Group IDs and geolocation data) to VPC Flow Logs for analysis in Elasticsearch.
Language:JavaScript 86- Language:Go 61
hervenivon / aws-experiments-data-ingestion-and-analytics
Ingestion of bid requests through Amazon Kinesis Firehose and Kinesis Data Analytics. Data lake storage with Amazon S3. Restitution with Amazon QuickSight and CloudWatch. 📉
Language:TypeScript 26aws-samples / aws-dms-cdc-data-pipeline
Data Pipeline for CDC data from MySQL DB to Amazon OpenSearch Service through Amazon Kinesis using Amazon Data Migration Service(DMS).
Language:Python 24mirusresearch / firehoser
A wrapper around AWS Kinesis Firehose with retry logic and custom queuing behavior. Requires node >= 6.0.0
Language:JavaScript 22AWS-Big-Data-Projects / Analyzing-Twitter-in-real-time-with-Kinesis-Lambda-Comprehend-and-ElasticSearch
Analyzing Twitter in real time with Kinesis, Lambda, Comprehend and ElasticSearch
Language:Python 15A simple, practical, and affordable system for measuring head trauma within the sports environment, subject to the absence of trained medical personnel made using Amazon Kinesis Data Streams, Kinesis Data Analytics, Kinesis Data Firehose, and AWS Lambda
Language:Shell 11Collect, process, and analyze log data using Amazon Kinesis and Elasticsearch Service
Describes the concepts of lambda architecture and the actual deployment process with an example of building a serverless business intelligence systems using Amazon Kinesis, S3, Athena, OpenSearch Service, and QuickSight.
Language:Python 11GhayathAlobaidi / Data-Pipeline--Twitter-Analysis
Use AWS to stream and analyze the sentiment of live tweets from Twitter based on a certain keyword.
Language:Python 9zhudotexe / FIREBALL-data-processing
The data preprocessing code for FIREBALL
Language:Python 9rochitasundar / TwitterSentimentAnalysis-BigDataProject
Scrapped tweets using twitter API (for keyword ‘Netflix’) on an AWS EC2 instance, ingested data into S3 via kinesis firehose. Used Spark ML on databricks to build a pipeline for sentiment classification model and Athena & QuickSight to build a dashboard
Language:Jupyter Notebook 4aws-cloudformation / aws-cloudformation-resource-providers-kinesisfirehose
The CloudFormation Resource Provider Package For Amazon Kinesis Data Firehose
Language:Java 2ptimson / firehose-mock
An embedded Java mock for AWS Kinesis Firehose
Language:Java 2ZachTRice / aws-apache-to-json
AWS Kinesis Firehose: Apache Log to JSON
Language:JavaScript 2Streaming data pipeline to continuously load data from an Amazon MSK or MSK Serverless cluster to Amazon S3 using Amazon Kinesis Data Firehose.
Language:Python 1epomatti / aws-cloudwatch-subscriptions
Subscribing to CloudWatch Logs with various destinations
Language:HCL 1jonathannocek / twitter-analysis
Streaming and real-time analysis of Twitter data through an AWS data stream
Language:Python 1markoshlima / crimes-map
This Big Data project consists of obtaining data on vehicle theft in the city of São Paulo and consolidating it in a counting and heat map, in order to show areas with a higher index of this type of crime. All applicable in AWS Resources.
Language:Scala 1psy-pri / aws-realtime-tweets-streaming
❄️ Stream real-time data into Snowflake with Amazon Kinesis Firehose
Language:Python 1Rafat97 / aws-kinesis-firehose-lambda-s3
AWS kinesis data stream, kinesis data firehose, a transformer with lambda and store into s3 bucket
Language:TypeScript 1rodcsant / dio-live-aws-bigdata-2
Big Data Lab | Stream Delivery AWS Kinesis Firehose
Language:Python 1Anirudha-N / Text_Analysis_using_AWS
Let's analyze twitter sentiments.This project uses Twitter API and AWS kinesis,AWS kinesis Firehose,Comprehend,Lambda,S3 and DynamoDB
Language:JavaScript 0bicarbon8 / automated-functional-testing
Automated Functional Testing (AFT) packages supporting nodejs based Functional Testing
Language:TypeScript 0byungjun0689 / aws-streaming-sample-hist-2023
Streaming data pipeline on aws, Tech session repository for hist
Language:Python 0chrisammon3000 / aws-json-dataset
Lightweight and simple Python package to quickly send JSON data to various AWS services.
Language:Python 0ggarciabas / mlops_aws_punkapi
Machine Learning Engineer - MLOps!
Language:Jupyter Notebook 0lee040118 / stream-data-pipeline-in-aws
Streaming data-pipeline in aws
Language:Python 0msheikh24 / aws-analytics
Resources for AWS Big data certification preparation
Language:TSQL 0SagarFall2022 / BigData
Realtime data pipeline
Language:Jupyter Notebook 0WithDD97 / Twitter-sentiment-analysis-Elon-Musk
Big data Text Classification: 4M records
Language:Jupyter Notebook 0adautoneto / firehose-recover-errors
Recover AWS Kinesis Firehose errors by running the COPY command to each of the manifests file in the S3 errors folders
Language:PythonGuz-Ali / AWS-Streaming-Data-to-ML-Model-Pipeline
A complete AWS pipeline that collects, compiles, preprocesses streaming data and trains an ML model
Language:Pythonksmin23 / streaming-data-pipeline-from-kafka-to-s3-using-aws-kinesis-firehose
Streaming data pipeline to continuously load data from an Amazon MSK or MSK Serverless cluster to Amazon S3 using Amazon Kinesis Data Firehose.
Language:PythonproductiveAnalytics / aws-cdk-constructs-sandbox
Cloud Development Kit (AWS CDK) using TypeScript, Python and Java
Language:Java
