gcs-bucket

There are 2 repositories under gcs-bucket topic.

• makeabledk / laravel-cloud-images

  Never generate another thumbnail again - image sizing on the fly for Laravel

  gcs-bucketimages-apiimageserverlaravelserve-images
  Language:PHP 58

• Fozan-Talat / divvy-bikeshare-de-project

  An end-to-end data pipeline which extracts divvy bikeshare data from web loads it into data lake and datawarehouse transforms it using dbt and finally , a dashboard to visualize the data using looker studio, the pipeline is orchestrated using prefect

  bigquerydbtdivvy-bikesgcpgcs-bucketgoogle-cloud-platformgoogle-cloud-storagelooker-studioprefectpythonterrafromdata-engineeringdata-modelingdata-pipelinedata-visualizationdata-warehouseelt-pipelineorchestrationdezoomcamp
  Language:Python 34

• weswu8 / gcsfuse-win

  Gcs fuse system, windows fuse system on top of the google cloud storage service, mount Gcs buckets and folder as local driver on you local windows host

  fusegcsgoogle-cloud-storagegcs-windowsfuse-winwingcs-bucketgcpgcp-fuseblob-storageblob-fuse
  Language:C# 28

• DanEngelbrecht / golongtail

  Command line front end for longtail synchronization tool

  archivechunkingsynchronizationdownloaduploaddeliverys3-storagegcss3gcs-bucket
  Language:Go 22

• googlearchive / gcsbeat

  An Elastic Beat to ingest data from Google Cloud Storage

  google-cloud-storagebeatselasticelasticbeatsstackdriver-logsgcs-bucketgoogle-cloud-platform
  Language:Go 19
• storagebus

  ducktors / storagebus

  A storage abstraction layer for Node.js that removes any difference among multiple public cloud storage services and local filesystems

  gcsgcs-buckets3s3-bucketstorage
  Language:TypeScript 9

• ishvad / gcs-bucket-listing

  Create nice directory listings for Google Cloud Storage buckets with javascript and HTML.

  gcsgcs-bucketgcp-storagejavascripthtmlstorages3cloud-storageaws-s3
  Language:JavaScript 9
• stona

  ali-furkan / stona

  (WIP) An Object Storage

  dockerbucketobject-storagegolangstorages3-bucketgcs-bucket
  Language:Go 8

• alexbakerdev / GCS-Reverse-Proxy

  A google cloud storage reverse proxy. For hosting private static sites using google cloud storage.

  micronodegoogle-cloud-storagestatic-sitegcs-bucketaccess-control
  Language:JavaScript 7

• GbotemiB / gharchive_de_project

  An end-to-end data engineering project on github activities data

  bigquerydbtclouddockergcpgcs-bucketlooker-studioprefectsparkterraform
  Language:Jupyter Notebook 7

• google / BucketServer

  Serve GCS Bucket content anonymously from Windows, Linux and MacOS

  cloudgcpgcsgcs-bucketsigned-url
  Language:Go 6

• mesmacosta / datacatalog-fileset-enricher

  A Python package to enrich Google Cloud Data Catalog Fileset Entries with tags.

  gcs-bucketdatacataloggcp-storagegcp-datacatalogfileset-enricherfileset-entriespythonbigdatastatisticsdocker
  Language:Python 4

• hypnosapos / yellow-pachyderm

  Using pachyderm as pipeline engine to serve "taxi chicago" machine learning models

  pachydermtensorflowkuberneteskubernetes-deploymenttfmagcs-buckettf-servingkvcvcktfservingtfx
  Language:Makefile 3

• quannguyen0103 / vnstock-data-pipeline

  Creating a robust and scalable data pipeline on Google Cloud Platform (GCP) to monitor and analyze stock performance. Leveraging the power of GCP's data processing and storage services, a comprehensive solution has been built to efficiently collect, process, and visualize stock data.

  airflowbash-scriptbigquerycloud-vmdataprocgcs-bucketkafka-streamslooker-studiopubsubpysparkpythonstockcloud-functionstelegram-bot
  Language:Python 3

• DevSecOpsSamples / gke-workload-identity

  GKE IAM role and workload identity sample project

  gcpgkecontaineriamservice-accountworkload-identitypythonsecuritykubernetesgcs-bucketpubsubdevopsgoogle-cloud-platformgoogle-cloud
  Language:HCL 2

• df8-naufal-aldy-pradana / 02-airflow-gcs-bigquery-pipeline

  Airflow script that ingest data from API and upload it to gcs bucket

  airflowairflow-dagsdocker-composegcsgcs-bucket
  Language:Python 2

• mehroosali / bigquery-sparksql-batch-etl

  Batch ETL pipeline project on GCP to load and transform daily flight data using Spark to update tables in BigQuery. The pipeline is automated using Airflow.

  pysparksparkgcpgcs-bucketbigqueryairflowetl-pipelineshelldatawarehousing
  Language:Python 2

• MongoExpUser / Object-Storage-Interaction

  Interacting with public cloud object storage

  pythonboto3s3fsobject-storageawslinodegcps3-selectpysparkaws-comprehendbackblaze-b2gcs-buckets3-bucketbackblazepandaspandasqllinode-objsdaskstoragedask-sql
  Language:Python 2

• AakashDeorukhkar / Airflow_NYC_Taxi_Data

  Ingesting NYC Yellow Taxi Data to GCP using Airflow running on Docker

  airflowairflow-dagsairflow-dockerbigquerydockerdocker-composegcs-bucketgoogle-cloud-platformpythonsqlterraform
  Language:Python 1

• digital-clouds / space

  Storage Automation

  cloudflare-workersgcsgcs-bucketgoogle-cloud
  Language:JavaScript 1

• No-Country / c17-48-n-java

  Aplicacion web para adopcion de mascotas

  api-restclever-clouddockerdrawioflyiogcsgcs-bucketgithubjavamysqlreactjsspringtrello
  1

• poshkaran04 / stocks_data_transform

  This is in order to add additional stocks data information using dbt.

  airflowbigquerydata-analysisdata-engineeringdata-visualizationdatalakedatawarehousedbtgcpgcs-bucketpowerbipython3
  Language:Python 1

• tiwarisanjay / tf-gcs-bucket

  GCS Bucket with Terraform

  gcsgcs-bucketgcpgcp-storage
  Language:HCL 1

• xadityax / Google-Cloud-Storage-to-BigQuery-flow

  Using google functions/virtual machine to retrieve data from a API, store into GCS bucket and transfer to BigQuery

  google-cloud-storagebigquerybigquery-flowgcs-bucket
  Language:JavaScript 1
• Cloud-based-Web-Scraper

  abhi777 / Cloud-based-Web-Scraper

  A GUI based Web Scraper

  gcs-bucketgooglecloudstorageguipythonwebscraperwebscrapingwebapp
  0

• addin12 / DF9-data-viz-pyspark-installation

  Data Fellowship 9 Session 5 Assignment - Visualize Transformed Data & pySpark Installation

  bigquerydata-visualizationgcs-bucketlooker-studiopyspark
  0

• denoqo / around

  Go-based social network app with Elasticsearch

  elasticsearchgcs-bucketgolang
  Language:Go 0

• df8-naufal-aldy-pradana / 01-upload-to-gcp-buckets

  Simple python scripts to upload local files into GCP's bucket containerized with docker.

  dockergcpgcsgcs-bucketpython3
  Language:Python 0

• quannguyen0103 / data-migration-on-GCP

  This project aims to migrate data from MongoDB to Google Cloud Storage (GCS) and BigQuery automatically. It enables businesses to easily transfer and analyze the data in the cloud, improving data and cost management.

  analyze-databigquerycrontabdata-migrationdata-visualizationgcpgcs-bucketgoogle-cloud-functionsgoogle-cloud-platformgoogle-cloud-storagegoogle-virtualmachinelooker-studiomongodbpythonshell-script
  Language:Python 0

• shubhammirajkar / uber_etl_data_engineering_project

  An ETL Pipeline built over GCP and orchestrated by Mage, which involves Extracting Data from GCS Bucket, building Dimensional Model, loading the Data into BigQuery and a Looker Dashboard for further analysis.

  bigqueryetl-pipelinegcs-bucketlookermageai
  Language:Jupyter Notebook 0

• usefusefi / gcp_terraform

  Google Cloud Platform (GCP) infrastructure setup using Terraform

  gcpgcp-storagegcs-bucketterraformgoogle-cloud-bigquerygoogle-cloud-platform
  Language:HCL 0

• vspatil / citibike-data-pipeline

  Analysis of NYC's citibike data. Technologies: Python , Prefect, dbt, Terraform , Looker data studio

  dbtdockerlookerprefectpythonterraformdatadata-visualizationdataanalysisdataengineeringsqlbigquerygcpgcs-bucketdata-engineering-pipeline
  Language:Python 0

• vyshnavi-pvr / serverless

  Lambda function for 'webapp' to save files in GCP bucket and logs in DynamoDB tables when SNS topic triggers

  dynamodbgcs-bucketlambda-functionsmailgunsns-topic
  Language:Python 0

• hitthecodelabs / GCSBucketBridge

  Migrate data between Google Cloud Storage (GCS) buckets

  gcloud-sdkgcs-bucketgsutilpythonscript
  Language:Jupyter Notebook

• OmaymaS / train_test_data_utils

  Util functions to organize train/test data

  data-sciencedatasetgcs-buckettraining-data
  Language:Python

• rifa8 / data-warehouse-submission

  Learning about Data Warehouse

  gcs-bucketbigquerycituscolumnardata-warehousedatalake