m-mizutani / hatchery

Periodic SaaS audit logs importer

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

hatchery

A tool to gather data + logs from SaaS and save them to object storage

overview

Motivation

Many SaaS services offer APIs for accessing data and logs, but managing them can be challenging due to various reasons:

  • Audit logs are often set to expire after a few months.
  • The built-in log search console provided by the service is not user-friendly and lacks centralized functionality for searching and analysis.

As a result, security administrators are required to gather logs from multiple services and store them in object storage for long-term retention and analysis. However, this process is complicated by the fact that each service has its own APIs and data formats, making it difficult to implement and maintain a tool to gather logs.

Hatchery is a solution designed to address these challenges by collecting data and logs from SaaS services and storing them in object storage. This facilitates log retention and prepares the data for analysis by security administrators.

For those interested in importing logs from Cloud Storage to BigQuery, please refer to swarm.

License

Apache License 2.0

About

Periodic SaaS audit logs importer

License:Apache License 2.0


Languages

Language:Go 98.5%Language:Dockerfile 1.2%Language:Makefile 0.3%