A handy lookup table of similar technology and services to help ex-googlers survive the real world :)
pull-requests welcomed. Please do not list any confidential projects!
See also: The Hadoop Ecosystem Table
| Google Internal | Google Open Source | Open Source / Real-World |
|---|---|---|
| MapReduce | Apache Hadoop, Spark | |
| Protocol Buffer | Protobuf | Cap'n Proto, Thrift, Avro Amazon Ion |
| Network protocol | gRPC | Bolt, Thrift |
| Chubby | Apache Zookeeper, etcd | |
| ? | Apache Kafka, Apache Pulsar |
| Google Internal | Google Open Source | Open Source / Real-World |
|---|---|---|
| Borg | Kubernetes | Apache Mesos |
| GSLB (load balancer) | ELB, Istio, F5, envoy | |
| data center hardware | open compute |
| Google Internal | Google Open Source | Open Source / Real-World |
|---|---|---|
| GFS/Colossus | HDFS, Ceph, GlusterFS | |
| BigTable | PrestoDB, Cassandra, HBase, Accumulo, DynamoDB | |
| Spanner | Cloud Spanner | CockroachDB, TiDB |
| columnIO | Apache Parquet | |
| sstable | levelDB | |
| zippy | Snappy | lz4 |
| Google Internal | Google Open Source | Open Source | SaaS |
|---|---|---|---|
| Dremel | bigquery | Apache Drill, Presto, Spark(sort-of), | AWS Athena, Redshift Spectrum |
| Dremel UI | Redash | ||
| Search (Mustang, Alexandria) | Elasticsearch, Solr, Lucene | algolia | |
| pubsub | pubsub | RabbitMQ, PubNub | AWS SQS/SNS |
| Google Internal | Google Open Source | Real-World |
|---|---|---|
| Blaze | Bazel | Buck, Pants |
| Oncall | PagerDuty, OpsGenie, VictorOps | |
| varz/borgmon | Prometheus, librato, newrelic, skylight, scout, also this and this | |
| Exception/Error Tracking (??) | Sentry.io, Raygun.io, Rollbar, Honeybadger, Airbrake, OverOps | |
| styleguides | google styleguides | PEP-8 |
| blaze test / build / CI | buildkite, circleCI, travis, jenkins, gitlabCI | |
| continuous delivery / releasing | lambdaCD, screwdriver.cd, CodeShip, shipit-engine, GoCD, AWS CodeDeploy, Capistrano, Fabric, ConcourseCI | |
| borg / borgcfg | AWS Cloudformation, Puppet, Chef, Salt, Ansible, Terraform | |
| borgcfg | Jsonnet | |
| logging | logstash, fluentd, papertrail, cernan | |
| CodeSearch | Sourcegraph | |
| cider | Eclipse Che, Cloud9 |
| Google Internal | Real-World |
|---|---|
| free food | :( |
| software engineering at google | |
| valentine | 1Password Lastpass |
| OWNERS files in repo | github CODEOWNERS |
| snippets | Khan/snippets |
| memegen | memegen |