Alex wang's repositories
alibaba-mom
2015 ali中间件比赛项目,1. 通信模块: 涉及到了消息架构设计,每一个主题分配1-2个队列,这个是可以横向增加,考虑到了一个主题有多个消费者订阅,而且还有过滤条件,为了负载均衡,对应的队列投递消息是根据随机数对队列数取膜完成的。以上是内存队列。 2. 持久化系统:因为考虑到机器坏掉,broker不可用等等原因导致的消息丢失,就需要每次收到的消息必须及时落盘,这个就是比赛优化的重中之重。为此设计了一个小型的文件系统,借鉴阿里的rocketmq. 用一个大的日志文件,一般1G大小每个,和内存队列的结构映射到实体队列。整个日志文件是顺序文件,每条消息固定大小,里面有对应的队列号,消息号,还有长度等等。这个方便恢复消息到实体队列用的。 同步刷盘,异步刷盘,持久化必须可靠,所以一般是同步刷盘到日志文件,日志文件定时异步刷盘到实体队列,实体队列里面是索引,消息的本体在日志文件里面。为了加快大面积的写入速度,用了内存映射:内存映射文件首先将外存上的文件映射到内存中的一块连续区域,被当成一个字节数组进行处理,读写操作直接对内存进行操作,而后再将内存区域重新映射到外存文件,这就节省了中间频繁的对外存进行读写的时间,大大降低了读写时间
armeria
Asynchronous RPC/API client/server library built on top of Java 8, Netty 4.1, HTTP/2, and Thrift
awesome-java-cn
Java资源大全中文版,包括开发库、开发工具、网站、博客、微信、微博等,由伯乐在线持续更新。
btrace
BTrace - a safe, dynamic tracing tool for the Java platform
caffeine
A high performance caching library for Java 8
cat
Central Application Tracking
cloud-vision
Sample code for Google Cloud Vision
DistributedTracingSystem
分布式系统的跟踪系统
docker-java
Java Docker API Client
dubbo-rpc-jsonrpc
The Json rpc module of dubbo project
greys-anatomy
Java诊断工具
hadoop-book
Example source code accompanying O'Reilly's "Hadoop: The Definitive Guide" by Tom White
jbender
An easy-to-use library for creating load testing applications.
kubernetes
Container Cluster Manager from Google
LittleProxy
High Performance HTTP Proxy
memcached-session-manager
A tomcat session manager that backups sessions in memcached and pulls them from there if asked for unknown sessions
metrics
:chart_with_upwards_trend: Capturing JVM- and application-level metrics. So you know what's going on.
moquette
Java MQTT lightweight broker
motan
A remote procedure call(RPC) framework for rapid development of high performance distributed services.
mykernel
It is a platform to write your own OS kernel,its based on Linux Kernel 3.9.4 source code.
prosparkstreaming
Code used in "Pro Spark Streaming: The Zen of Real-time Analytics using Apache Spark" published by Apress Publishing.
RocketMQ
:rocket: Alibaba's MQ, also aliyun ONS.
scalecube
ScaleCube is a microservices framework for the rapid development of distributed, resilient, reactive applications that scales.
tensorflow
Computation using data flow graphs for scalable machine learning
test_db
A sample MySQL database with an integrated test suite, used to test your applications and database servers
tomcat-redis-session-manager
Redis-backed non-sticky session store for Apache Tomcat
zookeeper
Mirror of Apache Hadoop ZooKeeper