fengruotj

Master.TJ's repositories

mydotfiles

All of my dot configuration files.

Language:Vim Script000

fengruotjBlog

GitHub Master.TJ 我的个人博客主页源码（Source Code）

Language:JavaScript000

blog

GitHub Master.TJ 我的个人博客主页

Language:HTML000

Ares, a high performance and fault tolerant DSPS. Ares considers both system performance and fault tolerant capability during task allocation. In the design of Ares, we formalize the problem of Fault Tolerant Scheduler (FTS) for finding an optimal task allocation which maximizes the system utility. We treat the FTS problem as a game and propose Nirvana, an algorithm based on best-response dynamics scheduling strategy.

Language:Java300

Whale

Whale is a novel RDMA-assisted DSPS with efficient one-to-many data partitioning. Whale explores a novel RDMA-assisted stream multicast mechanism and a new worker-oriented communication mechanism. We implement Whale on top of Apache Storm and evaluate it using experiments with large-scale datasets. The results show that Whale achieves 56.6x improvement of system throughput and 97% reduction of processing latency compared to existing designs.

Apache-2.0100

kafkaParallelIO

Java NIO java TransferTo方法优化：并行读取磁盘IO。Kafka并行传输直接内存池，利用DirectMemoryChannel并行或者串行的读取数据。

Language:Java400

RDMAFileTransfer

RDMA Large File Transfer：A Large-scale File and Folder Transfer Framework. By using two components, RDMA Channel and RDMA Verbs.

Language:Java1300

RdmaChannel

RDMA Channel: A Channel-Oriented RDMA Java Communication Library. More high-level abstract Channel API on top of RDMA verbs.

Language:HTML400

JbexGis

基于MapGis开发的“感知校园”的社交应用是利用 Gis 技术实现的移动端应用和利用JavaWeb技术实现的Web端后台管理应用。

Language:Java200

DStream

DStream is a popularity-aware differentiated distributed stream processing system, which identifies the popularity of keys in the stream data and uses a differentiated partitioning scheme. DStream greatly outperforms Storm on skew distributed data in terms of throughput and processing latency.

Language:JavaApache-2.0200

BigDataAnalysisWeb

Big data performance test analysis platform (including WebUI display)。 BigDataAnalysisWeb Analyze storm, spark, and flink throughput changes in the form of charts.

Language:JavaScript2000

HdfsCachePool

Hadoop Distributed File System (HDFS) has slow serial read speed of the log stream file, it cannot meet the requirements of the stream processing system and can not fully exert the processing capability of the stream processing system, thus restricting the stream processing system. Improve performance. On the basis of HDFS, this software adopts parallel data transmission methods to fully utilize network bandwidth and effectively improve the throughput of distributed file system and meet the demand of stream processing system for data source throughput. At the same time, with respect to the highly ordered nature of the log stream, the software controls the timing of the data to ensure the timing of the log file and provides high-speed and orderly data input for the stream processing system.

Language:Java400

JavaCommunicate

Java通信协议Study 包括Scoket通信、NIO通信、Netty通信

Language:Java100

Algorithm

算法分析：提升算法能力（动态规划、递归等）

Language:Java100

JavaBasciLearing

Java基础知识学习：包括JVM虚拟机、对象模型等Java基础知识代码案例。（此项目与本人的博客用到的代码同步更新）

Language:Java100

DataStructure

数据结构与算法分析书籍源码实现

Language:Java000

spark-parent

Apache Spark核心源码分析：Spark Core、Spark Streaming源码分析(内容有spark消息通信原理、spark作业执行原理、spark调度算法原理等等)

Language:ScalaApache-2.0000

hadoopAction

hadoop 深入学习 HDFS-API以及MapReduce相关操作，同步Bolg更新

Language:Java100

zookeeperAction

Apache Zookeeper是一个分布式协调服务，就是为用户的分布式应用程序提供协调服务.本项目Apache Zookeeper的学习项目。ZookeerperAction Zookeeper简单实现RMI高可用性包括RIM服务。并且包括用Zookeeper实现分布式锁以及分布式系统动态上线下线。

Language:Java100