大神 Jeff Dean 相关的一些项目

与他有关的一些项目：

• Spanner, a scalable, multi-version, globally distributed and synchronously replicated database

• Some of the production system design and statistical machine translation system for Google Translate.

• Bigtable, a large-scale semi-structured storage system.

• MapReduce, a system for large-scale data processing applications.

• Google Brain, a system for large-scale artificial neural networks.

• LevelDB, an open-source on-disk key-value store. 原理与 bigtable 类似

• TensorFlow, an open-source machine-learning software library.

MapReduce

并行计算框架

具体的执行过程如上图

思考：

1. worker 宕机

2. master 宕机

3. 顺序保证机制

BigTable

分布式存储框架

实现层面：

一主多从模式

tablelet 定位：