Topic of Distributed Computing Environment

In this page, I am going to prepare a index page to help we all installing, configuring and deploying a Hadoop ecosystem.

ZooKeeper

• Official site
• Download page

Hadoop

• How to deploy a HDFS environment
• Official site
• Hadoop Download Mirror Page
• A native go client for HDFS
• snakebite -- A pure python HDFS client

HBase

• Official site
• Download page

Hive

• Use data from hdfs to in hive
• Hive External Table Skip First Row

Pig

• Official site
• Download page and Latest release note

Spark

• Official site

Impala

It is based on hive, and written in c++

You can visit its official documents:

• Impala Tutorials
• Post-Installation Configuration for Impala
• Installing Impala from the Command Line
• Using HDFS Caching with Impala (CDH 5.1 or higher only)

Presto

• Official site
• REST APIs

Presto is an open source distributed SQL query engine for running interactive analytic queries against data sources of all sizes ranging from gigabytes to petabytes.

Zeppelin

• Official site
• Download page