Hadoop 3.0 Release Date

Hadoop 3.0 Release Date is 13-Dec-2017 and General Availability (GA) binaries can be downloaded from its official website. General availability (GA) marks a point of quality and stability  for the release series that indicates it’s ready for production use. You can also download the source code for this release which is around ~25Mb in size.  Hadoop 3.0 binaries will be somewhere around ~250Mb in size.

Hadoop 3.0 alpha was released in Sep-2016 and since then they have made 6 releases and the final Hadoop 3.0 release date was Dec 2017.  If you want to follow more closely, you can click on their JIRA dashboard for patch availability.

Hadoop 3.0 Release Date

Congratulations to the Apache Hadoop community on this major milestone for the project.

Downstream Compatibility with Other Apache Project

Following are the version compatibility matrix sheet indication the version of different Apache projects and their unit test status including basic functionality testing. This was done as part of Hadoop 3.0 Beta 1 release in Oct 2017.

Apache Project Version Compiles Unit Testing Status Basic Functional Testing
HBase 2.0.0
Spark 2.0
Hive 2.1.0
Oozie 5.0
Pig 0.16
Solr 6.x
Kafka 0.10

Overview of Hadoop 3.0 Release Highlight

  1. Improved storage efficiency using HDFS Erasure Coding
  2. Java 1.8 Support
  3. Improved Yarn Timeline Services v2
  4. Yarn resource types which allows scheduling for user defined resources like GPU
  5. Support for Opportunistic Containers

Hadoop 3.0 features and enhancement covers all 15+ core features added in Hadoop 3.0 Release. You can also refer installation guide here for UNIX environment to gets your hands dirty with it.

Hadoop 3.0 Bundling with Cloudera (CDH)

Cloudera 5.x release does not bundle Hadoop 3.0. Cloudera 6.x release is planning to have Hadoop 3.0 and its features and improvements listed above will be eventually be incorporated into CDH after our usual rigorous testing and integration process.

Though Hadoop is an open-source distributed computing technology, Cloudera strongly influcences the direction its development. Moreover Doug Cutting who founded Hadoop and mamber of Apache Hadoop Foundation.

Hadoop 3.0 Bundling with Hortonworks (HDP)

The current HDP version does not support Hadoop 3.0 and there are lot of discussion in hortonworks community by when this support will be available (refer discussion). No update is available as on posting of this blog.

Hadoop 3.0 Release Date Journey

Apache Hadoop Community has planned to release early and release often to quickly iterate the feedback from the downstream projects. You can see the release history and future plan below.

Release Date Released?
3.0.0-alpha1 2016-09-03
3.0.0-alpha2 2017-01-25
3.0.0-alpha3 2017-05-26
3.0.0-alpha4 2017-07-07
3.0.0-beta1 2017-10-03
3.0.0 GA 2017-12-13
3.0.1 TBD In Progress
3.0.2 TBD Not Started

Hadoop 3.0 Related Reading

# Other Articles Link
1 All the newly added features and enhancements in Hadoop 3.0 Hadoop 3.0 features and enhancement
2 Detailed comparison between Hadoop 3.0 vs Hadoop 2.0 and what benefit it brings to the developer Hadoop 3.0 vs Hadoop 2.0
3 Hadoop 3.0 Installation Hadoop 3.0 Installation
4 Hadoop 3.0 Release Date Hadoop 3.0 Release Date
5 Hadoop 3. 0 Security Book Hadoop 3.0 Security by Ben and Joey
6 Demystify The Hadoop 3.0 Architecture and its components Hadoop 3.0 Architecture
7 Hadoop 3.0 & Hortonworks Support for it in HDP 3.0 Release Hadoop 3.0 Hortonworks