Hadoop 3.0 GPU : Hadoop is still behind high performance capacity due to CPUs’ limited parallelism, though. GPU (Graphical Processing Unit) accelerated computing involves the use of a GPU together with a CPU to accelerate applications to data processing on GPU cluster toward higher efficiency. However, GPU cluster has low level data storage capacity
MapReduce … read the rest
This deep dive article on “Hadoop 3.0 Erasure coding explained” will highlight how the erasure coding will help reducing 50% of storage overhead cost. The storage component (HDFS) of Hadoop 3.0 by default replicates each block 3 times (and could be higher based on configuration). Replication facilitates a simple and robust form of redundancy to protect against failure … read the rest
Hadoop 3.0 Docker : The docker enables users to bundle an application together with its preferred execution environment. In this article, we will talk about Hadoop and docker together. What are the benefit and single node setup.
Hadoop 3.0 Roadmap : Latest version of Hadoop is already out and everybody is excited about its features. Hadoop 3.0 is a major release after Hadoop 2.9 which was released in Dec 2017. Hadoop 3.0 Roadmap includes primarily 3 key enhancements YARN Feature, HDFC Features & common Features.
YARN Features are very important and having around 11 key … read the rest
Many spark users who are using Hadoop as storage under the Spark computation is asking if Hadoop 3.0 vs Spark 2.x compatible or not. Spark 2.2.1 was released the 1st week of Dec 2017 and Hadoop 3.0 GA was released on 2nd week of Dec 2017. It is obvious that this compatibility is not fully tested and it not running … read the rest
Apache Hadoop 3.0 Installation on Windows is a short and practical guide for bigdata engineers to get their hands dirty. Since Hadoop 3.0 is not yet available with Cloudera CDH 6.x or Hortonworks HDP 3.x , this guide navigate you through the installation steps without cyngwin.
Since Hadoop 3.0 New Features are based on Java 1.8, you need following preparation … read the rest
Hadoop 3.0 Cloudera (or CDH 6.x) is an obvious question after you have seen Hadoop 3.0 new feature and enhancement list. At the time of writing this blog, CDH was having 5.14 supporting Hadoop 2.7.3. Hadoop 3.0 has lot of changes and if you want to try it in stand alone mode before it becomes available, it is available … read the rest
Hadoop 3.0 Hortonworks is an obvious question after you have seen Hadoop 3.0 new feature and enhancement list. At the time of writing this blog, HDP was having 2.6.4 supporting Hadoop 2.7.3. Hadoop 3.0 has lot of changes and if you want to try it in stand alone mode before it becomes available, it is available for installation. … read the rest
Hadoop, the most popular open-source distributed framework has arrived with a new release 3.x. It brings promising features and enhancements, but here we will demystify the Hadoop 3.0 Architecture in detail. The difference between Hadoop 3.0 & Hadoop 2.0 is already talked a lot but how all such changes fit into Hadoop 3.0 architecture will give you a … read the rest
Hadoop 3.0 Release Date is 13-Dec-2017 and General Availability (GA) binaries can be downloaded from its official website. General availability (GA) marks a point of quality and stability for the release series that indicates it’s ready for production use. You can also download the source code for this release which is around ~25Mb in size. Hadoop 3.0 binaries will … read the rest