TDP Stacks

TDP is based on proven, reliable and scalable components from the Hadoop eco-system. Coherent set of components that has been tested and validated to work together are gathered in stacks (as it was called by HDP and Ambari).

The following tables show the core TDP components and their versions for each stack. Two branches are curated for each component:

-basic branch, a fork of the original repository with the minimum changes to make it build.
-fix branch, based on the -basic branch, with fixes and features backported from the original repository.

Note: For some projects, the Apache foundation sometimes maintains branches on which are backported fixes and features. We will be using these branches as much as possible if they are maintained and compatible.

Stack 3.1

Versions are approximately based on the HDP 3.1.5 release.

Components

Component Name	Base Version	Type	Source	Binaries
Apache Zookeeper	3.4.14	Apache		zookeeper-3.4.14.tar.gz
Apache Hadoop	3.1.1	basic	3.1.1-0.0(compare with Apache)	hadoop-3.1.1-0.0.tar.gz
Apache Hadoop	3.1.1	fix	3.1.1-0.2(compare with basic)	hadoop-3.1.1-0.2.tar.gz
Apache Hive 3	3.1.3	basic	3.1.3-2.0(compare with Apache)	apache-hive-3.1.3-2.0-bin.tar.gz
Apache Hive 3	3.1.3	fix	3.1.3-2.3(compare with basic)	apache-hive-3.1.3-2.3-bin.tar.gz
Apache Tez	0.9.2	basic	1.0(compare with Apache)	tez-0.9.2-1.0.tar.gz
Apache Spark 2	2.3.4	basic	2.3.4-1.0(compare with Apache)	spark-2.3.4-1.0-bin-tdp.tgz
Apache Spark 3	3.2.4	basic	3.2.4-1.0(compare with Apache)	spark-3.2.4-1.0-bin-tdp.tgz
Apache Ranger	2.0.0*	fix	2.0.0-1.0(compare with Apache)	ranger-2.0.0-1.0-admin.tar.gz ranger-2.0.0-1.0-hbase-plugin.tar.gz ranger-2.0.0-1.0-hdfs-plugin.tar.gz ranger-2.0.0-1.0-hive-plugin.tar.gz ranger-2.0.0-1.0-kafka-plugin.tar.gz ranger-2.0.0-1.0-kms.tar.gz ranger-2.0.0-1.0-knox-plugin.tar.gz ranger-2.0.0-1.0-usersync.tar.gz ranger-2.0.0-1.0-yarn-plugin.tar.gz
Apache Solr (for Ranger)	7.7.3	Apache		solr-7.7.3.tgz
Apache HBase	2.1.10 RC1*	basic	2.1.10-1.0(compare with Apache)	hbase-2.1.10-1.0-bin.tar.gz
Apache HBase	2.1.10 RC1*	fix	2.1.10-1.1(compare with basic)	hbase-2.1.10-1.1-bin.tar.gz
Apache HBase Operator tools	1.1.0	basic	1.1.0-0.0(compare with Apache)	hbase-hbck2-1.1.0-0.0.jar hbase-table-reporter-1.1.0-0.0.jar hbase-tools-1.1.0-0.0.jar
Apache HBase Connectors (for HBase)	1.0.0	basic	1.0.0-0.0(compare with Apache)	hbase-spark-2.3.4-1.0.0-0.0.jar
Apache Phoenix	5.1.3	basic	5.1.3-1.0(compare with Apache)	phoenix-hbase-2.1-5.1.3-1.0-bin.tar.gz
Apache Phoenix Query Server	6.0.0	basic	6.0.0-1.0(compare with Apache)	phoenix-queryserver-6.0.0-1.0-bin.tar.gz
Apache Knox	1.6.1	basic	1.6.1-0.0(compare with Apache)	knox-1.6.1-0.0.tar.gz knoxshell-1.6.1-0.0.tar.gz
Apache Knox	1.6.1	fix	1.6.1-0.1(compare with basic)	knox-1.6.1-0.1.tar.gz knoxshell-1.6.1-0.1.tar.gz

*Contains some Apache fixes

Dependencies

Component Name	Base Version	Type	Source
Apache Hive (for Spark 2)	1.2.1-spark2	basic	1.2.1.spark2-1.0(compare with JoshRosen/hive)
Apache Hive 2 (for Spark 3)	2.3.9	basic	2.3.9-1.0(compare with Apache)
Apache Hive 2 (for Spark 3)	2.3.9	fix	2.3.9-1.1(compare with basic)