| name | value |
|---|---|
| Rebalancing Threshold | 1 |
| Maximum Iteration Size | 100GiB |
| Minimum Block Size | 1MiB |
| Mover Threads | 50 |
| Dispatcher Threads | 50 |
| DataNode Faied Volumes Tolerated | 6 |
| DataNode Data Directory | |
| Use Trash | Check |
| HttpFS Lad Balancer | |
| JournalNode Edits Directory | /Hadoop/jn |
| NameNode Data Directories | /Hadoop/nn1 |
| /Hadoop/nn2 | |
| HDFS Checkpoint Directories | /Hadoop/jn/dfs/snn |
| HDFS Service Advancec Configuration Snippet (Safety Valve) for hdfs-site.xml |
<property> <name>dfs.blockreport.intervalMsec</name><value>43200000</value></property><property><name>dfs.blockreport.incremental.intervalMsec</name> <value>100</value></property><br><property> <name>dfs.namenode.fs-limits.max-directory-items</name><value>2097152</value></property> |
| Cluster-wide Advanced Configuration Snippet (Safety Valve) for core-site.xml |
<property> <name>hadoop.proxyuser.yarn.hosts</name> <value>*</value></property><property> <name>hadoop.proxyuser.yarn.groups</name> <value>*</value></property><property> <name>fs.s3a.access.key</name><value>!@ACCESS_KEY@!</value></property><property> <name>fs.s3a.secret.key</name> <value>!@SECRET_KEY@!</value></property><property> <name>fs.s3a.endpoint.key</name> <value> https://OBJ_STORAGE.HOST.COM </value></property><property> <name>fs.s3a.path.style.access</name> <value>true</value></property><property> <name>fs.s3a.impl</name> <value>org.apache.hadoop.fs.s3a.S3AFileSystem</value></property><property> <name>fs.s3a.connection.ssl.enabled</name> <value>true</value></property> |
| HDFS Service Advanced Configuration Snippet (Safety Valve) for ranger-hdfs-security.xml |
<property> <name>ranger.plugin.hdfs.chained.services</name> <value>cm_hive</value></property><property><name>ranger.plugin.hdfs.chained.services.cml_hive.impl</name><value>org.apache.ranger.chainedplugin.hdfs.hive.RangerHdfsHiveChainedPlugin</value></property><property> <name>ranger.plugin.hdfs.privileged.user.names</name> <value>admin,dpprofiler,hue,beacon,hive,impala</value></property><property> <name>ranger.plugin.hdfs.service.names</name> <value>hive,impala</value></property> |
| NameNode Nameservice | |
| Quorum-based Storage Journal name | |
| Enable Automatic Failover | |
| DataNode Block Count Thresholds | Warning - Specify - 10000000 |
| File Descriptor Monitoring Threshods | Warning - Specify - 60 |
| Critical - Specify - 80 | |
| Ranger Plugin Spool Directory Usage Threholds for NameNode | 2GiB |
| Maximum Process File Descriptors | 655360 |
| NameNode Handler Count | 46 |
| NameNode Service Handler Count | 46 |
| DataNode Tranceiver Port | 1024 |
| DataNode Http Web UI Port | 1006 |
| NameNode Service RPC Port | 8022 |
| Java Heap Size of DataNode in Bytes | 6GiB |
| Java Heap Size of Failover Controller in Bytes | 2GiB |
| Client Java Heap Size in Bytes | 1GiB |
| Java Heap Size of HttpFS in bytes | 1GiB |
| Java Heap Size of JournalNode in Bytes | 4GiB |
| Java Heap Size of NameNode in Bytes | 12GiB |
| Java Heap Size of Secondary NameNode in Bytes | 8GiB |
| DataNode Data Transfer Protection | Authentication |
| Enable Ranger Authorization | Check |
| Data Transfer Encyption Algorithm | AES/CTR/NoPadding |
| Enable Kerberos Authentication for HTTP-Web-consoles | |
| Hadoop TLS/SSL Server Keystore File Location | |
| Hadoop TLS/SSL Server Keystore File Password | |
| Hadoop TLS/SSL Server Keystore key Password | |
| HttpsFS TLS/SSL Server Keystore File Location | |
| HttpsFS TLS/SSL Server Keystore File Password | |
| HttpsFS TLS/SSL Trust Store File | |
| HttpsFS TLS/SSL Trust Store Password |
| name | value |
|---|---|
| Core Configuration | |
| Object Store Service | 1 |
| Hadoop Secure Authentication | kerberos |
| Hadoop Secure Authorization | Core Configuration |
| Hadoop TLS/SSL Enabled | Core Configuration |
| Cluster-Wide Default TLS/SSL Client Truststore Location | |
| Cluster-Wide Default TLS/SSL Client Truststore Password |