name | value |
---|---|
Rebalancing Threshold | 1 |
Maximum Iteration Size | 100GiB |
Minimum Block Size | 1MiB |
Mover Threads | 50 |
Dispatcher Threads | 50 |
DataNode Faied Volumes Tolerated | 6 |
DataNode Data Directory | |
Use Trash | Check |
HttpFS Lad Balancer | |
JournalNode Edits Directory | /Hadoop/jn |
NameNode Data Directories | /Hadoop/nn1 |
/Hadoop/nn2 | |
HDFS Checkpoint Directories | /Hadoop/jn/dfs/snn |
HDFS Service Advancec Configuration Snippet (Safety Valve) for hdfs-site.xml |
<property> <name>dfs.blockreport.intervalMsec</name> <value>43200000</value> </property> <property> <name>dfs.blockreport.incremental.intervalMsec</name> <value>100</value> </property><br><property> <name>dfs.namenode.fs-limits.max-directory-items</name> <value>2097152</value> </property> |
Cluster-wide Advanced Configuration Snippet (Safety Valve) for core-site.xml |
<property> <name>hadoop.proxyuser.yarn.hosts</name> <value>*</value> </property> <property> <name>hadoop.proxyuser.yarn.groups</name> <value>*</value> </property> <property> <name>fs.s3a.access.key</name> <value>!@ACCESS_KEY@!</value> </property> <property> <name>fs.s3a.secret.key</name> <value>!@SECRET_KEY@!</value> </property> <property> <name>fs.s3a.endpoint.key</name> <value> https://OBJ_STORAGE.HOST.COM </value> </property> <property> <name>fs.s3a.path.style.access</name> <value>true</value> </property> <property> <name>fs.s3a.impl</name> <value>org.apache.hadoop.fs.s3a.S3AFileSystem</value> </property> <property> <name>fs.s3a.connection.ssl.enabled</name> <value>true</value> </property> |
HDFS Service Advanced Configuration Snippet (Safety Valve) for ranger-hdfs-security.xml |
<property> <name>ranger.plugin.hdfs.chained.services</name> <value>cm_hive</value> </property> <property> <name>ranger.plugin.hdfs.chained.services.cml_hive.impl</name> <value>org.apache.ranger.chainedplugin.hdfs.hive.RangerHdfsHiveChainedPlugin</value> </property> <property> <name>ranger.plugin.hdfs.privileged.user.names</name> <value>admin,dpprofiler,hue,beacon,hive,impala</value> </property> <property> <name>ranger.plugin.hdfs.service.names</name> <value>hive,impala</value> </property> |
NameNode Nameservice | |
Quorum-based Storage Journal name | |
Enable Automatic Failover | |
DataNode Block Count Thresholds | Warning - Specify - 10000000 |
File Descriptor Monitoring Threshods | Warning - Specify - 60 |
Critical - Specify - 80 | |
Ranger Plugin Spool Directory Usage Threholds for NameNode | 2GiB |
Maximum Process File Descriptors | 655360 |
NameNode Handler Count | 46 |
NameNode Service Handler Count | 46 |
DataNode Tranceiver Port | 1024 |
DataNode Http Web UI Port | 1006 |
NameNode Service RPC Port | 8022 |
Java Heap Size of DataNode in Bytes | 6GiB |
Java Heap Size of Failover Controller in Bytes | 2GiB |
Client Java Heap Size in Bytes | 1GiB |
Java Heap Size of HttpFS in bytes | 1GiB |
Java Heap Size of JournalNode in Bytes | 4GiB |
Java Heap Size of NameNode in Bytes | 12GiB |
Java Heap Size of Secondary NameNode in Bytes | 8GiB |
DataNode Data Transfer Protection | Authentication |
Enable Ranger Authorization | Check |
Data Transfer Encyption Algorithm | AES/CTR/NoPadding |
Enable Kerberos Authentication for HTTP-Web-consoles | |
Hadoop TLS/SSL Server Keystore File Location | |
Hadoop TLS/SSL Server Keystore File Password | |
Hadoop TLS/SSL Server Keystore key Password | |
HttpsFS TLS/SSL Server Keystore File Location | |
HttpsFS TLS/SSL Server Keystore File Password | |
HttpsFS TLS/SSL Trust Store File | |
HttpsFS TLS/SSL Trust Store Password |
name | value |
---|---|
Core Configuration | |
Object Store Service | 1 |
Hadoop Secure Authentication | kerberos |
Hadoop Secure Authorization | Core Configuration |
Hadoop TLS/SSL Enabled | Core Configuration |
Cluster-Wide Default TLS/SSL Client Truststore Location | |
Cluster-Wide Default TLS/SSL Client Truststore Password |