Getting this? Aug 25 08:18:51 idmipa03.mws.mds.xyz krb5kdc[6704](info): preauth (encrypted_timestamp) verify failure: Preauthentication failed Aug 25 08:18:51 idmipa03.mws.mds.xyz krb5kdc[6704](info): AS_REQ (4 etypes {18 17 16 23}) 192.168.0.140: PREAUTH_FAILED: hue/cm-r01en01.mws.mds.xyz@MWS.MDS.XYZ for krbtgt/MWS.MDS.XYZ@MWS.MDS.XYZ, Preauthentication failed Check the principal vs the keytab you're using for the same service: kadmin.local:  getprinc hue/cm-r01en01.mws.mds.xyz@MWS.MDS.XYZ Principal: hue/cm-r01en01.mws.mds.xyz@MWS.MDS.XYZ Expiration date: [never] Last password change: […]

Getting this error? ==> /var/log/cloudera-scm-agent/cloudera-scm-agent.log <== [24/Aug/2019 22:00:08 +0000] 3697 Monitor-HostMonitor throttling_logger ERROR    Timed out waiting for worker process collecting filesystem usage to complete. This may occur if the host has an NFS or other remote filesystem that is not responding to requests in a timely fashion. Current nodev filesystems: /dev/shm,/run,/sys/fs/cgroup,/run/cloudera-scm-agent/process,/run/cloudera-scm-agent/process,/run/user/155601104,/n/mds.xyz,/run/user/0 [24/Aug/2019 22:00:08 +0000] […]

Getting this? INFO:desktop.kt_renewer:Renewing kerberos ticket to work around kerberos 1.8.1: /usr/bin/kinit -R -c /var/run/hue/hue_krb5_ccache kinit: KDC can't fulfill requested option while renewing credentials ERROR:desktop.kt_renewer:Couldn't renew kerberos ticket in order to work around Kerberos 1.8.1 issue. Please check that the ticket for 'hue/cm-r01en01.mws.mds.xyz@MWS.MDS.XYZ' is still renewable: $ klist -f -c /var/run/hue/hue_krb5_ccache If the 'renew until' date […]

Getting this? -bash-4.2$ kadmin -k -t /tmp/kadmin/cmf8392129202434993503.keytab -p cmadmin-530029b6@MWS.MDS.XYZ -r MWS.MDS.XYZ -q 'listprincs'         Authenticating as principal cmadmin-530029b6@MWS.MDS.XYZ with keytab /tmp/kadmin/cmf8392129202434993503.keytab. kadmin: Communication failure with server while initializing kadmin interface Ensure you have port 749 defined in your firewall config: [root@idmipa03 ~]# cat /etc/firewalld/zones/public.xml|grep -Ei 749   <port protocol="tcp" port="749"/> [root@idmipa03 ~]# […]

Getting this error from Ansible? ERROR! Extraneous options or arguments Simply drop down one folder where the infra file resides and reexecute: [root@awx01 adhoc]# cd .. [root@awx01 ansible]# ansible cm* -i infra -m copy -a 'src=adhoc/public.xml dest=/etc/firewalld/zones/public.xml' This was just a fancy way of ansible telling you it can't find the infra file containing the […]

Before enabling kerberos, the HDFS user is the only one that can list out files owned by itself: [root@cm-r01en01 run]# hdfs dfs -ls /tmp/.cloudera_health_monitoring_canary_files/.canary_file_2019_08_20-19_28_02.abab681cca56293als: Permission denied: user=root, access=EXECUTE, inode="/tmp/.cloudera_health_monitoring_canary_files":hdfs:supergroup:d——— You'll need to run the command via SUDO like this: [root@cm-r01en01 run]# sudo su -c "hdfs dfs -ls /tmp/.cloudera_health_monitoring_canary_files/.canary_file_2019_08_20-19_28_02.abab681cca56293a" -s /bin/bash hdfs -rw-rw-rw-   3 hdfs […]

Seeing slow SSD performance through SATA 3.0?  Tired of transfer rates of 30MB/s when you should be seeing at least 150MB/s?  Fix this by adding the following kernel parameters: libata.noacpi=1 Cheers, TK

Getting this? FATAL: Module scsi_wait_scan not found. This is likely followed by a kernel panic.  Look for a non existing mount point being defined, such as a LVM_swap partition that doesn't exist. Remove it.  Also remove any non existent partitions in /etc/fstab through the recovery console. Cheers, TK

Getting this? SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] ERROR StatusLogger No log4j2 configuration file found. Using default configuration: logging only errors to the console. Set system property 'org.apache.logging.log4j.simplelog.StatusLogger.level' to TRACE to show Log4j2 internal initialization logging. Investigate by first running the command manually: [oozie@cm-r01en01 ~]$ /usr/java/latest/bin/java -Xms52428800 -Xmx52428800 -XX:+UseG1GC -XX:MaxGCPauseMillis=20 -XX:InitiatingHeapOccupancyPercent=35 -XX:G1HeapRegionSize=16M -XX:MinMetaspaceFreeRatio=50 -XX:MaxMetaspaceFreeRatio=80 […]

Running into this? java.lang.ClassNotFoundException: org.cloudera.log4j.redactor.RedactorAppender Solve it with this: [root@awx01 ansible]# ansible 'cm*' -m shell -a 'cd /opt/cloudera/parcels/CDH/lib/oozie/libtools; ln -s ../../../jars/log4j-core-2.8.2.jar log4j-core-2.8.2.jar; ln -s ../../../jars/logredactor-2.0.7.jar  logredactor-2.0.7.jar' Cheers, TK