How do I connect to HiveServer2 (HS2) through beeline: beeline> !connect jdbc:hive2://cm-r01en01.mws.mds.xyz:10000/default;principal=hive/cm-r01en01.mws.mds.xyz@MWS.MDS.XYZ Connecting to jdbc:hive2://cm-r01en01.mws.mds.xyz:10000/default;principal=hive/cm-r01en01.mws.mds.xyz@MWS.MDS.XYZ Connected to: Apache Hive (version 2.1.1-cdh6.3.0) Driver: Hive JDBC (version 2.1.1-cdh6.3.0) Transaction isolation: TRANSACTION_REPEATABLE_READ 0: jdbc:hive2://cm-r01en01.mws.mds.xyz:10000/> 0: jdbc:hive2://cm-r01en01.mws.mds.xyz:10000/> 0: jdbc:hive2://cm-r01en01.mws.mds.xyz:10000/> show tables; INFO  : Compiling command(queryId=hive_20190902102937_4ef97c5b-19ff-47b8-be81-dacb2edeece0): show tables INFO  : Semantic Analysis Completed INFO  : Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:tab_name, type:string, […]

Getting this? java.lang.IllegalArgumentException: Required executor memory (1024), overhead (384 MB), and PySpark memory (0 MB) is above the max threshold (1024 MB) of this cluster! Please check the values of 'yarn.scheduler.maximum-allocation-mb' and/or 'yarn.nodemanager.resource.memory-mb'. Either increase the Container Memory: yarn.nodemanager.resource.memory-mb to 2GB from 1GB Or reduce the maximum container memory: yarn.scheduler.maximum-allocation-mb from 1GB to 512MB in the […]

Are you getting this result? [root@cm-r01en01 process]# systemctl restart cloudera-scm-agent [root@cm-r01en01 process]# [root@cm-r01en01 process]# [root@cm-r01en01 process]# [root@cm-r01en01 process]# kinit -kt ./1401-hdfs-NFSGATEWAY/hdfs.keytab hdfs/cm-r01en01.mws.mds.xyz@MWS.MDS.XYZ [root@cm-r01en01 process]# klist Ticket cache: FILE:/tmp/krb5cc_0 Default principal: host/cm-r01en01.mws.mds.xyz@MWS.MDS.XYZ Valid starting       Expires              Service principal 12/31/1969 19:00:00  12/31/1969 19:00:00  Encrypted/Credentials/v1@X-GSSPROXY: [root@cm-r01en01 process]#   Solve it […]

Getting this? [root@cm-r01en01 ~]# hdfs dfs -ls / 19/08/25 22:43:19 WARN ipc.Client: Exception encountered while connecting to the server : org.apache.hadoop.security.AccessControlException: Client cannot authenticate via:[TOKEN, KERBEROS] ls: Failed on local exception: java.io.IOException: org.apache.hadoop.security.AccessControlException: Client cannot authenticate via:[TOKEN, KERBEROS]; Host Details : local host is: "cm-r01en01.mws.mds.xyz/192.168.0.140"; destination host is: "cm-r01nn02.mws.mds.xyz":8020; [root@cm-r01en01 ~]# Fix it by doing […]

Getting this from the Impala Daemon? The readiness of the Impala Daemon to process queries is not known. Investigation reveals: Aug 25 09:16:39 cm-r01wn01 kernel: FINAL_REJECT: IN=eth0 OUT= MAC=00:50:56:86:7e:b7:00:50:56:86:79:2a:08:00 SRC=192.168.0.132 DST=192.168.0.160 LEN=60 TOS=0x00 PREC=0x00 TTL=64 ID=6227 DF PROTO=TCP SPT=59318 DPT=23000 WINDOW=29200 RES=0x00 SYN URGP=0 Solve it by adding the port to the firewall configuration and […]

Getting this? Aug 25 08:18:51 idmipa03.mws.mds.xyz krb5kdc[6704](info): preauth (encrypted_timestamp) verify failure: Preauthentication failed Aug 25 08:18:51 idmipa03.mws.mds.xyz krb5kdc[6704](info): AS_REQ (4 etypes {18 17 16 23}) 192.168.0.140: PREAUTH_FAILED: hue/cm-r01en01.mws.mds.xyz@MWS.MDS.XYZ for krbtgt/MWS.MDS.XYZ@MWS.MDS.XYZ, Preauthentication failed Check the principal vs the keytab you're using for the same service: kadmin.local:  getprinc hue/cm-r01en01.mws.mds.xyz@MWS.MDS.XYZ Principal: hue/cm-r01en01.mws.mds.xyz@MWS.MDS.XYZ Expiration date: [never] Last password change: […]

Getting this error? ==> /var/log/cloudera-scm-agent/cloudera-scm-agent.log <== [24/Aug/2019 22:00:08 +0000] 3697 Monitor-HostMonitor throttling_logger ERROR    Timed out waiting for worker process collecting filesystem usage to complete. This may occur if the host has an NFS or other remote filesystem that is not responding to requests in a timely fashion. Current nodev filesystems: /dev/shm,/run,/sys/fs/cgroup,/run/cloudera-scm-agent/process,/run/cloudera-scm-agent/process,/run/user/155601104,/n/mds.xyz,/run/user/0 [24/Aug/2019 22:00:08 +0000] […]

Getting this? INFO:desktop.kt_renewer:Renewing kerberos ticket to work around kerberos 1.8.1: /usr/bin/kinit -R -c /var/run/hue/hue_krb5_ccache kinit: KDC can't fulfill requested option while renewing credentials ERROR:desktop.kt_renewer:Couldn't renew kerberos ticket in order to work around Kerberos 1.8.1 issue. Please check that the ticket for 'hue/cm-r01en01.mws.mds.xyz@MWS.MDS.XYZ' is still renewable: $ klist -f -c /var/run/hue/hue_krb5_ccache If the 'renew until' date […]

Getting this? -bash-4.2$ kadmin -k -t /tmp/kadmin/cmf8392129202434993503.keytab -p cmadmin-530029b6@MWS.MDS.XYZ -r MWS.MDS.XYZ -q 'listprincs'         Authenticating as principal cmadmin-530029b6@MWS.MDS.XYZ with keytab /tmp/kadmin/cmf8392129202434993503.keytab. kadmin: Communication failure with server while initializing kadmin interface Ensure you have port 749 defined in your firewall config: [root@idmipa03 ~]# cat /etc/firewalld/zones/public.xml|grep -Ei 749   <port protocol="tcp" port="749"/> [root@idmipa03 ~]# […]

Getting this error from Ansible? ERROR! Extraneous options or arguments Simply drop down one folder where the infra file resides and reexecute: [root@awx01 adhoc]# cd .. [root@awx01 ansible]# ansible cm* -i infra -m copy -a 'src=adhoc/public.xml dest=/etc/firewalld/zones/public.xml' This was just a fancy way of ansible telling you it can't find the infra file containing the […]