Monthly Archives: July 2015


Kafka Architecture
In this post we will discuss about Kafka Installation and Test Broker Setup in Ubuntu machine in a stand-alone zookeeper mode. Apache Kafka: Open Source Message Broker from Apache Software Foundation.  Initially developed at LinkedIn and later contributed to Open-source community. It is written in Scala. Kafka Provides a unified, […]

Kafka Installation and Test Broker Setup


2
HBase Functions Cheat Sheet SHELL [cloudera@quickstart ~]$ hbase shell LIST hbase(main):003:0> list SCAN Scanner specifications may include one or more of: TIMERANGE, FILTER, LIMIT, STARTROW, STOPROW, TIMESTAMP, MAXLENGTH, or COLUMNS, CACHE. If no columns are specified, all columns will be scanned. To scan all members of a column family, leave […]

HBase Functions Cheat Sheet


Good SQL Queries Collection /* CREATE TABLE FOR DEPARTMENT */ CREATE TABLE DEPARTMENT ( “DEPT_ID” NUMBER, “DEPT_NAME” VARCHAR2(30), PRIMARY KEY (“DEPT_ID”) ) /* CREATE TABLE FOR EMP */ CREATE TABLE EMPLOYEE ( “EMP_ID” NUMBER, “MGR_ID” NUMBER, “DEPT_ID” NUMBER, “EMP_NAME” VARCHAR2(30), “SAL” NUMBER, “DOJ” DATE, PRIMARY KEY (“EMP_ID”) ENABLE, FOREIGN KEY […]

Good SQL Queries Collection



Real Time Hadoop Interview Questions from Various interviews Hive – Where do you use Internal or Managed table? What scenarios? In your resume, what do you mean by, “monitoring & managing MapReduce jobs”? Explain? Interviewer’s Project: How to modify the RDBMs’ Nested SQL queries into Hadoop framework using Pig. Sqoop: […]

Real Time Hadoop Interview Questions From Different Readers


Hadoop Testing Tools MRUnit  – Java framework that helps developers unit test Hadoop Map reduce jobs. Mockito –  Java Framework, similar to MRUnit for unit testing Hadoop Map reduce jobs. PigUnit – Java framework that helps developers unit test Pig Scripts. HiveRunner – An Open Source unit test framework for hadoop hivequeries based […]

Hadoop Testing Tools


This post is about basic String Functions in Hive with syntax and examples. Creating Table in HIVE: [crayon-5d121d3d9d7a7891734255/] String Functions and Normal Queries: [crayon-5d121d3d9d7b8989189674/] ASCII ASCII Function converts the first character of the string into its numeric ASCII value. [crayon-5d121d3d9d7bf817088724/]  CONCAT The CONCAT function concatenates all the strings/columns. [crayon-5d121d3d9d7c5602665579/] [crayon-5d121d3d9d7ca686970044/] [crayon-5d121d3d9d7cf507688244/] […]

String Functions in Hive



3
Deciding How to Pass Arguments to Oozie Jobs So far, you have learned about several ways to pass parameters to an Oozie job. To help you decide which approach to use, you should first understand how Oozie uses parameters: Oozie uses parameters explicitly defined inside an action’s <arg> tag. If […]

Passing arguments to Oozie workflows