Working with Apache Pig Datetime Functions

Datetime FunctionsAddDurationCurrentTimeDaysBetweenGetDayGetHourGetMilliSecondGetMinuteGetMonthGetSecondGetWeekGetWeekYearGetYearHoursBetweenMilliSecondsBetweenMinutesBetweenMonthsBetweenSecondsBetweenSubtractDurationToDateToMilliSecondsToStringToUnixTimeWeeksBetweenYearsBetween ...

Read More

Working with Apache Pig - String Functions

...

Read More

Working with Apache Pig Math Functions

...

Read More

Working with Apache Pig - Tuple, Bag, Map Functions

...

Read More

Working with Apache Pig Filter condition

...

Read More

How to work with Apache Pig Eval Functions?

How to work with Apache Pig Eval Functions? In this post I am focussing on the following Eval Functions. The examples shown are developed Pig v.0.15.0 as the latest binary available. Eval Functions Data: Department file: Employees file: ______________________________________________________________________________ EVAL...

Read More

Apache Pig Grunt shell Help Commands

The following options are based on Apache Pig 0.15.0 latest at the time. Please make sure to review my earlier posts in relation to this. These commands can be view once you entered into grunt shell either in local or map reduce mode. grunt> help Commands: <pig latin statement>; - See...

Read More

Apache Pig Command line Options

The following options are based on Apache Pig 0.15.0 latest at the time. Please make sure to review my earlier post in relation to this. Link: Ways of invoking Pig or Pig script from command line Apache Pig version 0.15.0 (r1682971) compiled Jun 01 2015, 11:44:35 USAGE:  Pig [options]...

Read More

Apache Pig Exercises: 22. List total sales per departmental store wise and consumer wise

In this post the sample Apache Pig script will display the total sales with respect to either departmental stores or with consumers. The examples and exercise scripts are created using Apache Pig current version r0.14.0. @ Test data structure and sample data: person,  dstore, spent A,...

Read More

What is Dereference in Apache Pig?

What is a Dereference? Many time it is necessary to reference a field in a tuple or a bag that are outside the current operator scope. Here is the complete pig script for your review to be able to discuss dereferencing: data = load 'books.txt' using PigStorage(',') as (f1:int, F1:chararray,...

Read More

Cannot locate pig-core-h2.jar. do 'ant -Dhadoopversion=23 jar', and try again

Error: While running Pig (in local mode from command line) if we may come across the following error" Cannot locate pig-core-h2.jar. do 'ant -Dhadoopversion=23 jar', and try again. Solution: Please make sure in your .bash_profile or .bashrc you have following environment variables:  export...

Read More