Posts

Kinesis | Trouble Shooting

Im currently working on AWS KINESIS and thought I will document all the issue I'm facing When running consumer.py - I got              SEVERE: Failed to start client executable             java.io.IOException: Cannot run program "/bla/bla/bla/my_aws/mySample_kcl_app.py": error=2, No such file or directory SOLUTION: This is what I found you can have absolute path or relative it doesnt matter. it is not necessary to set the PATH if you are using absolute path if you had use the (consumer)sample.py as a template, then fix the shebang (ie.. origina sample.py had #!env python... It is for this the KCL lib threw the error file or directory not found. change this to the actual python path like (#!/usr/bin/env python). Then the file or folder not found error is gone.

DataStage | Remote Column Propagation ( RPC )

Image
I actually love this feature in DataStage. I think this is one of the excellent feature of dataStage and yet not been effective used by everyone. So I thought let me document it. Things covered in this Blogs are RPC features and highlights Manipulating just few column from the list of RPC'd columns. Deleting a column from the RPC list as it is not required for the target. Add new columns at the bottom of the existing RPC list. RPC highlights As you all know, when we enable the check box "Runtime column propagation" there is no need to define any column definition. The column name, type, nullable characteristics and the value gets carried to the target stage.  Saves a lot of time in manual column defining ( using "load" table definition manually is not that great). Secondly when you make changes to you tables, you don't have to do anything on your DS job ( you can also argue this as a negative thing, but in most case I think it is helpful)...

TABLEAU | My Résumé

Image
Here is my first Attempt to a VISUAL CV. I thought why not use TABLEAU to achieve this. I also gave a challenge to myself to have different data source( i,e excel sheets) and join them to achieve what I want. My main objective of this exercise are - Achieve a VISUAL and INTERACTIVE CV. Use TABLEAU's new "story board" feature and hight areas of the chats based on the story selected. Is to gain a better understanding of joins with multiple data sources within TABLEAU. Visual / Interactive CV in TABLEAU URL -  https://public.tableausoftware.com/views/CV_11/CareerStory?:embed=y&:display_count=no Learn About Tableau

Apps | Cows and Bulls

Image
       DESCRIPTION of the APP Its a SINGLE PLAYER game in which the App randomly selects a 4 character english word and hides that from you. You now get 10 guesses to find that word. After each Guess the App gives you a hint of how close you are to the hidden word. The hint is given as count of BULLs and COWs. A BULL means a character in your guess exists in the hidden word and also the position matches. A COW means a character in your guess exists on the hidden word, but the position does not match. This is a simple game which can help in improving your analytical skills, memory skills and basic english. Above all its lots of fun to play this game. Examples Lets assumes "PART" is the hidden word if the guess word is "JOLT" then its 1 BULL because "T" from JOLT also exists in PART and it in the same position ie 4th position. If the guess word is "TONE" then its 1 COW because "T" from TONE exists in PART but their positi...

Apps | PhoneticHelp

Image
This is my very first IOS app, more like my first hello world app I wrote 3 years ago. DESCRIPTION of the APP 1. This app helps to spell some of the common names/words, over the phone. 2. Supports 2 languages( english and German). 3. To spell each letters, the APP uses a set of phonetic words, which have a distinctive pronunciation and   commonly used for spelling alphabet. 4. This App ships with the initial set of Phonetic words for both the languages. 5. This App also allows to customise the words, if the user prefers to have his/her own words for a specific( or all) letter(s). Technical Details: Uses Sqllite as the internal DB. Objective C Designed for iPhone and Ipods.

No SQL DB || Big DATA DBs List

Image

SSIS | Read & Update Sharepoint File List using SSIS

Image
This blog will cover the following items Read a SharePoint document Lists (in my case it is a document library and has custom columns)  And get a handle to each file available ( which can be used to import the data from the file) Use CAMLQuery specific files only. Update value back to Sharepoint file record.  the SSIS- sharepoint  adapater from CodePlex – ( SharePointListAdaptersSetup.msi ) - https://sqlsrvintegrationsrv.codeplex.com/releases/view/17652 Create a new SSIS Project and create a new “data flow Task” in “control Flow” screen a nd go to the “Data Flow” screen.   In “Data flow” screen you should see the below components. If not then something has gone wrong at step-1. Please fix that first. Also add the "SharePointList source" and SharePointList Destination" to the Data Flow Create a new "connection", by right clicking on "Connection Manager".  Select the Connection Manager for Sharepoint.  Now open the pro...