Hadoop Setup and Architecture

-

Comments

Post a Comment

Popular posts from this blog

DataStage | Remote Column Propagation ( RPC )

-
Image
I actually love this feature in DataStage. I think this is one of the excellent feature of dataStage and yet not been effective used by everyone. So I thought let me document it. Things covered in this Blogs are RPC features and highlights Manipulating just few column from the list of RPC'd columns. Deleting a column from the RPC list as it is not required for the target. Add new columns at the bottom of the existing RPC list. RPC highlights As you all know, when we enable the check box "Runtime column propagation" there is no need to define any column definition. The column name, type, nullable characteristics and the value gets carried to the target stage.  Saves a lot of time in manual column defining ( using "load" table definition manually is not that great). Secondly when you make changes to you tables, you don't have to do anything on your DS job ( you can also argue this as a negative thing, but in most case I think it is helpful)...
Read more

Tableau - Accessing Tableau's DB

-
Image
Click here for other Tableau related Blogs Please note that TABLEAU does not advice anyone to access their DB. So if you are doing it you are on your own. Tableau has 2 DB Postgresql for managing all its reporting repositories FireBird for mapping repositories Tools Required pgAdmin 3 for PostgreSql Flamerobin for FireDB Accessing Tableau's PostgreSQL DB Tableau has 2 buitin userid tableau = with read-only access to some of Tableau's view tblwgadmin = admin user will all privileges Please note tblwgadmin is like a admin user, so if you are using this you have to be very careful. Or if you dont admin privs but just need enough access to read the tables then use just "tableau" user. Get access for "tableau" user.  First set a password for "tableau" userid open command prompt go to <Tableau_Home>\Tableau Server\7.0\bin run -  tabadmin dbpass <give a password> Restart the server Now open pgAdmin3 and from...
Read more

Tableau : Convert ESRI shapes into Tableau Format

-
Image
Click here for other Tableau related Blogs Requirement is to convert data in ESRI Map shapes into Tableau format. Tools Required Quantum GIS -  http://www.qgis.org/en/site/ Python  Download the below Python Code -  https://github.com/venkat-vs-id/python import csv import re import sys #def convertESRI2TableauFormat( p_inputfile, p_outputfile): l_outfileName = 'c:/ESRI_suburb_tab_format.csv' # make changes here.. l_ESRIFileName ='c:/ESRI_suburb.csv' # make changes here.. rdx=0 csv.field_size_limit(sys.maxsize) outfile = open( l_outfileName, 'w', newline='') csvWriter = csv.writer( outfile, delimiter=',', quotechar='"', quoting=csv.QUOTE_MINIMAL) with open( l_ESRIFileName, 'r') as csvfile: csvR = csv.reader( csvfile, delimiter=',', quotechar='"') for row in csvR: rdx += 1 ci=0 rowValues = [] rowValues.append(row[1]);# ssc_code rowValues.append(...
Read more