Profile cover photo
Profile photo
Shahed Munir
23 followers
23 followers
About
Posts

Post has attachment
**
Google Sheets Download as csv using Python for processing into Hadoop Recent Client had some Google Sheets stored on their Google Drive and needed them processing into the Hadoop Cluster. As Google Drive uses Oauth authentication we needed to use a Service ...
Add a comment...

Post has attachment
Hive HPLSQL setup on Google DataProc
Hive HPLSQL setup on Google DataProc Google Dataproc Hadoop and Hive Hive Version : 2.3.2 (Version Supports Tez Engine) More Information on hplsql http://www.hplsql.org/ https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=59690156 As always we ...
Add a comment...

Post has attachment
PowerBI Custom Direct Query ODBC Connector
PowerBI Custom Direct Query ODBC Connector         At DeliverBI we have various challenges presented to us and a client uses Powerbi as their main reporting and analytics tool.     We implemented Presto , Hadoop , hive etc as we outlined in an earlier blog ...
Add a comment...

Post has attachment
Hive Tez vs Presto 12 Billion Records and 250 Columns Performance
Hive Tez vs Presto as
a query Engine & Performance 12 BILLION ROWS AND a 250 Column Table with
Dimensions.  Here at DELIVERBI we have been implementing quite a few Big Data
Projects. At one of our more recent clients we required speedy analytics using
a que...
Add a comment...

Post has attachment
Google Big Query Cloning DataSets - PROD --> TEST --> DEV Projects
Google Big Query Cloning of Datasets & Tables across GCS Projects. Copying of Tables and Datasets from PROD --> TEST --> DEV etc. Technologies Used Linux Python3 Pip library: google.cloud import bigquery Please make sure : pip install --upgrade google-cloud...
Add a comment...

Post has attachment
Scripting Hive Commands with Python
  Scripting Hive Commands with Python   In the previous posts, we touched upon basic data processing using Hive. But it is all interactive. We will discuss how to script these Hive commands using Python. We will start with a very basic python script and add...
Add a comment...

Post has attachment
Hive Big Data Command References
Add a comment...

Post has attachment
Hive Commands Reference
DELIVERBI Hive Command
Reference     Today we are sharing some of the frequently used Hive
commands and settings that will come handy To see the status of the Hive Server2 and also view the logs
etc. you can use the following URL http://<IP Addresses>:10002...
Hive Commands Reference
Hive Commands Reference
deliverbi.blogspot.com
Add a comment...

Post has attachment
Add a comment...

Post has attachment
Big Data Processing with Hadoop and Hive on top of the Google DataProc Service
Big Data Processing with Hadoop and Hive on top of the Google DataProc Service Offering     Business Scenario One of our clients wanted us to evaluate Hadoop for data processing of about 5000 Shops. The objective of this exercise is to establish if the curr...
Add a comment...
Wait while more posts are being loaded