Profile cover photo
Profile photo
Pulasthi Supun Wickramasinghe
707 followers
707 followers
About
Posts

Post has attachment
Using screens to handle long running jobs in remote servers
This will be a short post on using screen sessions when running long jobs on remote servers. Using screen session will help if you don't want something that is running to stop when you loose connection to the server. I use this when i run long running jobs ...
Add a comment...

Post has attachment
Similarities and Differences Between Parallel Systems and Distributed Systems Part 2
This post part 2 from a series of posts that are extracted from a technical report i wrote for a research study and Indiana University. The full paper can be found in the  digital science center  publications page, or you can get the pdf link  here . I thou...
Add a comment...

Post has attachment
Similarities and Differences Between Parallel Systems and Distributed Systems Part 1
This post part 1 from a series of posts that are extracted from a technical report i wrote for a research study and Indiana University. The full paper can be found in the digital science center publications page, or you can get the pdf link here . I thought...
Add a comment...

Post has attachment
Shell script for Tree structured copying to copy large data files to large number of nodes with scp
Sometimes you need to copy a large file to number of remote hosts. I recently had a similar situation where i had to copy a 56GB data file to around 30 compute nodes in an HPC cluster. And i did not have the option to copy it to the shared disk (since it wa...
Add a comment...

Post has attachment
Setting up Heron Cluster with Apache Aurora Locally
In this post we will be looking at how we can setup Heron steam processing engine in Apache Aurora in our local machine. Oh Boy this is going to be a long post :D. I am doing this on Ubuntu 14.04 and these steps should be similar to any Linux machine. Heron...
Add a comment...

Post has attachment

Post has attachment
Getting started with Heron in Ubuntu 14.04
I was trying to get started with Heron which is a stream processing engine from twitter and faced some problems when trying to do the initial setup on Ubuntu. I am using Ubuntu 14.04 so not these problems might not happen in other Ubuntu versions. The steps...
Add a comment...

Post has attachment
Apache Hadoop detailed word count example from scratch
In this post we will look at how to create and run a word count program in Apache Hadoop. In order to make it easy for a beginner we will cover most of the setup steps as well. Please note that this blog entry is for Linux based environment. I am running Ub...
Add a comment...

Post has attachment
Reading and Writing Binary files in java - Converting Endianness ( between Big-endian byte order and Little-endian byte order)
In this post we will look into working with binary files in java. The end goal of the post will be to create simple java application that reads a binary file and write it back to a different binary file. The difference between the two files would be the byt...
Add a comment...

Post has attachment
Wait while more posts are being loaded