Profile

Cover photo
555 followers|25,923 views
AboutPostsPhotosVideos

Stream

Dejan Research

Shared publicly  - 
 
A partitioning technique for improving the performance of PageRank on Hadoop

There are a lot of research results in large scale graph analysis on Hadoop. The performance of the graph analysis based on Hadoop is impacted by data partitioning. The effectiveness of data partitioning depends on how the data partitioning maintains data locality in each node of cluster, and this would be different from the problems faced with. One way of data partitioning known to be effective is partitioning data by domains.

For instance, this technique could be very useful in partitioning data by areas analyzing web graphs. But this kind of improvement from the data partitioning is limited to specific problems. In this paper, we propose a data partitioning technique based on semi-clustering for analyzing web graphs with PageRank algorithm on Hadoop.

With experiment, PageRank computation with our partitioning technique improves the performance, as the number of iterations increases. This method can be very effective in the case of large scale graph processing.

Authors
Hoon Choi 
Inf. & Software Res. Center, KISTI, Daejeon, South Korea 
Jungho Um ; Hwamook Yoon ; Minho Lee ; Yunsoo Choi ; Wongoo Lee ; Sakwang Song ; Hanmin Jung

Link: http://www.deepdyve.com/lp/institute-of-electrical-and-electronics-engineers/a-partitioning-technique-for-improving-the-performance-of-pagerank-on-j0zdfc0nOh
3
Add a comment...

Dejan Research

Shared publicly  - 
 
Wtf ("Who to Follow") is Twitter's user recommendation service, which is responsible for creating millions of connections daily between users based on shared interests, common connections, and other related factors. This paper provides an architectural overview and shares lessons we learned in building and running the service over the past few years.

Link: http://www.stanford.edu/~rezab/papers/wtf_overview.pdf
4
5
Add a comment...

Dejan Research

Shared publicly  - 
 
A conversation with scientist and inventor of the World Wide Web Tim Berners-Lee on what is wrong with social networking:
http://www.weforum.org/sessions/summary/insight-idea-tim-berners-lee
3
1
Add a comment...

Dejan Research

Shared publicly  - 
 
"In some parts of this world the rains predict disease, and a hot, dry, dusty wind is the harbinger of a meningitis outbreak that is yet to come. Now, from where you sit, Google will soon predict the next great epidemic."

http://www.google.org/denguetrends/
http://mappyhealth.com/
http://www.who.int/topics/dengue/en/
http://static.googleusercontent.com/external_content/untrusted_dlcp/research.google.com/en//archive/papers/detecting-influenza-epidemics.pdf
2
1
Add a comment...

Dejan Research

Shared publicly  - 
4
1
Jaaved Khatree's profile photo
 
Currently 2 QUT Grads repping it at Dejan SEO - myself and +Stephanie Danoy !
Add a comment...
Have them in circles
555 people
Jacob Pettit's profile photo
Al Johnson's profile photo
Ethio Helix's profile photo
Richard Green's profile photo
肖碧涛's profile photo

Dejan Research

Shared publicly  - 
 
Google’s Hybrid Approach to Research
Link: http://goo.gl/95ugQ

Google’s approach to research is iterative and usually involves writing production, or near-production, code from day one.

By closely connecting research and development Google is able to conduct experiments on an unprecedented scale, often resulting in new capabilities for the company. 
2
Add a comment...
People
Have them in circles
555 people
Jacob Pettit's profile photo
Al Johnson's profile photo
Ethio Helix's profile photo
Richard Green's profile photo
肖碧涛's profile photo
Contact Information
Contact info
Email
Story
Tagline
Advancing Search Education
Introduction
Dejan Research is a private initiative aimed at advancement of search education in schools and universities. Our primary objective is to highlight the significance of development of search skills as part of education and training activities.