Profile

Cover photo
KyungHyun Cho
372 followers|164,207 views
AboutPostsPhotos+1's

Stream

KyungHyun Cho

Shared publicly  - 
 
Very nice paper! This may be a way toward building a generative model for large, realistic images: http://arxiv.org/abs/1412.6604
Abstract: We propose a strong baseline model for unsupervised feature learning using video data. By learning to predict missing frames or extrapolate future frames from an input video sequence, the model discovers both spatial and temporal correlations which are useful to represent complex ...
6
2
Vincent Vanhoucke's profile photo노현우's profile photo
Add a comment...

KyungHyun Cho

Discussion  - 
Abstract: While depth tends to improve network performances, it also makes gradient-based training more difficult since deeper networks tend to be more non-linear. The recently proposed knowledge distillation approach is aimed at obtaining small and fast-to-execute models, and it has shown that ...
37
8
Dai Wei's profile photoHao Wooi Lim's profile photo
Add a comment...

KyungHyun Cho

Shared publicly  - 
4
Add a comment...

KyungHyun Cho

Shared publicly  - 
Summary¶. This tutorial aims to provide an example of how a Recurrent Neural Network (RNN) using the Long Short Term Memory (LSTM) architecture can be implemented using Theano. In this tutorial, this model is used to perform sentiment analysis on movie reviews from the Large Movie Review Dataset ...
16
3
Junyoung Chung's profile photoKyle Kastner's profile photoAlec Radford's profile photoPo-Sen Huang's profile photo
12 comments
 
My impression on GRU is that it does something really good on discrete sequence modeling (tasks such as language modeling, polyphonic music modeling, etc.).
Add a comment...

KyungHyun Cho

Shared publicly  - 
 
http://lisa.iro.umontreal.ca/mt-demo/embs/
The web demo of <Not All Neural Embeddings are Born Equal>: +Felix Hill, +Sébastien Jean Coline Devin +Yoshua Bengio 
4
1
Kyle Kastner's profile photo
Add a comment...

KyungHyun Cho

Shared publicly  - 
 
Our NIPS demo page of neural machine translation is now online and support English->French and English->German: http://lisa.iro.umontreal.ca/mt-demo/
Our network was trained on a lot of data from the United Nations and the European Parliament, so these are the kind of sentences that it does well on. Give them a try! Economic growth has slowed down in recent years. The war in the Middle East is almost over. The European Parliament has decided ...
13
Add a comment...

KyungHyun Cho

Shared publicly  - 
 
 
Imagine a human, doesn't matter how old, 60yo, 16yo, 6yo, who never been exposed to language, never been taught arithmetics. And then he was presented with task of predicting what the short Python program output will be... Well human without any sort of basic education, nvm knowledge of language would have zero chance of figuring out the task on his own.

And here is the code that could do it. Not only it gets it mind around how to do addition, subtraction, multiplication, but it also grasp concepts of loops, if statements, variables... All by being exposed to puzzles represented by Python code and to the output of the code.

Well, the code was published yesterday, and if you have Linux with Nvidia GPU you could try it yourself. Link to relevant paper is on the same page.
6 comments on original post
2
Add a comment...
In their circles
446 people
Have them in circles
372 people
Eric Laufer's profile photo
Saizheng Zhang's profile photo
Daniel Nordberg's profile photo
Jack Lin's profile photo
Jaeyoung Kwak's profile photo
Da-Woon Chung's profile photo
Heechul Jung's profile photo
Sanjith S's profile photo
Jimmy Ba's profile photo

KyungHyun Cho

Shared publicly  - 
19
11
Deniz Yuret's profile photoMikhail Bakhterev's profile photoolgert denas's profile photoSai Rajeshwar's profile photo
2 comments
 
I should note I messed up the initialization bias counteracting in the implementation used for these slides. >.>
Add a comment...

KyungHyun Cho

Shared publicly  - 
 
https://github.com/mesnilgr/nbsvm NB-SVM for Sentiment Analysis +Gregoire Mesnil 
Contribute to nbsvm development by creating an account on GitHub.
1
Add a comment...
 
Neural machine translation applied to English->German this time with a nice result: http://arxiv.org/abs/1412.2007 +Sébastien Jean +Roland Memisevic +Yoshua Bengio 
Abstract: Neural machine translation, a recently proposed approach to machine translation based purely on neural networks, has shown promising results compared to the existing approaches such as phrase-based statistical machine translation. Despite its recent success, neural machine translation ...
9
1
Macduff Hughes's profile photoAlbert Zeyer's profile photo
Add a comment...

KyungHyun Cho

Shared publicly  - 
 
<End-to-end Continuous Speech Recognition using Attention-based Recurrent NN: First Results> by +Jan Chorowski+Dzmitry Bahdanau, me and +Yoshua Bengiohttp://arxiv.org/abs/1412.1602
Abstract: We replace the Hidden Markov Model (HMM) which is traditionally used in in continuous speech recognition with a bi-directional recurrent neural network encoder coupled to a recurrent neural network decoder that directly emits a stream of phonemes. The alignment between the input and ...
12
3
Albert Zeyer's profile photoraia hadsell's profile photo
Add a comment...

KyungHyun Cho

Shared publicly  - 
2
Hugo Larochelle's profile photoKyungHyun Cho's profile photo
2 comments
 
+Hugo Larochelle That sounds like a good idea! I'll discuss with people here and see how it works out. 
Add a comment...
People
In their circles
446 people
Have them in circles
372 people
Eric Laufer's profile photo
Saizheng Zhang's profile photo
Daniel Nordberg's profile photo
Jack Lin's profile photo
Jaeyoung Kwak's profile photo
Da-Woon Chung's profile photo
Heechul Jung's profile photo
Sanjith S's profile photo
Jimmy Ba's profile photo
Links
KyungHyun Cho's +1's are the things they like, agree with, or want to recommend.
BMW 316 E46 2003 - Used vehicle - Nettiauto
www.nettiauto.com

Nyt myynnissä BMW 316 E46 109 000 km 2003 - Espoo. Klikkaa tästä kuvat ja lisätiedot vaihtoautosta.

InoReader: News and RSS Reader
chrome.google.com

RSS reader built with simplicity and speed in mind. Inspired by Google Reader. Made for Google Reader fans.

ICML 2013 Reading List
peekaboo-vision.blogspot.com

The ICML is now already over for two weeks, but I still wanted to write about my reading list, as there have been some quite interesting pap

The Benefits of Double-Blind Review « Machine Learning (Theory)
hunch.net

This post is a (near) transcript of a talk that I gave at the ICML 2013 Workshop on Peer Review and Publishing Models. Although there's a PD

What it took 20 years on Wall Street to learn | Guest Blog, Scientific A...
blogs.scientificamerican.com

I was always attracted to numbers. In middle school my baseball card collection spilled into a second drawer, driven by my love of the stati

Is It Quantum Computing or Not? | Guest Blog, Scientific American Blog N...
rss.sciam.com

This week I had a fascinating discussion on BBC Radio 4 with Dr Geordie Rose, the CTO of DWave, triggered by the news that NASA and ...

End Piracy, Not Liberty – Google
www.google.com

Millions of Americans oppose SOPA and PIPA because these bills would censor the Internet and slow economic growth in the U.S.. Two bills bef

DNA - Puhelimen tarkemmat tiedot
www.dna.fi

Etusivulle. Sivukartta; Yhteystiedot; In English. Hakusana. Yksityisille; Yrityksille; Nettikauppa; DNA Oy. Puhe; Liikkuva Laajakaista; Laaj

Daum - 생활이 바뀐다! Life On Daum
www.daum.net

전체서비스. 가계부; 검색쇼; 검색트렌드; 공연; 게임; 금융; 날씨; 디렉토리검색; 루리웹; 모바일; 모터쇼; 문자. 문학속세상; 문화유산; 미즈넷; 미즈맘; 미즈쿡; 보안넷. 소설; 소셜쇼핑; 쇼핑원; 쇼핑하우; 스타일; 스포츠. 아이찾기; 여행;

[단독] 박주영, 군대 10년 연기…‘은퇴 후 공익근무요원 복무’ - Daum 스포츠
sports.media.daum.net

[일간스포츠 박린]박주영(28·아스널)이 군대를 미뤘다.박주영 측 대리인인 법무법인 DLS의 이성희 변호사는 16일 "박주영이 국외여행기간 연장 허가 되었음으로 국외 입영연기가 허가됐다. 외국에 거주하면 군대를 미룰 수있다는 허가서를 발급 받았다"고

Docs PDF/PowerPoint Viewer (by Google) - Chrome Web Store
chrome.google.com

Automatically previews pdfs, powerpoint presentations, and other documents in Google Docs Viewer.

Chrome Multitask Mode
www.google.com

Chrome Multitask Mode lets you browse the web with multiple mice at the same time, so you can get more done, clickety-split.

Winter tyre change due soon
www.yle.fi

Approaching colder weather means changing over to winter tyres should be done as soon as possible. According to a survey carried out by Y

News: Two Tenure Track or Tenured Positions in Information and Computer ...
ics.aalto.fi

The positions are open to outstanding individuals who hold a doctorate and have excellent potential for a successful scientific career. Cand

Surplus - Chrome Web Store
chrome.google.com

Google Plus Integration for Chrome

Introducing the ZenRobotics R&amp;D Blog
techblog.zenrobotics.com

Short and sweet: we are launching a blog, by the technical staff, for other technical people, to: Share what it is like to work as an engine

이우진의 이글루 : 줄것처럼 하다가 안주는게 더 싫어
stonepc.egloos.com

줄것처럼 하다가 안주는게 더 싫어. 보통 보면... 얼마 되지도 않는데 오라가라... 이래라 저래라... 그러면서 결제일은 또 늦고.... 그나마 조금이나마 되면 다행인데 뭐 줄것처럼 잔뜩 생색내놓고, 결국엔 &quot;미안합니다 다음 기회에...&amp;q

You're Lucky if You're in Tallinn
online.wsj.com

This charming medieval city is one of Europe's most attractive capitals, with its people still reveling over reestablishing their national i

News: 10 Postdoc / Research Associate positions in the new Finnish Cente...
ics.tkk.fi

Department of Information and Computer Science. Aalto Yliopisto logo. Suomeksi. Contact information; Text version. Department of Information