Profile

Cover photo
Frank Rusch
166,273 views
AboutPostsPhotosVideos

Stream

Frank Rusch

Shared publicly  - 
 
OEM-installed malware is bad... especially the kind that lets people at starbucks MITM your https traffic.
http://blog.erratasec.com/2015/02/extracting-superfish-certificate.html
#komodia  
I extracted the certificate from the SuperFish adware and cracked the password ("komodia") that encrypted it. I discuss how down below. The consequence is that I can intercept the encrypted communications of SuperFish's victi...
1
Add a comment...

Frank Rusch

Shared publicly  - 
 
Cool stuff... even its misfires are interesting.
“A green monster kite soaring in a sunny sky.”
...is intepreted as:
“A man flying through the air while riding a snowboard.”
 
A group of young people playing a game of frisbee.
A pizza sitting on top of a pan on top of a stove.
A person riding a motorcyle on a dirt road.
These are automatically generated captions from a computer model that starts with just the raw pixels of an image, described in a recent research paper titled Show and Tell: A Neural Image Caption Generator that was just published on Arxiv (http://arxiv.org/abs/1411.4555).

+Oriol Vinyals, +Alexander Toshev, +Samy Bengio,  and +Dumitru Erhan in our research group at Google have been working on automatically generating these captions using an accurate convolutional neural network (similar to the one that won the 2014 ImageNet object recognition challenge) combined with a powerful recurrent neural network language model (using an LSTM, a particular kind of recurrent network that is good at capturing long-range dependencies in sequence data, similar to the model that was used recently by our group's recent work on using LSTMs for machine translation).  The system initializes the state of the language model with the features from the top of the convolutional neural network, and is then trained to generate captions using a modest amount of human-labeled training data of (image, caption) pairs, and the resulting system does a good job of generalizing to generating captions automatically from previously-unseen images.

Since two of these folks sit within 15 feet of me, I've enjoyed watching their progress on this project and chatting with them over the past few weeks as it has developed.  The examples you can see in the New York Times article are great examples of what the system can do: it doesn't always get it right, but in general, the captions it generates are very fluent, mostly relevant to the image, and sometimes show a surprising level of sophistication.  Furthermore, because it is a generative model, and we're sampling from the distribution of possible captions, you can run the model multiple times, and it will generate different captions.  For one image, it might generate the two different captions "_A close up of a child holding a stuffed animal_" and "_A baby is asleep next to a teddy bear._"

+John Markoff of the New York Times has written up a nice article about this work (along with some similar research out of Stanford that has been happening concurrently):

http://www.nytimes.com/2014/11/18/science/researchers-announce-breakthrough-in-content-recognition-software.html

A Google Research blog post about the work has also just been put up here:

http://googleresearch.blogspot.com/2014/11/a-picture-is-worth-thousand-coherent.html

An Arxiv paper titled Show and Tell: A Neural Image Caption Generator appears here:

http://arxiv.org/abs/1411.4555

You can see a few more examples at the end of the set of slides from a talk I gave recently in China (pages 75 to 79 of this PDF):

http://research.google.com/people/jeff/CIKM-keynote-Nov2014.pdf

[ Edited to insert the title and link to the Arxiv paper now that it made it through the Arxiv editorial review process. ]
Scientists have created artificial intelligence software able to recognize the content of photos and videos with such accuracy than it can sometimes mimic humans.
6 comments on original post
1
Add a comment...

Frank Rusch

Shared publicly  - 
1
Timothy Waring's profile photo
 
Amazing. 
Add a comment...

Frank Rusch

Shared publicly  - 
 
http://www.cnn.com/2014/04/15/tech/innovation/blood-moon/

I like how CNN's URL puts "blood moon" under /tech/innovation.
Step outside, gaze upward and catch a glimpse of a coppery moon as it crosses the Earth's shadow.
1
Add a comment...

Frank Rusch

Shared publicly  - 
 
Fascinating talk from Alan Kay.

“The present just came from a tiny part of the past. And that’s the past we pay attention to when we pay attention to the past at all.”
1
Add a comment...

Frank Rusch

Shared publicly  - 
 
Intuition is... recognition.
1
Add a comment...

Frank Rusch

Shared publicly  - 
 
MacBook users -- it might be time to superglue your thunderbolt port.
https://trmm.net/Thunderstrike_31c3
This is an annotated version of my 31C3 talk on Thunderstrike, a significant firmware vulnerability in Apple's EFI firmware that allows untrusted code to be written to the boot ROM and can resist attempts to remove it. There is also an hour long video of the talk if you prefer to watch instead ...
1
Add a comment...

Frank Rusch

Shared publicly  - 
In light of eBay's recommendation to change your password, I went ahead and started that process. I get to the "new password" section to paste in...
1
Add a comment...

Frank Rusch

Shared publicly  - 
 
Cheers
1
Add a comment...

Frank Rusch

Shared publicly  - 
 
Learning how to walk...
1
Add a comment...

Frank Rusch

Shared publicly  - 
 
Coachella is streaming live on youtube this weekend.
 
Can't make it to Indio for Coachella this weekend? Catch more than 70 acts—including Lorde, Pharrell, The Replacements, Arcade Fire and Beck—streaming live on +YouTube starting at 3:30 p.m. PT today: http://goo.gl/bWkQSL. Ninety-degree weather not included. 
8 comments on original post
1
Add a comment...
Links
Basic Information
Gender
Male