For the last few weeks, Googlers have been obsessed with an internal visualization tool that Alexander Mordvintsev in our Zurich office created to help us visually understand some of the things happening inside our deep neural networks for computer vision. The tool essentially starts with an image, runs the model forwards and backwards, and then makes adjustments to the starting image in weird and magnificent ways.
In the same way that when you are staring at clouds, and you can convince yourself that some part of the cloud looks like a head, maybe with some ears, and then your mind starts to reinforce that opinion, by seeing even more parts that fit that story ("wow, now I even see arms and a leg!"), the optimization process works in a similar manner, reinforcing what it thinks it is seeing. Since the model is very deep, we can tap into it at various levels and get all kinds of remarkable effects.
Alexander, , and Mike Tyka wrote up a very nice blog post describing how this works:
There's also a bigger album of more of these pictures linked from the blog post:
I just picked a few of my favorites here.
- SRE: Systems Engineer, 2007 - present
- Deutsche Bank1999 - 2007
- Credit Suisse First Boston1997 - 1999
- Nomura Research Institute1996 - 1997
- Salomon Brothers International Ltd1994 - 1996
- The Institute of Cancer ResearchSystems Programmer, 1991 - 1994
- The Victoria University of ManchesterComputer Science, 1988 - 1991
Google searches for blue-ribbon HQ - but can it fit in Sydney?
Leading property groups are jockeying to house Google’s gigantic Australian headquarters - which will be one of the biggest in the country -
Israel has broken my heart: I’m a rabbi in mourning for a Judaism being ...
I've always been proud of Israel, but the brutal Gaza assault requires Jews worldwide to be honest, not nationalist
Dinner for two? A serving of cheap and cheerful, please
Catherine Deveny: Australians are eating out more but spending less. I blame jus