Profile

Cover photo
Drew Conway
Attends New York University and Hamilton College
Lives in Brooklyn, NY
1,276 followers|43,863 views
AboutPostsPhotosVideos

Stream

Drew Conway

Shared publicly  - 
 
A quotation of mine about where I think data science may be headed as a discipline.

Plus lots of other -- smarter -- words from others, with bonus coverage of +Harlan Harris work. 
Is a data scientist just a confused statistician And does data science even exist Some industry heavyweights weigh in.
4
2
Yann LeCun's profile photoHarlan Harris's profile photoRui Miguel's profile photo
 
Amazing how the "data science is just statistics" crowd completely misses the paramount importance of computation

Data Science is at the juncture of statistics, machine learning, optimization and a few areas of applied math, and a host of other areas of computer science. It is not "contained" in any of the above disciplines.

The critiques we hear about data science today are similar to the ones that were addressed to computer science in the 60's and 70's, before it became a full-fledged  academic discipline: "it's just a branch of mathematics" or "it's just a branch of electrical engineering". What made it turn into a discipline was its size and importance to society.
Add a comment...

Drew Conway

Shared publicly  - 
 
"I'm a gremlin, I'm leaving the party, and I want everyone to stuff the ice chest. Thank you."

"Mitt Romney" — A BLR Soundbite
3
1
James Long's profile photoDrew Conway's profile photoJames Savage's profile photo
2 comments
 
Before Kristen left this morning she said, "Have fun at the fiesta piranha party tonight!" It has begun...
Add a comment...

Drew Conway

Shared publicly  - 
 
Do you like exotic salamanders and hacking text data? Then you'll love +John Myles White and my forthcoming mini-eBook on machine learning for email.
9
8
Alexandre Passos's profile photoJoseph Quattrocchi's profile photo
Add a comment...

Drew Conway

Shared publicly  - 
 
Edd Dumbill originally shared:
 
After mentioning the release of +Wes McKinney 's Python data library, pandas, on Twitter I asked him and +Drew Conway if there was an overview of the variety of Python data processing libraries.

It turns out some of Wes' work is in response to discontent with the state of libraries in Python for manipulating data structures. In the post linked below, A Roadmap to Rich Scientific Data Structures in Python, Wes explains a little of what existing solutions lack, and outlines his vision to produce a data processing solution in Python that "trounces R".

If you're in New York, you can catch talking about his work tomorrow night at the Open Statistical Programming Meetup. Oh yeah, and Strata's paying for the first round of drinks :) http://edd.me/r78MqG
A Roadmap for Rich Scientific Data Structures in Python. Posted by Wes McKinney on July 21, 2011 Leave a comment (31) Go to comments. Discussion thread on Hacker News. So, this post is a bit of a brai...
4
4
Lynn Cherny's profile photoBruno M's profile photo
Add a comment...

Drew Conway

Shared publicly  - 
3
Add a comment...

Drew Conway

Shared publicly  - 
 
So, at about 2:00AM this morning Kristen wakes me up frantically and whispers, "Drew, I think there is someone ringing our doorbell..."

Just as she finishes, the doorbell rings in quick succesion. Not the front door buzzer, but the doorbell, so someone is standing at our door at 2 in the morning. I walk up to the door and look through the peephole and am faced with the eyeball of a strange man starring me back right back. After my partial heart attack passes, I go back in the room and tell Kristen not to worry, but there is a strange man standing in front of our door.

I walk back to the door, look through the peephole and say, "What do you want?" To which the many stumbles backwards and mumbles some nonsense. Now I see that not only is there something very wrong with our new friend, but he is also not wearing a shirt. I yell back to him, "Are you OK, are you hurt?" And faintly I hear, "No."

I implore him to just go home, but after a minute instead of leaving he decides to cover the peephole. Frustrated and scared, we decide to call the police, at about 2:10AM. At 2:20AM (a very long 10 minutes), after parking and re-parking their squad car several times, as to avoid stepping in curbside puddle in front of our apartment, two uniform police officers come to our door. When I open the door there is a ratty white towel laying in front it, but no topless man.

I explain to the officers the situation, but also that from our vantage point in the apartment we can see people coming and going from the building, so we think the guy must still be inside. Just as the words leave my mouth, a loud crash is heard a few floors up. Both offices unholster their sidearms, and command us to go back inside and stay there. Guns pointed up, the officers slowly climb the stairs.

As they get to second floor, our upstairs neighbor---likely aroused by the commotion---opens his door to survey the situation. The officers bark out, "Stay right right where you are! Do you live in this building?! Let me see your hands! Do you have keys for that apartment?!" Unfortunately, because I stated the man at my door had no shirt, and my neighbor came to the door with no shirt, he was an immediate suspect. After they worked it out, the officers continued up the stairs.

Upon reaching the third floor, they find our man. Passed out, laying in front of the apartment two floors directly above ours. From our door, Kristen and I hear...

"Sir, how do you get in the building? Are you hurt? What happened to your clothes? Do you live here, is this your apartment?"

We cannot hear any of the response, but after about 5 minutes one of the officer's cell phone rings, "Hello...yeah, we're here. We found him [laughing] he's butt ass naked in the hallway!"

Kristen and I look at one another, and begin laughing. After about another 10 minutes, two more officers arrive with EMTs. The original responding officers come back downstairs and inform us that it is actually our 4th floor neighbor, having a PARTICULARLY rough Sunday night, and that everything is under control and we are welcome to go back to sleep.

As my father said when I told my parents the story, I guess that's why they call it the naked city.
15
Jeremy Allen's profile photoMax Kesin's profile photo
2 comments
 
Nakedness might be a good self-defense trick against getting shot my NYPD - I don't think "he was going for his gun" will stand up in in court
Add a comment...
Have him in circles
1,276 people
Boris Avsec's profile photo
emierul aimy's profile photo
j verzani's profile photo
Hermano Gualberto's profile photo
Neil Bhatiya's profile photo
Stephen Rush's profile photo
Simon Lilburn's profile photo
TAY TAKI's profile photo
amel mumut's profile photo

Drew Conway

Shared publicly  - 
 
"Statisticians don't program."

Thoughts on this as a normative statement?

http://flowingdata.com/2011/10/18/statisticians-dont-program/
Recently Popular. yoda Yoda pie chart 6 comments. unfacebook Where people don't use Facebook 16 comments. How Americans spend their day -full How do Americans spend their days? 13 comments. No con...
1
1
James Long's profile photoAndrew Redd's profile photoYann LeCun's profile photoJohn Johnson's profile photo
3 comments
 
More people need to see your Venn diagram Drew.
Add a comment...

Drew Conway

Shared publicly  - 
 
I say the ecosystem is its biggest asset.
What's there to like about R? Posted on October 12, 2011 by yang. The R statistical computing platform is a rising star that's been gaining popularity and attention, but it gets no respect in ...
8
2
Jay Ulfelder's profile photoWes McKinney's profile photoJames Long's profile photoRich Gillin's profile photo
6 comments
 
I don't think Sean's comment was that much of a non-sequitur because the article references Python throughout.

As far as R, I <3 the libraries, hate the language, and am kind of "meh" on the data structures ;)

As an aside, the only thing I have written that qualifies as a rant is my post on July 21 (http://bit.ly/rm41My) which was strictly a message to the Python community stating that we (the Python community) need to forge ahead in the domain of rich data structures. And I have done exactly that -- the amount of code that I've turned out recently (net increase of ~10kloc in pandas since 8/1) is pretty massive-- so I also walk the walk =P

And now I'm going to get back to hacking
Add a comment...

Drew Conway

Shared publicly  - 
 
+Wes McKinney's talk to the NYC Open Statistical Computing meetup on statistical computing in Python and data manipulation using his pandas package.

http://www.vcasmo.com/video/drewconway/13268

Which, seems to have sufficiently rattled the collective R beehive.

https://plus.google.com/109246313993679724191/posts/93DCxiASTsQ
Wes McKinney is a prominent figure in the scientific Python community, and has made tremendous contributions to several core statistical computing libraries in that language. This month, Wes will be ...
4
John Hunter's profile photoGavin Simpson's profile photoWes McKinney's profile photoLaurent Gautier's profile photo
9 comments
 
+Wes McKinney By this I mean that the discussion might have started differently. Say in the beginning "yes, I do reimplement functionailties I like under a BSD licence" and there is little that can argued about beside "why can't use GPL code" (and it usually ends with "check with a lawyer" ;-) ). I read more myself on the issue since this stared and while there is no clear cut, it made me see the extent of the problem for people wanting to distribute closed source code. Now I have some ideas around that, I hope to have code to demonstrate them by the end of the year.
Add a comment...

Drew Conway

Shared publicly  - 
 
Great op-ed by Evgeny Morozov on the tech of political repression

http://www.nytimes.com/2011/09/02/opinion/political-repression-2-0.html
2
1
J. Scott Shipman's profile photo
Add a comment...

Drew Conway

Shared publicly  - 
 
Edd Dumbill originally shared:
 
Glad to announce that +Alistair Croll 's data shirts are now up and available! A bunch of Strata types contributed to this, and profits are going to Data Without Borders.
1
Edd Dumbill's profile photo
 
I should add that you can contribute new shirt ideas at http://reddit.com/r/datashirts
Add a comment...

Drew Conway

Shared publicly  - 
 
Me ranting about the problems with how Twitter treats the intellectual members of its ecosystem
Data ownership, social science, and Twitter's folly. By Drew Conway, on July 28th, 2011. Last night I received the following courtesy email from the good folks at Infochimps: We received a takedow...
5
4
David Smith's profile photoPierre Roudier's profile photoAjay Ohri's profile photoGavin Simpson's profile photo
8 comments
 
Ought oh, now they almost certainly will!
Add a comment...
People
Have him in circles
1,276 people
Boris Avsec's profile photo
emierul aimy's profile photo
j verzani's profile photo
Hermano Gualberto's profile photo
Neil Bhatiya's profile photo
Stephen Rush's profile photo
Simon Lilburn's profile photo
TAY TAKI's profile photo
amel mumut's profile photo
Work
Occupation
PhD student in political science
Places
Map of the places this user has livedMap of the places this user has livedMap of the places this user has lived
Currently
Brooklyn, NY
Links
Contributor to
Story
Tagline
Hopeful academic, data nerd, average hacker, student of conflict.
Introduction
I am a PhD student in political science at New York University. Drew studies terrorism and armed conflict; using tools from mathematics and computer science to gain a deeper understanding of these phenomena.
Education
  • New York University and Hamilton College
    present
Basic Information
Gender
Male