Profile cover photo
Profile photo
Brian O'Neill
302 followers
302 followers
About
Brian's posts

Post has attachment
Productivity: Audacity and calculated Hubris in Estimation
I started work at Unisys as a summer intern when I was 18.  By the time I was 19, I had moved over to the Natural Language Processing group and was helping to rewrite their core semantic interpretation engine.  I loved it.  We had a big client to whom we ha...

Post has attachment

Post has attachment
Monetate: Philly's Best Technology Work Culture
Since I moved back to Philly from Silicon Valley, I've had the following on my resume: Goal: To bring the creative, inventive spirit of Silicon Valley to the Philadelphia region. Monetate is doing exactly this.   It is the first company for which I've worke...

Post has attachment
PySpark on Amazon EMR w/ Kinesis
Spark is fantastic.  And its streaming framework has proven to be a perfect fit, functioning as the real-time leg of a lambda architecture. In our initial use of Spark, we decided to go with Java, since Spark runs native on the JVM. (and sorry Scala, still ...

Post has attachment
Monetate open-sources Koupler: a versatile interface to Kinesis!
I'm happy to announce that Monetate has open-sourced Koupler, a versatile interface for Kinesis.  We took the best practices outlined by Amazon  and codified them. Hopefully, this will be the first of many contributions back to the community. For the full s...

Post has attachment
Using Squid as an HTTP Proxy via SSH (to fetch remotely from Amazon yum repos)
We've been playing around with vagrant for local development.   When combined with Ansible, the pair allows you to recreate complex systems locally with high fidelity to your deployment environment.   Through magic voodoo (kudos to @jjpersch and @kmolendyke...

Post has attachment
Diagnosing memory leaks in Java
Every time I suspect a memory leak, I have to go dig up these commands. So, here they are for posterity's sake: First, I use the following command to monitor the process over time: while ( sleep 1 ) ; do ps -p $PID -o %cpu,%mem,rss ; done (and/or New Relic...

Post has attachment
Using Gradle with AWS and S3 (w/ DefaultAWSCredentialsProviderChain and InstanceProfileCredentialsProvider (FTW!))
We recently switched over to gradle as our build mechanism.  As part of that switchover, we wanted to be able to build w/o external dependencies (e.g. Maven Central).  We tossed around the idea of Artifactory, but in the end we decided to keep it simple and...

Post has attachment
Reverse Engineering Kinesis Aggregation and Sharding (and the magic "a" partitionKey)
I love open source.  I love being able to take things apart to understand them.  And for that reason, I'd like to thank Amazon for open sourcing Kinesis Consumer Library  and Kinesis Producer Library .  It allowed us to get to the bottom of a couple of stra...

Post has attachment
A quick proof that Black is not White (to save all of mankind)
In the Hitchhiker's guide to the galaxy, there is a proof about the non-existence of God.  The reasoning roughly mimics that of the Ontological argument for God . The passage has stuck with me: "I refuse to prove that I exist," says God, "for proof denies f...
Wait while more posts are being loaded