Jedd Haberstro's posts

Post has attachment

**Frequentists vs Bayesians**

A really wonderful aspect of learning about machine learning is that you can't help but learn about the field statistics as well. As a computer scientist (or really, a software engineer -- I have a hard time calling myself a computer scientist), one of the ...

Post has attachment

**An intuition for Newton's method**

During my lazy weekend afternoons (and all the other days of the week) I've been going through Nando de Freitas' undergraduate machine learning course on youtube . In lecture 26 he introduces gradient descent, an iterative algorithm for optimizing (potentia...

Post has attachment

**On optimizing high-dimensional non-convex functions**

Excuse me for the (in)completeness of this post. What follows is merely a thought, inspired by two independent statements, about a domain of science (or math, really) with which I am barely initiated. Let me give you these two statements first. In the book ...

Post has attachment

**TIL: premultiplied-alpha colors**

Alpha is the measure of how translucent an object is. An alpha of 0.0 means the object is entirely transparent, an alpha of 1.0 means the object is entirely opaque, and an alpha in the middle means a fraction of the total light may passthrough the object. T...

Post has attachment

**TIL: The column space and null space**

A vector space is a set of vectors that is closed under addition and scalar multiplication. In other words, given two vectors, v and w , a vector space is formed by the set of all linear combinations formed between v and w , namely c v + d w for arbi...

Post has attachment

**TIL: a principled approach to dynamic programming**

Dynamic programming has always been a topic I understood at a surface level ( it's just memoization, right?!) , but ultimately feared for lack of real-world experience solving such problems. I read today a superb explanation of a principled approach to solv...

Post has attachment

**TIL: Alpha-to-coverage for order-independent transparency**

Alpha-to-coverage is a computer graphics technique, supported by most (all?) modern GPUs, for rendering translucent multi-sampled anti-aliased primitives. Given an alpha value in the range of [0.0, 1.0] and N samples of color stored per pixel, the alpha ch...

Post has attachment

**TIL: Today I learned**

It has been a long time since my last appearance. I've written a couple of unfinished posts in that time, but I've realized that writing a detailed essay that's up to a satisfactory standard of quality is actually quite time consuming ( who would have thoug...

Post has attachment

**Encapsulation == Parameterization**

Martin Odersky recently made the interesting observation that encapsulation is equivalent to parameterization. He demonstrated this by showing how abstract types are used (in their natural fashion) for encapsulation in Scala, and then equivocated parameteri...

Post has attachment

**"Is President Obama Really A Socialist? Let's Analyze Obamanomics" -- Reactions**

I wrote this in response to a post of a Facebook friend the other night. It was never meant to be more than some casual thoughts, and sti...

Wait while more posts are being loaded