Profile cover photo
Profile photo
Michael Mahemoff
15,897 followers -
It's so just cloud
It's so just cloud

15,897 followers
About
Michael's posts

Post has shared content

Post has attachment
Tardigrades: Nature's Cuddly, Indestructible Microanimal by Stuff You Should Know
https://player.fm/1jYRBs #nowplaying

These guys will last longer than humans. They'll last longer than cockroaches. They'll last longer than the Simpsons.

They're 600 million years old, survive freezing at near-zero, heating at over 100 degrees, water immersion, water deprivation, radiation. Oh and being sent to space and back.

Post has attachment
Play store question for the #lazyweb

Post has attachment
At some point, a single database instance starts to creak as more objects are added to it, even with read-only replication. A battle-proven strategy here is to scale horizontally via sharding, however there be dragons. Here are general design principles on sharding with relational databases such as MySQL and Postgres.

These are some good case studies on MySQL sharding:

* Sharding Pinterest: How we scaled our MySQL fleet (+ Hacker News thread on this).
* Sharding & IDs at Instagram

Only shard when you have to. Premature optimisation is, after all, the root of all evil. Sharding adds more servers to build, maintain, failover, and backup; and it makes apps more complex.

Each object/record has its own GUID to uniquely identify it across all servers. The GUIDs indicate the shard this object lives in. When requests come in, they specify a GUID which the server can then map to a particular shard. Instagram Engineering has a good overview on GUID generation, there are various options with pros and cons.

Use many virtual shards and distribute evenly between them. It’s best to assign each object to one of thousands of virtual shards, and then map those to physical shards (ie database instances running on a particular host). e.g. You might assign an object to shard 1331 out of a possible 10,000 shards, using a simple random number or modulo function to ensure each shard has approximately the same quantity. This virtual shard its permanent home and will never change. You then map 1331 to “database server 3”. The reason for this indirection is so you can easily split up data as the system grows.

Related content lives in the same shard. Typically, content owned by a single user/team/company should live together on the same (virtual) shard. For many applications, the main queries that need a quick user response are all within the same object graph, ie some kind of join between a company, its workers, and their content. It makes sense to store all of this in the same shard, so if you have a natural hierarchy, ensure each class’s shard is initialised with that of the root class (e.g. each “sale” is assigned to the same shard as the shard of the “salesperson” who made them, and each “salesperson” is assigned to the same shard as the “company” they work for).

Slave replication is only for backup/failover. This is advocated by he Pinterest paper. Replication can cause weird “time travel” bugs, where an application reads stale data from a slave and then uses it to update the master. Sharding is sufficient to replace the performance benefits of reading from multiple slaves, so replication should only be used for backup and failover purposes. Each shard (and any central database) gets its own slave.

Post has attachment
Required comedy feature on all VR headsets
Animated Photo

Post has attachment
Lose-Lose

Occasionally one team is incentivised to lose a game, but what happens when both sides are trying to throw a game, and it's on the Olympics stage no less?
https://player.fm/1hsStC #nowplaying

Post has attachment
AUTOEXEC.BAT

via r/programmerhumor
Photo

Post has attachment
Wow, Tesla moves fast 💨

From a tweet to an enforced policy in six days.

It takes most companies their size six days to bounce their no-reply emails back to anyone leaving feedback.
Photo

Post has shared content
This is probably the last js blogging of MIT licensed code I'll do in quite a while, as I am about to join a company that is a bit... ...control freak:ish, on that front.

Thanks to +Michael Mahemoff and +Dmitry Sorin for Control Freak! :-) I love it. Grab and CDN the on.user.js lib at will, anyone, if you want to make its UX gentler by having it covered by Control Freak's library presets.

Post has attachment
TIL a New York skyscraper had a 1 in 16 chance of collapsing every year, until an undergrad student informed the engineers. Even weirder, she went unknown and never even knew about her contribution until a BBC documentary 2 decades later.

99% Invisible covered it
https://player.fm/series/ninety-nine-percent-invisible/110-structural-integrity

(Discovered via https://news.ycombinator.com/item?id=13172646)
Wait while more posts are being loaded