Pinboard (jm)
https://pinboard.in/u:jm/public/
recent bookmarks from jmOpinion | The Malign Incompetence of the British Ruling Class - The New York Times2019-01-17T12:46:01+00:00
https://www.nytimes.com/2019/01/17/opinion/sunday/brexit-ireland-empire.html
jmPoliticians and journalists in Ireland are understandably aghast over the aggressive ignorance of English Brexiteers. Business people everywhere are outraged by their cavalier disregard for the economic consequences of new borders. But none of this would surprise anyone who knows of the unconscionable breeziness with which the British ruling class first drew lines through Asia and Africa and then doomed the people living across them to endless suffering.
]]>britain india brexit ireland pakistan asia partition history colonialism pankaj-mishrahttps://pinboard.in/https://pinboard.in/u:jm/b:0e6730366fbb/Call me maybe: Elasticsearch 1.5.02015-05-04T22:57:52+00:00
https://aphyr.com/posts/323-call-me-maybe-elasticsearch-1-5-0
jmelasticsearch reliability data storage safety jepsen testing aphyr partition network-partitions caphttps://pinboard.in/https://pinboard.in/u:jm/b:b6fc5795a3e6/Call me maybe: Elasticsearch2014-06-20T08:45:37+00:00
http://aphyr.com/posts/317-call-me-maybe-elasticsearch
jmIf you are an Elasticsearch user (as I am): good luck. Some people actually advocate using Elasticsearch as a primary data store; I think this is somewhat less than advisable at present. If you can, store your data in a safer database, and feed it into Elasticsearch gradually. Have processes in place that continually traverse the system of record, so you can recover from ES data loss automatically.
]]>elasticsearch ops storage databases jepsen partition network outages reliabilityhttps://pinboard.in/https://pinboard.in/u:jm/b:9f108006b5b8/The network is reliable2013-06-04T21:09:43+00:00
http://aphyr.com/posts/288-the-network-is-reliable
jm
This post is meant as a reference point -- to illustrate that, according to a wide range of accounts, partitions occur in many real-world environments. Processes, servers, NICs, switches, local and wide area networks can all fail, and the resulting economic consequences are real. Network outages can suddenly arise in systems that are stable for months at a time, during routine upgrades, or as a result of emergency maintenance. The consequences of these outages range from increased latency and temporary unavailability to inconsistency, corruption, and data loss. Split-brain is not an academic concern: it happens to all kinds of systems -- sometimes for days on end. Partitions deserve serious consideration.
I honestly cannot understand people who didn't think this was the case. 3 years reading (and occasionally auto-cutting) Amazon's network-outage tickets as part of AWS network monitoring will do that to you I guess ;)]]>networking outages partition cap failure fault-tolerancehttps://pinboard.in/https://pinboard.in/u:jm/b:e3ad7ddd7feb/Riak, CAP, and eventual consistency2013-04-20T22:03:34+00:00
https://gist.github.com/macintux/5418295
jmAs Brewer's CAP theorem established, distributed systems have to make hard choices. Network partition is inevitable. Hardware failure is inevitable. When a partition occurs, a well-behaved system must choose its behavior from a spectrum of options ranging from "stop accepting any writes until the outage is resolved" (thus maintaining absolute consistency) to "allow any writes and worry about consistency later" (to maximize availability). Riak leans toward the availability end of the spectrum, but allows the operator and even the developer to tune read and write requests to better meet the business needs for any given set of data.]]>riak cap eventual-consistency distcomp distributed-systems partition last-write-wins voldemort allow_multhttps://pinboard.in/https://pinboard.in/u:jm/b:1bded8180d0b/