https://pinboard.in/u:jm/public/ recent bookmarks from jm 2021-04-11T21:18:02+00:00 https://zeynep.substack.com/p/the-gaslighting-of-science jmPut all three together: airborne transmission, clusters driving the epidemic, and presymptomatic transmission. Not only do we get a clear and consistent picture of many things that have happened since, we also get the mitigation strategy. Further, all three dimensions support each other: transmission from people not (yet) coughing or sneezing very much argues in favor of aerosol transmission, which explains how large clusters can be driving the epidemic and how transmission in a situation like that ship can occur. And the mitigation and other strategies become clear: pay attention to clusters and ventilation, universal masks, different policies for indoors and outdoors, etc.  ]]> zeynep-tufekci coronavirus science covid-19 aerosols transmission clusters https://pinboard.in/ https://pinboard.in/u:jm/b:697b6ca481c2/ 2020-06-03T21:18:24+00:00 https://www.mhlw.go.jp/content/10900000/000635891.pdf jm covid-19 japan pandemics contact-tracing clusters infection https://pinboard.in/ https://pinboard.in/u:jm/b:81d4ef4613b9/ 2020-04-23T10:48:55+00:00 https://blog.google/inside-google/infrastructure/data-centers-work-harder-sun-shines-wind-blows jmOur latest advancement in sustainability, developed by a small team of engineers, is a new carbon-intelligent computing platform. We designed and deployed this first-of-its kind system for our hyperscale (meaning very large) data centers to shift the timing of many compute tasks to when low-carbon power sources, like wind and solar, are most plentiful. This is done without additional computer hardware and without impacting the performance of Google services like Search, Maps and YouTube that people rely on around the clock. Shifting the timing of non-urgent compute tasks—like creating new filter features on Google Photos, YouTube video processing, or adding new words to Google Translate—helps reduce the electrical grid’s carbon footprint, getting us closer to 24x7 carbon-free energy. ]]> energy google sustainability green clusters datacenters power https://pinboard.in/ https://pinboard.in/u:jm/b:c82fd1e31d0c/ 2019-05-22T10:46:45+00:00 https://medium.com/@ranshn/the-definitive-guide-to-running-ec2-spot-instances-as-kubernetes-worker-nodes-68ef2095e767 jm ec2 spot-instances cost-saving kubernetes clusters asg aws https://pinboard.in/ https://pinboard.in/u:jm/b:6f043fb3a3f0/ 2015-04-24T13:56:08+00:00 https://medium.com/aws-activate-startup-blog/cluster-based-architectures-using-docker-and-amazon-ec2-container-service-f74fa86254bf jmIn this post, we’re going to take a deeper dive into the architectural concepts underlying cluster computing using container management frameworks such as ECS. We will show how these frameworks effectively abstract the low-level resources such as CPU, memory, and storage, allowing for highly efficient usage of the nodes in a compute cluster. Building on some of the concepts detailed in the earlier posts, we will discover why containers are such a good fit for this type of abstraction, and how the Amazon EC2 Container Service fits into the larger ecosystem of cluster management frameworks. ]]> docker aws ecs ec2 ops hosting containers mesos clusters https://pinboard.in/ https://pinboard.in/u:jm/b:5c48004c7952/ 2014-04-15T09:03:04+00:00 http://www.infoq.com/news/2014/04/hydra jmThe intuition behind Hydra is something like this, "I have a lot of data, and there are a lot of things I could try to learn about it -- so many that I'm not even sure what I want to know.” It's about the curse of dimensionality -- more dimensions means exponentially more cost for exhaustive analysis. Hydra tries to make it easy to reduce the number of dimensions, or the cost of watching them (via probabilistic data structures), to just the right point where everything runs quickly but can still answer almost any question you think you might care about. Code: https://github.com/addthis/hydra Getting Started blog post: https://www.addthis.com/blog/2014/02/18/getting-started-with-hydra/ ]]> hyrda hadoop data-processing big-data trees clusters analysis https://pinboard.in/ https://pinboard.in/u:jm/b:88e7ba130d36/ 2013-11-01T16:52:34+00:00 http://www.serfdom.io/intro/index.html jm clustering service-discovery ops linux gossip broadcast clusters https://pinboard.in/ https://pinboard.in/u:jm/b:33c38925937b/ 2013-10-23T21:09:21+00:00 http://yahooeng.tumblr.com/post/64758709722/making-storm-fly-with-netty jm netty async zeromq storm messaging tcp benchmarks yahoo clusters https://pinboard.in/ https://pinboard.in/u:jm/b:0980d14db16f/ 2013-01-27T21:11:16+00:00 https://github.com/infochimps-labs/ironfan/wiki/walkthrough-web jm chef deployment clusters knife services aws ec2 ops ironfan demo https://pinboard.in/ https://pinboard.in/u:jm/b:ed73e23aae92/ 2010-02-08T15:25:42+00:00 http://petewarden.typepad.com/searchbrowser/2010/02/how-to-split-up-the-us.html jm clusters facebook data statistics maps culture analytics datamining demographics socialnetworking graph dataviz https://pinboard.in/u:jm/b:11f5af518b1b/