https://pinboard.in/u:jm/public/ recent bookmarks from jm 2025-10-23T15:08:30+00:00 https://aws.amazon.com/message/101925/ jm dynamodb dns aws ec2 nlb outages post-mortems cloud-computing amazon us-east-1 https://pinboard.in/ https://pinboard.in/u:jm/b:4a70bf22a463/ 2025-02-05T10:01:43+00:00 https://cur.vantage.sh/ jm aws billing codes cost-explorer ec2 s3 finops https://pinboard.in/ https://pinboard.in/u:jm/b:55952b17d38d/ 2024-07-25T09:57:54+00:00 https://aws-new-features.s3.amazonaws.com/html/aws_services.html jm via:lwia aws features releases regions ops ec2 vpc https://pinboard.in/ https://pinboard.in/u:jm/b:9504799b9f96/ 2024-05-31T10:33:27+00:00 https://awsmaniac.com/aws-outages/ jm aws cloud outages downtime s3 ec2 dynamodb incidents post-mortems https://pinboard.in/ https://pinboard.in/u:jm/b:1b6a3252e8c2/ 2023-05-15T16:19:55+00:00 https://jack-vanlightly.com/blog/2023/5/15/kafka-vs-redpanda-performance-do-the-claims-add-up jm kafka redpanda benchmarks ec2 aws ssd optimization performance ops https://pinboard.in/ https://pinboard.in/u:jm/b:c155a58ab563/ 2023-01-24T11:03:07+00:00 https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/monitoring-network-performance-ena.html jm metrics ec2 ops drivers networking bandwidth errors https://pinboard.in/ https://pinboard.in/u:jm/b:3176cdd6fec2/ 2022-08-29T09:13:46+00:00 https://docs.google.com/spreadsheets/d/1DqYgQnEDLQVQm5acMAhLgHLD8xXCG9BIrk-_Nv6jF3k/edit#gid=504755275 jm aws carbon emissions ec2 hosting https://pinboard.in/ https://pinboard.in/u:jm/b:1c85b1d03555/ 2022-04-05T08:37:58+00:00 https://github.com/aws/aws-sdk-ruby/issues/2177#issuecomment-562772431 jm aws aws-sdk containers docker eks ec2 bugs fail imdsv2 https://pinboard.in/ https://pinboard.in/u:jm/b:fea302b0ba13/ 2022-03-02T14:39:20+00:00 https://aws.amazon.com/blogs/aws/new-customer-carbon-footprint-tool/ jm aws carbon emissions climate-change sustainability climate infrastructure ops ec2 s3 https://pinboard.in/ https://pinboard.in/u:jm/b:6fb815c75d98/ 2021-12-01T10:09:14+00:00 https://netflixtechblog.medium.com/cache-warming-leveraging-ebs-for-moving-petabytes-of-data-adcf7a4a78c3 jm architecture ebs memcache caching networking ec2 netflix https://pinboard.in/ https://pinboard.in/u:jm/b:1e40b505a3ec/ 2021-08-10T09:10:29+00:00 https://www.bbva.com/en/economics-of-serverless/ jm With traffic profiles where requests arrive in at periodic intervals, and a low total amount of requests, serverless architecture seems to be a great architecture in terms of cost, speed of delivery and effort. Thus, Lambda is probably the way to go if our application has sufficiently large periods of inactivity. Once the break-even point is reached, when EC2 is more cost-effective than Lambda, the cost difference grows rapidly, making Lambda less and less attractive in terms of cost. Thus, it is of great importance to know if the expected amount of traffic will be around the break-even point. Be aware of the CPU throttling you will get with the smaller memory flavors of Lambda. If your code is CPU-bound, choosing the smaller memory flavors might not be an option, since execution times, and thus latency, might grow beyond your requirements. On the other hand, if your code is I/O bound, the CPU throttling might not affect you significantly. Break-even point (if there is one, that is) strongly depends on the application itself. Without measuring the target application code, knowing the intended usage of the service, the SLA and the capabilities of the team in charge of building the application it is almost impossible to know for sure which service, Lambda or EC2, is more convenient. IMO there are still significant costs in organisational and infrastructure terms around replacing a working EC2 infrastructure with a Lambda-based one; deployment and other integration points with AWS are extremely tricky to deal with. But this is good data on the $ point alone. ]]> serverless aws lambda costs cost-control ec2 hosting architecture https://pinboard.in/ https://pinboard.in/u:jm/b:2ff2f72827fa/ 2021-06-27T20:41:55+00:00 https://www.reddit.com/r/aws/comments/o7oxnl/strange_performance_decline_aws_clocksource_change/ jmwe determined that calls to time.Now() or time.Since(time.Time) in Golang were taking about 200 times longer on new servers than they were on old servers. We found similar impacts in Python, which lead us to the clocksource. It turns out that in our Grub boot parameters for AL2, we had added clocksource=hpet about two years ago, but all of our servers launched prior to 6/17 had a clocksource of kvm-clock, apparently ignoring the Grub config. Servers launched after 6/17 (with the same AMI, Grub config, everything) were honoring the specified clocksource, which caused our performance issue. ]]> ec2 aws clocksource linux kvm https://pinboard.in/ https://pinboard.in/u:jm/b:68b3230eeae8/ 2021-05-31T14:36:45+00:00 https://www.lastweekinaws.com/blog/the-17-ways-to-run-containers-on-aws/?ck_subscriber_id=512829374 jm containers aws ec2 eks k8s docker architecture https://pinboard.in/ https://pinboard.in/u:jm/b:0efe3719a580/ 2021-05-21T08:46:49+00:00 https://aws.amazon.com/blogs/compute/using-shared-memory-for-low-latency-intra-node-communication-in-aws-batch/ jmHPC workloads use algorithms that require parallelization and a low latency communication between the different processes. The two main technologies used for the parallel communications are message-passing with distributed memory and shared memory. Message Passing Interface (MPI) is a message-passing standard used for the communication in a parallel distributed environment. Elastic Fabric Adapter (EFA) enables your MPI applications to use low-latency, inter-node communication. The shared memory paradigm allows multiple processors in the same system to communicate using a memory (RAM) portion that is shared between the processes. This method takes advantage of the high-speed memory bus. ]]> shared-memory hpc mpi shmem ram coding efa aws ec2 low-latency https://pinboard.in/ https://pinboard.in/u:jm/b:6dd0427bd3ed/ 2021-04-27T11:59:58+00:00 https://medium.com/teads-engineering/estimating-aws-ec2-instances-power-consumption-c9745e347959 jm aws ec2 cloud-computing energy carbon footprint power estimation ops https://pinboard.in/ https://pinboard.in/u:jm/b:5d2afd8b0f5a/ 2020-06-26T10:35:28+00:00 https://prestosql.io/blog/2020/06/25/data-integrity-protection.html jm presto data-corruption bugs aws azure ec2 checksums reliability https://pinboard.in/ https://pinboard.in/u:jm/b:c751bb2609c8/ 2020-06-08T20:04:55+00:00 https://spotcost.net/ jm spot-instances ec2 aws spots ops https://pinboard.in/ https://pinboard.in/u:jm/b:42d9ebcd05f6/ 2020-04-08T09:07:50+00:00 https://twitter.com/avibryant/status/1247754254212665344 jm aws amazon ec2 spot-instances foldingathome covid-19 https://pinboard.in/ https://pinboard.in/u:jm/b:e4917664327c/ 2020-02-17T10:49:05+00:00 https://aws.amazon.com/about-aws/whats-new/2020/02/ebs-multi-attach-available-provisioned-iops-ssd-volumes/ jm ebs ec2 filesystems networking ops https://pinboard.in/ https://pinboard.in/u:jm/b:2f99d09d89c4/ 2019-11-11T10:30:38+00:00 https://srvaroa.github.io/kubernetes/migration/latency/dns/java/aws/microservices/2019/10/22/kubernetes-added-a-0-to-my-latency.html jmKIAM [a Kubernetes IAM API helper] happens to provide short-lived credentials to Pods, which makes sense as it’s fair to assume that the average lifetime of a Pod is shorter than EC2 instances. The default is precisely 15 min. But if you put both defaults together, you have a problem. Each certificate provided to the application has a 15 min expiration time. The AWS Java SDK will force refreshing any certificate with less than 15 min expiration time left. The result is that every request will be forced to refresh the temporary certificate, which requires two calls to the AWS API that add a huge latency penalty to each request. We later found a feature request in the AWS Java SDK that mentions this same issue. The fix was easy. We reconfigured KIAM to request credentials with a longer expiration period. Once this change was applied, requests started being served without involving the AWS Metadata service and returned to an even lower latency than in EC2. ]]> kubernetes kiam defaults aws latency performance ec2 https://pinboard.in/ https://pinboard.in/u:jm/b:e6d5522f5c36/ 2019-05-22T10:46:45+00:00 https://medium.com/@ranshn/the-definitive-guide-to-running-ec2-spot-instances-as-kubernetes-worker-nodes-68ef2095e767 jm ec2 spot-instances cost-saving kubernetes clusters asg aws https://pinboard.in/ https://pinboard.in/u:jm/b:6f043fb3a3f0/ 2019-04-26T10:26:17+00:00 https://stressgrid.com/blog/pps_limits_in_ec2/ jmBy running these experiments, we determined that each EC2 instance type has a packet-per-second budget. Surprisingly, this budget goes toward the total of incoming and outgoing packets. Even more surprisingly, the same budget gets split between multiple network interfaces, with some additional performance penalty. This last result informs against using multiple network interfaces when tuning the system for higher networking performance. The maximum budget for m5.metal and m5.24xlarge is 2.2M packets per second. Given that each HTTP transaction takes at least four packets, we can translate this to a maximum of 550k requests per second on the largest m5 instance with Enhanced Networking enabled. ]]> aws ec2 networking pps packets tcp ip benchmarking https://pinboard.in/ https://pinboard.in/u:jm/b:94369fd8e8b0/ 2019-04-18T12:56:05+00:00 https://medium.com/@tinder.engineering/tinders-move-to-kubernetes-cda2a6372f44 jm kubernetes k8s flannel networking elb aws envoy ec2 ops tinder https://pinboard.in/ https://pinboard.in/u:jm/b:68e5fb0e2425/ 2019-04-08T09:19:48+00:00 https://www.reddit.com/r/aws/comments/b9f8fn/s3_benchmark/ jmI used this to benchmark S3's performance from all 155 EC2 instance types in existence. I put all the data in an interactive spreadsheet. [...] Below is the max throughput I got from each instance type, but the spreadsheet shows you what object sizes and thread counts you need to get that performance. ]]> ec2 instances instance-types hardware cloud s3 performance benchmarks ops https://pinboard.in/ https://pinboard.in/u:jm/b:c487e84fb24d/ 2019-02-28T17:51:40+00:00 https://github.com/databricks/devbox jm remote-compiles compiling devbox databricks coding tools dev ec2 https://pinboard.in/ https://pinboard.in/u:jm/b:c2aad21df18a/ 2019-01-18T10:10:33+00:00 https://instaguide.io/ jm ec2 instances aws pricing hosts spot-instances money https://pinboard.in/ https://pinboard.in/u:jm/b:b0929e6d1b0a/ 2018-11-29T10:44:26+00:00 https://www.qubole.com/blog/presto-performance-for-ad-hoc-workloads-on-aws-instance-types/ jm qubole presto performance benchmarks ops aws instances ec2 https://pinboard.in/ https://pinboard.in/u:jm/b:476670e29703/ 2018-11-21T10:48:42+00:00 https://aws.amazon.com/about-aws/whats-new/2018/11/introducing-predictive-scaling-for-amazon-EC2-in-aws-auto-scaling/ jmPredictive Scaling predicts future traffic based on daily and weekly trends, including regularly-occurring spikes, and provisions the right number of EC2 instances in advance of anticipated changes. Provisioning the capacity just in time for an impending load change makes Auto Scaling faster than ever before. Predictive Scaling’s machine learning algorithms detect changes in daily and weekly patterns, automatically adjusting their forecasts. This removes the need for manual adjustment of Auto Scaling parameters over time, making Auto Scaling simpler to configure and consume. Auto Scaling enhanced with Predictive Scaling delivers faster, simpler, and more accurate capacity provisioning to our customers. Fantastic! More heavy lifting taken care of.]]> aws amazon scaling autoscaling predictive-scaling ml ec2 asg https://pinboard.in/ https://pinboard.in/u:jm/b:e3499386f7d2/ 2018-11-15T11:00:49+00:00 https://aws.amazon.com/blogs/aws/new-ec2-auto-scaling-groups-with-multiple-instance-types-purchase-options/ jm ec2 fleet asg ops architecture cost-control https://pinboard.in/ https://pinboard.in/u:jm/b:bbd4ce40f4c6/ 2018-10-03T16:09:14+00:00 https://aws.amazon.com/blogs/compute/running-high-scale-web-on-spot-instances/ jm appnext spot-instances ec2 scalability aws ops architecture https://pinboard.in/ https://pinboard.in/u:jm/b:e099fd008834/ 2018-09-17T11:11:36+00:00 https://www.slideshare.net/AmazonWebServices/deep-dive-maximizing-ec2-and-ebs-performance jm ebs ec2 aws ops storage tips https://pinboard.in/ https://pinboard.in/u:jm/b:8dc4551f948d/ 2018-06-26T16:29:41+00:00 https://forums.aws.amazon.com/thread.jspa?messageID=831922&tstart=0 jm c5 m5 instances ec2 aws amazon ops dns https://pinboard.in/ https://pinboard.in/u:jm/b:4b578d96708c/ 2018-05-18T10:11:29+00:00 https://aws.amazon.com/blogs/aws/ec2-instance-update-c5-instances-with-local-nvme-storage-c5d/ jmWith a 25% to 50% improvement in price-performance over the C4 instances, the C5 instances are designed for applications like batch and log processing, distributed and or real-time analytics, high-performance computing (HPC), ad serving, highly scalable multiplayer gaming, and video encoding. Some of these applications can benefit from access to high-speed, ultra-low latency local storage. For example, video encoding, image manipulation, and other forms of media processing often necessitates large amounts of I/O to temporary storage. While the input and output files are valuable assets and are typically stored as Amazon Simple Storage Service (S3) objects, the intermediate files are expendable. Similarly, batch and log processing runs in a race-to-idle model, flushing volatile data to disk as fast as possible in order to make full use of compute resources. Very nice!]]> ec2 instance-types ops storage hardware aws https://pinboard.in/ https://pinboard.in/u:jm/b:0521fbd281bc/ 2017-12-14T10:23:04+00:00 https://www.slideshare.net/AmazonWebServices/stg306deep-dive-on-amazon-ebs jm ec2 ebs aws amazon ops tips slides reinvent https://pinboard.in/ https://pinboard.in/u:jm/b:043c7cccb5c5/ 2017-12-14T10:22:46+00:00 https://www.slideshare.net/AmazonWebServices/dat302deep-dive-on-amazon-relational-database-service-rds jm ec2 ebs aws amazon ops tips slides reinvent https://pinboard.in/ https://pinboard.in/u:jm/b:6bbf7316c9fb/ 2017-12-14T10:22:27+00:00 https://www.slideshare.net/AmazonWebServices/cmp301deep-dive-on-amazon-ec2-instances jm ec2 ebs aws amazon ops tips slides reinvent https://pinboard.in/ https://pinboard.in/u:jm/b:4674fd1ed517/ 2017-11-20T10:23:58+00:00 https://aws.amazon.com/about-aws/whats-new/2017/11/spot-fleet-now-supports-target-tracking-and-new-plug-in-for-atlassian-bamboo/ jm spot-fleet spot-instances ec2 amazon aws scaling ops architecture https://pinboard.in/ https://pinboard.in/u:jm/b:b0bd09164e4c/ 2017-09-08T13:32:52+00:00 https://aws.amazon.com/blogs/aws/new-network-load-balancer-effortless-scaling-to-millions-of-requests-per-second/ jm load-balancing aws elb alb nlb networking ec2 ops architecture https://pinboard.in/ https://pinboard.in/u:jm/b:53d55f54edb6/ 2017-08-21T14:56:08+00:00 https://github.com/cristim/autospotting?__s=gf36pf8g1gjugcqh6ppo jm asg autoscaling ec2 aws spot-fleet spot-instances cost-saving scaling https://pinboard.in/ https://pinboard.in/u:jm/b:514204b9090f/ 2017-08-13T20:27:54+00:00 https://github.com/jorgebastida/awslogs jm$ awslogs get /var/log/syslog ip-10-1.* --start='2h ago' | grep ERROR Nice. ]]> cli logging aws cloudwatch logs awslogs ec2 https://pinboard.in/ https://pinboard.in/u:jm/b:6870758defc9/ 2017-07-26T13:14:54+00:00 https://jeremyeder.com/2017/07/25/docker-operations-slowing-down-on-aws-this-time-its-not-dns/ jm performance aws ebs ec2 burst-balance ops debugging https://pinboard.in/ https://pinboard.in/u:jm/b:bef976e76060/ 2017-07-21T09:54:23+00:00 https://github.com/awslabs/aws-ec2rescue-linux jmAmazon Web Services Elastic Compute Cloud (EC2) Rescue for Linux is a python-based tool that allows for the automatic diagnosis of common problems found on EC2 Linux instances. Most of the modules appear to be log-greppers looking for common kernel issues. ]]> ec2 aws kernel linux ec2rl ops https://pinboard.in/ https://pinboard.in/u:jm/b:1e8923ebc45e/ 2017-07-03T10:51:31+00:00 https://www.datadoghq.com/blog/top-5-ways-to-improve-your-aws-ec2-performance/ jm ops ec2 performance datadog aws ebs stolen-cpu virtualization metrics tips https://pinboard.in/ https://pinboard.in/u:jm/b:26efe6d76709/ 2017-05-18T14:43:35+00:00 https://segment.com/blog/spotting-a-million-dollars-in-your-aws-account/ jmYou can easily split your spend by AWS service per month and call it a day. Ten thousand dollars of EC2, one thousand to S3, five hundred dollars to network traffic, etc. But what’s still missing is a synthesis of which products and engineering teams are dominating your costs.  Then, add in the fact that you may have hundreds of instances and millions of containers that come and go. Soon, what started as simple analysis problem has quickly become unimaginably complex.  In this follow-up post, we’d like to share details on the toolkit we used. Our hope is to offer up a few ideas to help you analyze your AWS spend, no matter whether you’re running only a handful of instances, or tens of thousands. ]]> segment money costs billing aws ec2 ecs ops https://pinboard.in/ https://pinboard.in/u:jm/b:37e7b0f5b58b/ 2017-05-02T11:01:21+00:00 https://github.com/cristim/autospotting jmA simple and easy to use tool designed to significantly lower your Amazon AWS costs by automating the use of the spot market. Once enabled on an existing on-demand AutoScaling group, it launches an EC2 spot instance that is cheaper, at least as large and configured identically to your current on-demand instances. As soon as the new instance is ready, it is added to the group and an on-demand instance is detached from the group and terminated. It continuously applies this process, gradually replacing any on-demand instances with spot instances until the group only consists of spot instances, but it can also be configured to keep some on-demand instances running. ]]> aws golang ec2 autoscaling asg spot-instances ops https://pinboard.in/ https://pinboard.in/u:jm/b:e7451129fd50/ 2017-04-11T10:54:52+00:00 https://insights.ubuntu.com/2017/04/05/ubuntu-on-aws-gets-serious-performance-boost-with-aws-tuned-kernel/?__s=gf36pf8g1gjugcqh6ppo jm aws ubuntu ec2 kernel linux ops https://pinboard.in/ https://pinboard.in/u:jm/b:018d8e2ae296/ 2017-02-03T16:55:55+00:00 https://wiki.jenkins-ci.org/display/JENKINS/Amazon+EC2+Container+Service+Plugin jm ec2 ecs aws jenkins docker plugins https://pinboard.in/ https://pinboard.in/u:jm/b:26de51b78df5/ 2016-11-30T17:07:32+00:00 https://aws.amazon.com/blogs/aws/developer-preview-ec2-instances-f1-with-programmable-hardware/ jm fpga hardware coding aws ec2 https://pinboard.in/ https://pinboard.in/u:jm/b:f2a038ce758a/ 2016-11-17T12:34:18+00:00 http://jvns.ca/blog/2016/11/16/ideas-about-how-to-use-aws/ jm docker alb aws ec2 blue-green-deploys deployment ops tools skyliner via:jgilbert https://pinboard.in/ https://pinboard.in/u:jm/b:f2861c3cf680/ 2016-09-05T11:35:07+00:00 https://aws.amazon.com/blogs/aws/new-auto-scaling-for-ec2-spot-fleets/?sc_channel=sm&sc_campaign=launch_EC2_522bf4f3&sc_publisher=tw_go&sc_content=AnyScale_support_spot_fleets&sc_country=global&sc_geo=globaly jm asg auto-scaling ec2 spot-fleets ops scaling https://pinboard.in/ https://pinboard.in/u:jm/b:ac54c86f1987/ 2016-04-08T11:25:52+00:00 http://www.ybrikman.com/writing/2015/11/11/running-docker-aws-ground-up/ jmECS, believe it or not, is one of the simplest Schedulers out there. Most of the other alternatives I’ve tried offer all sorts of fancy bells & whistles, but they are either significantly more complicated to understand (lots of new concepts), take too much effort to set up (lots of new technologies to install and run), are too magical (and therefore impossible to debug), or some combination of all three. That said, ECS also leaves a lot to be desired. ]]> aws docker ecs ec2 schedulers https://pinboard.in/ https://pinboard.in/u:jm/b:deadf4093c4e/ 2016-04-08T10:56:29+00:00 http://www.slideshare.net/pwakeford/aws-sydney-meetup-april-2016-paul-wakeford jmaws ec2 costs money hosting ops https://pinboard.in/ https://pinboard.in/u:jm/b:68166c52777a/ 2016-03-09T17:18:00+00:00 https://cloudnative.io/yeobot/ jm chatops yeobot bots cloudnative ec2 aws slack https://pinboard.in/ https://pinboard.in/u:jm/b:0810f735b14e/ 2016-01-20T18:30:02+00:00 https://aws.amazon.com/blogs/compute/powering-your-amazon-ecs-clusters-with-spot-fleet/ jm amazon ec2 aws ecs autoscaling scaling ops https://pinboard.in/ https://pinboard.in/u:jm/b:2c1bb2a4048a/ 2016-01-03T09:57:03+00:00 http://perspectives.mvdirona.com/2015/12/vpc-nat-gateways-transactional-uniqueness-at-scale/ jmyou can think of it as a new “even bigger” [NAT] box, but under the hood NAT gateways are different. The connections are managed by a fault-tolerant co-operation of devices in the VPC network fabric. Each new connection is assigned a port in a robust and transactional way, while also being replicated across an extensible set of multiple devices. In other words: the NAT gateway is internally horizontally scalable and resilient. ]]> amazon ec2 nat networking aws colmmacc https://pinboard.in/ https://pinboard.in/u:jm/b:795dcd0733e5/ 2015-12-22T22:56:53+00:00 https://www.reddit.com/r/aws/comments/3xuf93/2016_wish_list_for_aws/ jm vpc aws ec2 ops wishlist https://pinboard.in/ https://pinboard.in/u:jm/b:cfbb7b294aba/ 2015-12-14T16:23:34+00:00 https://railsadventures.wordpress.com/2015/12/06/why-we-chose-kubernetes-over-ecs/ jm3 months ago when we, at nanit.com, came to evaluate which Docker orchestration framework to use, we gave ECS the first priority. We were already familiar with AWS services, and since we already had our whole infrastructure there, it was the default choice. After testing the service for a while we had the feeling it was not mature enough and missing some key features we needed (more on that later), so we went to test another orchestration framework: Kubernetes. We were glad to discover that Kubernetes is far more comprehensive and had almost all the features we required. For us, Kubernetes won ECS on ECS’s home court, which is AWS. ]]> kubernetes ecs docker containers aws ec2 ops https://pinboard.in/ https://pinboard.in/u:jm/b:9426fd8edac6/ 2015-10-27T12:38:29+00:00 http://docs.aws.amazon.com/AmazonECS/latest/developerguide/ECS_CLI_tutorial.html#ECS_CLI_tutorial_compose_service jm ecs cli linux aws ec2 hosting docker tutorials https://pinboard.in/ https://pinboard.in/u:jm/b:f1f678ae8462/ 2015-10-20T19:56:17+00:00 https://github.com/AdRoll/hologram jmHologram exposes an imitation of the EC2 instance metadata service on developer workstations that supports the [IAM Roles] temporary credentials workflow. It is accessible via the same HTTP endpoint to calling SDKs, so your code can use the same process in both development and production. The keys that Hologram provisions are temporary, so EC2 access can be centrally controlled without direct administrative access to developer workstations. ]]> iam roles ec2 authorization aws adroll open-source cli osx coding dev https://pinboard.in/ https://pinboard.in/u:jm/b:5801a286921c/ 2015-10-18T20:19:29+00:00 http://ispyker.blogspot.ie/2015/10/aws-reinvent-2015-video-slide.html jmmy quick index of all re:Invent sessions.  Please wait for a few days and I'll keep running the tool to fill in the index.  It usually takes Amazon a few weeks to fully upload all the videos and slideshares. Pretty definitive, full text descriptions of all sessions (and there are an awful lot of 'em).]]> aws reinvent andrew-spyker scraping slides presentations ec2 video https://pinboard.in/ https://pinboard.in/u:jm/b:c5e0596d9cbe/ 2015-10-09T10:04:24+00:00 https://segment.com/blog/rebuilding-our-infrastructure/ jm aws ops docker ecs ec2 prod terraform segment via:marc https://pinboard.in/ https://pinboard.in/u:jm/b:e2c14ca77c3e/ 2015-10-08T14:03:48+00:00 https://aws.amazon.com/blogs/aws/new-ec2-spot-blocks-for-defined-duration-workloads/ jmyou can now launch Spot instances that will run continuously for a finite duration (1 to 6 hours). Pricing is based on the requested duration and the available capacity, and is typically 30% to 45% less than On-Demand. ]]> ec2 aws spot-instances spot pricing time https://pinboard.in/ https://pinboard.in/u:jm/b:77d0e9aff94b/ 2015-09-23T12:48:44+00:00 https://aws.amazon.com/message/5467D2/ jm aws postmortem outages dynamodb ec2 post-mortems circuit-breakers monitoring https://pinboard.in/ https://pinboard.in/u:jm/b:f804599be513/ 2015-09-16T04:16:54+00:00 http://blog.cloudsploit.com/2015/09/15/how-we-use-lambda/ jm lambda aws ec2 autoscaling cloudsploit https://pinboard.in/ https://pinboard.in/u:jm/b:5b91285e9a68/ 2015-09-02T12:45:25+00:00 https://aws.amazon.com/ec2/spot/bid-advisor/ jmanalyzes Spot price history to help you determine a bid price that suits your needs. ]]> ec2 aws spot spot-instances history https://pinboard.in/ https://pinboard.in/u:jm/b:7717e3fd0a19/ 2015-08-19T22:07:18+00:00 http://ben.straub.cc/2015/08/19/kubernetes-aws-vpc-peering/ jm 10/8 ec2 aws vpc kubernetes ops internet ip-addresses https://pinboard.in/ https://pinboard.in/u:jm/b:23c27a56f95d/ 2015-08-11T10:03:51+00:00 http://blog.takipi.com/amazon-ec2-2015-benchmark-testing-speeds-between-aws-ec2-and-s3-regions/ jm fail latency measurement aws ec2 percentiles s3 https://pinboard.in/ https://pinboard.in/u:jm/b:4e5264c55d58/ 2015-07-10T22:49:32+00:00 http://lg.io/2015/07/05/revised-and-much-faster-run-your-own-highend-cloud-gaming-service-on-ec2.html jm gaming games ec2 amazon aws cloud windows hacks https://pinboard.in/ https://pinboard.in/u:jm/b:aa886a192762/ 2015-06-15T11:11:30+00:00 https://aws.amazon.com/blogs/aws/vpc-flow-logs-log-and-view-network-traffic-flows/ jmwe are introducing Flow Logs for the Amazon Virtual Private Cloud.  Once enabled for a particular VPC, VPC subnet, or Elastic Network Interface (ENI), relevant network traffic will be logged to CloudWatch Logs for storage and analysis by your own applications or third-party tools. You can create alarms that will fire if certain types of traffic are detected; you can also create metrics to help you to identify trends and patterns. The information captured includes information about allowed and denied traffic (based on security group and network ACL rules). It also includes source and destination IP addresses, ports, the IANA protocol number, packet and byte counts, a time interval during which the flow was observed, and an action (ACCEPT or REJECT). ]]> ec2 aws vpc logging tracing ops flow-logs network tcpdump packets packet-capture https://pinboard.in/ https://pinboard.in/u:jm/b:60c85edd365b/ 2015-06-14T21:22:02+00:00 http://highscalability.com/blog/2015/6/8/leveraging-aws-to-build-a-scalable-data-pipeline.html jm sqs aws ec2 auto-scaling asg worker-pools architecture scalability https://pinboard.in/ https://pinboard.in/u:jm/b:83cb65158dca/