How Google Does Planet-Scale Engineering for Planet-Scale Infra

Insightful talk from Melisa on the secret sauce of culture Google invented to achieve high availability.  We test if we are connected by hitting google.com. That’s the trust we’ve on Google.

Key takeaways

  • A role ‘Site Reliability Engineer’ (SRE) responsible
read the rest. “How Google Does Planet-Scale Engineering for Planet-Scale Infra”
How Google Does Planet-Scale Engineering for Planet-Scale Infra

Real-time message processing systems

Real-time message processing or stream processing systems are a need today. There are many examples in the world of IOT, Mobile push messaging, social media, etc.

  • Heart of such systems is an enterprise class stream processing system such as Kafka,
read the rest. “Real-time message processing systems”
Real-time message processing systems

Horizontally scaling systems (Scale out)

Just thought to record the horizontal scaling options I came across so far.

  • Connected and stateless – Requests in this scenario are synchronous (connected), meaning request is processed immediately and response served. Till then connection to kept open. Servers are
read the rest. “Horizontally scaling systems (Scale out)”
Horizontally scaling systems (Scale out)

Sample fault tolerant deployment in AWS

Sample-aws-fault-tolerant-architectureArchitecture courtesy: acloud.guru

Sample AWS fault tolerant architecture in AWS demonstrated using wordpress deployment.

  • Hosted in single region.
  • 2 security groups setup in a VPC. One web facing – Web DMZ and other private – RDS security group.
  • 2 Availability
read the rest. “Sample fault tolerant deployment in AWS”
Sample fault tolerant deployment in AWS

AWS reference architecture for High Availability

Achieving HA involves

  • Avoiding single point of failure.
  • Implementing heart beat to spot failures.
  • Having hot (cold) standby cross zone or cross geo at every layer in the application. This could be achieved leveraging clustering or replication.

AWS reference architecture.… read the rest. “AWS reference architecture for High Availability”

AWS reference architecture for High Availability