![]() This data allows our employees to answer questions such as how much a given service costs, or whether their service's use is in line with the targets for that service. Pinterest's Infra Cost and Usage DataĪt Pinterest, we provide our employees with this data in a set of tables that we call the BI Infrastructure Governance Data Mart. Providing this data source has been one of the core focuses of the Infrastructure Governance Program. Cloud costs require a trustworthy, timely data source. At Pinterest, we aim to make data-driven decisions whenever possible, and data-driven decisions that take cloud costs into account. The first key strategy that I'd like to go over is providing good data to employees so that they can make good decisions. Third, is not to micromanage your way to cloud efficiency, but using incentives instead to achieve your organization spend goals. Second, providing guidelines and strategies for how those cloud resources are used. First of all, the foundation will be providing good data. In my talk, I'd like to cover three key strategies that we've used for managing our cloud resources. Larger companies may also have other factors to consider, such as moving from single region to multi-region, which poses its own challenges. If we were to suddenly change the characteristics of our EC2 fleet in a major way without letting AWS know, it's possible they may not have that volume of capacity just sitting around waiting, and we may run into shortages. Sometimes, unexpected challenges that companies also see is that the typical principles of infinite cloud scalability that anybody can spin up as much as they want at any time on-demand, can break down when you're operating at scale. Architecture complexity often increases as well with scale, making predictions a lot harder when you're spinning hundreds of services versus maybe dozens of services. Unlike smaller companies, where generally you probably have smaller staff and can operate a little more nimbly, larger companies become like slow moving ships that require significant planning and coordination for any major change. One of the challenges that organizations face as they grow is that they face a different class of risks when it comes to controlling cloud costs. Many of the strategies that I'll be discussing apply regardless of what cloud provider your company uses. You may hear me refer to AWS technologies such as EC2 instances for compute, or S3 for file storage. Our cloud provider is Amazon Web Services, and we're a cloud native company. alone, we reach 41% of internet users every month. At our current scale, we're serving almost half a billion users every month across the globe. We also operate one of the world's largest cloud workloads, which makes it a really exciting place to work. The company was founded in 2010, and we've now surpassed over 2500 employees. Our mission is to bring everyone the inspiration to create a life they love. I may refer to infrastructure governance as infragov, but this is the same thing. What I'll refer to in this talk as my team, are the other contributors to the Infrastructure Governance Program, which is a cross-functional group from finance, engineering, and data science and analytics. Before Pinterest, I worked at Adobe on security and release engineering projects. I work here at Pinterest, where I've been for the last year and a half since April 2020. I'm a Technical Program Manager of the Infrastructure Governance Program. The purpose of my talk is going to be to share some of the strategies that we've used to successfully scale in the cloud that may hopefully be useful for your companies as well. That's the situation that my team and I find ourselves in at Pinterest every day, and sometimes it can be a daunting or a scary task. The company culture allows for any engineer to spin up as many machines as they want at any moment. Part of your job is to keep those cloud costs under control. Much further down that list is cloud efficiency. Your company's top priority is availability and user experience. Let's imagine you work for a company that operates on the public cloud, and runs one of the largest cloud workloads in the world, spanning hundreds of services. Junck: Halloween was just a few days ago, so I'm going to start today's presentation with a scary story.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |