The posting
Overview
We are looking for a Principal Software Engineer who lives and breathes Azure Cosmos DB and knows how it is implemented underneath. Your mission is to make throttling disappear from Microsoft's AI plugin registry with fast, surgical, high-ROI changes. Success is objective: throttling goes away, reliability goes up, and latency goes down, even as scale grows. You will see the results in days, not quarters.
We are the Agent Tools and Lifecycle team in Microsoft's Copilot, Agents and Platform (CAP) organization. We build the service behind the AI plugin registry. Admins use it in the Microsoft 365 admin center to govern the plugins (skills, connectors, and agents) that extend Microsoft Copilot, and users discover and use those plugins across products such as Copilot Chat, Cowork, Teams, Word, Excel, and PowerPoint. The registry is a core part of Microsoft's AI architecture, alongside Work IQ, and Copilot experiences across Microsoft depend on it. If you use an AI solution from Microsoft, you likely are working with our service. Come join us at the center of AI transformation at Microsoft!
As a hands-on individual contributor, you will be the technical leader for the AI plugin registry's Azure Cosmos DB tier. Our catalog of plugins and agents, and the entitlements and policies that decide who can use them, live in Cosmos DB in data centers worldwide, including sovereign clouds. Traffic keeps growing as the registry expands to experiences such as Copilot Studio, GitHub Copilot, and Microsoft Foundry. Experience working on the internals of Cosmos DB or a comparable database, such as MongoDB, Amazon DynamoDB, or Apache Cassandra, and an understanding of the hardware and network limits that make them throttle, are especially valuable. Our global reach means 24/7 on-call service.
This position is based in Redmond, Washington and requires the employee be in the office a minimum of 3 days per week.
Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
Responsibilities
- Cut request unit (RU) consumption to make throttling go away, fast. Start with the queries that use the most RUs, where we see room for 50–90% reductions: turn cross-partition and fan-out queries into point reads from Cosmos DB or Azure Blob Storage, batched reads, or single-partition queries, and tune indexes.
- Pick work by return on investment. Ship several targeted fixes in parallel, each within days, and measure each one in production. Take on a larger redesign only when the data shows smaller fixes cannot get there, and deliver it in steps that each pay off.
- Fix hot partitions and size limits at the source: partition keys, document design, indexing policies, and API contracts that give high-traffic calls the keys they need for point reads. When data has to move, migrate it with zero downtime across all environments, including sovereign clouds.
- Decide what belongs in Cosmos DB. Move large, binary, unbounded, or rarely queried content to Azure Blob Storage or other storage, weighing latency, availability, and data-residency needs.
- Remove redundant and sequential database calls on our busiest paths with batching, request coalescing, and caching, and use retry budgets, load shedding, and graceful degradation so database pressure does not turn into failed requests.
- Work with product management and the teams that call us to give each caller a throttling budget. Find callers that request the same unchanged data again and again, help them cache on their side, and lower the budgets of the heaviest callers over time.
- Make success measurable: own the telemetry, dashboards, and alerts, RU use per API and per caller, partition skew, availability, and latency. Set targets, show the effect of every change, and spot limits before we hit them.
- Raise the bar through AI: write AI skills that review designs and code for Cosmos DB mistakes, find high-RU queries, and show engineers how to fix them, so your expertise scales across the team. Use agentic tools to build and validate fixes faster, following Responsible AI practices. Mentor engineers and represent us with the Azure Cosmos DB product group.
- Serve as a Designated Responsible Individual (DRI) in our 24/7 on-call rotation, lead data-tier incident response, and turn what we learn into lasting fixes.
Qualifications
Required Qualifications:
- Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or PythonOR equivalent experience.
Other Requirements:
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:
- Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Preferred Qualifications:
- Master's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or PythonOR Bachelor's Degree in Computer Science or related technical field AND 12+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
- 4+ years of experience building or operating large-scale distributed databases, such as Azure Cosmos DB, MongoDB, Amazon DynamoDB, or Apache Cassandra, including partitioning, indexing, and query performance.
- Experience finding and fixing throttling, hot partitions, or resource-heavy cross-partition queries in production databases.
- Experience building or improving the internals of Azure Cosmos DB, or of a comparable distributed database such as MongoDB, Amazon DynamoDB, or Apache Cassandra, in areas such as partitioning, replication, storage engines, query execution, indexing, or rate limiting.
- Deep, hands-on Azure Cosmos DB expertise: what drives the RUs each operation uses, physical partitions and splits, hierarchical partition keys, indexing policies, point reads and ReadMany versus cross-partition queries, change feed, consistency levels, multi-region accounts, autoscale, SDK (software development kit) retries, and diagnosing errors.
- Track record of making throttling go away quickly, raising availability, and cutting tail latency in production, with targeted, high-ROI changes and before-and-after measurements to prove it.
- Deep understanding of why distributed databases throttle, from per-partition throughput and storage limits to hardware, network, and replication overhead, and how to design data models that stay within those limits.
- Experience moving large or rarely queried content from a document database to Azure Blob Storage or comparable object storage, and serving it with point reads.
- Experience with zero-downtime data migrations and re-partitioning on live production systems.
- Experience designing rate limits, quotas, and noisy-neighbor isolation for a multi-tenant platform, and getting partner teams to cache on their side.
- Proficiency in C# and .NET, and experience with Azure services such as Azure Functions, Service Bus, Azure Cache for Redis, and API (application programming interface) Management.
- Understanding of modern AI technologies, including generative AI and foundation models, and experience writing AI skills and using agentic tools to engineer faster.
#CosmosDB, #MongoDB, #DynamoDB, #Cassandra,# AI,# Artificial Intelligence
Software Engineering IC5 - The typical base pay range for this role across the U.S. is USD $142,800 - $274,800 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $188,000 - $304,200 per year.
Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.
