From Wall Street to ByteDance – One Engineer's 15-Year Bet on Automation
- Jun 12, 2024
- 4 min read
Written by: Julianna Davies
The line between Wall Street and Silicon Valley, for the engineering generation that came up in the 2010s, has run through a quiet middle layer of infrastructure work that does not feature in the company narratives of either coast. Wall Street's technology stack and Silicon Valley's were once separate trades, governed by different cultures, regulated by different agencies, and built for different kinds of risk. The engineers who moved between them carried something the public conversation about both industries has rarely captured. They carried an operator's intuition about what large systems actually cost to run. Shashidhar Bhat, the software engineer who this month joined ByteDance's big-data team in San Jose, is one of the cleaner illustrations of that line.
Bhat's career began in 2007 at TechMahindra, the Indian information technology services firm headquartered in Pune. The work at that point was the broad, services-oriented engineering practice that for much of his cohort served as the entry door into the industry. The chapter that followed, at JPMorgan Chase's India operations, was a step into a more demanding environment. JPMorgan's technology footprint in India had grown into one of the largest tech operations in the country by the period in which Bhat worked there. The work was mission-critical, regulated, and compliance-bound. The standards under which engineering decisions had to hold were the standards of a global investment bank. The discipline absorbed in those years is the kind that does not come back later in a career.
The pivot away from financial services took him to Cornerstone OnDemand, the Santa Monica-based talent-management software company that for most of the past decade has been one of the more substantial enterprise SaaS firms outside the headline names. He stayed for twelve years.
What Bhat shipped over that twelve-year stretch is the part of his career that explains the move he is making this month. The platform he inherited at Cornerstone was a monolith. The platform he left behind was a Kubernetes-native infrastructure that provisioned new environments in six hours rather than two weeks. The mean time to repair across the GPU node fleet had dropped by forty percent over the course of the migration. Total platform scalability had improved by two hundred percent. Operating costs had fallen by thirty percent across the same period. The customer-facing service was holding ninety-eight percent uptime against a Fortune 500 client base.
The transformation was not a rebuild led from the top. It was a sequence of incremental, justified replacements, each running alongside the previous system long enough to clear the reliability case before the cutover. The discipline that produced the twelve-year arc has, in retrospect, been organized around a single thesis. Infrastructure decisions made by humans, on call, at routine cadence, scale poorly. The cognitive load on each operator rises as the system grows. The error rate rises with the cognitive load. The remediation cost rises with the error rate. The way out is to take the routine decisions off the human and put them onto software. The work Bhat has shipped, role by role, has been a steady escalation toward that thesis.
The chapter that has just begun is the most demanding test of it. ByteDance, the company best known publicly as the parent of TikTok, operates one of the largest Kubernetes infrastructures on earth and runs roughly one petabyte of data through its big-data pipelines each month. The operational complexity of an environment of that size does not yield to incrementalism. The opportunity Bhat has stepped into is precisely that. A petabyte-scale environment in active use, with the volume of routine decision-making that comes with it, is the cleanest possible proving ground for the thesis he has been building toward since 2007.
The path that took him there has not been a sequence of brand-name moves. TechMahindra is not on most of the engineering recruiting funnels that dominate Silicon Valley. The JPMorgan Chase chapter, run from India rather than Manhattan, was the kind of high-compliance experience that does not register in the narratives the U.S. tech press tends to write about engineering careers. The Cornerstone OnDemand stretch was twelve years long inside a company well-known to its customers and less well-known outside them. Each move was a rung up in infrastructure complexity, and each took place inside a company whose technical ambitions have been less visible to the public than to the operators inside the building.
The pattern is the part of the story that does not fit the usual shape. Most engineering profiles at this stage of a career describe a single defining shipment, an early founder pedigree, or a name-brand stretch at one of the half-dozen firms that dominate engineering coverage. Bhat's career does none of those things. It reads, instead, as a fifteen-year compounding bet on a particular operator's view of how infrastructure should run. The bet has not been visible at any single moment. It is visible across the line.
The ByteDance role is the place where the thesis gets written into production code at the scale where the thesis matters. The team Bhat has joined sits inside the big-data engineering organization. The work will involve removing more humans from more routine decisions inside an environment where the routine decisions are themselves a substantial cost center.
What the next several years will demonstrate is whether the thesis holds at the scale ByteDance operates at. Most of the operational savings, when this kind of work is done correctly, do not show up in press releases. They show up as quiet reductions in headcount per cluster, quiet improvements in mean time to repair, quiet declines in the percentage of engineering time spent firefighting. What ends up surfacing in the public record over the next two to three years will depend on how much of the internal work ByteDance chooses to publish. The pattern of the previous fifteen years suggests most of it will not.
