top of page

From Wall Street to ByteDance – One Engineer's 15-Year Bet on Automation

Jun 12, 2024
4 min read

Written by: Julianna Davies

The line between Wall Street and Silicon Valley, for the engineering generation that came up in the 2010s, has run through a quiet middle layer of infrastructure work that does not feature in the company narratives of either coast. Wall Street's technology stack and Silicon Valley's were once separate trades, governed by different cultures, regulated by different agencies, and built for different kinds of risk. The engineers who moved between them carried something the public conversation about both industries has rarely captured. They carried an operator's intuition about what large systems actually cost to run. Shashidhar Bhat, the software engineer who this month joined ByteDance's big-data team in San Jose, is one of the cleaner illustrations of that line.


Smiling bald bearded man in a white shirt in a modern office, with a blurred cityscape screen behind him.

Bhat's career began in 2007 at TechMahindra, the Indian information technology services firm headquartered in Pune. The work at that point was the broad, services-oriented engineering practice that for much of his cohort served as the entry door into the industry. The chapter that followed, at JPMorgan Chase's India operations, was a step into a more demanding environment. JPMorgan's technology footprint in India had grown into one of the largest tech operations in the country by the period in which Bhat worked there. The work was mission-critical, regulated, and compliance-bound. The standards under which engineering decisions had to hold were the standards of a global investment bank. The discipline absorbed in those years is the kind that does not come back later in a career.


The pivot away from financial services took him to Cornerstone OnDemand, the Santa Monica-based talent-management software company that for most of the past decade has been one of the more substantial enterprise SaaS firms outside the headline names. He stayed for twelve years.


What Bhat shipped over that twelve-year stretch is the part of his career that explains the move he is making this month. The platform he inherited at Cornerstone was a monolith. The platform he left behind was a Kubernetes-native infrastructure that provisioned new environments in six hours rather than two weeks. The mean time to repair across the GPU node fleet had dropped by forty percent over the course of the migration. Total platform scalability had improved by two hundred percent. Operating costs had fallen by thirty percent across the same period. The customer-facing service was holding ninety-eight percent uptime against a Fortune 500 client base.


The transformation was not a rebuild led from the top. It was a sequence of incremental, justified replacements, each running alongside the previous system long enough to clear the reliability case before the cutover. The discipline that produced the twelve-year arc has, in retrospect, been organized around a single thesis. Infrastructure decisions made by humans, on call, at routine cadence, scale poorly. The cognitive load on each operator rises as the system grows. The error rate rises with the cognitive load. The remediation cost rises with the error rate. The way out is to take the routine decisions off the human and put them onto software. The work Bhat has shipped, role by role, has been a steady escalation toward that thesis.


The chapter that has just begun is the most demanding test of it. ByteDance, the company best known publicly as the parent of TikTok, operates one of the largest Kubernetes infrastructures on earth and runs roughly one petabyte of data through its big-data pipelines each month. The operational complexity of an environment of that size does not yield to incrementalism. The opportunity Bhat has stepped into is precisely that. A petabyte-scale environment in active use, with the volume of routine decision-making that comes with it, is the cleanest possible proving ground for the thesis he has been building toward since 2007.


The path that took him there has not been a sequence of brand-name moves. TechMahindra is not on most of the engineering recruiting funnels that dominate Silicon Valley. The JPMorgan Chase chapter, run from India rather than Manhattan, was the kind of high-compliance experience that does not register in the narratives the U.S. tech press tends to write about engineering careers. The Cornerstone OnDemand stretch was twelve years long inside a company well-known to its customers and less well-known outside them. Each move was a rung up in infrastructure complexity, and each took place inside a company whose technical ambitions have been less visible to the public than to the operators inside the building.


The pattern is the part of the story that does not fit the usual shape. Most engineering profiles at this stage of a career describe a single defining shipment, an early founder pedigree, or a name-brand stretch at one of the half-dozen firms that dominate engineering coverage. Bhat's career does none of those things. It reads, instead, as a fifteen-year compounding bet on a particular operator's view of how infrastructure should run. The bet has not been visible at any single moment. It is visible across the line.


The ByteDance role is the place where the thesis gets written into production code at the scale where the thesis matters. The team Bhat has joined sits inside the big-data engineering organization. The work will involve removing more humans from more routine decisions inside an environment where the routine decisions are themselves a substantial cost center.


What the next several years will demonstrate is whether the thesis holds at the scale ByteDance operates at. Most of the operational savings, when this kind of work is done correctly, do not show up in press releases. They show up as quiet reductions in headcount per cluster, quiet improvements in mean time to repair, quiet declines in the percentage of engineering time spent firefighting. What ends up surfacing in the public record over the next two to three years will depend on how much of the internal work ByteDance chooses to publish. The pattern of the previous fifteen years suggests most of it will not.


 
 

This article is published in collaboration with Brainz Magazine’s network of global experts, carefully selected to share real, valuable insights.

Article Image

Conflict is Not About the Other Person, It is About the System You Enter

When conflict repeats, the problem may not lie in either person's behaviour alone but in the system of expectations, roles, and responses that emerges between them. Understanding conflict requires looking beyond...

Article Image

5 Financial Mistakes U.S. Business Owners Make, and How to Avoid Them

A business can have strong sales and still struggle to pay its bills. Often, the problem isn’t a lack of customers, it’s a lack of clear financial information. Here are five mistakes I see business...

Article Image

You Changed My Life, The Most Meaningful Words a Mentor Can Hear

“You changed my life.” For me, few words carry more meaning. After years of mentoring entrepreneurs, I have learned that intelligent, capable founders often need someone to help them connect the dots...

Article Image

Jupiter Moves Into Leo to Join Ketu

Jupiter’s move into Leo alongside Ketu brings power, confidence and transformation into the spotlight of this Vedic astrology interpretation. Stefania Leone explores the symbolism of this planetary combination...

Article Image

The Job You're Hugging Won't Hug You Back and 7 Keys to Position Your Career in the Age of AI

Most leaders I speak with this year are not planning their next move. They are holding their breath. They are capable. They are experienced. Many are at the peak of their careers. They are gripping...

Article Image

Why Boutique Hotels Are Winning on Emotion, Not Scale

Boutique hotels can offer more than beautiful rooms, thoughtful design, and personalized service, they can create experiences that stay with travelers long after they leave. Through stays at four...

Conflict is Not About the Other Person, It is About the System You Enter

5 Financial Mistakes U.S. Business Owners Make, and How to Avoid Them

You Changed My Life, The Most Meaningful Words a Mentor Can Hear

Jupiter Moves Into Leo to Join Ketu

The Job You're Hugging Won't Hug You Back and 7 Keys to Position Your Career in the Age of AI

Why Boutique Hotels Are Winning on Emotion, Not Scale

I Published My Book the Way I Built a Food Company

Everyone Thinks They're the Hero

Why Joy Might Be the Missing Link in Your Fitness Journey

bottom of page