The Engineering Leadership Podcast

In this episode, we’re diving into how orgs can leverage AI to create more autonomous processes when it comes to product development and quality control with Iccha Sethi, SVP of Engineering @ Vanta. Iccha shares how as an eng leader, it’s imperative to continue to be hands on, and she shares her experience replicating Vanta by vibe coding and what it taught her. She not only breaks down Vanta’s product development workflow and the ways in which AI has automated it, but she also shares the guardrails & checkpoints in place that ensure quality. Additionally, Jerry and Iccha discuss individual and team accountability within Vanta’s fast product cycle. Lastly, they cover the AI DX team, who it is comprised of, and its role within Vanta while still maintaining a culture of experimentation when it comes to AI.

ABOUT ICCHA SETHI
Iccha Sethi is SVP of Engineering at Vanta, where she leads the engineering organization building products that help businesses earn and prove trust by automating security and compliance. Previously, she led engineering teams at GitHub across products including Actions, Codespaces, npm, Packages, and Pages. Her career also includes engineering and leadership roles at InVision, Atlassian, and Rackspace.
Iccha focuses on connecting engineering decisions to business outcomes, building reliable products at scale, and exploring how AI and agentic systems are reshaping software products and engineering organizations. She brings the perspective of both a hands-on technical leader and an executive leading engineering organizations. Outside work, she enjoys reading science fiction and fantasy.

The CAFE(S) framework is a research-backed definition of context quality for AI agents.
DX collaborated with researchers at Capital One, Google, and UVic to give teams a shared standard for reviewing agent context by breaking it into five properties: clarity, actionability, fidelity, efficiency, and security.
Your agent is only as good as its context and the CAFE(S) framework establishes a shared language around context to help you better understand how & why agents go wrong.
Check it out here!

SHOW NOTES:
Introducing Iccha & her leadership philosophy / style (1:23)
Differentiating between what is marketing vs. real value for engineers (3:33)
Lessons learned from vibe cloning Vanta (6:33)
Iccha’s perspective on the future of SaaS (9:04)
Understanding total cost of ownership when it comes to app maintenance (10:28)
How to stay hands on as an eng leader / knowing what to practice (11:48)
Vanta’s process from customer call through production (14:43)
Implementing an EPD triad to iterate quickly & allow autonomy (17:48)
What “Walk the Store” is / how it acts as a checkpoint for the team (19:34)
Strategies for a more automated product workflow & quality / eng guardrails (22:41)
What handoffs look like @ Vanta (25:22)
Creating a culture of accountability within Vanta’s product cycles (28:12)
Frameworks for scaling agent-assisted workflows (30:44)
Forming an AI DX team & its overall goals (32:59)
Qualities that make a successful AI DX team member (35:21)
Supporting bottom-up experimentation without creating internal chaos (37:55)
Rapid fire questions (40:26)

This episode wouldn’t have been possible without the help of our incredible production team:
Jerry Li - Host
Noah Olberding - Associate Producer, Audio & Video Editor https://www.linkedin.com/in/noah-olberding/
Dan Overheim - Audio Engineer, Dan’s also an avid 3D printer - https://www.bnd3d.com/
Ellie Coggins Angus - Copywriter, Check out her other work at https://elliecoggins.com/about/

Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

In this episode, Pratima Arora, Chief Product and Technology Officer @ Smartsheet, dives into what it means to be a modern builder as product, design, and engineering roles converge into today’s post-AI world. She and Jerry discuss why the modern builder model is disrupting traditional engineering processes / responsibilities as individuals embrace a breadth of skills while maintaining individual expertise. They cover how to encourage “cross-pollination” of roles, maintaining product quality while improving iteration speed, facilitating bottom-up contributions, creating context / knowledge graphs to inform agents, examples of good product builders, and what this means for hiring.

ABOUT PRATIMA ARORA
Pratima Arora is the Chief Product and Technology Officer at Smartsheet. In this position, she is responsible for the company’s product management, product marketing, user experience, pricing and packaging, and digital and product partnerships.
An accomplished technology executive, Pratima has more than 20 years of experience as a product and technology leader with a passion for building innovative tools that solve real problems.
She has held senior product leadership roles at Atlassian and Salesforce, working on some of the companies’ highest-revenue products. Most recently, she was Chief Product and Technology Officer at Chainalysis, where she led the global R&D organization for one of the world’s top blockchain data platforms.
She holds a B.S. in Physics, an M.S. in Computer Science, and an MBA from UC Berkeley’s Haas School of Business.

The CAFE(S) framework is a research-backed definition of context quality for AI agents.
DX collaborated with researchers at Capital One, Google, and UVic to give teams a shared standard for reviewing agent context by breaking it into five properties: clarity, actionability, fidelity, efficiency, and security.
Your agent is only as good as its context and the CAFE(S) framework establishes a shared language around context to help you better understand how & why agents go wrong.
Check it out here!

SHOW NOTES:
Introducing Pratima & her role @ Smartsheet (1:21)
Pratima’s insights on the CPTO role / the modern builder (3:11)
How the modern builder idea is disrupting traditional processes (4:52)
Maintaining product quality while improving building speed (6:48)
Understanding boundaries / designated roles as builder role expands (9:19)
Reward your teams & develop a mindset of cross-pollinating roles (11:32)
Benefits of a flexible modern builder role within teams (14:02)
The relationship between modern builders & skill development (17:28)
Strategies for facilitating bottom-up contributions across roles (19:44)
Defining the chief AI officer’s responsibilities / team roles (21:30)
What internal launches / adoption techniques look like @ Snapsheet (24:29)
Creating & maintaining the knowledge graph that informs agents (26:05)
The role of experts / specialities within the modern builder framework (29:28)
What the modern builder role means for the org chart (32:17)
Examples of modern builder archetypes (34:06)
Skills that make a good product builder (35:07)
Hiring insights when it comes to bringing in new modern builder talent (36:08)

This episode wouldn’t have been possible without the help of our incredible production team:
Jerry Li - Host
Noah Olberding - Associate Producer, Audio & Video Editor https://www.linkedin.com/in/noah-olberding/
Dan Overheim - Audio Engineer, Dan’s also an avid 3D printer - https://www.bnd3d.com/
Ellie Coggins Angus - Copywriter, Check out her other work at https://elliecoggins.com/about/

Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

In this episode, Sagnik Nandy (CTO & EVP of Engineering @ Docusign) joins Jerry to discuss keys to success when it comes to peer-led AI transformation. Sagnik shares how they approached AI adoption internally @ Docusign with the use of both champions & multipliers, understanding trade offs associated with AI adoption, determining which tasks to assign to agents, frameworks for measuring the ROI of agentic tools, and how it helps bring value to your customers. He also discusses how to measure the customer productivity index (CPI) and what it takes to mitigate customer issues when scaling AI internally.

ABOUT SAGNIK NANDY
Sagnik Nandy is the Chief Technology Officer and Executive Vice President of Engineering at Docusign responsible for engineering, cloud operations, and technology strategy that enables customers globally to run their organizations on Docusign.
Most recently, Sagnik served as the President and Chief Development Officer for Workforce Identity at Okta where led engineering development and operations, product management, and design and user research. Earlier, he joined Okta as their CTO, overseeing the engineering and business technology arms of the company.
Prior to Okta, Sagnik served as the Vice President of Engineering at Google where he oversaw several critical components of Google’s core advertising business, the backbone of the company’s growth and revenue. During his 15 years at Google, Sagnik also helped build Google’s Measurement and Analytics offerings and took several products from inception to becoming market leaders.
Sagnik has a bachelor’s degree from the BITS, Pilani (Birla Institute of Technology and Science Pilani) and a Ph.D. in computer science and engineering from UC San Diego.

The CAFE(S) framework is a research-backed definition of context quality for AI agents.
DX collaborated with researchers at Capital One, Google, and UVic to give teams a shared standard for reviewing agent context by breaking it into five properties: clarity, actionability, fidelity, efficiency, and security.
Your agent is only as good as its context and the CAFE(S) framework establishes a shared language around context to help you better understand how & why agents go wrong.
Check it out here!

SHOW NOTES:
Introducing Sagnik & his role @ Docusign (1:28)
Strategies for approaching AI transformation internally (2:52)
How to create early goals & iterate quickly (4:50)
Using DocuWiki as a source of truth for agents (9:10)
How multipliers can address architecture-related decision making (11:12)
Understanding the role of multipliers & organizational accountability (12:43)
Trade offs eng leaders have to make when scaling AI adoption (14:05)
Illustrating the standard AI workflow / where human decision making steps in (16:22)
Frameworks for measuring the customer value of agents (20:13)
Steps for mitigating risks of customer-facing issues when scaling AI internally (26:13)
Tackling cost considerations when it comes to AI adoption (30:35)
Best practices for maintaining your AI usage / methodology across a large org (35:06)
How to AI effectively as a CTO (37:25)
Rapid fire questions (38:39)

This episode wouldn’t have been possible without the help of our incredible production team:
Patrick Gallagher - Producer & Co-Host
Jerry Li - Co-Host
Noah Olberding - Associate Producer, Audio & Video Editor https://www.linkedin.com/in/noah-olberding/
Dan Overheim - Audio Engineer, Dan’s also an avid 3D printer - https://www.bnd3d.com/
Ellie Coggins Angus - Copywriter, Check out her other work at https://elliecoggins.com/about/

Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

Amit Gupta, Partner @ SNR Ventures, joins Jerry to discuss his unique eng leadership journey and how that led him to his second career as an investor / coach. We cover some of the lessons learned throughout his time working as VP of various startups and how those experiences shaped his desire to start his own consulting business. Amit defines what a coaching tree is and his philosophy when it comes to mentorship, picking the right projects, and determining what a team needs to work effectively together. Throughout the conversation, we revisit why effective engineering coaching also includes mentorship around company building. Lastly, Amit discusses why eng leaders make good investors and how investing was a natural continuation off of engineering for him.

ABOUT AMIT GUPTA
Amit Gupta has held leadership roles at multiple high-growth companies from early-stage through the public markets, including Qualcomm, INQ Mobile, Lookout, and Benchling. He combines concentrated, early stage investing with a passion for helping technical founders with company building. In some cases that materializes into a role helping in the trenches and in others a more passive, help as needed voice. Amit has helped countless companies directly and as an advisor to Y Combinator Continuity.

The CAFE(S) framework is a research-backed definition of context quality for AI agents.
DX collaborated with researchers at Capital One, Google, and UVic to give teams a shared standard for reviewing agent context by breaking it into five properties: clarity, actionability, fidelity, efficiency, and security.
Your agent is only as good as its context and the CAFE(S) framework establishes a shared language around context to help you better understand how & why agents go wrong.
Check it out here!

SHOW NOTES:
Amit’s transition from Qualcomm (1:05)
Talent acquisitions challenges faced when starting a company (4:58)
Lessons learned from Amit’s time @  Qualcomm (8:24)
Strategies for building a support networks as an eng leader (9:41)
An example of effective mentorship in Amit’s career (11:00)
Defining work-life integration & how that influences Amit as a coach (12:55)
Transitioning from a second startup / starting his own consulting business (14:05)
Why the work at Benchling wasn’t as hard as the first couple startups (16:21)
Amit’s favorite behavioral interview question (17:40)
Shared traits of great teams who perform well together (18:56)
Frameworks for determining good leaders vs. good managers (20:38)
Ways to feed your high-aptitude leaders (23:18)
An example of a rewarding coaching scenario (25:25)
Amit’s perspective on investing as an extension of building (29:38)
Strategies for determining which bets will be successful (32:16)
Considerations for the eng leader to investor pipeline (34:43)
Rapid fire questions (39:53)

This episode wouldn’t have been possible without the help of our incredible production team:
Patrick Gallagher - Producer & Co-Host
Jerry Li - Co-Host
Noah Olberding - Associate Producer, Audio & Video Editor https://www.linkedin.com/in/noah-olberding/
Dan Overheim - Audio Engineer, Dan’s also an avid 3D printer - https://www.bnd3d.com/
Ellie Coggins Angus - Copywriter, Check out her other work at https://elliecoggins.com/about/

Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

Zohar Einy, CEO & Co-Founder @ Port, shares best practices for building a software factory, how software factories impact the organizational structure of your org, and scaling strategies. He and Jerry discuss why software factories can contribute to a significant ROI, tools for helping your teams navigate the transition from building a product for agents vs. people, and what scary (but healthy) decision-making looks like as an eng leader in a post-AI world. Zohar also shares some of his core beliefs when it comes to developing talent & hiring young engineers @ Port.

ABOUT ZOHAR EINY
Zohar Einy is the co-founder and CEO of Port, the agentic SDLC platform helping companies like GitHub, Visa, and PwC build and scale their AI Software Factories. Port has raised $158M, backed by General Atlantic, Accel, Bessemer Venture Partners, Team8, and TLV Partners.
The idea for Port began during Zohar and co-founder Yonatan Boguslavski’s time as engineers in the IDF’s Unit 8200, where they built a platform to help developers move more quickly at scale. After recognizing the same challenge across the broader market, they founded Port in 2022.

The CAFE(S) framework is a research-backed definition of context quality for AI agents.
DX collaborated with researchers at Capital One, Google, and UVic to give teams a shared standard for reviewing agent context by breaking it into five properties: clarity, actionability, fidelity, efficiency, and security.
Your agent is only as good as its context and the CAFE(S) framework establishes a shared language around context to help you better understand how & why agents go wrong.
Check it out here!

SHOW NOTES:
Introducing Zohar & his background / main focus (1:02)
Defining what a software factory is & what that means for the industry (1:50)
Parallels between a physical factory vs. a software factory (3:50)
How the software factory model impacts organizational structure (5:27)
What certification means in the context of software factories (8:46)
Best practices for building a new software factory (10:48)
Don’t make the ability to scale an afterthought (12:15)
Navigating the balance between control & automation when building from scratch (13:17)
How to know when a team / function merits its own software factory (14:37)
Transitioning from a pre-AI to post-AI world as a large company (16:18)
Inside Port’s rebuild using AI & navigating the team through the transition (18:00)
The team’s reaction to building for agents vs. humans (20:25)
Approaching decision-making with a healthy dose of trepidation (21:48)
Characteristics that make for good hires today (22:51)
Examples of product-related decisions that felt scary in the moment (25:03)
Lessons learned while Port transitioned to building for agents (27:27)
How to measure the ROI of software factories (29:05)
Insights on how to best allocate resources across a mature company (31:10)
Hiring hungry, young talent vs. hiring established talent (32:56)
Rapid fire questions (35:30)

This episode wouldn’t have been possible without the help of our incredible production team:
Patrick Gallagher - Producer & Co-Host
Jerry Li - Co-Host
Noah Olberding - Associate Producer, Audio & Video Editor https://www.linkedin.com/in/noah-olberding/
Dan Overheim - Audio Engineer, Dan’s also an avid 3D printer - https://www.bnd3d.com/
Ellie Coggins Angus - Copywriter, Check out her other work at https://elliecoggins.com/about/

Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.