SoFi - TEST - GH API (EA YES) Logo

SoFi - TEST - GH API (EA YES)

Senior Staff Software Engineer, AI Developer Experience

Posted 4 Days Ago
Be an Early Applicant
Easy Apply
In-Office
San Francisco, CA, USA
173K-297K Annually
Senior level
Easy Apply
In-Office
San Francisco, CA, USA
173K-297K Annually
Senior level
Lead architecture and technical direction for SoFi’s AI Developer Experience platform, including AI gateways, model routing, evaluation systems, harness vending, and AI economics. Drive multi-team initiatives, distributed-system improvements, operational excellence, incident resolution, architectural standards, and engineering roadmaps. Mentor senior and staff engineers while advancing secure, maintainable, and effective AI-assisted development practices.
The summary above was generated by AI

Employee Applicant Privacy Notice

Who we are:

Shape a brighter financial future with us.

Together with our members, we’re changing the way people think about and interact with personal finance.

We’re a next-generation financial services company and national bank using innovative, mobile-first technology to help our millions of members reach their goals. The industry is going through an unprecedented transformation, and we’re at the forefront. We’re proud to come to work every day knowing that what we do has a direct impact on people’s lives, with our core values guiding us every step of the way. Join us to invest in yourself, your career, and the financial world.

The role:

SoFi's AI Platform team builds the foundation that lets every engineer at SoFi ship faster, safer, and with more leverage from AI. Our AI Developer Experience (AI DevEx) team owns SoFi's interactive coding strategy and the underlying infrastructure: AI economics, coding harnesses and harness vending, our evaluation platform, the AI Gateway, and intelligent model routing. 

As a founding Senior Staff Software Engineer, you'll be the technical lead and subject matter expert for this area across AI Platform: setting architecture, shaping the interactive coding strategy, and leading work across Autonomous Coding, CI/CD, Code Factory, and our customer engineering teams.

What you’ll do:

  • Set Technical Direction: Define and drive the architecture for the enterprise AI Gateway, model routing, automated evaluation platform, and harness vending, ensuring seamless support for interactive and autonomous workflows across multiple business units.

  • Shape Strategy & Roadmaps: Proactively identify systemic developer productivity bottlenecks, translate opportunities into a 12–24 month technical roadmap, and execute high-impact design and build initiatives.

  • Lead AI Economics Engineering: Architect cost models, metering systems, telemetry, and adaptive routing policies that balance model accuracy, latency, and operational spend across the engineering organization.

  • Drive Cross-Group Initiatives: Plan and technically lead initiatives spanning multiple engineering teams; establish shared interfaces and platform contracts with Autonomous Coding, CI/CD pipelines, and Code Factory.

  • Resolve Architectural Deficiencies: Identify and remediate root causes of complex architectural bottlenecks (latency, throughput, state management, dependencies) across distributed systems.

  • Evaluate Build-vs-Buy Choices: Continuously assess emerging AI tooling and foundational models, recommending vendor-neutral, future-proof integration patterns.

  • Represent Group Architecture: Lead department-level technical planning, establish architectural RFC standards, and facilitate rigorous design reviews across product areas.

  • Raise Operational Excellence: Set production standards for resilience, testing, and deployment; act as a lead incident resolver capable of coordinating responses to high-severity incidents and driving post-incident reviews to root-cause prevention.

  • Mentor & Elevate Talent: Actively coach and develop Senior (IC3) and Staff (IC4) engineers, cultivating an engineering culture of craft, ownership, and psychological safety.

What you’ll need:

  • Education & Minimum Experience Requirements: Bachelor’s Degree + 4+ Years of Experience OR Master’s Degree + 3+ Years of Experience in software engineering, computer science, or a related technical field.

  • Proven track record of technical leadership on software initiatives spanning multiple teams and complex distributed architectures.

  • Adept system design capability with large-scale, high-availability distributed systems, platform infrastructure, and cross-domain APIs.

  • Hands-on engineering experience building with LLM-based architectures, model APIs, and AI-assisted development tools (coding agents, developer harnesses, prompt/context evaluation, tool integration).

  • Hands-on experience designing or operating model evaluation pipelines, AI proxies/gateways, or dynamic routing systems.

  • Demonstrated ability to analyze infrastructure unit economics, capacity trade-offs, and operational telemetry.

  • Exceptional communication and cross-functional leadership skills, with a track record of driving technical alignment across engineering squads and leadership.

  • Commitment to engineering best practices, security guardrails, data privacy, and maintainable software design.

AI-Assisted Engineering Expectations:

  • Use AI tools responsibly to accelerate prototyping, explore new architectures, and streamline ramp-up across new domains.

  • Review AI-generated code and architecture critically, enforcing rigorous automated testing, safety, and long-term maintainability.

  • Adhere strictly to data-handling and security protocols to safeguard proprietary and member data.

  • Elevate team productivity by sharing effective AI development workflows, spec templates, and evaluation guardrails.

Nice to have:

  • Experience designing or scaling internal developer platforms (IDPs) and developer tooling at enterprise scale.

  • Practical exposure to FinOps frameworks for tracking and optimizing cloud or AI compute spend.

  • Direct experience developing autonomous agentic workflows or deep integrations into engineering development lifecycle tools.

  • Background in financial technology, banking platforms, or regulated engineering environments.

Compensation and Benefits
The base pay range for this role is listed below. Final base pay offer will be determined based on individual factors such as the candidate’s experience, skills, and location. 
 
To view all of our comprehensive and competitive benefits, visit our Benefits at SoFi page!
SoFi provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion (including religious dress and grooming practices), sex (including pregnancy, childbirth and related medical conditions, breastfeeding, and conditions related to breastfeeding), gender, gender identity, gender expression, national origin, ancestry, age (40 or over), physical or medical disability, medical condition, marital status, registered domestic partner status, sexual orientation, genetic information, military and/or veteran status, or any other basis prohibited by applicable state or federal law.The Company hires the best qualified candidate for the job, without regard to protected characteristics.Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.New York applicants: Notice of Employee RightsSoFi is committed to an inclusive culture. As part of this commitment, SoFi offers reasonable accommodations to candidates with physical or mental disabilities. If you need accommodations to participate in the job application or interview process, please let your recruiter know or email [email protected].We are unable to accommodate remote work from Hawaii, Alaska or Puerto Rico at this time.
Internal Employees
If you are a current employee, do not apply here - please navigate to our Internal Job Board in Greenhouse to apply to our open roles.

Similar Jobs at SoFi - TEST - GH API (EA YES)

16 Hours Ago
Easy Apply
In-Office
San Francisco, CA, USA
Easy Apply
154K-264K Annually
Mid level
154K-264K Annually
Mid level
Fintech • Security
Lead the Prism engineering team, managing software engineers and delivering SoFi’s internal AI productivity platform. Define and execute the AI platform roadmap, oversee foundational infrastructure such as model-routing, harness wrappers, and programmatic evaluations, develop engineering talent, and partner with internal developer customers to drive adoption. The role requires experience with AI-powered developer tooling, internal platforms, people management, greenfield engineering, and rapid iteration in ambiguous environments.
Top Skills: Ai Evaluation FrameworksAi PlatformsLlmsRetrieval-Augmented Generation (Rag)
4 Days Ago
Easy Apply
In-Office
San Francisco, CA, USA
Easy Apply
154K-264K Annually
Mid level
154K-264K Annually
Mid level
Fintech • Security
Lead development of foundational AI developer-experience platforms, including AI gateways, model routing, evaluation systems, coding harnesses, and cost telemetry. Own systems end to end, establish engineering standards, guide architecture, coordinate cross-team delivery, improve operational reliability, partner with internal developers, and mentor engineers. The role requires distributed systems expertise, backend programming, cloud infrastructure, CI/CD, AI-assisted tooling, LLM systems, and production service ownership.
Top Skills: Ai Evaluation PlatformsAi-Assisted Developer ToolingAWSCi/CdContainerizationDistributed SystemsFinops InstrumentationGCPGoJavaKotlinLlmsModel RoutingPythonScala
4 Days Ago
Easy Apply
In-Office
San Francisco, CA, USA
Easy Apply
198K-341K Annually
Expert/Leader
198K-341K Annually
Expert/Leader
Fintech • Security
Own SoFi’s company-wide cloud networking strategy, architecture, automation, and operational excellence. Design resilient AWS multi-region, multi-account, and Kubernetes networking; lead progressive traffic delivery, observability, and incident response; and guide AI-enabled infrastructure automation with appropriate guardrails. Partner with Security, Compliance, Risk, SRE, architecture, and business leaders, influence technical direction and investment decisions, and mentor senior engineering talent.
Top Skills: Ai AutomationAWSBgpCdnDdos ProtectionDnsGoHTTPInfrastructure As CodeKubernetesL4/L7 Load BalancingNetwork AutomationPythonService MeshesTcp/IpTlsWaf

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account