Platform Product Manager

Ally

Charlotte, NCPosted 2 days agoDiscoveredMatch locked

RemoteFull time3+ years exp

Ally and Your Career

Ally Financial only succeeds when its people do - and that's more than some cliché people put on job postings. We love this stuff! We see our people as, well, people - with interests, families, friends, dreams, and causes that are all important to them. Our focus is on the health and safety of our teammates as well as work-life balance and diversity and inclusion. From generous benefits to a variety of employee resource groups, we strive to build paths that encourage employees to stretch themselves professionally. We want to help you grow, develop, and learn new things. You're constantly evolving, so shouldn't your opportunities be, too? Work Schedule : Ally designates roles as (1) fully on-site, (2) hybrid, or (3) fully remote. Hybrid roles are generally expected to be in the office a certain number of days per week as indicated by your manager. Your hiring manager will discuss this role's specific work requirements with you during the hiring process. All work requirements are subject to change at any time based on leader discretion and/or business need.

The Opportunity

The Manager, Product Management - Enterprise Data & AI Platforms will define and deliver the product strategy and multi-quarter roadmap for Ally's shared GenAI, machine learning, data, and knowledge platform. This role owns developer-facing capabilities such as AI gateways, agent frameworks and templates, model and capability registries, evaluation tools, and reliability dashboards. The manager will translate business workload needs into reusable, secure, governed, and SLA-backed platform products; manage prioritization, versioning, adoption, reliability, and cost metrics; and partner closely with engineering, FinOps, Enterprise Architecture, Model Risk Management, and senior leadership. The ideal candidate has 10+ years of combined product management and AI/data engineering experience, including 5+ years managing enterprise platform products and 3+ years of hands-on ML or GenAI delivery experience. Strong knowledge of modern AI platforms, responsible AI, model governance, enterprise security, AI unit economics, Agile delivery, and regulated financial-services environments is required.

The Work Itself

The Manager, Product Management, EDA Platforms, reports to the Head of the Data & AI Platform team and serves as a strategic partner in translating business priorities into a clear, actionable product roadmap. Working closely with the Head of Platform, this role ensures that platform investments and capabilities are aligned with enterprise needs, delivery-team demand, and measurable business outcomes. The role is responsible for clear articulation and tracking of product lines that powers Ally's GenAI and ML capabilities as a paved-path, self-service platform across Data Foundation, Knowledge Platform, Catalog & Governance, Model Platform, Apps & Agents, AI Reliability, and supporting Platform Fabric. The role owns key GenAI and ML product roadmaps used by delivery teams - including the AI Gateway, agent development tools and templates, capability and model-risk registries, and AI evaluation and monitoring dashboards - and partners with engineering and governance delivery leaders to prioritize, sequence, and evolve these capabilities in line with the Head of Platform's strategic direction. Day-to-day, the manager will define and publish a rolling multi-quarter roadmap sequenced by workload demand; own the versioning, SLA, deprecation, and paved-path contracts for each owned product; run the intake and prioritization loop that converts workload requests (predictive scoring, forecasting, document intelligence, conversational AI, agentic, streaming) into platform features, paved-path patterns, or explicit non-goals; partner with FinOps and Model Platform engineering on unit economics (cost-per-inference, GPU utilization, cost-per-agent-run) for GenAI and ML workloads; represent EDA Platforms in the EA and Model Risk Management forums with clear options, trade-offs, and recommendations; and instrument every product with adoption, reliability, and cost-to-serve telemetry so that platform health is visible to executives at all times. The manager will champion the platform mindset across the organization by systematically packaging recurring workload patterns into reusable products, making the paved path measurably cheaper and safer than bespoke alternatives, and holding the line against one-off exceptions that erode the platform contract.

The Skills You Bring

Bachelor of Science and 10+ years of combined experience across product management and hands-on ML, GenAI, or data/AI engineering, or equivalent combination of education and experience. Advanced degree in Computer Science, Engineering, Data Science, or related field preferred.
5+ years of product management experience owning developer-facing, platform, or internal PaaS products (SDKs, APIs, gateways, model platforms, developer portals) with demonstrated ownership of versioned APIs, SLA contracts, and deprecation policies at enterprise scale.
3+ years of hands-on practitioner background in ML, GenAI, or applied AI as an ML Engineer, Applied Scientist, Data Scientist, or Staff Engineer on an AI/ML platform. Must have shipped AI systems into production and be able to reason substantively about model evaluation, retrieval quality, prompt and agent design, drift, and inference cost. Pure non-technical product managers without a practitioner background will not be a fit.
Proven experience defining and delivering a GenAI and ML platform roadmap: model hosting and inference gateways, agent frameworks, retrieval-augmented generation, evaluation harnesses, prompt and model registries, and continuous monitoring for GenAI and classical ML workloads.
Familiarity with the modern AI stack - Amazon Bedrock, SageMaker, Azure OpenAI. Able to lead architectural trade-off discussions with senior engineers.
Understanding of the AI Development Life Cycle (AIDLC) across both classical ML (train, deploy, monitor, retrain) and GenAI/agent (prompt, retrieve, tool, evaluate, deploy, observe, iterate) flavors, and ability to map platform capabilities to each stage of the lifecycle.
Demonstrated ability to translate AI use cases into measurable business outcomes (cycle-time reduction, cost-to-serve, adoption of paved paths, data-quality uplift, operational efficiency) and to publish monthly platform scorecards visible to senior leadership.
Responsible AI capability: model governance, model risk management (MRM) partnership, human-in-the-loop controls for high-impact actions, auditability of AI recommendations, and continuous monitoring for drift, bias, hallucination, and prompt-injection risk. Comfortable operating alongside second-line functions in a regulated financial-services environment.
Strong Agile product leadership (Scrum/Kanban) with demonstrated ability to drive complex cross-team platform initiatives with predictable execution across multiple engineering pods, vendor partners, and governance stakeholders.
Excellent written and verbal communication: able to lead with a one-line verdict, back it with named contracts, decision rules, and anti-patterns, and present complex technical trade-offs clearly to both engineering and executive audiences.
Preferred: background in a bank, insurer, or health-payer AI platform organization. Prior contribution to or evaluation of model gateways, agent frameworks, or evaluation harnesses in production is a strong plus.

Minimum qualifications

7+ years of relevant experience
Bachelor's degree in relevant field of study or equivalent

How We'll Have Your Back

Ally's compensation program offers market-competitive base pay and pay-for-performance incentives (bonuses) based on achieving personal and company goals. Our Total Rewards program includes industry-leading compensation and benefits plus additional incentives that are designed to meet your needs and those of your family so you can get the most out of your career and your life, including:

Time Away: Program starts at 20 paid time off days in addition to 11 paid holidays and 8 hours of volunteer time off yearly (time off days are prorated based on start date and program varies based on full or part-time status and management level).

Planning for the Future: plan for the near and long term with an industry-leading 401K retirement savings plan with matching and company contributions, student loan pay downs and 529 educational save up assistance programs, tuition reimbursement, employee stock purchase plan, and financial learning center and financial coach access.

Supporting your Health & Well-being: flexible health and insurance options including medical, dental and vision, employee, spouse and child life insurance, short- and long-term disability, pre-tax Health Savings Account with employer contributions, Healthcare FSA, critical illness, accident & hospital indemnity insurance, and a total well-being program that helps you and your family stay on track physically, socially, emotionally, and financially.

Building a Family: adoption, surrogacy and fertility assistance as well as paid parental and caregiver leave, Dependent Day Care FSA back-up child and adult/elder care days and childcare discounts.

Work-Life Integration: other benefits including Mentally Fit Employee Assistance Program, subsidized and discounted Weight Watchers® program and other employee discount programs.

Other Compensations: depending on the role for which you are considered, you may be eligible for travel allowances, relocation assistance, a signing bonus and/or equity.

To view more detailed information about Ally's Total Rewards, please visit this link: https://www.ally.com/content/dam/pdf/corporate/ally-total-rewards-snapshot.pdf

Who We Are :

Ally Financial is a customer-centric, leading digital financial services company with passionate customer service and innovative financial solutions. We are relentlessly focused on "Doing it Right" and being a trusted financial-services provider to our consumer, commercial, and corporate customers. For more information, visit www.ally.com .

Ally is an equal opportunity employer committed to diversity and inclusion in the workplace. All qualified applicants will receive consideration for employment without regard to age, race, color, sex, religion, national origin, disability, sexual orientation, gender identity or expression, pregnancy status, marital status, military or veteran status, genetic disposition or any other reason protected by law.

In accordance with the Americans with Disabilities Act, if after review of the position expectations, you believe that you may need a medical accommodation to fulfill the duties of this role, please email hrpolicy@ally.com with details of your accommodation request.

Base Pay Range

$110,000.00 - $180,000.00 An individual's position in the range is determined by the specific role, the scope and responsibilities of the role, work experience, education, certification(s), training, and additional qualifications. We review internal pay, the competitive market, and business environment prior to extending an offer.

Incentive Compensation:

This position is eligible to participate in our annual incentive plan.

Not included in the source posting: about the role, what you'll do, benefits.

Skills

artificial-intelligencemachine-learninggenerative-aiproduct-managementagileazurekanbanscrum

Who can apply

The employer didn't state any visa, work authorization, citizenship or clearance requirements in this posting. Confirm with the employer before applying.

Read automatically from the employer's posting text. Always confirm with the employer — requirements can change after a job is published.