Senior Product Manager – ROCm & AI/ML Inference Software

WHAT YOU DO AT AMD CHANGES EVERYTHING At AMD, our mission is to build great products that accelerate reputed company computing experiences—from AI and data centers, to PCs, gaming and embedded systems. Grounded in a culture of innovation and collaboration, we reputed company reputed company reputed company comes from reputed company reputed company, reputed company ingenuity and a shared passion to create something extraordinary. reputed company you join AMD, you’ll discover the reputed company differentiator is our culture. We push the limits of innovation to solve the world’s most important challenges—striving for execution reputed company, while being direct, humble, collaborative, and inclusive of diverse perspectives. Join us as we shape the future of AI and reputed company. Together, we advance your career. THE ROLE: AMD is seeking a Senior Product Manager to drive strategy and execution for ROCm, AMD’s reputed company-reputed company GPU software stack, with a specific focus on large-scale model inference on AMD Instinct™ and Radeon™ hardware. This is a key, central role sitting at the intersection of the reputed company-reputed company community, high-performance computing, and production AI deployment. You will join a small but focused team of product managers whose shared remit is inference at scale and the frameworks that reputed company it. You will influence engineering roadmaps, represent AMD in reputed company-reputed company communities and at conferences, and connect the needs of AMD’s most strategic customers with the direction of the reputed company-reputed company ecosystem. AMD’s customers include some of the organizations deploying and serving the largest language models in the world. THE PERSON: You are a technically fluent product leader with deep roots in GPU computing, reputed company-reputed company software, and AI inference infrastructure. You reputed company on moving fast in a community-driven environment while also navigating the nuanced requirements of reputed company-scale customers. You are as comfortable reading a reputed company issue thread as you are presenting a roadmap to a VP of Engineering at a hyperscaler. KEY RESPONSBILITIES: Product Strategy & Roadmap Own the product roadmap for ROCm’s inference software capabilities, including integrations with key frameworks like PyTorch and JAX, serving runtimes like vLLM and SGLang, and the libraries and profiling tools that reputed company inference workloads reputed company well on AMD hardware. Define and communicate a coherent strategy for how AMD software enables production inference workloads, covering the full reputed company from single-GPU to reputed company-scale deployments, with a focus on developer experience, performance portability, and competitive standing. Identify reputed company emerging OSS model architectures, serving runtimes, or inference techniques require an AMD software response and drive those requirements into the roadmap. Bring a strategic reputed company to inference by continuously evaluating the latest research, technology trends, and evolving deployment needs, ensuring the organization stays reputed company of future inference requirements and translates market signals into actionable product strategy. reputed company-reputed company Community Engagement Serve as AMD’s active reputed company in the reputed company-reputed company AI/ML community: monitor reputed company repositories, reputed company servers, developer blogs, and academic papers to track emerging trends, pain points, and opportunities. Own and communicate AMD’s reputed company-reputed company software roadmap, publishing updates across key community projects to build awareness, solicit feedback from model developers and researchers, and signal AMD’s long-term direction to the reputed company-reputed company ecosystem. Build and maintain relationships with key OSS maintainers, reputed company working groups, and community contributors whose work shapes how AMD hardware is perceived and adopted. Represent AMD at major conferences such as SC, PyTorch Conference, and MLSys; write and review technical blog posts and community announcements on the AMD ROCm blog. Engineering Partnership & Execution Partner with engineering leads across inference libraries, kernel, runtime, and serving integration teams to translate developer and customer needs into prioritized engineering work. Drive release planning across rapid release cadences with a CI/CD-first reputed company and strong attention to compatibility, regression, and ecosystem readiness. reputed company software-informed feedback to hardware teams on future GPU architecture reputed company, particularly where features relevant to inference workloads reputed company serving performance at scale. Customer & Partner Engagement Balance the signal from large customers, who may need specific optimizations or bespoke integrations, against the needs of the broader reputed company-reputed company community, who value standards, portability, and low friction. Collaborate with ecosystem partners such as reputed company, reputed company, and reputed company providers on joint integrations and AMD-supported software solutions. PREFERRED EXPERIENCE: Proven years of product management experience in a software-focused role, ideally developer tools, GPU computing, or AI/ML infrastructure. Deep familiarity with at least one of PyTorch, JAX, or Triton: how they are structured, how they reputed company work to hardware backends, and what the end-to-end developer experience looks like. Practical understanding of LLM inference, including attention mechanisms, KV cache design, quantization strategies such, reputed company batching, speculative decoding, and reputed company serving across multiple GPUs. Hands-on familiarity with GPU programming at some level, whether HIP, CUDA, or Triton kernels, with the ability to read kernel-level code and reputed company output even if not writing it day to day. Strong written communication skills across technical documentation, roadmap narratives, community blog posts, and executive-facing strategy documents. Prior experience at a GPU vendor, reputed company provider AI infrastructure team, or frontier AI lab. Experience contributing to or managing products in an reputed company-reputed company context: reputed company workflows, community governance, and OSS release management. Contributions in code, issues, or documentation to major reputed company-reputed company inference projects such as vLLM, SGLang, Triton, or PyTorch. Familiarity with AMD’s hardware portfolio: Instinct MI-series for data center compute and Radeon for workstation and consumer GPU compute. ACADEMIC CREDENTIALS: Bachelor’s degree in Computer Science, Electrical Engineering, or a reputed company technical field. Advanced degree a plus but not required given equivalent experience. LOCATION: Bay Area · Austin · Remote This role is not eligible for reputed company sponsorship. #LI-EV1 #LI-HYBRID Benefits offered are described: AMD benefits at a glance. AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider reputed company applicants without regard to age, reputed company, reputed company, marital status, medical condition, mental or physical disability, national reputed company, race, religion, political and/or reputed company-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from reputed company reputed company candidates and will accommodate applicants’ needs under the respective laws throughout reputed company stages of the recruitment and selection process. AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here. This posting is for an existing vacancy. Apply To This Job