Job Description

We help the world run better
At SAP, we keep it simple: you bring your best to us, and we'll bring out the best in you. We're builders touching over 20 industries and 80% of global commerce, and we need your unique talents to help shape what's next. The work is challenging – but it matters. You'll find a place where you can be yourself, prioritize your wellbeing, and truly belong. What's in it for you? Constant learning, skill growth, great benefits, and a team that wants you to grow and succeed. 

SAP BTP Fabric helps our customers and internal developers to create platform services including platform services for Agents. BTP Fabric is growing immensely by provisioning base platform for services within SAP as well for Agents. BTP Fabric is evolving into a Machine Learning powerhouse, utilizing the power of AI to build platform, for current day services; as well as building the next-generation platform for Agentic solutions. As an AI / Machine Learning Engr. on SAP BTP Fabric team, you can accelerate the innovation, design, and delivery of the next generation of platform experiences with Machine Learning and Generative AI. Applications running on the Network provide critical business processes involving thousands of buying organizations, millions of sellers across the globe, and several millions of users.

Duties and Responsibilities:

Duties and responsibilities of an AI / Machine Learning Engineer within SAP BTP Fabric will include work at the bleeding edge of generative AI, Agentic AI, and Semantic Vector Search including working with open-source as well as third-party generative models. In-addition, Machine Learning Engrs. within SAP BTP Fabric will work with conventional, open-source, reasoning as well as basic LLMs for adapted use for POC business use cases through fine-tunning, distillation and/or quantization to enable serving customers at scale.

Responsibilities will also involve out-of-box utilization of SOTA LLMs to enable Platform capabilities that can be adopted by several LOBs including:

• Design and implement innovations in the Semantic Vector Search space
• Develop, test, deploy GPU enabled microservices that provide BIC metrics and support measurable improvement in Business KPIs
• Work in and develop core agentic platform components for BTP
• Master framework design and modeling in a largescale, multi-tenant, on-demand environment
• Proactively detect and solve scalability and performance issues
• Work across teams and functions to build best-in-class solutions for various stakeholders

Minimum Qualifications:

• Master’s degree in Computer Science, Data Science, Machine Learning, with equivalent work experience.
• 5+ years experience developing production-grade, scalable, multi-threaded python API, Agentic and web applications
• Advanced compute acceleration expertise with GPU acceleration, vector programming.
• Advanced knowledge of Nvidia or AMD GPU architecture and acceleration capabilities and provisioning across cloud enterprises.
• Working knowledge of cloud-native architecture and cloud deployment frameworks, including microservices, containerization, Jenkins deployment pipeline, Docker files, Github actions & K8s.
• Capable of application performance analysis, tuning as well as latency enhancements with vector programming.
• Knowledgeable in application security best practices, networking, and data communication
• Proficient in Python, RUST, Linux, HTML, and REST APIs with either Flask, FAST APIs etc.
• Proficiency in building production-grade Machine Learning, Artificial Intelligent products as well as deep knowledge on using Agents.
• Proficiency with Databricks, github fundamentals.
• An understanding of the basics of Encoder and Decoder models including Generative LLM models.
• Cybersecurity fundamentals including foundational knowledge of Data Protection and Privacy.

Preferred Qualifications:

• Experience working with and deploying and utilizing LLM models in production.
• Experience with Claude code, Cline, Github copilot as developer accelerators etc.
• Experience with cloud platforms such as GCP, AWS, and Azure.
• Experience with MLOPs, LLMOPs and/or genAIOPs

Bring out your best
SAP innovations help more than four hundred thousand customers worldwide work together more efficiently and use business insight more effectively. Originally known for leadership in enterprise resource planning (ERP) software, SAP has evolved to become a market leader in end-to-end business application software and related services for database, analytics, intelligent technologies, and experience management. As a cloud company with two hundred million users and more than one hundred thousand employees worldwide, we are purpose-driven and future-focused, with a highly collaborative team ethic and commitment to personal development. Whether connecting global industries, people, or platforms, we help ensure every challenge gets the solution it deserves. At SAP, you can bring out your best.  

We win with inclusion
SAP’s culture of inclusion, focus on health and well-being, and flexible working models help ensure that everyone – regardless of background – feels included and can run at their best. At SAP, we believe we are made stronger by the unique capabilities and qualities that each person brings to our company, and we invest in our employees to inspire confidence and help everyone realize their full potential. We ultimately believe in unleashing all talent and creating a better world.

SAP is committed to the values of Equal Employment Opportunity and provides accessibility accommodations to applicants with physical and/or mental disabilities. If you are interested in applying for employment with SAP and are in need of accommodation or special assistance to navigate our website or to complete your application, please send an e-mail with your request to Recruiting Operations Team: Careers@sap.com.

For SAP employees: Only permanent roles are eligible for the SAP Employee Referral Program , according to the eligibility rules set in the SAP Referral Policy. Specific conditions may apply for roles in Vocational Training.

Qualified applicants will receive consideration for employment without regard to their age, race, religion, national origin, ethnicity, age, gender (including pregnancy, childbirth, et al), sexual orientation, gender identity or expression, protected veteran status, or disability.

Compensation Range Transparency : SAP believes the value of pay transparency contributes towards an honest and supportive culture and is a significant step toward demonstrating SAP’s commitment to pay equity. SAP provides the annualized compensation range inclusive of base salary and variable incentive target for the career level applicable to the posted role. The targeted annual combined range for this position is 148600-306300USD . The actual amount to be offered to the successful candidate will be within that range, dependent upon the key aspects of each case which may include education, skills, experience, scope of the role, location, etc. as determined through the selection process. Any SAP variable incentive includes a targeted dollar amount and any actual payout amount is dependent on company and personal performance. Please reference this link for a summary of SAP benefits and eligibility requirements:

AI Usage in the Recruitment Process

For information on the responsible use of AI in our recruitment process, please refer to our .

Please note that any violation of these guidelines may result in disqualification from the hiring process.

Requisition ID: 454105  | Work Area: Software-Design and Development  | Expected Travel: 0 - 10%  | Career Status: Professional  | Employment Type: Regular Full Time   | Additional Locations:  #LI-Hybrid

Job Tags

Permanent employment, Full time, Work experience placement, Worldwide, Flexible hours

Similar Jobs