AI Framework Software Engineer – SGlang & Kernels

Intel

PRC, ShanghaiPosted about 1 month agoDiscoveredMatch locked

Full time

Job Description

Conducts design and development to build and optimize AI software. Designs, develops, and optimizes for AI frameworks (e.g., SGLang) and contribute to public upstream. Implements various distributed algorithms such as model/data parallel frameworks, parameter servers, dataflow based asynchronous data communication in machine learning, and/or deep learning frameworks. Transforms computational graph representation of neural network model, and develops machine learning and/or deep learning primitives in mathematical libraries. Profiles distributed deep learning models to identify performance bottlenecks and proposes solutions across individual component teams. Optimizes code for various computing hardware backends, and interacts with machine learning and/or deep learning researchers, and utilizing experience with machine learning and/or deep learning frameworks.

Qualifications

Master degree or Ph.D. in in Computer Science, Artificial Intelligence, Software Engineering, or related fields.
Good programming skills of modern C++ and Python
Know foundations of Deep Learning theory and some hands-on experience
Communicate in English fluently (both written and spoken)
Are passionate on solving problems and positive thinker
Experience of performance optimization or high efficiency kernel development experience is a plus
Experience of PyTorch, SGLang, vLLM is a plus
Experience of LLM and deep understanding of model structure is a plus

Job Type

College Grad

Shift

Shift 1 (China)

Primary Location

PRC, Shanghai

Posting Statement

All qualified applicants will receive consideration for employment without regard to race, color, religion, religious creed, sex, national origin, ancestry, age, physical or mental disability, medical condition, genetic information, military and veteran status, marital status, pregnancy, gender, gender expression, gender identity, sexual orientation, or any other characteristic protected by local law, regulation, or ordinance. Position of Trust N/A

Work Model for this Role

This role will require an on-site presence. Job posting details (such as work model, location or time type) are subject to change.

ADDITIONAL INFORMATION: Intel is committed to Responsible Business Alliance (RBA) compliance and ethical hiring practices. We do not charge any fees during our hiring process. Candidates should never be required to pay recruitment fees, medical examination fees, or any other charges as a condition of employment. If you are asked to pay any fees during our hiring process, please report this immediately to your recruiter.

Not included in the source posting: about the role, what you'll do, benefits.

Skills

deep-learningartificial-intelligencemachine-learningcllmpythonpytorch

Who can apply

The employer didn't state any visa, work authorization, citizenship or clearance requirements in this posting. Confirm with the employer before applying.

Read automatically from the employer's posting text. Always confirm with the employer — requirements can change after a job is published.