About XPENG
XPENG is a leading smart technology company at the forefront of innovation, integrating advanced AI and autonomous driving technologies into its vehicles, including electric vehicles (EVs), electric vertical take-off and landing (eVTOL) aircraft, and robotics. With a strong focus on intelligent mobility, XPENG is dedicated to reshaping the future of transportation through cutting-edge R&D in AI, machine learning, and smart connectivity.
Job Responsibilities
- Fine-tune the pre-trained LLM on particular use cases in Humanoid Robots and Autonomous Driving Cars, e.g. chat, API calling, etc.
- Work on efficient LLMs (e.g. small LLMs, weight sharing, model quantization, etc.) that can be deployed locally in Robots and Cars.
- Develop and maintain the LLM (including multi-modal LLM) training and deployment pipelines that could scale to massive production.
- Work on efficient and effective ways to leverage large scale dataset and computational resource.
- Explore novel ways to generate synthetic data to improve the data diversity & quality.
- Communicate and align with different teams on product needs across the company
Minimum Skill Requirements
- Ph.D in Computer Science or related fields.
- Solid background in machine learning, natural language processing (NLP), computer vision, speech or data.
- Experience in working with LLMs
- Strong python programming skills & software development, and strong experience with any major deep learning framework.
- Open-minded, collaborative and excellent communication skills
Preferred Skill Requirements
- Deep understanding of language model modern architectures, ‘under the hood’ LLM training knowledge, quantization techniques, etc.
- Familiarity of large language models (LLMs) relevant technologies, such as SFT, RLHF, prompt engineering, RAG, etc.
- Record of publications, innovations or leadership.