Intern Researcher - LLM Optimization Algorithms

Huawei Canada has an immediate internship opening for a Researcher.

About the team:

Founded in 2012, the Noah’s Ark lab has evolved into a prominent research organization with notable achievements in academia and industry. The lab’s mission focuses on advancing artificial intelligence and related fields to benefit the company and society. Driven by impactful, long-term projects, the aim is to enhance state-of-the-art research while integrating innovations into the company's products and services, including LLMs, RL, NLP, computer vision, AI theory, and Autonomous driving.

About the job:

• Development and implementation of new optimization algorithms for training LLMs.

• Conducting large-scale experiments to validate and evaluate proposed algorithms versus the current SOTA.

• Present results and write scientific papers for top AI/ML conferences.

About the ideal candidate:

• Currently a PhD or Master's student in computer science or related fields, with an emphasis on optimization algorithms and training LLMs.

• Knowledge of current LLM architectures, such as Transformer and Mamba.

• Deep understanding of the fundamentals and state-of-the-art techniques of numerical optimization, as currently being applied to deep learning models (e.g., non-convex optimization theory, SGD, AdamW).

• Strong hands-on programming skills with experience in implementing and customizing optimization algorithms for deep learning models using libraries such as PyTorch.

• First-author publication in top-tier ML conferences or journals, such as NeurIPS, ICML, ICLR, JMLR, etc., is a plus.