Software Engineer, Large Language Models (LLM) Intern – Large Language Models

Job Description

Research Scientist Intern (Applied Machine Learning-Enterprise) – 2026 Summer (BS/MS) | ByteDance

The Tone:
This is an internship at ByteDance, located in the US. The company builds and operates a big model service platform, offering Model-as-a-Service (MaaS) solutions to both vendors and users of large language models. This role matters because it provides a foundational experience in developing a critical platform that powers hundreds of LLM-based applications, while efficiently managing extensive GPU resources. Interns contribute directly to ByteDance’s mission of inspiring creativity and enriching life, gaining invaluable industry exposure and practical skills.

The TL;DR
• Role: Internship
• Type: Temporary
• Location: In-person, US
• Pay: $45 hourly
• Team: Applied Machine Learning Enterprise team
• Mission: Develop and maintain a big model service platform to provide Model-as-a-Service solutions for Large Language Models.
• Tech Stack: PyTorch, TensorFlow, C++, Python, Go

What You’ll Actually Do
• Building: Build a next-generation big model as a service platform to serve hundreds of LLMs based applications.
• Developing: Develop and maintain the big model as a service platform, including offline training/finetuning, online inference, model management, and resource orchestration.
• Managing: Manage a huge number of GPU resources and provide computing power efficiently.
• Gaining Experience: Gain hands-on industry exposure and practical experience in developing fundamental skills and exploring potential career paths.
• Utilizing Knowledge: Utilize knowledge in real-world scenarios while laying a strong foundation for personal and professional growth.

The Must-Haves
• Background: Currently pursuing a Bachelor’s or Master’s degree in Computer Science or a related technical field.
• Experience: Proficient in deep learning frameworks such as PyTorch or TensorFlow, and experienced with software development in at least one of C++, Python, or Go.
• Skills: Strong software programming capabilities, good code design and coding style, along with good teamwork and communication skills.
• Bonus: Experience in Natural Language Processing (NLP) and Large Language Model (LLM) technologies, experience or research in Alignment for Large Language Models, experience in ModelOps (e.g., large model management, finetuning workflow management), or contributions to top-tier conference papers like NeurIPS, ICML, ICLR, CVPR, ICCV, ACL, or KDD.