Software Engineer, Large Language Models (LLM) – Large Language Models

Job Description

Software Engineer Intern (Applied Machine Learning-Enterprise) – 2026 Start (PhD) | ByteDance

The Tone:
This is an internship at ByteDance, for a 2026 start, specifically for PhD students. ByteDance builds a suite of over a dozen products, including TikTok, Lemon8, CapCut, Toutiao, Douyin, and Xigua, with a mission to inspire creativity and enrich life. This role contributes to the Applied Machine Learning Enterprise team by helping develop and operate a big model service platform that offers Model-as-a-Service solutions, making a direct impact on the organization’s future plans and emerging technologies.

The TL;DR
• Role: Internship
• Type: Temporary
• Location: Not Specified
• Pay: $60 hourly
• Team: Applied Machine Learning Enterprise team
• Mission: Develop and operate a big model service platform that offers Model-as-a-Service solutions for businesses.
• Tech Stack: PyTorch, TensorFlow, C++, Python, Go

What You’ll Actually Do
• Platform Building: Build a next-generation big model as a service platform to serve hundreds of LLMs based applications.
• System Operations: Develop and maintain the big model as a service platform, including offline training/finetuning, online inference, and model management.
• Resource Optimization: Manage a huge number of GPU resources and provide computing power efficiently.
• Strategic Contribution: Actively contribute to ByteDance’s products, research, and emerging technologies.
• Solution Delivery: Offer Model-as-a-Service solutions to both big model vendors and users.

The Must-Haves
• Background: Currently pursuing a PhD in Computer Science or a related technical field.
• Experience: Software development in at least one of C++, Python, or Go, demonstrating strong programming capabilities with good code design and style.
• Skills: Proficient in deep learning frameworks such as PyTorch or TensorFlow, along with good teamwork and communication skills.
• Bonus: Experience in NLP and LLM technologies, research or experience in Alignment for Large Language Models, experience in ModelOps, or contributions to top-tier conference papers.