PhD Intern – AI Machine Perception

Job Description

AI Vision Research Scientist Intern – Global Frontier Tech Recruitment Program – 2027 Start (PHD) | ByteDance

The Tone:
This is an internship at ByteDance, located in Los Angeles County, CA. ByteDance is a global technology company that builds innovative products, fostering creativity and connection for communities worldwide. This role is crucial for developing the next generation of intelligent hardware that acts as a bridge between AI Agents, the physical world, and users, enabling round-the-clock environmental awareness and real-time user intent recognition.

The TL;DR
• Role: Internship
• Location: In-person, Los Angeles County, CA
• Pay: $60 hourly
• Team: EE Platform team, focusing on silicon and EE architecture for AR/VR platforms.
• Mission: To enable intelligent hardware to better connect AI, users, and daily life by overcoming limitations of conventional visual perception systems.
• Tech Stack: C/C++, MATLAB, Python, ML frameworks

What You’ll Actually Do
• Innovation: Innovate and develop a power-efficient, low-latency, highly-intelligent all-day machine perception vision system.
• Algorithm Development: Develop necessary training, data collection/generation pipelines along with state-of-the-art ML algorithms and frameworks for understanding scenes and user behaviors.
• Hardware Co-design: Map cutting-edge ML algorithms to hardware accelerators, identify performance bottlenecks, optimize performance and efficiency, and propose more efficient hardware/software co-designs for AI accelerators.
• Collaboration: Collaborate with cross-functional teams to translate system requirements into proper cloud-edge workload partitions and edge ML accelerator hardware/software requirements.
• Evaluation: Perform quantitative evaluations through the use of system modeling and influence sensor, system-on-chip (SoC), and software co-design.

The Must-Haves
• Background: Currently pursuing a PhD in Electrical Engineering, Computer Science, Physics, or a related technical discipline.
• Experience: Research experience in computer vision, edge ML perception algorithms, and/or related AI accelerator design.
• Skills: Proficiency with programming tools and languages such as C/C++, MATLAB, and Python.
• Bonus: Familiarity with appropriate ML frameworks and model deployment, experience with image sensors and Image Signal Processors (ISP), and a good track record of publications in top-tier conferences or journals.