PhD Intern – AI Agents & Machine Perception

Job Description

AI Vision Research Scientist Intern – Global Frontier Tech Recruitment Program – 2027 Start (PHD) | ByteDance

The Tone:
This is a PhD internship at ByteDance. The company is dedicated to inspiring creativity and enriching life, developing innovative products to help people express themselves, discover, and connect. This role is crucial for linking AI Agents to the physical world and end-users, enabling them to perceive environments and understand user intent. The work involves overcoming limitations of conventional visual perception systems through full-stack innovation, from hardware to algorithms, to unlock next-generation intelligent hardware.

The TL;DR
• Role: Internship
• Pay: $60 hourly
• Team: EE Platform team, focusing on silicon and EE architecture for AR/VR platforms to optimize system power, latency, and performance.
• Mission: Innovate full-stack solutions for intelligent hardware to enable AI Agents to maintain round-the-clock environmental awareness and efficiently capture real-time user intentions.
• Tech Stack: C/C++, MATLAB, Python

What You’ll Actually Do
• System Innovation: Innovate and develop a power-efficient, low-latency, highly-intelligent all-day machine perception vision system.
• Algorithm Development: Develop necessary training, data collection/generation pipelines along with state-of-the-art ML algorithms and frameworks for understanding scenes and user behaviors.
• Hardware/Software Co-design: Map cutting-edge ML algorithms to hardware accelerators, identify performance bottlenecks, optimize performance and efficiency, and propose more efficient hardware/software co-designs for AI accelerators.
• Cross-functional Collaboration: Collaborate with cross-functional teams to translate system requirements into a proper cloud-edge workload partition and edge ML accelerator hardware/software requirements.
• Quantitative Evaluation: Perform quantitative evaluations through the use of system modeling and influence sensor, SoC, and software co-design.

The Must-Haves
• Background: Currently pursuing a PhD in Electrical Engineering, Computer Science, Physics, or related technical disciplines.
• Experience: Research experience in computer vision, edge ML perception algorithms, and/or related AI accelerator design.
• Skills: Experience with programming tools and languages such as C/C++, MATLAB, Python.
• Bonus: Familiarity with appropriate ML frameworks and model deployment, familiarity with image sensors and ISPs, and a good track record on top-tier conference or journal publications.