PhD Intern, AI Agents & Perception (EE Platform) – AI Agents & Perception

Job Description

AI Vision Research Scientist Intern – Global Frontier Tech Recruitment Program – 2027 Start (PHD) | ByteDance

The Tone:
This is a PhD internship at ByteDance, with compensation information specifically noting Los Angeles County for certain candidates, but no universal location is specified for the role itself. ByteDance is a company that develops immersive and interactive VR experiences and cutting-edge AR/VR platforms, focusing on customized silicon solutions. This role is crucial for advancing intelligent hardware that bridges AI Agents with the physical world, enabling them to perceive environments and understand user intent. It focuses on pushing the boundaries of conventional visual perception systems through full-stack innovation.

The TL;DR
• Role: Internship
• Type: Temporary
• Location: Unspecified (Los Angeles County mentioned for specific legal considerations)
• Pay: $60 hourly
• Team: EE Platform team, focusing on silicon and EE architecture for AR/VR platforms
• Mission: Develop next-generation intelligent hardware to enhance AI Agents’ real-time environmental awareness and user intent recognition by innovating sensing and computing.
• Tech Stack: C/C++, MATLAB, Python, ML frameworks

What You’ll Actually Do
• Innovation: Innovate and develop a power-efficient, low-latency, highly-intelligent all-day machine perception vision system.
• Algorithm Development: Develop necessary training, data collection/generation pipelines along with state-of-the-art ML algorithms and frameworks for understanding scenes and user behaviors.
• Hardware Optimization: Map cutting-edge ML algorithms to hardware accelerators, identify performance bottlenecks, optimize performance and efficiency, and propose more efficient HW/SW co-designs for AI accelerators.
• System Collaboration: Collaborate with cross-functional teams and translate system requirements into proper cloud-edge workload partitions and edge ML accelerator HW/SW requirements.
• Quantitative Evaluation: Perform quantitative evaluations through the use of system modeling and influence sensor, SoC, and software co-design.

The Must-Haves
• Background: Doctorate Degree (Ph.D.) candidate in Electrical Engineering, Computer Science, Physics, or a related technical discipline.
• Experience: Research experience in the fields of computer vision, edge ML perception algorithms, and/or related AI accelerator design.
• Skills: Programming proficiency in C/C++, MATLAB, and Python.
• Bonus: Familiarity with appropriate ML frameworks and model deployment, familiar with image sensors and ISP, and a good track record of publications in top-tier conferences or journals.