Listing Governance Program Manager Graduate – Prompt Engineering

Job Description

AI Agent Development Project Intern (TikTok Shop Governance and Experience) | TikTok

The Tone:
This is an internship at TikTok, likely located in Los Angeles, California. TikTok is the leading destination for short-form mobile video, inspiring creativity and bringing joy to users globally. This role is crucial within the Global E-commerce Governance and Experience team, contributing to policies and systems that maintain a safe and trustworthy marketplace. The intern will focus on developing and optimizing AI models for regulatory compliance, directly impacting the platform’s quality and sustainability.

The TL;DR
• Role: Internship
• Type: Temporary, 6+ months
• Location: In-person, Los Angeles, CA
• Pay: $23.75 hourly
• Team: Global E-commerce Governance and Experience (GNE) team, collaborating with Listing Governance, Program Managers, Compliance SMEs, and AI/ML teams.
• Mission: Support the development and optimization of Prompt Engineering (PE) models for regulatory compliance and prohibited product programs.
• Tech Stack: Excel, SQL

What You’ll Actually Do
• Prompt Design & Refinement: Collaborate with Subject Matter Experts (SMEs) to design, test, and refine prompts for AI models used in compliance decision-making.
• AI Output Evaluation: Evaluate the quality of AI model outputs against defined accuracy metrics and identify prompt overkill/leakage issues.
• Compliance Program Support: Assist with the classification and verification of products for various compliance programs (e.g., Prohibited products, DG, EPA), performing sample audits as needed.
• Data Analysis & Documentation: Analyze compliance data to identify trends, gaps, and misclassifications, then document and escalate these findings to relevant teams.
• Data Preparation & Reporting: Clean, prepare, and annotate datasets for AI model training and validation, while also creating performance dashboards and summarizing progress for leadership.

The Must-Haves
• Background: Student or recent graduate pursuing a Bachelor’s or Master’s in Computer Science, Data Science, Engineering, Business Analytics, Compliance, or a related field.
• Experience: Familiarity with AI/ML concepts, natural language processing, large language model interaction, and prompt testing.
• Skills: Strong analytical, data handling, and problem-solving skills; proficient communication and coordination abilities; practical experience with Excel and SQL.
• Bonus: Prior experience in E-commerce environments.