Junior Data Engineer

Job Description

Junior Data Engineer | Not Specified

The Tone:
This is an early career role at Not Specified. This position supports the development and maintenance of robust data infrastructure. The role is crucial for ensuring efficient data collection, processing, and storage, focusing on building reliable data pipelines. It also ensures high-quality, accessible data for analytical insights and operational efficiency.

The TL;DR
• Role: Early Career
• Mission: Ensure efficient data collection, processing, and storage through robust data infrastructure.
• Tech Stack: Python, SQL, PostgreSQL, MySQL, AWS, Azure, GCP, Apache Airflow, Prefect, Dagster

What You’ll Actually Do
• Data Pipeline Development: Assist in the design and implementation of ETL/ELT pipelines to move and transform data.
• Data Integration: Integrate data from various sources like APIs, databases, and files into centralized data systems.
• Database Management: Support the management and optimization of databases and data warehouses.
• Performance Monitoring & Troubleshooting: Monitor data pipeline performance, proactively troubleshoot issues, and optimize processes for efficiency and reliability.
• Documentation: Maintain thorough documentation for data processes, systems, and pipelines, ensuring clarity and maintainability.

The Must-Haves
• Background: Bachelor Degree in Computer Science, Information Technology, Engineering, or a closely related technical field; Early Career.
• Experience: Entry-level; relevant coursework, personal projects, or internships demonstrating proficiency in data engineering concepts are highly valued.
• Skills: Foundational understanding of Python and SQL for scripting, data manipulation, and database management; familiarity with database systems and data modeling principles; strong analytical thinking and problem-solving skills; proven capability to collaborate effectively and communicate technical concepts clearly.
• Bonus: Exposure to cloud platforms (AWS, Azure, GCP) and their data services; experience with data pipeline tools and workflow orchestration frameworks (e.g., Apache Airflow, Prefect, Dagster).