Data Engineer

Job Description

About the Company:

Deloitte is a leading professional services firm providing consulting, financial advisory, risk management, and tax services. Their US Delivery Centers are experiencing significant growth and are looking to hire experienced data engineers. Deloitte emphasizes a collaborative and innovative work environment, minimizing extensive travel requirements. Their commitment extends to fostering a diverse, equitable, and inclusive culture. The company’s purpose is to make an impact that matters for clients, people, and communities, focusing on sustainability, equity, and trust. They offer various professional development opportunities. Deloitte Consulting LLP is a subsidiary of Deloitte LLP.

Job Description:

This position is for a Data Engineer within Deloitte’s Artificial Intelligence & Data Engineering team. The role involves working collaboratively with a team to build and manage data systems. Key responsibilities include:

• Business Needs Analysis: Evaluating business needs and priorities, liaising with key business partners to address data system and management needs.
• Technical Specification Development: Translating business requirements into detailed technical specifications for applications, components, and enhancements.
• Project Planning and Execution: Participating in project planning, defining milestones and deliverables, tracking activities and task execution.
• Documentation: Generating design, development, and test plans; creating detailed functional specifications documents, user interface designs, and process flow charts.
• Data Pipeline Development: Developing data pipelines and APIs using Python, SQL, potentially Spark, and cloud platforms like AWS, Azure, or GCP. This includes moving data from on-premises systems to the cloud and performing cloud data conversions.
• Data Analysis: Utilizing an analytical, data-driven approach to understand fast-changing business needs.
• Large-Scale Data Pipeline Construction: Building large-scale batch and real-time data pipelines using data processing frameworks on cloud platforms.

Team:

The Artificial Intelligence & Data Engineering team leverages data, analytics, robotics, science, and cognitive technologies to generate insights and inform decision-making. They work with clients to implement large-scale data ecosystems, leverage automation and cognitive techniques, and drive operational efficiency through data ecosystem maintenance and analytics expertise.

Qualifications:

Required:

• 1+ years of experience in data engineering with a focus on data analytics and reporting.
• 1+ years of experience with at least one cloud platform (Azure, AWS, GCP).
• 1+ years of experience in SQL, data transformations, statistical analysis, and troubleshooting across multiple database platforms (Cassandra, MySQL, Snowflake, PostgreSQL, Redshift, Azure SQL Data Warehouse, Databricks, etc.).
• 1+ years of experience designing and building ETL processes and custom data pipelines.
• 1+ years of experience with scripting languages (Python, SQL, Kafka, etc.).
• 1+ years of experience designing and building solutions using various cloud services (EC2, S3, EMR, Kinesis, RDS, Redshift/Spectrum, Lambda, Glue, Athena, API gateway, etc.).
• Bachelor’s degree in Computer Science, Information Technology, Computer Engineering, or a related field, or equivalent experience.
• Legal authorization to work in the US without employer sponsorship.
• Eligibility for US Government security clearance.
• Ability to travel up to 10% (may include overnight travel).
• Must live within commuting distance (approximately 100-mile radius) of one of several specified locations.
• Willingness to co-locate in the designated Delivery location up to 30% of the time.

Preferred:

• AWS, Azure, or GCP certification.
• Master’s degree or higher.
• Expertise in Scala, PySpark, or Python.
• Experience with MapReduce or MPP systems.
• Experience with agile development methodologies (Sprint, Scrum).
• Ability to obtain the required level of security clearance.

The job posting also includes information about accommodation for applicants needing it and a requisition code (202634).