Data Engineer

Roles and Responsibilities:

• Perform various activities including requirements gathering, solution development and the project implementation throughout the phases of Agile methodology
• ELT Engineer / Developer will be responsible for the design, implementation and maintenance of a ELT process to support Cloud Enterprise Data Warehouse (CEDW) and data platform. This includes using cloud-based technologies, establishing best practices and procedures for ETL development, implementing ETL processes
• Design, Feature, Test Case, Test Completion report documentation
• The ETL Developer will collaborate with the Systems and Operations teams on a day-to-day basis and receive technical guidance from the DSO Manager or Lead Delivery Engineer
• Peer Reviews and System testing
• Demo the solution to various stakeholders (technical and non-technical)
• Deploying the solution using CI/CD pipelines
• Leverage standard toolset and develop ETL/ELT code to move data from various internal and external sources into the analytics platform
• Participate in agile ceremonies

Skills and Experience Required:

• Hands on experience in Large Data Warehouse projects (at least 3+ years)
• Strong ELT/ ETL designer/developer experience (5+ years)
• Ability to select and implement the appropriate ETL or ELT techniques
• Data modelling experience (3NF and Dimension modelling)
• Strong SQL & Python Expert level (5+ years)
• Performance tuning with SQL
• Cloud environment development & operations experience (AWS)

Preference for candidates experienced with:

• Airflow (scheduler), git, AWS Redshift, Teradata, DataStage, IWS