DataOps Engineer (ETL)

Experience : 3-4 years

3 Yrs relevant

ETL : ADF, Databricks, GitHub, Azure DevOps, SQL, Python

Need to have knowledge on Data Warehouse, ETL/ELT, Cloud, Data Flow, Lakehouse, Agile, Big Data, Spark, Semantic Layer, Security, DataViz

Looking for candidates with operational experience NOT support experience.

Immediate joiners, already serving notice period with a confirmed LWD within the next 30 days.

Scope

Responsible for designing, developing and deploying ETL processes, work with petabytes of data through our big data platform and enable BI and data science initiatives.

Responsibilities

• Be autonomy to develop ETL processes and use CI/CD and help other team members to develop their jobs;
• Create reusable structures or processes that can be used in different projects, developing code to automate jobs using real-time services to remove dependencies;
• Create process and dataflow documentation;
• Act as level 3 in the support and quality of processes, identifying root causes for the L3 tickets;
• Work on data service transformations and Data Quality using SQL: analyzing redundant and inconsistent data;
• Work in Agile methodology, participating in ceremonies during the sprint;
• Align the deliverables and deadlines with the teams involved in the project, analyzing the impacts that team and project can have
• Participate Data Engineering OKR process, define actions and keep them up to date
• Share the knowledge between BrewDat team (India and Zones).
• Work with reusable structures or processes that can be used in different project.
• Develop code to automate jobs using real-time services and parameterized coding to remove dependencies.

Required Knowledge

Concepts

Technical

Data Warehouse, ETL/ELT, Cloud, Data Flow, Lakehouse, Agile, Big Data, Spark, Semantic Layer, Security, DataViz

ADF, Databricks, GitHub, DevOps,SQL, Python, PBI

Soft Skills

Curiosity; Logical/Critical thinking; Communication; Resilience; Collaboration