Industry: IT / Technology Locations: Hyderabad | Bengaluru | Pune Experience: Relevant experience in Data Engineering Key Skills: Apache Airflow, DBT, Python, SQL
We are looking for a skilled and motivated Senior Data Engineer to design, develop, implement, and maintain scalable data pipelines and ETL processes. The ideal candidate will have strong expertise in Python, Apache Airflow, DBT, and SQL, along with a solid understanding of data engineering concepts.
The role involves working closely with data scientists, analysts, and cross-functional stakeholders to ensure data quality, reliability, accessibility, and efficient data processing for analytics and reporting.
Design, develop, and maintain robust, scalable, and efficient data pipelines.
Build and manage ETL/ELT workflows to process large datasets.
Develop and maintain data workflows using Apache Airflow.
Create and manage data transformation models using DBT.
Write optimized SQL queries for data extraction, transformation, and analysis.
Use Python for data processing, automation, and pipeline development.
Monitor, troubleshoot, and optimize data pipelines to ensure reliability and performance.
Implement data quality checks, validations, and monitoring mechanisms.
Collaborate with data scientists, analysts, and business stakeholders to understand data requirements.
Work on data modeling, data warehousing, and database integration.
Maintain technical documentation for data pipelines, workflows, and architectures.
Follow industry best practices for data engineering, scalability, and data governance.
Strong hands-on experience with Python for data processing and automation.
Good experience with Apache Airflow for workflow orchestration and pipeline scheduling.
Hands-on experience with DBT for data transformation and modeling.
Strong proficiency in SQL and relational databases such as PostgreSQL and MySQL.
Understanding of ETL/ELT processes and data pipeline architecture.
Knowledge of data modeling and data warehousing concepts.
Familiarity with cloud platforms such as AWS, Azure, or GCP.
Strong analytical, debugging, and problem-solving abilities.
Good communication and collaboration skills.
Bachelor's or Master's degree in Computer Science, Data Engineering, Information Technology, or a related field.
Experience with big data technologies such as Apache Spark or Hadoop.
Familiarity with data visualization tools such as Tableau or Looker.
Experience working in Agile and fast-paced development environments.
Understanding of data quality, governance, and performance optimization practices.
Apache Airflow
DBT
Python
SQL
Overall Technical Fitment
We are one of the fastest growing Staffing & Recruitment Services in India. We specialize in Recruitment, Staffing, Payroll, Digital Marketing, and Management services across a wide range of industries. Our mission is to help our clients and aspirants flourish in an ever-changing work environment.
We believe that the power of association is a critical component of inclusive and organic growth. Boolean Staffing & Recruitment Solutions offers a variety of services to both businesses and candidates.
It is our ongoing goal to develop high-impact solutions that improve the competitiveness of the organizations and individuals we serve. Every year, Boolean provides services that help businesses flourish in a fast-changing, uncertain world of work and connect people to meaningful employment opportunities. We provide solutions that are tailored to your specific company requirements.
Contact us at the Booleans office nearest to you or submit a business inquiry online.
We are the driving force behind the transformation of the world of work and employment. We are able to provide completely integrated workforce solutions that will support your organization’s development and growth plan due to our breadth and depth of experience gathered on the global stage. As a result, you are not merely prepared for the future.