Job Description:
We are looking for a skilled Big Data Engineer to join our team. The ideal candidate will be responsible for designing, implementing, and maintaining Big Data solutions using technologies such as Azure, Data Lake, Kinesis, Kafka, Nifi, AWS EMR, Snowflake, Hadoop, Hive, HBase, Cassandra, PySpark, Flume, and more. The role involves working with large datasets, optimizing data pipelines, and ensuring data quality and reliability.
Responsibilities:
- Design and develop Big Data solutions using various technologies.
- Optimize data pipelines for performance and scalability.
- Ensure data quality and reliability in Big Data systems.
- Collaborate with cross-functional teams to integrate data analytics solutions.
- Monitor and troubleshoot Big Data applications to ensure smooth operation.
Qualifications:
- Bachelor's degree in Computer Science, Engineering, or related field.
- Proven experience in designing and implementing Big Data solutions.
- Strong understanding of Big Data technologies such as Hadoop, Hive, Spark, and more.
- Experience with cloud platforms like Azure and AWS.
- Excellent problem-solving and analytical skills.
- Good communication and teamwork abilities.