We are looking for an energetic, high-performing, and highly skilled Big Data + GCP Engineer with strong expertise in Google Cloud Platform (GCP), Big Data technologies, GKE, and FastAPI. The ideal candidate should have hands-on experience in designing, developing, and deploying scalable cloud-native applications using Java, PySpark, and modern data engineering technologies.
The candidate must possess strong experience in Big Data processing, cloud infrastructure, containerized deployments, API development, and database optimization. Exposure to Kubernetes-based deployments and modern microservices architecture is highly preferred.
Design, develop, and deploy scalable applications on Google Cloud Platform (GCP).
Develop robust and high-performance data processing pipelines using PySpark and Big Data technologies.
Build and maintain RESTful APIs and microservices using FastAPI.
Work with large-scale distributed data processing frameworks such as Spark, Hive, MapReduce, and HBase.
Deploy and manage containerized applications using Google Kubernetes Engine (GKE).
Develop cloud-native solutions using GCP services such as Compute Engine, App Engine, Cloud Functions, BigQuery, Cloud SQL, Dataproc, and Dataflow.
Optimize database queries, indexing strategies, and overall application performance.
Collaborate with cross-functional teams including data engineering, DevOps, and application development teams.
Perform troubleshooting, debugging, and root cause analysis for production issues.
Create reusable components, automation scripts, and deployment pipelines.
Ensure best practices in scalability, security, reliability, and maintainability.
6+ years of overall IT experience.
Strong hands-on experience with Google Cloud Platform (GCP).
Strong programming expertise in Java 8+ and PySpark.
Hands-on experience in Big Data technologies:
Apache Spark
Hive
MapReduce
HBase
Strong experience with FastAPI development.
Hands-on experience with Google Kubernetes Engine (GKE).
Strong understanding of distributed data processing and cloud architecture.
Experience with GCP services:
Compute Engine
App Engine
Cloud Functions
BigQuery
Cloud SQL
Dataproc
Dataflow
Experience in UNIX, Shell scripting, Python, or Perl scripting.
Strong knowledge of relational databases such as PostgreSQL, MySQL, or DB2.
Experience in query optimization and database indexing.
Good understanding of CI/CD and containerization concepts.
Strong analytical, problem-solving, and debugging skills.
Bachelor’s or Master’s degree in Computer Science, Information Technology, or related field.
At Whitefield Careers, we connect top talent with leading companies across diverse industries. Our team is dedicated to understanding your skills, career goals, and aspirations to match you with the perfect opportunity. Whether you’re looking for a new challenge, seeking to advance in your current field, or exploring a career change, our wide range of job openings cater to all levels and sectors. From entry-level roles to senior positions, we work with prestigious employers to offer you the most exciting opportunities. Browse our current openings, apply directly, or submit your resume to be considered for future roles.
Your dream job is just a click away—let’s make it happen!
Follow us on LinkedIn to stay updated on recent openings – https://www.linkedin.com/company/whitefield-careers/