Gopuff is seeking a Senior Data Engineer to join its Data Engineering team. This individual will be responsible for building the data platform that enables analytics, data science, and machine learning at scale. The ideal candidate will bring data and cloud engineering expertise and leadership to influence the team's technical direction.
Responsibilities
- Implement generalized platform solutions that process data at scale
- Develop Gopuff's data infrastructure and partner closely with the Cloud Engineering team
- Create deployment strategies processes to improve platform quality and stability
- Participate in proof of concepts and pilot new technologies that impact team architecture
- Engage in design and architectural review sessions with data engineers
- Conduct code reviews and knowledge sharing sessions across data engineering and partner teams
Requirements
- 5-8 years of experience in a Data Engineering or Cloud Engineering role
- Experience deploying open-source data tools in a production environment such as Apache Spark, Kafka, etc
- Experience deploying applications and service to Kubernetes and using related tools in the Kubernetes ecosystem (i.e. Helm, ArgoCD, Istio)
- Experience implementing DevOps best practices within the data platform, including solutions for CI/CD, data observability, monitoring, and lineage
- Experience with Infrastructure as code tools such as Terraform
- Experience with data warehouses, data lakes, and their underlying infrastructure
- Experience with cloud computing platforms such as Azure, AWS
- Proficiency in Python, SQL, RESTful API development
- Experience building batch data pipelines using DAG-based tools such as Dagster or
