Key Responsibilities
- Design and maintain scalable data pipelines and ETL processes
- Optimize data storage and retrieval for performance
- Develop and deploy data models for analytics and reporting
- Ensure data integrity, security, and compliance
- Collaborate with data scientists to enable ML workflows
- Monitor and troubleshoot data infrastructure issues
Requirements
- 5+ years of experience in data engineering
- Proficiency in Python, SQL, and big data tools (Spark, Hadoop)
- Experience with cloud data platforms (AWS/GCP)
- Strong understanding of data warehousing and modeling
- Familiarity with CI/CD and infrastructure as code