Key Responsibilities
- Design, build, and maintain scalable data pipelines and ETL processes
- Develop and optimize data warehousing solutions for analytics
- Ensure data integrity, security, and compliance with standards
- Collaborate with data scientists and analysts to support business insights
- Monitor and troubleshoot data pipeline performance and reliability
- Document data models, schemas, and pipeline architectures
Requirements
- 4+ years of experience in data engineering with Python and SQL
- Experience with ETL pipelines, data warehousing, and big data technologies
- Familiarity with tools like Airflow, Spark, or Hadoop
- Strong problem-solving skills with a focus on data quality and performance
- Ability to work in cross-functional teams and communicate technical concepts