Key Responsibilities
- Design, build, and maintain data pipelines and ETL processes
- Develop and optimize data storage solutions (data warehouses, lakes)
- Ensure data integrity, quality, and security
- Collaborate with data scientists and analysts to enable insights
- Monitor and troubleshoot data infrastructure issues
- Implement best practices for data governance and compliance
Requirements
- 5+ years of experience in data engineering
- Proficiency in SQL, Python, and big data technologies (Spark, Hadoop)
- Experience with data warehousing solutions (Snowflake, Redshift)
- Knowledge of cloud platforms (AWS, Azure, or GCP)
- Familiarity with data modeling and schema design