As a Principal Specialist, Senior Data Engineer, you will be responsible for designing, developing, and implementing large-scale data processing systems. You will work closely with cross-functional teams to architect and implement data pipelines, data warehouses, and data lakes. You will also be responsible for ensuring data quality, security, and compliance with company standards. The ideal candidate will have experience with cloud-based technologies, particularly AWS, and a strong understanding of data engineering principles and practices.
Key Responsibilities:
- Design and develop large-scale data processing systems using cloud-based technologies.
- Collaborate with cross-functional teams to architect and implement data pipelines, data warehouses, and data lakes.
- Ensure data quality, security, and compliance with company standards.
- Develop and maintain data engineering best practices and standards.
- Provide technical guidance and mentorship to junior engineers.
Requirements:
- 8+ years of experience in data engineering with a focus on cloud-based technologies.
- Strong understanding of data engineering principles and practices.
- Experience with AWS, including AWS Lambda, S3, and Glue.
- Experience with Apache Kafka and Apache Spark.
- Strong programming skills in Python.