As a Senior Data Engineer, Reporting & Analytics at drata, you will be responsible for designing, developing, and maintaining large-scale data pipelines and reporting systems that provide data-driven insights to the business. You will work closely with cross-functional teams to understand business requirements and develop solutions that meet their needs. You will also be responsible for ensuring the scalability, reliability, and performance of our data infrastructure.
Key Responsibilities:
- Design and develop large-scale data pipelines using Python, Apache Spark, and Apache Hive.
- Develop and maintain reporting systems using Tableau and other data visualization tools.
- Collaborate with cross-functional teams to understand business requirements and develop solutions that meet their needs.
- Ensure the scalability, reliability, and performance of our data infrastructure.
- Develop and maintain data models and data quality checks to ensure data accuracy and integrity.
Requirements:
- 5+ years of experience in data engineering and reporting.
- Strong experience with Python, Apache Spark, and Apache Hive.
- Experience with data visualization tools such as Tableau.
- Strong understanding of data modeling and data quality checks.
- Experience with cloud-based data infrastructure, preferably AWS.