As a Software Engineer on our Data Infrastructure & Acquisition team, you will be responsible for designing, building, and maintaining scalable data infrastructure and acquisition systems. You will work closely with cross-functional teams to develop and implement data pipelines, data warehousing, and data processing solutions. You will also be responsible for ensuring the security, reliability, and performance of our data systems.
Key Responsibilities:
- Design and implement data pipelines and data warehousing solutions using cloud-based technologies.
- Develop and maintain scalable data processing systems using Docker and containerization.
- Collaborate with cross-functional teams to develop and implement data acquisition and processing solutions.
- Ensure the security, reliability, and performance of our data systems.
- Develop and maintain documentation for data systems and processes.
Requirements:
- 5+ years of experience in software engineering with a focus on data infrastructure and acquisition.
- Proficiency in Python, Bash, and cloud-based technologies such as Google Cloud.
- Experience with data processing and warehousing solutions.
- Strong understanding of containerization and Docker.
- Excellent communication and collaboration skills.