Description
Job Description:
We are seeking a skilled Data Engineer (Data Developer) to join our team. The ideal candidate will be responsible for designing, developing, and maintaining our data pipelines and systems, with a focus on using Redshift, Kinesis, SQL, and Python. You will work closely with data scientists and analysts to ensure data integrity and accessibility.
Responsibilities:
- Design, build, and maintain scalable data pipelines using Redshift and Kinesis.
- Writing complex SQL queries
- Develop and optimize ETL processes.
- Ensure data quality and integrity.
- Collaborate with data scientists and analysts to support their data needs.
- Implement and manage data storage solutions.
- Apache airflow and pulsar is a plus
Qualifications:
- Bachelor’s degree in Computer Science, Engineering, or a related field.
- Proven experience as a Data Engineer or in a similar role.
- Proficiency in SQL and Python.
- Experience with Redshift and Kinesis.
- Strong problem-solving skills and attention to detail.