Job Description:
We are looking for an Experienced Data Engineer to help us leverage our data to benefit Consumers and also SMEs.
Responsibilities: Design, implement and manage end to end data pipelines. Enabling us to uncover actionable insights and opportunities and make data-informed decisions. Be accountable for data integrity and quality, ensuring it is continuously maintained and improved. Collaborate and coordinate with other departments (and/or other parties) to solve their use cases using data technology. Explore/learn new technologies that can complement or replace our current stack to improve it. Write automated job for data related tasks Minimum Qualifications:
Requirements: Minimum 3 years experience in Data Engineering Team player with good communication skill Bachelor's degree in computer/engineering/science-related field Passionate working with data, and learning new technologies in the Big data landscape. Familiarity with Cloud infrastructure (e.g. AWS EC2, S3 or others) Familiarity with Java, Python, or equivalent Familiarity with Selenium and/or other testing frameworks Advanced SQL knowledge and experience working with relational SQL (MySQL) and NoSQL databases (MongoDB) Able to clearly articulate pros and cons of different technologies, solutions and platforms Able to plan and schedule work in cooperation with Product team Strong analytical skills related to working with unstructured datasets Ability to manipulate, process, and extract from large disconnected datasets Familiarity with big data processing tools (e.g. Hadoop, Spark, Kafka, etc) is a plus Familiarity with building data pipelines is also a plus