Job Description:
This role exists to provide data solutions to analytical and operational problems by transforming data, automating data ingestion, and setting up the data warehouse and data lake in order to provide the single source of truth to provide guidance on the stakeholder / business decisions. Responsible for making sure that data used by analysts for business stakeholders are relevant and actionable. The role is active in mentoring junior members of the team and stakeholders to ensure success and efficiency. The role is also proactive in designing the data and analytics strategy to make sure it is actionable and aligned in the business operations and strategic plans.
Key Responsibilities
Maintain efficient data infrastructure including data warehouse and data lake implementation Data warehouse should be able to process all ETLs with minimum downtime Data lake should be able ingest relevant data without impacting data source performance Ingest relevant data from internal and external sources Create data solutions such as data integrations and automated jobs Create streamlined jobs to speed up data processing and optimize data pipeline
Job Requirements:
Graduate of any STEM or business bachelor’s degree Has at least 3 to 5 years of data engineering experience and 2 to 4 years of people management experience Can create data models using Python, Scala, or R Experience in utilizing Pandas or Numpy (or any equivalent is a plus) Can setup data pipeline using Airflow (or any equivalent) Experience in implementing the data engineering architecture in a cloud environment such as Amazon Web Services or Google Cloud Services Can manage stakeholders in setting up timelines and proposing data solutions Strong analytical skills with the ability to collect, organize, and analyze big data and present to stakeholders Problem-solving and critical thinking mindset Detail-oriented with strong ability to multi-task Ability to work with a team and independently Ability to lead a team to achieving business goals Develop team members’ capabilities and drive them to their full potential
