Data Engineer

MY | FULL TIME

Share Job via:

Date: May 19, 2022 3:50:30 AM UTC
Company: Synagie
City: Selangor, Malaysia
Country: MY

Description:

Responsibilities – What You’ll Do

  1. Developing and maintaining the data pipelines and data platform to ensure consistency across data.
  2. Work closely with the Data Engineering, Data Products team on improving the product to better enhance the investment decision and processes.
  3. Design and develop APIs for 3rd party data into existing database.
  4. Look at daily operational data CI/CD to ensure the standards of stable data.
  5. Troubleshoot of the production system, assist, and implement the necessary mechanisms and tools to ensure the stability of the overall operation of the production system.

Qualifications – What You Should Have

  1. Familiar with Cloud solutions and services like AWS EC2, AWS S3, Databricks, Snowflake.
  2. Familiar with Python, R, NoSQL, SQL and other programming languages.
  3. Knowledge of Job Orchestration solutions like Apache Airflow, Control M, AWS Step Functions.
  4. Knowledge of database technologies like AWS Redshift, Snowflake, MongoDB and its basic administration.
  5. Experience with various data formats and ingestions procedures for Excel files, CSV, JSON, etc.
  6. Strong coding and trouble shooting ability.
  7. Willing to challenge questions that have no obvious answers and have a strong enthusiasm for learning new technologies.
  8. Min 3 years of experience in enterprise databases, data modeling, and data integration.

Going beyond – Good to Have

  1. Experience with administration of git repositories.
  2. Experience with Beautiful Soup, Scrapy, Selenium and other web automation tools.
  3. Data migration experience. (Data collection, transformation and destination audit)
  4. Experience with cloud providers other than AWS and Azure.
  5. Experience with building offline/private Docker and Kubernetes infrastructure.

Experience: 3 Year

Apply For This Job


    Top