Manager - Data Engineering

Job Summary:

Responsibilities:

• Design and implement scalable data pipelines across the medallion architecture on Corporate datawarehouse & datamarts
• Build and maintain data models that accurately reflect business domains — dimensional, normalized, or hybrid
• Engage directly with business stakeholders to gather requirements, understand business needs, and translate them into data structures and pipeline logic
• Develop and maintain the ingestion framework using Python and PySpark; integrate with source systems via ADF or custom connectors
• Manage Unity Catalog governance: naming conventions, access control, lineage, and schema management
• Set up and maintain CI/CD pipelines using Azure DevOps (Repos + Pipelines) following team branching and deployment standards
• Champion AI adoption within the team — use tools like Databricks AI/BI, MLflow, and AI coding assistants to improve productivity and build smarter solutions
• Write clean, testable, production-grade Python code; review peers' code and contribute to engineering standards
• Create and maintain technical documentation for pipelines, data models data mapping, and platform decisions

Qualifications:

• 5+ years of data engineering experience, with at least 2 years on a cloud lakehouse platform (Databricks preferred)
• Strong data modeling skills — able to design dimensional models, entity-relationship diagrams, and understand how model choices affect downstream analytics
• Comfortable running business requirement workshops and translating business logic into data pipeline specs
• Proficient in SQL, Python or PySpark — including complex query writing, window functions, and performance tuning
• Familiar with Delta Lake, Unity Catalog, and Databricks Workflows
• Experience with Azure services: ADLS Gen2, ADF, Azure DevOps, Key Vault
• Practical experience with CI/CD — branching strategy, automated testing, deployment pipelines
• Curious about and actively using AI tools in daily work — whether for code generation, documentation, data exploration, or building AI-assisted features
• Strong communication skills; able to work across technical and non-technical stakeholders
• Bachelor's degree in Computer Science, Data Engineering, or a related field
• Good command of English communication (TOEIC score 700 and above.)
• Experience with financial or operational data is a plus

Remark Per the company's policy, this position requires a criminal record information as one of the employment criterias.