Data Engineer
Date
Location
Colombo, Sri Lanka
Department
Information Technology
Type
Full Time
Key Responsibilities:
- Design, build, and maintain robust, scalable, and efficient data pipelines supporting analytics, reporting, and operational requirements
- Design, develop, and maintain data integration solutions using Microsoft Fabric and Microsoft Azure
- Develop and maintain data models, data warehouses, and data lake architectures to ensure data is accurate, consistent, and accessible
- Collaborate with Data Analysts, Functional teams, and Engineering teams to understand data requirements and deliver reliable solutions
- Implement data quality checks, monitoring, and alerting to proactively identify and resolve pipeline and data issues
- Optimise existing data infrastructure for performance, cost efficiency, and scalability
- Establish and enforce data engineering best practices, including coding standards, version control, testing, and documentation
- Evaluate and recommend new tools, frameworks, and technologies to improve the data platform
- Ensure compliance with data governance, security, and privacy standards and policies
- Participate in incident response for critical data pipeline issues as required
Qualifications:
- Bachelor's degree in Computer Science, Software Engineering, Information Technology, Information Systems, or a related discipline, or equivalent practical experience
- Minimum 4 years of experience in Data Engineering, Software Engineering, or a related technical field, with a proven track record of designing, developing, and maintaining data solutions
- Strong proficiency in SQL and at least one programming language commonly used for data engineering, such as Python, Scala, Shell, or XSLT
- Hands-on experience with Microsoft Azure data services and Microsoft Fabric, including the design, development, and management of cloud-based data solutions
- Strong experience designing, developing, and supporting ETL/ELT pipelines, with knowledge of both relational and non-relational database technologies
- Solid understanding of data warehousing principles, dimensional data modelling, data integration, and workflow orchestration tools
- Experience with Apache Spark or PySpark, REST APIs, Azure Data Factory, Azure Logic Apps, and cloud platforms such as AWS will be an added advantage
- Experience with code management and CI/CD tools such as GitHub or GitLab
- Strong analytical, troubleshooting, and problem-solving skills, with a strong focus on data quality, accuracy, and performance
- Demonstrated understanding of coding standards, secure development practices, Agile methodologies, and DevSecOps principles
- Excellent written and verbal communication skills, with the ability to communicate technical concepts effectively to both technical and non-technical stakeholders
Application: Send your résumé to careers@efl.global with the contact information of two non-related references. Please mention the job title in the subject line of your email.