Data Engineer

Data Engineer
Date
Location
Colombo, Sri Lanka
Department
Information Technology
Type
Full Time

 Key Responsibilities:
 

  • Design, build, and maintain robust, scalable, and efficient data pipelines supporting analytics, reporting, and operational requirements
  • Design, develop, and maintain data integration solutions using Microsoft Fabric and Microsoft Azure
  • Develop and maintain data models, data warehouses, and data lake architectures to ensure data is accurate, consistent, and accessible
  • Collaborate with Data Analysts, Functional teams, and Engineering teams to understand data requirements and deliver reliable solutions
  • Implement data quality checks, monitoring, and alerting to proactively identify and resolve pipeline and data issues
  • Optimise existing data infrastructure for performance, cost efficiency, and scalability
  • Establish and enforce data engineering best practices, including coding standards, version control, testing, and documentation
  • Evaluate and recommend new tools, frameworks, and technologies to improve the data platform
  • Ensure compliance with data governance, security, and privacy standards and policies
  • Participate in incident response for critical data pipeline issues as required


Qualifications:
 

  • Bachelor's degree in Computer Science, Software Engineering, Information Technology, Information Systems, or a related discipline, or equivalent practical experience
  • Minimum 4 years of experience in Data Engineering, Software Engineering, or a related technical field, with a proven track record of designing, developing, and maintaining data solutions
  • Strong proficiency in SQL and at least one programming language commonly used for data engineering, such as Python, Scala, Shell, or XSLT
  • Hands-on experience with Microsoft Azure data services and Microsoft Fabric, including the design, development, and management of cloud-based data solutions
  • Strong experience designing, developing, and supporting ETL/ELT pipelines, with knowledge of both relational and non-relational database technologies
  • Solid understanding of data warehousing principles, dimensional data modelling, data integration, and workflow orchestration tools
  • Experience with Apache Spark or PySpark, REST APIs, Azure Data Factory, Azure Logic Apps, and cloud platforms such as AWS will be an added advantage
  • Experience with code management and CI/CD tools such as GitHub or GitLab
  • Strong analytical, troubleshooting, and problem-solving skills, with a strong focus on data quality, accuracy, and performance
  • Demonstrated understanding of coding standards, secure development practices, Agile methodologies, and DevSecOps principles
  • Excellent written and verbal communication skills, with the ability to communicate technical concepts effectively to both technical and non-technical stakeholders


Application: Send your résumé to careers@efl.global with the contact information of two non-related references. Please mention the job title in the subject line of your email.