Azure Data Engineers

Azure Data Engineers (Europe) · £450 - £550 per day · 12 month FTC · Fully Remote · Europe based

Coltech Global is currently partnered with one of Europe’s largest technology businesses working on a high-profile Azure Data Program.

We are currently looking for multiple Azure Data Engineers to join on a 12-month fully remote freelance project.

Responsibilities

• Develop and maintain data pipelines, ETL processes, and data integration workflows using Azure Data Factory, Azure Databricks, or other relevant tools.
• Design and optimize data storage and retrieval systems, leveraging Azure data services such as Azure Data Lake Storage, Azure SQL Database, and Azure Cosmos DB.
• Collaborate with cross-functional teams, including data scientists, business analysts, and developers, to understand data requirements and provide technical expertise in data solution design and implementation.
• Ensure data quality, integrity, and security across all stages of data processing, implementing appropriate data validation, encryption, and access controls.
• Monitor and troubleshoot data pipelines and data workflows, proactively identifying and resolving any performance issues or bottlenecks to ensure optimal data processing and availability.

Requirements

• Vast experience working with Azure Databricks Platforms
• Azure Data Lake experience
• Must have previously worked on Big Data Platforms
• Kubernetes
• Strong hands-on experience with Azure
• Have previously worked with CI/CD Pipelines