Azure Data Engineer

Role Description:
Azure Data Platform Architecture Design and architect Azure data platforms using services such as Azure Data Factory (ADF) Azure Databricks Azure Synapse Analytics (Serverless Dedicated) Azure Data Lake Storage (ADLS Gen2) Azure SQL Cosmos DB (as applicable) Define data ingestion, transformation, and serving patterns for batch and near Realtime workloads.
Ensure scalable, high-performance architectures for large volume data processing.
Azure Infrastructure Design and Implementation Design, deploy, and manage Azure-based infrastructure solutions, including IaaS, PaaS, and hybrid cloud environments.
Design Azure networking (VNets, Subnets, Private Endpoints, NSGs) to securely host data platforms.
Implement high availability, disaster recovery, and resiliency patterns for data services.
Utilize Terraform to automate infrastructure provisioning and management.
Data Management and Integration Design and implement data pipelines and workflows using Azure services like Synapse Analytics, Data Factory, and Event Hubs.
Implement and manage Azure data storage solutions, including Azure Blob Storage, Azure Data Lake Storage, and Azure SQL Database.
Ensure data security, compliance, and governance within the Azure environment.
Terraform Proficiency Develop and maintain Terraform modules for infrastructure automation, including IaC (Infrastructure as Code) deployments and resource management.
Utilize Terraform for cloud deployments, resource management, and infrastructure-as-code methodologies.
Collaborate with development and operations teams to integrate Terraform into CICD pipelines.
Collaboration and Communication Collaborate with cross-functional teams, including developers, operations, and security, to ensure alignment and successful deployment of infrastructure solutions.
Document infrastructure designs and configurations, including Terraform modules and code.
Communicate complex technical concepts effectively to both technical and non-technical audiences.
Performance and Optimization Monitor and optimize the performance and cost-effectiveness of Azure infrastructure.
Identify and implement cost-saving measures and optimize resource utilization.
Ensure the security, reliability, and availability of Azure-based systems and applications.

Required Skills and Qualifications:
Mandatory Skills Strong hands-on experience as an Azure Data Platform Architect.
Deep expertise in Azure Data Factory Azure Databricks Azure Synapse Analytics ADLS Gen2 Strong Azure Infrastructure architecture knowledge (networking, security, HADR).
Proficiency in Terraform (Infrastructure as Code) for Azure.
Experience with Azure DevOps CICD pipelines.

Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.