ADF Lead Engineer Job at Webilent, Washington DC

WXFyZTh3UkQxbDJUbXFFc2JOZ3R3VzFsc2c9PQ==
  • Webilent
  • Washington DC

Job Description

e are seeking a skilled and experienced Azure Data Engineer with a strong background in ETL, Azure Data Factory (ADF), Azure Synapse, and SQL Server. The ideal candidate will have hands-on expertise in data integration, migration, and transformation using Microsoft Azure services, with strong experience in Azure Functions, Logic Apps, and advanced SQL/PLSQL development.

Key Responsibilities:

  • Design, develop, and maintain scalable data pipelines using Azure Data Factory and Azure Synapse.
  • Migrate data solutions to Azure using Azure Data Lake, Data Lake Gen2, Azure SQL Pools, and Databricks.
  • Develop ADF pipelines, copy activities, and custom Azure components to ingest and transform data.
  • Write and optimize complex T-SQL and Synapse SQL queries for analytics and reporting.
  • Develop and implement PolyBase scripts to load data from Azure Data Lake to staging areas in Synapse Analytics.
  • Perform query tuning, monitoring, and database performance optimization.
  • Utilize Azure Functions and Logic Apps to orchestrate data workflows and custom automation logic.
  • Implement data modeling concepts including Star Schema and Snowflake Schema for efficient data warehousing.
  • Participate in metadata and data mart design and extension.
  • Collaborate with cross-functional teams to meet business data needs and ensure data quality and reliability.
  • Provide technical guidance and best practices related to Azure data engineering.

Required Qualifications:

  • 8+ years of overall experience in data engineering and analytics.
  • 4+ years of experience in ETL development and data integration.
  • 4+ years of experience with Azure Data Factory (ADF).
  • 4+ years of experience with Microsoft SQL Server and T-SQL.
  • 2+ years of experience with Azure Functions and Logic Apps.
  • Hands-on experience with Azure Databricks, Data Lake (ADLS Gen2), Azure Blob Storage.
  • Proficiency in PL/SQL, triggers, views, indexes, and schema design.
  • Experience in implementing at least 2 projects in Azure Synapse and SQL Server analytics.
  • Strong knowledge of PolyBase, metadata management, and data model design.
  • Excellent written and verbal communication skills.

Preferred Qualifications:

  • Experience with PySpark.
  • Microsoft Azure certifications (e.g., DP-203: Data Engineering on Microsoft Azure).
  • Familiarity with Azure Storage Explorer and DevOps practices.

Job Tags

Full time, Contract work, Part time, Internship, Seasonal work,

Similar Jobs

Providence Health & Services

Occupational Therapist Job at Providence Health & Services

 ...treatment planning and implementation, related documentation, and communication. Providence caregivers are not simply valued theyre...  ...in over 50 hospitals, over 1,000 clinics and a full range of health and social services across Alaska, California, Montana, New Mexico... 

emergiTEL Inc.

Program Manager, Generative AI - 2025-39 Job at emergiTEL Inc.

 ...De tails: Position ID:Requisition 2025-39 Title: Program Manager, Generative AI Positions: 1 Pay Rate: As per skill set Duration...  ...Project Delivery experience in Data or Financial realms is an asset Proven experience delivering projects with teams that include... 

Gotham Enterprises

LMFT Job at Gotham Enterprises

 ...Sign on Bonus: There is a sign-on bonus for new Licensed Mental Health Professionals who join our company. Qualifications: Must have an LMFT License. No disciplinary actions on your license Must have access to a computer in good working condition.... 

PwC

Strategy& Financial Services (x-sector) Manager Save for Later Remove job Job at PwC

 ...CA-Silicon Valley, PA-Philadelphia, WA-Seattle, TX-Houston At PwC, our people in strategy consulting focus on providing strategic guidance...  ...professional and technical standards (e.g. refer to specific PwC tax and audit guidance), the Firm's code of conduct, and independence... 

Solomon Page

Videographer/Photographer - Finance Job at Solomon Page

Our client, an agency in NYC who is working with a financial client, is seeking a skilled and experienced Videographer/Photographer to join their Brand and Content team for a temp-to-perm role. This creative professional will play a key role in concepting, capturing, and...