ETL Data Platform Developer
machine learning technologies llc · Not specified · onsite · Posted today
Not disclosed7–9 yrsfulltimeSourced from
About a minute. You'll make an account on the way through.
About this role
- Home
- About
- Adaptive AI
- Industries
- Consulting
- Jobs-Portal
- Contact Us
- Home
- About
- Adaptive AI
- Industries
- Consulting
- Jobs-Portal
- Contact Us
Job Overview
- Job ID:
- Job Title:
- Location:
- Duration:
- Hourly Rate:
- Work Authorization:
H4-EAD, L2-EAD, GC-EAD
- Client:
- Employment Type:
View All Jobs
Similar Jobs
- Software Developer - 423 W WHEATLAND RD, SUITE 103C, DUNCANVILLE, TX 75116-4605
- Software Developer - 423 W WHEATLAND RD, SUITE 103C, DUNCANVILLE, TX 75116
- Software Developer - 423 W WHEATLAND RD,, TEXAS 75116
- Data Analyst - Trenton, New Jersey
- Java Developer - 423 W WHEATLAND RD, SUITE 103C, DUNCANVILLE, TX 75116
Role : ETL Data Platform Developer
Location : Redmond, WA (Onsite )
Key Responsibilities
Design and implement ETL pipelines using Microsoft Fabric (Dataflows, Pipelines, Lakehouse ,warehouse, sql) and Azure Data Factory.
Build and maintain a metadata driven Lakehouse architecture with threaded datasets to support multiple consumption patterns.
Develop agent specific data lakes and an orchestration layer for an uber agent that can query across agents to answer customer questions.
Enable interactive data consumption via Power BI, Azure OpenAI, and other analytics and AI tools.
Ensure data quality, lineage, and governance across all ingestion and transformation processes.
Collaborate with product teams to understand data needs and deliver scalable solutions.
Optimize performance and cost across storage and compute layers.
Required Qualifications
7+ years of experience in data engineering with a focus on Microsoft Azure Data stack and Fabric technologies.
Strong Expertise In
Executive written and oral communication
Microsoft Fabric (Lakehouse, Dataflows Gen2, Pipelines, Notebooks)
Azure Data Factory, Azure SQL, Azure Data Lake Storage Gen2
Power BI and/or other visualization tools
SQL, Python and PySpark/ Scala
Experience working with structured and semi structured data (JSON, XML, CSV, Parquet).
Proven ability to build metadata driven architectures and reusable components.
Familiarity with agent based architectures and conversational AI integration is a plus.
Strong understanding of data modeling, data governance, and security best practices.
Apply Now
Equal Opportunity Employer
MACHINE LEARNING TECHNOLOGIES LLC is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. MACHINE LEARNING TECHNOLOGIES LLC will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will MACHINE LEARNING TECHNOLOGIES LLC require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract
- Home
- About
- Adaptive AI
- Industries
- Consulting
- Contact Us
Sourced from foundit
Skills
ScalaparquetMicrosoft FabricCSVlakehouseAzure SQLdata flowsAzure Data Lake Storage Gen2PipelinesJSONPysparkPythonPower BiXMLSQLAzure Data Factory