HYDERABAD · FULLTIME
Data engineer
STEIGEN ELEVATORS
Hyderabad · onsite · Posted 3d ago
Sourced from
Undisclosed5–7 yrsfulltimeHyderabad
Your match
?
Sign in to see your match score, skill gaps & tailored resume.
Section · 01
About this role
Tech stacks: AWS, databricks, pyspark, DBT, airflow ,sql
Shift Timing : Evening Shift 6:30pm Work from Office Responsibilities Include
- Design and maintain DBT models that produce trusted datasets, features, and metrics the Data Science team relies on for analysis, experimentation, ML, and reporting.
- Build and operate pipelines in Databricks - PySpark jobs and Delta/Iceberg tables - that turn raw operational events into analysis-ready data.
- Develop deep familiarity with operations so the datasets, schemas, and models you ship reflect how the business actually works.
- Orchestrate end-to-end data workflows in Airflow (and Prefect where it fits), with SLAs the DS team can count on for daily models, dashboards, and operational decisions.
- Participate in peer code reviews and raise the bar on data quality, testing, and documentation across the team's models.
- Partner with data scientists to scope, design, and productionize feature pipelines and the model-supporting data behind them.
- Optimize DBT and Spark workloads for cost, performance, and reliability as data volume grows.
- Learning new technologies quickly - nobody comes into this role knowing every piece of the stack.
- 5+ years of experience building, testing, and deploying data engineering systems.
- Experience with at least one distributed data system, and the ability to reason about consistency, latency, throughput, and fault tolerance.
- Strong SQL and proficiency with at least one of (py)Spark, DBT, or Airflow in production.
- Experience with Infrastructure-as-Code systems such as Terraform, AWS CDK, or Pulumi.
- Understanding or strong interest in supply chain and the data challenges it creates.
- A self-starter who takes initiative, moves fast, and ships while collaborating on big challenges.
- Enthusiastic about working closely with team members to develop creative solutions to novel problems.
- Excellent written and oral communication in English.
- Tech: DBT, Databricks, (py)Spark, Airflow, Prefect, SQL, Iceberg/Delta; familiarity with the broader Veho stack (Kinesis, EMR, Sigma, Pulumi) a plus.
- Comfortable using modern AI coding assistants (Claude Code, Cursor, Copilot, or similar) and experienced with AI-native workflows - prompting, agentic tooling, evaluations, retrieval - and willing to bring them into your data engineering practice.
- A plus: Demonstrated, measurable success building with LLMs, evaluating model outputs, or integrating AI into data pipelines or internal tooling. Skills: aws,pyspark,sql,databricks,airflow,dbt
Sourced from linkedin · view original
Let the agent run this one for you.
Tailored resume, auto-apply, and referral lookup — in under 2 minutes.
Section · 02
Skills
Terraformaws kinesisDeltasigmaamazon web servicesapache airflowAws EmrClaude CodedbtcopilotcursoricebergAWS CDKLarge Language Models (LLMs)PulumiPrefectDatabricksPysparkSQLArtificial IntelligenceMachine LearningApache Spark