Azure Databricks Engineer (PySpark)
PSRTEK Inc · Hyderabad · onsite · Posted 21d ago
About a minute. You'll make an account on the way through.
About this role
We are seeking a skilled Azure Databricks Engineer with strong expertise in PySpark to design, build, and optimize scalable data pipelines on the Azure cloud platform. The ideal candidate will work with large-scale distributed data systems and support advanced analytics and data engineering initiatives.
Key Responsibilities- Develop and maintain ETL/ELT pipelines using PySpark on Azure Databricks
- Design scalable data solutions using Apache Spark
- Integrate data from multiple sources (Azure Data Lake, SQL DBs, APIs, streaming sources)
- Optimize Spark jobs for performance and cost efficiency
- Work with Azure Data Factory for orchestration
- Implement data transformation, cleansing, and validation logic
- Collaborate with data scientists, analysts, and stakeholders
- Ensure data quality, governance, and security standards
- Monitor and troubleshoot production data pipelines
- Strong experience with PySpark
- Hands-on experience with Azure Databricks
- Good understanding of SQL
- Experience with distributed computing concepts
- Familiarity with Azure Data Lake Storage
- Knowledge of data warehousing concepts
- Experience with version control (Git)
- Experience with Delta Lake
- Knowledge of streaming frameworks (Spark Streaming / Kafka)
- Experience with Azure Synapse Analytics
- Python programming beyond PySpark
- CI/CD pipelines (Azure DevOps)
Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
Sourced from naukri
Skills
About PSRTEK Inc
PSRTEK Inc
Recruitment
501-1000
employees
2015
11 years old
Princeton
US
₹3.3L PA avg
Avg at PSRTEK Inc
About
PSRTEK Inc. is a technology recruitment and IT staffing brand with a global footprint and an admired client base. As an ideas and innovation powerhouse with a culture of excellence, we bring remarkable expertise and deliver powerfully transformative results.
What differentiates us is the deep industry focus, ability to anticipate trends and carry through on the explicit and implicit needs of clients. With specialist expertise and support, we bring absolute value to every touch point and deliver top talent in a highly competitive market within agreed timelines.
Driven by the philosophy of customer delight, we take pride in our transparent approach and bring speed, sincerity, and humbleness to operations. Our passionate teams are ably supported by a strong technology base, thereby providing a consistent level of service in a tumultuous global scenario, where change is the new normal. Streamlined, yet agile, our deep reach, refined business processes and single-minded dedication empower us to take on any challenge and deliver commendably.
Welcome to a world where knowledge meets integrity, dedication meets focus and success greets you…
WELCOME to PSRTEK Inc.!!!
Industries
Employee ratings
10 reviews
Culture
4.1
Career growth
3.3
Work-life
4.2
Employees rate it well for
Find them on