Cloud Data Engineer
SWITS DIGITAL · Bengaluru · onsite · Posted 8d ago
Undisclosed5–8 yrsfulltimeSourced from
About a minute. You'll make an account on the way through.
About this role
Cloud Data Engineer
Experience: 5-8 Years
Relevant Experience: Minimum 5+ Years
Location: Bangalore
Work Mode: Hybrid - 3 Days a Week in Office
Relevant Experience: Minimum 5+ Years
Location: Bangalore
Work Mode: Hybrid - 3 Days a Week in Office
Job Summary
We are looking for an experienced Cloud Data Engineer with strong hands-on expertise in Hadoop, HDFS, Hive, and PySpark. The ideal candidate should have solid experience in big data processing, distributed computing, data transformation, and building scalable data pipelines.
Key Responsibilities
- Design, develop, and maintain scalable data processing pipelines using PySpark.
- Work with Hadoop and HDFS for distributed data storage and processing.
- Develop, optimize, and maintain Hive queries, tables, and data models.
- Perform large-scale data extraction, transformation, and loading (ETL) using PySpark and Hadoop ecosystem technologies.
- Optimize Spark jobs and Hive queries for performance and resource utilization.
- Handle structured and semi-structured data for analytics and reporting requirements.
- Troubleshoot data pipeline failures, data quality issues, and performance bottlenecks.
- Collaborate with data engineers, analysts, and other stakeholders to deliver reliable data solutions.
- Follow best practices for data security, data quality, code maintenance, and performance optimization.
Required Skills
- Hadoop: Strong hands-on experience with the Hadoop ecosystem.
- HDFS: Experience managing and processing data in the Hadoop Distributed File System.
- Hive: Proficiency in HiveQL, query optimization, and data management.
- PySpark: Strong hands-on experience in distributed data processing and transformation.
- Big Data: Good understanding of distributed computing and large-scale data processing.
- ETL/Data Pipelines: Experience developing, maintaining, and optimizing data pipelines.
- SQL: Strong query-writing and data manipulation skills.
- Troubleshooting: Ability to identify and resolve data processing and performance issues.
Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
Sourced from naukri
Skills
data qualitydata extractiondata manipulationdata storagedata transformationdistributed computingAnalyticsdata modelsApache HadoopCloud DatacloudData SecurityData ManagementData ProcessingETLData PipelineBig Data
About SWITS DIGITAL
SWITS DIGITAL
IT Services & Consulting
21
employees
2024
2 years old
Chennai, Tamil Nadu
India
₹3.3L PA avg
Avg at SWITS DIGITAL
About
At SWITS Digital Private Limited, we are driven by innovation, integrity, and a commitment to empowering businesses through technology. As a fast-growing company, we specialize in designing and develo
Industries
IT Services & ConsultingInternetRecruitment
Employee ratings
10 reviews
4.1/ 5
Culture
3.8
Career growth
3.7
Work-life
3.8
Employees rate it well for
Company Culture41Job Security41
Find them on