CHENNAI · FULLTIME
Data Engineer
AVP VIGILANT TECHNOLOGY PVT LTD
Chennai · onsite · Posted 19d ago
Your match
Sign in to see your match score, skill gaps & tailored resume.
Section · 01
About this role
Job Title: Data Engineer
Experience: 2–10 Years
Employment Type: Full-Time
Location: Bangalore / Mumbai / Gurgaon
Salary: ₹12–45 LPA
Job Summary We are looking for a skilled
Data Engineer to design, build, and optimize scalable data pipelines and modern data platforms. The ideal candidate should have strong expertise in
Apache Spark, SQL, and Databricks , with experience handling large-scale data processing, ETL development, and cloud-based data engineering solutions. Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT data pipelines.
- Build and optimize data processing workflows using Apache Spark.
- Develop and manage data solutions on Databricks.
- Write efficient SQL queries for data extraction, transformation, and analysis.
- Integrate data from multiple structured and unstructured sources.
- Optimize data models, storage, and pipeline performance.
- Ensure high data quality, integrity, and security across platforms.
- Collaborate with Data Scientists, Analysts, and Software Engineers.
- Troubleshoot production issues and improve system reliability.
- Participate in architecture discussions and implement best engineering practices.
Required Skills
- Strong experience with Apache Spark
- Advanced SQL programming
- Hands-on experience with Databricks
- ETL/ELT pipeline development
- Data Warehousing concepts
- Python or Scala (preferred)
- Experience with cloud platforms (AWS, Azure, or GCP)
- Git and CI/CD fundamentals
- Data Lake and Delta Lake concepts
- Performance tuning and query optimization
Preferred Qualifications
- Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
- Experience working with large-scale distributed data processing.
- Knowledge of Airflow, Kafka, Snowflake, or Azure Data Factory is an added advantage.
- Familiarity with Agile/Scrum development methodologies. What We Offer
- Competitive salary of ₹12–45 LPA
- Opportunity to work on enterprise-scale data platforms
- Exposure to modern cloud and big data technologies
- Learning and certification support
- Collaborative and innovative work environment
- Career growth opportunities with leading organizations Hiring Process
- Resume Screening
- Technical Assessment
- Technical Interview(s)
- Managerial Discussion
- HR Interview
- Offer & Onboarding Skills: databricks,etl,python,ci/cd,apache spark,aws, azure, or gcp
Sourced from linkedin · view original
Let the agent run this one for you.
Tailored resume, auto-apply, and referral lookup — in under 2 minutes.
Section · 02