PUNE · FULLTIME
Data Engineer
UN
unfilterstory
Pune · onsite · Posted 51d ago
Sourced from
Not disclosed4–8 yrsfulltimePune
About a minute. You'll make an account on the way through.
agent · working
- Read this posting0.4s
- Found the form on Foundit · 7 questions to answer1.0s
- Decided the answers for all of them2.7s
- Tailor your résumé to this role
- Waiting for you
Section · 01
About this role
Job Title: Data Engineer
Job Type: Full Time
Location: Pune, India
Experience: 4–8 Years
Job Summary
We are looking for an experienced Data Engineer with strong expertise in big data technologies, data pipelines, distributed processing, and data modeling.
The ideal candidate should have a minimum of 4 years of hands-on experience with core technologies and possess excellent communication skills.
Must-Have Skills
Category Skills / Experience Programming Languages Python (PySpark), SQL, Java Big Data Frameworks Apache Spark Workflow Orchestration Apache Airflow Streaming & Messaging Apache Kafka Operating System Strong familiarity with Linux/Unix environments and shell scripting Data Engineering Experience in data ingestion, ETL/ELT pipeline development, data transformation, data cleansing, and data quality validation Data Modelling Experience in logical and physical data modeling, schema design, and data warehouse concepts
Good-to-Have Skills
Category Skills / Experience API Integration Experience developing or consuming RESTful APIs Stream Processing Experience with Apache Flink or other real-time stream processing frameworks
Key Requirements
[Add information regarding benefits and perks here]
Skills: apache spark,apache,pyspark,java,apache kafka,sql,airflow
Job Type: Full Time
Location: Pune, India
Experience: 4–8 Years
Job Summary
We are looking for an experienced Data Engineer with strong expertise in big data technologies, data pipelines, distributed processing, and data modeling.
The ideal candidate should have a minimum of 4 years of hands-on experience with core technologies and possess excellent communication skills.
Must-Have Skills
Category Skills / Experience Programming Languages Python (PySpark), SQL, Java Big Data Frameworks Apache Spark Workflow Orchestration Apache Airflow Streaming & Messaging Apache Kafka Operating System Strong familiarity with Linux/Unix environments and shell scripting Data Engineering Experience in data ingestion, ETL/ELT pipeline development, data transformation, data cleansing, and data quality validation Data Modelling Experience in logical and physical data modeling, schema design, and data warehouse concepts
Good-to-Have Skills
Category Skills / Experience API Integration Experience developing or consuming RESTful APIs Stream Processing Experience with Apache Flink or other real-time stream processing frameworks
Key Requirements
- Minimum 4 years of relevant experience in Data Engineering.
- Strong hands-on experience with Python (PySpark), SQL, and Java.
- Strong knowledge of Apache Spark, Apache Airflow, and Apache Kafka.
- Good understanding of Linux/Unix environments and shell scripting.
- Experience building and managing data ingestion and ETL/ELT pipelines.
- Strong understanding of data transformation, cleansing, and data quality validation.
- Experience with logical and physical data modeling.
- Understanding of schema design and data warehouse concepts.
- Excellent communication and stakeholder-management skills.
- Experience with REST APIs and Apache Flink/real-time stream processing will be an advantage.
[Add information regarding benefits and perks here]
Skills: apache spark,apache,pyspark,java,apache kafka,sql,airflow
Sourced from foundit
Section · 02
Skills
Data CleansingBashApache SparkApache Kafkarestful apisapache flinkdata transformationapache airfloweltschema designData quality validationUnixData Warehouse ConceptsPysparkPythonSQLJavaETLData ModelingLinux