CHENNAI · FULLTIME
Big Data Engineer
Yantran
Chennai · onsite · Posted 36d ago
Sourced from
Undisclosed3–6 yrsfulltimeChennai
About a minute. You'll make an account on the way through.
agent · working
- Read this posting0.8s
- Found the form on Naukri · 15 questions to answer1.5s
- Decided the answers for all of them2.2s
- Tailor your résumé to this role
- Waiting for you
Section · 01
About this role
Seeking a Big Data Engineer to design and develop distributed data-processing platforms capable of handling large-scale datasets.
Responsibilities:
- Develop distributed data-processing applications.
- Build batch and streaming pipelines.
- Process high-volume structured and unstructured data.
- Develop Spark/PySpark applications.
- Implement Kafka-based streaming solutions.
- Optimize large-scale data processing.
- Build data lakes and analytics platforms.
- Implement data quality and monitoring.
- Support cloud-based big-data environments.
Required Skills:
- Big Data.
- Apache Spark.
- PySpark.
- Hadoop ecosystem.
- Kafka.
- Python/Java/Scala.
- SQL.
- Databricks preferred.
- AWS/Azure/GCP.
- Data Lake technologies.
Sourced from naukri
Section · 02
Skills
data qualityApache SparkScalaApache KafkaHadoop ecosystemgoogle cloud platformamazon web servicesanalytics platformsAnalyticsApache HadoopData LakeDatabricksPysparkPythonSQLJavaData ProcessingMicrosoft AzureBig Data