Big Data Developer

About the Company Shriram General Insurance is a leading general insurance provider in India, offering a comprehensive range of insurance products including motor, health, travel, and home insurance. The company leverages data and technology to drive business insights, operational efficiency, and enhanced customer experiences. Job Summary Shriram General Insurance is seeking a skilled Big Data Developer to design, develop, and maintain scalable big data solutions for processing and analyzing large volumes of structured and unstructured data. The role involves building data pipelines, optimizing data processing workflows, and collaborating with analytics and engineering teams to support data-driven decision-making. Key Responsibilities

• Design, develop, and maintain scalable big data processing solutions.
• Build and optimize ETL/ELT pipelines for ingesting and transforming large datasets.
• Develop and maintain data processing workflows using distributed computing frameworks.
• Collaborate with data analysts, data engineers, and business stakeholders to understand data requirements.
• Optimize data storage, processing performance, and resource utilization.
• Ensure data quality, integrity, security, and governance across data platforms.
• Monitor and troubleshoot big data applications and workflows.
• Document data architecture, processes, and technical solutions.
• Support the implementation of data lakes, data warehouses, and analytics platforms. Required Skills & Qualifications
• Bachelor's degree in Computer Science, Information Technology, Data Science, Engineering, or a related field.
• Strong proficiency in Python, Java, Scala, or similar programming languages.
• Experience with Apache Hadoop, Apache Spark, Hive, Kafka, or related big data technologies.
• Knowledge of SQL and NoSQL databases such as MySQL, MongoDB, Cassandra, or HBase.
• Experience with ETL tools and data integration techniques.
• Familiarity with cloud platforms such as AWS, Microsoft Azure, or Google Cloud Platform.
• Understanding of distributed systems, data warehousing, and data modeling.
• Experience with Git and version control systems.
• Strong analytical, troubleshooting, and problem-solving skills. Preferred Skills
• Experience with workflow orchestration tools such as Apache Airflow.
• Familiarity with containerization technologies like Docker and Kubernetes.
• Knowledge of real-time data streaming and event-driven architectures.
• Understanding of data governance, security, and compliance practices.
• Experience working in Agile or Scrum development environments. Work Environment Shriram General Insurance offers a collaborative and innovation-focused environment where Big Data Developers contribute to building scalable data platforms that enable advanced analytics, business intelligence, and digital transformation.