Senior Data Engineer

Role: Senior Data Engineer - (AWS, Opensearch)

Years of Experience: 5-8 Years

Location: Ahmedabad, Pune, Indore

Notice Period: Immediate to 45 Days Max

Job Description: We are seeking a highly motivated and enthusiastic Senior Data Engineer with 5- 8 years of experience to join our dynamic team. The ideal candidate will have a strong background in Data Engineering/Data analytics and a passion for leveraging data to drive business insights and innovation.

Qualifications:

• Bachelor's degree in Computer Science, Data Science, or a related field.

Required Skills and Qualifications:

• 5-8 years of experience in data engineering, with a proven track record of building and managing data solutions.
• Design, develop, and manage scalable data solutions on AWS (RDS, DynamoDB, S3)
• Build and optimize Logstash pipelines to push Kafka events into OpenSearch for real-time search and monitoring.
• Work on OpenSearch indexing and query optimization to improve performance and scalability.
• Collaborate with cross-functional teams to design and implement efficient ETL/ELT pipelines using Logstash, AWS Glue, Lambda, PySpark, and other tools.
• Manage and optimize data warehouses such as DynamoDB and SQL
• Ensure high availability, performance tuning, and reliability of relational and NoSQL databases.
• Work with structured and unstructured data formats (JSON, CSV, XML, Excel).
• Integrate data solutions with BI tools like PowerBI or any reporting.
• Having Knowledge on LLM/NLP techniques, providing basic integration knowledge where applicable.
• Collaborate using version control (GitHub, SVN), ticketing systems (Jira)
• Excellent problem-solving, analytical, and communication skills.

Must Have

• AWS
• Amazon RDS
• DynamoDB
• Data warehouse
• Logstash
• Kafka
• OpenSearch
• Elasticsearch (alternative keyword to for OpenSearch)

Should Have

• Power BI
• LLM and NLP Awareness