Big Data Engineer

Skill: Big Data Engineer (Pyspark + SQL) Exp: 5 to 8 years Loc: Pune & Chennai

J

• DLead end to end analysis of largescale multisource datasets using Big Data technologies driving insights for strategic and operational decision makin
• gDesign develop and optimize complex analytical queries using Starburst Trino Presto to enable fast federated access across enterprise data source
• sBuild manage and optimize analytics workflows in Databricks using SQL PySpark and Python for scalable data processin
• gPartner closely with Data Engineering Architecture and Platform teams to influence data models analytics architecture and performance optimizatio
• nTranslate ambiguous business problems into structured analytical approaches and clearly communicate findings trends and recommendations to senior stakeholder
• sDefine and enforce best practices for data quality validation reconciliation and governance within analytics solution
• sMentor junior and midlevel analysts providing technical guidance code reviews and analytical best practice
• sSupport executive reporting dashboards and advanced adhoc analysis as require
• dContribute to continuous improvement of analytics processes standards and reusable frameworks710 years of experience as a Data Analyst Senior Data Analyst working in largescale enterprise data environment
• sStrong handson experience with Big Data ecosystems Hadoop Hive Spark distributed data platform
• sProven experience using Starburst TrinoPresto for complex high performance analytical querie
• sExtensive experience with Databricks including Databricks SQL Spark based analytics and notebook developmen
• tExpert level SQL skills query optimization performance tuning complex join
• sStrong proficiency in Python and or PySpark for data analysis and transformatio
• nSolid understanding of data warehousing data modeling and analytics architecture concept
• sExcellent analytical problem solving and stakeholder communication skills Experience working on cloud platforms such as AWS Azure or GC
• PExposure to BI and visualization tools Power BI Tableau or equivalen
• tKnowledge of enterprise data governance metadata management and data quality framework
• sExperience working in Agile DevOps delivery models Strong ownership and ability to lead quality outcomes end to en
• dClear communication and stakeholder managemen
• tMentoring mindset and collaboration across QA Dev and DevOps team s