Data Engineer

Role & responsibilities

Databricks Engineer to build, structure, and maintain Databricks environment while leveraging Python or R for development. The engineer should be able to take ownership of workspace setup, catalog governance, and access management.

Key Responsibilities

• Environment Setup & Administration: Configure Databricks workspaces, clusters, compute resources, and access controls.
• Catalog & Data Governance: Architect catalog structures, schemas, and permissions using Unity Catalog.
• Data & Pipeline Development: Write clean, efficient code using Python (PySpark) or R (SparkR) and SQL to process datasets and optimize Delta Lake tables.

Key Qualifications

• Proven hands-on experience managing and structuring Databricks environments.
• Strong proficiency in Python or R, alongside solid SQL skills.
• Practical knowledge of Unity Catalog, Delta Lake, and role-based access management.

Preferred candidate profile