Data Engineer
Capgemini · Bengaluru · onsite · Posted 37d ago
Undisclosed1–6 yrsfulltimeSourced from
About a minute. You'll make an account on the way through.
About this role
At Capgemini Invent, we believe difference drives change. As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to deliver cutting-edge solutions. Join us to drive transformation tailored to our client''s challenges of today and tomorrow. Informed and validated by science and data. Superpowered by creativity and design. All underpinned by technology created with purpose.
Your role
- Design, develop, and maintain scalable data pipelines using Snowflake. Write efficient and maintainable code in Python and PySpark. Develop and optimize SQL queries for data extraction and transformation.Implement data ingestion strategies in Snowflake using Snowpipe and COPY command to load data into base tables with Streams and Tasks.
- Extract data from various source systems and load data into Snowflake using Python, Pyspark scripts. Configure role-based access on Snowflake objects and process data sharing and cloning between Snowflake accounts.
- Create models in DBT and integrate data quality rules and tests to ensure data accuracy, consistency, and completeness.Implement data quality checks and monitoring, ensuring data accuracy and reliability.Collaborate with cross-functional teams to gather requirements and translate them into technical solutions.
- Ensure data quality, governance, and security across all pipelines and storage layers.Hands-on experience with CI/CD tools and DevOps practices
Your Profile
- Proficiency in Python and PySpark, SQL skills, including query optimization and performance tuning.
- Snowflake/ AWS/ Azure/ GCP
- Familiarity with data warehousing concepts and ETL processes. Experience with big data tools: Hadoop, Spark, Kafka, etc.
- Experience with relational databases such as Microsoft SQL Server, MySQL, PostgreSQL, Oracle, and NoSQL databases such as Hadoop, Cassandra, MongoDB. Excellent problem-solving skills with an emphasis on sustainable and reusable development.
What you will love about working here
- We recognize the significance of flexible work arrangements to provide support. Be it remote work, or flexible work hours, you will get an environment to maintain healthy work life balance.
- At the heart of our mission is your career growth. Our array of career growth programs and diverse professions are crafted to support you in exploring a world of opportunities.
- Equip yourself with valuable certifications in the latest technologies such as Generative AI.
Sourced from naukri
Skills
DevopsPostgresqlApache SparkNoSQLApache KafkaPerformance Tuningcdgoogle cloud platformamazon web servicescassandraApache HadoopOracle DBPysparkPythonMongoDBMySQLSQLData WarehousingSnowflakeETLMicrosoft AzureSQL ServerBig DataCi/Cd
About Capgemini
Capgemini
IT Services & Consulting
235k+
employees
1967
59 years old
Mumbai, Maharashtra
India
About
Capgemini is an AI-powered global business and technology transformation partner, delivering tangible business value.
Industries
IT Services & ConsultingAnalytics & KPOBankingSoftware Product
Employee ratings
53,345 reviews
3.6/ 5
Culture
3.6
Career growth
2.8
Work-life
3.8
Employees rate it well for
Work Life Balance7494Salary7201Work Culture5032Appraisal4419Senior Management3872
Find them on