PUNE · FULLTIME
Sr Security Data Engineer
Cynergistek
Pune · onsite · Posted 4d ago
Sourced from
Undisclosed5–10 yrsfulltimePune
Your match
?
Sign in to see your match score, skill gaps & tailored resume.
Section · 01
About this role
Job Title: Senior Security Data Engineer
Classification: Exempt
Approved by: Jitendra Patil
Experience: 5-10 Years
Reports to: Shivendra Ashish
Core Responsibilities
- Pipeline Management: Maintain high-throughput streaming pipelines to ingest logs from various sources (Firewalls, Cloud, Endpoints) to a central destination.
- Log Normalization: Write parsers to convert raw, messy logs into standard schemas (e.g., OCSF or ECS) for consistent querying.
- Cost Optimization: Implement routing logic to send high-value data to the SIEM and bulk data to low-cost Object Storage (Data Lake).
- Data Preparation: Clean and structure data to enable AI/ML detection models and advanced analytics.
Must-Have Skills
- Data Engineering: Proficiency in Python (for ETL) and SQL (for complex querying).
- Streaming Tech: Experience with Message Queues (e.g., Kafka, Pub/Sub) and stream processing concepts.
- Log Handling: Mastery of Regex and log parsing strategies for standard formats (Syslog, CEF, JSON).
- Storage Architecture: Understanding of Data Lake principles (Parquet/Avro formats) vs. Data Warehouses.
Preferred / Nice to Have
- Experience with Vector Databases for storing embeddings.
- Knowledge of Log Observability/Routing tools (middleware that routes logs).
- Familiarity with Big Data frameworks (e.g., Spark, Flink).
Mental/Physical Requirements: Fast paced environment handling multiple demands. Must be able to exercise appropriate judgment as necessary. Requires a high level of initiative and independence. Excellent written and oral communication skills required. Requires the ability to use a personal computer for extended periods of time.
Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
Sourced from naukri
Let the agent run this one for you.
Tailored resume, auto-apply, and referral lookup — in under 2 minutes.
Section · 02
Skills
Data Engineermessage queuesApache Kafkafirewallsdata preparationapache flinkclassificationClient SuccessEmbeddingsAnalyticsData LakeJSONCEFData EngineeringcloudCommunication SkillsArchitectureAdvanced AnalyticsETLBig DataArtificial Intelligence