Big Data Platform Engineer

The must have skills sets :

· DevOps tools like Jenkins, GitLab CI/CD, or similar

· Containerization using Docker and Kubernetes

· Real-time data integration using Apache Kafka

· Distributed SQL engines like Presto and Trino

· Cloud-based object storage solutions like Amazon S3

· Experience with cloud migration, including assessment, planning, execution, and validation

· Experience with disaster recovery setup, including backup and restore processes, replication, and failover mechanisms

· Experience with Python

Good to have –

· Apache Spark and big data processing

· Data science platforms like Dataiku

· Ansible Playbooks to automate infrastructure provisioning, configuration, and deployment.

· Terraform to manage and provision cloud infrastructure resources

#LI-CTSAPAC