Job Summary
Streaming Architecture: Design, implement, and manage Kafka-based real-time streaming solutions capable of handling high-throughput and low-latency environments. • Cluster Management: Perform Kafka cluster setup, configuration, tuning, and performance optimization to ensure high availability and disaster recovery. • Pipeline Development: Build and manage streaming data pipelines utilizing Kafka ecosystem components (Kafka Connect, ksqlDB, Schema Registry) to process large datasets. • Cloud & Infrastructure: Work with cloud-native applications, automate infrastructure deployment using Infrastructure-as-Code (IaC) tools (e.g., Terraform), and apply GitOps practices. • System Reliability: Ensure system fault tolerance, scalability, and robust security protocols (SSL/mTLS, SASL, ACLs).
Key Responsibilities
Streaming Architecture: Design, implement, and manage Kafka-based real-time streaming solutions capable of handling high-throughput and low-latency environments. • Cluster Management: Perform Kafka cluster setup, configuration, tuning, and performance optimization to ensure high availability and disaster recovery. • Pipeline Development: Build and manage streaming data pipelines utilizing Kafka ecosystem components (Kafka Connect, ksqlDB, Schema Registry) to process large datasets. • Cloud & Infrastructure: Work with cloud-native applications, automate infrastructure deployment using Infrastructure-as-Code (IaC) tools (e.g., Terraform), and apply GitOps practices. • System Reliability: Ensure system fault tolerance, scalability, and robust security protocols (SSL/mTLS, SASL, ACLs).
Skill Requirements
Streaming Architecture: Design, implement, and manage Kafka-based real-time streaming solutions capable of handling high-throughput and low-latency environments. • Cluster Management: Perform Kafka cluster setup, configuration, tuning, and performance optimization to ensure high availability and disaster recovery. • Pipeline Development: Build and manage streaming data pipelines utilizing Kafka ecosystem components (Kafka Connect, ksqlDB, Schema Registry) to process large datasets. • Cloud & Infrastructure: Work with cloud-native applications, automate infrastructure deployment using Infrastructure-as-Code (IaC) tools (e.g., Terraform), and apply GitOps practices. • System Reliability: Ensure system fault tolerance, scalability, and robust security protocols (SSL/mTLS, SASL, ACLs).
Other Requirements
Streaming Architecture: Design, implement, and manage Kafka-based real-time streaming solutions capable of handling high-throughput and low-latency environments. • Cluster Management: Perform Kafka cluster setup, configuration, tuning, and performance optimization to ensure high availability and disaster recovery. • Pipeline Development: Build and manage streaming data pipelines utilizing Kafka ecosystem components (Kafka Connect, ksqlDB, Schema Registry) to process large datasets. • Cloud & Infrastructure: Work with cloud-native applications, automate infrastructure deployment using Infrastructure-as-Code (IaC) tools (e.g., Terraform), and apply GitOps practices. • System Reliability: Ensure system fault tolerance, scalability, and robust security protocols (SSL/mTLS, SASL, ACLs).