Job Summary
Job description for Java DeveloperWe are seeking a highly skilled Senior Java Developer with deep expertise in Apache Beam to design and implement robust data replication frameworks. You will be responsible for building "replicators"—high-throughput, low-latency pipelines that ensure data consistency across our distributed ecosystem. You will work on solving complex challenges like schema evolution, exactly-once processing, and backfill orchestration.Pipeline Development: Design, develop, and maintain complex data replication pipelines using the Apache Beam Java SDK.Data Synchronization: Build and optimize "Replicators" to move data between various sources (Kafka, Pub/Sub, Oracle, MySQL) and sinks (BigQuery, Snowflake, Cassandra, S3).Stateful Processing: Implement advanced Beam features such as State and Timers API to handle data deduplication and sessionization during replication.Performance Tuning: Optimize pipeline performance by managing worker utilization, tackling data skew, and refining "shuffling" operations.Error Handling & DLQ: Implement sophisticated error-handling strategies and Dead Letter Queues (DLQ) to ensure no data loss during the replication process.Schema Management: Handle dynamic schema mapping and evolution using Avro, Protobuf, or Beam Schemas to ensure downstream compatibility.Designing, building and maintaining Java-based applications & websites.Highly efficient in Java & proficiency in object-oriented programming.Experience in Spring Framework, Restful Web services, Micro services.Contributing in all phases of the development lifecycle.Writing well designed, testable, efficient code.Experience in integrating front end interfaces with internal and external services using API.Improve the code quality by implementing best practices.Producing detailed design documentation.Knowledge of testing tools like JUnit, TestNG, Mockito, etcJava Full Stack8 to 10 Years of experienceBackend: J2EE, Spring Boot, Web Services, JMS, JUnit,Database: SQL/OracleCloud: GCP (preferred)Back End6 to 8 years of experienceIndividual ContributorBackend: J2EE, Spring Boot, Web Services, JMS, JUnitDatabase: SQL/OracleFrontend: Angular/Typescript(Optional)Cloud: GCP (preferred)