Job Summary
Looking for an experienced L3 Subject Matter Expert (SME) with deep expertise in Cribl and Dynatrace to lead enterprise observability initiatives. The ideal candidate will architect, deploy, optimize, and support enterprise monitoring and log management platforms while mentoring L1/L2 engineers, driving automation, and ensuring platform reliability, scalability, and security across on-premises and cloud environments. The candidate will serve as the highest technical escalation point, provide architecture guidance, lead migration and modernization projects, collaborate with application and infrastructure teams, and continuously improve monitoring strategy across the enterprise.
Key Responsibilities
Cribl Platform Administration • Design, deploy, administer, and optimize Cribl Stream, Edge, and Cribl Search. • Build and maintain complex data pipelines for enterprise log ingestion. • Perform routing, filtering, masking, enrichment, parsing, transformation, sampling, and reduction of telemetry data. • Configure Sources, Routes, Pipelines, Packs, Destinations, Workers, Worker Groups, and Distributed Deployments. • Optimize observability costs by reducing unnecessary log ingestion while maintaining data quality. • Troubleshoot pipeline failures, throughput issues, latency, parsing errors, and worker performance. • Implement Git-based deployment and configuration management. • Develop reusable pipeline templates and automation. • Integrate Cribl with enterprise monitoring and SIEM platforms. ________________________________________ Dynatrace Administration • Deploy and administer Dynatrace SaaS and Managed environments. • Install, upgrade, and maintain OneAgent, ActiveGate, Extensions, and Synthetic Monitoring. • Onboard complex enterprise applications. • Configure Smartscape, Service Flow, Process Groups, Management Zones, Auto Tags, and Naming Rules. • Configure infrastructure, application, cloud, Kubernetes, OpenShift, VMware, database, and network monitoring. • Implement Real User Monitoring (RUM), Session Replay, Synthetic Monitoring, and Digital Experience Monitoring. • Configure Davis AI for intelligent root cause analysis. • Design dashboards, alerts, anomaly detection, and Service Level Objectives (SLOs). • Lead Dynatrace Managed to SaaS migration initiatives. • Implement OpenTelemetry (OTEL) integration with Dynatrace. ________________________________________ Observability & Monitoring • Develop enterprise monitoring strategy. • Define KPIs, SLIs, and SLOs. • Design monitoring for hybrid infrastructure including: o Windows o Linux o VMware o Kubernetes o Docker o AWS o Azure o GCP • Monitor Java, .NET, Node.js, Python, Go, and microservices-based applications. • Build end-to-end observability across infrastructure, applications, logs, metrics, and traces. • Create custom dashboards, reports, scorecards, and executive views. ________________________________________ Performance Engineering • Analyze application performance bottlenecks. • Investigate latency, throughput, memory, CPU, thread, and garbage collection issues. • Support performance testing and workload analysis. • Collaborate with application teams for performance tuning. • Develop recommendations for application optimization. ________________________________________ Automation & Integration • Develop automation using: o Python o PowerShell o Bash/Shell • Utilize Dynatrace REST APIs and Cribl APIs. • Automate monitoring deployment and configuration. • Integrate with CI/CD pipelines including GitHub, GitLab, Azure DevOps, and Jenkins. • Develop Infrastructure-as-Code using Terraform where applicable. ________________________________________ Incident & Problem Management • Act as L3 technical escalation point. • Perform Root Cause Analysis (RCA). • Troubleshoot production incidents. • Support Major Incident Management. • Reduce Mean Time to Detect (MTTD) and Mean Time to Resolve (MTTR). • Drive proactive monitoring improvements.
Skill Requirements
Technical Skills Cribl • Cribl Stream • Cribl Edge • Cribl Search • Distributed Worker Groups • Pipelines • Routes • Sources • Destinations • Packs • Parsing • Data Reduction • Sampling • Data Masking • Data Enrichment • Replay • Git Integration • API Integration
Other Requirements
NA