DevOps Specialist

Must have -- GCP, IaC, Github Actions, Infrastructure & Orchestration (IaC & CI/CD)

Key Responsibilities

1. Infrastructure & Orchestration (IaC & CI/CD)
2. Architect and maintain multi-environment infrastructure using Terraform.
3. Design and manage complex CI/CD pipelines using GitHub Actions, Tekton, and Cloud Build.
4. Orchestrate data pipelines using Astronomer (Airflow) to ensure reliable execution of Java and Python-based utilities. 2. Data & Search Operations (DataOps)
5. Support Dataflow (Apache Beam) ETL jobs, focusing on autoscaling, VCPU quota management, and the implementation of Dead Letter Queues (DLQ) for failed records.
6. Manage Elasticsearch indices, including the implementation of Index Lifecycle Management (ILM) to balance performance and storage costs.
7. Optimize BigQuery performance through partitioning, clustering, and slot management strategies. 3. Advanced Security & Governance
8. Integrate and manage "Shift Left" security tools: FOSSA, SonarQube, 42Crunch, and Cycode.
9. Implement Binary Authorization to ensure only verified, scanned images from Artifact Registry are deployed.
10. Enforce strict IAM roles, Secret Management, and VPC security (Service Controls) to protect sensitive data. 4. Observability & Reliability (SRE)
11. Develop comprehensive monitoring dashboards and alerting in GCP Cloud Monitoring/Logging.
12. Define and track SLIs/SLOs for all five data flows to ensure system health.
13. Establish Disaster Recovery (DR) and backup protocols for BigQuery datasets and Elasticsearch snapshots. 5. Cost & API Management
14. Implement FinOps practices to monitor and reduce cloud spend across Dataflow, BigQuery, and Cloud Run.
15. Manage outbound API connections and credentials securely, potentially utilizing GCP API Gateway or Apigee.