[Remote] Databricks Platform Engineer (AWS)
Note: The job is a remote job and is open to candidates in USA. DXC Technology is a leading global provider of information technology services, seeking a Databricks Platform Engineer to implement and operationalize core platform capabilities on Databricks running on AWS. The role focuses on developing frameworks, automation, observability, and ensuring reliable delivery aligned with established platform standards.
Responsibilities
- Implement metadata-driven ingestion frameworks and standard ingestion patterns
- Build batch, incremental, and CDC ingestion pipelines
- Ensure pipelines follow platform standards for configuration, schema evolution, tagging, and error handling
- Implement pipeline monitoring, metrics, and alerting
- Support operational validation, failure simulation, and recovery testing
- Embed data quality rules and quarantine patterns
- Apply Unity Catalog tags (domain, owner, sensitivity, freshness) at ingestion time
- Ensure governance metadata is written to governed schemas
- Build CI/CD pipelines using GitHub Actions
- Support configuration validation, environment promotion, and rollback
- Ensure secret management via AWS Secrets Manager
Skills
- 5–8 years data or platform engineering experience
- 3+ years hands-on Databricks experience
- Strong PySpark and SQL
- Experience with Delta Lake, Unity Catalog, Git-based development
- Ingestion framework experience
- Monitoring and alerting implementation
- Production platform support experience
Benefits
- Health, dental, and vision insurance coverage
- Employee wellness
- Life and disability insurance
- A retirement savings plan
- Paid holidays
- Paid time off
- Flexibility to support wellbeing, productivity, individual work styles, and life circumstances
Company Overview