[Remote] Sr Data Engineer
Note: The job is a remote job and is open to candidates in USA. BeyondTrust is a global identity security leader creating a safer world through their cybersecurity SaaS portfolio. As a Data Engineer, you will build and enhance the data lake, optimize infrastructure, and develop data assets to drive business value.
Responsibilities
- Take ownership of data modelling to solve complex identity security problems
- Solve complex analytical problems across disparate systems to provide a unified view of security posture in the datalake
- Optimize data workloads at a software level by improving processing efficiency
- Identify opportunities for engineering process improvement and collaborate with senior resources to execute a plan of action
- Use monitoring and observability best practices to ensure optimal pipeline performance
- Assist with ML Operations to ensure optimal model efficiency
- Leverage CI/CD best practices to effectively develop and release source code
Skills
- Strong programming and technology knowledge in cloud data processing
- Spark experience is needed, existing Databricks knowledge is a plus
- Technical understanding of underlying systems and computation minutiae
- Experience working with distributed systems and data processing on object stores
- Ability to work autonomously
- Required: Data warehousing for analytics use cases
- Required: Highly proficient in Python (or another object orientated language)
- Required: Distributed processing framework experience
- Interest in identity security is highly preferred
- Highly Preferred: Spark
- Highly Preferred: Realtime processing experience
- Ideal: Some experience with graph data stores
Company Overview
Company H1B Sponsorship