Data Engineer II
Radian Generation
External4+ yearsPosted 13 days ago
Let the right jobs find you
Get personalised suggestions from verified company career pages, matched to your role, location, level, and skills.
Overview
Position Type
External
Experience
4+ years
Job Description
Role and Responsibilities
- Guide and front the design and development of ETL pipelines and processes
- Collaborate with a team of data science and analytics professionals to understand how best to prepare data for further use
- Build, maintain, and optimize existing data architecture and infrastructure
- Enhance data quality and integrity through pressure testing and validation
- Spearhead the development and unification of multiple systems in a microservice centric architecture
Required Qualification & Education
- University Degree in Computer Science, Data Science, Mathematics or a related field and 4+ years of applicable experience
- Certification in one or more data management technologies or methodologies
Required Skills & Competencies
- Expertise with both SQL and noSQL database solutions
- Experience working with both structured and unstructured data
- Knowledge of programming languages such as Python or Ruby
- Understanding of data warehousing concepts and tools in AWS or Azure
- Understanding of a data lakehouse architecture, design, and implementation
- Strong problem solving skills and a passion for high quality data management
Required Software Knowledge
- 2+ yrs of SQL experience
- 4+ years of programming experience using either Ruby, Python, or another scripting language
- Experience working within expansive AWS systems involving multiple groups of microservices
Preferred Experience
- Masters Degree in Computer Science, Data Science, Mathematics or a related field and 2+ years of applicable experience
- Experience unifying systems with similar but distinct approaches to data management is a plus
Preferred Skills & Competencies
- Understanding of cloud computing and data management technologies in AWS (Sagemaker, Lambda, RDS, Redshift)
- Prior history working under Agile software development methods and tooling, such as Jira ticketing, Kanban process, etc.
- Exposure to data visualization or business intelligence tools is a plus (DOMO, Tableau, PowerBI)
- Experience working with version control systems such as GIT