Scop of work
- Provide engineering support for early stage projects: Help identify where data lives,how to get access to it, how to make it available and well suited
- Provide engineering support for in progress projects: Design, implement and maintain data pipelines that feed proof of concept implementations
- Provide engineering support for production systems: Design, implement and maintain data pipelines, model training and deployment workflows, and APIs
- Implement data ingestion routines both real time and batch using best practices in data modeling and ETL/ELT processes
- Becoming a Cloud Platform and on-premises data expert on services relating to data engineer stuff
- Perform testing, validation, and deployment in order to deliver the accuracy of data transformations and data verification
- Monitor the big data tools and frameworks required to provide requested capabilities
Qualification
- Bachelor's or Master's degree in Computer Science, Engineering, Mathematics, or a related field or 2+ years industry experience
- At least 1 year of experience with Google Cloud Platform (Big Query , Buckets etc.)
- 2+ years of experience with demonstrated strength in ETL/ELT, data modeling, data warehouse technical architecture, infrastructure components and reporting/analytic tools.
- 2+ years of hands-on experience in writing complex, highly-optimized SQL queries across large data sets.
- Experience with Python programming is advantage
- Must have excellent communication & interpersonal skills
- Quick learner, looking for new challenges