Data Engineer
We are looking for passionate candidates to join the Sri Lankan operations of an Australian-based cutting-edge Technology Company serving both government and private organizations in Australia, England, and New Zealand.
This can be a part-time/full-time (multiple positions available) contract with the possibility to join the permanent carder based on your performance. We offer an attractive package and flexibility of working from home (maintaining social distancing to stay safe and healthy as well as saving commuting time and cost).
Who are we looking for?
Self-motivated energetic, creative individuals who can work with minimal supervision and produce high-quality results with strong
analytical skills.
Key Responsibilities
- Build, Track and Maintain ETL (extract; transform, load) and analysis pipelines
- Work with data scientists to identify optimal ways to prepare, store and navigate their datasets
- Work with the software and information technology teams to specify, design, and implement the infrastructure for storing, searching, and integrating new datasets
- Management of the data ecosystem, ensuring it meets required business service levels is well maintained and cost-effective
Essential
- A Bachelor’s Degree in Computer Science IT or equivalent qualification
- Experience in supporting/implementing data pipelines – using Apache Airflow
- Proficient programming skills in a scripting language – preferably Python
- Experience in data engineering best practices. E.g. CI/CD and using verSion control
- Experience in data quality assessment and validation
- Experience with Cloud platforms (GCP)
Preferred
- Experience writing SQL code (DBT)
- Working in an Agile Development environment
Nice to have
- Deployment/use of GCP Components including DataFlowe PubSub BigQuery, Cloud Composer, etc.
- Experience with graph databases — Ne04J
- BigQuerye MS SQL Server or Postgres familiarity