Consulting D&A – Azure Data Engineer – Senior

  • Microsoft Azure
  • Scala/ Java / Python on Spark/ Pyspark
  • Spark SQL

Job Description

  • Hands-on Data Engineering role. Delivering high-quality data engineering deliverables, helping to ensure project timelines are met, and providing informal mentoring / training to junior members of the team
  • Participate in RFPs, Soluttioning, and estimation
  • Hands-on role on data models, data storage, cleansing, validation integration and transformation, and data migration to manage data within the organization, for a small to medium-sized project
  • Resolving escalated design and implementation issues with moderate to high complexity
  • Providing technical expertise to maximize value from current applications, solutions, infrastructure, and emerging technologies and seek to continuously improve internal processes
  • Developing working relationships with peers across other engineering teams and beginning to collaborate to develop leading data engineering solutions
  • Driving adherence to the relevant data engineering and data modeling processes, procedures, and standards
  • Need to work as a team member to contribute to various technical streams of project implementation
  • Interface and communicate with the onsite coordinators

Requirements

  • In-depth cloud domain experience with a focus on Microsoft Azure / Microsoft Azure Stack solutions
  • Experience building on Azure using Databricks, ADF
  • Good to have a Synapse experience
  • Sound programming, debugging/troubleshooting, and problem-solving skills with familiarity in Scala/ Java / Python on Spark/ Pyspark
  • Strong knowledge of Pyspark/ Spark SQL
  • Strong data warehousing concepts
  • Good analytical skillsĀ 
  • 6+ years of work experience in a very large data warehousing environment
  • 6+ years of experience with detailed knowledge of data warehouse technical architectures, infrastructure components, ETL/ ELT, and reporting/analytic tools.
  • Specialization in a specific sector/domain will be an added advantage

Company: George Bernard (Pvt) Ltd
Company email: [email protected]
Job Location: Colombo
Job Category: IT-Software
Job Type: Full Time

Apply now

Allowed Type(s): .pdf, .doc, .docx