Consulting D&A – Azure Data Engineer – Senior
- Microsoft Azure
- Scala/ Java / Python on Spark/ Pyspark
- Spark SQL
Job Description
- Hands-on Data Engineering role. Delivering high-quality data engineering deliverables, helping to ensure project timelines are met, and providing informal mentoring / training to junior members of the team
- Participate in RFPs, Soluttioning, and estimation
- Hands-on role on data models, data storage, cleansing, validation integration and transformation, and data migration to manage data within the organization, for a small to medium-sized project
- Resolving escalated design and implementation issues with moderate to high complexity
- Providing technical expertise to maximize value from current applications, solutions, infrastructure, and emerging technologies and seek to continuously improve internal processes
- Developing working relationships with peers across other engineering teams and beginning to collaborate to develop leading data engineering solutions
- Driving adherence to the relevant data engineering and data modeling processes, procedures, and standards
- Need to work as a team member to contribute to various technical streams of project implementation
- Interface and communicate with the onsite coordinators
Requirements
- In-depth cloud domain experience with a focus on Microsoft Azure / Microsoft Azure Stack solutions
- Experience building on Azure using Databricks, ADF
- Good to have a Synapse experience
- Sound programming, debugging/troubleshooting, and problem-solving skills with familiarity in Scala/ Java / Python on Spark/ Pyspark
- Strong knowledge of Pyspark/ Spark SQL
- Strong data warehousing concepts
- Good analytical skillsĀ
- 6+ years of work experience in a very large data warehousing environment
- 6+ years of experience with detailed knowledge of data warehouse technical architectures, infrastructure components, ETL/ ELT, and reporting/analytic tools.
- Specialization in a specific sector/domain will be an added advantage
Company: George Bernard (Pvt) Ltd
Company email: [email protected]
Job Location: Colombo
Job Category: IT-Software
Job Type: Full Time