Data Engineer – Private Equity
Main Responsibilities
- Build Python data pipelines and query engines (to and from S3, Athena, and Snowflake)
- Write data science Python packages, modularise existing code scripts and build analytical utility functions
- Design and develop Python AWS proxy authentication
- Systematically update and store credentials in AWS Secrets Manager
- Implement AWS Command Line Interface (CLI) data science packages
- Build standard methods for data visualizations
- Build unit tests with robust test cases
- Write efficient SQL queries
- Interpret business requirements, either gathered or acquired
- Automate processes associated with models in the production and development of solutions for technology integration
- Work collaboratively in a global setting while learning new technologies
- Document solutions
- Implement or adhere to coding standards and best practices
- Perform quality checks and adhere to the agreed service level agreement (SLA)/turnaround time (TAT)
Required Background
- Bachelor’s/Master’s degree in Computer Science/Statistics or Engineering
- Strong skills in programming languages, such as Python, SQL, and Unix Shell
- Experience in building Python packages, OOP (object-oriented) programming and PEP8
- Experience in building unit tests and implementing test cases
- Experience in DevOps, AWS (S3, CLI, CD, CodeBuild, and CodePipeline), and Snowflake
- AWS experience and skills in S3, Athena, Secrets Manager, CodeBuild, CodeDeploy, and CodePipeline
- Excellent communication skills (both written and verbal)
- Knowledge or experience working in private equity (preferred)
- Excellent team player, adaptable and flexible with a zeal to learn
- High attention to detail, with the ability to work in a dynamic environment whilst maintaining high-quality standards and a natural aptitude to develop good internal working relationships
- Strong track record of excellent results delivered to internal and external clients
- Ability to work independently without the need for close supervision and work collaboratively as part of cross-team efforts
- Experience delivering projects in an agile environment
Company: Acuity Knowledge Partners
Company email: [email protected]
Job Location: Colombo
Job Category: Software Development / Web / QA / Data / GIS
Job Type: Full Time
