Sr Data Engineer
Job Description:
Summary
We are seeking a highly skilled and motivated Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in data engineering, with a strong focus on Databricks, Python, and SQL. As a Data Engineer you will play a crucial role in designing, developing, and maintaining our data infrastructure to support various business needs.
Key Responsibilities
- Develop and implement efficient data pipelines and ETL processes to migrate and manage client, investment, and accounting data in Databricks
- Work closely with the investment management team to understand data structures and business requirements, ensuring data accuracy and quality.
- Monitor and troubleshoot data pipelines, ensuring high availability and reliability of data systems.
- Optimize database performance by designing scalable and cost-effective solutions.
What’s on offer
- Competitive salary and benefits package.
- Opportunities for professional growth and development.
- A collaborative and inclusive work environment.
- The chance to work on impactful projects with a talented team.
Candidate Profile
Experience:
- 5+ years of experience in data engineering or a similar role.
- Proficiency in Apache Spark. Databricks Data Cloud, including schema design, data partitioning, and query optimization
- Exposure to Azure.
- Exposure to Streaming technologies. (e.g Autoloader, DLT Streaming)
- Advanced SQL, data modeling skills, and data warehousing concepts tailored to investment management data (e.g., transaction, accounting, portfolio data, reference data etc).
- Experience with ETL/ELT tools like snap logic and programming languages (Python/Scala/R programming).
- Familiarity with workload automation and job scheduling tools such as Control M.
- Familiar with data governance frameworks and security protocols.
- Excellent problem-solving skills and attention to detail.
- Strong communication and collaboration skills.
Education
- Bachelor’s degree in computer science, IT, or a related discipline.
Key Skills :
Company Profile
------ helps forward-looking companies and organizations in the financial services, manufacturing, and higher education/public services sectors innovate and achieve a better future faster. Clients rely on ------ for domain expertise, innovation, modernization, and the creative use of emerging technologies. Dedication to client success, deep expertise in leading capabilities in business and technology transformation has been the cornerstone for success to our people, clients, partners and the planet. The world’s most innovative and valuable companies work with ------ for their transformation journeys.
With headquarters in the U.S., the company has more than 2,500 employees in locations spread across five countries. For more information, please visit the company website www.------.com
Apply Now
- Interested candidates are requested to apply for this job.
- Recruiters will evaluate your candidature and will get in touch with you.