Senior Data Engineer

Senior Data Engineer

Location – Macquarie Park, Sydney preferred

• Our data team is growing & we need an MS data specialist.

• Join an ambitious firm which is growing, evolving & increasing its headcount.

• Allied Credit has a hybrid work environment; we understand the value of a work-life balance.

Allied Credit is a leading vehicle finance firm with strategic alliances with global car, marine and motorcycle brands. Offering white label, joint venture and floorplan finance, our proprietary software provides a seamless, convenient and customer-focused finance service to consumers and businesses.

We are seeking a Senior Data Engineer to bring a deep expertise in Microsoft Data technologies and a strong background in data engineering to play a critical role in designing, building and maintaining robust and scalable data pipelines, which are capable of handling large volumes of real-time data.

What you will be doing

• Design, develop, and maintain scalable and reliable data pipelines using Fabric.

• Integrate various data sources (databases, APIs, file systems, etc.) with Kafka and downstream systems to ensure seamless data flow.

• Implement real-time data processing solutions using stream processing frameworks such as Kafka Streams, Apache Flink or Apache Spark Streaming.

• Continuously monitor Azure/Fabric data pipelines, identify issues and troubleshoot to ensure smooth data flow and minimal downtime.

• Enforce data quality checks and compliance with data governance standards, while maintaining data security and privacy.

• Partner with Data and Project teams/Data Architect to build and sustain the data infrastructure, providing technical guidance and mentorship to junior data engineers.

• Optimize the performance of Azure/Fabric data pipelines to manage increasing data loads and maintain low latency.

• Create and maintain comprehensive documentation for data pipelines and associated processes.

Your background

• Tertiary qualifications, ideally a Masters, in computer science, engineering or a related field, and certification in Power BI.

• Experience with machine learning pipelines, integrating real-time data streams, and building AI models.

• Familiarity with event-driven architectures and microservices.

• Extensive experience as a Data Engineer or similar role, with a strong focus on real-time data streaming.

• Proven experience with Microsoft Fabric, Power BI, Azure Data Lake, Azure Data Factory, Azure Data Warehouse, Azure DevOps, SQL Server and Python.

• Familiarity with CI/CD pipelines and distributed systems with a solid understanding of data architecture principles.

• Excellent communication and problem-solving skills with the ability to thrive in a fast-paced environment.

Why work for Allied Credit?

• Work-life balance – hybrid working arrangements allow a balance of working from home and the office, and we are always willing to discuss flexible working options.

• Wellness day to take a day off for some R&R around your birthday and a Volunteer Day to support your community.

• Discount offers on selected retailers, car loans and novated leasing options.

• A learning environment where we take your development and career aspirations seriously.

• 16 weeks of paid parental leave along with Salary Continuance Insurance.

We want individuals who will buy into and thrive with Allied Credit’s Values of Customer Focus, Adaptability, Risk Confidence, Integrity and Teamwork.

Allied Credit pledges to treat all candidates with the utmost respect and professionalism throughout the recruitment process. We promise to conduct a fair, transparent, and inclusive hiring process, ensuring that all candidates are evaluated based on their skills, experience, and potential, regardless of race, gender, age, disability, sexual orientation or any other irrelevant characteristic.

Please contact Alex Kelly on 0484 109 354 for a confidential discussion. For further information on Allied Credit, please visit our website at https://alliedcredit.com.au/ or email hrservices@alliedcredit.net.au.