Job description
Job Opportunity: Real-Time Data Engineer
Location: Sydney
Contract Type: Contract
Start Date: "ASAP"
Join a high-impact digital transformation initiative focused on implementing scalable, low-latency, and fault-tolerant real-time data pipelines to process and store digital payment transactions at scale.
🔧 Your Role
As a Real-Time Data Engineer, you will:
Design and develop high-performance real-time data pipelines using AWS, Apache Spark, Kafka, Python, and Spark Streaming.
Collaborate with cross-functional teams to implement secure and reliable data flows for digital payment processing.
Execute performance testing and tuning to ensure compliance with strict SLA thresholds.
Optimize data storage and retrieval using DynamoDB and other AWS services.
🛠Tech Stack
Cloud: AWS (Lambda, S3, EMR, etc.)
Data Processing: Apache Spark, Spark Streaming
Languages: Python
Messaging: Apache Kafka
Database: DynamoDB
✅ Ideal Candidate
You are someone who thrives in a fast-paced, data-intensive environment and has:
Proven experience in building real-time data systems on cloud infrastructure.
Strong hands-on expertise in Python, Kafka, Spark, and AWS ecosystem.
A passion for scalable architecture, fault-tolerance, and performance optimizatio
To be considered for the role click the 'apply' button or for more information about this and other opportunities please contact Yash Kumar Jain on 03 8680 4235 or email: [email protected] and quote the above job reference number.
Paxus values diversity and welcomes applications from Indigenous Australians, people from diverse cultural and linguistic backgrounds and people living with a disability. If you require an adjustment to the recruitment process, including the application form in an alternate format, please contact me on the above contact details.
