Summary: The role of Data Engineer - Machine Learning involves designing and implementing data pipelines and machine learning models in a London-based contract position. Key responsibilities include setting up Redis clusters, managing Kafka/Flink streaming pipelines, and utilizing AWS services like S3 and SageMaker. The position requires expertise in real-time data processing and machine learning frameworks such as Pytorch.
Key Responsibilities:
- Redis cluster setup
- Kafka/Flink streaming pipelines
- S3 Data pipeline
- Real-time micro batches implementation (5 minutes, hourly, daily)
- Mongo/Atlas as alternative implementation
- SageMaker MLOps / SageMaker Training / SM Model Deployment
- Pytorch
Key Skills:
- Redis
- Kafka
- Flink
- AWS S3
- MongoDB/Atlas
- SageMaker
- Pytorch
Salary (Rate): undetermined
City: London
Country: United Kingdom
Working Arrangements: undetermined
IR35 Status: undetermined
Seniority Level: undetermined
Industry: IT
Role : Data Engineer - Machine Learning
Location : London
Contract Role
Job Description – Skills
- Redis cluster setup
- Kafka/Flink streaming pipelines
- S3 Data pipeline
- Real-time micro batches implementation (5 minutes, hourly, daily)
- Mongo/Atlas as alternative implementation (we might land with S3 instead)
- SageMaker MLOps / SageMaker Training / SM Model Deployment
- Pytorch