Summary: The role is for a senior Data Engineer with a focus on machine learning and strong Python development skills. The position requires experience with Google Cloud Platform (GCP) and various data management tools. The role is hybrid, requiring 2-3 days per week on-site in London. The contract duration is for 6 months or more.
Key Responsibilities:
- Develop and manage data pipelines using Python.
- Utilize blob storage for unstructured data, preferably with Google Cloud Storage or AWS S3.
- Implement data loading and dataset management using PyTorch.
- Work with BigQuery in GCP and SQL databases.
- Manage memory effectively in data processing tasks.
- Collaborate with clients on-site in London for part of the week.
Key Skills:
- Strong Python development experience.
- Experience with blob storage, particularly Google Cloud Storage or AWS S3.
- Proficiency in PyTorch for data loading and dataset management.
- Experience with BigQuery in GCP.
- Knowledge of SQL databases, such as Microsoft SQL Server or PostgreSQL.
- Experience with other GCP services is a plus.
- Machine learning experience is desirable.
Salary (Rate): undetermined
City: London
Country: United Kingdom
Working Arrangements: hybrid
IR35 Status: undetermined
Seniority Level: Senior
Industry: IT
Data Engineer
Contract
6 Months+
Hybrid working
We are seeking a senior Data Engineer (L3) with ML experience (proven years of commercial experience).
Must have:
- Strong Python development
- Blob storage - object storage for unstructured data ( experience with Google cloud storage (GCS preferred) or AWS S3)
- PyTorch experience, especially on using PyTorch on data loading and dataset management
* It is essential you will have strong experience on GCP.*
Should have:
- BigQuery in GCP
- SQL Database, eg Microsoft Sql Server Database (preferred), PostgreSQL, etc.
- Memory management
Nice to have:
- Experience with other GCP services, such as Cloud Run, Cloud SQL, Cloud Scheduler, etc.
- Experience with Machine Learning
This will be a hybrid role with 2-3 days per week on client site (London)
Full details given upon application
Disclaimer:
This vacancy is being advertised by either Advanced Resource Managers Limited, Advanced Resource Managers IT Limited or Advanced Resource Managers Engineering Limited ("ARM"). ARM is a specialist talent acquisition and management consultancy. We provide technical contingency recruitment and a portfolio of more complex resource solutions. Our specialist recruitment divisions cover the entire technical arena, including some of the most economically and strategically important industries in the UK and the world today. We will never send your CV without your permission. Where the role is marked as Outside IR35 in the advertisement this is subject to receipt of a final Status Determination Statement from the end Client and may be subject to change.
