Senior Data Engineer - Data Lake Migration & Modernization - Gaming

ERNI Spain · Madrid, Spain

No Spanish requiredPosted 3 days ago

You apply off-site, with the employer or the job board. I never handle applications.

Can you imagine accelerating a large-scale Data Lake modernization project while working with AWS and Apache Iceberg? ️

Join our expert team to work on a Data Platform Modernization initiative, contributing to the migration and evolution of a cloud-native data ecosystem. You will apply your knowledge of AWS, Apache Iceberg, Python, DuckDB and SQL to improve scalability, governance, performance and reliability across the platform. At ERNI, you are never just a number. Even if you work on an external project, you will feel part of the team and always supported.

At ERNI, you are never just a number. Even if you work on an external project, you will feel part of the team and always supported.

How do we make this happen?

With people. Besides your team and manager, you will have several support figures like a godparent, who will help you with the practical and administrative aspects of daily life during your first 6 months.

And the second most important person after you, your mentor, who will guide you through your entire onboarding and career at ERNI. You will have regular 1:1 meetings with them, and recurrently, you will work on your development plan to define your short-, medium-, and long-term goals.

At ERNI, we highly value experience and technical knowledge. As a senior profile, you will have the space to continue growing, whether by deepening your technical skills or having greater influence on project decisions, with autonomy and the opportunity to share knowledge with other experts.

And if you are interested in mentoring, there is also space for that: supporting other ERNIans while still focusing on the technical excellence that sets us apart.

What you will bring

4 to 6+ years of experience in Data Engineering and cloud-native data platforms.
Hands-on experience with AWS services such as S3, Athena, Redshift and Lambda.
Experience working with Apache Iceberg, Delta Lake or Hudi and strong knowledge of data modeling, partitioning and schema evolution.
Proficiency in Python, SQL, DuckDB or similar transformation technologies and Docker.
Experience with Git and performance optimization of analytical workloads.

You will be responsible for accelerating the migration of datasets and pipelines to an Apache Iceberg architecture while developing Python-based data processing jobs and SQL transformations with DuckDB. You will optimize performance and cost efficiency, manage Redshift data structures and views, participate in testing and code reviews, and ensure proper documentation and knowledge transfer across the project.

What if the project ends?

We work on a wide variety of projects, technologies, and sectors, allowing you to keep growing in different environments. If a project ends or you feel ready for a new challenge, we will find another one that aligns with your professional development.

Our working model ‍

We ask you to be available for key meetings. Need to leave for a doctor’s appointment or to pick up your child from school? No problem. We trust you to deliver quality work within your 40-hour workweek.

Our model is hybrid: we usually go to the office 2 days a week, though this depends on the project and team, but we love seeing each other’s faces; the best stories always happen in the office!