Chapter Lead Data Engineering

Job description

What you will do
As a chapter lead, you…

• Mentor and manage the team of data engineers and provide technical guidance, support, and mentorship;
• Enable and encourage knowledge sharing within the chapter;
• Will be responsible for implementing and enforcing best practices in the chapter;
• Are the ambassador of the chapter towards the rest of the organization;
• Will evaluate new technologies and tools and make recommendations on how they can be used in the teams

You will also be practicing your data engineering skills in a domain based team. Some of the tasks that you will be involved with include:

• Design data modelling architecture;
• Build production grade data pipelines on different processing paradigms (streaming, batch and graph);
• Ingest data from a wide variety of sources with different sizes and formats;
• Use automated deployment tools and templates to deploy the solutions;
• Work with Spark Structured Streaming, Delta Live Tables and Change Data Capture to refresh data products that require low latency.

Our stack is mainly composed of the following tools: Python, Databricks, PySpark, AWS S3, EventBridge and Lambdas. As a chapter lead you will report directly to our CTO.

About Company.info
Company.info is part of FD Mediagroep and market leader in Dutch business information and insights. We are a fast-growing data company where data is the core product. We provide our clients with qualitative, up-to-date and in-depth business insights. We do everything we can to bring together all relevant data about companies, structure it and make it applicable for our customers. Company.info helps customers to be more innovative and successful.
We work with the latest technologies in flat structures and we like to see our people take responsibility so that we can take on the world. It's fun, it's fast and sometimes it's intense! So keep reading if this appeals to you.

The team
We are working on a multi-year big program where we completely redefine the way we build (data)products, including our current architecture and organisation. We do this using a domain driven architecture, with the goal of improving and aligning all our data processing and technical foundation. Part of successfully transforming the organization is to focus more on boosting our data engineering capabilities. Currently we are transitioning towards working in domain based teams, with skill & expertise based chapters.

Our Product & Tech department consists of 40 people. We are all passionate about our products, technology and data. Currently we are transitioning towards working in domain based teams, with skill & expertise based chapters. For the data engineering chapter we are looking for a Chapter Lead that has the drive to get the best out of the data engineering chapter. Next to that you will be part of a domain team, where we (aim to) have a combination of data engineers, back-end engineers and a flexible pool of data scientists and analysts.

Currently the data engineering chapter consists of two data engineers, who work together in one of the domain teams. We expect the data engineering chapter to grow to 6-8 people within in the next 2 years. In terms of management style, the organization is flat, relaxed and clear. The atmosphere is open, pleasant, social and fun.

What we offer
We offer you a dynamic, international oriented environment with innovative, challenging and diverse projects, using cutting-edge technology and directly benefiting our clients and our business managers at the same time.
We will make sure you have all the software and hardware (laptop, phone) required to perform at your highest level.

Next to that we offer:

• part-time and full-time possibilities, flexible hours;
• depending on your experience and skills a salary between €90.000 and €100.000 per year;
• flexibility to work a part of your time from your home-office;
• Because we work with the latest technologies, we offer the opportunity to keep on developing yourself by taking courses, attending (and presenting at) conferences, etc.;
• Very modern working environment, the office is new and specially furnished to the wishes of Company.info. The office is centrally located in Amsterdam and easily accessible by public transport;
• We offer support for the 30% ruling and a relocation-budget if you are currently not based in the Netherlands.

Job requirements

Who you are

Background:

• You have at least 5+ years of relevant working experience in the IT or data sector;
• Extensive experience in production grade data ingestion, processing, and modelling;
• Experience with cloud environments (preferably AWS);
• Preferably you have a Bachelor or Master in Computer Science, Software engineering, AI or a related field;
• Preferably you have experience managing or coaching people and teams.

Key technical skills and requirements

• Extensive experience with software development (Python);
• Experience with shipping production grade software;
• Experience with some of the tools we like to work with (in order of importance);
  • Spark (preferably Databricks);
  • AWS Services (Lambda, Eventbridge);
  • Data-stores (MySQL, PostgreSQL, Elasticsearch, …);
  • Infrastructure as code (Terraform, Cloudformation, …);
  • Monitoring and alerting (ELK, Grafana, Prometheus, …)

Competences

• Strong leadership, communication skills (written and spoken in English), and collaboration skills;
• Coach and encourage members of the chapter to achieve real personal development;
• Strong problem solving skills and capacity to learn and transfer new content quickly;
• Drive to develop innovative solutions and focus on continuous improvement.

Interested?

Great! We invite you to come in and check the office atmosphere (and our coffee) yourself. Let us know you are interested by sending us your resume or LinkedIN profile added with your contact details and we will get back to you shortly.

If you are a highly motivated, results-driven Chapter Lead Data Engineering looking for an exciting opportunity to make an impact, we encourage you to apply!