FULL_TIME

Python Data Engineer - Visser & Van Baars

Antwerpen, Antwerp BE
2025-04-03
2025-04-04

Let's take your Data Engineering career to the next level!

We are looking for a skilled Python Data Engineer to join our client's dynamic team. If you are passionate about building scalable data solutions and optimizing performance in a cloud-based environment, this role is for you! You will play a crucial role in designing and implementing data processing workflows, integrating APIs, and working with cutting-edge technologies like Azure Databricks and Apache Spark.

Key Responsibilities

  • Develop, optimize, and maintain data pipelines using Python and Apache Spark.
  • Work with Azure Databricks to manage clusters, workflows, and asset bundles.
  • Implement and manage CI/CD pipelines in Azure DevOps, including YAML pipelines and release management.
  • Build and expose REST APIs for seamless data integration with other applications.
  • Optimize Spark jobs for performance and scalability.
  • Collaborate with cross-functional teams to translate business requirements into technical solutions.
  • Ensure data quality, security, and governance best practices are followed.

 

Required Experience & Skills

  • Proven experience as a Data Engineer.
  • Strong programming skills in Python, including experience with REST APIs and data processing libraries (PySpark, Requests, Pandas).
  • Hands-on experience with Azure Databricks (clusters, workflows, Databricks asset bundles, and frameworks).
  • Experience implementing CI/CD pipelines using Azure DevOps.
  • Strong knowledge of Apache Spark and the ability to optimize Spark jobs.
  • Ability to design and expose APIs for application integration.
  • Experience in an industrial B2B market is a plus.
  • Strong problem-solving skills and attention to detail.
  • Effective communication skills and the ability to work collaboratively in cross-functional teams.

Nice to Have

  • Knowledge of Azure MLflows.
  • Experience with Scala (ability to read and understand existing code).

  • Familiarity with Agile methodologies, including implementing design and testing strategies.

     

Offer

Our client offers a stimulating work environment where innovation and collaboration are key. They foster an open and diverse company culture and prioritize flexibility to ensure a healthy work-life balance. This is an exciting opportunity to work with cutting-edge technologies while continuously developing your skills in a supportive environment.

About the Client

Our client offers a stimulating work environment where you can continuously develop your skills. They foster an open and diverse company culture that prioritizes innovation and collaboration. Additionally, they offer flexibility to help maintain a healthy work-life balance.

If this sounds like the perfect next step for you, let's connect!

Send me a message or apply now.
0471 38 86 98