Senior Data Engineer for Connected Services
Job Description
As a Data Engineer in the Engineering and Data Solutions department you will work with us on creating software products with a strong focus on security, quality and automation for continuous data flow in the scope of vehicle-to cloud ecosystem, working together with an internationally distributed team, in a hybrid working model. Become part of our team and join us in creating state of the art data products.
In your role you will:
• Develop data integration solutions for large scale automotive R&D; applications
• Design, test and document, reliable and excellent quality data integration solutions
• Design Proof-of-concepts and pitch for implementation.
• Contribute to the architecture and implementation of software products for (near)-real time processing.
• Develop solutions for scalable and automatic data processing, involving Extract, Load, Transform (ETL/ELT) in Big Data frameworks
• Create and maintain data visualizations in close collaboration with domain experts
• Work in an agile environment with an internationally distributed team and collaborate closely with key stakeholders (Project Leaders, Product Owners, Solution Architects)
• Present and communicate solutions to an international audience
• Guide and mentor new team members
Technology stack:
• Python (with focus on data libraries: pandas, numpy, scipy etc.)
• Optional: Golang, Scala, Java
• Apache Spark / Pyspark
• Big Data platforms: on premises (Hadoop) and Cloud (Azure Databricks/Synapse/Data Factory)
• Automation: Azure DevOps/Pipelines / Apache Airflow / Jenkins
• Streaming and Messaging: Apache Kafka, RabbitMQ, MQTT
• Virtualization: Docker/Kubernetes
• Relational DBs (Oracle, mySQL) and noSQL DBs (MongoDB)
• Data Visualization (e.g. Tableau, PowerBI)
• Version source control (e.g. Git, Bitbucket)
Requirements
Function: Information Technology
Experience Level: Mid-Senior Level