Data Platform Engineer (Enterprise Data Lake)

Responsibilities

• Build pipelines to ingest, transform, and store data (Hive/S3, IBM MQ, XML ingestion)
• Develop XML based ingestion pipeline into Data Platform using Hive/S3
• Develop IBM MQ native based schemaless data ingestion
• Prepare datasets and resolve data issues
• Support relevant business stakeholders
• Ensure adherence to data classification, sensitivity, and banking regulations

Requirements

• Several years of experience in data engineering or architecture
• Hands-on Big Data experience using common open source components (Hadoop, Hive, Spark, Trino, Airflow/NiFi, MinIO, K8S, Kafka)
• SQL expertise preferably in mixed environments (traditional DWH and distributed platforms)
• Experience with XML-based ingestion pipelines and IBM MQ
• Very good knowledge around financial data classification / sensitivity
• Excellence business stakeholder management
• Fluent in English

Nice to have

• Knowledge of metadata management and related tools
• Understanding of data modelling standards, processes and tools (cleansing, Meta Data)
• Knowledge of DataIQ and Hackolade

Personality

• Working under pressure to resolve unknown roadblocks
• Excellent business stakeholder management
• Working in cross-divisional setup between IT and Business

We offer exiting opportunities to work in the complex IT environments of leading banking and insurance companies in Switzerland. We are a fair employer with a personal touch for Swiss and EU residents paying great attention to working conditions, further training and development. If you are a strong IT specialist - for this role or in general - please do not hesitate to submit your application and to discuss further details directly.