Senior Data Engineer
Engineering | Marseille or Remote
Role Overview
We are looking for an experienced and resourceful Senior Data Engineer to design and enhance the data infrastructure that powers Syroco’s innovative solutions. In this role, you will take ownership of data ingestion pipelines, working with diverse data sources such as IoT sensor data from vessels, weather data, and operational metrics. You will be responsible for revamping and scaling our existing data pipeline, creating robust, scalable, and efficient systems that enable real-time insights and analytics.
Your expertise will guide the architectural evolution of our data platform, helping us transition to cutting-edge tools and methodologies like Airflow, dbt, or other data ingestion solutions.
A key aspect of this role is to incorporate data validation checks, anomaly detection, and automated quality gates into the pipeline to ensure data integrity and reliability.
Additionally, your ability to work with sensor data and time-series databases will ensure Syroco’s solutions remain at the forefront of maritime technology. This is an exciting opportunity to have a direct impact on transforming how data is leveraged to drive sustainability in the shipping industry.
Key Responsibilities
- Data Pipeline Development:
- Overhaul and optimize Syroco’s existing data pipeline, introducing tools and frameworks to enhance performance and scalability.
- Architect and implement new data ingestion frameworks that handle diverse sources, including IoT sensor data, weather, operational data by using different interfaces such as APIs, web applications scrapping, emails, …
- Implement robust data validation checks, anomaly detection mechanisms, and automated quality gates to ensure data consistency and reliability.
- Data Architecture:
- Design systems for data storage, transformation, and retrieval, ensuring efficient handling of time-series data and large datasets.
- Collaborate with cross-functional teams to define data requirements and ensure seamless integration into products and analytics workflows.
- Tooling and Automation:
- Evaluate and integrate modern data tools such as Airflow, Spark, dbt, or other suitable platforms for data ingestion and orchestration.
- Develop robust monitoring and alerting mechanisms for data pipelines.
- Collaboration and Leadership:
- Work closely with data scientists, ML and software engineers, and product teams to align data solutions with business needs.
- Mentor junior engineers, fostering a culture of excellence in data engineering practices.
- Observability:
- Implement and maintain monitoring and alerting solutions using tools like Datadog and PagerDuty to guarantee system health and uptime.
- Infrastructure Management:
- Oversee and maintain the cloud infrastructure required for data pipelines, leveraging AWS services such as Lambda, Step Functions, and RDS.
Qualifications and Experience
- Technical Expertise:
- 5+ years of experience in data engineering, with a strong focus on building and managing data pipelines.
- Proficiency in Python or a similar programming language.
- Experience working with sensor data, time-series databases (e.g., TimescaleDB, InfluxDB), and large-scale distributed systems.
- Strong knowledge of cloud platforms, preferably AWS, and tools like S3, ECS, Lambda, and Step Functions.
- Tools and Frameworks:
- Hands-on experience with modern data orchestration and transformation tools like Airflow, dbt, Spark, or similar platforms.
- Familiarity with ETL/ELT best practices and tools for data ingestion as a service.
- Problem Solving:
- Ability to diagnose and resolve data pipeline issues in real-time.
- Experience optimizing data pipelines for performance and cost efficiency.
- Collaboration:
- Proven ability to work cross-functionally with data scientists, software engineers, and other stakeholders to deliver high-impact solutions.
- Observability:
- Proven ability to implement monitoring and alerting solutions using Datadog or similar tools.
- Mindset:
- Alignment with Syroco’s engineering principles:
- Think about problems before talking about solutions.
- Never assume, always check.
- Done is better than perfect.
- You build it, you run it.
- Production first.
- Share more, learn more.
- Only the paranoid survive.
- Alignment with Syroco’s engineering principles:
- Language Skills:
- Proficiency in English (written and spoken) is required.
What We Offer
- The opportunity to work on impactful projects at the forefront of maritime innovation.
- The chance to make a tangible difference in reducing the carbon footprint of the maritime industry.
- Competitive compensation package commensurate with experience.
- Access to company equity.
- Collaborative work environment with a commitment to sustainability and excellence.
- Professional growth and development opportunities.
- Pleasant working conditions, close to the Vieux Port of Marseille for onsite employees or remote visits.
- Remote work possible, with periodic visits to Marseille (every 6 weeks): you should be based in the European Union, +/- 1-hour time difference with France, and within half-a-day of transportation at most.