Backend Engineer (Web Scraping & Data Extraction Specialist)
Key information
- Publication date:11 October 2024
- Workload:100%
- Contract type:Unlimited employment
- Language:English (Fluent)
- Place of work:Rötelstrasse 84, 8057 Zürich
Similarweb’s mission is to create the most accurate, comprehensive, and actionable Digital Data, so every business can win their market, and the acquisition of 42matters completes an important part of that picture.
42matters has been a vital partner in Similarweb's App Intelligence offering for 2 years, providing essential data that has helped app creators and owners gain a competitive edge. Similarweb's collaboration with 42matters’ team has been seamless, and now, as colleagues, we can achieve even greater heights together.
At Similarweb, we are revolutionizing the way businesses interact with the digital world by revealing to them everything that happens online. Our unique data and solutions empower over 4,800 customers globally, including industry giants like Google, eBay, and Adidas, to make game-changing decisions that drive their digital strategies. In 2021, we went public on the New York Stock Exchange, and we continue to reach new heights! Come work alongside Similarwebbers across the globe who are bright, curious, practical and good people.
We are looking for a Backend Engineer (Web Scraping & Data Extraction Specialist) to join our Zurich team, this role will report to Director, R&D.
So, what will you be doing all day?
- Design, implement, and maintain crawlers to aggregate data from diverse sources, ensuring data quality and accuracy.
- Design and maintain data pipelines for ETL processes, utilizing both traditional and large-scale distributed technologies to handle collected data.
- Continuously improve and optimize existing services and applications for better performance and scalability.
- Help build a reliable, sustainable and scalable data infrastructure.
- Lead new projects from inception or refactor existing systems to meet evolving business needs.
This is the perfect job for someone who:
- 3+ years of work experience in automated data collection, cleaning, and processing.
- Experience with Amazon Web Services (e.g. ECS or EKS, SQS, Firehose).
- Strong knowledge of Java (frameworks are not required)
- Understanding of Python basics and the interest to dive into it
- Hands-on experience with Docker.
- Familiarity with NoSQL databases (e.g., MongoDB, DynamoDB).
- Good abilities in DevOps.
- Fluent English.
Preferred qualifications:
- Strong educational background: Bachelor/Master degree in CS or other technical/science/math field.
- Experience with major crawling libraries (e.g. jsoup, selenium, scrapy, beautifulsoup)
- Experience with Spark or Databricks will be considered an advantage.
- Proven ability to identify and resolve performance issues efficiently.
Why you’ll love being a Similarwebber:
You’ll actually love the product you work with: Our customers aren’t our only raving fans. When we asked our employees why they chose to come work at Similarweb, 99% of them said “the product.” Imagine how exciting your job is when you get to work with the most powerful digital intelligence platform in the world.
You’ll find a home for your big ideas: We encourage an open dialogue and empower employees to bring their ideas to the table. You’ll find the resources you need to take initiative and create meaningful change within the organization.
We offer competitive perks & benefits: We take your well-being seriously and offer competitive compensation packages to all employees. We also put a strong emphasis on community, with regular team outings and happy hours.
You can grow your career in any direction you choose: Interested in becoming a VP or want to transition into a different department? Whether it’s Career Week, personalized coaching, or our ongoing learning solutions, you’ll find all the tools and opportunities you need to develop your career right here.
Diversity isn’t just a buzzword: People want to work in a place where they can be themselves. We strive to create a workplace that is reflective of the communities we serve, where everyone is empowered to bring their full, authentic selves to work. We are committed to inclusivity across race, gender, ethnicity, culture, sexual orientation, age, religion, spirituality, identity and experience. Our culture of equality and mutual respect also helps us better understand and serve our customers in a world that is becoming more global, more diverse, and more digital every day.
Contact
- Andrea Giarardello
42matters AG (Similarweb company)