Senior Backend Engineer - Data Extraction

At Similarweb, we are revolutionizing the way businesses interact with the digital world by revealing to them everything that happens online.

Our unique data and solutions empower over 4,300 customers globally, including industry giants like Google, eBay, and Adidas, to make game-changing decisions that drive their digital strategies.

In 2021, we went public on the New York Stock Exchange, and we continue to reach new heights! Come work alongside Similarwebbers across the globe who are bright, curious, practical and good people.

We’re looking for an Experienced Backend/Data Engineer to take an important part in SimilarWeb’s data extraction team and play a key role in our growing data acquisition operation.

This role will report to Team manager- R&D.

Why is this role so important at Similarweb?

Similarweb is a data-focused company, and data is the heart of our business. As a data server engineer, you will work in one of the company’s core teams and design and implement complex, high-scale systems that retrieve and analyze data from around the internet.

Backend engineers on Data-Extraction are responsible for

• Scraping - Building and maintaining high scale web-scraping operations.
• Processing - Creating complex data pipelines that process and enrich our raw data and serve it to different consumers through various databases and data-lakes.
• Engineering - Designing and building large scale, high quality systems to support our data infrastructure and production systems
  
  

• Write complex PySpark applications that process, manipulate and validate large datasets, in high quality and under strict SLA.
• Develop dockerized high performance microservices.
• Take a major part in designing and implementing complex high scale systems using a large variety of technologies.
• Work in a team with talented and independent engineers with whom you’ll be able to share knowledge and expertise.
• learn new technologies, handle a multitude of systems.
• Implement solutions in AWS cloud environment.
• Take part in monitoring and debugging data pipelines and high scale services in order to identify and fix bottlenecks and failures.
  
  

• Has at least 5 years of server-side software development experience in one or more general purpose programming languages (C#, Java, Python etc.)
• Holds a BSc degree in Computer Science or equivalent practical experience.
• Has Experience with Big Data technologies such as Hadoop, Spark, Databricks and Airflow.
• Worked in a cloud environment such as AWS or GCP, and is familiar with its different services, as well as docker and Kubernetes
• Has experiences with web scraping technologies or familiar with web technologies and the internet’s internals - a big advantage.
• Is comfortable taking on challenges and learning new technologies, including new coding languages.
• Is a team player and likes giving and receiving constructive feedback
• Can effectively prioritize tasks, multitask and work independently
• Has good communication skills and enjoys helping and supporting team members as well as people from other groups