Data Engineer

Intelos is a dynamic and rapidly growing tech startup that specializes in leveraging proprietary mapping technology. Our cutting-edge solutions collect and analyze data from diverse sources, including mobile devices, desktops, and private databases. With innovative methods, we track and analyze a wide range of predefined attributes, such as geographics, demographics, psychographics, and more.

We are seeking a dedicated software Big Data engineer to join our growing company. The ideal candidate will have strong programming skills, particularly in languages commonly used for data processing and analysis (such as Python, Java, or Scala). They should also have experience with a variety of big data technologies, such as Hadoop, Spark, and SQL, as well as a strong understanding of data management and data warehousing principles. In addition, strong communication skills and the ability to work well with cross-functional teams are crucial for success in this role.

Responsibilities

• Designing and implementing data pipelines to collect, process, and store large volumes of data from a variety of sources
• Developing and maintaining data infrastructure, including data warehouses, data lakes, ETL and other storage systems
• Collaborating with data scientists and analysts to understand their data needs and ensure that the data infrastructure meets those needs
• Building and deploying data processing systems (Spark) to handle large-scale data analysis tasks
• Optimizing data pipelines and processing systems to improve performance and scalability
• Developing and implementing data governance policies to ensure the integrity and security of the organization's data

Qualifications

o   At least 4 years of experience as a data engineer of big data solutions

o   Experienced in Spark/Pyspark/Apache Spark – a must.

o   Experience developing and maintaining data infrastructure, including data warehouses, data lakes, ETL and other storage systems.

o   Strong skills in writing advanced SQL Code and SQL database design.

o   Knowledge of programming in Python

o   Great numerical and analytical skills

o   Deep understanding of predictive modeling, machine-learning, clustering, and classification techniques

o   Bachelor's degree or equivalent experience in Computer Science, master’s degree is a plus.