Data Engineer

TeamUp (by AT&T) helps engineering leaders, managers, and developers improve daily.

We’re building a big-data SW intelligence platform that turns data generated throughout the SW development lifecycle (code, user stories, pipelines, scanning tools) into insights and optimization tools to help 1000+ R&D teams in AT&T continuously improve while developing products for dozens of millions of customers to use.

We are looking for an experienced data engineer with a passion for engineering practices to join our team and help to redefine software excellence in the industry.

You will have an opportunity to own the whole data flow, from fetching the data and until visualizing it for users.

Your Responsibilities:

• Be responsible for designing the full data flow, from extraction to visualizing in external tools, implementing, and maintaining it
• You will translate User and Product manager requirements into a technical design and implement it to be part of large data engineering solutions
• Support robust, scalable solutions to enhance business analysis capabilities, identify gaps and design processes, and fill them
• Work with cutting-edge big-data tools and techniques
• Collaborate with R&D, architects, data scientists, analysts, Projects Managers and DevOps in order to deliver the right solution

Requirements:

• At least 3 years of experience in Big-Data technologies as a data engineer, including ETL/ELT processes and data exploration
• At least 3 years of experience with Spark, Spark Streaming, Databricks, Airflow and other components required in building end-to-end data pipelines.
• At least 3 years of experience in Python programming and SQL queries
• At least 1 year of experience in data visualization tools, such as PowerBI, Tableau
• At least 1 year of experience in cloud big data solutions and architectures (Azure)
• Deep knowledge of Big Data design principles and guidelines
• Strong experience in Javascript/Java programming languages
• Excellent interpersonal and communicational skills, a team player
• Excellent self-management skills, ownership skills, and understanding of the business
• Bachelor in Mathematics/Statistics/Computer Science