Senior Data Engineer

Join a Company That Invests in You

Seeking Alpha is the world's leading community of engaged investors. We’re the go-to destination for investors looking for actionable stock market opinions, real-time market analysis, and unique financial insights. At the same time, we’re also dedicated to creating a workplace where our team thrives. We’re passionate about fostering a flexible, balanced environment with remote work options and a variety of perks that make a real difference.

Here, your growth matters. We prioritize your development through ongoing learning and career advancement opportunities, helping you reach new milestones. Join Seeking Alpha to be part of a company that values your unique journey, supports your success, and champions both your personal well-being and professional goals.

What We're Looking Fo

rSeeking Alpha is looking for a Senior Data Engineer to design, build, and maintain data infrastructure for large-scale analysis. The role includes managing ETL processes and data warehousing, working with big data technologies (e.g., Hadoop, Spark, NoSQL), and collaborating with data and business teams to align infrastructure with company goal

s
What You'll

• DoWork closely with data scientists/analytics and other stakeholders to identify and prioritize data engineering projects and to ensure that the data infrastructure is aligned with business goals and objectiv
• esDesign, build and maintain optimal data pipeline architecture for extraction, transformation, and loading of data from a wide variety of data sources, including external APIs, data streams, and data store
• s.Continuously monitor and optimize the performance and reliability of the data infrastructure, and identify and implement solutions to improve scalability, efficiency, and securi
• tyStay up-to-date with the latest trends and developments in the field of data engineering, and leverage this knowledge to identify opportunities for improvement and innovation within the organizati
• onSolve challenging problems in a fast-paced and evolving environment while maintaining uncompromising qualit
• y.Implement data privacy and security requirements to ensure solutions comply with security standards and framework
• s.Enhance the team's dev-ops capabilitie

s.
Requireme

• ntsBachelor's or Master's degree in Computer Science, Engineering, or a related fi
• eld2+ years of proven experience developing large-scale software using an object-oriented or functional langua
• ge.5+ years of professional experience in data engineering, focusing on building and maintaining data pipelines and data warehou
• sesStrong experience with Spark, Scala, and Python, including the ability to write high-performance, maintainable c
• odeExperience with AWS services, including EC2, S3, Athena, Kinesis/Firehose Lambda and
• EMRFamiliarity with data warehousing concepts and technologies, such as columnar storage, data lakes, and
• SQLExperience with data pipeline orchestration and scheduling using tools such as Airf
• lowStrong problem-solving skills and the ability to work independently as well as part of a t
• eamHigh-level English - a mu
• st.A team player with excellent collaboration skil

ls.
Nice to H

• ave:Expertise with Vertica or Redshift, including experience with query optimization and performance tu
• ningExperience with machine learning and/or data science proj
• ectsKnowledge of data governance and security best practices, including data privacy regulations such as GDPR and C
• CPA.Knowledge of Spark internals (tuning, query optimizat