Senior Big Data Engineer

This job is with eBay, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly.

At eBay, we're more than a global ecommerce leader — we're changing the way the world shops and sells. Our platform empowers millions of buyers and sellers in more than 190 markets around the world. We're committed to pushing boundaries and leaving our mark as we reinvent the future of ecommerce for enthusiasts.

Our customers are our compass, authenticity thrives, bold ideas are welcome, and everyone can bring their unique selves to work — every day. We're in this together, sustaining the future of our customers, our company, and our planet.

Join a team of passionate thinkers, innovators, and dreamers — and help us connect people and build communities to create economic opportunity for all.

At eBay buyer experience, we develop AI/ML models that directly affects the usability of our site/app.

Our Recommendations Team Works On Delivering Recommendations At Scale And In Near Real Time To Our Buyers On Our Website And Native App Platforms. Recommendations Are a Core Part Of How Our Buyers Navigate EBay's Vast And Varied Inventory. Our Team Develops State-of-the-art Recommendations Systems, Including Deep Learning Based Retrieval Systems For Personalized Recommendations, Machine Learned Ranking Models, As Well As Advanced MLOps In a High Volume Traffic Industrial E-commerce Setting.We Are Building Cutting Edge Recommender Systems Powered By The Latest ML, NLP, LLM And AI Techniques. Some Papers Published By Our Research Team Lately

Automatic Future Product Releases Extraction from Web Data

Personalized Ordering of Recommendation-Modules on an E-Commerce Homepage

Responsibilities

Working with our AI/ML researchers and our Buyer Product group - Senior Big Data Engineer handles

• ETL data pipelines
• Model training
• Model deployment
• Analysis and monitoring
  
  

Need To Manage Integration Points With The Following Groups

• Researchers
• Product
• Platforms
• Data
• Application backend
  
  

This requires good written communication skills in English.

Required Experience

• Python - 6+ years
• Apache Spark (pyspark) 6+ years
• SQL
• model deployment
• dockers
  
  

Additional Optional Experience

• Backend - Java/Scala
• Orchestration AirFlow/Jenkins
• Near Real Time processing - Apache Flink/ Spark Streaming
  
  

Please see the Talent Privacy Notice for information regarding how eBay handles your personal data collected when you use the eBay Careers website or apply for a job with eBay.

eBay is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, national origin, sex, sexual orientation, gender identity, veteran status, and disability, or other legally protected status. If you have a need that requires accommodation, please contact us at [email protected]. We will make every effort to respond to your request for accommodation as soon as possible. View our accessibility statement to learn more about eBay's commitment to ensuring digital accessibility for people with disabilities.

Jobs posted with location as "Remote - United States (Excludes: HI, NM)" excludes residents of Hawaii and New Mexico.

This website uses cookies to enhance your experience. By continuing to browse the site, you agree to our use of cookies. Visit our Privacy Center for more information.