Lead Data Pipeline Engineer - Digital Measurement and Optimization

Minneapolis, Minnesota
Aug 15, 2019
Oct 28, 2019
Employment Status
Full Time

The Target Data Sciences and Big Data Platform Engineering team a hyper-growing, dynamic and collaborative team working on large scale data products. The Lead Data Engineer for this team will work closely with our Data Scientists to build data pipelines utilizing Java, Python, Scala as well as Hadoop, Spark, Kafka, etc. to scale these Digital Measurement products.

About this Opportunity

As a Lead Data Engineer, you'll have the opportunity to build robust data pipelines, using agile practices and Data/DevOps principles. Responsibilities will include designing, programming, debugging and supporting high quality, distributed, and large-scale software solutions on the latest Big Data tech stack. Specifically, you'll be designing and scaling the data engineering efforts for our Target.com digital measurement and global A/B Testing/Optimization platform.

We are looking for a highly motivated data engineering professional who's a team player and can engage with both technical and business team members while mentoring/developing Sr and Jr Data Engineers on our growing team.

Key Responsibilities:
  • Develop tested software systems employing CI/CD best practices
  • Partner with other engineers and team members to develop software that meets business needs
  • Follow Agile methodology for software development and technical documentation
  • Innovate constantly and stay current with latest Streaming and Big Data technologies (Kafka, Flink, Druid, etc.) while staying focused on solving large scale and challenging problems in retail and ecommerce.

Minimum Requirements:
  • BS degree in Computer Science or relevant work experience
  • 5+ years of experience in developing software applications
  • Proficiency in at-least one of the following languages: Java, Scala, Python
  • 3+ years of experience working in Big Data technologies like Hadoop, Hive, Spark, Kafka, etc.
  • Experience building and tuning real time and batch data pipelines at scale
  • Extensive understanding of application/software development and design

  • Proficiency in Scala
  • Experience with real time stream processing frameworks
  • Previous work experience with A/B testing and measurement approaches
  • Experience with REST APIs' and services

Americans with Disabilities Act (ADA)

Target will provide reasonable accommodations (such as a qualified sign language interpreter or other personal assistance) with the application process upon your request as required to comply with applicable laws. If you have a disability and require assistance in this application process, please visit your nearest Target store or Distribution Center or reach out to Guest Services at 1-800-440-0680 for additional information.


Similar jobs

Similar jobs