Lead Streaming Platform Engineer

Minneapolis, Minnesota, United States
Dec 06, 2018
May 01, 2019
Employment Status
Full Time
Similar Industry Titles and Keywords: Java/JVM Developer, DevOps Engineer

You should join our team. We're the team that enables Data Movement at Target. A massive part of our technology footprint is Apache Kafka and the ecosystem that has developed around it. It's not every day that you'll get to use some of the technologies we've chosen, do it at the scale we're using them, and interact with engineers at the heart of the Apache Kafka community. Demand for Kafka at Target is high and continues to grow at a rapid pace. We want to level up even more on the platform and we need your help!
Some of the approaches important to us and the technologies we use:

  • Everything we do is “as-code” in version control. We don't like clicking buttons or doing things manually
  • All development or infra config changes go through a pull-request process, so you'll always have a say to thumbs up or down things you catch
  • Everything should have test cases and they go through a continuous integration process
  • We understand the importance of logs and metrics, so having visibility to things you need to see to do your job isn't an issue. And if you need to add more metrics or see more logs, it's within our control to improve that
  • We try to own as much of the platform as we reasonably can. You don't need to rely on other teams outside our own to improve the stack or change the way we do things
  • Our stack runs across bare metal, OpenStack, and Kubernetes internally. We're also taking advantage of the public cloud in a big way
  • Some of the technologies we use: OpenStack, Kubernetes, public cloud, Spinnaker, Terraform, Kafka, Influx, Grafana, ELK, Sensu, Consul, Java, Python, GitHub Enterprise, Jenkins, Artifactory, Drone, Sack
As a Kafka Platform Engineer on Target's Streaming Platform Team, you'll

  • Design and implement enhancements to our Kafka platform, this can include implementing new open source solutions that have been developed around the platform, improving our cluster architecture, improving our monitoring capabilities, and developing and possibly open sourcing tooling of our own
  • Writing Kafka producers and consumers in modern languages (Java, Groovy, Kotlin, Go, etc.)
  • Developing API's to manage massive multi-cluster distributed Kafka platform
  • Troubleshoot and resolve operational issues 
  • Help drive adoption of new technologies within the team and across Target
  • Build prototypes to prove out concepts

  • Minimum of 5 years as a software developer in JVM-based languages (e.g. Java, Groovy, Kotlin)
  • Significant experience with modern development pipelines (Git/GitHub/GitLab, Jenkins/Drone, Docker, private/public cloud)
  • Experience developing and supporting high scale enterprise production systems
  • Experience writing software for Linux-based operating systems
  • Highly productive, self-starter and self-motivated
  • Passionate about staying current with new and evolving technologies 

  • Experience with Kafka, OpenStack, Kubernetes, Python, Spinnaker, Terraform, InfluxDB, Consul, Zookeeper, working with major public cloud providers
  • Personal or professional experience contributing to open source projects
  • Innovative mindset - willingness to push new ideas into the company
  • 5+ years of dev/ops experience 
  Target is one of the world's most recognized brands and one of America's leading retailers. But behind the brand our guests love, is a culture of continual innovation - and right now, we are up to big things. The Target Technology Team is driving a transformation in retail, one that will move us from “brick-and-mortar and online” to “brick-and-mortar and everywhere else.” Our goal is to deliver Target's unique “Expect More. Pay Less.” promise to guests wherever and whenever they shop, today and tomorrow: in-store, online, on tablets and mobile phones, and in the retail channels of the future.   About Target:


Similar jobs

More searches like this

Similar jobs