Senior Data Engineer

We are the company behind WordPress.com, Jetpack, WooCommerce, and Tumblr! We are looking for a Senior Data Engineer with experience in Spark/Scala to join our team of data scientists and engineers to build, deploy, and iterate on large-scale data pipelines and applications.

How do we work

• We’re kind to each other and our users – we strive to build a positive, supportive, and inclusive culture of cohesive teams focused on delivering value to our customers.
• We work as a global and distributed workforce resulting in a unique way of working built around our creed.
• We offer flexible work arrangements allowing our team members to work when they feel best.
• We welcome collaboration, and you can be involved in any discussion across our many communication channels.

Enough about us, let‘s talk more about you. The Senior Data Engineer position might be a good fit if you:

• Have hands-on Data Engineering experience for around 5+ years with strong experience in big data. 
• Have hands-on experience with implementing large-scale data flows, primarily focusing on Spark/Scala. 
• Have production experience with open source technologies. 
  • Ideally, you have experience in managing and tuning on-premise Hadoop and related services in production.
  • Alternatively, hands-on AWS/GCP analogs (S3/RedShift/etc. or Google Storage/Big Query/etc.) and, preferably, a strong functional programming background. 
  • Love working with Hive, Kafka, Airflow, Trino, etc.
• Live on the application level, however, are comfortable tuning it with OS/low-level.
• Understand that with on-premise you gain free hands to deal with OS compared to cloud solutions, gaining a much more internal understanding of the tech. 
• Care about architecture, unit testing, and building reliable infrastructure and pipelines.
• Are motivated to propose technical solutions, own software architecture, evaluate technologies and infrastructure, and develop technical roadmaps for future applications.
• Bring programming skills in multiple programming languages and paradigms. In addition to Scala and Spark, you are likely to encounter Python, Java, PHP, and SQL in this role and the idea of using them on a regular basis should not be a blocker for you.
• Are familiar with professional software engineering methods and standards such as coding conventions, code reviews, continuous integration, build processes, testing, and operations.
• Are open and able to travel 3-4 weeks per year to meet your teammates in person. We hold an annual all-company meeting every year, and meet up with our teams for a week once or twice per year. Important note: at the moment all company travel has been suspended due to COVID-19. Automattic is monitoring government and health agency reports closely and responding however possible to prioritize safety and well-being for our team and communities.

Like all positions at Automattic, you’ll work remotely, and can be based wherever you live.

How to apply

Please answer the following questions in the application form. Applications without these questions answered will not be considered:

1. Tell us some details about an interesting at-scale data problem you’ve worked on. What made it interesting or challenging?
2. Include a link to a recent favorite blog post or paper about working with lots of data.
3. What questions do you have for us?

#LI-JC1