Senior Data Engineer, Big Data
GitLab (View all Jobs)
Remote
Interview Process
1. A series of video calls 2. Coding exercise involving working on a Merge Request that is like a real work task
Salary
$110,900
Programming Languages Mentioned
ETL, Java, Python, SQL
The GitLab DevOps platform empowers 100,000+ organizations to deliver software faster and more efficiently. We are one of the world’s largest all-remote companies with 2,000+ team members and values that guide a culture where people embrace the belief that everyone can contribute.
Gitlab is looking to add their first Senior Data Engineer, Big Data, to the team!
The successful incumbent in this role, will be our resident expert in this area. You won’t only implement and design the solutions, but you will be the architect as well, providing cutting edge technologies and processes on data and analytics platforms.
The ideal candidate will have been a key driver of Big Data solutions in a few projects previously, to be able to share their knowledge and experience with our internal Data Engineers and wider Data team.
Location - This position is 100% remote
Don’t have a ton of knowledge about GitLab yet? Don’t worry. We have an extensive onboarding and training program at GitLab and you will be provided with necessary DevOps and GitLab knowledge to fulfill your role.
What you'll do in this role...
- Maintain our data warehouse with timely and quality data
- Build and maintain data pipelines from internal databases and SaaS applications
- Create and maintain architecture and systems documentation
- Write maintainable, performant code
- Implement the DataOps philosophy in everything you do
- Plan and execute system expansion as needed to support the company's growth and analytic needs
- Collaborate with Data Analysts to drive efficiencies for their work
- Collaborate with other functions to ensure data needs are addressed
- This position is always central and reports to the Manager, Data
- Understand and implement data engineering best practices
- Improve, manage, and teach standards for code maintainability and performance in code submitted and reviewed
- Create smaller merge requests and issues by collaborating with stakeholders to reduce scope and focus on iteration
- Ship medium to large features independently
- Generate architecture recommendations and the ability to implement them
- Great communication: Regularly achieve consensus amongst teams
- Perform technical interviews
We're looking for...
- 5+ years hands-on experience deploying production quality code
- Professional experience using Python, Java, or Scala for data processing (Python preferred)
- Knowledge of and experience with data-related Python packages
- Demonstrably deep understanding of SQL and analytical data warehouses (Snowflake preferred)
- Hands-on experience implementing ETL (or ELT) best practices at scale.
- Hands-on experience with data pipeline tools (Airflow, Luigi, Azkaban, dbt)
- Expertise in designing and developing distributed data pipelines using big data technologies on large scale data sets demonstrated with years of proven experience.
- Has experience with various streaming data concepts, such as Kafka.
- Can lead full scale Data Lake implementations.
- Has good understanding of Lambda Architecture.
- Strong data modeling skills and familiarity with the Kimball methodology.
- Understand and implement data engineering best practices
- Experience with Salesforce, Zuora, Zendesk and Marketo as data sources and consuming data from SaaS application APIs.
- Share and work in accordance with our values
- Constantly improve product quality, security, and performance
- Desire to continually keep up with advancements in data engineering practices
- Catch bugs and style issues in code reviews
- Ship small features independently
- Ability to use GitLab
Also, we know it’s tough, but please try to avoid the confidence gap. You don’t have to match all the listed requirements exactly to be considered for this role.
Hiring Process
To view the full job description and hiring process, please view our handbook. Additional details about our process can also be found on our hiring page.
Compensation
#LI-MG1
Country Hiring Guidelines: GitLab hires new team members in countries around the world. All of our roles are remote, however some roles may carry specific location-based eligibility requirements. Our Talent Acquisition team can help answer any questions about location after starting the recruiting process.
Privacy Policy: Please review our Recruitment Privacy Policy. Your privacy is important to us.
GitLab is proud to be an equal opportunity workplace and is an affirmative action employer. GitLab’s policies and practices relating to recruitment, employment, career development and advancement, promotion, and retirement are based solely on merit, regardless of race, color, religion, ancestry, sex (including pregnancy, lactation, sexual orientation, gender identity, or gender expression), national origin, age, citizenship, marital status, mental or physical disability, genetic information (including family medical history), discharge status from the military, protected veteran status (which includes disabled veterans, recently separated veterans, active duty wartime or campaign badge veterans, and Armed Forces service medal veterans), or any other basis protected by law. GitLab will not tolerate discrimination or harassment based on any of these characteristics. See also GitLab’s EEO Policy and EEO is the Law. If you have a disability or special need that requires accommodation, please let us know during the recruiting process.
Please mention No Whiteboard if you apply!
I'm a one-man team looking to improve tech interviews, and could use any support! 😄