At Verizon Media, we connect people to their passions. With brands like Yahoo, TechCrunch and more, we help people stay informed and entertained, communicate and transact while creating new ways for advertisers and partners to connect. From XR experiences to advertising and content technology, Verizon Media is an incubator of innovation and is revolutionizing the next generation of content creation in a 5G world.

Big Data Platform

We build some of the largest data lakes in the world!

• We manage 50K nodes

• We run 1.5 million jobs per day across thousands of users and application processing close to an exabyte of data

• Developing dozens of big data components including Presto, HBase, Hive, Pig, Oozie, and more

We do coolest projects!

• Building brand new caching layer from scratch for Presto!

• Building brand new stats collection layer utilizing sketches for data compression for Hive, Presto, and Spark

• Building state of the art rolling upgrade system for HBase

• Designing scalable and performant OLTP layer for HBase that can compete with Oracle!

We do open source!

• We are active in 6 Apache projects for Hive, Pig, Oozie, Presto and HBase, and Tez with 6 committers and PMC members in the team of 10.

• We participate in most major Big Data conferences including Hadoop Summit/DataWorks, Strata, HBaseCon, Spark Summit, Presto Summit and more.

We have one of the best work environments where you can

• Have huge impact: we are agile with at least monthly release for each product. We work like a startup with all the benefits of large company;

• be challenged: we solve some of the most complex problems in the industry;

• Be known: open source makes you known and famous at the scale way beyond your immediate team;

• Have great mentors. Work with experts across big data technology stack. Work with nice people with get things done attitude.

• Have free food all day long :).

JOB POST

Big Data Systems Engineer - Open Source Development

About the Team

We're looking for engineers to join the Verizon Media Big Data team. In this role, you'd be building some of the largest data lakes in the world! We manage 50K nodes running 1.5 million jobs per day, across thousands of users and application, processing close to an exabyte of data.

So when considering this position, please ask yourself, do you want to do something exceptional?

About the Role

The qualified engineer would work on one or more of the following open source projects: Pig, Oozie, Hive, PrestoDB or Hbase. On this outstanding team, we're challenged by complex problems day in and day out, and in having each other to lean on, we find ourselves growing every day as a result.

We're currently active in 6 Apache projects and our team consists of numerous committers and PMC members. In other words, not only will you make a massive impact here at Verizon Media, but globally as well.

We work like a startup, do phenomenal work, and have fun while we do it. Come join us and become an authority on big data and cloud computing!

Did I mention free food? Yeah, we have that too.

Responsibilities

• Understand all aspects of our distributed systems and learn select components in detail

• Be a leader in open source (Apache Software Foundation) projects

• Design massively distributed technology and develop bleeding-edge cloud computing software

• Work closely with service engineering, operations, and Hadoop users to engineer bleeding-edge solutions that allow us to answer today's most meaningful data-related questions

Current Projects

• Develop brand new caching layer from scratch for Presto

• Build a brand new stats collection layer utilizing sketches for data compression for Hive, Presto, and Spark

• Work on state of the art rolling upgrade system for HBase

• Crafting scalable and performant OLTP layer for HBase that can compete with Oracle!

Qualifications

• BS/MS in Computer Science (or equivalent)

• Strong work history and/or educational background

• Skilled in either Java or C++

• In-depth knowledge of Algorithms, Data Structures, and Performance Optimization Techniques

• A passion for working with large distributed data and systems

• An interest in working on database internals and query optimization

Verizon Media is proud to be an equal opportunity workplace. All qualified applicants will receive consideration for employment without regard to, and will not be discriminated against based on age, race, gender, color, religion, national origin, sexual orientation, gender identity, veteran status, disability or any other protected category. Verizon Media is dedicated to providing an accessible environment for all candidates during the application process and for employees during their employment. If you need accessibility assistance and/or a reasonable accommodation due to a disability, please submit a request via the Accommodation Request Form () or call 408-336-1409. Requests and calls received for non-disability related issues, such as following up on an application, will not receive a response.

At Verizon, we know that diversity makes us stronger. We are committed to a collaborative, inclusive environment that encourages authenticity and fosters a sense of belonging. We strive for everyone to feel valued, connected, and empowered to reach their potential and contribute their best. Check out our diversity and inclusion () page to learn more.

Currently work for Verizon Media? Please apply on our internal career site.