Software Engineer - Hadoop, Big Data Tools and Automation

Posted on Jun 29, 2020


Cupertino, CA

This position can be located in Santa Clara Valley (CA) or Austin (TX)Imagine what you could do here.

At Apple, great ideas have a way of becoming great products, services, and customer experiences very quickly.

Bring passion and dedication to your job and there's no telling what you could accomplish.

Apples Applied Machine Learning team has built systems for a number of large-scale data science applications.

We work on many high-impact projects that serve various Apple lines of business.

We use the latest in open source technology and as committers on some of these projects, we are pushing the envelope.

Working with multiple lines of business, we manage many streams of Apple-scale data.

We bring it all together and extract the value.

We do all this with an exceptional group of software engineers, data scientists, SRE/devops engineers and managers.We manage several large hadoop/YARN clusters running 10s of thousands of jobs.

This role requires you an expert level understanding of hadoop/spark based technologies so that you can build right automation/tooling for the administration, capacity management and showback/chareback/resource visibility of the platform.

This also requires understanding of complete ecosystem of kafka, spark streaming and other streaming technologies, airflow to build a comprehensive end to end management and monitoring systems.You are an independent problem-solver who is self-directed and capable of exhibiting deftness to handle multiple simultaneous competing priorities and deliver solutions in a timely manner.Provide incident resolution for all technical production issues.

Create and maintain accurate, up-to-date documentation reflecting configuration, and responsible for writing justifications, training users in complex topics, writing status reports, documenting procedures, and interacting with other Apple staff and management.Provide guidance to improve the stability, security, efficiency and scalability of systems.

Determine future needs for platform and investigate new products and/or features.

Strong troubleshooting ability will be used daily; will take steps on their own to isolate issues and resolve root cause through investigative analysis in environments where the candidate has little knowledge/experience/documentation.

How to Apply

Follow the application procedure at for more info.

Related positions:

Hadoop and Big Data Software Engineer

JP Morgan Chase, Wilmington, VA

Lead Site Reliability Engineer - Big Data (Hadoop/Spark)

JPMorgan Chase Bank, N.A., Houston, TX

Lead Site Reliability Engineer - Big Data (Hadoop/Spark)

JPMorgan Chase Bank, N.A., Houston, TX

Tools & Automation Engineer

Apple, San Diego, CA

QA - Tools and Automation Engineer

Apple, Austin, TX

Download free Serefind app to explore more!