IrvineRecruiter Since 2001
the smart solution for Irvine jobs

Remote - Big Data processing Engineer - Spark or Flink

Company: Intelliswift Software, Inc.
Location: Irvine
Posted on: November 22, 2021

Job Description:

Required Skills: Java/Scala/Python, AWS, Hadoop, Spark/Flink, Stream Processing (Spark or Flink)Duration: 12 monthsLocation: Seattle, WA / Remote
Title: SW ( big data processing ) Location: Seattle/Remote, WA, United States Description: You will be responsible for the stream processing platform used for analytics and machine learning of worldwide Siri and Search events. We process a triple digit billion events per day. To run our environment efficiently, we drive for proper monitoring, alerting and automation. The team's goal is to ensure the reliability and performance at the highest level. Manage one of the largest infrastructure supporting hundreds of millions of Siri and customers Diagnose, fix, improve, and automate complex issues across the entire stack to ensure maximum uptime and performance Take part in designing and building out our next generation realtime data processing infrastructure and push our services to the next level Harden and launch new data models and data pipelines in production Establish SLA's for all data sets and applications running in production Advise other teams (within and outside of Siri) on proper integration of our platform Build relationships with Data Scientists, Product Managers and Software Engineers to understand data needs Manage the infrastructure which powers ETL, Analytics, and Privacy Efforts within AIML Skills . Passionate about Data Processing Technologies Extensive programming experience in Java, Python or Go Extensive experience using data processing frameworks such as Apache Flink or Apache Spark Streaming Experience configuring and troubleshooting data processing frameworks (e.g. Flink, Spark Streaming, Samza, Kafka Streams or Storm) Experience with alerting, monitoring and remediation automation in a large scale distributed environment Experience setting up and managing public cloud infrastructure on AWS (EKS, S3, IAM, etc) Education . BS, MS, or PhD degree in Computer Science or equivalent and 5+ years experience in data technologies

Keywords: Intelliswift Software, Inc., Irvine , Remote - Big Data processing Engineer - Spark or Flink, Engineering , Irvine, California

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category
within


Log In or Create An Account

Get the latest California jobs by following @recnetCA on Twitter!

Irvine RSS job feeds