Spark Software Engineers (Multiple Levels)

Plume - California4.0

Full-timeEstimated: $120,000 - $150,000 a year
Job Summary

Plume has built a data driven "over-the-top" services delivery platform to manage consumer wireless networks and devices in real time at "massive" scale - 100s of millions of devices spanning mobile, IoT, and other applications.

We are looking for experienced Data Infrastructure engineers that would help us make sure that the platform service we are delivering will meet both our and our customers' reliability expectations.

Candidate should be a talented engineer that can show initiative, adaptability to challenging environment, problem solving skills, and understanding of Data Infrastructure. 3+ years industry experience is a must!


  • Create infrastructure and abstractions that can enable anyone (engineer or data scientist) to create a scalable ETL pipeline for whatever the purpose is: metrics, analysis, machine learning, dashboard visualizations
  • Work closely with ops team to monitor and tune existing infrastructure.
  • Make intuitive decisions about what services, frameworks, and capabilities need to be in place before they are desperately needed.
  • Build and maintain a data collection system that robustly extracts relevant data from multiple sources and data stores

  • BA/BS in Computer Science, Information Systems or related technical field.
  • 3+ years of experience in Data Infrastructure, with Cloud SW experience a plus.
  • Strong analytical and problem-solving skills.
  • Experience in designing and scaling data infrastructure, models, and pipelines
  • Hands-on experience with a variety of data infrastructures, such as:
  • Processing: Spark, Flink, Hadoop, Lambda
  • Messaging: Kafka, Zookeeper, Pulsar
  • Storage: Hive, Mongo DB, Athena, Phoenix, Splice, Redshift, DynamoDB
  • Machine Learning: Sagemaker, H2O, Keras,
  • Open and active in sharing knowledge as well as excellent communication skills
  • Programming experience in one or more application or systems languages:
  • Scala, Java, Python
  • The ability to manage a project from inception to completion