Big Data Engineer

San Francisco Peninsula , CA

Posted: 08/19/2019 Employment Type: Contract Industry: Mobile Job Number: JOS000008789

Description

  • As part of a small team of highly skilled data engineers, you will own significant responsibility in designing, developing and maintaining our large-scale ETL pipelines, storage, and processing services.
  • You will build self-service analytics tools to help engineering teams derive actionable metrics out of large volumes of raw data.
  • You will partner with data science and engineering teams and develop big data algorithm to answer complex questions on usage of our products
  • You will work closely with the DevOps team and develop monitoring and alerting scripts on various data pipelines and jobs
  • You will have the opportunity to learn and work on the latest Big Data technologies, lead POCs to demonstrate new ideas and influence the future direction of our technology stack

Key Qualifications

  • Experience developing large scale distributed computing systems
  • In-depth knowledge and experience in one or more of the following technologies: Hadoop ecosystem, Kafka, Samza, Flume, HBase, Cassandra, Redshift, Vertica, Spark.
  • Deep understanding of key algorithms and tools for developing high efficiency data processing systems
  • Proven software engineering experience and discipline in design, test, source code management and CI/CD practices
  • Experience in data modeling and developing SQL database solutions
  • Proficient in working with Linux or other Posix operating systems, shell scripting, and networking technologies
  • Strong software development, problem-solving and debugging skills with experience in one or more of the following languages: Java, Python, Scala, or Ruby
  • Self-driven, passionate about software development, especially in data technologies, love working in a fast-paced and dynamic environment
  • Extremely organized, detail oriented, and thorough in every undertaking
  • Excellent communication skills.

Send an email reminder to:

Share This Job:

Related Jobs:

Login to save this search and get notified of similar positions.