Big Data engineerВакансия в архиве

А у вас есть резюме?
Создайте свое резюме, чтобы работодатели смогли найти вас и пригласить на работу. Это быстро и абсолютно бесплатно!
Создать резюме
Уровень зарплаты
Город
Требуемый опыт работы
з/п не указана
США
более 6 лет

Big Data engineer (Relocation to USA)

Requirements:

  • Experience with Hadoop stack (HIVE, Pig, Hadoop streaming) and MapReduce
  • Experience with Hbase or comparable NoSQL.
  • Strong grasp of algorithms and data structures
  • Database experience with MySQL, MSSQL or equivalent
  • Proficient in two of the languages: Java, Python/Jython, Scala, Clojure, Ruby, C++
  • Experience with Test Driven Code Development, SCM tools such as GIT, SVN, Jenkins, Gerrit code review
  • Good familiarity with in Linux/Unix, scripting and administration

Additional requirements:

  • Experience in Spark MLLib, Mahout, Elasticsearch, TSDB
  • Familiarity out data formats and serialization, XML, JSON, AVRO, Thrift, ProtoBuf
  • Experience with graph frameworks, such as Giraph, Hama, GraphLab, GraphX
  • Experience with R and/or MatLab
  • Strong communication skills
  • Read Tom White's "Hadoop: the Definitive Guide" and Jimmy Lin/Chris Dryer’s “Data-Intensive Text Processing with MapReduce”

Responsibilities:

  • Build and maintain code to populate HDFS, Hadoop with log events from Kafka or data loaded from SQL production systems.
  • Design, build and support pipelines of data transformation, conversion, validation
  • Design and support effective storage and retrieval of BigData >500Tb
  • Assess the impact of external production system changes to Big Data systems on Hadoop or Spark and implement changes to the ETL to ensure consistent and accurate data flows.
  • Design and implement best practices for cloud based cluster deployments of Hadoop, Spark, and other BigData eco-system tools.

Conditions:

  • Unique working environment where you communicate and work directly with client
  • Usage of the latest technologies and tools
  • State of the art, cool, centrally located offices with warm atmosphere which creates really good working conditions
  • High salary

Тип занятости

Полная занятость, полный день
Отклик направлен работодателю
Сопроводительное письмо к отклику
Написать сопроводительное письмоПисьмо отправлено
Произошла ошибка, попробуйте ещё раз
Дата публикации вакансии
Вакансия дня
Рекомендуем

Вакансия в архиве