Data Engineer
Venator Recruitment
New York
16d ago

Job Type : Permanent

Venator Broadcast are working in collaboration with a widely-adopted web video player market front-runner. We're looking for a Data Engineers build products to increase engagement through feature enhancements to our Search and Recommendations engine.

We engineer solutions at large scale to serve tens of millions of responses per day with millisecond response times. We work closely with our Data Scientists on defining next generation solutions through online and offline evaluation of existing and new algorithms.

We are excited by the challenge of improving Content Discovery for our publishers to help them increase monetization and viewer satisfaction.

Within this role you will :

  • Optimize Elasticsearch queries
  • Deploy containerized services in a Kubernetes cluster
  • Apply distributed large scale processing solutions using Celery
  • Improve information retrieval processes
  • Write performant Python code
  • Requirements :

  • 3+ years relevant experience.
  • Experience working with programming languages and technologies that can deal with
  • Big Data. Knowledge of some of the following and a willingness to learn the others : Python, Java, Spark, Kafka, Hive, Hadoop / MapReduce, Storm, Avro / Parquet, Relational & Columnar databases, MongoDB / NoSql, Elasticsearch, etc.

  • Experience with Test-Driven Development. Whether it's pure unit tests, integration tests, or both, you are responsible for your code working correctly.
  • You can easily validate this with tests that can be hooked into a CI environment.

  • Scale is something that excites you and you have dealt with before. When you build a data pipeline, you are confident it will work just as well in a dev environment as it will in a prod environment with 100x the amount of data.
  • Comfortable working in a Cloud environment, ideally AWS. You will work closely with the DevOps team to define infrastructure and tooling to support the data engineering efforts.
  • True collaboration comes from mutual understanding and an open sharing of ideas.

  • Enjoy working with other engineers. You recognize there are multiple ways to engineer a solution and feel a code review is a chance to share knowledge, not judge others' code.
  • B.S. or higher in Computer Science or comparative experience engineering experience.
  • For more information on this role and other opportunities across The Americas, contact Tom Allen at Venator Broadcast on +44 7867 419 389 or at tom venator-rec.com.

    Apply
    Apply
    My Email
    By clicking on "Continue", I give neuvoo consent to process my data and to send me email alerts, as detailed in neuvoo's Privacy Policy . I may withdraw my consent or unsubscribe at any time.
    Continue
    Application form