Cloud Big Data Engineer

Barcelona (Spain)
See Recent Jobs

Cloud Big Data Engineer

Barcelona (Spain)

Ref: KR1015 January 12, 2021 TRANSPORT AND LOGISTICS

#

FUNCTIONS

We are looking for self-driven, curious and creative BigData engineers to join the data engineering team and architect an automated, scalable and reliable BigData platform. You will team-up with our product engineering team and will interact with our data scientist/analyst department Main duties: Leverage your strong background in distributed data processing, stream processing and data modelling to develop reliable and scalable production components Develop data stream processing pipelines (Kafka) Build, tune, and troubleshoot data processing clusters Develop and integrate machine learning algorithms for data processing and analysis Build models to address business problems Think in Cloud native design patterns i.e. auto-scaling, elasticity, container orchestration Participate in technical design and architectural discussions within the product engineering team to solve some real operational issues Be outspoken in meetings and generate new ideas for the team Development Practices What are we looking for? If you’re a GCP wizard, hands-on person, a structured change agent and are looking for a new business challenge, then keep on reading… Requirements: 2+ years of related experience in data engineering Knowledge of GCP infrastructure & services Familiar with GCP datastores, GCP Dataproc, GCP Pub/Sub, etc. Strong exposure to the Hadoop ecosystem, e.g. HDFS, Yarn, Zookeeper, Hive Good knowledge of batch and streaming frameworks, e.g. Spark, Flink Hands-on experience of (Cloud-based) NoSQL databases Excellent Linux scripting skills Solid experience in Terraform scripting, or equivalent Experience building CI/CD pipelines, with tools like Jenkins in production environments Experience of GitHub Actions a plus Experience orchestrating the build and deployment of a containerized environment Proven experience of Kubernetes Experience with languages such as: Python, Go

Apply now

Looking for the best qualified professionals? At Catenon we can find the best talent anywhere in the world. With 23 offices around the planet and operations in more than 100 countries, we are specialists in the global acquisition of professionals. All this, thanks to our technology platform and our specialized global team. Find out more information about our services.

Select CV Change Remove
More Information
You can consult the terms and conditions associated with the talent registration at CATENON.

Related Jobs