#вакансия #senior #bigdata #scala #удаленка
one of the top three UK insurance companies. Our team helps the client in finding and clearing issues with the data.
The Big Data engineer will be responsible for creating applications and solutions that will manage data flow. The specialist will also participate in the creation of new data pipelines, identify existing data gaps, and offer automated solutions for providing advanced analytical capabilities and enriching data with application APIs.
Must have
Strong knowledge of Big Data general concepts
Hands-on experience with the Hadoop ecosystem (Spark, MapReduce, Hive, etc.)
Knowledge of standard data structures and algorithms
Experience handling large data using streaming
Experience with tools like Hive, Spark, HBase, Sqoop, Impala, Kafka, Flume, Oozie, MapReduce, Indexers, etc.
Hands-on programming experience in Scala
Experience with end-to-end design and build processes for Near-Real-Time and Batch Data Pipelines
Strong experience with SQL and Data modeling
Analytical thinking
Spoken English
Remote, full time