Big Data Engineer
The Big Data Engineer provides expert guidance and delivers through self and others to source and integrate structured and unstructured data from dozens of local data sources including streaming data feeds into a data lake. You will implement solutions to wrangle, cleanse, validate and govern the petabyte scale data lake, and build machine learning applications that make use of large volumes of data to generate outputs and commercial actions that deliver incremental revenue or reduce cost.
Designing and producing high performing and stable applications to perform complex processing of massive (petabyte scale) volumes of data in a Hadoop based environment.
Working alongside Data Scientist to build end-to-end applications that make use of large volumes of source data from the operational systems and output insights back to business systems
Building real-time data processing applications which are integrated with business systems to enable value from analytic models to drive rapid decision making
Sourcing, ingesting, wrangling and validating data sets, building pipelines to transform data and produce analytical records for machine learning
- Managing complex stakeholder relationships
Languages and Data Tools
- Hadoop ecosystem (Spark, Hive/Impala, HBase, Yarn)
- Scala and Python
- Unix-based systems, including bash programming
Other distributed technologies such as Cassandra, Solr/ElasticSearch, Flink, Flume would also be desirable
We need someone with expert level experience in designing, building and managing applications to process large amounts of data in a Hadoop / Spark ecosystem. Extensive experience with performance tuning applications on Hadoop and configuring Hadoop based systems to maximise performance. Ideally, also knowledge of building systems to perform real-time data processing using Spark Streaming and Kafka, or similar technologies. It would be great if you have dealth with common SDLC, including SCM, build tools, unit testing, TDD/BDD, continuous delivery and agile practises and also working in large-scale multitenancy Hadoop environments both on-premise and cloud.
What’s in it for you?
Great reward with a competitive salary. We will also throw in 28 days’ holiday and a flexible work environment. You will get to work with a fun, diverse and driven team who love what they do and a leadership team who listen, support and inspire you to be your very best!
Vodafone is committed to attracting, developing and retaining the very best people by offering a flexible, motivating and inclusive workplace in which talent is truly recognised, developed and rewarded. We believe that diversity plays an important role in the success of our business and we are committed to creating an inclusive work environment, which respects, values, celebrates and makes the most of people’s individual differences - we are not only multinational but multicultural too.
Vodafone is committed to making reasonable adjustments for all candidates considered to have a disability during the recruitment assessment process. Should you meet the minimum criteria for the role you are applying to, we will contact you to discuss the reasonable adjustments that you may need.
Senior Technology Operations ManagerLocation – Newbury What’s the role? Reporting directly in to the Head of Tech Ops, this is a fantastic opportunity for an experienced Technology leader to join the
London, Greater London
Role Title: Senior Architect Location: Paddington At Vodafone Group we build connections to all our Global operations, acting as an advisory board to drive consistency and customer excellence acros
Level 3 Field Technician Non-Youth Apprentice Unified Communications Technician (Advanced Apprenticeship) Locations include Bracknell & High Wycombe areas Joining Vodafone is more than a job, what w
Role Title: IoT Connectivity Product Manager Role Location: Newbury At Vodafone Group we build connections to all our Global operations, acting as an advisory board to drive consistency and customer
Role Title: Penetration Testing Specialist Location: Brentford At Vodafone Group we build connections to all our Global operations, acting as an advisory board to drive consistency and custom
Role Title: Principal Satellite Engineer Location: Newbury At Vodafone Group we build connections to all our Global operations, acting as an advisory board to drive consistency and customer excel
Role Title: Technical Product Owner Location: Newbury As a bold global technology leader, our products and services touch the lives of millions, as well as lending a huge helping hand to some of
Fibre Planning Engineer Location - Newbury Build the Network, Build your future! As a Networks Engineer within Fibre Services you will engaged in the fundamental and detailed planning of the Vodafone
Project CoordinatorNewbury As you might imagine, technology is very much at the heart of Vodafone – without it, there wouldn't be a business. But here's the thing. We don't just develop new and innov
Role Title Infrastructure and Integration Engineer Location: Newbury At Vodafone Group we build connections to all our Global operations, acting as an advisory board to drive consistency and custo
Delivery Coordinator – Fixed Services Newbury As a Delivery Coordinator you will be responsible for delivering the best possible service experience that exceeds expectations throughout the order deli