Big Data Engineer
The Big Data Engineer provides expert guidance and delivers through self and others to source and integrate structured and unstructured data from dozens of local data sources including streaming data feeds into a data lake. You will implement solutions to wrangle, cleanse, validate and govern the petabyte scale data lake, and build machine learning applications that make use of large volumes of data to generate outputs and commercial actions that deliver incremental revenue or reduce cost.
Designing and producing high performing and stable applications to perform complex processing of massive (petabyte scale) volumes of data in a Hadoop based environment.
Working alongside Data Scientist to build end-to-end applications that make use of large volumes of source data from the operational systems and output insights back to business systems
Building real-time data processing applications which are integrated with business systems to enable value from analytic models to drive rapid decision making
Sourcing, ingesting, wrangling and validating data sets, building pipelines to transform data and produce analytical records for machine learning
- Managing complex stakeholder relationships
Languages and Data Tools
- Hadoop ecosystem (Spark, Hive/Impala, HBase, Yarn)
- Scala and Python
- Unix-based systems, including bash programming
Other distributed technologies such as Cassandra, Solr/ElasticSearch, Flink, Flume would also be desirable
We need someone with expert level experience in designing, building and managing applications to process large amounts of data in a Hadoop / Spark ecosystem. Extensive experience with performance tuning applications on Hadoop and configuring Hadoop based systems to maximise performance. Ideally, also knowledge of building systems to perform real-time data processing using Spark Streaming and Kafka, or similar technologies. It would be great if you have dealth with common SDLC, including SCM, build tools, unit testing, TDD/BDD, continuous delivery and agile practises and also working in large-scale multitenancy Hadoop environments both on-premise and cloud.
What’s in it for you?
Great reward with a competitive salary. We will also throw in 28 days’ holiday and a flexible work environment. You will get to work with a fun, diverse and driven team who love what they do and a leadership team who listen, support and inspire you to be your very best!
Vodafone is committed to attracting, developing and retaining the very best people by offering a flexible, motivating and inclusive workplace in which talent is truly recognised, developed and rewarded. We believe that diversity plays an important role in the success of our business and we are committed to creating an inclusive work environment, which respects, values, celebrates and makes the most of people’s individual differences - we are not only multinational but multicultural too.
Vodafone is committed to making reasonable adjustments for all candidates considered to have a disability during the recruitment assessment process. Should you meet the minimum criteria for the role you are applying to, we will contact you to discuss the reasonable adjustments that you may need.
Role Title: Regional Consulting Lead – Northern Europe Location: Newbury or Paddington At Vodafone Group we build connections to all our Global operations, acting as an advisory board to drive cons
Role Title: Senior Developer / Designer Location: Newbury At Vodafone Group we build connections to all our Global operations, acting as an advisory board to drive consistency and customer excelle
Field Technician – Telecommunication Permanent – Field BasedM4 Corridor Looking to cross skill? Become one of our Field based engineers that can deliver best in class Fixed & Mobile solutions to our
Senior Enterprise Architect Working as an Enterprise Architect within the UK IT Architecture team, you will be creating end to end cross functional architectures that meet the UK business requirements
Role Title: Cyber Threat Intelligence Specialist Location: Brentford At Vodafone Group, we build connections to all our Global operations, acting as an advisory board to drive consistency and cust
Cloud Delivery Manager - 254242 Role PurposeCloud computing is at the heart of Vodafone’s Technology strategy and one of the most important drivers to deliver on our vision of making Vodafone a truly
Role Title: Sales Enablement Manager Location: Newbury/Paddington Baird House Vodafone Group Business partners with large multi-national organisations to find better ways of working through our tot
Role Title: Business Relationship ManagerLocation: Newbury Babbage House As a bold global technology leader, our products and services touch the lives of millions, as well as lending a huge helping h
Role Title: Security Architect Location: Newbury Our Team: The Security Architect acts as a technical generalist at Business level, responsible for delivering strategic technology security in
London, Greater London
Role Title: Software Development Team Lead Location: London Are you bold? Innovative? Inquisitive? Great, then we can help you thrive… The V by Vodafone team was created just 2 years ago to pioneer
London, Greater London
Role Title: Quality Assurance Manager - Cellular Location: London Are you bold? Innovative? Inquisitive? Great, then we can help you thrive… The V by Vodafone team was created just 2 years ago to pi