Big Data Engineer
The Big Data Engineer provides expert guidance and delivers through self and others to source and integrate structured and unstructured data from dozens of local data sources including streaming data feeds into a data lake. You will implement solutions to wrangle, cleanse, validate and govern the petabyte scale data lake, and build machine learning applications that make use of large volumes of data to generate outputs and commercial actions that deliver incremental revenue or reduce cost.
Designing and producing high performing and stable applications to perform complex processing of massive (petabyte scale) volumes of data in a Hadoop based environment.
Working alongside Data Scientist to build end-to-end applications that make use of large volumes of source data from the operational systems and output insights back to business systems
Building real-time data processing applications which are integrated with business systems to enable value from analytic models to drive rapid decision making
Sourcing, ingesting, wrangling and validating data sets, building pipelines to transform data and produce analytical records for machine learning
- Managing complex stakeholder relationships
Languages and Data Tools
- Hadoop ecosystem (Spark, Hive/Impala, HBase, Yarn)
- Scala and Python
- Unix-based systems, including bash programming
Other distributed technologies such as Cassandra, Solr/ElasticSearch, Flink, Flume would also be desirable
We need someone with expert level experience in designing, building and managing applications to process large amounts of data in a Hadoop / Spark ecosystem. Extensive experience with performance tuning applications on Hadoop and configuring Hadoop based systems to maximise performance. Ideally, also knowledge of building systems to perform real-time data processing using Spark Streaming and Kafka, or similar technologies. It would be great if you have dealth with common SDLC, including SCM, build tools, unit testing, TDD/BDD, continuous delivery and agile practises and also working in large-scale multitenancy Hadoop environments both on-premise and cloud.
What’s in it for you?
Great reward with a competitive salary. We will also throw in 28 days’ holiday and a flexible work environment. You will get to work with a fun, diverse and driven team who love what they do and a leadership team who listen, support and inspire you to be your very best!
Vodafone is committed to attracting, developing and retaining the very best people by offering a flexible, motivating and inclusive workplace in which talent is truly recognised, developed and rewarded. We believe that diversity plays an important role in the success of our business and we are committed to creating an inclusive work environment, which respects, values, celebrates and makes the most of people’s individual differences - we are not only multinational but multicultural too.
Vodafone is committed to making reasonable adjustments for all candidates considered to have a disability during the recruitment assessment process. Should you meet the minimum criteria for the role you are applying to, we will contact you to discuss the reasonable adjustments that you may need.
Role Title: Digital Technical Lead Location: Newbury Our Team: The Enterprise IT Solutions Architecture department caters to IT needs of vertical business units in Vodafone Group Enterpri
London, Greater London
Insight & Analytics Specialist London, Smale House Competitive salary + excellent benefits Digital transformation is a journey not a one off-event. It needs to be nurtured and grown by talente
Senior Manager – Technology Operations Permanent Newbury Based UK Vodafone Business Technology Solutions is the function of Vodafone UK accountable for delivering fixed and converged communication sol
Role Title: Data Domain Lead Location: Newbury Goal: To participate to the development of an end-to-end Data transformation strategy in IT, to deliver the business objectives. To lead, in conju
Cyber Security Manager Working across the business functions (Enterprise, Consumer or Internal), your role will be to ensure we deliver secure products and services to our customers and identifying a
Job Title: IP Network Specialist Business Area: Vodafone Secure Sector Location: Farnborough Successful candidates must be able to obtain and maintain DV level security clearance About Vodafone Secur
IT Operation Authority - VET000245917 Location – NewburySalary- £Competitive + 10% Bonus and Benefits What’s the role? As an IT Operation Authority you will work within one of the most progressive are
Integration Technical Architect Location: Newbury HQ Hiring Manager: Santosh Menon Band: G Is this role for you? The Integration Technical Architect will work as a key member of the Vodafone UK IT In
Technology Solution Specialist The Technology Solutions Specialist will work in a customer facing capacity, driving the enterprise customer solution by providing technical support to a virtual team o
Role Title: Coe Oracle Solution Analyst Location: Newbury At Vodafone Group we build connections to all our Global operations, acting as an advisory board to drive consistency and customer excellenc
Delivery Coordinator – Fixed Services Newbury As a Delivery Coordinator you will be responsible for delivering the best possible service experience that exceeds expectations throughout the order deli