Big Data Engineer
Austin Fraser are currently recruiting for a Big Data Engineer on behalf of a long-term client in Oxfordshire. The successful candidate will work closely with our client's Cyber team to build and deliver a big data intelligence platform. The ideal candidate will have a genuine interest and enthusiasm for working on real data to drive proactive cyber security.
You will have a focus on data processing, data security and deliver the systems that process huge volumes of data from various sources. You will be working closely with internal stakeholders such as Data Scientists and the Product Development team.
Development of our client's big data Intelligence Platform.
Maintenance and design of data pipelines.
Integration of new security data sources.
Implementation of continuous integration.
Implementation of the tests driven development processes.
Required Skills & Experience:
Experience in building large-scale data processing systems and large-scale data infrastructures.
Good understanding of distributed computing principles.
Able to work with the latest (NoSQL) database technologies such as Cassandra and Elasticsearch.
Commercial or open source experience in software engineering (object-oriented design, coding and testing patterns).
Extensive knowledge in programming languages such as Java and Python.
Experience building data processing systems with Spark and Kafka using Java or Python.
Knowledge in continuous integration and automatic testing of big data pipelines.Desirable Skills & Experience:
Understanding of DNS.
Cyber security knowledge.
Experience in C++ and C.This is a Remote-friendly opportunity; while we have a preference for local candidates, we will consider applications UK-wide. To be considered for this role, please 'Apply Now', or contact Sam Chaher at Austin Fraser.
Austin Fraser is acting as an Employment Agency in relation to this vacancy.
Austin Fraser is committed to being an equal opportunities employer, and encourages applications from candidates regardless of sex, race, disability, age, sexual orientation, gender reassignment, religion or belief, marital status, or pregnancy and maternity status.
Due to the volume of applications received, we are unable to provide individual feedback to unsuccessful applicants