1588 data engineer jobs found

Description About HSO HSO Success and Ambition HSO are a leading Microsoft Dynamics Gold partner who were founded in 1987 specialising in sectors such as Retail, Rental, Manufacturing, Professional Services and Local Government. With a head count of over 280 employees in the UK, winning multiple awards such as 2020 Microsoft Partner of the Year, Best Tech company 2021 and Top 3 Large Companies to work for 2021 our reputation in the Dynamics Market is higher than ever. Prioritising customer satisfaction, our expertise and pragmatic approach to each customer’s business needs enable us to provide a 100% reference-able solution, supported by award winning 24-hour support. Our recruitment moto has always been – ‘We don’t want good people to just join us, we want them to stay with us’. Ensuring our employees are challenged, supported and engaged in our wider family is key to our continued success – we have a designated Learning and Development Team who are...

Senior Data Engineer | £80K - £110K | 100% Remote | Spark | Hadoop | Python | Azure SC CLEARANCE REQUIRED Are you looking to work with the fastest growing UK consultancy? Are you looking for more of a client facing position? I have several roles for a UK based consultancy firm who are looking for strong Senior Data Engineers to join the team and work on a huge range of clients. You will be using cutting-edge technology to solve real-world problems. As a Lead Data Engineer you will provide strong development leadership for the team members and take responsibility for the quality that you will provide. You will be working with an agile team to develop and design large scale of data processing software to meet user needs in demanding production environments. The types of technologies they use include, Apache, Hadoop, Spark, Azure, NoSql, and many more. Skills: Leading the development of substantial components for large scale data processing solutions Software...

Minimum qualifications • Thorough understanding of at least one modern programming language (at Hopper we use mostly Scala and Python)• 4+ years professional experience in data engineering capacity with experience designing and building ETL pipelines• Expertise with deduping data, and web scraping• Experience working in a cloud environment with data warehouse technologies such as BigQuery, Redshift, Athena, or Snowflake• Excelled in an environment with cross-functional teams, working fluidly with Product Managers, Data Scientists, Software Developers, and other highly skilled specialists• Exposure to data-intensive systems as well as writing production-quality software Preferred qualifications • Experience with, or willing to learn, distributed system development in Scala• Thorough understanding of data engineering, designing and building data pipelines at scale• Experience in Recommendation Systems and Feeds-ranking a strong plus• Experience with data parsing, transformations,...

I am currently on the market for a Senior Data Engineer that specialises in the Azure technology stack. This position is required for one of my favourite consultancy clients who are always quick to move when it comes to contract recruitment, especially as their client need someone onboarded ASAP. This Senior Data Engineer will be required to oversee the implmenetation and the subsequent post-impementation support of the Azure cloud that the client requires.  Contract Details: - 6 Months (Initial - open to extension)  - Outside IR35  - Remote Working  - Market Rate  Requirements of the role: - Excellent Experience With Azure  - Azure Data Engineer Certification (Azure Architecture Certification Desirable)  - Excellent hands-on experience of using Azure Data Lake and Azure Databricks - Experience with Python and other programming languages (I.e. Java + Scala) - Azure Synapse (Desriable)  - Experience with Start-ups/Scale-ups within the Fintech space  If you fit the...

Azure Data Engineer - Remote (Azure Data Engineer, Data Engineer, Azure, Azure data lake, Azure data factory pipelines, Power BI, Python, API, C#, Restful API, AS2, SFTP, JSON, csv, iDoc, XML, MS SQL Server, SQL Azure ) Our client is an exciting and cutting-edge technology giant with a global presence. They have been a market leader within the e-learning sector for many years and their worldwide client base has never been stronger, with significant growth in the last 12 months. They are looking for an architecturally minded data engineer to join an exceptional core engineering team and deliver features across their Azure-based SaaS platform and infrastructure. We are seeking an Azure Data Engineer who is experienced in building, testing and maintaining Azure data factory pipelines, as well as using Azure Integration tools and services. You will be expected to optimise and improve the platform, in terms of technology and process and to demonstrate hands-on experience...

About Us The world isn’t standing still, and neither is Allstate. We’re moving quickly, looking across our businesses and brands and taking bold steps to better serve customers’ evolving needs. That’s why now is an exciting time to join our team. You’ll have opportunities to take risks, challenge the status quo and shape the future for the greater good. You’ll do all this in an environment of excellence and the highest ethical standards – a place where values such as integrity, inclusive diversity and accountability are paramount. We empower every employee to lead, drive change and give back where they work and live. Our people are our greatest strength, and we work as one team in service of our customers and communities. Allstate operate a very flexible hybrid working policy that will allow you to design your working week in collaboration with your manager with a blend of remote and office working for NI based employees as well as condensed working patterns (4 day...

AWS Data Engineer | 9 Month Contract | Remote | Outside IR35  This is for a small Consultancy looking for a Data Engineer with a strong Python and AWS background to help build out new Data Platforms for a Financial Client.  Requirements: 3 years Python coding experience  3 years AWS experience with tools such as Redshift, S3, EMR and Glue  ETL Experience  Datawarehousing in Redshift or Snowflake Desireables: Consutlancy and Finance Experience  Start up personality If you are interested, please send through an application with your most up to date CV asap to be considered.  AWS Data Engineer | 9 Month Contract | Remote | Outside IR35 

IntaPeople are helping scale up a Data Analytics team with a Data Engineer due to growth and progression within the tribe.  Although the head office is in Cardiff, you will have a choice between being office-based, fully remote or a hybrid approach.   We can only consider applications from those based in the UK.   About the role… This company really rewards talent and hard work by giving bonuses, pay rises and career progression. They have won endless awards for being an exemplary employer year after year. The tribe are elevating and taking data analytics from on-premise systems to the cloud, creating a nice usable format in Google Cloud Platform that can be used by all.    Some data sources are live so you will be responsible for BAU tasks, some are at reconciliation stage, some pipelines in development and some yet to be built.   About you… You will be proactive and have a real passion for data. You have an...

Azure Data Engineer, End User, Remote, Up to £50K Pearson Carter are currently working with an End User who are looking to hire an Azure Data Engineer to join their team. The company are a high end management firm who are embarking on a huge Digital Transformation for their Data platform. They offer a base salary of  Up to £50K and remote working. Get in touch if you are looking for your next opportunity!   Responsibilities: Translating business requirements into Data analytics Design, build and test Data products Develop Data pipelines to be used company wide   Experience: Proven track record of successful implementation of technological solutions/modelling; having the ability to turn business issues into solution design through understanding of integration architecture and patterns. Experience of integrating solutions/applications using the full capability of the Microsoft Azure platform (standardised API approach) and PaaS environment. Experience of working...

Pearson Carter are working with a leading regulated financial services group who are looking to hire an Azure Data Engineer to join their team. They are looking for a talented Data Engineer who can assist in designing and implementing BI and large-scale Data Analytics solutions for customers. They are offering a salary of up to £55k, depending on experience, + benefits. Don’t miss out – APPLY NOW Responsibilities: Azure Data Engineer Translating requirements from stakeholders and customers Implementing and being up to date with all latest technologies End-to-end Design of BI and Data Analytics solutions Experience: Experience in designing and implementing Azure Data solutions using services such as: -Azure Synapse Analytics -Azure Data Lake Storage Gen2 -Azure SQL Database -Azure Data Factory Have working knowledge of Microsoft Power BI Have working knowledge of Azure DevOps Salary: They offer an excellent salary package of up to £55,000 + Private...

About Us The world isn’t standing still, and neither is Allstate. We’re moving quickly, looking across our businesses and brands and taking bold steps to better serve customers’ evolving needs. That’s why now is an exciting time to join our team. You’ll have opportunities to take risks, challenge the status quo and shape the future for the greater good. You’ll do all this in an environment of excellence and the highest ethical standards – a place where values such as integrity, inclusive diversity and accountability are paramount. We empower every employee to lead, drive change and give back where they work and live. Our people are our greatest strength, and we work as one team in service of our customers and communities. Allstate operate a very flexible hybrid working policy that will allow you to design your working week in collaboration with your manager with a blend of remote and office working for NI based employees as well as condensed working patterns (4 day...

Data Engineer  About ConsenSys Data ConsenSys Data sits within Consensys Software Inc. to help address all our variants of data, break down silos, enable best practices, provide first rate resources, and accelerate our mission of becoming a cutting edge data driven organization. We are using a mix of providing some centralized data engineering functions as a shared service, while enabling our business units to make great data decisions with their own data functions. ConsenSys Software Inc. is a wide organization with each individual business unit facing unique data challenges. Infura needs to provide real time analytics on top of a data pipeline doing billions of events per day. MetaMask Swaps needs to provide financial accounting for a purely on chain data source. Truffle needs to track developer engagement across the open source ecosystem. We are looking for a data engineer to join our shared data engineering team, with a goal of helping to build,...

Senior Data Engineer | £80K - £110K | 100% Remote | Spark | Hadoop | Python | Azure SC CLEARANCE REQUIRED Are you looking to work with the fastest growing UK consultancy? Are you looking for more of a client facing position? I have several roles for a UK based consultancy firm who are looking for strong Senior Data Engineers to join the team and work on a huge range of clients. You will be using cutting-edge technology to solve real-world problems. As a Lead Data Engineer you will provide strong development leadership for the team members and take responsibility for the quality that you will provide. You will be working with an agile team to develop and design large scale of data processing software to meet user needs in demanding production environments. The types of technologies they use include, Apache, Hadoop, Spark, Azure, NoSql, and many more. Skills: Leading the development of substantial components for large scale data processing solutions Software...

I am currently on the look out for a GCP Data Engineer to join one of my Media/Marketing clients. This is an urgent hire so we will be looking to get someone strating in the next few weeks, as such availability to start a new role within this is essential. Contract: - 6 Months  - Remote Working  - Inside IR35  Key Skills - 3+ years GCP experience - A good understanding of Python  - Excellent SQL experience Desirable  - DBT  - Power BI, Tableau or Qlikview  If you are able to start within the next couple of weeks, and believe you may be a close fit then please don't hesitate to apply with your up to date CV.

Azure Data Engineer, End User, Remote, £70,000  Pearson Carter are currently working with an End User who are looking to hire an Azure Data Engineer to join their team. The company are a high end retailer who are embarking on a huge Digital Transformation for their Data platform. They offer a base salary of  £70,000  and remote working. Get in touch if you are looking for your next opportunity!   Responsibilities: Translating business requirements into Data analytics Design, build and test Data products Develop Data pipelines to be used company wide   Experience: Azure Synapse Analytics, Data Lake, Tabular SSAS and Power BI datasets Visual Studio, SQL Server, SSIS, SQL and T-SQL   Salary They offer an excellent salary:  £70,000    Location This client has an office in London and is offering hybrid working. Applications are welcome from professionals with Azure experience.   How to Apply Please apply asap with your CV to be considered for...

Azure Data Engineer, End User, Remote, Up to £60,000 Pearson Carter are currently working with an End User who are looking to hire an Azure Data Engineer to join their team. The company are a high end retailer who are embarking on a huge Digital Transformation for their Data platform. They offer a base salary of  £60,000  and remote working. Get in touch if you are looking for your next opportunity!   Responsibilities: Translating business requirements into Data analytics Design, build and test Data products Develop Data pipelines to be used company wide Experience: Azure Synapse Analytics, Data Lake, Tabular SSAS and Power BI datasets Visual Studio, SQL Server, SSIS, SQL and T-SQL Salary They offer an excellent salary:  £60,000   Location This client has an office in London and is offering hybrid working. Applications are welcome from professionals with Azure experience. How to Apply Please apply asap with your CV to be considered for this...

With more than 25m users playing 30m matches every month FACEIT is the leading competitive gaming platform. We provide gamers the best experience possible by making sure we are always on top of our tech – and continue to deliver industry leading features to our already awesome platform! The Team: Our Data team is growing! During the last year, the Data team has grown significantly and has been a key driver of our business with products like Minerva – and we still have a lot more to do! We’re on the lookout for a Data Engineer who loves working with the latest technologies and has a passion for programming and maths! Could this be you? As a Data Engineer you will build and maintain data streaming solutions and data pipelines, help implement AI and ML infrastructure and code in production to solve problems such as cheating identification, matchmaking and detection of abusive behaviour and contribute to creating a best in class data engineering function, supporting...

Microsoft Azure Data Engineer - £45,000 – Remote Pearson Carter are currently working with an International Leading real estate consultancy, who are in search of an Azure Data Engineer to assist them with their Azure Cloud/Data migration projects. Responsibilities: Maintain Data quality Manage database security Develop/manage data recovery plans Support data collection/analysis Document data procedures Power Bi applications  Experience: Data Warehouse/modelling Microsoft Azure Data/Cloud Microsoft SQL, VMWare Power Bi Dynamics 356   Salary: They are offering salaries from £40,000 - 45,000 Location: The Client is offering remote work. How to Apply: Please reply asap along with your CV to be considered for this position. You can also reach out to me on  Victoria@pearsoncarter.com  or 0191 406 6111. Pearson Carter is the Global Leader in Microsoft Azure Recruitment with specialist roles across the globe -  www.pearsoncarter.com   Azure,...

Our IT Team is growing - we need talent professionals to join our team and help us deliver an exciting programme of work that is due to begin in 2022. With a D365 programme and the delivery of a Laboratory Information Management System application due to go ahead in the coming months, now is a great time to be joining our team. We are on the look out for a Data Engineer to contribute to the design and build of required infrastructure to support optimal extraction, transformation, and load of data from various sources. The Role This role forms part of the IT department with specific responsibility for Business Intelligence. As part of the role you will be responsible for every step of data flow and designing, maintaining and configuring data pipelines/platforms and sources. You will be involved in the integration and validation of new software and technical solution and we will look to you to provide effective technical leadership to enable technical...

Position Summary #Remote or #Hybrid Here at S&P Global (formerly IHS Markit) we are looking for an adept, action-oriented Senior Data Engineer to build out a multi-tenant data mesh to enable our soon-to-be-launched digital transformation product which uses advanced NLP, knowledge engineering, and ML to accelerate innovation in engineering, manufacturing, and scientific operations. The perfect candidates will have strong data infrastructure and data architecture skills, a proven track record of collaborating and iteratively implementing data-intensive solutions, strong operational skills to drive efficiency and speed, strong project leadership, and a strong vision for how data engineering can proactively create positive impact for companies. You will be a part of an early-stage team. You will educate stakeholders, mentor team members, and have a significant stake in defining the future of the Data Engineering function for the product. Job...