National AI Awards 2025Discover AI's trailblazers! Join us to celebrate innovation and nominate industry leaders.

Nominate & Attend

Lead Big Data Engineer - Contract

Northrop Grumman
London
9 months ago
Applications closed

Related Jobs

View all jobs

Lead Manufacturing Engineer - Composites

Lead FEM Engineer

Lead Quality Engineer

Lead Engineer CFD

Quality Engineering Team Lead

Electronics Design Engineer

Requisition ID: R10166531

Your Opportunity to Define Possible.Our Opportunity to Deliver the Nation’s Security. Together.

Role clearancetype:Must already hold highest level of government clearance.

Location:London

About Your Opportunity:

As a Big Data Systems Engineer, you will be responsible for designing, implementing, and maintaining scalable big data systems that support our data science, machine learning, and AI workloads. You will work closely with cross-functional teams to ensure seamless data integration, security, and compliance with GDPR and privacy regulations. Your expertise in scripting, troubleshooting, and integration testing will be essential in optimizing our data pipelines and orchestration processes.

On-site presence required a minimum of 4 days per week.

Your Benefits:

Flexible working schedules -we offer flexible and hybrid working arrangements. Talk to us at the application stage about any scheduling preferences you may have.Flexible Benefits Package– choose which NGUKL benefits you want to satisfy your personal needs. Core Benefits provided for you are Healthcare, Dental, Life Assurance and Pension. Benefits you can flex include Critical Illness Cover, Health Cash Plan, and Health Assessments.Employee Incentive Programme –exceptional performance is recognized through our annual incentive programme which is awarded to top performers who excel.Career Development –opportunity for ongoing professional development and career growth opportunities.

Your Responsibilities:

- Scripting and Automation: Develop and maintain scripts for automating data processes and workflows.

- Troubleshooting: Diagnose and resolve technical issues related to big data systems, data pipelines, and integrations.

- Integration Testing: Conduct thorough testing to ensure seamless integration of new tools and technologies into existing systems.

- Linux Internals: Utilize in-depth knowledge of Linux internals to optimize performance and reliability of big data infrastructure.

- Network Protocols: Apply understanding of TCP/IP and OSI models in the design and troubleshooting of networked systems.

- Data Pipeline Support: Manage and optimize data pipelines and orchestration tools such as NiFi and Airflow.

- Scalable System Design: Design scalable big data systems with a focus on security, GDPR compliance, and privacy.

- Hybrid Cloud Management: Leverage hybrid cloud experience to manage on-premise and AWS cloud resources effectively.

- Data Science Support: Support data science, machine learning, and AI workloads using tools like Jupyter, Spacy, Transformers, and NLTK.

- Big Data Platforms: Utilize big data NoSQL engines and platforms such as Hive, Impala, and Elasticsearch for data storage and processing.

- BI and Visualization: Implement and support business intelligence and visualization tools like Tableau, Kibana, and PowerBI to provide actionable insights.

Your Experience:

- Proven experience in scripting languages such as Python, Bash, or similar.

- Strong troubleshooting skills and the ability to diagnose and resolve complex technical issues.

- Experience with integration testing and ensuring seamless tool integration.

- In-depth knowledge of Linux internals and system administration.

- Understanding of TCP/IP and OSI models.

- Hands-on experience with data pipeline tools like NiFi and Airflow.

- Proven ability to design scalable big data systems with a focus on security and GDPR compliance.

- Hybrid cloud experience, specifically with on-premise and AWS cloud environments.

- Familiarity with data science, machine learning, and AI tools such as Jupyter, Spacy, Transformers, and NLTK.

- Experience with big data NoSQL engines/platforms such as Hive, Impala, and Elasticsearch.

- Proficiency with business intelligence and visualization tools like Tableau, Kibana, and PowerBI.

- Excellent communication and collaboration skills.

Preferred Experience:

- Certification in AWS or other cloud platforms.

- Experience with additional data orchestration tools.

- Familiarity with other big data tools and technologies. (Hadoop, Cloudera)

- Previous experience in a similar role within a dynamic and fast-paced environment.

Your Future Team:

The teams in this space work on some of the toughest challenges that are key to our client’s success, as such they carry a heavy load and require the ability to be able to dip in and share the workload. Success in this area requires flexibility in tasking, adapting to the problem at hand and picking up the skills along the way. This work is predominantly on client site and will vary between integrating with development and test teams, as well as taking on standalone tasks when needed.

We believe that creating a team that values diversity and fosters inclusion is essential to great performance. We know the best ideas come from diversity of thought, background, perspective, culture, gender, race, age and many other elements. We welcome candidates from all backgrounds and particularly from communities currently under-represented within our industry. We treat everyone with respect and foster safe and inclusive environments.

About Our Responsibilities:

Our customers operate in unique environments which offer new and exciting challenges every day, cultivating a place where you can learn and thrive, working alongside the best minds in industry. We’ll give you space to develop your career, where your ideas can shape the future of our dynamic business. 

We promote collaboration to achieve more than we could imagine, together. And within a respectful and inspirational environment, we value what you say and do.

How to Apply:

Interested in our opportunity?

Yes– then simply submit your application online. Your application will be reviewed by one of our expert recruiters who’ll then respond advising you of the outcome and next steps for successful candidates.

Possibly, I’d like to find out more– then connect direct with , where one of our recruitment business partners will be happy to support you with any enquires.

Background checks and potentially security clearance form part of the recruitment process, our team will inform you of the procedures when required.

Northrop Grumman UK:

Work with a global brand that makes a real contribution to our nation’s security and future. At Northrop Grumman UK, the brightest minds come together to push the boundaries and Define Possible. As leaders in the digital transformation of Aerospace, Defence and Intelligence we are providing ground-breaking outcomes for our customers.

UK Cyber & Intelligence Business:

Our UK Cyber & Intelligence business combines modern software development approaches with a rich heritage and experience in the Defence and security sectors. Our customers have complex and sensitive data and information requirements requiring a mission partner who quickly understands the context, delivering and sustaining a portfolio of challenging technology projects at scale and pace, supporting them through an ambitious digital transformation programme.

#LI-CJ1

#LI-ONSITE

Northrop Grumman is committed to hiring and retaining a diverse workforce, and encourages individuals from all backgrounds and all abilities to apply and consider becoming a part of our diverse and inclusive workforce.

National AI Awards 2025

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

How to Find Hidden Space Jobs in the UK Using Professional Bodies like the RAeS, UKSpace & More

The UK space sector is enjoying rapid growth—driven by satellite constellations, launch services, Earth observation, space science, and defence applications. But while demand for engineers, scientists, mission designers, and space analysts is high, many of the most compelling roles are never advertised publicly. Instead, these opportunities are often filled through professional networks, working groups, innovation clusters, and academic-industry partnerships. This guide will show you how to access hidden UK space jobs by engaging with bodies like the Royal Aeronautical Society (RAeS), UKSpace, British Interplanetary Society (BIS), and regional space clusters. By leveraging membership directories, special-interest groups (SIGs), CPD events, and funded projects, you can position yourself to be first in line—even before roles are posted.

How to Get a Better Space Sector Job After a Lay-Off or Redundancy

Being made redundant from a role in the UK space sector can be disheartening. Whether your work was tied to satellite design, launch services, ground systems, mission operations, or Earth observation analytics, the experience and specialist knowledge you've gained is still highly valuable. The UK government’s Space Strategy, increased commercial investment, and new launch initiatives across Cornwall, Scotland, and Wales continue to drive opportunities in upstream and downstream space technologies. This guide will help you relaunch your career in the UK space sector after redundancy.

UK Space Jobs Salary Calculator 2025: Work Out Your Market Value in Seconds

Why last year’s pay survey already misfires for UK space talent Ask a Satellite Systems Engineer wrestling with RF budgets, a Mission Operations Analyst shepherding cubesats at 04:00 UTC, or a Launch Vehicle Propulsion Engineer machining ablative liners in Cornwall: “Am I earning what I deserve?” The honest answer drifts faster than orbital debris. Since early 2024 the UK Space Agency released £1.6 billion of National Space Strategy funding, SaxaVord’s spaceport edged toward its first vertical launch licence, and Harwell Campus welcomed three VC‑fuelled in‑orbit‑servicing start‑ups. Each headline ratcheted hiring demand—and salaries. A salary guide printed in 2024 is already as dated as a Block II GPS ephemeris: no mention of the Scottish micro‑launcher premium, the AI‑earth‑observation bubble, or the sudden scarcity of flight‑dynamics controllers who can wrangle multi‑constellation mega‑swarms. To replace guesswork with data, UKSpaceJobs.co.uk distilled a clear, three‑factor formula. Feed in your discipline, UK region & seniority; you’ll get a realistic 2025 baseline—no stale averages, no vague “competitive” claims. This article unpacks the formula, explores the forces inflating space salaries, and sets out concrete steps to boost your value within ninety days.