Data Engineer - Palantir Foundry
This job is no longer accepting applications
See open jobs at Ve3.See open jobs similar to "Data Engineer - Palantir Foundry" Global Talent Jobs.
Posted 6+ months ago
About Us
VE3 is a technology and business consultancy focused on delivering end-to-end technology solutions and products. We have successfully serviced enterprises across multiple markets, including the public and private sectors. Our services span all aspects of business, providing a holistic approach to managing an organization. We are committed to providing technical innovations and tools that empower organizations with critical information to facilitate decision-making that results in business transformation through cost savings and increased operational efficiency. Our commitment to quality is adopted throughout the organization and sets the foundation for delivering our full suite of capabilities.
Job Description
Data Engineer – Palantir Foundry
Role Summary
The Foundry Engineer is responsible for designing, building, and operating data pipelines, transformations, and data products within Palantir Foundry / FDP. The role focuses on hands-on engineering, working closely with platform architects, data architects, and clinical SMEs to deliver reliable, auditable, and reusable data assets during a live platform transition.
This role operates in a highly governed NHS environment, handling sensitive data and supporting both transformation delivery and operational continuity.
Requirements
Key Responsibilities
Data Engineering & Pipeline Development
Build and maintain end-to-end Foundry pipelines, from raw ingestion to curated and semantic layers.
Implement ingestion from multiple source systems (EPRs, operational systems, reference datasets).
Develop transformations using Foundry pipelines, SQL, PySpark, and native Foundry tooling.
Apply consistent patterns for:
- schema evolution
- incremental loads
- reconciliation and validation
Support multi-tenant or multi-trust data separation where required.
Data Quality, Lineage & Governance
Implement data quality rules, validation checks, and exception handling.
Ensure lineage, provenance, and auditability are embedded in pipelines.
Support compliance with NHS DSPT, IG, and internal governance standards.
Participate in DPIA-driven controls such as:
- access restrictions
- data minimisation
- logging and traceability
Collaboration & Domain Enablement
Work closely with:
- internal NHS data engineers and SMEs
- Foundry Architects and Data Architects
- clinical and operational stakeholders
Translate legacy ETL logic and undocumented business rules into modern, maintainable transformations.
Contribute to canonical data model (CDM) and ontology implementation under architectural guidance.
Operational Support & Change
Support service management activities for Foundry pipelines:
- monitoring
- incident investigation
- root cause analysis
Respond to small change requests (schema changes, source upgrades, data corrections).
Contribute to runbooks and operational documentation.
Essential Skills & Experience
Foundry / Platform
Hands-on experience with Palantir Foundry (or FDP) in a delivery role.
Strong understanding of Foundry concepts:
- pipelines
- datasets
- transforms
- permissions and access control
Data Engineering
- Strong SQL skills.
- Experience with Python and/or PySpark for data transformation.
- Solid understanding of data engineering patterns (ETL/ELT, batch, incremental loads).
Governance & Quality
- Experience implementing data quality checks and validation logic.
- Understanding of lineage, auditability, and operational controls in regulated environments.
Delivery Environment
- Experience working in complex, multi-stakeholder programmes.
- Comfortable operating during platform transition and change.
Desirable Skills & Experience
- NHS or healthcare data experience (acute, ICB, or national datasets).
- Experience working with sensitive or PII data under strict IG controls.
- Familiarity with service management concepts (incident, change, release).
- Experience working alongside platform providers (e.g. Palantir, NHSE) and SIs.
Security & Compliance Requirements
- UK-based role.
- BPSS clearance (or eligible).
- Ability to work under NHS DSPT and DPIA-controlled environments.
This job is no longer accepting applications
See open jobs at Ve3.See open jobs similar to "Data Engineer - Palantir Foundry" Global Talent Jobs.