About the role
Why We Work at Dun & Bradstreet
We are at a transformational moment in our company journey - and we’re so excited about it. Each day, we are finding new ways to strengthen our award-winning culture, and to accelerate creativity, innovation and growth. Our purpose is to help customers improve business performance with Dun & Bradstreet’s Data Cloud and Live Business Identity, and we’re wildly passionate and committed to this purpose. So, if you’re looking to make an immediate impact at a company that welcomes bold and diverse thinking, come join us!
As a Data Engineer II in our AI & Ingestion team, you will work as part of an agile team building and operating the pipelines that bring new data into Dun & Bradstreet, increasingly using AI to collect, extract, enrich and validate it. You will be responsible for designing, building and running production AI pipelines, from source acquisition and ingestion through to AI-powered extraction, classification and entity matching, and delivery against our data quality standards.
Your focus will be on applying modern cloud-native and generative AI services across the ingestion lifecycle, harnessing their scale and automation to accelerate how we onboard and curate data, while keeping accuracy, integrity, completeness, conformity and consistency at the core. Beyond delivery, you will play an active role in our AI & Ingestion community of practice, sharing patterns, tooling and lessons learned so that good practice is adopted across teams. Continuous improvement will be a key measure of success in this role.
Key Responsibilities
- Design, build and operate scalable data ingestion pipelines across a range of sources, including web data collection, API integrations and batch file deliveries, on our cloud data platform
- Build and productionise AI pipelines that use large language models (LLMs) and machine learning to extract, classify, enrich and standardise structured and unstructured data
- Develop agentic and retrieval-augmented generation (RAG) workflows, including prompt design, tool and Model Context Protocol (MCP) integrations and orchestration, where they deliver measurable gains in coverage, speed or quality
- Establish evaluation and monitoring for AI components, including accuracy benchmarks, human-in-the-loop review, drift detection, and cost and latency tracking
- Embed data quality, data governance and Responsible AI practices into every pipeline, in line with Dun & Bradstreet's AI Ethics and data management policies
- Research and apply modern data mastering and entity resolution techniques, including AI-assisted matching, to increase derived insight from disparate data sources
- Own the operational health of ingestion and AI pipelines in production, including monitoring, incident resolution and continuous optimisation of performance and cost
- Contribute to and help lead the AI & Ingestion community of practice by sharing reusable components, patterns and standards, running knowledge-sharing sessions and supporting the upskilling of engineers across teams
- Support other engineers through design reviews, code reviews and mentoring
- Develop and maintain documentation, including data flow diagrams, data lineage, pipeline runbooks, and prompt and model documentation
- Partner with product, data science and business stakeholders to translate data requirements into effective ingestion and AI solutions
Key Requirements
- 5+ years of experience in data engineering or a similar position, including hands-on experience building data ingestion pipelines
- Strong Python and SQL are minimum requirements
- Practical experience building pipelines or applications with LLMs (for example via Anthropic, OpenAI or Google Vertex AI / Gemini APIs), including prompt engineering, structured outputs and evaluation
- Experience with cloud data processing, GCP preferred (e.g. BigQuery, Dataflow, Cloud Composer/Airflow, Vertex AI); Databricks experience is an advantage
- Experience in various methods of data ingestion and collection, such as web data collection, APIs, SFTP and other file delivery channels
- Familiarity with RAG, embeddings and vector databases, agent frameworks or MCP is desirable
- Understanding of engineering best practice for AI pipelines (MLOps/LLMOps), including version control, CI/CD, automated testing and monitoring
- Awareness of Responsible AI principles and of data privacy and governance considerations (e.g. GDPR) when applying AI to data
- A genuine passion for knowledge sharing, with experience of, or strong interest in, contributing to communities of practice, internal tech talks or mentoring
- Show an ownership mindset in everything you do; be a problem solver, be curious and be inspired to take action, be proactive, seek ways to collaborate and connect with people and teams in support of driving success.
- Continuous growth mindset: keep learning in a fast-moving AI landscape through social experiences and relationships with stakeholders, experts, colleagues and mentors, and widen your competencies through structured courses and programmes.
- Where applicable, fluency in English and languages relevant to the working market
- Robust data knowledge preferably around business data sets with proven analytical and quantitative skills
- Bachelor’s Degree in Data Science field, Information Systems, Computer Science, Mathematics or similar