Engineering at DueDil

We're hiring! If you're interested in joining the DueDil engineering and product team to work with great people
on solving interesting and meaningful problems, check out the open positions on our careers page and get in touch!

Migration to google cloud - part 1 - arrival of API V4

17 January 2020 Craig MarcusGcp , Containers , Nginx

At DueDil we are migrating workloads from a managed hardware provider to the Google Cloud Platform (GCP). Services have historically been run on our Mesos cluster, using Marathon for Docker container orchestration »

Ansible on an immutable VM

06 February 2019 Marcus GustavssonAnsible , Containers , Docker , Dev-ops

We use a fair bit of Ansible here at DueDil, and as we try to investigate how to best manage workloads that for one reason or another we don’t want in Kubernetes we've had to do some workarounds that might be helpful for others. »

Efficient broadcast joins in Spark, using Bloom filters

22 November 2018 Mohamed Abdelbary

Broadcast joins are a nice way to avoid a shuffle operation in Spark. However, Spark’s collect operation for the broadcast set can introduce memory pressure on the driver. Bloom filters can provide a neat solution to this problem. »

Inside DueDil. Meet Farouk, Data Protection Manager.

08 November 2018 Ross DeanePeople

Introducing Farouk, DueDil's Data Protection Manager. In this interview, he shares why he enjoys being part of DueDil's engineering team and his journey into the world of tech. »

Reconstructing case information

17 October 2018 Nagarjuna Kumar

When you register a business at Companies House, the names are stored in upper case regardless of input. That's a loss of information. We wanted to see if we could reconstruct the "intended" case for these names. »