The importance of interfaces 8 December 2023·2 mins Software Engineering Data Engineering Interfaces are powerful.
The dead letter queue pattern 9 June 2023·2 mins Software Engineering Data Engineering The dead letter queue (DLQ) pattern is commonly used to increase the resiliency of services that process data, allowing them to recover from incidents that prevent the processing or writing of that data without losing that data.
We had an incident, and it was great 24 January 2021·4 mins Data Platform Software Engineering We recently had an incident with our data pipeline, resulting in data being lost on route to our data platform.
The benefits of postmortems 11 October 2019·1 min Management Software Engineering Postmortems are a well established process followed in the aftermath of an incident.