New posts (collected on Mar 15, 2021)
Hey,
here are the latest posts from my blog. I’m interested to hear what you think at @mkrcah on Twitter. Or just hit reply to this email.
Building bi-directional sync between two system #data-engineering
I've been facing the question of how to build a bidirectional near-real-time synchronization between two systems. In the past years, I've seen multiple projects where data between two systems were synced bi-directionally. In these projects, the bi-directional sync was a cause of data loss, unresolved conflicts, and frustration.
Generating tax reports with Python, Jinja, and Click #tools
Every month I need to create a tax report using this ancient government website. Facing the choir, I found myself procrastinating every month, and this procrastination had been draining my energy. So I decided to face my daemons.
Testing asynchronous systems #engineering
I'm spending these days kicking off end-to-end tests. By end-to-end tests, I mean tests that interact with a set of IT systems as if the set was a big black box. For example, one test sends a REST API request to system A, waits until the data propagates through systems B and C to system D, and checks the result in system D via another REST API call. Now, how to implement the waiting part for this asynchronous test?
Contractor didn't deliver: how to resolve? #process
A client recently asked for my input in the following situation: the company works with an external contractor, and the contractor worked for months on a project. When the contractor delivered the project, the output wasn't what had been expected. The misalignment resulted in tension between the company and the contractor, as well as in tension within the company. Now, how to resolve this?