Endjin - Home

Technology

I recently wrote a blog on using ADF Mapping Data Flow for data manipulation. As part of the same project, we also ported some of an existing ETL Jupyter notebook, written using the Python Pandas library, into a Databricks Notebook. This notebook could then be run as an activity in a ADF pipeline, and combined […]


As part of a recent project we did a lot of experimentation with the new Azure Data Factory feature: Mapping Data Flows. The tool is still in preview, and more functionality is sure to be in the pipeline, but I think it opens up a lot of really exciting possibilities for visualising and building up […]


For those who don’t know, I am currently in the process of carrying out a full code review and improvement of some of our internal code using NDepend. To find out more about the quality measures that NDepend uses to analyse the code – read my first blog in this series! Otherwise, let’s press on! […]


My take on the cornerstones of good project estimation and planning. Firstly, a huge thank you to Mike Cohn for his book on Agile estimation and Planning, which I wholeheartedly recommend if you want to know more about these techniques. And also, to Steve McConnell for going into the real details of software estimation in […]


11 cheers for binary (And 3 for hexadecimal)!

by Carmel Eve

So, I finally reached a point in my software development education where I could no longer avoid it. I needed to actually learn what binary was… Now a lot of you are probably sat here wondering how on earth I managed to get to this point without knowing, and to be honest, I have no […]


So, this week we are looking at the Buffer and Window Rx operators. (If you have no idea what I’m on about, I suggest you start at the beginning!) There are a few different implementations of these operators, and we are going to focus on the time-based versions. In order to do this, we need […]


After a brief foray into Azure AD, we’re back onto Rx! (If you missed part 1 and 2 then might be worth having a quick read – going to gloss over some of the stuff common to both) OnNext(The GroupBy operator) This week we’re looking at the GroupBy operator. This one’s a bit more involved, […]


In September I joined endjin a Technical Fellow (an entirely new branch in endjin’s career pathway to accommodate me – more on that later). I’ve has been involved with endjin since 2011, as an Associate, helping to deliver some of our most technically challenging projects (and if you go even further back, I attended Cambridge University with endjin co-founder […]


There’s been a little bit of a gap since my last Rx blog, I’ve been pretty busy with keeping up with Advent of Code in any spare time (and I’m sure there will be a blog along those lines at some point in the near future). But, for now, it’s time for a deep dive […]


In case you missed it… Here’s a link to my last blog on understanding Rx (luckily this blog has an internal buffer so if you’re just tuning in now, you’ve not missed your chance)! OnNext(Understanding of the Rx operators) Now one of the most exciting things about Rx is that it has its own implementation […]


Overflowing with dataflow part 2: TPL Dataflow

by Carmel Eve

Edit: In case you missed it! Here’s a link to part 1, a general overview of dataflow as a processing technique! The specific implementation of dataflow that I want to talk about is the TPL dataflow library. The task parallel library is a .NET library which aims to make parallel processing and concurrency simpler to […]


I’m very excited that Ian Griffiths has joined endjin as a “Technical Fellow”. This is a new career pathway branch we created especially for Ian, as he didn’t really fit into any of our existing roles; his skills and expertise exemplify a pathway that many software engineers desire, but few have the opportunity to achieve […]


Disclaimer: This is not an in-depth overview of encryption and data management, more a slice of the concepts I’ve come across as a relative newcomer to this world (i.e. I’m new, please forgive my relative ignorance). A brief introduction to hashing In order to talk about cryptography, we first need to understand hashing. In a […]


After four years of university, you’d think I’d have this whole research thing down. However, I must admit that in my somewhat limited university experience of writing essays (us scientists tended to prefer the Greek alphabet), most of my “research” was done after the fact. I would spend the last day before a deadline frantically […]


Over the last few week’s I’ve been catching up on my reading backlog and serendipity meant that I read Simon Sinek’s “Start With Why: How Great Leaders Inspire Everyone To Take Action” which was published in 2009, shortly followed by Satya Nadella’s “Hit Refresh: The Quest to Rediscover Microsoft’s Soul and Imagine a Better Future […]


Digital Transformation is the buzzword of the moment; organisations are trying to reconfigure themselves to operate in the digital age. One of the key enablement strategies involves putting APIs at the heart of the organisation to centralise access to data, logic and value, while removing those traditional barriers that prevent collaboration between organisational silos. APIs […]


We produced a booklet to coincide with our Future Decoded talk “The 100 Year Start-up: Embracing Disruption in Financial Services“, where we examine the challenges and opportunities in the Microsoft Cloud for the Financial Services Industry, covering the following topics: Security, Privacy & Data Sovereignty Data Ingestion, Transformation & Enrichment Big Compute Big Data – […]


This continues Endjin’s series on FinTech as part of #fintechweek Today, we are talking about what it takes to make a FinTech start-up succeed. So, what are the ingredients for a great FinTech start-up? Yesterday, the UK Government published a report commissioned from EY on the leading locations for FinTech start-ups. It decided that the […]


It’s #FinTechWeek in the UK, which means it’s the perfect time to share a customer story; for the past 3 years endjin have been helping Hymans Robertson, a market leading actuarial consultancy who have realigned their business towards innovation, placing FinTech and the cloud at the heart of their offerings in the emerging API, Data, […]


This continues Endjin’s series on FinTech as part of #fintechweek Today, we are talking about the blockchain. There is a lot of hype about the blockchain – usually wrapped up with talk about Bitcoin, crypto-currencies and people being arrested in Japan. But when you cut through the hype, there is a underlying reality that will […]