Endjin - Home

Azure

In the last post I explained how to create a set of Azure Functions that could load data into Snowflake as well as execute Snowflake queries and export the results into your favorite cloud storage solution. In this post I will show how we can use these functions in Azure Data Factory to plug Snowflake […]


If, like me, you are a fan of Azure Data Factory and love Snowflake then you are probably disappointed that there isn’t a native Data Factory connector for Snowflake. While we wait for an official connector from Microsoft we have no alternative but to roll our own. In this blog post I will walk you through […]


Enforce resource tagging with Azure Policy

by Mike Larah

We recently had a requirement from a client that all of their Azure resources must be tagged with a specific set of tags, which were ultimately to be used for cost accounting when the bill came rolling in. For simplicity of this blog post, let’s assume the client just required that all resources had to […]


We were recently looking for a way to run a script on an Azure Virtual Machine that already existed (i.e. not executing it at provisioning time). Whilst there are ways to do this remotely (using PowerShell remoting, for example), these tend to require updating the VM’s networking configuration to open up ports or allow traffic […]


One of the great benefits of Azure (and the Cloud in general) is the simplicity with which you can create and scale resources. The downside to this is that you can easily lose track what you’ve got deployed, or accidentally create expensive items and leave them running. We wanted a way to track our spending […]


One very useful but little used pattern when working with Resource Manager templates, is the ability to use parameters to optionally deploy resources, constrain certain resource configurations based on other user defined parameters, or to toggle parameters based on other values. To give a couple of concrete examples, imagine we have a highly reusable template […]


Cloud Adoption: Risks & Mitigations Analysis

by Howard van Rooijen

Guest Blogger – Barry Smart IT Director & Partner, Hymans Robertson Barry is IT Director at Hymans Robertson, the largest independent firm of consultants and actuaries in the UK. He is responsible for leading the firm’s technology strategy. The firm is turning increasingly to technology to enhance and extend the services it provides to clients. […]


What is Azure Machine Learning? Azure Machine Learning (Azure ML) is a fully managed cloud service that enables you to easily build, deploy and share predictive analytics solutions. Azure ML allows you to create a predictive analytic experiment and then directly publish that as a web service. The web service API can be used in […]


We’re currently working on a project to migrate a customer from AWS to Azure. As always, we like to put a Continuous Delivery pipeline at the heart of the project to ensure there is zero friction pushing out changes across all dev, test and production environments. Two years ago I wrote about the process we […]


It’s #FinTechWeek in the UK, which means it’s the perfect time to share a customer story; for the past 3 years endjin have been helping Hymans Robertson, a market leading actuarial consultancy who have realigned their business towards innovation, placing FinTech and the cloud at the heart of their offerings in the emerging API, Data, […]


Azure data services part 3: Azure Machine Learning

by Alice Waddicor

In parts 1 and 2 of this mini-series, I wrote brief intros to HDInsight and Stream Insight, Azure’s offerings for big data analytics and real-time analytics. Next up, Azure Machine Learning. What it’s for: Azure Machine learning provides a GUI with drag and drop pre-built components for carrying out predictive analytics. You can also plug […]


Azure data services part 2: Stream Insight

by Alice Waddicor

This blog is part of a series where I’m writing up my notes from a training session on Azure’s data services. The previous post dealt with Azure’s Hadoop implementation, HDInsight. This week, I’m going to write about Stream Insight. What it’s for: Stream Insight is an Azure service for real-time event processing. Use cases for […]


Azure data services part 1: HDInsight

by Alice Waddicor

Last Autumn, Richard Kerslake and I were lucky enough to land in the warmth of Barcelona, for a Microsoft Analytics training event. The sessions gave an introduction to Azure’s HDInsight, Stream Analytics and Machine Learning services. I’m going to write up a quick summary of what I learned about each service, starting with HDInsight. What […]


SpecFlow Extensions for Azure Storage Emulator

by Howard van Rooijen

In most cases, when writing an integration specifications against Azure Storage, you want to use the real thing rather than the Storage Emulator as the performance profile and behaviours are noticeably different. One exception is if you’ve hosted your code in a public repo; in this case you really don’t want to commit your real […]


A CDN, short for Content Delivery Network, is essentially a network of servers set-up, in various geographic locations, with the aim of speeding up the delivery of content to end-users across the Internet. […]


Troubleshooting Twilio with New Relic

by Richard Kerslake

Recruitment Genius asked endjin to develop an automated, telephony-based candidate interviewing system, using Twilio and Microsoft Azure. After it went live, Recruitment Genius started receiving a number of support calls from users who were having trouble logging into the system. Troubleshooting involved a series of laborious steps to manually tally Twilio logs with logs from the rest […]


Gotchas when installing an Elasticsearch cluster on Azure

by Richard Kerslake

Elasticsearch is an open source distributed search server, based on Lucene. It provides full-text search via a RESTful interface and JSON documents. It is ideally suited for running on cloud platforms like Azure. This is not a step-by-step guide to using Elasticsearch and running it on Azure. I’m assuming you already have some basic knowledge […]


Last month I wrote a guest blog post for JetBrains; a detailed step by step guide for creating a custom TeamCity MetaRunner to notify NewRelic that a new deployment has occurred based on a case study I wrote earlier in the year called “From Chaos, Through Fear, To Confidence” which details an ALM and DevOps […]


Downloading Windows Azure Subscription Files

by Pascal Arnould

If you use Azure Management Studio, you can quickly setup your connections by importing your publish settings […]


1601 was the year that Pierre de Fermat and King Louis XIII of France were born, Robert Devereux was beheaded in the Tower of London, the Dutch defeated the Portuguese navy in the battle of Bantam Bay and the year Shakespear’s Hamlet is thought to have been performed for the first time. Monday January, 1st 1601 (in the Gregorian calendar) was a pretty uneventful day yet the first day of the 17th century is affecting millions today. […]