Posted on Wed 18 July 2018 in misc

During my internship with Twitter's Real Time Compute team I created a service that would allow incoming traffic levels to a topology to be predicted and the performance effect of that traffic level on the topology assessed. The code for this service, called Caladrius, has just been open sourced!

Continue reading

Starting My Twitter Internship

Posted on Tue 20 February 2018 in misc

Yesterday I started my internship with the Real Time Compute team at Twitter! I will be working to apply the findings of my performance modelling research of Apache Storm topologies to Twitter's Heron system.

Continue reading

Twitter Heron and Dhalion

Posted on Sat 01 July 2017 in misc

Two recent papers have given more detail on Heron (the successor to Storm). I am hoping my work on Storm can transfer to Heron and particularly Dhalion, the newly proposed auto-scaling system for Heron.

Continue reading

Python North East - The Next Generation

Posted on Wed 01 March 2017 in misc

This month I officially take the reins of the Python North East user group. Myself and Scott Walton are taking over from Rowan Hargreaves and Kieran Darcy's fine stewardship.

Continue reading

Hacking Happiness

Posted on Wed 18 January 2017 in misc

Yesterday I took part in a hack-a-thon hosted by the Digital Catapult and the Royal Society. It was based on the premise of using data analysis and technology to try and measure and improve happiness. It was a great event, with lots of teams from all different disciplines and backgrounds. I was part of a team from Newcastle University, as well as members from Brighton and Central St. Martins. Our idea was to create an app that could find the happiest route between two points, avoiding high pollution areas and preferring green spaces. The judges liked it so much they declared us the winners!

Continue reading

Back from DEBS 2016

Posted on Mon 20 June 2016 in misc

I had an amazing time at DEBS 2016! It was great to meet other researcher's in my field, discuss my ideas (and have them dissected), make some new friends and even met the lead developer of Twitter's Real Time Analytics. Also my doctoral symposium paper has now been published as part of the DEBS proceedings, so I am official a published researcher!

Continue reading

DEBS 2016 - Doctoral Symposium

Posted on Thu 05 May 2016 in misc

I am going to my first academic conference! Distributed Event Based Systems (DEBS) in Irvine, California which takes place at the end of June this year. I will be presenting as part of their Doctoral Symposium, where I will explain the basis, current progress and future plan for my PhD research and get feedback from experts in the field!

Continue reading

Python North East - Introduction to Apache Spark

Posted on Wed 11 November 2015 in misc

This post contains links and basic tutorials for the November Python North East talk, Introducing Apache Spark.

Continue reading

Dual Booting Ubuntu and Windows on Surface Pro 3

Posted on Sat 28 February 2015 in misc

As part of my PhD I was generously given a brand new Microsoft Surface Pro 3. Unfortunately, as I have been an Ubuntu user for the better part of a decade, using Windows again was a less than optimal experience. Having read many blog posts about the Surface 3 hardware not being supported by the current Ubuntu kernel I resolved to wait and battle on with Windows 8.1. However, after a sever bout of yak shaving I managed to get the latest 15.04 beta 2 working (mostly).

Continue reading

Installing Microsoft Azure Command Line Tools on Ubuntu

Posted on Mon 01 December 2014 in misc

As part of my MRes I am using Microsoft's Azure cloud platform. I had a few issues getting the command line tools to work so I am posting the solution here to save other people the bother.

Continue reading