Recovering Corrupt Tickerplant Logs

Glen Smith data capture, kdb, kdb+, TorQ 1 Comment

Corrupt tickerplant logs are a curse that no one deserves but that doesn’t stop them from happening even to the best of us. However, all hope is not lost as it is possible to recover the good messages and discard the bad. In this post we will extend upon the standard rescuelog procedure to recover as much as possible from the …

Glen SmithRecovering Corrupt Tickerplant Logs

UK general election 2015 – telling the story of results night with data

Matt Doherty data capture, datablog, kdb+ 1 Comment

If you have been keeping abreast of the UK news recently, you may have heard that an election was happening.  It was an exciting campaign and the results night was even better!  Despite all the opinion polls suggesting that the UK was heading for a hung parliament, the result has turned out dramatically different.  Even US election sage Nate Silver …

Matt DohertyUK general election 2015 – telling the story of results night with data

kdb+ FIX adaptor case study

Mark Rooney kdb+ 2 Comments

FIX is one of the most common communication protocols used within the finance industry. This blog outlines the use of a kdb+ API built on top of QuickFix (www.quickfixengine.org) and describes how simple Indication of Interest (IOI) messages can be sent between two FIX components. We will demonstrate how to use the API to create some simple FIX messages and …

Mark Rooneykdb+ FIX adaptor case study

Six Nations 2015 – using data to tell a story with TorQ and d3.js

Matt Doherty data capture, datablog, kdb+ 6 Comments

This year’s six nations championship will go down in history as one of the best ever (and not just because Ireland won for the second year in a row). The final six hours of rugby on Saturday was some of the most exciting sports I’ve ever watched. How many England fans would’ve believed going into the final day in first …

Matt DohertySix Nations 2015 – using data to tell a story with TorQ and d3.js

kdb+ and MongoDB case study

Jamie Grant kdb+ 1 Comment

Big Data technologies have been all over technology press for what seems like a long time now. MongoDB is an established player in the space, one of the first examples of what have come to be called ‘NOSQL’ databases. With its schema-less design MongoDB is well suited to storing unstructured data and it promises many features to make it easy …

Jamie Grantkdb+ and MongoDB case study

kdb programming challenge – Morse Code

AquaQ Admin kdb+ 7 Comments

“dit dit dit dit – dit dit” We hear this noise in films, war documentaries and even in everyday life. What is this adorable little sound of melody? Yes you are right. This is not just any random sound generated by highly skilled operator (myself) using this little clicking thingy, but THE Morse Code itself. It is just a fancy way of saying …

AquaQ Adminkdb programming challenge – Morse Code

Superbowl XLIX – data visualization using TorQ and d3.js

Matt Doherty datablog, kdb+ 3 Comments

  This weekend saw the New England Patriots face the Seattle Seahawks in the annual American sports-travaganza that is the superbowl. It was the most closely matched and exciting superbowl in years, but what does this have to do with data visualization and analytics? Sports – in particular the big American sports of baseball, basketball and football – are increasingly …

Matt DohertySuperbowl XLIX – data visualization using TorQ and d3.js

kdb programming challenge – the Morse-Thue sequence

Matt Doherty kdb+ 2 Comments

This week’s post is going to be a little different from the last few in that there won’t be one challenge, but rather a series of bite-size challenges in an attempt to tie together what we’ve done in the last three posts. First definition The Morse-Thue sequence is an infinite binary sequence that looks like 0 1 1 0 1 …

Matt Dohertykdb programming challenge – the Morse-Thue sequence

Supporting A kdb+ System: Online Training

Jonny Press kdb, kdb+, training Leave a Comment

We are pleased to announce that due to popular demand we’ve added new content to our online training course.  The additional material is on supporting a kdb+ system (something we have some experience of).  The new material covers: overview of a real time data capture architecture (kdb+tick) kdb+tick setup health checking, monitoring, support and maintenance of a data capture system on …

Jonny PressSupporting A kdb+ System: Online Training

kdb programming challenge – self similarity

Matt Doherty kdb+ 9 Comments

A self similar object is one that is exactly or approximately similar to a part of itself (i.e. the whole has the same shape as one or more of the parts). Self similarity is a central property of fractals. Many objects in the real world, such as coastlines, are statistically self-similar: parts of them show the same statistical properties at …

Matt Dohertykdb programming challenge – self similarity