Free of Charge kdb+ Architecture Workshop NYC

AquaQ Admin data capture, datablog, kdb, kdb+, News, TorQ, training Leave a Comment

We were discussing our launch party in NYC and were kicking around ideas of what to do before it.  Some of us wanted to go to the Metropolitan Museum of Art; some of us wanted to go for a long lunch and maybe a stroll through Central Park; some of us wanted to run a kdb+ Architecture Workshop. So here we are. …

AquaQ AdminFree of Charge kdb+ Architecture Workshop NYC

TorQ User Group

AquaQ Admin data capture, datablog, kdb, kdb+, TorQ Leave a Comment

We have recently created a TorQ user group, for questions and discussions on TorQ (our kdb+ framework).  We will also be using it for more general data capture architecture considerations, and we’ll be publishing coding challenges every two weeks. We hope it will become a useful resource!

AquaQ AdminTorQ User Group

End-of-Day Parallel Sorting in TorQ

AquaQ Admin data capture, datablog, kdb, kdb+, TorQ Leave a Comment

We’ve written some blog posts previously on TorQ End-of-Day and more efficient methods for structuring temporary data on disk.  Until now TorQ has handled the end-of-day sorting or merging of tables sequentially, processing one table at a time.  Additional functionality has been added in the latest release of TorQ (v2.6.2) which will enable the parallel sorting of tables. This will allow …

AquaQ AdminEnd-of-Day Parallel Sorting in TorQ

kdb+ 3.4: Broadcast Publish

Glen Smith data capture, datablog, kdb, kdb+, TorQ Leave a Comment

kdb+ v3.4 introduces a new broadcast feature that reduces the work done when publishing messages to multiple subscribers.  Whenever a message is sent from one process to another via IPC (Inter Process Communication), the message is serialised before being sent and then deserialised when received.  Under normal IPC, if the same message is sent to multiple processes, it is serialised separately …

Glen Smithkdb+ 3.4: Broadcast Publish

Temporal and Bitemporal Data in kdb+: 2

Daniel McCullion datablog, kdb, kdb+ Leave a Comment

The previous section of this blog post explored using kdb+ to manage unitemporal data. We will continue the discussion into bitemporal data, which provides an additional timeline to the database and allows different historical views of the database to be defined. Bitemporal Data Bitemporal data consists of two temporal fields and is an extension of unitemporal data. Unitemporal adds Valid …

Daniel McCullionTemporal and Bitemporal Data in kdb+: 2

Temporal and Bitemporal Data in kdb+: 1

Daniel McCullion datablog, kdb, kdb+ Leave a Comment

When you look at a table within a database you usually assume that the data being presented is up-to-date and correct. But what if a particular record was updated or corrected for in-accuracy? Usually the record would be modified directly to reflect this. But what if you wanted to know when this modification occurred, what did it replace, or when …

Daniel McCullionTemporal and Bitemporal Data in kdb+: 1

kdb+ Internet of Things and Pharmaceutical Applications

Jonny Press datablog, kdb, kdb+, TorQ 5 Comments

We at AquaQ Analytics have recently built two kdb+ applications which are outside its traditional finance domain.  One is an IoT application which monitors vehicle movements, the other is a cost forecasting and analysis tool for clinical trials in the pharmaceutical industry.  Both are built on our TorQ Framework.  We had to do some slightly novel things, moving away from the …

Jonny Presskdb+ Internet of Things and Pharmaceutical Applications

UK general election 2015 – telling the story of results night with data

Matt Doherty data capture, datablog, kdb+ 1 Comment

If you have been keeping abreast of the UK news recently, you may have heard that an election was happening.  It was an exciting campaign and the results night was even better!  Despite all the opinion polls suggesting that the UK was heading for a hung parliament, the result has turned out dramatically different.  Even US election sage Nate Silver …

Matt DohertyUK general election 2015 – telling the story of results night with data

Six Nations 2015 – using data to tell a story with TorQ and d3.js

Matt Doherty data capture, datablog, kdb+ 6 Comments

This year’s six nations championship will go down in history as one of the best ever (and not just because Ireland won for the second year in a row). The final six hours of rugby on Saturday was some of the most exciting sports I’ve ever watched. How many England fans would’ve believed going into the final day in first …

Matt DohertySix Nations 2015 – using data to tell a story with TorQ and d3.js