Kafka with kdb+ and Java

Paul Doherty kdb, kdb+ Leave a Comment

Kafka is a distributed messaging service used to achieve a low-latency, high-throughput transfer of data using persistent logs to prevent loss of data. This blog will: Illustrate the various components used in Kafka. Show how Kafka can be used to share data between different technologies, for example, a Java producer and a kdb+ consumer. Highlight a use case for Kafka …

Paul DohertyKafka with kdb+ and Java

Grafana kdb+ Adaptor Update

Dylan Creighton kdb, kdb+ Leave a Comment

One of the most requested features to our kdb+ Grafana adaptor was the ability to create panels from the results of server side functions. This most recent update to the adaptor continues to build on the SimpleJSON datasource created by Grafana by working around the limitation of the single drop down menu for queries, whilst also allowing parameters to be supplied. The adaptor is also integrated into TorQ …

Dylan CreightonGrafana kdb+ Adaptor Update

Grafana – kdb+ adaptor

Fiona Morgan kdb, kdb+ 2 Comments

AquaQ Analytics are often involved in projects using different visualisation tools connected to kdb+.  We have recently spent some time reviewing and then implementing a simple Grafana-kdb+ adaptor. This open-source script has been developed using the inbuilt Grafana SimpleJSON datasource and comes with the capability of table and time series visualisation and manipulation. Instructions for installation and usage can be …

Fiona MorganGrafana – kdb+ adaptor

Using kdb+ with REST APIs

Jonathon McMurray kdb+ Leave a Comment

In the modern web, APIs (Application Programming Interfaces) form a large part of programmatic interfacing with web services. Many of the services you likely use everyday provide APIs, allowing third party developers to build applications around these services, whether that means retrieving data, receiving notifications of certain events, or sending information to the service for processing. Numerous services used frequently …

Jonathon McMurrayUsing kdb+ with REST APIs

AquaQ Analytics Launches kdb+ Training Academy

AquaQ Admin kdb+, News, training Leave a Comment

AquaQ Analytics is delighted to announce a new 5 Week kdb+ Training Academy   AquaQ Analytics is pleased to announce the launch of a new 5-week intensive kdb+ Training Academy. Clients can now take advantage of the same comprehensive kdb+ training AquaQ provides to its own staff. The training is delivered by industry leading experts and is aimed at clients’ …

AquaQ AdminAquaQ Analytics Launches kdb+ Training Academy

New TorQ-FX Released

Jamie Grant data capture, kdb, kdb+, TorQ Leave a Comment

For anyone who has used TorQ, you will most likely be familiar with the Finance Starter Pack. The starter pack is an example data capture system that is based on randomly generated equity data. It was created with the purpose of showing how to set up an example TorQ installation and how different applications can be built and deployed on …

Jamie GrantNew TorQ-FX Released

Adventure in Retrieving Memory Size of kdb+ Object

WooiKent Lee kdb+ Leave a Comment

It has been quite a puzzle to figure out how much memory a kdb+ object uses within a q session, so we decided to write this utility script and add it to the latest release of our TorQ Framework. My first naïve impression was why not just use -22!, that should be a good estimate. Um no, -22! is only returning …

WooiKent LeeAdventure in Retrieving Memory Size of kdb+ Object

Avoiding End-of-Day Halts with TorQ

Jonny Press data capture, kdb, kdb+, TorQ 3 Comments

kdb+tick is great, but there’s a problem- when the RDB (real time database) writes to disk on its daily schedule, users cannot access that day’s data until the write out is complete.  There are various solutions to this issue including: using something similar to w.q to write out the data periodically intraday have a replicated system and staggering the save down, …

Jonny PressAvoiding End-of-Day Halts with TorQ

kdb+ and MongoDB case study

Jamie Grant kdb+ 1 Comment

Big Data technologies have been all over technology press for what seems like a long time now. MongoDB is an established player in the space, one of the first examples of what have come to be called ‘NOSQL’ databases. With its schema-less design MongoDB is well suited to storing unstructured data and it promises many features to make it easy …

Jamie Grantkdb+ and MongoDB case study