AquaQ Parquet kdb+ converter

William Lowe kdb+ Leave a Comment

Following on from the columnar and data formats blog post, we have decided to investigate creating a custom API for parquet. Traditionally, we would do this through python, however, we are interested to see what the performance benefits are. Kdb-Parquet is a library that can convert kdb+ tables to and from the Apache Parquet table format. The library provides a …

William LoweAquaQ Parquet kdb+ converter

kdb+ in a Containerised solution

Gary Davies kdb+ Leave a Comment

There has been a trend in recent years to move towards containerisation in software solutions. A containerised approach looks to package applications along with their dependencies for ease of deployment and improving scalability and resiliency. AquaQ has created a proof of concept which looks at leveraging containers, in conjunction with kdb+, to demonstrate the following capabilities: Use of kdb+ in …

Gary Davieskdb+ in a Containerised solution

Kafka with kdb+ and Java

Paul Doherty kdb, kdb+ 3 Comments

Kafka is a distributed messaging service used to achieve a low-latency, high-throughput transfer of data using persistent logs to prevent loss of data. This blog will: Illustrate the various components used in Kafka. Show how Kafka can be used to share data between different technologies, for example, a Java producer and a kdb+ consumer. Highlight a use case for Kafka …

Paul DohertyKafka with kdb+ and Java

Grafana kdb+ Adaptor Update

Dylan Creighton kdb, kdb+ 1 Comment

One of the most requested features to our kdb+ Grafana adaptor was the ability to create panels from the results of server side functions. This most recent update to the adaptor continues to build on the SimpleJSON datasource created by Grafana by working around the limitation of the single drop down menu for queries, whilst also allowing parameters to be supplied. The adaptor is also integrated into TorQ …

Dylan CreightonGrafana kdb+ Adaptor Update

Grafana – kdb+ adaptor

AquaQ Admin kdb, kdb+ 3 Comments

AquaQ Analytics are often involved in projects using different visualisation tools connected to kdb+.  We have recently spent some time reviewing and then implementing a simple Grafana-kdb+ adaptor. This open-source script has been developed using the inbuilt Grafana SimpleJSON datasource and comes with the capability of table and time series visualisation and manipulation. Instructions for installation and usage can be …

AquaQ AdminGrafana – kdb+ adaptor

Using kdb+ with REST APIs

Jonathon McMurray kdb+ Leave a Comment

In the modern web, APIs (Application Programming Interfaces) form a large part of programmatic interfacing with web services. Many of the services you likely use everyday provide APIs, allowing third party developers to build applications around these services, whether that means retrieving data, receiving notifications of certain events, or sending information to the service for processing. Numerous services used frequently …

Jonathon McMurrayUsing kdb+ with REST APIs

AquaQ Analytics Launches kdb+ Training Academy

AquaQ Admin kdb+, News, training Leave a Comment

AquaQ Analytics is delighted to announce a new 5 Week kdb+ Training Academy   AquaQ Analytics is pleased to announce the launch of a new 5-week intensive kdb+ Training Academy. Clients can now take advantage of the same comprehensive kdb+ training AquaQ provides to its own staff. The training is delivered by industry leading experts and is aimed at clients’ …

AquaQ AdminAquaQ Analytics Launches kdb+ Training Academy

New TorQ-FX Released

Jamie Grant data capture, kdb, kdb+, TorQ Leave a Comment

For anyone who has used TorQ, you will most likely be familiar with the Finance Starter Pack. The starter pack is an example data capture system that is based on randomly generated equity data. It was created with the purpose of showing how to set up an example TorQ installation and how different applications can be built and deployed on …

Jamie GrantNew TorQ-FX Released

Adventure in Retrieving Memory Size of kdb+ Object

AquaQ Admin kdb+ Leave a Comment

It has been quite a puzzle to figure out how much memory a kdb+ object uses within a q session, so we decided to write this utility script and add it to the latest release of our TorQ Framework. My first naïve impression was why not just use -22!, that should be a good estimate. Um no, -22! is only returning …

AquaQ AdminAdventure in Retrieving Memory Size of kdb+ Object