SEMO-Downloader TorQ App

Liam O'Connor data capture, TorQ Leave a Comment

The TorQ-SEMO downloader is an application which is built upon the TorQ framework in partnership with The Electric Storage Company. It allows users to download and store data relevant to electricity production for the island of Ireland. The app can be used to perform bespoke analysis on electricity market data sourced from the SEMOpx API and weather data obtained from the Tomorrow.io API (formerly known as ClimaCell). …

Liam O'ConnorSEMO-Downloader TorQ App

Automating Data Egress from kdb+ into Google BigQuery

Matthew Clark data capture, kdb+, TorQ Leave a Comment

kdb+ tick data capture software has been largely popular in banks, hedge funds and other financial institutions for years. Its kdb+ framework permits incredibly fast querying of data largely due to its vectorised querying language and efficient storage methods. A large cost component in any kdb+ implementation is always storage costs. Storage costs have been a big driving factor towards …

Matthew ClarkAutomating Data Egress from kdb+ into Google BigQuery

Pegasus TorQ Tick Tools

Stefan Hales data capture, TorQ Leave a Comment

Following our partnership with Pegasus, we have built TorQ adaptor which will provide TorQ’s segmented tickerplant with out-of-the-box access to leading data platforms and direct data solutions such as TP ICAP’s SURFIX data feed. Some of the key benefits Pegasus’ MarketsIO Tick Tools package provides are: Data burst protection against tick loss. Control over the distribution of streaming analytics. Ability to …

Stefan HalesPegasus TorQ Tick Tools

Real-time airline traffic dashboards with TorQ-Air

Chad Thackray data capture, kdb+, TorQ Leave a Comment

TorQ-Air is an application built on the TorQ framework that allows us to capture data through the Lufthansa developer API and perform both real-time and historical analytics on flight data. The solution includes a front-end built on Kx-dashboards, showing a number of real-time and historical stats. Download and installation instructions can be found on the TorQ-Air github repo. Founded in …

Chad ThackrayReal-time airline traffic dashboards with TorQ-Air

TorQ in 2020

Elliot Tennison data capture, kdb+, TorQ Leave a Comment

2020 was a strange year for most of us. We’ve used it as an excuse to put a lot of work into extending TorQ- here’s a brief recap of some highlights. The first large contribution in 2020 was to provide the option of integrating Datadog into TorQ. Datadog is an extremely useful application monitoring service capable of tracking anything from …

Elliot TennisonTorQ in 2020

TorQ Segmented Tickerplant

Elliot Tennison data capture, kdb+, TorQ Leave a Comment

Our most recent project here at AquaQ Analytics has been an extension of the TorQ production framework. In particular, a new segmented tickerplant process (STP) has been incorporated into TorQ which will provide greater flexibility to the user whilst also preserving the functionality of the original tickerplant process. This blog post will revisit the role of the tickerplant in TorQ, show the new features that a segmented tickerplant provides and highlight the advantages …

Elliot TennisonTorQ Segmented Tickerplant

TorQ-Crypto Released

Cormac Ross data capture, kdb+, TorQ Leave a Comment

Today we are excited to release our new TorQ-Crypto package! For those of you that have used TorQ, you will most likely be familiar with the TorQ Finance Starter Pack. TorQ-Crypto behaves in a similar manner to the starter pack and provides an example of how an application can be built and deployed on top of the TorQ framework. The …

Cormac RossTorQ-Crypto Released

TorQ DQS

Daniel Lam data capture, kdb+, TorQ Leave a Comment

We are delighted to announce the release of the Data Quality System to TorQ, our kdb+ framework.  The system allows developers to easily set up customizable checks on the quality of data within their database system. Motivation TorQ already has monitoring tools provided, but previously they were mainly used to monitor the health of individual processes. Checks would be performed …

Daniel LamTorQ DQS

kdb+ IoT Database Structure

Jonny Press data capture, datablog, kdb+ Leave a Comment

When implementing a kdb+ database the partitioning structure is a key decision point. kdb+ provides four in-built ways to partition database tables: by year, month, date or integer. Only one partitioning scheme may be used. The best option is usually based on two factors: how data arrives how it is accessed The partitioning scheme should facilitate easy addition of data …

Jonny Presskdb+ IoT Database Structure