The TorQ-SEMO downloader is an application which is built upon the TorQ framework in partnership with The Electric Storage Company. It allows users to download and store data relevant to electricity production for the island of Ireland. The app can be used to perform bespoke analysis on electricity market data sourced from the SEMOpx API and weather data obtained from the Tomorrow.io API (formerly known as ClimaCell). …
Automating Data Egress from kdb+ into Google BigQuery
kdb+ tick data capture software has been largely popular in banks, hedge funds and other financial institutions for years. Its kdb+ framework permits incredibly fast querying of data largely due to its vectorised querying language and efficient storage methods. A large cost component in any kdb+ implementation is always storage costs. Storage costs have been a big driving factor towards …
Pegasus TorQ Tick Tools
Following our partnership with Pegasus, we have built TorQ adaptor which will provide TorQ’s segmented tickerplant with out-of-the-box access to leading data platforms and direct data solutions such as TP ICAP’s SURFIX data feed. Some of the key benefits Pegasus’ MarketsIO Tick Tools package provides are: Data burst protection against tick loss. Control over the distribution of streaming analytics. Ability to …
Real-time airline traffic dashboards with TorQ-Air
TorQ-Air is an application built on the TorQ framework that allows us to capture data through the Lufthansa developer API and perform both real-time and historical analytics on flight data. The solution includes a front-end built on Kx-dashboards, showing a number of real-time and historical stats. Download and installation instructions can be found on the TorQ-Air github repo. Founded in …
TorQ in 2020
2020 was a strange year for most of us. We’ve used it as an excuse to put a lot of work into extending TorQ- here’s a brief recap of some highlights. The first large contribution in 2020 was to provide the option of integrating Datadog into TorQ. Datadog is an extremely useful application monitoring service capable of tracking anything from …
TorQ Segmented Tickerplant
Our most recent project here at AquaQ Analytics has been an extension of the TorQ production framework. In particular, a new segmented tickerplant process (STP) has been incorporated into TorQ which will provide greater flexibility to the user whilst also preserving the functionality of the original tickerplant process. This blog post will revisit the role of the tickerplant in TorQ, show the new features that a segmented tickerplant provides and highlight the advantages …
TorQ-Crypto Released
Today we are excited to release our new TorQ-Crypto package! For those of you that have used TorQ, you will most likely be familiar with the TorQ Finance Starter Pack. TorQ-Crypto behaves in a similar manner to the starter pack and provides an example of how an application can be built and deployed on top of the TorQ framework. The …
TorQ DQS
We are delighted to announce the release of the Data Quality System to TorQ, our kdb+ framework. The system allows developers to easily set up customizable checks on the quality of data within their database system. Motivation TorQ already has monitoring tools provided, but previously they were mainly used to monitor the health of individual processes. Checks would be performed …
kdb+ IoT Database Structure
When implementing a kdb+ database the partitioning structure is a key decision point. kdb+ provides four in-built ways to partition database tables: by year, month, date or integer. Only one partitioning scheme may be used. The best option is usually based on two factors: how data arrives how it is accessed The partitioning scheme should facilitate easy addition of data …