TorQ provides detailed and thorough standard output, error and usage logging for multiple processes. These comprehensive logs are essential to system development and monitoring. However more detailed logs can increase the time and effort required to examine log files. Logs aggregation can streamline log analysis, by consolidating log data from multiple components or applications into a centralised location. Log aggregation …
TorQ Roadmap 2022
We are currently assisting a number of clients with the move towards cloud, and cloud capabilities feature heavily in the development pipeline for TorQ, our kdb+ production framework. The move to cloud can be a “lift-and-shift” approach, or it can be an opportunity to re-engineer the solution. The case for re-engineering parts or all of an incumbent solution are strong. …
CI/CD & TorQ-Pipeline
Many application development lifecycles have moved to more modern cycle approaching full automation. The purpose of this blog is to demonstrate TorQ-Pipeline, an example using TorQ of a modern kdb+ CI/CD (Continuous Integration/Continuous Delivery/Deployment) pipeline. Before DevOps culture, the software cycle was heavily siloed. The goal of CI/CD is to break down the barriers between the different teams involved in …
SEMO-Downloader TorQ App
The TorQ-SEMO downloader is an application which is built upon the TorQ framework in partnership with The Electric Storage Company. It allows users to download and store data relevant to electricity production for the island of Ireland. The app can be used to perform bespoke analysis on electricity market data sourced from the SEMOpx API and weather data obtained from the Tomorrow.io API (formerly known as ClimaCell). …
Automating Data Egress from kdb+ into Google BigQuery
kdb+ tick data capture software has been largely popular in banks, hedge funds and other financial institutions for years. Its kdb+ framework permits incredibly fast querying of data largely due to its vectorised querying language and efficient storage methods. A large cost component in any kdb+ implementation is always storage costs. Storage costs have been a big driving factor towards …
Pegasus TorQ Tick Tools
Following our partnership with Pegasus, we have built TorQ adaptor which will provide TorQ’s segmented tickerplant with out-of-the-box access to leading data platforms and direct data solutions such as TP ICAP’s SURFIX data feed. Some of the key benefits Pegasus’ MarketsIO Tick Tools package provides are: Data burst protection against tick loss. Control over the distribution of streaming analytics. Ability to …
TorQ Data Access API
Accessibility is important for all software, it provides a pleasant user experience as well as a seamless interaction with non-native processes. The Data Access API provides TorQ with a sleek user interface as well as accessible and extensive functionality to both the inexperienced kdb+ user and non kdb+ processes. Whilst experienced kdb+ developers will likely prefer to write queries directly, …
Real-time airline traffic dashboards with TorQ-Air
TorQ-Air is an application built on the TorQ framework that allows us to capture data through the Lufthansa developer API and perform both real-time and historical analytics on flight data. The solution includes a front-end built on Kx-dashboards, showing a number of real-time and historical stats. Download and installation instructions can be found on the TorQ-Air github repo. Founded in …
TorQ in 2020
2020 was a strange year for most of us. We’ve used it as an excuse to put a lot of work into extending TorQ- here’s a brief recap of some highlights. The first large contribution in 2020 was to provide the option of integrating Datadog into TorQ. Datadog is an extremely useful application monitoring service capable of tracking anything from …
AquaQ Analytics and Pegasus Partner to provide Client Value
Capital markets relies on massive data sets that are exponentially growing and moving faster. The key to making use of the data to create information is through smart analytics, delivered in a cost effective and modular way. AquaQ Analytics and Pegasus Enterprise Solutions are teaming together to provide dynamic, cost effective access to your data that will yield tremendous insights …