TorQ 2018 Roadmap

Jonny Press data capture, kdb+, TorQ Leave a Comment

Below is our current TorQ roadmap for 2018. We welcome any additional suggestions, or prioritisation requests. Data Manipulation Library The point here is to produce a set of utilities useful for analysing and manipulating datasets. The target audience is new kdb+ developers or business users. Visualisation products (e.g. Panopticon) are probably good target applications as it is useful to pivot, …

Jonny PressTorQ 2018 Roadmap

Smart Belfast Collaborative Challenge & Belfast Bikes

Brooke Hopley data capture, kdb+, News Leave a Comment

With the recent launch of Smart Belfast Collaborative Challenge by Invest NI and Belfast City Council we thought we’d write a short blog about the existing transport success story of BelfastBikes. If any companies are interested in talking to AquaQ Analytics about their proposed collaborative network and assistance on data please contact us on info@aquaq.co.uk We noticed an API end-point …

Brooke HopleySmart Belfast Collaborative Challenge & Belfast Bikes

AquaQ Analytics Signs Panopticon Reseller Agreement with Datawatch

Jamie Grant kdb+, News, TorQ Leave a Comment

AquaQ Analytics is pleased to announce that it has become an authorised reseller of the Datawatch Panopticon www.panopticon.com Visual Analytics Technology. Already a professional services partner for Datawatch www.datawatch.com, AquaQ will now actively resell the technology to clients operating within the capital markets sector and beyond into other industry verticals. Speaking about the news, AquaQ Analytics CEO Ronan Pairceir commented …

Jamie GrantAquaQ Analytics Signs Panopticon Reseller Agreement with Datawatch

AquaQ Analytics Launches kdb+ Training Academy

AquaQ Admin kdb+, News, training Leave a Comment

AquaQ Analytics is delighted to announce a new 5 Week kdb+ Training Academy   AquaQ Analytics is pleased to announce the launch of a new 5-week intensive kdb+ Training Academy. Clients can now take advantage of the same comprehensive kdb+ training AquaQ provides to its own staff. The training is delivered by industry leading experts and is aimed at clients’ …

AquaQ AdminAquaQ Analytics Launches kdb+ Training Academy

kdb+ Feedhandler Development

Stephanie Woodings data capture, datablog, kdb, kdb+ Leave a Comment

Setting up a kdb+ database is relatively straight forward.  The TorQ Starter Pack is a good place to start.  Two of the trickier bits are: Estimating how much memory your dataset will require Writing applications (generally called “feedhandlers”) to insert data into the database For (1) we’ve written previously on some database set up utilities used to estimate the size of a dataset …

Stephanie Woodingskdb+ Feedhandler Development

Alteryx and kdb+ Integration

Michael Dougherty datablog, kdb, kdb+ Leave a Comment

Integrating kdb+ via TorQ with Alteryx Designer We decided to take a look at Alteryx (https://www.alteryx.com/), the company, their designer product and also see what is possible when rapidly integrated with TorQ, our open source kdb+ framework. Alteryx is based in Irvine, California, U.S. It offers a data science platform geared toward citizen data scientists. The platform’s self-service data preparation …

Michael DoughertyAlteryx and kdb+ Integration

TorQ Release v3.1 – Kafka, Data Replay and Subscriber Cutoff

Jamie Grant data capture, kdb, kdb+, TorQ Leave a Comment

We are delighted to announce release v3.1 of TorQ, the latest instalment of our kdb+ framework. The first of our great new additions is kafka.q, which provides q language bindings for the ‘distributed streaming platform’ Apache Kafka, a real time messaging system with persistent storage in message logs. An application architecture built around Kafka could dispense with a tickerplant component, …

Jamie GrantTorQ Release v3.1 – Kafka, Data Replay and Subscriber Cutoff

Integrating kdb+ with Apache Kafka

Jamie Grant kdb, kdb+ Leave a Comment

We’ve noticed a few clients and listbox/google group members asking questions about Apache Kafka recently, so we decided to take a closer look and add it to TorQ. Apache Kafka bills itself as a ‘distributed streaming platform’ – what that seems to mean is that it is a real time messaging system with persistent storage in message logs. The distributed …

Jamie GrantIntegrating kdb+ with Apache Kafka

TorQ – CME Data Processing Add-on

Aidan O'Gorman datablog, kdb, kdb+, TorQ 2 Comments

Our new addition to the TorQ framework presents a method for processing historical data in its native FIX format from the CME, building and maintaining an order book, and writing this data to disk in a variety of approaches suited to query efficiency or space efficiency. Our example data set is FX futures contracts of 11 major currency pairs, but …

Aidan O'GormanTorQ – CME Data Processing Add-on

Data Replay and Backtest in TorQ

Allan Moore data capture, kdb+, TorQ Leave a Comment

TorQ has a new utility for replaying historical data into real-time data processes, datareplay.q.  Replaying data is usually the first step towards allowing you to backtest.  datareplay.q builds a table of upd function calls like those generated by a tickerplant, but instead, using a historical database as the data source, making it simple to test new or existing real-time subscribers …

Allan MooreData Replay and Backtest in TorQ