Do IT With Data

Real Time - CEPs - The fire that powers the engine

Posted on

furnace

So in previous posts I have talked about the pipes, that gets the data from here to there, the hardware and network that pipes sit on, and for most people reading about real time on the web, that is where the conversation usually ends.

 

But there is another crucial component ...

Continue Reading

Comments»


With great data comes great responsibility

Posted on

To paraphrase FDR (and more recently Spiderman) who once said that ‘great power involves great responsibility’, machine learning is having a larger impact on everyone's day to day lives.

your model over time

This is important to remember when you start planning to roll out your machine learning models on your customers. Whether ...

Continue Reading

Comments»


Real Time - The Pipes

Posted on

The Pipes

In my last post I described the often forgotten lower layer of a Real Time stack, the hardware and network layers. 

 

In this post I want to discuss what I call the ‘pipes’ layer. The pipes layer is the set of components that are responsible for moving the bits around ...

Continue Reading

Comments»


Real Time - Network and HW layers

Posted on

 

In my last blog post I mentioned how Real time (and large scale data processing in general) changes some of the basic tools and techniques that a typical application developer has to deal with.

 

In this post I want to talk about the lowest level of the technology stack that ...

Continue Reading

Comments»


A Real Time state of mind

Posted on

I cut my teeth using OLTP systems back on a mainframe way back when. Back then a application programmers toolbox was rather limited, they had a transaction processing controller (TPC) that would deal with all scaling, and a DBMS (non relational) that stored data, and a job submission service to ...

Continue Reading

Comments»