Post #45: The data deluge, revisited

What do Kafka, fabric and catalogues have in common? It’s nothing to do either with literature or with clothing. Rather, all three terms were used with liberal…

Post #45: The data deluge, revisited

What do Kafka, fabric and catalogues have in common? It’s nothing to do either with literature or with clothing. Rather, all three terms were used with liberal abandon at the Big Data LDN event we attended earlier this week. If you’re a geek, then they relate to a tool for streaming data, an architecture for providing consistent data capabilities and a metadata management service, respectively. Alternatively, if you’re a generalist like this author, then the most overwhelming conclusion we drew from the event was that we all know data is growing; the challenge lies in how to manage it to be relevant.

Big Data LDN is an annual event (we also attended in 2018) where over 8,000 attendees spent two days meeting with more than130 different businesses all of whom are seeking to provide answers to (varying aspects of) the above challenge. There were also a series of keynote speeches from the likes of Google, Microsoft and IBM (Google’s, on intelligent data science, was the most interesting). In terms of what we learned:

“We’re not even halfway there.” This was a quote from an executive whom we met referring to the data journey which most businesses are undergoing. Historically, companies have used software to improve outcomes; now, they are ‘becoming’ software. Think about the paradigm change underway, say, in ride hailing (Uber, Lyft etc) or in getting access to a loan. For this journey to reach fruition, the prevailing view from the event is that data needs to become more dynamic; or the tools used to leverage data need to work harder. Machine learning and artificial intelligence should not be seen as ends in themselves; more as means to an end. There was a strong and consistent view that (human) analysis and interpretation remain crucial as much as anything to avoid unconscious bias. 

Against this background, many participants with whom we spoke highlighted a profound shortage of skilled data personnel. IBM noted that some 500,000 IT jobs in the US are unfilled simply because candidates lack the right skill sets. Training, therefore, remains paramount. One other topic that emerged in many of our discussions at the event related to data sovereignty. With increasing regulatory scrutiny (think GDPR in Europe from one perspective, or suggestions that the mega-cap tech companies in the US should be broken up from another), every business needs to take more responsibility in terms of data management. Securing data effectively and ensuring its privacy remain paramount.


The document is provided for information purposes only and does not constitute investment advice or any recommendation to buy, or sell or otherwise transact in any investments. The document is not intended to be construed as investment research. The contents of this document are based upon sources of information which Heptagon Capital believes to be reliable. However, except to the extent required by applicable law or regulations, no guarantee, warranty or representation (express or implied) is given as to the accuracy or completeness of this document or its contents and, Heptagon Capital, its affiliate companies and its members, officers, employees, agents and advisors do not accept any liability or responsibility in respect of the information or any views expressed herein. Opinions expressed whether in general or in both on the performance of individual investments and in a wider economic context represent the views of the contributor at the time of preparation. Where this document provides forward-looking statements which are based on relevant reports, current opinions, expectations and projections, actual results could differ materially from those anticipated in such statements. All opinions and estimates included in the document are subject to change without notice and Heptagon Capital is under no obligation to update or revise information contained in the document. Furthermore, Heptagon Capital disclaims any liability for any loss, damage, costs or expenses (including direct, indirect, special and consequential) howsoever arising which any person may suffer or incur as a result of viewing or utilising any information included in this document. 

The document is protected by copyright. The use of any trademarks and logos displayed in the document without Heptagon Capital's prior written consent is strictly prohibited. Information in the document must not be published or redistributed without Heptagon Capital's prior written consent. 

Heptagon Capital LLP, 63 Brook Street, Mayfair, London W1K 4HS
tel +44 20 7070 1800
fax +44 20 7070 1881
email [email protected] 

Partnership No: OC307355 Registered in England and Wales Authorised & Regulated by the Financial Conduct Authority 

Related Insights

Featured Insights
Featured Insights22 July 2021

Season 3, Post 29: Quiz time

Your one and only question is the following: what do electric vehicles and plant-based burgers have in common? The answer: they’re both getting better the whole time. As improvements to these products occur, so adoption levels should increase. This intriguing analogy was made to us by the Chief Executive of Meatless Farm, Morten Toft Bech, […]

Learn more
Featured Insights
Featured Insights15 July 2021

Season 3, Post 28: The magic of mushrooms

Mycelium-tech could be the next big thing. You might think you are familiar with the humble mushroom. Fried, they work well as a breakfast option, for example. Alternatively, they could perhaps be chopped into a pasta dish or salad. However, when you buy mushrooms in your local store or – even better – see them […]

Learn more
Featured Insights
Featured Insights06 July 2021

Season 3, Post 27: Take a trip on the hyperloop

Imagine being able to get from central London to Edinburgh in less than an hour, or from downtown New York to San Francisco in fewer than five. Think of all that extra time you would save. Travelling the former route by train currently takes close on four hours, while, a coast-to-coast US trip might require […]

Learn more

Get The Updates

Separated they live in Bookmarks right at the coast of the famous Semantics, large language ocean Separated they live in Bookmarks right


Sign up to our monthly email newsletter for the latest fund updates, webcasts and insights.