Post #45: The data deluge, revisited - Heptagon Capital – Production

What do Kafka, fabric and catalogues have in common? It’s nothing to do either with literature or with clothing. Rather, all three terms were used with liberal…

Post #45: The data deluge, revisited

What do Kafka, fabric and catalogues have in common? It’s nothing to do either with literature or with clothing. Rather, all three terms were used with liberal abandon at the Big Data LDN event we attended earlier this week. If you’re a geek, then they relate to a tool for streaming data, an architecture for providing consistent data capabilities and a metadata management service, respectively. Alternatively, if you’re a generalist like this author, then the most overwhelming conclusion we drew from the event was that we all know data is growing; the challenge lies in how to manage it to be relevant.

Big Data LDN is an annual event (we also attended in 2018) where over 8,000 attendees spent two days meeting with more than130 different businesses all of whom are seeking to provide answers to (varying aspects of) the above challenge. There were also a series of keynote speeches from the likes of Google, Microsoft and IBM (Google’s, on intelligent data science, was the most interesting). In terms of what we learned:

“We’re not even halfway there.” This was a quote from an executive whom we met referring to the data journey which most businesses are undergoing. Historically, companies have used software to improve outcomes; now, they are ‘becoming’ software. Think about the paradigm change underway, say, in ride hailing (Uber, Lyft etc) or in getting access to a loan. For this journey to reach fruition, the prevailing view from the event is that data needs to become more dynamic; or the tools used to leverage data need to work harder. Machine learning and artificial intelligence should not be seen as ends in themselves; more as means to an end. There was a strong and consistent view that (human) analysis and interpretation remain crucial as much as anything to avoid unconscious bias. 

Against this background, many participants with whom we spoke highlighted a profound shortage of skilled data personnel. IBM noted that some 500,000 IT jobs in the US are unfilled simply because candidates lack the right skill sets. Training, therefore, remains paramount. One other topic that emerged in many of our discussions at the event related to data sovereignty. With increasing regulatory scrutiny (think GDPR in Europe from one perspective, or suggestions that the mega-cap tech companies in the US should be broken up from another), every business needs to take more responsibility in terms of data management. Securing data effectively and ensuring its privacy remain paramount.


The document is provided for information purposes only and does not constitute investment advice or any recommendation to buy, or sell or otherwise transact in any investments. The document is not intended to be construed as investment research. The contents of this document are based upon sources of information which Heptagon Capital believes to be reliable. However, except to the extent required by applicable law or regulations, no guarantee, warranty or representation (express or implied) is given as to the accuracy or completeness of this document or its contents and, Heptagon Capital, its affiliate companies and its members, officers, employees, agents and advisors do not accept any liability or responsibility in respect of the information or any views expressed herein. Opinions expressed whether in general or in both on the performance of individual investments and in a wider economic context represent the views of the contributor at the time of preparation. Where this document provides forward-looking statements which are based on relevant reports, current opinions, expectations and projections, actual results could differ materially from those anticipated in such statements. All opinions and estimates included in the document are subject to change without notice and Heptagon Capital is under no obligation to update or revise information contained in the document. Furthermore, Heptagon Capital disclaims any liability for any loss, damage, costs or expenses (including direct, indirect, special and consequential) howsoever arising which any person may suffer or incur as a result of viewing or utilising any information included in this document. 

The document is protected by copyright. The use of any trademarks and logos displayed in the document without Heptagon Capital's prior written consent is strictly prohibited. Information in the document must not be published or redistributed without Heptagon Capital's prior written consent. 

Heptagon Capital LLP, 63 Brook Street, Mayfair, London W1K 4HS
tel +44 20 7070 1800
fax +44 20 7070 1881
email [email protected] 

Partnership No: OC307355 Registered in England and Wales Authorised & Regulated by the Financial Conduct Authority 

Related Insights

Featured Insights
Featured Insights14 April 2021

Season 3, Post 15: Greener spending

Great news that the world is getting slowly back to normal, but some things have undoubtedly changed, arguably permanently. It has become increasingly apparent that environmental and sustainability issues matter, much more so than they did historically. In new research released by Mastercard this week, 85% of adults state they’re willing to take personal action […]

Learn more
Featured Insights
Featured Insights08 April 2021

Season 3, Post 14: Fake steak and test-tube tomatoes

Next week marks the reopening of London’s restaurants – at least for outdoor dining – for the first time since December 2020. Menus will likely be full of the joys of spring; perhaps an asparagus starter followed by some young lamb. Needless to say, your author already has several reservations in his diary. While not […]

Learn more
Featured Insights
Featured Insights01 April 2021

Season 3, Post 13: Life on Mars

Plans are afoot to build the first human city on Mars. Yes, you did read that sentence correctly; it is not an April Fool’s Day spoof. Spanish design firm and think-tank ABIBOO released plans last week for a conceptual city on the red planet that would see construction commence in 2054 with the intention for […]

Learn more

Get The Updates

Separated they live in Bookmarks right at the coast of the famous Semantics, large language ocean Separated they live in Bookmarks right