+44 7887 691 077 inphinity@myinphinity.comPartnersContact us
INPHINITY
  • Company
    • About Inphinity
    • Partners
    • Events
    • CSR
    • Careers
    • Inphinity Universe
    • Inphinity.App
  • News
  • Products
    • Inphinity Suite
    • Inphinity Forms
    • Inphinity Flow
    • Inphinity Mole
    • Other products
  • Solutions
    • Budgeting and Planning
    • Mole Data Privacy Analytics
    • Project Management Solution
    • Audit Genie Solution
    • ESG Reporting & Compliance
  • Resources
    • Demo apps
      • HR Workflow Into Action
      • Inphinity Files Analyzer
      • Inphinity Universe: Demo Portal
    • Webinars
      • Qlik and Inphinity: The only cloud solution for the next generation of analytics
      • Inphinity Webinar On-Demand │Qlik and Inphinity: The only cloud solution for the next generation of analytics
      • Activate your HR Analytics with Qlik and Inphinity Suite
      • Activate your data intelligence with Qlik & Inphinity Suite Superpowers for Budgeting and Planning
      • Mission Critical: 4th Gen Analytics in Healthcare
      • Qlik World 2020 Sessions
      • UHMB NHS: Taking Actions Where The Data Is
      • Waterfall AM: Actionability In Financial Services
      • Pushing the Boundaries Video Series
      • Qlik Geex: Writeback Discussion
    • Success stories
      • Waterfall AM
      • Mayo Hardware
      • UHMB NHS UK
      • Emark Analytics
      • Thunderbox Business Success
      • Inphinity Forms on Mobile
      • Inphinity Healthcare: Mission Critical
    • Technical
      • Inphinity Suite November 2022
      • TechTuesday Video Series
      • Inphinity Suite May 2022
      • Inphinity Forms Version 10.0
      • Inphinity Flow Version 2.3
      • More releases
  • Training & Consultancy
  • Menu Menu

Is unstructured data worth your time? What do Qlik luminaries think?

By Maria Oreska | | 15. May 2020

Did you know it would take 1.2 million mosquitoes, each sucking once, to completely drain the blood in an average human? My latest post about the covid-19 publicly available app has 5 815 views up to now. The text analytics market value will be US$ 18.25 Bn by 2025. Interesting, isn’t it?

Do you think those numbers are correct? Is it even important? How many posts and articles do you read-only because they contain numbers in the headline or first one or two sentences?

People are fascinated by numbers. I believe there are many theories why it is so – about the evolution, genes, collective behavior… I like numbers, too. It’s comfortable to know exactly how many breads I should buy, to see numbers when comparing two possible scenarios before making the decision where to go for a vacation, to watch the reach of my posts in social media.

“If you can’t measure it, you can’t improve it.”

Data is something I can use to improve my business, my decisions, my lifestyle…

All in all, data is here to be measured.

Measures are numbers.

Data is numbers.

Wrong.

…but somehow many people think like this. Despite the fact that 80% of all data we generate is unstructured (not sure if the number is correct, but it looks better than “much”), we are still focused on analyzing and measuring numbers.

A few years ago, at Inphinity (even before it was named Inphinity and the team was a part of Emark) we developed the Mole unstructured data connector – the first Qlik custom connector for unstructured data. To be honest, it doesn’t have hundreds of users today as we expected.

What do Qlik Luminaries think?

Why are we so focused on numbers? According to Konrad Mattheis (Deloitte): “The first reason is that there is a lot of structured data. Secondly, most human beings need and want structure – unstructured is chaos, unpredictable, for them.”

However, many leaders with years of experience in the data analytics universe discuss the importance of unstructured data (see the article by Martin Kostic) or already deal with it (Visualizing HR 660 by Dalton Ruer). If you are interested in some creative analysis, check US Presidential Speeches Analysis by Terezia Blaskova (Emark).

I can nothing else than agree with Adrian Parker (Differentia Consulting): “For the full story, we need to show both structured and unstructured data in a single tool.”

The opinion of Radovan Oresky (Emark) is quite skeptical but also confirms the value in usage all data, not only structured: “Unstructured data will surely have its part in the future (not the only one). But I am doubtful, that it will be mainstream.“

Angelika Klidas (Data literacy evangelist) confirms it, too: “I think the power is within the combination of the two, so yes I do believe that unstructured data is in combination with structured the future.”

“For the full story, we need to show both structured and unstructured data in a single tool.” (Adrian Parker)

All mentioned leads me to the conclusion that unstructured data needs to be analyzed together with structured – it should be accessible and easy to understand for the users. We are on the way to “avoid the data racism” but it is a step by step process. Let’s start by combining the data together…

Combining data together

Thanks to Inphinity Forms new feature, the user can simply upload any file to the Qlik app. When you combine it with the Mole unstructured data connector in the background, the result can be a simple “file search engine” that I think many users will appreciate. “Show me all documents where Customer X or John Doe is mentioned.” Connect your files to structured data and create an overview of your sales team together with their CVs and soft-skills or language certificates. Use a Qlik associative engine to identify anomalies in invoice payments by using clients’ data and invoices in the very same Qlik app. Check if the customer satisfaction correlates with the documentation of the project your team provided.

I think we are on the same page it doesn’t end here. And I don’t think only about almost sci-fi scenarios how the AI will rule the world. Unstructured data can be crucial for specific but very important use cases, exactly like Radovan Oresky (Emark) mentioned: “The main effort will still be to capture the most important data in a structured, easily analyzable form (with help from RPA). Analysis of unstructured data will be used to either enrich key analysis or be used for very specific, niche use-cases (customer/population sentiment, fraud detection, context search).”

After we become more familiar with it, I think we will come with more and more use cases on how to use it and get value from it. Also, the technology needed for its processing will become more accessible. Some of us already think this way. Dalton Ruer (Qlik) is a person I really admire for his ideas and opinions when it comes to the technical future of data analytics. When we were in touch about this specifically, he emailed me (except for the comment that the video needed sound): “I don’t believe it alone holds all the answers as it generally requires very sophisticated NLP to make sense of it to get meaning. But getting data into the application is at least half of the battle. Because I could then call out to whatever R/Python NLP library I want to use.”

“Getting files with unstructured data into the application is at least half of the battle.” (Dalton Ruer)

Yes, there are known workarounds on how to process unstructured data in Qlik. However, it is not easy or intuitive. Not even for a Qlik guru like Rob Wunderlich (Panalytics, Inc.): “I’ve occasionally dealt with unstructured data either brute-forced it with Qlik Script or wrote a processor/extractor in another language. I have usually shied away from PDF as a source because it can be so complex. So, your solution for PDF looks great!”

Unstructured data is just a type of data. Files are only other data sources. In my opinion, it is like with women in tech – there is a long journey until we truly forget the differences (men and women, structured and unstructured) and simply said: until we will analyze “all data” – but we know it’s time to start… somehow. And you can start by downloading the app in the video by yourself here 😉.

DOWNLOAD INPHINITY FILES ANALYZER

Some inspirations

Oh, yes and some inspirations how something like this can be used right now 😉:

Adrian Parker: “This solution is great for empowering users to self-serve with sensitive data recorded on unstructured documents.  Delivery accurate and rapid results. Every department and business function will have this type of data. It can reduce exposure to compliance risk, e.g. the GDPR. If the data is stored only in one place it can be found.”

Angelika Klidas: “Uhm, this is more from an HR perspective, what is handy due to the fact that from the systems I know certificates are just copied, or scanned and added in the personals file. I love it that you can add it to a list and that the PDF is saved as well. I like what I see, but I have to think a bit further… it could also work for adding budget information, or expected deals to close, etc…”

Radovan Oresky: “Review, search and semantic analysis in Construction (engineering documentation), Legal (contracts, laws), Manufacturing / High-tech (product documentation, supplier contracts), Consulting (deliverables, knowledge base).”

Me: “I personally used it a year ago for managing all those presentations I downloaded from Qonnections 😁. You can start with something straightforward like CVs and certificates, legal documents, or technical documentation. Once you become familiar with unstructured data, I think many more ideas will come.”

Download Your Files Analyzer

    WRITTEN BY

    • About
    • Latest Posts
    Maria Oreska
    Maria Oreska
    CTO at Inphinity ∞
    🤩 "You do not need to torture the data to tell you the truth - you just need to understand it." We generate a lot of data every day and it will not change. I am a mathematician and data analyst who see its potential not only in robotics or research but in understanding the world around us, our businesses, and clients' behavior, as well. I am doing my best to help people use their data wisely.
    Maria Oreska
    Latest posts by Maria Oreska (see all)
    • Inphinity Suite November 2022 - 29. November 2022
    • Inphinity Suite August 2022 - 15. September 2022
    • Inphinity Suite May 2022 - 31. May 2022

    WRITTEN BY

    Maria Oreska

    🤩 “You do not need to torture the data to tell you the truth – you just need to understand it.” We generate a lot of data every day and it will not change. I am a mathematician and data analyst who see its potential not only in robotics or research but in understanding the world around us, our businesses, and clients’ behavior, as well. I am doing my best to help people use their data wisely.

    See author's posts

    Latest news

    Inphinity Suite Release May 2023

    News & Updates | Imogen Pickett

    Experience the thrill of certainty at QlikWorld 2023

    News & Updates | Imogen Pickett

    Inphinity Suite November 2022

    News & Updates | Maria Oreska

    Most Popular

    How process intelligence holds the key to excellence

    Demos and Use Cases | Sean Price

    How Analytics Holds a Vital Key to Health Services

    News & Updates | Imogen Pickett

    Inphinity Healthcare: Mission Critical Tools to Improve Patient Outcomes, Reduce Risk and Minimise Cost

    Demos and Use Cases | Sean Price

    Latest tweets

    Could not authenticate you.

    Subscribe and get fresh inphinity news, invitations and access to webinars
     

      Address

      Inphinity Limited
      Soho Square Centre
      18 Soho Square
      London W1D 3QL
      United Kingdom
      _

      Inphinity CEE
      Westend Gate,
      Dubravska cesta 14,
      84104 Bratislava,
      Slovakia

      +44 7887 691 077 

      inphinity@myinphinity.com

      Company

      • Contact us
      • News
      • Events
      • Partners
      • CSR
      • Careers

      Products

      • Inphinity Suite
      • Inphinity Forms
      • Inphinity Flow
      • Inphinity Mole
      • Inphinity.App
      • Other products

      Terms & Conditions | Privacy Policy | User License Agreement

      © 2019 All rights reserved by Inphinity - Enfold Theme by Kriesi
      • Twitter
      • LinkedIn
      Scroll to top

      We use cookies to give you the best possible experience on our website. By continuing to browse this site, you give consent for cookies to be used. See how.

      Got it!×

      Cookie and Privacy Settings



      How we use cookies

      We may request cookies to be set on your device. We use cookies to let us know when you visit our websites, how you interact with us, to enrich your user experience, and to customize your relationship with our website.

      Click on the different category headings to find out more. You can also change some of your preferences. Note that blocking some types of cookies may impact your experience on our websites and the services we are able to offer.

      Essential Website Cookies

      These cookies are strictly necessary to provide you with services available through our website and to use some of its features.

      Because these cookies are strictly necessary to deliver the website, refusing them will have impact how our site functions. You always can block or delete cookies by changing your browser settings and force blocking all cookies on this website. But this will always prompt you to accept/refuse cookies when revisiting our site.

      We fully respect if you want to refuse cookies but to avoid asking you again and again kindly allow us to store a cookie for that. You are free to opt out any time or opt in for other cookies to get a better experience. If you refuse cookies we will remove all set cookies in our domain.

      We provide you with a list of stored cookies on your computer in our domain so you can check what we stored. Due to security reasons we are not able to show or modify cookies from other domains. You can check these in your browser security settings.

      Other external services

      We also use different external services like Google Webfonts, Google Maps, and external Video providers. Since these providers may collect personal data like your IP address we allow you to block them here. Please be aware that this might heavily reduce the functionality and appearance of our site. Changes will take effect once you reload the page.

      Google Webfont Settings:

      Google Map Settings:

      Google reCaptcha Settings:

      Vimeo and Youtube video embeds:

      Privacy Policy

      You can read about our cookies and privacy settings in detail on our Privacy Policy Page.

      Accept settingsHide notification only