Thinking about unstructured data
My employer BearingPoint is a leader in information management (IM) and Mike 2.0 is a great example of our capabilities. We have completed a great projects around the world and has been viewed by many as leaders in this space. Being an enterprise 2.0 evangelist, I will ask myself, IM is great! Its addresses many different aspects of information within the organisation from strategy down to data migration. But that’s targeting your structured data through SQL, ETL and the 101 acronyms out there. What about unstructured data?
Enterprise 2.0 is about collaboration, social networking, innovation and so on. The end product of the whole company using a common platform to interact is a huge database of unstructured data. At the moment, there are some ways to mine this data and try to make sense of it. However, I wouldn’t call these methods productive nor efficient. This huge database of information which is currently untapped and understood at a higher level. There has been new technologies like natural language search and ideas like the semantic web which I hope would lay the foundation for the mining and understanding of large scale unstructured data better.
I do believe that this is the future of where the world is heading. We have now become extremely competent in managing large amounts of structured data, making it readily available and usable. The next area is to make unstructured data understandable and usable.


Art Conroy said,
Sean, great topic. I just left BE after a number of years doing work on the black side and guess what, there is no such thing as UNSTRUCTURED DATA. If it is digital, it has structure. Yes, in some cases to the casual observer, they can’t see the patterns. So what do we need to discover the hidden patterns in digital assets?
1) a term rank algorithm
2) a middle level ontology
3) and a domain specific model
With these three technical components running you can do amazing things.
There is a small core of us that have mapped the web evolution through WEB 5.0 and the opportunities are incredible.
To get started immerse yourself in the recent developments in cognitive science, computational thinking, and bio-informatics. Good luck and I look forward to more new thinking from down under.
Add A Comment