Bangkok--17 Oct--IDC
The "Big Data" phenomenon seems to have appeared from almost nowhere, but in reality, some aspects of this emerging trend are not new. We have known about the exponential growth of data volumes for some time and according to a recent IDC Digital Universe study published in June 2011, the amount of information created and replicated will surpass 1.9 zettabytes (1.8 trillion gigabytes) in 2011, growing by almost nine times in just five years.
Other aspects of "Big Data" are indeed new. The variety of the data sources is growing at a rapid rate, particularly as we move into the semi-structured and unstructured realm (e.g. social media interactions, rich media files and geospatial information). The other emerging factor that organizations need to contend with is the increased velocity at which data is being generated (e.g. real-time sensor data feeds from smart meters).
"These new aspects of 'Big Data' are creating unprecedented levels of complexity for IT executives, particularly as they realize that these massive data sets cannot be processed, managed and analyzed using traditional databases and architectures," says Philip Carter, Associate Vice President at IDC Asia/Pacific. "What is becoming clearer is that the real value from 'Big Data' will be derived from the high-end analytics, predominantly using data mining, statistics, optimization and forecasting type of capabilities to proactively turn this data into intelligence to drive business benefits and better decision making capabilities."
In line with this trend, as businesses in Asia invest to drive growth in emerging markets, they are harnessing analytics-led solutions to gain better customer insights, and manage risk and financial metrics more effectively while striving for unique market differentiation. In a February 2011 C-suite barometer survey drawing over 1000 responses from CIOs and LoBs across Asia/Pacific, IDC found that business analytics ranked as the top rated technology that would allow organizations to gain significant competitive advantage in the year ahead. In addition, in an IDC June 2011 survey of over 1300 CIOs and IT decision makers across Asia/Pacific (excluding Japan) or APEJ, data management and analytics ranked as the top business priority for organizations in the region.
However, the approach to business analytics in the era of "Big Data" will be significantly different to the traditional approach. “For example, one of the key differences between traditional analytics and what we are dealing with in terms of the 'Big Data' era is that we are gathering data that we may or may not need. From an analysis perspective, this means ‘we don’t know what we don’t know’. To run an analysis on 'Big Data', the variables and models are likely to be entirely new. Therefore, a different infrastructure strategy and perhaps most importantly, new skill sets, are required,” adds Philip.
To cope with the challenges "Big Data" poses, organizations must begin looking at deploying not only the applications traditionally used for Business Analytics (BA), but also the supporting architecture in order to scale efficiently. IDC recommends looking at cloud bursting, the deployment of analytical appliances, and creating truly scalable enterprise architectures that leverage the attributes of high performance computing. This approach should also allow for the deployment of new technologies and frameworks such as Hadoop to assist with the analysis of large pools of disparate, unstructured data.This will require new technical skill sets --particularly around emerging technologies like Hadoop, Map Reduce and Key Value Stores -- as well as a revised approach to the role of the business analyst. The next generation business analyst will be more akin to "data scientists". These individuals will have strong statistical skills and will be able to extract information from large datasets and present value to non-analytical experts. They will also have the unique skill of understanding the new algorithms and analytical models that will have the most significant business impact in the short term.
In conjunction with the skills dimension, IDC believes that organizations need to be looking at their "Big Data" analytics strategy across the following dimensions:
- Technology identification/deployment
- Business case creation and ROI justification
- Data governance frameworks with clear policies and guidelines around master data management, data quality and data models
- Ensure IT/Business alignment by involving the critical stakeholders at the right time
- Involve the CIO as the supporter of the necessary transformation from an IT perspective that will in turn create the necessary business impact
As part this strategy, some organizations are putting in place a Business Analytics Competency Center (BACC). "This structure should include stakeholders from management, IT and the business to ensure that the projects undertaken get the right level of business alignment without impacting the data governance that IT needs to put in place. This is necessary because despite all the hype around 'Big Data', CIOs will need to be realistic about their approach to 'Big Data' analytics and focus on specific use cases where it will have the biggest business impact," recommends Philip.
To set up an interview with Philip Carter, please contact Lay Fang Tan at
[email protected].
About IDC
International Data Corporation (IDC) is the premier global provider of market intelligence, advisory services, and events for the information technology, telecommunications, and consumer technology markets. IDC helps IT professionals, business executives, and the investment community make fact-based decisions on technology purchases and business strategy. More than 1,000 IDC analysts provide global, regional, and local expertise on technology and industry opportunities and trends in over 110 countries. For more than 46 years, IDC has provided strategic insights to help our clients achieve their key business objectives. IDC is a subsidiary of IDG, the world's leading technology media, research, and events company. You can learn more about IDC by visiting www.idc.com.
For press enquiries, please contact:
Philip Carter
Associate Vice President, Services, Application Software, Channels, Green IT & Sustainability
IDC Asia/Pacific
+65-6829-7741
[email protected]
Lay Fang Tan
Senior Manager, Marketing Communications & Media Relations
IDC Asia/Pacific
+65-6829-7731
[email protected]