This blog assumes fundamental understanding of generative AI concepts, terms, and technology.

Over the past few months, generative AI has taken the technology world by storm. As per CB Insights, 2022 was a record year for investment in generative AI start-ups, with equity funding topping $2.6 billion across 110 deals. Whether it is content creation with Jasper.ai, image creation with Midjourney, or text processing with Azure OpenAI services, there is a generative AI foundation model to boost various aspects of your business.

How Data is Processed

Whether you decide to train your proprietary foundation model or fine tune and prompt tune an open source/commercial foundation model, or a domain specific foundation model as an ISV solution, it is critical that you take the necessary steps to mitigate potential data security and privacy risks.

Some of the commonly asked questions are:

  • Can we provide sensitive information to Large Language Models (LLM) either through fine-tuning or prompt augmentation?
  • Will LLMs reveal my information?

A common concern is that an LLM might ‘learn’ from your prompts and offer that information to others who query for related things or be used to further train the LLM. Or the data that you share via queries is stored online and may be hacked, leaked, or more likely, accidentally made publicly accessible.

It is critical that you take the necessary steps to mitigate potential data security and privacy risks.

Types of Data

Let us first delve into the types of data a generative AI service or application provider may process if you decide to fine tune and prompt tune an existing foundation model, using the example reference diagram below:

Foundation model for using generative AI on an enterprise solution. You can take two paths. One by uploading training files and the second by setting up API calls with prompts.
Foundation Models: Approaches and Impacts on an Enterprise Application/Solution

Checklist for Mitigating Risk with Generative AI

Now that you have a baseline understanding of how your data is processed, you need to review how your data is retained and what custom controls are available to you. Basically, you need to understand how your data sharing as part of fine-tuning or prompt augmentation is managed. To aid with this, here is the checklist of questions you need to ask the provider and ensure adherence to your corporate policies to mitigate your data security and privacy risks:

Does the provider support your ability to opt-in/opt out of including your data for training their model?

  • Subject to your use case and for proprietary data, make sure you opt out or, at a minimum, that the training data provided by you is only used to fine-tune your model and not used by the provider to train or improve any of their models.

Can you delete your training and validation data and your fine-tuned models?

  • Make sure you can.

Does the provider process the data [prompts, completions, and generated result] to train, retain or improve their models?

  • Subject to your use case and for proprietary data, make sure you opt out, or by default the output data is not used by the provider to train or improve any of their models.
  • Do not submit any private and/or proprietary data to any public LLM as prompts.

Are the prompts and completions data stored temporarily? If “yes”, how long is the data stored for?

  • Make sure it is stored securely in the same region you operate from and is logically isolated with your subscription and API credentials.
  • Make sure it is no longer than “N” number of days that is aligned with your corporate policies.
  • Make sure it is encrypted, at best, by providers’ managed keys.

Is the data shared with partners?

  • Many providers anonymize the data while sharing it with partners. Make sure you are fine with this specific to your use case, this may not be enough for your corporation.

Who has access to it from the provider?

  • Make sure only the authorized employees have access to it.

How is the data used by the provider?

  • It may be used for debugging purposes in the event of a failure and/or investigating patterns of abuse or misuse.
  • The content filtering models are run on both the prompt inputs as well as the generated completions.

Can you opt out of content filtering and logging?

  • If your use case involves the processing of sensitive, highly confidential, or legally regulated input data but the likelihood of harmful outputs and/or misuse is low, check with your provider if you can opt out of content filtering and logging.
  • Once the provider approves the opt out, make sure they do not store any prompts and completions associated with the approved subscription for which abuse monitoring is configured off. In this case, because no prompts and completions are stored at rest, no provider employees have access to your data, even for limited time.

Does the provider log model usage and support traceability for your compliance needs?

  • Make sure they do.

    If your use case necessitates the creation of a proprietary model, which means you train your own model, you could either train the model in-house or partner with the model provider that supports training a new proprietary model. If partnering with the model provider, in addition to opting for VPC for training and hosting the model, make sure you follow the above noted checklist where relevant and ensure adherence to your corporate policies to mitigate your data privacy and security risks.

    You can subscribe to IDC’s Artificial Intelligence Software and Strategies Research and hear more on generative AI during our latest webinar.

    The Exciting Year Ahead for IDC Spending Guide

    IDC’s Spending Guides, standard-bearers for extensive and exhaustive technology market intelligence, are undergoing major updates starting in July 2023 and continuing into 2024. The updates will bring deeper analysis capabilities to market through enhanced visibility into sectors, sub-sectors, and industries—increasing the total number of industries covered from 20 to 28. The update also includes a planned size segmentation refresh which will add additional granularity of insight.

    IDC and Spending Guide: Years of Proven Success for Market Intelligence

    For decades, IDC has been the tech industry’s standard for consistent, benchmarkable market intelligence in six continents. Designed around a global overarching technology taxonomy that includes detailed segmentation by geography, industry, size, use case, and other metrics, IDC’s market intelligence is one of four integrated “intelligence” domains IDC maintains for the tech world.

    Since 2016, IDC’s Spending Guides have delivered this market intelligence in a collection of over 25 market forecast products which detail planned technology spending across a variety of different market scenarios. Created leveraging a combination of demand side and supply side data and validated by our in-country industry and technology analysts, IDC provides the most accurate forecasts available. This intelligence enables tech vendors, investors, and partners, as well as others that serve and observe the tech world, to deeply analyze the size, trajectory, and growth opportunities over time in highly specific markets and segments.

    Industry Enhancements Coming July 2023

    Starting in July 2023, IDC Spending Guides will become even more powerful with the restructuring of industry coverage within the IDC taxonomy.

    Starting with the Enterprise and SMB by Industry and Software and Public Cloud Services Spending Guides, IDC will update industry coverage across the entire product line, adding clarity to segmentation-scope and introducing coverage in eight new industries. At the same time, this update maintains the fundamental methodologies of IDC’s existing taxonomy, keeping companies whole, SIC based, and aggregating sub-industries with similar IT needs or along the same value chain. This major undertaking will eventually expand to all Spending Guide products, including our 3rd platform use case-based guides, with the goal end-date of 2025 H2.

    Spending Guide: The Year in Review

    IDC spent a year researching existing industry taxonomies. In this time, we conducted a study of economic standards, client inquiries, tech vendor industry taxonomies, and competitive taxonomies. The conclusion was that a restructuring of the industry segmentation within IDC’s taxonomy was necessary to keep clients informed to the degree expected in the modern world. The resulting update, which is summarized in the figure below, brings more granular industry scope and enhanced industry definition to IDC’s taxonomy.

    Figure 1: IDC’s new industry segmentation

    The new taxonomy refines existing industries while introducing eight new ones.

    While this update impacts all industries to varying degrees, the benefits will be felt most notably in the following industries: Discrete Manufacturing, Process Manufacturing, Professional Services, Wholesale, Personal and Consumer Services, Resource Industries, Retail, Transportation, and Insurance.

    Why Updating Industry Coverage Matters

    With more thoughtful categorization and granular segmentation, Spending Guide users are better equipped to identify, analyze, validate, and action questions and insights specific to the industries they serve.

    From a usability perspective, a more narrowly defined industry scope means less “noise” in the data, increasing the ability to find relevant information while decreasing the time it takes to do so. With less time spent in analysis, there is more time for execution. Analysts and strategists can also track trends across more industries, validating assumptions while understanding nuances of buyer behavior and if / how these change in adjacent segments. Executives and their teams can better inform strategic decisions and justify tactical actions, such as acquisitions, partner selection, resource allocation, territory and campaign planning, and more at granular industry levels.

    For example, a leading technology provider targets small to medium size DX technology vendors with specific industry focuses for acquisition. Once acquisition targets are identified by the team, they need a financial case for the acquisition to present to the executive team and the board, thereafter. Using the Worldwide Digital Transformations Spending Guide, the company aligns the offerings of target vendors to specific DX use cases across industries of note. From this vantage, they can narrow down the high-value targets and make their own internal assessment on technology fit and support. With enhanced industry granularity, the acquiring organization can further streamline their process and reduce the time to prioritize high-value targets against those less aligned.

    Deploy Spending Guide Industry Insights With Other IDC Solutions to Maximize Impact

    When used in combination with other IDC Data & Analytics products, the industry update makes it so Spending Guide can be used to further investigate global assumptions, insights, and trends in granular industry scenarios, including those characterized by different geographic, technological, size, use case, and other segmentations. For instance, total available and serviceable addressable market figures identified IDC Black Book can be refined and clarified at the industry-level in the Spending Guides, helping prioritize product development and acquisition plans. Conversely, Spending Guides can serve as an effective starting point for market sizing that is further validated at global levels in Black Book.

    Looking at it from another perspective, industry-related assumptions, insights, and trends identified in Spending Guides can be further refined and actioned with the data in other IDC data products for different purposes, like:

    • Tracker®, which provides vendor performance metrics in over 150 markets, driving competitive intelligence and helping to position products and align go-to-market plans.
    • Channel Partner Ecosystem, which provides profiles and performance details on technology partners, helping articulate partner go-to-market strategies.
    • Wallet and Services Contracts Database, which provide segmentation of individual company budgets and services contracts (including contract value and renewal dates) for technology buyers and vendors, helping craft strategic marketing initiatives and pinpoint sales activity timing.

    What’s Next on the Spending Guide Product Roadmap?

    IDC’s Spending Guide products and the Data & Analytics team are dedicated to continuous improvement as part of ongoing operations. While the magnitude of the industry expansion for Spending Guides is evident, IDC remains committed to other areas of improvement in the next 12 months, including the granularity of size segmentation in the taxonomy.

    With a target release of January 2024, IDC will introduce new company size details to the Enterprise and SMB ICT Spending Guide taxonomy. The change will result in nine ranges of company size across five size segments which are further categorized and grouped. See the figure below for full details on this size segment update.

    Figure 2: IDC’s upcoming size segment refresh

    More granular size segmentation enables deeper market analysis and understanding.

    There is a lot of reason to be excited about the product enhancements coming out of IDC Spending Guide in the year ahead. To learn more about the solution, market intelligence generally, or to request a demo please visit the Spending Guide section of IDC’s Data & Analytics Solutions page.

     

    A few months ago, as I was walking down the aisles of a professional fair for public sector decision makers, I noticed two main themes on display:

    • Cybersecurity, from secure citizen identity verification to the resilience of systems and data to threats.
    • Efficiency of public services, with an emphasis on the need to better leverage and share data.

    As a public decision maker, I would be lost, if not paralysed by, the contradiction of being asked to modernise my systems and organisation through better use of data and data sharing, while being constantly reminded that cyberthreats (and cyber attacks) are everywhere.

    The first months of 2023 have been characterised by two sub-topics that illustrate this bipolarity: digital sovereignty (a country’s capacity for self-determination and in some cases data protection and isolation) and generative AI (a platform’s capacity to have access to all the data you might collect and extract, and lever this information to turn it into intelligible insights).

    To bring these together, we felt something was needed and that some well-implemented borders and security measures are needed to be reconsidered.

    An Inflection Point in the Importance of Data

    Governments have long classified data primarily on its sensitivity. The UK government’s security classification, for example, defines “the sensitivity of information (in terms of the likely impact resulting from compromise, loss or misuse) and the need to defend against a broad profile of applicable threats.” Based on that definition of sensitivity, UK government policy applies three levels of classification for government data: top secret, secret and official. The majority of EU governments have also classified the data they manage based on sensitivity.

    This classification showed its limits in February 2022 when Ukraine rushed to identify and migrate strategic data assets critical for the government to enable operational continuity and bolster resilience. Previously, Ukrainian law required some government data to be stored in local servers in Ukraine, but this was changed a week before the invasion. Essential data has already been migrated from over 27 Ukrainian ministries.

    IDC analysis shows the public sector is at an inflection point when it comes to the importance of data, and that it’s not only a matter of protecting sensitive data but also of anticipation. This is done by recognising data as a critical and strategic asset for governments to function more efficiently, effectively and resiliently to deliver the outcomes and security solutions that citizens expect, in times of crisis and on a daily basis.

    A Framework to Facilitate Readiness

    This has led us to create a framework that builds a new layer in data classification. In our Learning from Ukraine: Building a Framework to Safeguard Governments’ Critical Data, we recommend that governments not only classify and manage sensitive data but also critical and value-added data.

    Critical data can be defined as data that if not accessible or not reliable can jeopardise a government’s ability to function in its daily activities and in times of crisis. It’s important to highlight this difference between classifying data based on the level of sensitivity and the level of criticality because some data sets have both characteristics.

    For example, a criminal record is both sensitive (because it contains personal information) and critical for the criminal justice system to function. However, land registry data does not contain the most sensitive information but is critically important to determine jurisdictional boundaries, settle property disputes and assess the value of taxable assets.

    Bringing Everyone on Board

    Data sharing and interoperability and the building of European data spaces are vital here; sovereignty (the capacity to self-determine your action) should serve this cause and not get in the way, as it is often confused with security.

    Sovereignty is a current concern as many government entities are seeking to update their cloud policies, such as the “Cloud au Centre” in France and “cloud first” in the UK. Some initiatives also promote interoperability, with Portugal’s eSPap government authority developing a platform for public entities.

    These initiatives aim to bring more coherence to IT systems and enable new services in healthcare and security, for example.

    Local governments are still trailing European or central governments when it comes to transformation, partly due to trust issues. We believe that enabling this new layer of criticality, and adapting our framework for every local public entity CIO, will be key to creating a common secure language.

    To learn more about government’s role in safeguarding critical data, see our new study Learning from Ukraine: Building a Framework to Safeguard Governments’ Critical Data and join us at the IDC Government Xchange.

    Remi Letemple - Senior Research Analyst, IDC Government Insights - IDC

    Remi Letemple leads IDC’s Worldwide Sustainable Transportation and Smart Vehicles Strategies service, where he provides strategic guidance and thought leadership on the future of mobility and transportation. Operating at a global level, he is recognized as a subject matter expert in smart mobility and transportation technologies—including connected, autonomous, shared, and electric mobility—enabled by software-defined vehicle (SDV) architectures, over-the-air (OTA) updates, cloud and edge platforms, and AI, including generative AI.

    IDC conducted a survey of close to 400 CEOs across the world, supplemented by a number of one-on-one interviews, and identified five mandates to help business leaders scale their digital businesses in a rapidly changing digital world. Our survey data revealed that the number one concern is the economy – economic pressures, such as inflation, rising interest rates, and slowing demand.

    Mandate #1: Redefine VUCA

    To forge a path forward for their organizations, many CEOs are redefining VUCA.

    What is VUCA?

    A concept that has gained wider awareness over the past several years, VUCA is an acronym for:

    • Volatility
    • Uncertainty
    • Complexity
    • Ambiguity

    So… how are CEOs redefining VUCA for their businesses and their leadership teams?

    In a recorded interview played during my IDC Directions 2023 presentation, Simon Paris, CEO of Finastra, talked about how his leadership team has addressed and adapted to the business and economic uncertainty of the last twelve months by redefining VUCA with… well, VUCA. Where his leadership team encountered volatility, they remained true to their vision. When faced with uncertainty, they focused more time on understanding. When complexity surfaced, they looked for clarity. And, when dealing with ambiguity, they employed agility to move forward.

    Many CEOs have told us how adaptation is the key to survival as they deal with risks across the world.

    • The CEO of a global telecoms organization discussed how his leadership team is trying to deal with the high interest rates and the higher cost of capital for customers and his own organization.
    • A CEO of a Swiss-based train operator told us about the challenges posed by rising electricity costs that have added 15-20% to his cost base in 12 months.
    • The CEO of Turkey-based multibillion dollar manufacturer is trying to navigate a difficult geopolitical environment and determine which markets to pursue.
    • The CEO of a large Australian health insurance organization, talked about his company’s major investments in digital and how he and his leadership team are now focusing on closing digital business execution gaps.
    • A CEO of a financial services software organization highlighted how is very focused on the imperative of closing the digital skills gap.

    As IDC analyst Dan Vesset discussed in his Directions 2023 presentation, organizations must accelerate decision velocity to address many of these challenges. By leveraging new data value chains to accelerate decision velocity, organizations can conduct better multi-scenario planning, more accurately assess retention rates by geography, and determine when to onboard and offboard suppliers to drive profitability.

    Mandate #2: Invest to Win

    The next mandate is determining the right investment strategy. According to Michael Porter, the well-known business academic, the worst mistake organizations can make in a downturn is to make cuts across the board. With that in mind, CEOs are taking a more strategic view of investment opportunities.

    In a clip played at IDC Directions 2023, Bas Burger, CEO of BT global, shared his thoughts with us. He discussed how companies that make investments during recessions – when times are tough – actually end up winning in the end and growing their market share. This is the philosophy he and his organization have adopted. So, growth, perhaps surprisingly, is the word of the year for CEOs in 2023, as they look for areas to invest in to keep teams motivated and investors happy.

    The second most popular word is technology. Close to 90% of CEOs plan to maintain or increase technology investments in 2023 – focusing those technology investments on revenue-generating activities. IDC’s research shows that organizations that provide more advanced customer experiences are delivering close to double the business growth compared to their peers in the industry. IDC analyst Marci Maddox discussed the critical role of the customer data engine in her IDC Directions presentation.

    IDC has forecasted that 40% of the revenue from the G2000 companies will come from digital products, services, and experiences by 2026. Already we are seeing some notable examples:

    • Bank of America’s realized a 22% increase in mobile sales linked to a mobile usage surge
    • Nike digital saw 34% growth in the last quarter
    • Kroger is aiming to double its digital business by 2023

    Mandate #3: Build Trust

    As organizations start to build and operate their digital businesses, they will also need to build trust. It’s no surprise that security risk and compliance, which are at the heart of the Future of Trust framework, are a technology priority for CEOs in 2023. IDC analyst Grace Trinidad discussed the Future of Trust framework during her Directions 2023 presentation.

    Some of the more progressive and strategic organizations are moving into ESG and privacy as they look to deliver outcomes – trusted governance, trusted ecosystems, and trusted enabled commerce – not only internally but increasingly externally into the ecosystem. But, they face some challenges and complexity as they look to build out trust for the digital business in a geopolitical context and operate in a global economy that is increasingly digital in nature.

    As every organization grows its digital business and moves data and intellectual property (IP) across suppliers, customers, and partners in a digital ecosystem, various questions are being raised. What if a court in Europe demands data customer data for national security reasons? What if an organization has to ensure that customer data for customers in Saudi Arabia is processed and stored locally? What if it is the target of a state-sponsored cybersecurity attack going after patent information and IP. These digital sovereignty concerns and scenarios must be addressed as the next element of the future of trust framework that CEOs need to focus on to straddle the business and geo-political worlds.

    Mandate #4: Reskill and Augment

    We are all witnessing a major talent overhaul, as companies across the world come to terms with hybrid working models. Companies are shifting from external approaches to hiring skills and using external service providers to strategies focused on reskilling and automation. As they reskill their organizations to deliver on the next phase of the digital business, organizations will need to connect reskilling to automation initiatives – the enterprise automation 2.0 strategy. IDC analysts Amy Loomis and Gina Smith discussed the IDC Skills Framework in their IDC Directions 2023 presentation.

    Automation must be infused throughout the enterprise – across IT, business, and the software value chains. To accomplish this, IT and business leaders will need technology architectures that help them scale the approach across the organization. And, for these efforts to succeed, CIOs must raise their visibility and become key players – orchestrators of technology architectures, budgets, and stakeholders.

    Mandate #5: Tech to Scale

    As CIOs take on these responsibilities, they must contend with spiraling cloud costs – 64% of CIO’s are spending more on cloud than originally budgeted. They need to optimize cloud investments, but must look beyond efficiency, which is really just an intermediate goal, and focus on creating sustainable value. Our survey data shows that in the next two years CIOs will move away from treating efficiency as an end-goal and look toward business outcomes, agility, and new revenue streams.

    The more prominent role of the CIO is already reflected in changing organizational reporting structures. According to IDC survey results, 60% of CIO’s are now reporting directly to the CEO as they become more involved in business strategy and work with the entire C-Suite to redefine VUCA, accelerate decision velocity, make strategic investments, build trust, and reskill and augment their workforces.

    Technology suppliers can play a key supporting role. With a focus on helping their customers achieve quantifiable business outcomes they can help organizations execute on these five mandates.

    Interested in learning more? Download our eBook, Beyond Digital Transformation: What Comes Next?

    Philip Carter - Group Vice President, General Manager, Research AI - IDC

    Philip Carter is General Manager and Group Vice President for AI, Data, and Automation research at IDC. In this role, he leads a global team of analysts focused on delivering IDC's research and insights at the intersection of AI, data platforms, and intelligent automation - three foundational areas shaping the future of technology and business. His work is centered on helping C-Suite executives make sense of the rapid innovation in the AI space, and drive meaningful transformation through data- and intelligence-led strategies. BACKGROUND Carter has held multiple senior roles at IDC across regions. Prior to his current position, he served as GVP and GM of IDC TechMatch, where he led a global team tasked to build and commercialize IDC's first AI-powered digital platform - focused on helping CIOs and procurement executives evaluate and source technology vendors leveraging IDC trusted intelligence. Earlier in his IDC career, Carter was the lead for IDC's Global Thought Leadership research function and was also Chief Analyst for IDC Europe, where he drove innovation in research related to digital transformation, emerging business models, and technology strategy at the C-suite level. Before that, he worked in IDC's Asia/Pacific region, covering software, services, and sustainability. Prior to joining IDC, he held various leadership roles at SAS Institute across EMEA and APAC in marketing strategy, product management, and business development. He is a recognized industry voice, regularly featured on platforms such as CNBC and Bloomberg, and quoted in leading publications including the New York Times. EDUCATION/INDUSTRY ACCOMPLISHMENTS: - Honors degree in Business Science, majoring in Economics and Law, University of Cape Town, South Africa.

    Companies are increasingly recognizing cloud computing’s ability to help businesses overcome macroeconomic pressures. As pressures rise, however, it is those with existing, broad cloud deployments that are benefiting the most. Companies only just now moving to cloud will still realize benefits from cloud but will face funding hurdles as business finance teams become increasingly involved in purchasing decisions, according to results from IDC’s Q4 2022 Cloud Pulse Survey.

    The Q4 study, which surveyed 1,350 cloud users from North America, Western Europe and Asia Pacific, found a significant number – 40% – of organizations relate their adoption of, or increased take-up, of cloud to the COVID-19 pandemic. Inflationary pressures have further led to increased adoption of cloud services, with cloud now making up on average 32% of IT budgets.

    Inflationary pressures currently impact 45% of organizations directly. These organizations say they have seen increased pricing for cloud services (for public cloud and internal operations for private cloud such as skills and increased data center costs). Despite cost pressures, 57% of companies say they require a ‘very high’ to ‘extremely high’ level of IT transformation to support their current business strategies – this is compared to just 48% in Q4 2021.

    Increasing costs are having an impact, however, on the value businesses believe they receive from their cloud services, with 55% of cloud buyers surveyed saying inflationary pressures had negatively impacted return on investment (ROI). Around a quarter of companies currently measure their cloud ROI on overall IT performance, and almost the same number again – 21% – integrate cloud ROI with wider company performance.

    Cloud is seen to deliver better ROI where it can help improve business processes, increase company revenue and reduce IT administrative costs.  The challenge is that many of the wraparound services required to deliver cloud are leading to increased costs. These include the cost of professional service, network costs, managed services, applications and software and, of course, the cost of the internal skills required to deliver cloud. This means that any increases seen in cloud budgets can easily be absorbed by increases in cost.

    This means cloud vendors are coming under much more scrutiny as cloud contracts reach end of life or as buyers seek new cloud options. Of those companies that changed cloud provider in the last year, 53% did so because of cost.

    Many vendors are providing solutions to inflationary pressures. Around a third of organizations say they have seen their cloud provider react to market requirements for more flexible contracts and pricing and billing options.

    Almost a quarter of companies are also looking internally at where they can make cloud cost reductions. Increasing cost of, and complexity of, cloud has led many companies to overspend on cloud services in the last year. Downtime from hardware, security and software failures also accounts for around 5-9% of overall cloud spend.

    And while the IT department is still accountable for cloud budget, late adopters of cloud – those just starting out – are seeing an increasing role is being played by the company’s finance department which is now the second most involved company department in signing off on early cloud deployments.

    The contrast is that those with broader cloud environments, from earlier deployments, are placing more emphasis on R&D and marketing involvement in cloud. These companies can commit more time to innovating and driving services that can make the company more agile and provide innovative services that can deliver cost savings across the business or innovative go-to-market solutions that can make the difference during tough economic times.

    These findings all come from IDC’s Cloud Pulse Q4 results. The survey focuses on cloud pricing and spend, cloud ROI, cloud strategies and macroeconomic trends.

    Across the board, the focus for cloud spend still rested heavily upon the need for organizations to digitally transform their business, however, cost and savings are now the second-highest area of concern for organizations dealing with increasing macroeconomic pressures.

    The magic moments in a customer’s experience that create a loyal and trusting customer are getting smarter, faster, and more dynamic. Think about how you feel about a company when the perfect product recommendation is brought to your attention, or when you get in your car, and it has automatically planned the route to your next appointment in your calendar.

    How does this happen? We’re in an exciting time of digital innovation! We are all producers and consumers of customer data across more digital and physical channels than ever before and the activation of customer data fuels these magic moments that deliver greater business success.

    Not only does customer data identify customer preferences that allows brands to match the expectations of the experience with its reality, but it can also be used to informed decisions about current and future product offerings or how to structure sales and support teams to better empathize with the customer’s situation.

    IDC has found over the last two years that the customer experience is the first or second top investment area for digital leaders with 78% stating customer data plays an extremely significant role in the customer experience.

    Every department wants to gain insight into their customer preferences and their use of specific products or services through customer data.

    Let’s define what we mean by customer data.

    • Zero-party data is information a customer intentionally shares unsolicited with a brand such as their interest in a product based on a friend’s referral.
    • First-party data is what a brand collects directly from online forms or transactions. 
    • Second-party data is data collected and shared through a brand partnership.
    • Third-party data is collected by an external organization that does not have a direct connection with the customer.

    Brands have been collecting these data types for years with the majority being 3rd-party data. But 3rd-party data is becoming unreliable and more expensive with companies like Apple rolling out consent-based tracking and Google sunsetting 3rd party web browser cookies. As global privacy restrictions increase, and consumers become more conscious of how their data is used, third-party data sharing is declining in popularity. 

    Now, with business buyers and consumers taking more control over what information they provide, the collection of more zero- and first-party data will replace 3rd party data because it is the more valuable resource to have. This “data flip” will dramatically impact the technologies that facilitate the collection, use and sharing of customer data. 

    52% of organizations are not prepared for a cookie-less future

    Not only do organizations need the right tools to collect valuable zero- and first-party data, but they also need to evolve their data practices to establish a social contract with consumers in how their information will be gathered and used developing a chain of custody of their personal profile data as it is connected from one entity to another.

    Managing the customer data relationship is about providing a secure experience with a brand users trust, and establishing an exchange for the privilege of using their digital identity to create that positive experience.

    When customers provide information to a company voluntarily, it allows for deeper personalization and a better understanding of relevant content, products, or services.

    IDC found that 59% of B2B buyers noted that the more it seemed like a vendor knew about them, the more concerned they were about privacy.

    Managing this first party data effectively in a scalable way requires the right tools, and it becomes more than just managing the customer relationship – it becomes a way of managing the customer data relationship at scale.

    What we are defining here is the Customer Data Supply Chain, such that digital applications will need to handle 3 things:

    • 1. Regulations of data privacy that influence levels of personalization
    • 2. Communication of what data is collected and used to further loyalty and engagement
    • 3. Investments in technology to handle the fast pace that data comes into the organization

    When customers provide their favorite brands with helpful personal data, the organization needs to be prepared to care for in a trust-worthy manner and used quickly to extend the value of the relationship. A December 2022 IDC survey asked about the ‘shelf life’ or period within which data loses its value – 75% of respondents say that most data will lose its value within days, if not hours of its collection.

    IDC defines the customer data value exchange with three foundations that matter: moving from data collection to establishing a trusted relationship; moving from only using the data once to orchestrating it across teams; and finally using technology to share and scale in real-time. 

    Customers want to see brands personalize their offering and are OK with the use of their personal information to deliver relevant content and offers. But they’re unwilling to compromise on their data privacy and are more cautious about who they share their data with. Enterprise applications have a responsibility to actively help the data managers improve transparency and governance in how personal data is being retained, where it is being stored and who has access to it, at any point in time.

    Once you have the basic tools in place to manage the customer data value exchange, it is time to increase the fly wheel of value by looking at activating the data automatically using AI/ML more effectively, connecting privileged first-party data securely through the use of customer data clean rooms and redefining new measures of customer experience.

    As the customer data value exchange takes hold in the organization, it is important to introduce new KPIs that look at the customer data relationship with the organization. Very few metrics used today describe the data from the viewpoint of the customer.  Most measures are internally focused – they look at the volume or age of the data- or the well-known Customer Satisfaction (CSAT) score is a lagging indicator of customer data usage.

    CSAT does not represent the customers’ point of view or feelings about how much data is known about them, and whether the information was used to proactively reduce the level of effort expended to complete a task.

    By 2027, 25% of global brands will abandon CSAT as a measure of customer experience and adopt a Customer Effort Score correlated to outcomes as a key indicator of journey satisfaction and success.

    Getting direct feedback from the customer about the experience and the expected vs expended level of effort is a radical change for some organizations.  However, businesses that look beyond customer data as only a marketing tool and use it across the whole connected customer journey will find benefits to both the customer and the business.   For example, customers will find more seamless journeys and use brand familiarity to purchase more products.   Businesses will see better forecast accuracy, higher order values and lower churn rates. 

    It is both the technology and processes that are needed to manage the customer data relationship and in turn, grow revenue at scale.

    To learn more about customer data and data value exchange, view Marci Maddox’s IDC Directions presentation.

    Marci Maddox - VP, Product, Research & Data Planning and Operations - IDC

    Marci Maddox leads IDC's research and content team for IDC's IT Tech Buyer Digital Platform. She collaborates with IDC analysts, IT development teams and the IT buyers to drive innovation and adoption of IDC's digital platform. Leveraging over two decades of experience in building and marketing digital experience applications, Ms. Maddox's work helps IDC's clients streamline their software purchasing process through market analysis, survey development, customer interactions, data management and product evaluations. She also works with IDC's industry analysts and technology suppliers to understand their market and how best to present their technology to buyers. She also works with buying organizations in an advisory role to gather enhancements for the platform and encourage networking across the organizations. Background Marci held an industry analyst role of Research Vice President of Digital Experience Strategies at IDC before joining the Tech Buyer Digital Platform team. Prior to joining IDC, Marci held a position within IBM's Watson and Cloud Platform where she helped clients to realize the future of AI, IoT and Cloud benefits for industry solutions in financial services, retail, telecom and healthcare. She also spent time at OpenText as a Senior Director Product Marketing leading a team of evangelists and industry solution marketers for Customer Experience Management solutions. Marci's education and activities: - B.S. in Computer Science from the University of Texas - M.B.A. in e-Business from St. Edwards University - Frequent speaker, presenter and moderator at industry conferences and publishing to a variety of media outlets

    Where once IT cost management was a competitive advantage, it is now table-stakes. If IT leaders are not operationally effective at managing costs, they risk falling behind in their ability to support business strategy and drive digital transformation.

    As an IT leader, one of the most important responsibilities is to manage costs and maximize the efficiency of your organization’s IT operations. Cost-saving measures not only benefit your organization’s bottom line but also pave the way for investment in innovative technology solutions that drive growth. This blog discusses five cost-saving measures that IT leaders should prioritize.

    Focus on Cloud Center of Excellence

    In a recent IDC poll[1] of CIOs, 64% of respondents said they were spending more on the Cloud than they budgeted. Over 50% of CEOs are concerned about Cloud Spend[2].

    A Cloud Center of Excellence (CCoE) are IT professionals assigned to develop and implement cloud computing strategies, policies and best practices. A CCoE centralizes cloud-related practices and standards as well as promotes consistency in cloud technology adoption.

    Six elements are key to a successful CCoE:

    • Leadership: Empowered leadership with the ability to work across traditional organizational boundaries or divisions. A CCoE is the opposite of siloed.
    • Talent: Technical expertise to understand and support cloud initiatives across the organization, including cloud architecture, enterprise architecture, security, compliance, DevOps, and infrastructure. In most organizations, this requires a combination of hiring or reskilling of existing staff.
    • Governance and Communication: Policies, practices, operating models, defined technologies, shared best practices (across divisions and business units,) and standards with an overarching architectural standard.
    • Continuous Improvement: Continuously monitor and assess cloud adoption and usage, identify areas for improvement and implement changes to optimize the benefits of cloud computing.
    • Reporting and Metrics: Establish and track key performance metrics for Cloud usage based on the business drivers underpinning the Cloud strategy.
    • Collaboration: Work closely with business units and IT teams to ensure cloud initiatives align with organizational goals and are integrated with existing systems and processes.

    Implement FinOps

    FinOps, or Financial Operations, is a practice that aligns IT spending with business objectives. By implementing FinOps, IT leaders and the business can gain greater visibility into Cloud value. FinOps teams address how the agility of Cloud can complicate budgets and forecasting. They also link spend to business value so business leaders can make considered decisions on their Cloud usage.

    [3] IDC CIO Quick Poll, n=69 (December 2022)

    The three phases of the FinOps life cycle provide a structure for effective implementation:

    Inform

    • Tagging (descriptive metadata)
    • Visibility into spending
    • Budgeting and forecasting
    • Cost allocation
    • Assembling a cross-disciplinary team

    Optimize

    • ROI
    • Rightsizing
    • Workload placement
    • Rate and discount optimization
    • Culture and ownership
    • Minimizing waste and unused resources
    • Identifying tools and software

    Operate

    • Automation
    • Centralized billing or showbacks
    • Defined control and governance
    • Communicating optimizations and spend-patterns to “Inform” phase and stakeholders

    IT leaders can start a FinOps team of one, but complexity typically expands it to additional roles:

    • FinOps Practitioner Lead
    • Cloud Engineering and Operations
    • DevOps Manager
    • Procurement
    • Finance
    • LOB Product Managers
    • Executive Sponsor

    CCoE and FinOps overlap in some duties but, simplistically, the former is focused on setting standards while the latter is responsible for ensuring value (cost versus business benefit). 

    Based on our consulting engagements with clients, when tech leaders build a robust CCoE and FinOps organization, they typically see 10-30% reductions in cost and slower cost growth than more ad hoc Cloud management practices.

    Benchmarking IT Costs

    IT cost benchmarking involves comparing your organization’s IT spending to relevant peers both inside and outside your industry. This approach ensures that you are not only comparing yourself to your industry peers but also to relevant performers in other industries. Benchmarking allows IT leaders to identify outliers in IT spending and optimize budgets accordingly. IT cost benchmarking also helps to ensure that your organization is receiving value for money from vendors and service providers. Finally, it can support budgetary requests or validate investments to the business.

    Cost benchmarking is a valuable tool for technology leaders to identify cost efficiency opportunities in their organization. In our experience, companies that regularly employ cost benchmarking typically find 5-10% efficiency opportunities. However, companies that have never performed cost benchmarking can see up to 30% opportunities for cost efficiency.

    It’s important to note that cost benchmarking goes beyond just KPIs. While KPIs provide metrics for the average organization, they don’t account for the different goals, strategies and technologies in each organization. Benchmarking allows technology leaders to gain insights into their organization versus similar technology, workload, volume, complexity, and service peers.

    Most organizations do not have the data to perform cost benchmarking themselves but use third-party advisory firms with a broad database of comparable peer data. As part of this, technology leaders need to inquire whether the data is regionally specific to their environment. Also, look for impartial assessors who don’t have down-stream interests in the results.

    With cost benchmarking, technology leaders can identify areas where their organization is overspending and implement cost-saving measures. This can lead to significant savings that can be reinvested in other areas of the organization.

    Conduct an IT Workforce Assessment

    In a global Future of Work survey[4] conducted last year, a large majority of the respondents stated that enabling employees to focus on higher value tasks, moving employees among roles and functions, and reskilling and retraining were critical. Further, companies are having challenges hiring staff, with an average of 3.2 additional months[5] in recruiting, which impacts project delivery.

    IT staffing assessments help IT leaders identify opportunities to optimize and improve the use of resources and optimize staffing costs and align IT to business needs. By assessing the duties within IT roles (and not the person in role), and appropriateness of IT roles and structures, IT leaders can identify gaps and opportunities for training and upskilling, and organizational evolution. Workforce assessments help better align the IT organization to evolving technology and business strategy. IT workforce assessments can also identify opportunities to outsource or automate certain tasks, drive better service for the business and reduce inefficiency.

    Typical benefits in performing an IT workforce assessment are:

    • Identifies roles and structure for the present and the future needs
    • Cost management and cost efficiency
    • Forecasting and transparency
    • Competitive resourcing
    • Investing to innovate
    • Determining whether IT is properly resourced, roles are consistent and are aligned with industry standard IT role structures

    Address Technical Debt

    Technical debt refers to the painful side effects of prioritizing time, money and workarounds over quality in the delivery of enterprise information technology[6].  As technology advances, legacy systems can become increasingly expensive to maintain and limit the ability of organizations to innovate. By addressing technical debt, IT leaders can reduce ongoing maintenance costs and free up resources for investment in innovative technology solutions.

    Key impacts of technical debt include:

    • Security vulnerabilities
    • Manual execution of business processes
    • Errors
    • Inefficiency
    • Reliance on institutional knowledge
    • Drag on business profitability and growth, customer and employee engagement and retention

    Technology leaders must first inventory their technology environment to identify technology debt and legacy technologies. This may be done using typical in-house technology tools present in most organizations: asset management, assets inventory, and asset discovery, source code analysis, or even speaking with your staff. There are also third-party tools and advisory groups that can assist in this process. 

    After inventorying your technical debt, triage the applications into key buckets for redress: retire, refactor, duplicate functionality, replace, rebuild, retain. Then determine the priority. Typical priority factors are cost, criticality, business risk, security risk, business benefit, supportability, and technology fit/strategic fit. Combining the buckets with the priority factors provides you a ranking system for targeting technology debt.

    In conclusion, IT leaders should prioritize cost-saving measures to maximize the efficiency of their organizations’ IT operations so they can focus on being a business enabler and innovation-driver, rather than a cost center. By focusing on a Cloud Center of Excellence, implementing FinOps, benchmarking IT costs, conducting a staffing assessment, and addressing technical debt, IT leaders can identify and implement cost-saving opportunities that enable investment in innovative technology solutions.

    Many IT leaders are challenged in demonstrating value to the business and validating their budgets. Learn how IDC Metri improves technology costs and performance delivery through our IT Service Cost Management service.


    [1] IDC CIO Quick Poll, n=69 (December 2022)

    [2] IDC Worldwide – CEO Survey, IDC, January 2022)

    [3] IDC CIO Quick Poll, n=69 (December 2022)

    [4] Future Enterprise Resiliency & Spending Survey – Wave 6, IDC, July 2022, n = 816, NA: 256, AP: 369, Europe: 191

    [5] Future Enterprise Resiliency & Spending Survey – Wave 6, IDC, July 2022, n = 816, NA: 256, AP: 369, Europe: 191

    [6] IDC Perspective, CIO Guidance: Preventing and Remediating Technical Debt, IDC, June 2022

    Daniel Saroff - GVP, Consulting and Research Services - IDC

    Daniel Saroff is Group Vice President of Consulting and Research at IDC, where he is a senior practitioner in the end-user consulting practice. This practice provides support to boards, business leaders, and technology executives in their efforts to architect, benchmark, and optimize their organization's information technology. IDC's end-user consulting practice utilizes our extensive international IT data library, robust research base, and tailored consulting solutions to deliver unique business value through IT acceleration, performance management, cost optimization, and contextualized benchmarking capabilities.

    As seen in recent world news, political forces and evolving company policies have put avenues for independent content creators to generate revenue at risk. While creators are now faced with the daunting possibility that their income may be significantly cut if a major platform is forced offline, content platforms may, on the other hand, encounter new opportunities to capture share of social media and content platform markets. Two key events unfolding – a potential ban on TikTok by the U.S. government and Meta discontinuing its Reels Play Bonus Program payouts.

    IDC’s Future Consumer research team continues to track and forecast online consumer engagement and digital economies, such as independent content creation. IDC’s Consumer Market Model (CMM) definition of independent content creation is non-corporate content offered in ad hoc or subscription-based platforms, such as Patreon, YouTube, TikTok, and Meta (Instagram and Facebook). Independent content creation and consumption is being embraced by consumers and online markets, driven in large part by younger Millennials and Gen Z as more than 50% of users belong to these two generational cohorts. As identified by IDC’s Consumer Pulse service, in the Home & Entertainment May-June 2022 reports, Instagram and TikTok are the leading platforms for posting by Gen Z and Millennial creators.

    IDC’s most recent CMM forecasts that independent content creation will experience continued user growth worldwide with the number of people who are creating content increasing at a compound annual growth rate (CAGR) above 12% from 2021 to 2026. This continues to build on the massive growth in recent years as independent content creation have added over 1 billion new users worldwide and 43 million in the U.S. since 2019.

    The number of consumers buying both consumer and professionally generated content is also growing quickly. In the U.S., IDC expects the market to add 2 million new mobile buyers by the end of 2026. IDC expects spending to surpass $5 billion in the U.S. by 2026, signaling a large market opportunity with persistent near-term growth. But, as seen in the political and business news in the U.S., it is a market experiencing change and challenges that might jeopardize some creators’ ability to make money.

    The U.S. government is currently considering a ban on TikTok, a leading short-form content platform owned by the Beijing-based company ByteDance, as it investigates national security concerns. The previous administration issued an ultimatum to sell to an entity not under Chinese government control. Although this order was rescinded by the current administration, the U.S. government is investigating national security concerns that ByteDance could access private and sensitive data of users that will, in turn, be subject to access by the Chinese government. The Chinese government could request information about ByteDance’s customers, and the company would have to comply, endangering valuable user data like location information or using the platform to spread misinformation. The U.S. government has already banned the app on government devices but now looks to potentially ban the app on personal devices.

    There has been uproar by U.S. TikTok users and content creators of claiming that their government is trying to censor them, but TikTok faces scrutiny across the globe. Notably, India banned the app for their citizens in 2020, citing similar concerns. Other major governments and armed forces have also banned TikTok on their devices due to espionage concerns. The ban has spread to U.S. allies who are also banning the app on all government devices and now considering a ban on personal devices. The decision has yet to be made by the U.S. Congress whether TikTok use will be prohibited, but if the U.S. bans the app, its allies may follow suit. Countries that already restrict the usage on government devices include Canada and the United Kingdom.

    In March, Meta announced it would discontinue its Reels Play Bonus Program payouts to save money amid its current financial situation, ending certain payments to creators. Meta started the program in 2021 by investing $1 billion for influencers and content creators to earn up to $10,000 for sharing Reels that receive high plays and/or likes. As TikTok dominated short-form content, especially among the younger generational cohorts, this program was meant to combat TikTok’s market position and attract creators. Meta’s current challenging financial times notwithstanding, the move comes as the potential ban of TikTok in the U.S. could drive more creators to use Reels.

    Income generated by content creation has become a key objective for many in the younger generational cohorts. The Great Resignation, along with the global pandemic, created an environment that drove consumers to try to earn money through different content platforms. IDC’s 2023 CMM survey revealed that creators making money were represented predominantly by younger Millennials and Gen Z as almost 40% reported some level of earnings. Content creators further reported that they have been earning, on average, over $22,000 yearly in the U.S.; some of which is at stake among the political fallout and business developments.

    With the U.S. government potentially banning TikTok and Meta no longer paying for Reels, two of the leading revenue-producing platforms may no longer be options for creators to make income. While this causes concerns for creators, it does create opportunities for other platforms (notably YouTube with its Shorts offering) and app developers pursuing the next big thing. Content creators should continue to look at apps like YouTube to make revenue despite potentially harder and longer editing processes. Content creators should continue to diversify the platforms they distribute on and always look for up-and-coming platforms for new opportunities.

    Without providing opportunities to produce income or build personal brands, platforms that host content run the risk of losing traction with top creators and may fail to attract the next wave of popular creators. Demonetizing creators may ultimately demonetize platforms and reduce traffic. These current events create an opportunity for platform creators to become major players. Platform developers would be wise to recognize the impact and risk associated with Meta’s actions when considering demonetizing or reducing monetization opportunities, as consumers will deprioritize platforms that do not align with revenue opportunities.

    Money and fame are what content creators seek, and this online activity is continuing to grow. Independent content creation in terms of users, buyers, and spending is only getting bigger as shown by IDC’s CMM, and platforms that offer revenue and exposure opportunities hold a competitive advantage for attracting creators.

    Do you become a major player in content creation platforms, or do you lose market share to the next big application due to reduced or discontinued revenue opportunities for your users?

    A potential TikTok ban should drive investment in capturing market share rather than a pullback. Despite the news of a potential TikTok ban and Meta no longer paying creators for Reels, the future for independent content creation is bright with expected growth through 2026.

    IDC tracks many online activities in the digital economy and clients use IDC’s CMM to identify emerging opportunities across a wide range of technology categories. Interested in learning more about IDC’s Future Consumer research and services?

    Kelly Brown - Research Manager - IDC

    Kelly Brown is a Research Manager for IDC's Consumer Market Model and Consumer Market Trends, specializing in forecasting key demographic, technological, and consumer internet trends across 51 countries. She analyzes how demographic shifts drive tech adoption, consumer spending, high-growth online services, and eCommerce evolution, while also examining digital engagement, emerging technologies, psychographics, generational trends, brand sentiment, and market forecasts on usage and spending. Kelly's research supports enterprises, consumer brands, and public sector institutions with insights into which technology-enabled products, services, and experiences will shape consumer behavior.

    Have you ever wondered why sustainability has become such a buzzword lately? From our conversations within the Information, Communication and Technology (ICT) industry, IDC discovered that this is one part due to pressures from stakeholders (e.g. investors, regulators, end-user, eco system partners and clients) and the other due to the opportunities sustainability initiatives can offer. In fact, an IDC survey conducted in 2022 has seen these drivers of sustainability initiatives as a 50/50 split among enterprises worldwide.

    Companies that have chosen to proactively integrate sustainability into their business strategies and operations have not only reduced waste and optimized costs, but also improved cost effectiveness and efficiency in operations, created new revenue streams for sales, helped human resources attract and retain talent and drove and enabled product and services innovation.

    chart showing sustainability benefits in two columns, one for the people dimension of business and the other for the innovation and growth

    In the Asia Pacific region, enterprises that have undertaken sustainability initiatives have seen the most benefits in the people dimension of business operations. This includes attracting and retaining talent, driving innovation and increasing productivity. The people dimension is a fundamental yet often elusive key factor for success in the execution of strategies. The link between sustainability and people dimension means that organizations can leverage on sustainability initiatives to enhance outcomes from other existing strategies especially transformative ones that cut across various aspects of an organization’s operations, such as the case in digital transformation strategies.

    An Opportunity for Human Resources

    Sustainability’s ability to influence a person’s choice of employment is important for organizations in the region because of the widespread skills shortages in the ICT workforce. According to a 2021 study of the International Labor Organization (ILO) on The Future of Work in ICT, the shortage of talent in Asia Pacific is partly attributable to rapid changes in technology, the prominence of digital transformation strategies in companies since the pandemic, and technology’s impact on work and the skills to do certain jobs. An IDC report sees IT skills shortage affecting 60-80% of Asia Pacific organizations.

    Sustainability’s capacity to produce positive outcomes in recruitment and retention stems from altruism. Sustainability principles are founded on the United Nation’s Sustainable Development Goals (previously called Human Development Goals) that are fundamentally connected to what matters most to a person. It is human nature to gravitate towards a community of people or entity (as in the case of companies) that shares the same values as the person.  In a 2021 Global Environmental, Social & Governance (ESG) Business Services Buyer Value Survey, IDC noted that younger generations such as Millennials and Generation Z value all three pillars of ESG as important and are factors for their decision-making in associating themselves with a particular brand or an organization.

    An Opportunity to Innovate

    A value derived from sustainability is its capacity to ignite creativity and innovation in organizations.  Sustainability initiatives centered on circularity for instance require companies to revisit and reconfigure product designs to accommodate the requirements of reduce, recycle, or repurpose value of parts and packaging materials. An example of the impact of circularity in product design is the emergence of eco-smartphones such as those sold by tech startups like Nothing, Fairphones, Teracube, and Shift and specific brand models of Apple and Samsung. There are also eco-SIM cards deployed by telecoms company, Globe, in the Philippines which is made from 100% recycled materials, including the plastic waste from refrigerators.

    Another prime example of product design innovation ignited by sustainability is the reengineering in datacenters and reimagining of how they are built. Apart from the sector’s shift to cleaner sources of fuel for power and cooling, and the use of recycled and recyclable parts, the more innovative datacenter designs include the underwater “clouds in the ocean”  of Microsoft that can reportedly reduce carbon dioxide (CO2) emissions by around 40%.

    For service companies, sustainability presents an opportunity to innovate how they deliver services to clients.  Sometimes defined as the future of work this could mean automation of mundane and repeatable tasks to free up resources for faster, high-value customer service, digital delivery of services to reduce carbon footprint, or the application of hybrid work, green workspaces and SMART buildings.

    An Opportunity for Demand Growth

    Probably the most obvious opportunity brought by sustainability is its impact on market demand.  Sustainability initiatives inevitably lead to demand for new tools and services that can specifically meet its requirements.  Just on data alone, sustainability has created a need for ESG-related professional business services such as carbon footprint measure, ESG data security, audit, and reporting. 

    Sustainability has also expanded the use cases of existing technologies. Blockchain technology for example is now used to verify sustainable sourcing. In the energy sector for instance, Blockchain technology is used to confirm renewable energy utilization sources in enterprises for eligibility on carbon credits, financing and for ESG reporting. This use of Blockchain in energy attribution tracking is done in Singapore from utilities provider SP Group. Other expanded uses cases emerging from sustainability are digital twins, used for sustainability simulations, or AI, used for human rights tracking.

    Clearly, sustainability can be an opportunity for companies to enhance their human resource strategy, accelerate product and service innovation and expand the scope of their market.

    If you have any questions on how solutions providers like you can maximize the opportunities that sustainability brings, we are here to help. Find out more today and learn how IDC research and services on sustainability can help you.

    Melvie Espejo - Research Director - IDC

    Melvie Espejo is a research director for IDC Sustainable Strategies and Technologies. She leads the sustainability research practice in Asia/Pacific, tackling sustainability/environmental, social, and governance (ESG) strategic research themes with a 360-degree lens. Melvie's across-industry, across-technology research captures topics, such as climate change technologies, ESG adoption and execution, sustainable transformation in organizations, circularity and the circular economy, green procurement, and sustainability/ESG regulations and its impact on technology investments, strategies, and the competitive landscape.

    At IDC Metri, we have witnessed firsthand the challenges organizations face with IT budgeting. Our consultants frequently help organizations adequately budget their IT environments to make sense of the complex and changing IT environment and its cost sources.

    The budgeting process can be full of difficulties, from misclassified costs to inadequate attention for changing IT environments. In this article, we’ll discuss five key issues in IT budgeting and provide possible solutions to help IT management worldwide create more effective and transparent budgets.

    Misclassified IT-related Costs

    One of the major issues in IT budgeting is the misclassification of costs that are not IT-related but should be classified differently, like facility costs. This can lead to an inaccurate representation of IT spending and hinder informed decision-making.

    In more detail, misclassified costs can stem from several factors, including unclear definitions of IT and non-IT expenses, inconsistent allocation methods, or a lack of understanding of the specific functions and responsibilities of the IT department. This can result in an inflated IT budget, obscuring the actual costs of IT operations and making it difficult for IT management to prioritize investments and justify expenditures to senior leadership.

    Solution: To address this issue, organizations should:

    • Implement a standardized cost classification system, such as the Component Based Measurement (CBM) framework, to clearly define and categorize IT and non-IT costs. This helps ensure consistency and transparency in cost allocation.
    • Conduct regular training sessions for IT controllers and finance teams to enhance their understanding of IT cost structures and expense categories.
    • Set up cross-functional teams consisting of IT, finance and business unit representatives to review and validate cost allocations periodically. These teams can collaborate to identify misclassified expenses and make necessary adjustments, promoting a more accurate and transparent IT budget.

    Lack of IT Domain Knowledge Among Controllers

    IT controllers often lack the necessary domain knowledge to classify different IT cost sources and types accurately. This can result in a vague and untransparent IT budget that does not provide clear insights into the organization’s IT spending.

    The consequences of this knowledge gap can be far-reaching. For example, a lack of IT domain knowledge may lead to inaccurate forecasting of technology-related costs, making it difficult to plan for future investments or identify areas where cost savings could be achieved. It can also hinder the ability to benchmark IT spending against industry standards or competitors, limiting the organization’s capacity to identify opportunities for improvement and maintain a competitive edge.

    Solution: To mitigate this issue, organizations should:

    • Invest in training programs to enhance IT controllers’ understanding of IT cost structures, technology trends and the specific needs of the organization.
    • Engage IT experts or consultants to assist in the budgeting process, providing guidance and insights to ensure a more accurate and transparent IT budget. These experts can help IT controllers better understand the intricacies of IT cost management and identify potential areas for optimization.
    • Encourage collaboration between IT controllers and IT management, fostering a culture of knowledge sharing and open communication. This will enable IT controllers to gain a deeper understanding of the organization’s IT needs and challenges, facilitating more accurate and informed budgeting decisions.

    Simplistic Budgeting Processes

    Budgeting processes that are too simplistic often fail to account for the complexity of an IT environment. This means that changing IT environments, driven by rapidly evolving technology trends and shifting business requirements, are not reflected in the budgeting process and the resulting yearly IT budget.

    Traditional budgeting approaches, such as annual or biannual budgeting cycles, can be inflexible and unable to accommodate the dynamic nature of IT operations. This can lead to outdated budgets that do not accurately represent current IT needs or investment priorities, making it challenging for IT management to allocate resources effectively and align IT strategy with broader organizational goals.

    Solution: To address this issue, organizations should:

    • Adopt a more dynamic budgeting approach that can adapt to changes in the IT environment. This may involve implementing rolling forecasts, which provide regular updates to budget projections based on the latest data and insights, allowing organizations to respond more effectively to changing IT needs and priorities.
    • Incorporate scenario planning into the budgeting process, developing multiple budget scenarios based on various assumptions and potential developments in the IT environment. This helps organizations prepare for different outcomes and enables more informed decision-making when allocating resources.
    • Implement a cost allocation framework that enables adequate budgeting decisions for each different IT service in the static or changing context that they exist in.

    Shadow IT

    Shadow can lead to security risks, duplication of efforts and increased IT costs as organizations may unknowingly invest in redundant or incompatible technologies. Additionally, shadow IT can contribute to a lack of visibility into the organization’s IT landscape, making it difficult for IT management to accurately assess the efficiency and effectiveness of IT operations.

    Solution: To tackle the issue of shadow IT, organizations should:

    • Establish clear IT governance policies and processes to ensure that all technology solutions are vetted and approved by the IT department. This may involve creating a centralized technology request process or implementing an IT service catalog that lists approved solutions and services.
    • Promote a culture of open communication between the IT department and business units, encouraging employees to consult with IT before implementing new technology solutions. This can help prevent the use of unauthorized tools and ensure that IT investments align with the organization’s strategic objectives.
    • Implement effective user training and awareness programs to educate employees on the risks associated with shadow IT and the importance of adhering to IT governance policies. This can help foster a culture of accountability and responsibility when it comes to technology use within the organization.

    Lack of Consolidation

    A lack of consolidation is found in many organizations when a multitude of contracts with various vendors offer similar functionality or services. This can lead to increased costs and complexity in managing IT resources, as overlapping contracts may result in unnecessary spending on redundant solutions. Moreover, the lack of consolidation can hinder IT management’s ability to negotiate better pricing and terms due to the fragmented nature of contracts and vendor relationships.

    Additionally, managing multiple contracts can strain the organization’s resources, as IT staff must dedicate time and effort to administering, monitoring and maintaining relationships with more vendors than is optimal. This can divert attention from more strategic IT initiatives and limit the organization’s capacity to optimize IT operations and drive innovation.

    Solution: To address the issue of lack of consolidation, organizations should:

    • Conduct a comprehensive review of existing contracts and vendor relationships to identify areas of overlap or duplication. This is typically done in a full scope IT cost benchmark. This should involve analyzing the functionality, performance and cost-effectiveness of each solution to determine whether consolidation is feasible and beneficial.
    • Consolidate contracts and vendors where possible to streamline IT operations and reduce costs. By reducing the number of vendor relationships, organizations can achieve economies of scale, which can lead to more favorable pricing, terms and service levels. Note that these projects are extensive in complexity and cost, but often lead to high returns.
    • Implement a centralized contract management system to track and monitor all IT vendor contracts. This can help organizations maintain visibility into their IT portfolio, making it easier to identify opportunities for consolidation and ensure that all contracts align with the organization’s strategic objectives.
    • Establish a vendor management office (VMO) or designate a dedicated team responsible for managing vendor relationships and contracts. This team can help negotiate better deals, manage contract renewals and terminations, and monitor vendor performance to ensure that the organization is receiving the best value for its IT investments.
    • Encourage collaboration between IT management and procurement to develop a unified approach to vendor selection and contract negotiation. This can help ensure that the organization’s IT and procurement strategies align, resulting in more efficient and cost-effective IT operations.

    By addressing the issue of lack of consolidation, organizations can achieve greater efficiency and cost savings in their IT operations. Implementing a strategic approach to vendor management and contract consolidation will enable IT management to optimize resources, negotiate better deals and focus on driving innovation and value for the organization.

    IT budgeting is a complex and challenging process, but by addressing the key issues outlined above, organizations can create more accurate, transparent and effective budgets. Investing in training, adopting agile budgeting processes and implementing strong IT governance can help IT management worldwide better align IT spending with business goals and maximize the value of their IT investments.

    Learn how to better demonstrate value to the business and validate budgets with our eBook on cost benchmarking.