Data conversions are tricky undertakings. There is no way around that. They are time-consuming, expensive, and can feel downright overwhelming. For many agencies in the public sector, the constraints on budgets and resources are a challenge day in and day out. When it comes to data conversions or modernization projects, there is no exception. Across organizations in the United States, approximately 80% of data migrations fail. Why, you ask? Let’s take a closer look.
Extract, transform, and load (ETL) is the process of integrating data from multiple, typically disparate, sources and bringing them together into one central location. It is a key component to businesses successfully making use of data in a data warehouse.
Sure, the process itself is fairly straightforward, and when done right, ETL prepares an organization for powerful business intelligence initiatives. However, a lot goes into a successful ETL process. Let’s discuss the three steps involved and why data management practices are an essential foundation to carrying ETL out properly.
In schoolyard terms, data migrations are the equivalent of the old “Telephone” game that you may have played as a kid. You get a line of people together, and the first person in the line whispers a sentence to the second person – “The quick brown fox jumped over the lazy dogs.” The second person then whispers this phrase to the next person, and so on, until they get to the end of the line. At that point, the last person says what the sentence is – in this case, “The slick clown’s socks slumped over the crazy bogs.” As you can see, the end result may be similar to the start, but it’s definitely not the same!
Data is at the heart of every organization, and data migration projects are important undertakings for many businesses as they strive to keep up with the pace of technological advancement. Data migrations to more updated systems underpin the success of many strategic initiatives. While 35 percent of organizations have a data migration project planned for this year, a staggering 80 percent of all data migrations fail!
So you’re tasked with your organization’s next big data migration. Maybe you’re moving to a new CRM system. Maybe you’ve just acquired another company and need to integrate their data into your system. Whatever the reason, data migrations are critical processes that many businesses go through. The continuing explosion in the volume of data businesses collect, store and use suggests that the trend of most companies engaging in some data migration project isn’t letting up anytime soon. According to a recent data migration study, 91% of companies engage in data migration projects.
Whether you’re working on a large data migration project, or simply trying to answer business questions with your data and having issues, Experian Pandora should be part of the conversation. We often hear from customers that they have disparate databases, leverage excel to house important data, or just have no idea how bad their data really is. This often leads to us running data tests on a subset of their data, which typically cannot tell the whole story, or is not statistically significant based on the total size of their database.
Government agencies at every level—city, state, and federal—collect large amounts of data; that’s a fact. The challenge for many lies in the ways information is collected and processed. Much of it is locked up in departmental silos, on somewhat dated computer systems, and it’s hard to access for additional analysis or to share publicly. Much of it may have been collected on paper forms or input by busy staff with lots of other things to do. Yet in any commercial organization, your data might be considered like gold dust! Locked within those siloed systems are many nuggets of valuable information that can help improve the efficiency of your entire organization, help deliver better services, and help improve the lives of your constituents.
It’s 8:30 in the morning on Day 3 of the MDM & Data Governance conference and Aaron Zornes, Chief Research Officer of The MDM Institute, is about to introduce a panel of three experts who will address an intimate room of 100 or so attendees.
Affectionately dubbed ‘The Catalina Wine Mixer’ for many years by Experian Data Quality employees who have attended, CS Week 2017 certainly lived up to its reputation as being the biggest event of the year. This year’s conference took place in San Antonio, Texas and centered around customer service within the electric, gas and water/wastewater utility industries. The event drew a crowd of about 2,000 utilities professionals from all over the United States and Canada.
This year the American Association of Motor Vehicle Administrators (AAMVA) took their Annual International Conference (AIC) to Williamsburg, Virginia. AIC showcases the latest trends in the motor vehicle and law enforcement community and provides a forum for chief administrators to learn from and network with their fellow jurisdiction executives. This is one of my favorite events that Experian Data Quality sponsors, and this year did not disappoint.