Infinity Works realised from day one that the project involved more than simply shifting data to another place. The first step was to learn about the business and how Delta-EE experts used the information they collected. Then the team explained what had to be done before any new solution could operate effectively.
It was a daunting prospect. Delta-EE had to cleanse the data in 28 massive files to take out errors and inconsistencies. Then the company had to restructure all the data into a standardised format so it could be successfully combined.
Infinity Works advised that this was the only way to give users a single view of all the data sets, making it possible to extract new information and gain different perspectives for clients. The task is still underway, led by Delta EE and supported by Infinity Works on an ad hoc basis.
To produce a working prototype, however, Infinity Works had to sidestep the long-term data consolidation activity. Having chosen Snowflake as the new data platform for Delta-EE, the team set about extracting the necessary elements from the Excel files to create a solution with all the relevant capabilities. They used AWS services to convert the Excel data into a format compatible with Snowflake and added metadata to enable us to model the data dynamically.
Infinity Works also structured the data to work with the Metabase business intelligence tool. It was chosen to give subject matter experts at Delta-EE better insights than before and more powerful charts and other visual presentation options. At this stage, Infinity Works created a pilot system in Snowflake which Delta-EE began testing at once.
The team took every opportunity to guide Delta-EE on its journey, advising on a range of topics to help the people who use the data every day as well as the executives who plot the company’s strategic direction.