Data Hygiene Should Be a Top Priority for Construction Contractors

Data Hygiene Contractors can benefit by shifting to construction data analytics platforms. However, beautiful charts, graphs and animations mean nothing if the underlying data is full of holes. This is according to  Bruce Orr, Chief Data Scientist of ProNovos. His new post at stresses the importance of data hygiene.

“For many contractors, what might be thought of as poor ‘data hygiene’ is a pressing concern,” Orr writes. “A flawed approach to data entry—especially the need for different stakeholders to manually enter data into different systems multiple times—tends to be the root of the problem.”

Founded by construction influencer Aarni Heiskanen, focuses on construction innovation and technology. Orr’s blogpost for the site is titled Keeping it Clean: Analytics Can Benefit Contractors—So Long as They Maintain Good ‘Data Hygiene’.

Orr is the ProNovos founder and 20-year veteran of data analytics. In the piece, he describes how seemingly minor mistakes tend to cause bigger problems as data volume grows with time. “For example, the project manager may enter ‘SmithCo Steel’ into the spreadsheet even as the controller refers to ‘Smith Co. Steel’ in the document,” Orr writes. “Without clarity into this inconsistency, a later analysis will skew the results.”

Incomplete data causes issues

Faulty or incomplete data in categories such as vendors, subcontractors, employees, equipment, materials or project costs can undermine contractors’ efforts to base their strategies on the facts. And yet despite the high importance of data integrity, Orr notes, some contractors are reluctant to tackle this issue. “This may be because they see it as a time-consuming, backward-looking exercise. It involves laboriously poring over existing files to ferret out incompleteness, inconsistency, duplication or lack of timeliness,” he explains.

But in fact, Orr notes, software tools can quickly and efficiently ferret out duplicates and other mistakes. In the column, the data scientist offers a few simple steps on the path to data hygiene.

Step 1: Put a Premium on Pulldowns

Orr encourages contractors to take full advantage of the ability of their existing accounting and business-information systems to generate pulldown menus. This is an easy way to avoid duplicates and errors caused by manual entry. “All users should be trained to make use of the pulldown feature and, whenever possible, avoid manually entering data,” Orr writes.

Step 2: Get a Data Hygiene Test

Figuring out whether your company has a data-cleanliness problem does not require your teams to work nights and weekends hunting down errors in old spreadsheets, Orr explains. “Look for a software tool that can give you a score on factors such as data completeness, accuracy, consistency and timeliness,” he advises. “Granularity is important. If a contractor is running an analysis that involves job descriptions as a key component, it helps to know if 30 percent of your records actually fail to include any job descriptions at all.”

Step 3: Leverage Existing Best Practices

Existing practices in master data management (MDM) provide painless pathways to resolving what may seem like intractable conundrums, Orr writes. One regional U.S. contractor, which was onboarding a new enterprise data warehouse, had long tracked its change orders using project management software. The contactor wanted to merge this data stream with flows from its accounting system. “However, there was a problem,” Orr recounts. “The job-numbering systems were different. ‘Job 1-2-3’ in one system was ‘Job A-B-C’ in the other.” The ProNovos team used a mapping tool in the data warehouse to sync the job data, thus allowing the contractor to merge the data flows and ready them for analysis.

In the conclusion to the piece, Orr describes data hygiene as a prerequisite for effective use of construction analytics. He adds that squeaky clean data can help companies make seamless IT transitions. This is true when moving from one accounting system to another or beginning to leverage AI. “Moving forward,” Orr writes, “good data hygiene will allow contractors to hit the ground running as artificial intelligence further transforms the industry.”

About ProNovos

ProNovos provides cloud-based business intelligence solutions and services that empower contractors. Their goal is to help contractors find new opportunities, make better decisions, save money and also reduce risk. Founded in 2014, the Atlanta-based operations-management and data-analytics firm focuses exclusively on the specific needs of the construction industry. This actionable intelligence is accessible anywhere, anytime by superintendents, project managers, accountants, estimators, c-suite executives and also other decision-makers. For more on ProNovos, you can also visit

Got more questions about your project?

  • Drop files here or
    Accepted file types: jpeg, jpg, gif, png, pdf, Max. file size: 50 MB.
      Allowed formats: jpeg, jpg, gif, png, pdf
    • How would you like us to respond?

    • Note: Some questions will be published anonymously with their answers at the end of this story to share with other readers.