Digital Financial Reporting

This blog post updates a prior post, Minimum Criteria for Evaluating SEC XBRL Financial Filings. The core premise did not change, only the supporting data and therefore the summary totals. This post updates the data for the complete set of 10-K filings submitted to the SEC between March 1, 2013 and February 28, 2014.

To repeat the core premise: "Prudence dictates that using financial information in SEC XBRL financial filings should not be a guessing game. Rather; safe, reliable, predictable, automated reuse of reported financial information seems preferable."

To realize that goal, fundamental things about an SEC XBRL financial filing must always be correct.  These are the minimum criteria for using the information; and therefore they should be the minimum criteria for evaluating the appropriateness of SEC XBRL financial filings.

Not meeting these minimum criteria cause the information contained in SEC XBRL financial filings to be ambiguous, to not be decipherable by automated computer processes, to yield "red flags" which indicate the information may not be trustworthy to automated computer processes, or to be unusable by such automated processes. Further, any human readable renderings derived from this information will not be usable.

In addition, violations of these criteria cause very specific issues, most are very easy to see and understand, and generally issues are very easy to fix.

The following is a summary of the minimum criteria which are necessary for an SEC XBRL financial filing in order to make use of any financial information within that digital financial report. Also provided is the percentage of situations within SEC XBRL financial filings which already meet this criteria.

1. 99.9% meet the criteria of consistent XBRL technical syntax rules and are therefore fundamentally readable documents (More information | Examples)
2. 97.9% meet the criteria of specified by automatable SEC EDGAR Filer Manual (EFM) rules (More information | Examples)
3. 99.9% meet the criteria of consistent and unambiguous report level model structure relations (More information | Examples)
4. 99.2% provide a detectable "root of reporting entity" so that information can be properly discovered using automated processes (More information | Examples)
5. 99.3% provide a detectable and unambiguous current balance sheet date (More information | Examples)
6. 97.8% consistenty report or provide enough information to impute 51 fundamental accounting concepts and those concepts consistently adhere to 21 basic accounting relationships (More information | Examples)
7. 90.1% provide detectable roll up rules for balance sheet, income statement, cash flow statement (More information | Examples)

How do I know that these criteria are correct?  Because 1,281 SEC XBRL financial filings satisfy all seven of these criteria and the foundational information in their digital financial reports is proven to be usable by automated computer processes. These 1,281 public companies are digital financial reporting all stars.

What is even more interesting than the 1,281 examples where you can use these digital financial reports is the fact that the gap between the others which do not meet these criteria and those public companies also becoming digital financial reporting all stars because they meet this required minimum criteria is so small. Consider the following:

• 1,281 have 0 errors/issues/anomalies (these are the current all stars)
• 2,293 have only 1 error/issue/anomaly
• 1,382 have 2 errors/issue/anomaly
• 700 have 3 errors/issue/anomaly
• 433 have 4 errors/issue/anomaly
• 255 have 5 errors/issue/anomaly

Add all those numbers up and you get 6,344 or 95% of all SEC XBRL financial filings which are 5 or less errors from meeting that minimum criteria. That is 10,164 errors!

Something is worth repeating here.  I am not saying that I have 100% of my criteria exactly correct.  What I can say is that given my interpretation, if my interpretation were employed the system would work.  However, the goal is system equilibrium, for the system to be in balance. There are three things which impact the system:

1. The SEC XBRL financial filing.
2. The business rules.
3. The software algorithm which reads the SEC XBRL financial filing.

So basically if someone has a better interpretation of the business rules or of someone can create a better software algorithm to effectively and safely use these digital financial reports, cool.  But we do need to have one agreed system, not 6674 different systems one for each of the 6674 different filers.

There is one other thing worth mentioning.  I don't have this totally dialed in yet, but this is what I currently see.  My perspective on these tests was the filing, the submission, the report.  If you pass all the tests then "you are an all star". 

But that perspective might not be correct or the best way to look at what is really going on with SEC XBRL financial filings. Perhaps a better and certainly a different perspective is looking at all the possible errors which COULD exist as compared to all the errors which DO exist.

Consider the following. In my set of 6,674 SEC XBRL financial filings I am testing there are 6,442,922 relations between the report elements contained in those filings.  Of those 6,442,922 relations there are only 344 total relations which are potentially ambiguous. If I am getting my decimal points correct, that is .0054% of the total relations. The vast, vast majority of those relations are correct.  This is not to minimize the errors, those errors must be fixed.  But considering that very few systems adequately manage these model structure relations correctly (proof of that is ANY errors), those who are creating these reports are doing a very good job of getting these model structure relations correct.

These SEC XBRL financial filings are made up of many, many, many little pieces.  All these many, many little pieces have to fit together correctly. Most of these pieces do fit together correctly.

What if we were to flip this around? The tests that I am looking at has the focus on what is wrong in the SEC XBRL financial filing.  What if one were to look at what is RIGHT!  Again, the point here is not to minimize the errors.  Again, those must be fixed.  But what I am noticing is that there are also a lot of things which are right with these digital financial reports; particularly considering that there are not nearly enough automated processes watching over the creation of the information.

To give you a perspective, there are an average of 1278 reported facts in a report.  Each reported fact has a context.  Each reported fact has taxonomy schema pieces, linkbase relations, lots and lots of stuff.  The XBRL 2.1 and XBRL Dimensions conformance suites have probably around a thousand tests.  Considering all the possible things which could be wrong and for 6674 SEC XBRL financial filings, there are 3 errors.  That is really pretty amazing.

Again, don't get me wrong.  In an article, XBRL Mistakes Really Hurt: Why Accuracy is Crucial for Your Company’s Communications with Financial Markets, Professor Dhananjay (Dan) Gode, a Clinical Associate Professor of Accounting at New York University’s Stern School of Business, makes the following statement:

"95% accuracy is not good enough – even 98% is not good enough"

The only way digital financial reports will work is if they are 100% accurate. The truth is that digital financial reports can be more accurate than the current financial reports created using Microsoft Word.  Why? Because computers can read and therefore help accountants creating digital financial reports.  Word knows nothing about financial reporting.

As you can see from my minimum criteria, digital financial reporting tools do understand financial reports.  Digital financial reporting tools know that "assets = liabilities and equity".  They know that assets foot.  They understand the notion of the balance sheet date and can help you keep it that information consistent.  Word can do none of this! And I would point out the phrase "minimum criteria".  My seven criteria is only the tip of a much larger iceberg.  While humans are crucial to the process of creating and even using financial information, computers can help humans if financial reports are digital.

So are SEC XBRL financial filings "half correct" or "half wrong"?  SEC XBRL financial filings are far, far more than "half correct".  I don't know if you can extrapolate my data onto the entire filing.  My lowest category is 90.1%.