« Revisiting Model Structure, Path Toward Understanding the Opportunity | Main | Trouble with Text Blocks in SEC XBRL Financial Filings »

XBRL's Sweet Spot: Aggreed Upon Fidelity

A while back I did a post where I mentioned XBRL's "sweet spot".  I am trying to zero in on the unique characteristics offered by XBRL. This is an updated list of that sweet spot, where XBRL seems to excel when compared with other alternatives for exchanging business information:

  • Internal or external information exchange. First and foremost, XBRL is a global standard.  While there are very good ways of exchanging information internally; if you need to exchange information external to your organization where you don't have control of the other system you need some sort of standard to avoid building expensive point solutions.  XBRL is a global standard.
  • Machine readable and also readable by humans.  XBRL offers information which is machine readable but also inherently readable by humans.  The reason information is readable by humans and machines is because of the rich set of domain business rules which explains the information.  Software applications can therefore be constructed which make the information readable by both humans and machines.  This is not to say users of the information can get a pixel perfect representation exactly as they desire to render the information without adding additional metadata.  This is more to say that a very usable rendering of the information is possible given only the business rules of the information because of patterns which software can leverage.
  • Larger transactions which tend to change. For example, a 50 or 100 page regulatory report packed with perhaps thousands of facts exchanged.  This is as contrast to a small transaction with a small number of data points.
  • Low to zero tolerance for errors in the information. For example, everything must tick and tie in a financial report and if things don't add up then those using the information could make bad decisions.
  • Information which needs to be reconfigured.  For example, financial statements are not static forms, they are dynamic.  This is contrast to say a tax form which is static and the form cannot be modified by the person who fills out the form.
  • Business people changing the metadata, no IT involvement required.  For example, business people create financial statements.  If the business user needs to adjust the metadata, the business user reconfigures the information without the need to call the IT department for help.
  • Agreed upon transaction fidelity. As was pointed out be a very good video about HL7 and in another blog post, "The only way a meaningful exchange of information can occur is the prior existence of agreed upon technical syntax, domain semantics, and domain workflow rules." For example, a CSV file (comma separated values) is low fidelity, you can exchange information but CSV offers no way to  associate rules with the information.  XML schema offers some ability to verify the fidelity of the information in terms of technical syntax, but not domain semantics.  XBRL offers much, much more in terms of business rules to insure information fidelity, very high-fidelity information exchanges are achievable using XBRL.
  • Table-type, tree-type or open graph-type information is supported.  CSV files can only express table-type information.  The same with a relational database.  Table-type information is homogeneous. But there are other types of information.  Tree-type and open graph-type information is more heterogeneous and therefore harder to store in tables.  XBRL can be used for table-type, tree-type and open graph-type information.
  • Strikes a good balance between power and ease of use.  While XBRL is not yet easy enough to use for business users, it is significantly easier than the much more powerful RDF/OWL/SPARQL "stack" of technologies.  Even for the average software developer, XBRL is easier than RDF/OWL/SPARQL.  Also, RDF/OWL/SPARQL does not really offer the ability to write the business rules necessary for the needs of business users.  Evidence of this is the SPIN and RIF specifications which are used to express business rules. The way that I would state it is that RDF/OWL/SPARQL offers almost infinite flexibility and that makes it harder to use.  XBRL offers, or should offer really, flexibility where flexibility is needed.

When everything is condensed down to its essence, the XBRL global standard is about enabling one business user users to exchange information with another business user or users without the involvement of the information technology department.  A key piece of this is what I called an "open taxonomy" type information exchange.  It was pointed out to me, and I agree, that it is more about domains which require flexible taxonomies.  You cannot really have "open".  Open means a hole.  There cannot be holes in information exchanges.  That leads to ambiguity and information quality problems.  Flexibility needs to be carefully controlled.  Different implementations of XBRL are taking different approaches.  I don't think anyone has figured out all the moving pieces quite yet.

So few people understand how to tame the XBRL beast today.  Some are zeroing in on it though.  It is my observation that most approaches used today either throw out XBRL's most important feature which is its extensibility or use an approach which leads to a dead end because they are focused on thee wrong problem elements.  Few craftsman understand how to appropritaly employ XBRL as it was intended to be employed.

The best opportunity to understand all the moving pieces is the SEC XBRL financial filings which are all publically available.  They offer many, many clues of what to do and what not to do.

Someone was trying to wrap their head around all this and they wrote a narrative which tried to explain the moving pieces as they needed to understand them.  I modified that narrative and this is what I came up with which attempts to explain the problem XBRL is trying to solve: 

Automating the exchange of information between two or more internal business systems has traditionally required an expensive manual integration process via tightly coupled custom interfaces and secure networks. Integration with business systems external to one's organization was extremely rare.  Integrations were often expensive, fragile, and handled only small, rather unsophisticated payloads of data from transactions.

The creation of the public internet changed that dynamic. The internet expanded the need to exchange information because more business systems were now connected.  The public internet lead to the need for publicly available standards such as XBRL.

Modern integration methods support looser coupling but require standards or negotiated syntax and standard protocols and workflow rules.  As information becomes more sophisticated and rich, semantic rules can be used to increase the fidelity of the information exchanged between sending and receiving systems.

Standards offer preexisting technical syntax, domain semantic, and workflow rules which enable the exchange of information that is not only readable/understandable to human business users but also is machine readable. 

These higher-fidelity information exchanges allow for entire supply chains to be integrated by business users themselves, removing the information technology department from the equation.  This allows for business users to control business processes, adjust the processes as deemed necessary, and otherwise avoid expensive 'point solutions' in favor of much less expensive but just as reliable standard, loosely coupled, dynamic, high-fidelity integrations internally and external to an organization and therefore across entire supply chains.

 This is a work in progress.  If you care to comment to improve this description please send me an email.

Posted on Friday, January 10, 2014 at 06:09AM by Registered CommenterCharlie in | CommentsPost a Comment

PrintView Printer Friendly Version

EmailEmail Article to Friend

Reader Comments

There are no comments for this journal entry. To create a new comment, use the form below.

PostPost a New Comment

Enter your information below to add a new comment.

My response is on my own website »
Author Email (optional):
Author URL (optional):
All HTML will be escaped. Hyperlinks will be created for URLs automatically.