Open format

An open file format is a published specification for storing digital data, usually maintained by a standards organization, which can therefore be used and implemented by anyone. For example, an open format can be implementable by both proprietary and free and open source software, using the typical software licenses used by each. In contrast to open formats, closed formats are considered trade secrets. Open formats are also called free file formats if they are not encumbered by any copyrights, patents, trademarks or other restrictions (for example, if they are in the public domain) so that anyone may use it at no monetary cost for any desired purpose.^[1]

Specific definitions

Sun Microsystems

Sun Microsystems defines the criteria for open formats as follows:^[2]

• The format is based on an underlying open standard
• The format is developed through a publicly visible, community driven process
• The format is affirmed and maintained by a vendor-independent standards organization
• The format is fully documented and publicly available
• The format does not contain proprietary extensions

US government

Within the framework of Open Government Initiative, the federal government of the United States adopted the Open Government Directive, according to which: "An open format is one that is platform independent, machine readable, and made available to the public without restrictions that would impede the re-use of that information".^[3]

State of Minnesota

The State of Minnesota defines the criteria for open, XML-based file formats as follows:^[4]

• The format is interoperable among diverse internal and external platforms and applications
• The format is fully published and available royalty-free
• The format is implemented by multiple vendors
• The format is controlled by an open industry organization with a well-defined inclusive process for evolution of the standard

Commonwealth of Massachusetts

The Commonwealth of Massachusetts "defines open formats as specifications for data file formats that are based on an underlying open standard, developed by an open community, affirmed and maintained by a standards body and are fully documented and publicly available."^[5]

The Enterprise Technical Reference Model (ETRM) classifies four formats as "Open Formats":

1. OASIS Open Document Format For Office Applications (OpenDocument) v. 1.1
2. Ecma-376 Office Open XML Formats (Open XML)
3. Hypertext Document Format v. 4.01
4. Plain Text Format

The Linux Information Project

According to The Linux Information Project, the term open format should refer to "any format that is published for anyone to read and study but which may or may not be encumbered by patents, copyrights or other restrictions on use".^[1] - as opposed to a free format which is not encumbered by any copyrights, patents, trademarks or other restrictions

Examples of open formats

Multimedia

• CMML — Timed metadata and subtitles
• DAISY Digital Talking Book — A talking book format
• FLAC — Lossless audio codec
• JPEG 2000 – an image format standardized by ISO/IEC
• Matroska (mkv), container for all type of multimedia formats (audio, video, images, subtitles)
• MNG — moving pictures, based on PNG
• Musepack — An audio codec
• Ogg, container for Vorbis, FLAC, Speex (audio formats) & Theora (a video format)
• SMIL — A media playlisting format and multimedia integration language^[6][7]
• Speex — Speech codec
• WavPack — "Hybrid" (lossless/lossy) audio codec
• XSPF — A playlist format for multimedia
• PNG – a raster image format standardized by ISO/IEC
• SVG – a vector image format standardized by W3C
• VRML/X3D – realtime 3D data formats standardized by ISO/IEC
• WebM - a video/audio format.

Text

• ASCII — a plain text file
• DVI — device independent (TeX)
• ePub — open e-book standard by the International Digital Publishing Forum (IDPF)
• LaTeX — document markup language
• Office Open XML — a formatted text format (ISO/IEC 29500:2008);^[8] see Licensing for details
• OpenDocument — a formatted text format (ISO/IEC 26300:2006).^[9]
• OpenXPS — open standard for a page description language and a fixed-document format
• PDF — open standard for documents exchange (ISO 15930-1:2001, ISO 19005-1:2005, ISO 32000-1:2008). PDF started out a proprietary standard, but was later submitted through standardization
• PostScript — a page description language and programming language. PostScript started out as a proprietary standard, but was later submitted through standardization
• Rich Text Format — a formatted text format (proprietary,^[10][11] published specification, defined and maintained only by Microsoft)
• Unicode
• UTF-8 — text encoding with support for all common languages and scripts

Archiving and compression

• 7z — for both archiving and compression
• bzip2 — for compression
• gzip — for compression
• PAQ — for compression
• SQX — for both archiving and compression
• tar — for archiving
• ZIP — for both archiving and compression; the base format is in the public domain, but newer versions have some patented features^[12][13][14]
• MAFF — for web page archiving based on ZIP
• xz — for compression

Other

• CSV — comma separated values, commonly used for spreadsheets or simple databases
• YAML — human readable data serialization format
• JSON — object notation, subset of YAML and correct ECMAScript statement
• XML — a general-purpose markup language, standardized by W3C ^[15]
• HTML/XHTML — markup language for web pages (ISO/IEC 15445:2000)
• PHP — scripting and markup language for web development
• RSS — syndication
• CSS — style sheet format usually used with (X)HTML, standardized by W3C
• DjVu — file format for scanned images or documents
• EAS3 — binary file format for floating point data
• ELF — Executable and Linkable Format
• FreeOTFE — container for encrypted data
• Hierarchical Data Format — Multi-platform data format for storing multidimensional arrays, among other data structures
• iCalendar — calendar data format
• NZB — for multipart binary files on Usenet
• NetCDF — for scientific data
• SDXF — the Structured Data eXchange Format
• SFV — checksum format
• TrueCrypt — container for encrypted data
• WebDAV — Internet filesystem format
• LTFS - Linear Tape File System

See also

Free software portal

• Open standard
• Free software
• Open source
• List of open source codecs
• Open system
• Free protocol
• Vendor lock-in
• Embrace, extend and extinguish
• Network effect

References

1. ^ ^{a b} "Free File Format Definition". LINFO.org. http://www.linfo.org/free_file_format.html. Retrieved 2007-02-11. 
2. ^ Open Document Format for Office Applications (OpenDocument) v1.0 - OASIS Standard, 1 May 2005
3. ^ Open Government Directive of December 8, 2009.
4. ^ Meanwhile, Deep Down in Texas: An Open Format Bill is Filed - Tuesday, February 06 2007 @ 03:55 PM PST Contributed by: Andy Updegrove - ConsortiumInfo.org
5. ^ Major Revision of Massachusetts Enterprise Technical Reference Model (ETRM). Robin Cover, Editor - Created: July 03, 2007. - Cover Pages
6. ^ W3C SMIL
7. ^ SMIL 2.1 (W3C Recommendation)
8. ^ ISO - News - Publication of ISO/IEC 29500:2008, Information technology — Document description and processing languages - Office Open XML file formats
9. ^ "ISO/IEC 26300:2006 Information technology -- Open Document Format for Office Applications (OpenDocument) v1.0". ISO. http://www.iso.org/iso/en/CatalogueDetailPage.CatalogueDetail?CSNUMBER=43485. 
10. ^ "tutorial: Rich Text Format (RTF)". Colorado State University. http://accessproject.colostate.edu/udl/modules/word/tut_rtf.cfm. Retrieved 2010-03-13. 
11. ^ "4.3 Non-HTML file formats". e-Government Unit. 2002-05. http://archive.cabinetoffice.gov.uk/e-government/resources/handbook/html/4-3.asp. Retrieved 2010-03-13. 
12. ^ ".ZIP Application Note". http://www.pkware.com/support/zip-app-note. Retrieved 2010-12-24. 
13. ^ "Latest OOX-ODF FUD-Spat: States Prepare to Ban Zip and PDF Files". http://orcmid.com/blog/2007/02/latest-oox-odf-fud-spat-states-prepare.asp. Retrieved 2010-12-24. 
14. ^ "PKZip Must Open Up". http://brianlivingston.com/eweek/article2/0,4149,1257562,00.html. Retrieved 2010-12-24. 
15. ^ W3C XML

External links

• OpenFormats
• Practical Advice for using Free Formats from Ubuntu Community Documentation
• Study on the: Economic impact of open source software on innovation and the competitiveness of the Information and Communication Technologies (ICT) sector in the EU, 2006 EU report in favor of adopting open source software
• Free File Format Definition
• Definition of Free Cultural Works