OpenRAW

OpenRAW logo

OpenRAW was an initiative to raise awareness of a serious problem with top-end digital photography and to help solve that problem. The problem concerns long-term access and viewing of the raw images often used by professional and experienced amateur photographers. OpenRAW's solution, (also their motto), was "Digital Image Preservation Through Open Documentation".^[1]

This initiative was primarily an international (non-political) advocacy and lobby activity directed at companies making digital cameras and those developing software to support those cameras. It also had the aim of raising awareness of the problem among photographers. Its resources included a website with a discussion forum,^[1] and many registered supporters, including individuals,^[2] companies,^[3] and professional organizations.^[4]

Formation

Early in 2005, Juergen Specht^[5] and the members of his mailing list D1scussion began to identify concerns about the difficulties associated with the proprietary RAW files introduced by camera makers.^[6]

The background to these concerns, described at Raw image format (Drawbacks), Digital Negative (Objectives), and dcraw (Motivation), is that the photographs from top-end digital cameras are often contained within files whose specifications are formally known only to the camera manufacturers. Not only does this require extra software development by many companies after the launch of most new camera models, but there is a major risk that future software products will not be able to render photographs from decades earlier.

As the seriousness of the issue was quickly realized, this team founded an initiative called OpenRAW, with the goal of encouraging image preservation and ensuring that the creators of the images retained the choice of how their images are processed.^[6]

OpenRAW was launched worldwide via a press release^[7] on 25 April 2005.^[8] There were positive reactions worldwide: for example at DPReview;^[9] many others in English;^{[10][11][12][13][14][15][16]} some in German;^[17][18][19] and in Japanese.^[20]

Achievements

Raising Awareness

The OpenRAW initiative identified the seriousness of this problem, articulated it in a way that photographers understood,^[8] summarized the solution with their "motto", and created a (non-commercial) global brand ("OpenRAW") which encapsulated all of these. The team were not the first to understand these problems, and didn't claim to be. They were primarily photographers,^[5][21][22] (rather than companies with commercial interests in cameras or image processing products, or archivists), with the advantage that they spoke to other photographers in their own language, rather than, for example, the language of archivists.^[23]

The OpenRAW initiative raised awareness, or crystallized vague awareness, of these problems with many photographers and organizations worldwide.^[24]

Camera manufacturers were made aware of the disquiet about their policies. One of them, Sony, responded with a letter held on the OpenRAW website,^[25] while others didn't respond when asked.^[13] There is no evidence that any of them changed their policies as a result of the OpenRAW initiative.^[6]

Supporters worldwide

At OpenRAW's peak there were over 1600 registered individual supporters from across the world, writing in English but sometimes as a second language.^[2] Nearly thirty software and hardware companies registered their support,^[3] thirty "photographic resources" were supporters,^[26] and so were five professional organisations.^[4]

Its influence was wider than these numbers would indicate. When it conducted a survey (in English) in 2006,^[27] more than 19,200 photographers worldwide responded to it. (From North America, 46%; Europe, 43%; Asia, 5%; Australia, 4%; Africa, 1%; South America, 1%).^[24][28][29] Twenty photography associations, forums, listservs, and other resources worldwide supported the survey.^[30]

What these supporters typically have in common was the conviction that people and organizations should reliably be able to access and view their photographs well into the future, and that this requires open documentation of the formats of the files used.^[3][4][26] While popular image file formats such as JPEG are openly documented, most raw image formats, often used by professional and experienced amateur photographers, are not.

Resources created

The OpenRAW website, especially the non-forum parts identified above, represent views of many companies and organizations other than camera makers.

The results of the survey continue to be available as a resource, but must be read with caution because it was conducted in 2006.

Another resource, often cited on the web and still pertinent, is an article "The RAW Flaw",^[31][32][33] jointly authored by Michael Reichmann (of The Luminous Landscape^[22]) and Juergen Specht (leader of the founding group of OpenRAW), and published on each website. Permission is given for the text to be copied and republished, with translation if desired, and there are examples in various countries and languages, especially of the "Act Now" call for action: in China (in English);^[34] in French;^[35] different versions in Spanish;^[36][37] in Danish;^[38] and in Italian.^[39]

Limitation

Summary of the problem

The problem identified by the sources identified above can be summarized as: "there is an ever increasing number of undocumented raw file formats". The final paragraph in "The RAW Flaw" on The Luminous Landscape website is:^[31]

"Finally, consider the problems of digital asset management and the cataloging of files. ... The various asset management programs can't hope to keep up with the ever increasing number of proprietary formats. And as time passes and these programs are enhanced, what are the chances that they will still be able to read your older RAW files?"

And it summarizes the solution as:

"The Solution? There really is only one solution – the adoption by the camera industry of...

A. Public documentation of RAW formats; past, present and future

or, more likely...

B. Adoption of a universal RAW format"

Stance from launch, April 2005

From April 2005, OpenRAW did not acknowledge the need to avoid the ever increasing number of proprietary formats, and did not pursue the idea of a "universal RAW format". The OpenRAW version of "The RAW Flaw" ^[40] is a subset of the Luminous Landscape version. It omits that entire final paragraph, and also the words "or, more likely...". Another article "The RAW Problem" at OpenRAW confirms this:^[41]

"We want camera manufacturers to publicly document their RAW image formats - past, present, and future. ... Many have suggested (and Adobe has created) a common, open file format for RAW image files for all camera makers to use as a solution to the RAW problem. A common, openly documented RAW format would fulfill many of the goals of OpenRAW, but is likely to face significant resistance from manufacturers who feel their "creativity" and ability to innovate would be constrained. Open documentation of all RAW file formats by manufacturers is the quickest and most satisfactory way for OpenRAW's goals to be reached."

The phrase "(and Adobe has created)" above refers to Adobe's DNG (Digital Negative Format), launched 7 months before OpenRAW. DNG was designed (among other things) as an archival raw image format and has a published specification.

Stance from April 2006

From April 2006, OpenRAW's stance was explicitly opposed to DNG. The words "(and Adobe has created)" disappeared from "The RAW Problem", removing the acknowledgment that Adobe had created such a file format.^[42] An article "Notes on the future of Open RAW formats, and a look at DNG" said "DNG is not the answer".^[43] Opposition was present in the forum.^[44] In an interview, a founder of OpenRAW said "No, DNG is unfortunately not a solution."^[45]

Instead of seeking synergy between its aims and those of DNG,^[46][47] OpenRAW limited itself to seeking specifications for proprietary file formats. This stance continued as DNG became better established while camera makers showed no signs of publishing documentation for their raw file formats.

Status in 2011

Status of OpenRAW initiative

The OpenRAW Mailing List was closed to new members in April 2006.^[48]

The OpenRAW website became inactive in August 2009, but the last post was a year earlier.^[49] By May 2011 that home page was moved to preserve it,^[1] and a new home page summarized the history of OpenRAW.^[6] It says:

"While the final goal of "Open Documentation" has not yet been reached, the OpenRAW initiative and the survey results have triggered the ongoing development of an "Open" RAW standard which is in the final stages of becoming a reality."

"OpenRAW had a lot of impact on the world of photography and it continues to aim at improving the situation for photographers and their photographs for years to come."

OpenRAW has a page on Facebook, created by a supporter rather than one of the founding team.^[50]

Status of cameras and camera makers

Niche and some smaller camera makers use DNG as a raw image format, and so conform to OpenRAW's requirement. However they do so by using this openly documented non-proprietary format rather than by using their own proprietary formats and openly documenting them. So they are helping to solve both parts of the "ever increasing number of proprietary formats" problem identified in "The RAW Flaw".^[31]

The larger camera makers, such as Canon, Nikon, Olympus, and Sony, continue to use raw image formats that are not openly documented, and so still cause the problems identified by OpenRAW. A variety of DNG Converters enables the undocumented proprietary formats used by the larger camera makers to be converted to DNG, but this is less satisfactory than the approach of the smaller camera makers.

Professional image archivists and conservationists

Increasingly, professional archivists and conservationists, working for respectable organizations, variously suggest or recommend DNG for archival purposes.^{[51][52][53][54][55][56][57][58][59][60][61]}

References

1. ^ ^{a b c} "Original OpenRAW website". http://www.openraw.org/index-old.html. 
2. ^ ^{a b} "Individuals supporting OpenRAW". http://www.openraw.org/forum/1/index.html. 
3. ^ ^{a b c} "Software Companies & Developers supporting OpenRAW". http://www.openraw.org/supporters/developers/index.html. 
4. ^ ^{a b c} "Organizations supporting OpenRAW". http://www.openraw.org/supporters/organizations/index.html. 
5. ^ ^{a b} Juergen Specht. "Juergen Specht - Photographs: Photos by a German Photographer living in Tokyo, Japan". http://www.juergenspecht.com/. 
6. ^ ^{a b c d} "Welcome to OpenRAW (latest home page)". http://www.openraw.org/. 
7. ^ Juergen Specht (2005-04-25). "For Immediate Release — OpenRAW Web Site Launched". http://www.openraw.org/press/release1/index.html. 
8. ^ ^{a b} Larry Strunk (2006-03-15). "About OpenRAW". http://www.openraw.org/about/index.html. 
9. ^ "OpenRAW launches website". http://www.dpreview.com/news/0504/05042501openraw_website.asp. 
10. ^ "OPENRAW Launches Web Site". http://photoshopnews.com/2005/04/23/openraw-launched-web-site/. 
11. ^ "Image Preservation Through Open Documentation". 2005-04-25. http://news.slashdot.org/story/05/04/25/1240219/image-preservation-through-open-documentation. 
12. ^ Declan McCullagh (2005-04-25). "Photographers ask camera makers to open up". http://www.zdnet.com/news/photographers-ask-camera-makers-to-open-up/142489. 
13. ^ ^{a b} Declan McCullagh (2005-04-25). "Photographers ask camera makers to open up". http://news.cnet.com/Photographers-ask-camera-makers-to-open-up/2100-1041_3-5683936.html. 
14. ^ "OpenRAW Web Site Launched". 2005-04-27. http://www.creativepro.com/node/56912. 
15. ^ Seb Chan (2005-05-02). "An open standard for the camera RAW format has just launched.". http://www.powerhousemuseum.com/dmsblog/index.php/2005/05/02/openraw/. 
16. ^ Andy Goetze (2005-06-21). "Leave Your Wife, Sign Up For OpenRAW". http://www.stockphototalk.com/phototalk/2005/07/sign_up_for_ope.html. 
17. ^ Andreas Donath (2005-04-26). "Freie Rohdaten von Digitalkameras: OpenRAW-Website eröffnet" (in German). http://www.golem.de/0504/37705.html. 
18. ^ "OpenRAW: Fotografen aller Länder, vereinigt Euch!" (in German). 2005-04-26. http://www.computerwoche.de/index.cfm?pid=254&pk=555954. 
19. ^ "OpenRAW fordert offengelegte RAW-Spezifikationen" (in German). 2005-04-25. http://www.photoscala.de/node/view/926?from=. 
20. ^ "OpenRAW (as a GIF)" (in Japanese). 2005-05-12. http://www.aivy.co.jp/BLOG_TEST/kobakoba/archives/002758.html. 
21. ^ Calvin Jones. "Calvin Jones Photography". http://www.ccjonesphotos.com/. 
22. ^ ^{a b} Michael Reichmann. "The Luminous Landscape". http://www.luminous-landscape.com/index.shtml. 
23. ^ Chris Rusbridge (2008-07-29). ""Digital Preservation" term considered harmful?". http://digitalcuration.blogspot.com/2008_07_01_archive.html. 
24. ^ ^{a b} Juergen Specht (2006-04-24). "Survey Press Release". http://www.openraw.org/press/release3/index.html. 
25. ^ Yasuo Takagi, Sony CS Center Service Quality Department (July 2006). "Sony responds to 2006 RAW Survey report". http://www.openraw.org/node/1530/index.html. 
26. ^ ^{a b} "Photographic Resources supporting OpenRAW". http://www.openraw.org/supporters/resources/index.html. 
27. ^ "The Original Survey Page (now nonfunctional)". http://www.openraw.org/2006rawsurvey/originalsurvey/index.html. 
28. ^ Calvin Jones (2006-04-25). "The 2006 RAW Survey". http://www.openraw.org/survey/. 
29. ^ Calvin Jones; Juergen Specht (2006-04-29). "2006 Raw Survey Results" (PDF). http://www.openraw.org/files/2006rawsurveyreport.pdf. 
30. ^ Juergen Specht; Calvin Jones. "OpenRAW home page". Archived from the original on 2006-04-02. http://web.archive.org/web/20060402213501/http://openraw.org/. 
31. ^ ^{a b c} "The RAW Flaw (at The Luminous Landscape)". May 2005. http://www.luminous-landscape.com/essays/raw-flaw.shtml. 
32. ^ "The RAW Flaw (at The Luminous Landscape)" (DOC). May 2005. http://www.luminous-landscape.com/TheRawFlaw.doc. 
33. ^ "The RAW Flaw (at The Luminous Landscape)" (PDF). May 2005. http://www.luminous-landscape.com/TheRawFlaw.pdf. 
34. ^ "RAW FLAW - PLEASE SUPPORT". 2005-05-25. http://www.av100fun.com/viewtopic.php?t=5782&sid=d58e7414efb04ed724cc7dd5faad2cc7. 
35. ^ Volker Gilbert (2005-05-23). "OpenRaw lance une campagne pour le RAW libre" (in French and English). http://volker.canalblog.com/archives/2005/05/23/521915.html. 
36. ^ "Lo malo del RAW" (in Spanish). 2006-06-01. http://www.caborian.com/20050601/lo-malo-del-raw/. 
37. ^ "El problema del Raw" (in Spanish). 2005-05-24. http://www.caborian.com/20050524/el-problema-del-raw/. 
38. ^ "Open RAW - skriv til din kamerafabrikant" (in Danish and English). 2005-05-25. http://www.pressefotografforbundet.dk/teknik/index.php?id=1766&action=info. 
39. ^ "OpenRAW - Act now! Petizione per un formato RAW libero!" (in Italian). 2005-05-25. http://www.photorevolt.com/news_id_835.html. 
40. ^ "The RAW Flaw (at OpenRAW)". May 2005. http://www.openraw.org/actnow/. 
41. ^ "The RAW Problem". Archived from the original on 2006-02-20. http://web.archive.org/web/20060220165818/http://www.openraw.org/info/. 
42. ^ "The RAW Problem". Archived from the original on 2006-04-11. http://web.archive.org/web/20060411194520/http://www.openraw.org/info/%23solution. 
43. ^ Stuart Nixon (2006-04-03). "Notes on the future of Open RAW formats, and a look at DNG". Archived from the original on 2006-04-21. http://web.archive.org/web/20060421030226/http://www.openraw.org/node/1482. 
44. ^ (various) (2007-02-03). "Converting current RAW images to Open RAW". http://www.openraw.org/node/1548/. 
45. ^ Javier García Diz. "RAW format, the captive photo". http://javiergarciadiz.blogspot.com/2011/07/raw-format-captive-photo.html. 
46. ^ vivosz (2007-10-23). "On workflows, openRaw and DNG". http://photobuntu.wordpress.com/2007/10/23/on-workflows-openraw-and-dng/. 
47. ^ Abhay Sharma, PhD (November 2006). "Digital Photos (see end)". Archived from the original on 2006-12-06. http://web.archive.org/web/20061206143053/http://www.gammag.com/BackIssues/artbgam0611.featphotos. 
48. ^ Juergen Specht (2006-04-02). "OpenRAW Mailing List". http://www.openraw.org/lists/index.html. 
49. ^ "OpenRAW home page". Archived from the original on 2010-02-08. http://web.archive.org/web/20100208232200/http://www.openraw.org/. 
50. ^ "OpenRAW on Facebook". http://www.facebook.com/pages/OpenRaw/107508059273330. 
51. ^ Planning for US Library of Congress Collections: Preferences in Summary
52. ^ dpBestflow: Raw File Formats
53. ^ universal photographic digital imaging guidelines (UPDIG): File formats - the raw file issue
54. ^ Archaeology Data Service / Digital Antiquity: Guides to Good Practice - Section 3 Archiving Raster Images - File Formats
55. ^ University of Connecticut: "Raw as Archival Still Image Format: A Consideration" by Michael J. Bennett and F. Barry Wheeler
56. ^ Inter-University Consortium for Political and Social Research: Obsolescence - File Formats and Software
57. ^ JISC Digital Media - Still Images: Choosing a File Format for Digital Still Images - File formats for master archive
58. ^ International Digital Enterprise Alliance, Digital Image Submission Criteria (DISC) Guidelines & Specifications 2007 (PDF)
59. ^ The J. Paul Getty Museum - Department of Photographs: Rapid Capture Backlog Project - Presentation
60. ^ American Institute for Conservation - Electronic Media Group: Digital Image File Formats
61. ^ Archives Association of British Columbia: Born Digital Photographs: Acquisition and Preservation Strategies (Rosaleen Hill)