MiTAP

MiTAP, or Mitre Text and Audio Processing, is a computer system that tries to automatically gather, translate, organize, and present information "for monitoring infectious disease outbreaks and other global events." ^[1] It is also used in the FBI Investigative Data Warehouse.

Sources

"Multiple information sources in multiple languages are automatically captured, filtered, translated, summarized, and categorized"^[1]

It uses 'web sources, electronic mailing lists, newsgroups, news feeds, and audio-video data.'. The audio-video is automatically transcribed into text by the ViTAP system.^[1].

Guts

In 2002 it was reported to have used CyberTrans, the Alembic natural language analyzer, WebSumm summarizer, Lucene indexing, NewsBlaster from Columbia, Brill tagging, SOAP, HTML, NNTP, Perl, Unix scripts, and other tools. Upgrades to various components are planned.^[1]

Creators

It was created at the Mitre Corporation by Damianos and a team of other researchers, with public release in 2001.^[1][2]

Users

It is being used by the FBI as part of their Investigative Data Warehouse via DARPA's TIDES program.^[3] According to 2004 FBI email, MiTAP was running at San Diego State University, collecting only English language website news. It mentioned a plan to have FBI run its own version of MiTAP.^[4]

It has also been used by people in the Whitehouse, the Department of Homeland Security, the Pentagon,^[1] the American Red Cross, the United Nations, and the European Disaster Center ^[5]

Notes

1. ^ ^{a b c d e f} Damianos et al, AI Magazine, Vol 23, No 4
2. ^ Damianos et al, The MiTAP System..., 2004
3. ^ FBI, IDW System Security Plan, 2003, and Security Concept of Operations IDW, 2004
4. ^ EFF FOIA file, 2008 Apr 8, idw02. page 30 of linked pdf
5. ^ Damianos et al. AI Magazine, Vol 23, No 4

Bibliography

• Damianos, Laurie, and Jay Ponte, Steve Wohlever, Florence Reeder, David Day, George Wilson and Lynette Hirschman (2002). "MiTAP for Biosecurity: A Case Study". AI Magazine 23 (4). doi:10.1609/aimag.v23i4.1666. http://www.aaai.org/ojs/index.php/aimagazine/article/view/1666/1564. 

• Damianos, Laurie, and Jay Ponte, Steve Wohlever, Florence Reeder, David Day, George Wilson and Lynette Hirschman (2002). "MiTAP, Text and Audio Processing for Bio-Security: A Case Study". AAAI-02 Proceedings. American Association for Artificial Intelligence. http://www.aaai.org/Papers/IAAI/2002/IAAI02-121.pdf. Retrieved 2009 3 17. 

• Damianos, Laurie. Guido Zareella, and Lynette Hirschman (2004 Aug). "The MiTAP System for Monitoring Reports of Disease Outbreak". Mitre Corporation. http://www.mitre.org/work/tech_papers/tech_papers_04/04_0804/. Retrieved 2009 3 17. 

• FBI Information Resources Division, Data and Information Management Section (2003-12-03). "Investigative Data Warehouse Integration System (IDW-I) System Security Plan". Electronic Frontier Foundation. p. Page 58 of linked PDF. http://www.eff.org/files/filenode/foia_idw/20090609_idw04.pdf. Retrieved 2009 3 17. 

• FBI Office of the Program Management Executive (2004-11-29). "Security Concept of Operations (S-CONOPS), Investigative Data Warehouse (IDW) Program". Electronic Frontier Foundation. p. Page 50 of linked PDF. http://www.eff.org/files/filenode/foia_idw/20090609_idw04.pdf. Retrieved 2009 3 17. 

• "EFF Freedom of Information Act (FOIA) files, 2008 April 8, idw02". Electronic Frontier Foundation. http://www.eff.org/files/filenode/foia_idw/20080408_idw02.pdf. Retrieved 2009 3 17.  (Contains various emails from inside the FBI regarding the IDW)