欢迎您访问程序员文章站本站旨在为大家提供分享程序员计算机编程知识!
您现在的位置是: 首页

[转]tika支持的文件格式

程序员文章站 2024-01-18 14:46:16
...

Supported Document Formats

This page lists all the document formats supported by the parsers in Apache Tika 1.13. Follow the links to the various parser class javadocs for more detailed information about each document format and how it is parsed by Tika.

Please note that Apache Tika is able to detect a much wider range of formats than those listed below, this page only documents those formats from which Tika is able to extract metadata and/or textual content.

HyperText Markup Language

The HyperText Markup Language (HTML) is the lingua franca of the web. Tika uses the TagSouplibrary to support virtually any kind of HTML found on the web. The output from the HtmlParserclass is guaranteed to be well-formed and valid XHTML, and various heuristics are used to prevent things like inline scripts from cluttering the extracted text content.

XML and derived formats

The Extensible Markup Language (XML) format is a generic format that can be used for all kinds of content. Tika has custom parsers for some widely used XML vocabularies like XHTML, OOXML and ODF, but the default DcXMLParser class simply extracts the text content of the document and ignores any XML structure. The only exception to this rule are Dublin Core metadata elements that are used for the document metadata.

Microsoft Office document formats

Microsoft Office and some related applications produce documents in the generic OLE 2 Compound Document and Office Open XML (OOXML) formats. The older OLE 2 format was introduced in Microsoft Office version 97 and was the default format until Office version 2007 and the new XML-based OOXML format. The OfficeParser and OOXMLParser classes use Apache POI libraries to support text and metadata extraction from both OLE2 and OOXML documents.

Old, pre-OLE2 Excel files (Excel 2, 3 and 4) are handled by the OldExcelParser.

OpenDocument Format

The OpenDocument format (ODF) is used most notably as the default format of the OpenOffice.org office suite. The OpenDocumentParser class supports this format and the earlier OpenOffice 1.0 format on which ODF is based.

iWorks document formats

The various iWorks document formats (Numbers, Pages, Keynote) are supported by theIWorkPackageParser class, which extracts text and metadata.

Portable Document Format

The PDFParser class parsers Portable Document Format (PDF) documents using the Apache PDFBoxlibrary.

Electronic Publication Format

The EpubParser class supports the Electronic Publication Format (EPUB) used for many digital books.

The FictionBookParser class supports the xml-based Fiction Book publishing format.

Rich Text Format

The RTFParser class uses the standard javax.swing.text.rtf feature to extract text content from Rich Text Format (RTF) documents.

Compression and packaging formats

Tika uses the Commons Compress library to support various compression and packaging formats. TheCompressorParser class handles parsing of the top level compression formats, then PackageParserclass and its subclasses parse the packaging formats and then pass the unpacked document streams to a second parsing stage using the parser instance specified in the parse context. Formats supported include Tar, AR, CPIO, Zip, 7Zip, Gzip, BZip2, XZ and Pack200.

Additionally, the RARParser class supports the RAR archive format, which isn't supported by Commons Compress.

Text formats

Extracting text content from plain text files seems like a simple task until you start thinking of all the possible character encodings. The TXTParser class uses encoding detection code from theICU project to automatically detect the character encoding of a text document.

Feed and Syndication formats

The FeedParser class supports the RSS and Atom feed syndication formats.

The IptcAnpaParser class supports the IPTC ANPA News Wire feed format.

Help formats

The ChmParser class supports the CHM Help format.

Audio formats

Tika can detect several common audio formats and extract metadata from them. Even text extraction is supported for some audio files that contain lyrics or other textual content. Extracted metadata includes sampling rates, channels, format information, artists, titles etc. The AudioParser andMidiParser classes use standard javax.sound features to process simple audio formats. The Mp3Parserclass adds support for the widely used MP3 format, and the MP4Parser class provides it for MP4 audio. The Ogg family of audio formats (Vorbis, Speex, Opus, Flac etc) are supported by theVorbisParserOpusParserSpeexParser and FlacParser classes.

Image formats

The ImageParser class uses the standard javax.imageio feature to extract simple metadata from image formats supported by the Java platform, such as PNG, GIF and BMP. More complex image metadata is available through the JpegParser class and TiffParser classes that uses the metadata-extractor library to supports Exif metadata extraction from Jpeg and Tiff images. The PSDParser class extracts metadata from PSD images. The BPGParser class extracts simple metadata from BPG (Better Portable Graphics) images. The WebPParser class extracts simple metadata from WebP image format. The ICNSParser class extracts simple metadata from the Apple ICNS icon image format.

When extracting from images, it is also possible to chain in Tesseract via the TesseractOCRParserto have OCR performed on the contents of the image.

Video formats

Tika supports the Flash video format using a simple parsing algorithm implemented in the FLVParserclass.

The MP4 family of video formats (MP4, Quicktime, 3GPP etc) is supported by the MP4Parser class, which extracts metadata on the video, along with audio stream (if present).

For the Ogg family of video formats, a limited amount of metadata is extracted by the OggParserclass. There is also an experimental TheoraParser class which extracts only limited metadata, pending a consensus on the "right" way to return metadata for audio streams along with the video metadata.

As an alternative to the metadata-focused parsers above, the PooledTimeSeriesParser can be used (if the required tool is installed) to generate a numeric representation of the video suitable for similarity searches. More details on this approach, and setup instructions for the parser + tool, can be found on the Tika wiki page for the parser.

Java class files and archives

The ClassParser class extracts class names and method signatures from Java class files, and theZipParser class supports also jar archives.

Source code

The SourceCodeParser class handles a number of source code formats, including Java, C, C++ and Groovy. It provides a formatted form of the code, along with some simple metadata.

Mail formats

The MboxParser can extract email messages from the mbox format used by many email archives and Unix-style mailboxes.

The RFC822Parser can process single email messages in the RFC 822 format used by many email clients in their archives / exports.

The OutlookPSTParser can extract email messages from the Microsoft Outlook PST email format.

The OutlookExtractor (part of OfficeParser) is able to extract email messages from the Microsoft Outlook MSG email format.

The TNEFParser can extract email attachments from the Microsoft TNEF (Transport Neutral Encoding Format, aka Winmail.dat) used with some Microsoft email clients.

CAD formats

The DWGParser can extract simple metadata from the DWG CAD format.

Font formats

The TrueTypeParser class can extract simple metadata from the TrueType font format. TheAdobeFontMetricParser class does something similar for Adobe Font Metrics files.

Scientific formats

The DIFParser is able to extract attribute metadata from the GCMD Directory Interchange Format (DIF) scientific file format.

The GDALParser is able to extract attribute metadata from the GDAL scientific file format.

The GeographicInformationParser is able to extract attribute metadata from the ISO-19139 georgraphic information file format.

The GeoParser is makes use of a pre-built collection of a geographic gazetteer, to resolve geographic entities into their positions into the metadata

The GribParser is able to extract attribute metadata from the Grib scientific file format.

The HDFParser is able to extract attribute metadata from the HDF scientific file format.

The ISArchiveParser is able to extract attribute metadata from the ISA-Tab (ISA Tools) family of scientific file formats.

The NetCDFParser is able to extract attribute metadata from the NetCDF scientific file format.

The MatParser is able to extract attribute metadata from the Matlab scientific file format.

Executable programs and libraries

The ExecutableParser can extract metadata information on platforms, architectures and types from a range of executable formats and libraries, such as Windows Executables and Linux / BSD programs and libraries.

Crypto formats

The Pkcs7Parser is able to parse the contents of PKCS7 signed messages, but doesn't include any information from the outer PKCS7 wrapper.

Database formats

The SQLite3Parser is able to extract content from SQLite3 files, in a tabular form. However, it requires that the is manually added to the classpath first, as that binary jar isn't shipped as standard.

The JackcessParser is able to extract metadata and content in a tabular form, from Microsoft Access database files.

Full list of Supported Formats

  • org.apache.tika.parser.asm.ClassParser
    • application/java-vm
  • org.apache.tika.parser.audio.AudioParser
    • audio/x-wav
    • audio/basic
    • audio/x-aiff
  • org.apache.tika.parser.audio.MidiParser
    • application/x-midi
    • audio/midi
  • org.apache.tika.parser.chm.ChmParser
    • application/vnd.ms-htmlhelp
    • application/x-chm
    • application/chm
  • org.apache.tika.parser.code.SourceCodeParser
    • text/x-c++src
    • text/x-groovy
    • text/x-java-source
  • org.apache.tika.parser.crypto.Pkcs7Parser
    • application/pkcs7-signature
    • application/pkcs7-mime
  • org.apache.tika.parser.dif.DIFParser
    • application/dif+xml
  • org.apache.tika.parser.dwg.DWGParser
    • image/vnd.dwg
  • org.apache.tika.parser.epub.EpubParser
    • application/x-ibooks+zip
    • application/epub+zip
  • org.apache.tika.parser.executable.ExecutableParser
    • application/x-msdownload
    • application/x-sharedlib
    • application/x-elf
    • application/x-object
    • application/x-executable
    • application/x-coredump
  • org.apache.tika.parser.external.ExternalParser
    • video/avi
    • video/mpeg
    • video/x-msvideo
  • org.apache.tika.parser.feed.FeedParser
    • application/atom+xml
    • application/rss+xml
  • org.apache.tika.parser.font.AdobeFontMetricParser
    • application/x-font-adobe-metric
  • org.apache.tika.parser.font.TrueTypeParser
    • application/x-font-ttf
  • org.apache.tika.parser.gdal.GDALParser
    • application/x-gsc
    • image/x-ozi
    • application/x-pds
    • image/eir
    • application/x-usgs-dem
    • application/aaigrid
    • application/x-bag
    • application/elas
    • application/x-rs2
    • application/x-tsx
    • application/x-lcp
    • image/geotiff
    • application/x-mbtiles
    • application/x-cappi
    • application/x-netcdf
    • application/x-gsag
    • application/x-epsilon
    • application/x-ace2
    • application/jaxa-pal-sar
    • image/x-pcraster
    • application/x-msgn
    • image/arg
    • application/x-hdf
    • image/x-mff
    • application/x-kro
    • image/x-hdf5-image
    • image/x-dimap
    • image/x-srp
    • image/big-gif
    • application/x-envi
    • application/x-cosar
    • application/x-ntv2
    • image/bmp
    • application/x-doq2
    • application/x-bt
    • application/x-kml
    • application/x-gmt
    • application/x-rst
    • application/vrt
    • application/pcisdk
    • application/x-ctg
    • application/x-e00-grid
    • application/x-rik
    • image/ida
    • image/x-mff2
    • application/sdts-raster
    • application/x-snodas
    • image/jp2
    • image/sar-ceos
    • application/terragen
    • application/x-wcs
    • application/leveller
    • application/x-ingr
    • application/x-gtx
    • image/sgi
    • application/x-pnm
    • image/raster
    • application/fits
    • application/x-r
    • image/gif
    • application/x-envi-hdr
    • application/x-http
    • application/x-rmf
    • application/x-ecrg-toc
    • application/aig
    • application/x-rpf-toc
    • image/adrg
    • application/x-srtmhgt
    • application/x-generic-bin
    • application/jdem
    • image/x-airsar
    • application/x-webp
    • application/x-ngs-geoid
    • application/x-pcidsk
    • image/x-fujibas
    • application/x-wms
    • application/x-map
    • image/ceos
    • application/xpm
    • application/x-zmap
    • image/envisat
    • application/x-ers
    • application/x-doq1
    • application/x-isis2
    • application/x-nwt-grd
    • application/x-ppi
    • image/ilwis
    • application/x-isis3
    • application/x-nwt-grc
    • application/x-blx
    • application/gff
    • application/x-ndf
    • image/jpeg
    • application/x-geo-pdf
    • application/x-l1b
    • image/fit
    • application/x-gsbg
    • application/x-sdat
    • application/x-ctable2
    • application/x-grib
    • application/x-coasp
    • application/x-dipex
    • application/grass-ascii-grid
    • image/fits
    • application/x-til
    • application/x-dods
    • image/png
    • application/x-gxf
    • application/x-gs7bg
    • application/x-cpg
    • application/x-lan
    • application/x-xyz
    • image/bsb
    • application/x-p-aux
    • application/dted
    • application/x-rasterlite
    • image/nitf
    • image/hfa
    • application/x-fast
    • application/x-los-las
  • org.apache.tika.parser.geo.topic.GeoParser
    • application/geotopic
  • org.apache.tika.parser.geoinfo.GeographicInformationParser
    • text/iso19139+xml
  • org.apache.tika.parser.grib.GribParser
    • application/x-grib2
  • org.apache.tika.parser.hdf.HDFParser
    • application/x-hdf
  • org.apache.tika.parser.html.HtmlParser
    • text/html
    • application/vnd.wap.xhtml+xml
    • application/x-asp
    • application/xhtml+xml
  • org.apache.tika.parser.image.BPGParser
    • image/bpg
    • image/x-bpg
  • org.apache.tika.parser.image.ICNSParser
    • image/icns
  • org.apache.tika.parser.image.ImageParser
    • image/png
    • image/vnd.wap.wbmp
    • image/bmp
    • image/x-xcf
    • image/gif
    • image/x-icon
    • image/x-ms-bmp
  • org.apache.tika.parser.image.PSDParser
    • image/vnd.adobe.photoshop
  • org.apache.tika.parser.image.TiffParser
    • image/tiff
  • org.apache.tika.parser.image.WebPParser
    • image/webp
  • org.apache.tika.parser.iptc.IptcAnpaParser
    • text/vnd.iptc.anpa
  • org.apache.tika.parser.isatab.ISArchiveParser
    • application/x-isatab
  • org.apache.tika.parser.iwork.IWorkPackageParser
    • application/vnd.apple.keynote
    • application/vnd.apple.iwork
    • application/vnd.apple.numbers
    • application/vnd.apple.pages
  • org.apache.tika.parser.jpeg.JpegParser
    • image/jpeg
  • org.apache.tika.parser.mail.RFC822Parser
    • message/rfc822
  • org.apache.tika.parser.mat.MatParser
    • application/x-matlab-data
  • org.apache.tika.parser.mbox.MboxParser
    • application/mbox
  • org.apache.tika.parser.mbox.OutlookPSTParser
    • application/vnd.ms-outlook-pst
  • org.apache.tika.parser.microsoft.JackcessParser
    • application/x-msaccess
  • org.apache.tika.parser.microsoft.OfficeParser
    • application/x-tika-msoffice-embedded; format=ole10_native
    • application/msword
    • application/vnd.visio
    • application/vnd.ms-project
    • application/x-tika-msworks-spreadsheet
    • application/x-mspublisher
    • application/vnd.ms-powerpoint
    • application/x-tika-msoffice
    • application/sldworks
    • application/x-tika-ooxml-protected
    • application/vnd.ms-excel
    • application/vnd.ms-outlook
  • org.apache.tika.parser.microsoft.OldExcelParser
    • application/vnd.ms-excel.workspace.3
    • application/vnd.ms-excel.workspace.4
    • application/vnd.ms-excel.sheet.2
    • application/vnd.ms-excel.sheet.3
    • application/vnd.ms-excel.sheet.4
  • org.apache.tika.parser.microsoft.TNEFParser
    • application/vnd.ms-tnef
    • application/x-tnef
    • application/ms-tnef
  • org.apache.tika.parser.microsoft.ooxml.OOXMLParser
    • application/vnd.ms-word.document.macroenabled.12
    • application/vnd.ms-excel.addin.macroenabled.12
    • application/x-tika-ooxml
    • application/vnd.openxmlformats-officedocument.wordprocessingml.template
    • application/vnd.ms-powerpoint.addin.macroenabled.12
    • application/vnd.openxmlformats-officedocument.spreadsheetml.template
    • application/vnd.openxmlformats-officedocument.wordprocessingml.document
    • application/vnd.openxmlformats-officedocument.presentationml.template
    • application/vnd.ms-powerpoint.slideshow.macroenabled.12
    • application/vnd.openxmlformats-officedocument.presentationml.presentation
    • application/vnd.ms-powerpoint.presentation.macroenabled.12
    • application/vnd.openxmlformats-officedocument.spreadsheetml.sheet
    • application/vnd.openxmlformats-officedocument.presentationml.slideshow
    • application/vnd.ms-excel.template.macroenabled.12
    • application/vnd.ms-excel.sheet.macroenabled.12
    • application/vnd.ms-word.template.macroenabled.12
  • org.apache.tika.parser.mp3.Mp3Parser
    • audio/mpeg
  • org.apache.tika.parser.mp4.MP4Parser
    • video/x-m4v
    • application/mp4
    • video/3gpp
    • video/3gpp2
    • video/quicktime
    • audio/mp4
    • video/mp4
  • org.apache.tika.parser.netcdf.NetCDFParser
    • application/x-netcdf
  • org.apache.tika.parser.odf.OpenDocumentParser
    • application/x-vnd.oasis.opendocument.presentation
    • application/vnd.oasis.opendocument.chart
    • application/x-vnd.oasis.opendocument.text-web
    • application/x-vnd.oasis.opendocument.image
    • application/vnd.oasis.opendocument.graphics-template
    • application/vnd.oasis.opendocument.text-web
    • application/x-vnd.oasis.opendocument.spreadsheet-template
    • application/vnd.oasis.opendocument.spreadsheet-template
    • application/vnd.sun.xml.writer
    • application/x-vnd.oasis.opendocument.graphics-template
    • application/vnd.oasis.opendocument.graphics
    • application/vnd.oasis.opendocument.spreadsheet
    • application/x-vnd.oasis.opendocument.chart
    • application/x-vnd.oasis.opendocument.spreadsheet
    • application/vnd.oasis.opendocument.image
    • application/x-vnd.oasis.opendocument.text
    • application/x-vnd.oasis.opendocument.text-template
    • application/vnd.oasis.opendocument.formula-template
    • application/x-vnd.oasis.opendocument.formula
    • application/vnd.oasis.opendocument.image-template
    • application/x-vnd.oasis.opendocument.image-template
    • application/x-vnd.oasis.opendocument.presentation-template
    • application/vnd.oasis.opendocument.presentation-template
    • application/vnd.oasis.opendocument.text
    • application/vnd.oasis.opendocument.text-template
    • application/vnd.oasis.opendocument.chart-template
    • application/x-vnd.oasis.opendocument.chart-template
    • application/x-vnd.oasis.opendocument.formula-template
    • application/x-vnd.oasis.opendocument.text-master
    • application/vnd.oasis.opendocument.presentation
    • application/x-vnd.oasis.opendocument.graphics
    • application/vnd.oasis.opendocument.formula
    • application/vnd.oasis.opendocument.text-master
  • org.apache.tika.parser.pdf.PDFParser
    • application/pdf
  • org.apache.tika.parser.pkg.CompressorParser
    • application/zlib
    • application/x-gzip
    • application/x-bzip2
    • application/x-compress
    • application/x-java-pack200
    • application/gzip
    • application/x-bzip
    • application/x-xz
  • org.apache.tika.parser.pkg.PackageParser
    • application/x-tar
    • application/java-archive
    • application/x-archive
    • application/zip
    • application/x-cpio
    • application/x-tika-unix-dump
    • application/x-7z-compressed
  • org.apache.tika.parser.pkg.RarParser
    • application/x-rar-compressed
  • org.apache.tika.parser.rtf.RTFParser
    • application/rtf
  • org.apache.tika.parser.txt.TXTParser
    • text/plain
  • org.apache.tika.parser.video.FLVParser
    • video/x-flv
  • org.apache.tika.parser.xml.DcXMLParser
    • application/xml
    • image/svg+xml
  • org.apache.tika.parser.xml.FictionBookParser
    • application/x-fictionbook+xml
  • org.gagravarr.tika.FlacParser
    • audio/x-oggflac
    • audio/x-flac
  • org.gagravarr.tika.OggParser
    • audio/ogg
    • application/kate
    • application/ogg
    • video/daala
    • video/x-ogguvs
    • video/x-ogm
    • audio/x-oggpcm
    • video/ogg
    • video/x-dirac
    • video/x-oggrgb
    • video/x-oggyuv
  • org.gagravarr.tika.OpusParser
    • audio/opus
    • audio/ogg; codecs=opus
  • org.gagravarr.tika.SpeexParser
    • audio/ogg; codecs=speex
    • audio/speex
  • org.gagravarr.tika.TheoraParser
    • video/theora
  • org.gagravarr.tika.VorbisParser
    • audio/vorbis
相关标签: tika