World Library  
Flag as Inappropriate
Email this Article


Article Id: WHEBN0000185224
Reproduction Date:

Title: Mpeg-7  
Author: World Heritage Encyclopedia
Language: English
Subject: Description Definition Language, Color layout descriptor, Metadata standards, MPEG-4, AudioID
Collection: Container Formats, Metadata Standards, Mpeg
Publisher: World Heritage Encyclopedia


MPEG-7 is a ISO/IEC 15938 (Multimedia content description interface).[1][2][3][4] This description will be associated with the content itself, to allow fast and efficient searching for material that is of interest to the user. MPEG-7 is formally called Multimedia Content Description Interface. Thus, it is not a standard which deals with the actual encoding of moving pictures and audio, like MPEG-1, MPEG-2 and MPEG-4. It uses XML to store metadata, and can be attached to timecode in order to tag particular events, or synchronise lyrics to a song, for example.

It was designed to standardize:

  • a set of Description Schemes ("DS") and Descriptors ("D")
  • a language to specify these schemes, called the Description Definition Language ("DDL")
  • a scheme for coding the description

The combination of MPEG-4 and MPEG-7 has been sometimes referred to as MPEG-47.[5]


  • Introduction 1
  • Parts 2
  • Relation between description and content 3
  • MPEG-7 tools 4
  • MPEG-7 applications 5
  • Software and demonstrators for MPEG-7 6
  • See also 7
  • Compare 8
  • References 9
  • External links 10


MPEG-7 is intended to provide complementary functionality to the previous MPEG standards, representing information about the content, not the content itself ("the bits about the bits"). This functionality is the standardization of multimedia content descriptions. MPEG-7 can be used independently of the other MPEG standards - the description might even be attached to an analog movie. The representation that is defined within MPEG-4, i.e. the representation of audio-visual data in terms of objects, is however very well suited to what will be built on the MPEG-7 standard. This representation is basic to the process of categorization. In addition, MPEG-7 descriptions could be used to improve the functionality of previous MPEG standards.With these tools, we can build an MPEG-7 Description and deploy it. According to the requirements document,1 “a Description consists of a Description Scheme (structure) and the set of Descriptor Values (instantiations) that describe the Data.” A Descriptor Value is “an instantiation of a Descriptor for a given data set (or subset thereof).” The Descriptor is the syntatic and semantic definition of the content. extraction algorithms are inside the scope of the standard because their standardization isn’t required to allow interoperability.


The MPEG-7 (ISO/IEC 15938) consists of different Parts. Each part covers a certain aspect of the whole specification.

MPEG-7 Parts[4][6]
Part Number First public release date (First edition) Latest public release date (edition) Latest amendment Title Description
Part 1 ISO/IEC 15938-1 2002 2002 2006 Systems the architectural framework of MPEG-7, the carriage of MPEG-7 content - TeM (Textual format for MPEG-7) and the binary format for MPEG-7 descriptions (BiM)[7]
Part 2 ISO/IEC 15938-2 2002 2002 Description definition language
Part 3 ISO/IEC 15938-3 2002 2002 2010 Visual
Part 4 ISO/IEC 15938-4 2002 2002 2006 Audio
Part 5 ISO/IEC 15938-5 2003 2003 2008 Multimedia description schemes
Part 6 ISO/IEC 15938-6 2003 2003 2010 (2011) Reference software
Part 7 ISO/IEC 15938-7 2003 2003 2010 (2011) Conformance testing
Part 8 ISO/IEC TR 15938-8 2002 2002 2010 Extraction and use of MPEG-7 descriptions
Part 9 ISO/IEC 15938-9 2005 2005 (2011) Profiles and levels
Part 10 ISO/IEC 15938-10 2005 2005 Schema definition
Part 11 ISO/IEC TR 15938-11 2005 2005 MPEG-7 profile schemas
Part 12 ISO/IEC 15938-12 2008 2008 (2011) Query format

Relation between description and content

Independence between description and content

An MPEG-7 architecture requirement is that description must be separate from the audiovisual content.

On the other hand there must be a relation between the content and description. Thus the description is multiplexed with the content itself.

On the right side you can see this relation between description and content.

MPEG-7 tools

Relation between different tools and elaboration process of MPEG-7

MPEG-7 uses the following tools:

  • Descriptor (D): It is a representation of a feature defined syntactically and semantically. It could be that a unique object was described by several descriptors.
  • Description Schemes (DS): Specify the structure and semantics of the relations between its components, these components can be descriptors (D) or description schemes (DS).
  • Description Definition Language (DDL): It is based on XML language used to define the structural relations between descriptors. It allows the creation and modification of description schemes and also the creation of new descriptors (D).
  • System tools: These tools deal with binarization, synchronization, transport and storage of descriptors. It also deals with Intellectual Property protection.

On the right side you can see the relation between MPEG-7 tools.

MPEG-7 applications

There are many applications and application domains which will benefit from the MPEG-7 standard. A few application examples are:

  • Digital library: Image/video catalogue, musical dictionary.
  • Multimedia directory services: e.g. yellow pages.
  • Broadcast media selection: Radio channel, TV channel.
  • Multimedia editing: Personalized electronic news service, media authoring.
  • Security services: Traffic control, production chains...
  • E-business: Searching process of products.
  • Cultural services: Art-galleries, museums...
  • Educational applications.
  • Biomedical applications.

Software and demonstrators for MPEG-7

  • Caliph & Emir: Annotation and retrieval of images based on MPEG-7 (GPL). Creates MPEG-7 XML files.[8]
  • C# Implementation: Open Source implementation of the MPEG-7 descriptors in C#.
  • Frameline 47 Video Notation: Frameline 47 from Versatile Delivery Systems. The first commercial MPEG-7 application, Frameline 47 uses an advanced content schema based on MPEG-7 so as to be able to notate entire video files, or segments and groups of segments from within that video file according to the MPEG-7 convention (commercial tool)
  • Eptascape ADS200 uses a real-time MPEG 7 encoder on an analog camera video signal to identify interesting events, especially in surveillance applications, check the demos to see MPEG-7 in action (commercial tool)
  • IBM VideoAnnEx Annotation Tool: Creating MPEG-7 documents for video streams describing structure and giving keywords from a controlled vocabulary (binary release, restrictive license)
  • iFinder Medienanalyse- und Retrievalsystem: Metadata extraction and search engine based on MPEG-7 (commercial tool)
  • MPEG-7 Audio Encoder: Creating MPEG-7 documents for audio documents describing low level audio characteristics (binary & source release, Java, GPL)
  • MPEG-7 Visual Descriptor Extraction: Software to extract MPEG-7 visual descriptors from images and image regions.
  • XM Feature Extraction Web Service: The functionalities of the eXperimentation Model(XM) are made available via web service interface to enable automatic MPEG-7 low-level visual description characterization of images.
  • TU Berlin MPEG-7 Audio Analyzer (Web-Demo): Creating MPEG-7 documents (XML) for audio documents (WAV, MP3). All 17 MPEG-7 low level audio descriptors are implemented (commercial)
  • TU Berlin MPEG-7 Spoken Content Demonstrator (Web-Demo): Creating MPEG-7 documents (XML) with SpokenContent description from an input speech signal (WAV, MP3) (commercial)
  • MP7JRS C++ Library Complete MPEG-7 implementation of part 3, 4 and 5 (visual, audio and MDS) by Joanneum Research Institute for Information and Communication Technologies - Audiovisual Media Group.
  • BilVideo-7: MPEG-7 compatible, distributed video indexing and retrieval system, supporting complex, multimodal, composite queries; developed by Bilkent University Multimedia Database Group (BILMDG).
  • UniSay: Sophisticated Post-production file analysis and audio processing based on MPEG-7.

See also



  • B.S. Manjunath (Editor), Philippe Salembier (Editor), and Thomas Sikora (Editor): Introduction to MPEG-7: Multimedia Content Description Interface. Wiley & Sons, April 2002 - ISBN 0-471-48678-7
  • Harald Kosch: Distributed Multimedia Database Technologies Supported by MPEG-7 and MPEG-21. CRC Press, January 2004 - ISBN 0-8493-1854-8
  • Giorgos Stamou (Editor) and Stefanos Kollias (Editor): Multimedia Content and the Semantic Web: Standards, Methods and Tools. Wiley & Sons, May 2005 - ISBN 0-470-85753-6
  • Hyoung-Gook Kim, Nicolas Moreau, and Thomas Sikora: MPEG-7 Audio and Beyond: Audio Content Indexing and Retrieval. Wiley & Sons, October 2005 - ISBN 0-470-09334-X
  1. ^ ISO. "ISO/IEC 15938-1:2002 - Information technology -- Multimedia content description interface -- Part 1: Systems". Retrieved 2009-10-31. 
  2. ^ MPEG. "About MPEG - Achievements". Archived from the original on July 8, 2008. Retrieved 2009-10-31. 
  3. ^ MPEG. "Terms of Reference". Archived from the original on February 21, 2010. Retrieved 2009-10-31. 
  4. ^ a b MPEG. "MPEG standards - Full list of standards developed or under development". Archived from the original on April 20, 2010. Retrieved 2009-10-31. 
  5. ^ NetworkDictionary. "Complete Protocol dictionary, glossary and reference - M". Retrieved 2009-12-26. 
  6. ^ ISO/IEC JTC 1/SC 29 (2009-10-30). "MPEG-7 (Multimedia content description interface)". Retrieved 2009-11-10. 
  7. ^ ISO/IEC JTC1/SC29/WG11 (October 2004). "MPEG-7 Overview (version 10)". Retrieved 2009-11-01. 
  8. ^ Lux, Mathias. "Caliph & Emir: MPEG-7 photo annotation and retrieval." Proceedings of the 17th ACM international conference on Multimedia. ACM, 2009.

External links

  • MPEG-7 Overview
  • MPEG-7 Resources
  • MPEG-7/-21 Community Portal
This article was sourced from Creative Commons Attribution-ShareAlike License; additional terms may apply. World Heritage Encyclopedia content is assembled from numerous content providers, Open Access Publishing, and in compliance with The Fair Access to Science and Technology Research Act (FASTR), Wikimedia Foundation, Inc., Public Library of Science, The Encyclopedia of Life, Open Book Publishers (OBP), PubMed, U.S. National Library of Medicine, National Center for Biotechnology Information, U.S. National Library of Medicine, National Institutes of Health (NIH), U.S. Department of Health & Human Services, and, which sources content from all federal, state, local, tribal, and territorial government publication portals (.gov, .mil, .edu). Funding for and content contributors is made possible from the U.S. Congress, E-Government Act of 2002.
Crowd sourced content that is contributed to World Heritage Encyclopedia is peer reviewed and edited by our editorial staff to ensure quality scholarly research articles.
By using this site, you agree to the Terms of Use and Privacy Policy. World Heritage Encyclopedia™ is a registered trademark of the World Public Library Association, a non-profit organization.

Copyright © World Library Foundation. All rights reserved. eBooks from Hawaii eBook Library are sponsored by the World Library Foundation,
a 501c(4) Member's Support Non-Profit Organization, and is NOT affiliated with any governmental agency or department.