Audiovisual media

The TIB AV-Portal

By developing the TIB AV Portal, TIB has created a customer- and demand-oriented platform for non-textual materials. The portal offers unrestricted access to high-quality scientific videos and computer visualisations, simulations, experiments, interviews as well as films and recordings of lectures and conferences from the fields of science and technology. TIB developed the portal in cooperation with the Semantic Web research group at the Hasso-Plattner-Institut (HPI). Key feature of the TIB AV Portal: it links the current state of the art of relevant multimedia retrieval methods with semantic analysis. The automatic video analysis of the TIB AV Portal includes not only structural analysis (scene recognition), but also text, audio and image analysis. Automatic indexing by the TIB AV Portal describes the videos at the segment level, enabling pinpoint searches to be made within videos. Videos in the TIB AV Portal are automatically indexed with terms from the Integrated Authority File (GND), which have a semantic relationship (synonyms, hypernyms, related terms, and so on) to each another. Based on the terms and their semantic relationships, the TIB AV Portal creates a semantic search that enhances traditional keyword-based search by expanding the search results and making them more precise. English-language videos in the TIB AV Portal are tagged using English identifiers, determined following the automated mapping of the GND terms onto other standard data (including DBpedia). Films are allocated a digital object identifier (DOI), which means they can be referenced clearly. Individual film segments are allocated a media fragment identifier (MFID), which enables the video to be de-referenced to the second, and cited.

Since 2016 the TIB publishes the authoritative and time-based, automatically generated metadata of films from the AV-Portal as linked open data. Current metadata is regularly made available for downloading in the standardised Resource Description Framework (RDF) model and under CC0 1.0 Universal at https://av.tib.eu/opendata.

Focus of development

  • Multimedia retrieval
  • Automatic indexing
  • Semantic search
  • Visual search
  • Linked data engineering and semantic applications

Range of services

  • Hosting
  • Indexing according to international standards
  • Development of innovative media-specific portals featuring automatic content-based indexing via text, speech and image recognition
  • Licensing, preferably under Open Access conditions
  • Registration of digital object identifiers (DOI) and media fragment identifiers (MFID)
  • Linked Open Data Service
  • Digital preservation
  • Provision of support to producers in publishing their media, including advice on technology, rights, metadata, digital preservation and DOI registration.

Contact

Margret Plank
Competence Centre for non-textual Materials

Phone: +49 511 762-4884