Example use case: find paintings of a similar style

KLIMT, Gustav
Portrait of Adele Bloch-Bauer I
1907
Oil and gold on canvas
138 x 138 cm
Austrian Gallery, Vienna

How can we find this other ‘Art nouveau’ painting?

MUNCH, Edvard
The Scream
1893
Oil, tempera and pastel on cardboard
91 x 73.5 cm
National Gallery, Oslo

MultimediaN Application Pilot e-Culture

• Partners: ICN, DEN, UvA, VU, CWI
• Improve "in context" search and presentation of search results by
  • Linking multiple collections
  • Reusing existing background knowledge (rich domain!)
• Current status:
  • Collections: Rijksmuseum A'dam (750), Artchive.com (3000), Rijksmuseum Volkenkunde (250.000), ...
  • Thesauri: Getty AAT, TGN, ULAN; SVCN, WordNet, ...
  • In total about 10 million RDF statements

Current demo

http://e-culture.multimedian.nl/

Architecture of the demonstrator

• Open Web standards
  • XML, XHTML, SVG, RDF/OWL, SPARQL
• SWI-Prolog’s semantic web package
  • SPARQL interface, RDF/OWL partial reasoning
• AJAX for rich Web client interaction
  • Semantic keyword suggestion
  • Dynamic tree browser for structured taxonomies
• Java applets for other interaction types
  • Picture point: annotating image content

Issues

• Parse annotation to find matches with thesauri terms
  • E.g. match artists to ULAN individuals
• Artists-style links
  • AAT contains styles; ULAN contains artists, but there is no link
    • Learn link from corpora
    • Derive it from other annotations
  • Domain-specific rules/reasoning needed
    • see example in SWRL doc
    • Painters may have painted in multiple styles

Future directions

• User testing: Domain Experts & General public
• More collections & thesauri
• New search paradigms (relation search)