Previous slide Next slide Toggle fullscreen Open presenter view
Linked Open Usable Data for Cultural Heritage
Perspectives on Community Practices and Semantic Interoperability
PhD Thesis - https://phd.julsraemy.ch - supervised by:
Peter Fornaro (University of Basel)
Walter Leimgruber (University of Basel)
Robert Sanderson (Yale University)
Julien A. Raemy | Linked Art at PIA
PIA
Julien A. Raemy | Linked Art at PIA
PIA Teams
Cultural Anthropology : Institute for Cultural Anthropology and European Ethnology, University of Basel
Technology : Digital Humanities Lab, University of Basel
Design : Bern Academy of the Arts, Bern University of Applied Sciences
Project Website
Julien A. Raemy | Linked Art at PIA
Collections of the Swiss Society for Fokflore Studies (SSFS) within PIA
SGV_05 Atlas der Schweizerischen Volkskunde - Cartography
SGV_10 Familie Kreis - Vernacular Photography
SGV_12 Ernst Brunner - Photojournalism
https://archiv.sgv-sstp.ch
Julien A. Raemy | Linked Art at PIA
Linked Art
Julien A. Raemy | Linked Art at PIA
Linked Art
Linked Art is a community collaborating to define a metadata application profile (the model) for describing cultural heritage, and the technical means for conveniently interacting with it (the API).
https://linked.art
Julien A. Raemy | Linked Art at PIA
Extensive Definition
Linked Art is an RDF profile of the CIDOC-CRM that uses JSON-LD and the Getty Vocabularies to describe object-based cultural heritage in an event-based framework for consumption by software applications. It uses a subset of classes from the CIDOC-CRM ontology along with other commonly-used RDF ontologies to provide interoperable patterns and models that can be interpreted either as JSON or as RDF.
Newbury 2018
Julien A. Raemy | Linked Art at PIA
Linked Art Model Fundamentals
Level
Linked Art
Model
CIDOC Conceptual Reference Model (CRM)
Ontology
RDF encoding of CRM 7.1, plus extensions
Vocabulary
Getty Vocabularies (mainly AAT)
Profile
Object-based cultural heritage (mainly art museum oriented)
API
JSON-LD, following REST and web patterns
Julien A. Raemy | Linked Art at PIA
Model Components
Basic Patterns, Object, People and Organizations, Places, Digital Integration, Provenance of Objects, Collections and Sets, Exhibitions of Objects, Primary Sources of Information, Assertion level metadata, Dataset level metadata
JSON-LD, Shared Constructs, Entity Endpoints, JSON Schema, Ecosystem Endpoints, Class Reference
Julien A. Raemy | Linked Art at PIA
Linked Art API Endpoints (1)
Concepts
- Types, Materials, Languages, and others, as full records rather than external references
Digital Objects
- Images, services and other digital objects
Events - Events and other non-specific activities that are related but not part of other entities
Groups
- Groups and Organizations
People
- People
Physical Objects
- Physical things, including artworks, buildings or other architecture, books, parts of objects, and more
Julien A. Raemy | Linked Art at PIA
Linked Art API Endpoints (2)
Places
- Geographic places
Provenance Activities
- The various events that take place during the history of a physical thing
Sets
- Sets, including Collections and sets of objects used for exhibitions
Textual Works
- Texts worthy of description as distinct entities, such as the content carried by a book or journal article
Visual Works
- Image content worthy of description as distinct entities, such as the image shown by a painting or drawing
Julien A. Raemy | Linked Art at PIA
Main Design Principle of Linked Art
Linked Art is focused on usability, not full precision / completeness
Consistently solves actual challenges from real data
Development is iterative, as new use cases are found
Sanderson 2019
Julien A. Raemy | Linked Art at PIA
PIA goes LOUD
Julien A. Raemy | Linked Art at PIA
Web Annotation Data Model
Julien A. Raemy | Linked Art at PIA
{
"@context" : "http://iiif.io/api/presentation/3/context.json" ,
"id" : "https://iiif.participatory-archives.ch/annotations/SGV_12N_00001-p1-list.json" ,
"type" : "AnnotationPage" ,
"items" : [
{
"@context" : "http://www.w3.org/ns/anno.jsonld" ,
"id" : "https://iiif.participatory-archives.ch/annotations/SGV_12N_00001-p1-list/annotation-2800001.json" ,
"motivation" : "commenting" ,
"type" : "Annotation" ,
"body" : [
{
"type" : "TextualBody" ,
"value" : "person" ,
"purpose" : "commenting"
} ,
{
"type" : "TextualBody" ,
"value" : "Object Detection (vitrivr)" ,
"purpose" : "tagging"
} ,
{
"type" : "TextualBody" ,
"value" : "<br><small>Detection score: 0.999616265296936</small>" ,
"purpose" : "commenting"
}
] ,
"target" : {
"source" : "https://iiif.participatory-archives.ch/SGV_12N_00001/canvas/p1" ,
"selector" : {
"type" : "FragmentSelector" ,
"conformsTo" : "http://www.w3.org/TR/media-frags/" ,
"value" : "xywh=3225,201,943,4051"
} ,
"dcterms:isPartOf" : {
"type" : "Manifest" ,
"id" : "https://iiif.participatory-archives.ch/SGV_12N_00001/manifest.json"
}
}
} ,
Julien A. Raemy | Linked Art at PIA
Implementation of Linked Art
Julien A. Raemy | Linked Art at PIA
Why do we need/want Linked Art at PIA?
Conveying semantically enriched events and as a benchmark against other collections leveraging this model
Event-based model inherited from CIDOC-CRM
Being part of a community of developers/scholars
Potential aggregation capabilities
Additional (LOUD) access point
Julien A. Raemy | Linked Art at PIA
LA API Endpoint
SSFS Class
Relevance to PIA
Concept
sgv:Concept
The terms from the Ernst Brunner Thesaurus
Digital Objects
sgv:Object
Digital-born resources as well as digital (positive) surrogates that were created from negatives.
Events
sgv:Event
TBD
Groups
sgv:Agent
Differentiate the different Agents
Julien A. Raemy | Linked Art at PIA
LA API Endpoint
SSFS Class
Relevance to PIA
People
sgv:Agent
Differentiate the different Agents
Physical Objects (HMO)
sgv:Object
"Everything that can easily be held in one's hands"
Places
None
Not as top-level entity. Geonames -> Thesaurus of Geographic Names (TGN)?
Provenance Activities
sgv:Event
TBD
Julien A. Raemy | Linked Art at PIA
LA API Endpoint
SSFS Class
Relevance to PIA
Sets
sgv:Collection
sgv:Dataset
Official collections from the SSFS Archives, User-generated datasets
Text
None
Could be used for the Atlas of Swiss Folkflore
Visual
None
It isn't planned to be leveraged as a top-level entity within PIA.
Julien A. Raemy | Linked Art at PIA
Schwyzer Fasnacht
Black and White Negative modelled as a DigitalObject
Julien A. Raemy | Linked Art at PIA
Needed properties/patterns for our DigitalObject
member_of
→ Collection (SGV_12) - Pointing a Set
subject_of
→ Web Pages / IIIF Manifest
current_owner
→ SSFS Photographic Archives
created_by
→ Through the digitisation of a negative
produced_by
→ Production of the negative
digitally_shows
→ Visual Content
identified_by
→ Names and Identifiers
access_point
→ IIIF Image API
Julien A. Raemy | Linked Art at PIA
{
"@context" : "https://linked.art/ns/v1/linked-art.json" ,
"id" : "https://linkedart.participatory-archives.ch/digital/12033" ,
"type" : "DigitalObject" ,
"_label" : "PIA ID 12033 - [Schwyzer Fasnacht]" ,
"classified_as" : [
{
"id" : "http://vocab.getty.edu/aat/300215302" ,
"type" : "Type" ,
"_label" : "Digital Image"
}
] ,
"member_of" : [
{
"id" : "https://linkedart.participatory-archives.ch/set/12" ,
"type" : "Set" ,
"_label" : "SGV_12 (Ernst Brunner)" ,
"classified_as" : [
{
"id" : "http://vocab.getty.edu/aat/300025976" ,
"type" : "Type" ,
"_label" : "Collection"
}
]
}
] ,
Julien A. Raemy | Linked Art at PIA
"subject_of" : [
{
"type" : "LinguisticObject" ,
"_label" : "SGV Homepage for PIA ID 12033 - [Schwyzer Fasnacht]" ,
"digitally_carried_by" : [
{
"type" : "DigitalObject" ,
"_label" : "SGV Homepage for PIA ID 12033 - [Schwyzer Fasnacht]" ,
"format" : "text/html" ,
"access_point" : [
{
"id" : "https://archiv.sgv-sstp.ch/resource/422236" ,
"type" : "DigitalObject"
}
] ,
"classified_as" : [
{
"id" : "http://vocab.getty.edu/aat/300264578" ,
"type" : "Type" ,
"_label" : "Web Page"
}
] ,
"identified_by" : [
{
"type" : "Name" ,
"content" : "SGV Homepage for PIA ID 12033 - [Schwyzer Fasnacht]"
}
]
}
]
} ,
Julien A. Raemy | Linked Art at PIA
{
"type" : "LinguisticObject" ,
"_label" : "IIIF Manifest for PIA ID 12033 - [Schwyzer Fasnacht]" ,
"digitally_carried_by" : [
{
"type" : "DigitalObject" ,
"_label" : "IIIF Manifest for PIA ID 12033 - [Schwyzer Fasnacht]" ,
"format" : "application/ld+json" ,
"conforms_to" : [
{
"id" : "http://iiif.io/api/presentation/3/context.json" ,
"type" : "InformationObject"
}
] ,
"access_point" : [
{
"id" : "https://iiif.participatory-archives.ch/12033/manifest.json" ,
"type" : "DigitalObject"
}
] ,
"identified_by" : [
{
"type" : "Name" ,
"content" : "IIIF Manifest for PIA ID 12033 - [Schwyzer Fasnacht]"
}
]
}
]
}
] ,
Julien A. Raemy | Linked Art at PIA
"current_owner" : [
{
"id" : "https://linkedart.participatory-archives.ch/group/42" ,
"type" : "Group" ,
"_label" : "SGV Fotoarchiv" ,
"classified_as" : [
{
"id" : "http://vocab.getty.edu/aat/300343368" ,
"type" : "Type" ,
"_label" : "Photo Archives"
}
]
}
] ,
Julien A. Raemy | Linked Art at PIA
"created_by" : {
"type" : "Creation" ,
"_label" : "Digitisation of Photograph" ,
"used_specific_object" : [
{
"type" : "HumanMadeObject" ,
"_label" : "Negative of [Schwyzer Fasnacht]" ,
"classified_as" : [
{
"id" : "http://vocab.getty.edu/aat/300128343" ,
"type" : "Type" ,
"_label" : "Black and White Negative" ,
"classified_as" : [
{
"id" : "http://vocab.getty.edu/aat/300435443" ,
"type" : "Type" ,
"_label" : "Type of Work"
}
]
}
] ,
Julien A. Raemy | Linked Art at PIA
"dimension" : [
{
"type" : "Dimension" ,
"classified_as" : [
{
"id" : "http://vocab.getty.edu/aat/300055647" ,
"type" : "Type" ,
"_label" : "Width"
}
] ,
"value" : 6 ,
"unit" : {
"id" : "http://vocab.getty.edu/aat/300379098" ,
"type" : "MeasurementUnit" ,
"_label" : "Centimetres"
}
} ,
{
"type" : "Dimension" ,
"classified_as" : [
{
"id" : "http://vocab.getty.edu/aat/300055644" ,
"type" : "Type" ,
"_label" : "Height"
}
] ,
"value" : 6 ,
"unit" : {
"id" : "http://vocab.getty.edu/aat/300379098" ,
"type" : "MeasurementUnit" ,
"_label" : "Centimetres"
}
}
Julien A. Raemy | Linked Art at PIA
"produced_by" : {
"type" : "Production" ,
"timespan" : {
"type" : "TimeSpan" ,
"identified_by" : [
{
"type" : "Name" ,
"classified_as" : [
{
"id" : "http://vocab.getty.edu/aat/300404669" ,
"type" : "Type" ,
"_label" : "Display Title"
}
] ,
"content" : "1937"
}
] ,
"begin_of_the_begin" : "1937-01-01T00:00:00Z" ,
"end_of_the_end" : "1937-12-31T23:59:59Z"
} ,
"took_place_at" : [
{
"id" : "https://linkedart.participatory-archives.ch/place/2" ,
"type" : "Place" ,
"_label" : "Schwyz"
}
] ,
"carried_out_by" : [
{
"id" : "https://linkedart.participatory-archives.ch/person/12345" ,
"type" : "Person" ,
"_label" : "Ernst Brunner"
}
]
} ,
Julien A. Raemy | Linked Art at PIA
"digitally_shows" : [
{
"type" : "VisualItem" ,
"_label" : "Visual Content of Digital Positive of [Schwyzer Fasnacht]" ,
"represents_instance_of_type" : [
{
"id" : "http://vocab.getty.edu/aat/300164207" ,
"type" : "Type" ,
"_label" : "Carnival"
}
]
}
] ,
Julien A. Raemy | Linked Art at PIA
"identified_by" : [
{
"type" : "Name" ,
"content" : "[Schwyzer Fasnacht]" ,
"classified_as" : [
{
"id" : "http://vocab.getty.edu/aat/300404670" ,
"type" : "Type" ,
"_label" : "Owner-Assigned Title"
}
] ,
"language" : [
{
"id" : "http://vocab.getty.edu/aat/300388344" ,
"type" : "Language" ,
"_label" : "German"
}
]
} ,
{
"type" : "Identifier" ,
"content" : "AA 1" ,
"classified_as" : [
{
"id" : "http://vocab.getty.edu/aat/300417447" ,
"type" : "Type" ,
"_label" : "Creator-Assigned Number"
}
]
} ,
{
"type" : "Identifier" ,
"content" : "SGV_12N_00001" ,
"classified_as" : [
{
"id" : "http://vocab.getty.edu/aat/300312355" ,
"type" : "Type" ,
"_label" : "SGV Signature"
}
]
} ,
Julien A. Raemy | Linked Art at PIA
"access_point" : [
{
"id" : "https://sipi.participatory-archives.ch/SGV_12/SGV_12N_00001.jp2/full/max/0/default.jpg" ,
"type" : "DigitalObject" ,
"_label" : "Image in full resolution"
}
] ,
"digitally_available_via" : [
{
"type" : "DigitalService" ,
"_label" : "IIIF Image API" ,
"format" : "application/ld+json" ,
"access_point" : [
{
"id" : "https://sipi.participatory-archives.ch/SGV_12/SGV_12N_00001.jp2/info.json" ,
"type" : "DigitalObject"
}
] ,
"conforms_to" : [
{
"id" : "http://iiif.io/api/image/3/context.json" ,
"type" : "InformationObject"
}
]
}
]
Julien A. Raemy | Linked Art at PIA
Collaboration with the Linked Art II Project (University of Oxford)
Julien A. Raemy | Linked Art at PIA
Linked Art II
Collaboration between PIA and the University of Oxford over the Summer 2022 after completion of a survey (centred on the application of Linked Art)
Workflow for the transformation of photographic collection data to Linked Art
https://linked.art/community/projects/linkedartii/
Julien A. Raemy | Linked Art at PIA
Julien A. Raemy | Linked Art at PIA
What has been done on the PIA side
Boilerplates (JSON-LD + in some cases SVG)
DigitalObject
HumanMadeObject
Set
Preliminary mappings of our several data models (old and new SSFS, PIA)
Alignment of some terms against the AAT
Julien A. Raemy | Linked Art at PIA
Future Work
Julien A. Raemy | Linked Art at PIA
Templates
Updating and creating new boilerplates for each (useful) top-level entity
Generic vs specific: another workflow? Software?
Julien A. Raemy | Linked Art at PIA
Acknowledgements
Many thanks to:
Rob Sanderson who helped me create some of the Linked Art boilerplates/templates
Tanya Gray for her work on the Linked Art Collection Data Workflow
Kevin Page, PI of the Linked Art II project
Julien A. Raemy | Linked Art at PIA
Image Credits
[Blick auf das Spalentor]. Basel, 1938. Ernst Brunner. SGV_12N_00115
[Katze auf einer Mauer]. Ort und Datum unbekannt. Ernst Brunner. SGV_12N_19553
[Ringtanz während der Masüras auf der Alp Sura]. Guarda, 1939. SGV_12N_08589
["Steffenbach-Brücke" der Furka-Bahn: Bau und Erneuern der Brücke]. Kanton Wallis, 1950. Ernst Brunner. SGV_12N_36937
These images are part of the photographic archives of the Swiss Society for Folklore Studies . Licence: CC BY-NC 4.0
This presentation is about the deployment of Linked Art within the PIA research project
It is grounded as part of the Participatory Knowledge Practices in Analogue and Digital Image Archives (PIA) research project, which aims to develop a Citizen Science platform around three photographic collections of the Swiss Society for Folklore Studies (SSFS). The theoretical framework of the thesis is situated through and beyond an Actor-Network Theory (ANT) lens.
PIA is a Sinergia project funded by the Swiss National Science Foundation (SNSF) led by the University of Basel, the Uni, the Bern Academy of the Arts, and the Swiss Society for Folklore Studies. PIA wants to connect the world of data and things in an interdisciplinary manner.
We explore the phases of the analogue and digital archive from the perspectives of cultural anthropology, technology and design. The common goal of this project is to design a visual interface with machine learning-based tools to make it easy to annotate, contextualize, organize, and link both images and their meta-information, to deliberately encourage the participatory use of archives.
Abstraction Standards / Implementation Standards "A profile is a selection of appropriate abstractions, to encode, the scope of what can be described. An API is a selection of appropriate technologies, to give access to the data managed using the profile." (Robert Sanderson)
The model can be treated as interlinking components that describe aspects of the events of interest. The model, or application profile, defines the aspects of the conceptual model, ontologies and vocabulary terms that are used by Linked Art. It is not defined with respect to any specific technical method of interaction, for retrieving, updating, harvesting, searching or browsing, allowing many different possible implementations. This API has been designed with several design principles in mind to ensure that it is as usable as possible for software developers.
The Linked Art API is made up of different endpoints, each of which has a defined structure for the format of the data that will be returned from it. These align (mostly) with the core classes of the model, and are structured according to the API design principles.
The Linked Art API is made up of different endpoints, each of which has a defined structure for the format of the data that will be returned from it. These align (mostly) with the core classes of the model, and are structured according to the API design principles.
Building upon participation in the Linked Art community, PIA have collaborated with the University of Oxford to create a workflow for transforming cultural heritage collection data into Linked Art that is reusable by the widest possible audience. For the already digitised Family Kreis and Ernst Brunner collections, boilerplates - to echo the IIIF Cookbook recipe process to some extent - have been generated for the different object types to demonstrate the range of Linked Art patterns needed for the workflow.
An intermediate JSON data format is used so that the transformation step can be reused with different collection data sources. The intermediate JSON data files are transformed to a Linked Art representation of the PIA templates for the photographic object types. Using the Python library Cromulent to create basic Linked Art representations, the Python functions encode larger building block-type representations of the photographic object types, e.g. name, web page, and digital service. Together, the functions encode the photographic object types as defined in the PIA templates, and offer the opportunity for reuse with photographic object types in other collection data, as well as for different cultural heritage objects that share the same properties.
PIA Linked Art data workflow designed for reuse with different data sources and object types. In a situation common to many collecting institutions, the digital systems used to maintain catalogues and other records do not remain unchanged indefinitely; planning and preparation for such migrations may take months or years. At PIA migration to a new data model and API was planned, to be realised after implementation of the Linked Art workflow. This presented both a challenge, but also an opportunity: to design a workflow which can be reconfigured and reused with different data sources and APIs