Linked Art at PIA

Julien A. Raemy | PhD Candidate in DH, University of Basel
ORCID Google Scholar GitHub Mastodon

Last updated: 22 November 2022

Linked Open Usable Data for Cultural Heritage

Perspectives on Community Practices and Semantic Interoperability

PhD Thesis - https://phd.julsraemy.ch - supervised by:

  • Peter Fornaro (University of Basel)
  • Walter Leimgruber (University of Basel)
  • Robert Sanderson (Yale University)
Julien A. Raemy | Linked Art at PIA

PIA

Julien A. Raemy | Linked Art at PIA

PIA Teams

  • Cultural Anthropology: Institute for Cultural Anthropology and European Ethnology, University of Basel
  • Technology: Digital Humanities Lab, University of Basel
  • Design: Bern Academy of the Arts, Bern University of Applied Sciences

Project Website

Julien A. Raemy | Linked Art at PIA

Collections of the Swiss Society for Fokflore Studies (SSFS) within PIA

  • SGV_05 Atlas der Schweizerischen Volkskunde - Cartography
  • SGV_10 Familie Kreis - Vernacular Photography
  • SGV_12 Ernst Brunner - Photojournalism

https://archiv.sgv-sstp.ch

Julien A. Raemy | Linked Art at PIA

Linked Art

Julien A. Raemy | Linked Art at PIA

Linked Art

Linked Art is a community collaborating to define a metadata application profile (the model) for describing cultural heritage, and the technical means for conveniently interacting with it (the API).

https://linked.art

Julien A. Raemy | Linked Art at PIA

Extensive Definition

Linked Art is an RDF profile of the CIDOC-CRM that uses JSON-LD and the Getty Vocabularies to describe object-based cultural heritage in an event-based framework for consumption by software applications. It uses a subset of classes from the CIDOC-CRM ontology along with other commonly-used RDF ontologies to provide interoperable patterns and models that can be interpreted either as JSON or as RDF.

Newbury 2018

Julien A. Raemy | Linked Art at PIA

Linked Art Model Fundamentals

Level Linked Art
Model CIDOC Conceptual Reference Model (CRM)
Ontology RDF encoding of CRM 7.1, plus extensions
Vocabulary Getty Vocabularies (mainly AAT)
Profile Object-based cultural heritage (mainly art museum oriented)
API JSON-LD, following REST and web patterns
Julien A. Raemy | Linked Art at PIA

Model Components

Basic Patterns, Object, People and Organizations, Places, Digital Integration, Provenance of Objects, Collections and Sets, Exhibitions of Objects, Primary Sources of Information, Assertion level metadata, Dataset level metadata

API Format

JSON-LD, Shared Constructs, Entity Endpoints, JSON Schema, Ecosystem Endpoints, Class Reference

Julien A. Raemy | Linked Art at PIA

Linked Art API Endpoints (1)

  • Concepts - Types, Materials, Languages, and others, as full records rather than external references
  • Digital Objects - Images, services and other digital objects
    Events - Events and other non-specific activities that are related but not part of other entities
  • Groups - Groups and Organizations
  • People - People
  • Physical Objects - Physical things, including artworks, buildings or other architecture, books, parts of objects, and more
Julien A. Raemy | Linked Art at PIA

Linked Art API Endpoints (2)

  • Places - Geographic places
  • Provenance Activities - The various events that take place during the history of a physical thing
  • Sets - Sets, including Collections and sets of objects used for exhibitions
  • Textual Works - Texts worthy of description as distinct entities, such as the content carried by a book or journal article
  • Visual Works - Image content worthy of description as distinct entities, such as the image shown by a painting or drawing
Julien A. Raemy | Linked Art at PIA

Main Design Principle of Linked Art

  • Linked Art is focused on usability, not full precision / completeness
  • Consistently solves actual challenges from real data
  • Development is iterative, as new use cases are found

Sanderson 2019

Julien A. Raemy | Linked Art at PIA

PIA goes LOUD

Julien A. Raemy | Linked Art at PIA

Web Annotation Data Model

Julien A. Raemy | Linked Art at PIA
{
  "@context": "http://iiif.io/api/presentation/3/context.json",
  "id": "https://iiif.participatory-archives.ch/annotations/SGV_12N_00001-p1-list.json",
  "type": "AnnotationPage",
  "items": [
    {
      "@context": "http://www.w3.org/ns/anno.jsonld",
      "id": "https://iiif.participatory-archives.ch/annotations/SGV_12N_00001-p1-list/annotation-2800001.json",
      "motivation": "commenting",
      "type": "Annotation",
      "body": [
        {
          "type": "TextualBody",
          "value": "person",
          "purpose": "commenting"
        },
        {
          "type": "TextualBody",
          "value": "Object Detection (vitrivr)",
          "purpose": "tagging"
        },
        {
          "type": "TextualBody",
          "value": "<br><small>Detection score: 0.999616265296936</small>",
          "purpose": "commenting"
        }
      ],
      "target": {
        "source": "https://iiif.participatory-archives.ch/SGV_12N_00001/canvas/p1",
        "selector": {
          "type": "FragmentSelector",
          "conformsTo": "http://www.w3.org/TR/media-frags/",
          "value": "xywh=3225,201,943,4051"
        },
        "dcterms:isPartOf": {
          "type": "Manifest",
          "id": "https://iiif.participatory-archives.ch/SGV_12N_00001/manifest.json"
        }
      }
    },
Julien A. Raemy | Linked Art at PIA

Implementation of Linked Art

Julien A. Raemy | Linked Art at PIA
Why do we need/want Linked Art at PIA?

Conveying semantically enriched events and as a benchmark against other collections leveraging this model

  • Event-based model inherited from CIDOC-CRM
  • Being part of a community of developers/scholars
  • Potential aggregation capabilities
  • Additional (LOUD) access point
Julien A. Raemy | Linked Art at PIA
LA API Endpoint SSFS Class Relevance to PIA
Concept sgv:Concept The terms from the Ernst Brunner Thesaurus
Digital Objects sgv:Object Digital-born resources as well as digital (positive) surrogates that were created from negatives.
Events sgv:Event TBD
Groups sgv:Agent Differentiate the different Agents
Julien A. Raemy | Linked Art at PIA
LA API Endpoint SSFS Class Relevance to PIA
People sgv:Agent Differentiate the different Agents
Physical Objects (HMO) sgv:Object "Everything that can easily be held in one's hands"
Places None Not as top-level entity. Geonames -> Thesaurus of Geographic Names (TGN)?
Provenance Activities sgv:Event TBD
Julien A. Raemy | Linked Art at PIA
LA API Endpoint SSFS Class Relevance to PIA
Sets sgv:Collection sgv:Dataset Official collections from the SSFS Archives, User-generated datasets
Text None Could be used for the Atlas of Swiss Folkflore
Visual None It isn't planned to be leveraged as a top-level entity within PIA.

GitHub

Julien A. Raemy | Linked Art at PIA

Schwyzer Fasnacht

Black and White Negative modelled as a DigitalObject

Julien A. Raemy | Linked Art at PIA

Needed properties/patterns for our DigitalObject

  • member_of → Collection (SGV_12) - Pointing a Set
  • subject_of → Web Pages / IIIF Manifest
  • current_owner→ SSFS Photographic Archives
  • created_by → Through the digitisation of a negative
  • produced_by → Production of the negative
  • digitally_shows → Visual Content
  • identified_by → Names and Identifiers
  • access_point → IIIF Image API
Julien A. Raemy | Linked Art at PIA
{
  "@context": "https://linked.art/ns/v1/linked-art.json", 
  "id": "https://linkedart.participatory-archives.ch/digital/12033",
  "type": "DigitalObject",
  "_label": "PIA ID 12033 - [Schwyzer Fasnacht]",
  "classified_as": [
    {
      "id": "http://vocab.getty.edu/aat/300215302", 
      "type": "Type", 
      "_label": "Digital Image"
    }
  ],
  "member_of": [
    {
      "id": "https://linkedart.participatory-archives.ch/set/12",
      "type": "Set",
      "_label": "SGV_12 (Ernst Brunner)",
      "classified_as": [
        {
        "id": "http://vocab.getty.edu/aat/300025976",
        "type": "Type",
        "_label": "Collection"
        }
      ]
    }
  ],
Julien A. Raemy | Linked Art at PIA
  "subject_of": [
    {
      "type": "LinguisticObject",
      "_label": "SGV Homepage for PIA ID 12033 - [Schwyzer Fasnacht]",
      "digitally_carried_by": [
        {
          "type": "DigitalObject",
          "_label": "SGV Homepage for PIA ID 12033 - [Schwyzer Fasnacht]",
          "format": "text/html",
          "access_point": [
            {
              "id": "https://archiv.sgv-sstp.ch/resource/422236",
              "type": "DigitalObject"
            }
          ],
          "classified_as": [
            {
              "id": "http://vocab.getty.edu/aat/300264578",
              "type": "Type",
              "_label": "Web Page"
            }
          ],
          "identified_by": [
            {
              "type": "Name",
              "content": "SGV Homepage for PIA ID 12033 - [Schwyzer Fasnacht]"
            }
          ]
        }
      ]
    },
Julien A. Raemy | Linked Art at PIA
    {
      "type": "LinguisticObject",
      "_label": "IIIF Manifest for PIA ID 12033 - [Schwyzer Fasnacht]",
      "digitally_carried_by": [
        {
          "type": "DigitalObject",
          "_label": "IIIF Manifest for PIA ID 12033 - [Schwyzer Fasnacht]",
          "format": "application/ld+json",
          "conforms_to": [
            {
              "id": "http://iiif.io/api/presentation/3/context.json",
              "type": "InformationObject"
            }
          ],
          "access_point": [
            {
              "id": "https://iiif.participatory-archives.ch/12033/manifest.json",
              "type": "DigitalObject"
            }
          ],
          "identified_by": [
            {
              "type": "Name",
              "content": "IIIF Manifest for PIA ID 12033 - [Schwyzer Fasnacht]"
            }
          ]
        }
      ]
    }
  ],
Julien A. Raemy | Linked Art at PIA
  "current_owner": [
    {
      "id": "https://linkedart.participatory-archives.ch/group/42",
      "type": "Group",
      "_label": "SGV Fotoarchiv",
      "classified_as": [
        {
          "id": "http://vocab.getty.edu/aat/300343368",
          "type": "Type",
          "_label": "Photo Archives"
        }
      ]
    }
  ],
Julien A. Raemy | Linked Art at PIA
  "created_by": {
    "type": "Creation",
    "_label": "Digitisation of Photograph",
    "used_specific_object": [
      {
        "type": "HumanMadeObject",
        "_label": "Negative of [Schwyzer Fasnacht]",
        "classified_as": [
          {
            "id": "http://vocab.getty.edu/aat/300128343",
            "type": "Type",
            "_label": "Black and White Negative",
            "classified_as": [
              {
                "id": "http://vocab.getty.edu/aat/300435443",
                "type": "Type",
                "_label": "Type of Work"
              }
            ]
          }
        ],
Julien A. Raemy | Linked Art at PIA
        "dimension": [
          {
            "type": "Dimension",
            "classified_as": [
              {
                "id": "http://vocab.getty.edu/aat/300055647",
                "type": "Type",
                "_label": "Width"
              }
            ],
            "value": 6,
            "unit": {
              "id": "http://vocab.getty.edu/aat/300379098",
              "type": "MeasurementUnit",
              "_label": "Centimetres"
            }
          },
          {
            "type": "Dimension",
            "classified_as": [
              {
                "id": "http://vocab.getty.edu/aat/300055644",
                "type": "Type",
                "_label": "Height"
              }
            ],
            "value": 6,
            "unit": {
              "id": "http://vocab.getty.edu/aat/300379098",
              "type": "MeasurementUnit",
              "_label": "Centimetres"
            }
          }
Julien A. Raemy | Linked Art at PIA
"produced_by": {
            "type": "Production",
            "timespan": {
              "type": "TimeSpan",
              "identified_by": [
                {
                  "type": "Name",
                  "classified_as": [
                    {
                      "id": "http://vocab.getty.edu/aat/300404669",
                      "type": "Type",
                      "_label": "Display Title"
                    }
                  ],
                  "content": "1937"
                }
              ],
              "begin_of_the_begin": "1937-01-01T00:00:00Z",
              "end_of_the_end": "1937-12-31T23:59:59Z"
            },
            "took_place_at": [
              {
                "id": "https://linkedart.participatory-archives.ch/place/2",
                "type": "Place",
                "_label": "Schwyz"
              }
            ],
            "carried_out_by": [
              {
                "id": "https://linkedart.participatory-archives.ch/person/12345",
                "type": "Person",
                "_label": "Ernst Brunner"
              }
            ]
          },

Julien A. Raemy | Linked Art at PIA
"digitally_shows": [
    {
      "type": "VisualItem",
      "_label": "Visual Content of Digital Positive of [Schwyzer Fasnacht]",
      "represents_instance_of_type": [
        {
          "id": "http://vocab.getty.edu/aat/300164207",
          "type": "Type",
          "_label": "Carnival"
        }
      ]
    }
  ],
Julien A. Raemy | Linked Art at PIA
  "identified_by": [
    {
      "type": "Name",
      "content": "[Schwyzer Fasnacht]",
      "classified_as": [
        {
          "id": "http://vocab.getty.edu/aat/300404670",
          "type": "Type",
          "_label": "Owner-Assigned Title"
        }
      ],
      "language": [
        {
          "id": "http://vocab.getty.edu/aat/300388344",
          "type": "Language",
          "_label": "German"
        }
      ]
    },
    {
      "type": "Identifier",
      "content": "AA 1",
      "classified_as": [
        {
          "id": "http://vocab.getty.edu/aat/300417447",
          "type": "Type",
          "_label": "Creator-Assigned Number"
        }
      ]
    },
    {
      "type": "Identifier",
      "content": "SGV_12N_00001",
      "classified_as": [
        {
          "id": "http://vocab.getty.edu/aat/300312355",
          "type": "Type",
          "_label": "SGV Signature"
        }
      ]
    },
Julien A. Raemy | Linked Art at PIA
"access_point": [
    {
      "id": "https://sipi.participatory-archives.ch/SGV_12/SGV_12N_00001.jp2/full/max/0/default.jpg",
      "type": "DigitalObject",
      "_label": "Image in full resolution"
    }
  ],
  "digitally_available_via": [
    {
      "type": "DigitalService",
      "_label": "IIIF Image API",
      "format": "application/ld+json",
      "access_point": [
        {
          "id": "https://sipi.participatory-archives.ch/SGV_12/SGV_12N_00001.jp2/info.json",
          "type": "DigitalObject"
        }
      ],
      "conforms_to": [
        {
          "id": "http://iiif.io/api/image/3/context.json",
          "type": "InformationObject"
        }
      ]
    }
  ]
Julien A. Raemy | Linked Art at PIA

Collaboration with the Linked Art II Project (University of Oxford)

Julien A. Raemy | Linked Art at PIA

Linked Art II

  • Collaboration between PIA and the University of Oxford over the Summer 2022 after completion of a survey (centred on the application of Linked Art)
  • Workflow for the transformation of photographic collection data to Linked Art

https://linked.art/community/projects/linkedartii/

Julien A. Raemy | Linked Art at PIA

High-level overview

Linked Art Collection Worfklow

  1. Query
  2. Map
  3. Transform
Julien A. Raemy | Linked Art at PIA
Julien A. Raemy | Linked Art at PIA

What has been done on the PIA side

  • Boilerplates (JSON-LD + in some cases SVG)
    • DigitalObject
    • HumanMadeObject
    • Set
  • Preliminary mappings of our several data models (old and new SSFS, PIA)
  • Alignment of some terms against the AAT
Julien A. Raemy | Linked Art at PIA

Future Work

Julien A. Raemy | Linked Art at PIA

Endpoints

  1. Deployment of the PIA Linked Art API at https://data.participatory-archives.ch. The PIA JSON API will be deprecated, but still accessible (at https://json.participatory-archives.ch)
  2. Workflow Source: PIA JSON API →
    • Omeka S API (JSON-LD) or
    • DaSCH Service Platform API (JSON-LD, Turtle, RDF/XML)
Julien A. Raemy | Linked Art at PIA

Templates

  • Updating and creating new boilerplates for each (useful) top-level entity
  • Generic vs specific: another workflow? Software?
Julien A. Raemy | Linked Art at PIA

Acknowledgements

Many thanks to:

  • Rob Sanderson who helped me create some of the Linked Art boilerplates/templates
  • Tanya Gray for her work on the Linked Art Collection Data Workflow
  • Kevin Page, PI of the Linked Art II project
Julien A. Raemy | Linked Art at PIA

Image Credits

  • [Blick auf das Spalentor]. Basel, 1938. Ernst Brunner. SGV_12N_00115
  • [Katze auf einer Mauer]. Ort und Datum unbekannt. Ernst Brunner. SGV_12N_19553
  • [Ringtanz während der Masüras auf der Alp Sura]. Guarda, 1939. SGV_12N_08589
  • ["Steffenbach-Brücke" der Furka-Bahn: Bau und Erneuern der Brücke]. Kanton Wallis, 1950. Ernst Brunner. SGV_12N_36937

These images are part of the photographic archives of the Swiss Society for Folklore Studies. Licence: CC BY-NC 4.0

This presentation is about the deployment of Linked Art within the PIA research project

It is grounded as part of the Participatory Knowledge Practices in Analogue and Digital Image Archives (PIA) research project, which aims to develop a Citizen Science platform around three photographic collections of the Swiss Society for Folklore Studies (SSFS). The theoretical framework of the thesis is situated through and beyond an Actor-Network Theory (ANT) lens.

PIA is a Sinergia project funded by the Swiss National Science Foundation (SNSF) led by the University of Basel, the Uni, the Bern Academy of the Arts, and the Swiss Society for Folklore Studies. PIA wants to connect the world of data and things in an interdisciplinary manner. We explore the phases of the analogue and digital archive from the perspectives of cultural anthropology, technology and design. The common goal of this project is to design a visual interface with machine learning-based tools to make it easy to annotate, contextualize, organize, and link both images and their meta-information, to deliberately encourage the participatory use of archives.

Abstraction Standards / Implementation Standards "A profile is a selection of appropriate abstractions, to encode, the scope of what can be described. An API is a selection of appropriate technologies, to give access to the data managed using the profile." (Robert Sanderson)

The model can be treated as interlinking components that describe aspects of the events of interest. The model, or application profile, defines the aspects of the conceptual model, ontologies and vocabulary terms that are used by Linked Art. It is not defined with respect to any specific technical method of interaction, for retrieving, updating, harvesting, searching or browsing, allowing many different possible implementations. This API has been designed with several design principles in mind to ensure that it is as usable as possible for software developers.

The Linked Art API is made up of different endpoints, each of which has a defined structure for the format of the data that will be returned from it. These align (mostly) with the core classes of the model, and are structured according to the API design principles.

The Linked Art API is made up of different endpoints, each of which has a defined structure for the format of the data that will be returned from it. These align (mostly) with the core classes of the model, and are structured according to the API design principles.

IIIF Workflow within PIA

Linked Art and IIIF

Building upon participation in the Linked Art community, PIA have collaborated with the University of Oxford to create a workflow for transforming cultural heritage collection data into Linked Art that is reusable by the widest possible audience. For the already digitised Family Kreis and Ernst Brunner collections, boilerplates - to echo the IIIF Cookbook recipe process to some extent - have been generated for the different object types to demonstrate the range of Linked Art patterns needed for the workflow.

An intermediate JSON data format is used so that the transformation step can be reused with different collection data sources. The intermediate JSON data files are transformed to a Linked Art representation of the PIA templates for the photographic object types. Using the Python library Cromulent to create basic Linked Art representations, the Python functions encode larger building block-type representations of the photographic object types, e.g. name, web page, and digital service. Together, the functions encode the photographic object types as defined in the PIA templates, and offer the opportunity for reuse with photographic object types in other collection data, as well as for different cultural heritage objects that share the same properties.

PIA Linked Art data workflow designed for reuse with different data sources and object types. In a situation common to many collecting institutions, the digital systems used to maintain catalogues and other records do not remain unchanged indefinitely; planning and preparation for such migrations may take months or years. At PIA migration to a new data model and API was planned, to be realised after implementation of the Linked Art workflow. This presented both a challenge, but also an opportunity: to design a workflow which can be reconfigured and reused with different data sources and APIs