Äïy˚������ådocutils.nodesîådocumentîìî)Åî}î(å rawsourceîå�îåchildrenî]î(h�årawîìî)Åî}î(hå\newpageîh]îh�åTextîìîå\newpageîÖîÅî}î(hhåparentîh ubaå
attributesî}î(åidsî]îåclassesî]îånamesî]îådupnamesî]îåbackrefsî]îåformatîålatexîå xml:spaceîåpreserveîuåtagnameîh åsourceîåe/var/lib/jenkins/jobs/metacat_beta/workspace/metacat/docs/user/metacat/source/ore-model-expansion.rstîålineîKhhhhubh�åsectionîìî)Åî}î(hhh]î(h�åtitleîìî)Åî}î(hå#ORE Model for Derived Data Packagesîh]îhå#ORE Model for Derived Data PackagesîÖîÅî}î(hh3hh1hhh'Nh)Nubah}î(h]îh]îh ]îh ]îh ]îuh&h/hh,hhh'h(h)Kubåsphinx.addnodesîåindexîìî)Åî}î(hhh]îh}î(h]îh]îh ]îh ]îh ]îåentriesî]î(åsingleîåDerived Resourcesîåindex-0îhNtîaåinlineîâuh&h@h'h(h)K hh,hhubh�åtargetîìî)Åî}î(hhh]îh}î(h]îhOah]îh ]îh ]îh ]îuh&hRhh,hhh'h(h)K ubhA)Åî}î(hhh]îh}î(h]îh]îh ]îh ]îh ]îhK]î(hMåPROVîåindex-1îhNtîahQâuh&h@h'h(h)K
hh,hhubhS)Åî}î(hhh]îh}î(h]îh]îh ]îh ]îh ]îårefidîhhuh&hRhh,hhh'h(h)K ubh�ådefinition_listîìî)Åî}î(hhh]î(h�ådefinition_list_itemîìî)Åî}î(håAuthor
Lauren Walker
îh]î(h�återmîìî)Åî}î(håAuthorîh]îhåAuthorîÖîÅî}î(hhÉhhÅubah}î(h]îh]îh ]îh ]îh ]îuh&hh'h(h)K
hh{ubh�å
definitionîìî)Åî}î(hhh]îh�å paragraphîìî)Åî}î(hå
Lauren Walkerîh]îhå
Lauren WalkerîÖîÅî}î(hhòhhñubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)K
hhëubah}î(h]îh]îh ]îh ]îh ]îuh&hèhh{ubeh}î(h]îh]îh ]îh ]îh ]îuh&hyh'h(h)K
hhvubhz)Åî}î(håODate
- 20140513 Initial draft of ORE model expansion for derived data packages
îh]î(hÄ)Åî}î(håDateîh]îhåDateîÖîÅî}î(hh∂hh¥ubah}î(h]îh]îh ]îh ]îh ]îuh&hh'h(h)Khh∞ubhê)Åî}î(hhh]îh�å bullet_listîìî)Åî}î(hhh]îh�å list_itemîìî)Åî}î(håH20140513 Initial draft of ORE model expansion for derived data packages
îh]îhï)Åî}î(håG20140513 Initial draft of ORE model expansion for derived data packagesîh]îhåG20140513 Initial draft of ORE model expansion for derived data packagesîÖîÅî}î(hh“hh–ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)KhhÃubah}î(h]îh]îh ]îh ]îh ]îuh&h hh«ubah}î(h]îh]îh ]îh ]îh ]îåbulletîå-îuh&h≈h'h(h)Khh¬ubah}î(h]îh]îh ]îh ]îh ]îuh&hèhh∞ubeh}î(h]îh]îh ]îh ]îh ]îuh&hyh'h(h)Khhvhhubhz)Åî}î(hå_Goal
Accurately describe the relationships of resources that are derived from other resources.
îh]î(hÄ)Åî}î(håGoalîh]îhåGoalîÖîÅî}î(hh˛hh¸ubah}î(h]îh]îh ]îh ]îh ]îuh&hh'h(h)Khh¯ubhê)Åî}î(hhh]îhï)Åî}î(håYAccurately describe the relationships of resources that are derived from other resources.îh]îhåYAccurately describe the relationships of resources that are derived from other resources.îÖîÅî}î(hj��hj
��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)Khj
��ubah}î(h]îh]îh ]îh ]îh ]îuh&hèhh¯ubeh}î(h]îh]îh ]îh ]îh ]îuh&hyh'h(h)Khhvhhubhz)Åî}î(håÁSummary
This proposed expansion of the Metacat ORE model uses the `PROV ontology <http://www.w3.org/TR/prov-overview/>`_ to describe
the relationships between generated or derived resources and the resources used to generate them.
îh]î(hÄ)Åî}î(håSummaryîh]îhåSummaryîÖîÅî}î(hj-��hj+��ubah}î(h]îh]îh ]îh ]îh ]îuh&hh'h(h)Khj'��ubhê)Åî}î(hhh]îhï)Åî}î(håfiThis proposed expansion of the Metacat ORE model uses the `PROV ontology <http://www.w3.org/TR/prov-overview/>`_ to describe
the relationships between generated or derived resources and the resources used to generate them.îh]î(hå:This proposed expansion of the Metacat ORE model uses the îÖîÅî}î(hå:This proposed expansion of the Metacat ORE model uses the îhj<��ubh�å referenceîìî)Åî}î(hå6`PROV ontology <http://www.w3.org/TR/prov-overview/>`_îh]îhå
PROV ontologyîÖîÅî}î(hhhjG��ubah}î(h]îh]îh ]îh ]îh ]îånameîå
PROV ontologyîårefuriîå#http://www.w3.org/TR/prov-overview/îuh&jE��hj<��ubhS)Åî}î(hå& <http://www.w3.org/TR/prov-overview/>îh]îh}î(h]îå
prov-ontologyîah]îh ]îå
prov ontologyîah ]îh ]îårefuriîjX��uh&hRå
referencedîKhj<��ubhån to describe
the relationships between generated or derived resources and the resources used to generate them.îÖîÅî}î(hån to describe
the relationships between generated or derived resources and the resources used to generate them.îhj<��ubeh}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)Khj9��ubah}î(h]îh]îh ]îh ]îh ]îuh&hèhj'��ubeh}î(h]îh]îh ]îh ]îh ]îuh&hyh'h(h)Khhvhhubeh}î(h]îhhah]îh ]îh ]îh ]îuh&hthh,hhh'h(h)Nåexpect_referenced_by_nameî}îåexpect_referenced_by_idî}îhhhjsubh+)Åî}î(hhh]î(h0)Åî}î(håOverviewîh]îhåOverviewîÖîÅî}î(hjç��hjã��hhh'Nh)Nubah}î(h]îh]îh ]îh ]îh ]îuh&h/hjà��hhh'h(h)Kubhï)Åî}î(hå~There are two main concepts that are being introduced to Metacat - derived data resources and the activities that create them.îh]îhå~There are two main concepts that are being introduced to Metacat - derived data resources and the activities that create them.îÖîÅî}î(hjõ��hjô��hhh'Nh)Nubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)Khjà��hhubhï)Åî}î(hXñ��A derived resource is defined as a entity, usually a data file, that is produced by transforming one entity into another or is the production of an activity that generates a new entity from an existing one.
In Metacat, derived data could be a data table that was composed from analyzing one or more existing data tables.
It could also be a visualization of another resource, such as a graph, chart, or map.îh]îhXñ��A derived resource is defined as a entity, usually a data file, that is produced by transforming one entity into another or is the production of an activity that generates a new entity from an existing one.
In Metacat, derived data could be a data table that was composed from analyzing one or more existing data tables.
It could also be a visualization of another resource, such as a graph, chart, or map.îÖîÅî}î(hj©��hjß��hhh'Nh)Nubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)K hjà��hhubhï)Åî}î(hXU��Because derived data is the product of a transformation activity, Metacat's ORE model will need to have the capability to store information on these activities.
These activities could be a script (e.g. an R script) that is used to create a visualization from a data table or to compose a new data table from one or more existing data tables.îh]îhXW��Because derived data is the product of a transformation activity, Metacat‚Äôs ORE model will need to have the capability to store information on these activities.
These activities could be a script (e.g. an R script) that is used to create a visualization from a data table or to compose a new data table from one or more existing data tables.îÖîÅî}î(hj∑��hjµ��hhh'Nh)Nubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)K!hjà��hhubhï)Åî}î(håDThese new resources will be documented by metadata, most likely EML.îh]îhåDThese new resources will be documented by metadata, most likely EML.îÖîÅî}î(hj≈��hj√��hhh'Nh)Nubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)K$hjà��hhubeh}î(h]îåoverviewîah]îh ]îåoverviewîah ]îh ]îuh&h*hh,hhh'h(h)Kubh+)Åî}î(hhh]î(h0)Åî}î(håOntology and Modelîh]îhåOntology and ModelîÖîÅî}î(hjfi��hj‹��hhh'Nh)Nubah}î(h]îh]îh ]îh ]îh ]îuh&h/hjŸ��hhh'h(h)K(ubhu)Åî}î(hhh]îhz)Åî}î(håÔThe `PROV ontology <http://www.w3.org/TR/prov-overview/>`_ will be used to describe the following relationships:
* Derived resources and the original resources used to create them
* Derived resources and the activities used to create them
îh]î(hÄ)Åî}î(håpThe `PROV ontology <http://www.w3.org/TR/prov-overview/>`_ will be used to describe the following relationships:îh]î(håThe îÖîÅî}î(håThe îhjÒ��ubjF��)Åî}î(hå6`PROV ontology <http://www.w3.org/TR/prov-overview/>`_îh]îhå
PROV ontologyîÖîÅî}î(hhhj˙��ubah}î(h]îh]îh ]îh ]îh ]îånameîå
PROV ontologyîjW��å#http://www.w3.org/TR/prov-overview/îuh&jE��hjÒ��ubhS)Åî}î(hå& <http://www.w3.org/TR/prov-overview/>îh]îh}î(h]îåid1îah]îh ]îh ]îå
prov ontologyîah ]îårefuriîj
��uh&hRjf��KhjÒ��ubhå6 will be used to describe the following relationships:îÖîÅî}î(hå6 will be used to describe the following relationships:îhjÒ��ubeh}î(h]îh]îh ]îh ]îh ]îuh&hh'h(h)K+hjÌ��ubhê)Åî}î(hhh]îh∆)Åî}î(hhh]î(hÀ)Åî}î(hå@Derived resources and the original resources used to create themîh]îhï)Åî}î(hj+��h]îhå@Derived resources and the original resources used to create themîÖîÅî}î(hj+��hj-��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)K*hj)��ubah}î(h]îh]îh ]îh ]îh ]îuh&h hj&��ubhÀ)Åî}î(hå9Derived resources and the activities used to create them
îh]îhï)Åî}î(hå8Derived resources and the activities used to create themîh]îhå8Derived resources and the activities used to create themîÖîÅî}î(hjF��hjD��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)K+hj@��ubah}î(h]îh]îh ]îh ]îh ]îuh&h hj&��ubeh}î(h]îh]îh ]îh ]îh ]îhÍå*îuh&h≈h'h(h)K*hj#��ubah}î(h]îh]îh ]îh ]îh ]îuh&hèhjÌ��ubeh}î(h]îh]îh ]îh ]îh ]îuh&hyh'h(h)K+hjÍ��ubah}î(h]îh]îh ]îh ]îh ]îuh&hthjŸ��hhh'Nh)Nubh�åfigureîìî)Åî}î(hhh]î(h�åimageîìî)Åî}î(håz.. figure:: images/PROV-simple-diagram.png
Figure 1. A simple diagram illustrating the PROV ontology Metacat will use
îh]îh}î(h]îh]îh ]îh ]îh ]îåuriîå images/PROV-simple-diagram.pngîå
candidatesî}îj^��jÉ��suh&jv��hjs��h'h(h)K/ubh�åcaptionîìî)Åî}î(håJFigure 1. A simple diagram illustrating the PROV ontology Metacat will useîh]îhåJFigure 1. A simple diagram illustrating the PROV ontology Metacat will useîÖîÅî}î(hjä��hjà��ubah}î(h]îh]îh ]îh ]îh ]îuh&jÜ��h'h(h)K/hjs��ubeh}î(h]îåid2îah]îh ]îh ]îh ]îuh&jq��h)K/hjŸ��hhh'h(ubhï)Åî}î(håòThis model will allow the original data file to remain unchanged as all assertions made about the derived data can be
described in the derived data RDF.îh]îhåòThis model will allow the original data file to remain unchanged as all assertions made about the derived data can be
described in the derived data RDF.îÖîÅî}î(hjü��hjù��hhh'Nh)Nubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)K1hjŸ��hhubhu)Åî}î(hhh]îhz)Åî}î(hX∑��The terms from the PROV ontology that will be introduced to Metacat to describe these relationships:
* `wasGeneratedBy <http://www.w3.org/ns/prov#wasGeneratedBy>`_ : Generation is the completion of production of a new entity by an activity. This entity did not exist before generation and becomes available for usage after this generation.
* `generated <http://www.w3.org/ns/prov#generated>`_ : Generation is the completion of production of a new entity by an activity. This entity did not exist before generation and becomes available for usage after this generation.
* `wasDerivedFrom <http://www.w3.org/ns/prov#wasDerivedFrom>`_ : A derivation is a transformation of an entity into another, an update of an entity resulting in a new one, or the construction of a new entity based on a pre-existing entity.
* `used <http://www.w3.org/ns/prov#used>`_ : Usage is the beginning of utilizing an entity by an activity. Before usage, the activity had not begun to utilize this entity and could not have been affected by the entity.
* `wasInformedBy <http://www.w3.org/ns/prov#wasInformedBy>`_ : Communication is the exchange of an entity by two activities, one activity using the entity generated by the other.
îh]î(hÄ)Åî}î(hådThe terms from the PROV ontology that will be introduced to Metacat to describe these relationships:îh]îhådThe terms from the PROV ontology that will be introduced to Metacat to describe these relationships:îÖîÅî}î(hj¥��hj≤��ubah}î(h]îh]îh ]îh ]îh ]îuh&hh'h(h)K:hjÆ��ubhê)Åî}î(hhh]îh∆)Åî}î(hhh]î(hÀ)Åî}î(håÏ`wasGeneratedBy <http://www.w3.org/ns/prov#wasGeneratedBy>`_ : Generation is the completion of production of a new entity by an activity. This entity did not exist before generation and becomes available for usage after this generation.îh]îhï)Åî}î(hj»��h]î(jF��)Åî}î(hå<`wasGeneratedBy <http://www.w3.org/ns/prov#wasGeneratedBy>`_îh]îhåwasGeneratedByîÖîÅî}î(hhhjÕ��ubah}î(h]îh]îh ]îh ]îh ]îånameîåwasGeneratedByîjW��å(http://www.w3.org/ns/prov#wasGeneratedByîuh&jE��hj ��ubhS)Åî}î(hå+ <http://www.w3.org/ns/prov#wasGeneratedBy>îh]îh}î(h]îåwasgeneratedbyîah]îh ]îåwasgeneratedbyîah ]îh ]îårefuriîj›��uh&hRjf��Khj ��ubhå∞ : Generation is the completion of production of a new entity by an activity. This entity did not exist before generation and becomes available for usage after this generation.îÖîÅî}î(hå∞ : Generation is the completion of production of a new entity by an activity. This entity did not exist before generation and becomes available for usage after this generation.îhj ��ubeh}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)K6hj∆��ubah}î(h]îh]îh ]îh ]îh ]îuh&h hj√��ubhÀ)Åî}î(hå‚`generated <http://www.w3.org/ns/prov#generated>`_ : Generation is the completion of production of a new entity by an activity. This entity did not exist before generation and becomes available for usage after this generation.îh]îhï)Åî}î(hj˛��h]î(jF��)Åî}î(hå2`generated <http://www.w3.org/ns/prov#generated>`_îh]îhå generatedîÖîÅî}î(hhhj��ubah}î(h]îh]îh ]îh ]îh ]îånameîå generatedîjW��å#http://www.w3.org/ns/prov#generatedîuh&jE��hj���ubhS)Åî}î(hå& <http://www.w3.org/ns/prov#generated>îh]îh}î(h]îå generatedîah]îh ]îå generatedîah ]îh ]îårefuriîj��uh&hRjf��Khj���ubhå∞ : Generation is the completion of production of a new entity by an activity. This entity did not exist before generation and becomes available for usage after this generation.îÖîÅî}î(hå∞ : Generation is the completion of production of a new entity by an activity. This entity did not exist before generation and becomes available for usage after this generation.îhj���ubeh}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)K7hj¸��ubah}î(h]îh]îh ]îh ]îh ]îuh&h hj√��ubhÀ)Åî}î(håÌ`wasDerivedFrom <http://www.w3.org/ns/prov#wasDerivedFrom>`_ : A derivation is a transformation of an entity into another, an update of an entity resulting in a new one, or the construction of a new entity based on a pre-existing entity.îh]îhï)Åî}î(hj4��h]î(jF��)Åî}î(hå<`wasDerivedFrom <http://www.w3.org/ns/prov#wasDerivedFrom>`_îh]îhåwasDerivedFromîÖîÅî}î(hhhj9��ubah}î(h]îh]îh ]îh ]îh ]îånameîåwasDerivedFromîjW��å(http://www.w3.org/ns/prov#wasDerivedFromîuh&jE��hj6��ubhS)Åî}î(hå+ <http://www.w3.org/ns/prov#wasDerivedFrom>îh]îh}î(h]îåwasderivedfromîah]îh ]îåwasderivedfromîah ]îh ]îårefuriîjI��uh&hRjf��Khj6��ubhå± : A derivation is a transformation of an entity into another, an update of an entity resulting in a new one, or the construction of a new entity based on a pre-existing entity.îÖîÅî}î(hå± : A derivation is a transformation of an entity into another, an update of an entity resulting in a new one, or the construction of a new entity based on a pre-existing entity.îhj6��ubeh}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)K8hj2��ubah}î(h]îh]îh ]îh ]îh ]îuh&h hj√��ubhÀ)Åî}î(håÿ`used <http://www.w3.org/ns/prov#used>`_ : Usage is the beginning of utilizing an entity by an activity. Before usage, the activity had not begun to utilize this entity and could not have been affected by the entity.îh]îhï)Åî}î(hjj��h]î(jF��)Åî}î(hå(`used <http://www.w3.org/ns/prov#used>`_îh]îhåusedîÖîÅî}î(hhhjo��ubah}î(h]îh]îh ]îh ]îh ]îånameîåusedîjW��å http://www.w3.org/ns/prov#usedîuh&jE��hjl��ubhS)Åî}î(hå! <http://www.w3.org/ns/prov#used>îh]îh}î(h]îåusedîah]îh ]îåusedîah ]îh ]îårefuriîj��uh&hRjf��Khjl��ubhå∞ : Usage is the beginning of utilizing an entity by an activity. Before usage, the activity had not begun to utilize this entity and could not have been affected by the entity.îÖîÅî}î(hå∞ : Usage is the beginning of utilizing an entity by an activity. Before usage, the activity had not begun to utilize this entity and could not have been affected by the entity.îhjl��ubeh}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)K9hjh��ubah}î(h]îh]îh ]îh ]îh ]îuh&h hj√��ubhÀ)Åî}î(hå±`wasInformedBy <http://www.w3.org/ns/prov#wasInformedBy>`_ : Communication is the exchange of an entity by two activities, one activity using the entity generated by the other.
îh]îhï)Åî}î(hå∞`wasInformedBy <http://www.w3.org/ns/prov#wasInformedBy>`_ : Communication is the exchange of an entity by two activities, one activity using the entity generated by the other.îh]î(jF��)Åî}î(hå:`wasInformedBy <http://www.w3.org/ns/prov#wasInformedBy>`_îh]îhå
wasInformedByîÖîÅî}î(hhhj¶��ubah}î(h]îh]îh ]îh ]îh ]îånameîå
wasInformedByîjW��å'http://www.w3.org/ns/prov#wasInformedByîuh&jE��hj¢��ubhS)Åî}î(hå* <http://www.w3.org/ns/prov#wasInformedBy>îh]îh}î(h]îå
wasinformedbyîah]îh ]îå
wasinformedbyîah ]îh ]îårefuriîj∂��uh&hRjf��Khj¢��ubhåv : Communication is the exchange of an entity by two activities, one activity using the entity generated by the other.îÖîÅî}î(håv : Communication is the exchange of an entity by two activities, one activity using the entity generated by the other.îhj¢��ubeh}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)K:hjû��ubah}î(h]îh]îh ]îh ]îh ]îuh&h hj√��ubeh}î(h]îh]îh ]îh ]îh ]îhÍj^��uh&h≈h'h(h)K6hj¿��ubah}î(h]îh]îh ]îh ]îh ]îuh&hèhjÆ��ubeh}î(h]îh]îh ]îh ]îh ]îuh&hyh'h(h)K:hj´��ubah}î(h]îh]îh ]îh ]îh ]îuh&hthjŸ��hhh'Nh)Nubhï)Åî}î(hå~The following diagram fully represents the new model for derived resources. New terms and resources are highlighted in purple.îh]îhå~The following diagram fully represents the new model for derived resources. New terms and resources are highlighted in purple.îÖîÅî}î(hjÔ��hjÌ��hhh'Nh)Nubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)K<hjŸ��hhubjr��)Åî}î(hhh]î(jw��)Åî}î(håà.. figure:: images/Derived-data-packages-model.png
Figure 2. The model for derived data sets with new terms highlighted in purple.
îh]îh}î(h]îh]îh ]îh ]îh ]îåuriîå&images/Derived-data-packages-model.pngîjÑ��}îj^��j ��suh&jv��hj˚��h'h(h)K@ubjá��)Åî}î(håOFigure 2. The model for derived data sets with new terms highlighted in purple.îh]îhåOFigure 2. The model for derived data sets with new terms highlighted in purple.îÖîÅî}î(hj
��hj ��ubah}î(h]îh]îh ]îh ]îh ]îuh&jÜ��h'h(h)K@hj˚��ubeh}î(h]îåid3îah]îh ]îh ]îh ]îuh&jq��h)K@hjŸ��hhh'h(ubeh}î(h]îåontology-and-modelîah]îh ]îåontology and modelîah ]îh ]îuh&h*hh,hhh'h(h)K(ubh+)Åî}î(hhh]î(h0)Åî}î(håExamplesîh]îhåExamplesîÖîÅî}î(hj-��hj+��hhh'Nh)Nubah}î(h]îh]îh ]îh ]îh ]îuh&h/hj(��hhh'h(h)KDubh+)Åî}î(hhh]î(h0)Åî}î(håDerived data using scriptsîh]îhåDerived data using scriptsîÖîÅî}î(hj>��hj<��hhh'Nh)Nubah}î(h]îh]îh ]îh ]îh ]îuh&h/hj9��hhh'h(h)KFubhï)Åî}î(håçJohn Smith is a scientist who has uploaded two data tables and an EML file to a Metacat repository. His package of data is represented below.îh]îhåçJohn Smith is a scientist who has uploaded two data tables and an EML file to a Metacat repository. His package of data is represented below.îÖîÅî}î(hjL��hjJ��hhh'Nh)Nubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)KGhj9��hhubjr��)Åî}î(hhh]î(jw��)Åî}î(håá.. figure:: images/derived-data-smith-package.png
Figure 3. Smith's original data package using the ORE model Metacat has now
îh]îh}î(h]îh]îh ]îh ]îh ]îåuriîå%images/derived-data-smith-package.pngîjÑ��}îj^��jf��suh&jv��hjX��h'h(h)KKubjá��)Åî}î(håKFigure 3. Smith's original data package using the ORE model Metacat has nowîh]îhåMFigure 3. Smith‚Äôs original data package using the ORE model Metacat has nowîÖîÅî}î(hjj��hjh��ubah}î(h]îh]îh ]îh ]îh ]îuh&jÜ��h'h(h)KKhjX��ubeh}î(h]îåid4îah]îh ]îh ]îh ]îuh&jq��h)KKhj9��hhh'h(ubhï)Åî}î(hXı��Jessica Couture is an analyst who wants to create a graph of John's Smith data. She creates an R script that grabs the data files smith_data.1.1 and smith_data.2.1,
performs some sort of analysis on them and transforms them into a single data file, couture_data.1.1. She then creates another R script to visualize this composed data
into a chart. She describes her process and the data in an EML file and uploads all five files to Metacat. Below is the model that describes Couture's new data package:îh]îhX˘��Jessica Couture is an analyst who wants to create a graph of John‚Äôs Smith data. She creates an R script that grabs the data files smith_data.1.1 and smith_data.2.1,
performs some sort of analysis on them and transforms them into a single data file, couture_data.1.1. She then creates another R script to visualize this composed data
into a chart. She describes her process and the data in an EML file and uploads all five files to Metacat. Below is the model that describes Couture‚Äôs new data package:îÖîÅî}î(hj��hj}��hhh'Nh)Nubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)KMhj9��hhubjr��)Åî}î(hhh]î(jw��)Åî}î(hå≤.. figure:: images/Derived-data-example.png
Figure 4. Couture's derived data package with the existing Metacat ORE notation in blue and the new PROV notation in purple.
îh]îh}î(h]îh]îh ]îh ]îh ]îåuriîå images/Derived-data-example.pngîjÑ��}îj^��jô��suh&jv��hjã��h'h(h)KSubjá��)Åî}î(hå|Figure 4. Couture's derived data package with the existing Metacat ORE notation in blue and the new PROV notation in purple.îh]îhå~Figure 4. Couture‚Äôs derived data package with the existing Metacat ORE notation in blue and the new PROV notation in purple.îÖîÅî}î(hjù��hjõ��ubah}î(h]îh]îh ]îh ]îh ]îuh&jÜ��h'h(h)KShjã��ubeh}î(h]îåid5îah]îh ]îh ]îh ]îuh&jq��h)KShj9��hhh'h(ubeh}î(h]îåderived-data-using-scriptsîah]îh ]îåderived data using scriptsîah ]îh ]îuh&h*hj(��hhh'h(h)KFubh+)Åî}î(hhh]î(h0)Åî}î(hå Derived data without scriptsîh]îhå Derived data without scriptsîÖîÅî}î(hjΩ��hjª��hhh'Nh)Nubah}î(h]îh]îh ]îh ]îh ]îuh&h/hj∏��hhh'h(h)KVubhï)Åî}î(hXB��Not all derived data will be produced from a script that can be stored in Metacat. An analyst may create a composed data table through a more
manual process, such as transforming values in a spreadsheet program like MS Excel. Or a scientist may create a simple graph of their data with
MS Excel or an online graphing tool.îh]îhXB��Not all derived data will be produced from a script that can be stored in Metacat. An analyst may create a composed data table through a more
manual process, such as transforming values in a spreadsheet program like MS Excel. Or a scientist may create a simple graph of their data with
MS Excel or an online graphing tool.îÖîÅî}î(hjÀ��hj…��hhh'Nh)Nubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)KWhj∏��hhubhï)Åî}î(hX√��Let's say John Smith decides to create a time series chart using the data from one of his data files, smith_data.1.1. He adds this image file to
the original data package and edits the metadata to explain his process and the chart. His data package will essentially be using the PROV model without the activity concept.
Smith has the option of creating a new data package with the image and an EML file so that his metadata ID does not have to change.îh]îhX≈��Let‚Äôs say John Smith decides to create a time series chart using the data from one of his data files, smith_data.1.1. He adds this image file to
the original data package and edits the metadata to explain his process and the chart. His data package will essentially be using the PROV model without the activity concept.
Smith has the option of creating a new data package with the image and an EML file so that his metadata ID does not have to change.îÖîÅî}î(hjŸ��hj◊��hhh'Nh)Nubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)K[hj∏��hhubjr��)Åî}î(hhh]î(jw��)Åî}î(håm.. figure:: images/PROV-simple-diagram-without-activity.png
Figure 4. The PROV model without an activity
îh]îh}î(h]îh]îh ]îh ]îh ]îåuriîå/images/PROV-simple-diagram-without-activity.pngîjÑ��}îj^��jÛ��suh&jv��hjÂ��h'h(h)Kaubjá��)Åî}î(hå,Figure 4. The PROV model without an activityîh]îhå,Figure 4. The PROV model without an activityîÖîÅî}î(hj˜��hjı��ubah}î(h]îh]îh ]îh ]îh ]îuh&jÜ��h'h(h)KahjÂ��ubeh}î(h]îåid6îah]îh ]îh ]îh ]îuh&jq��h)Kahj∏��hhh'h(ubjr��)Åî}î(hhh]î(jw��)Åî}î(håπ.. figure:: images/derived-data-smith-package-with-img.png
Figure 5. Smith's new data package with a data visualization. Note that the resource map and metadata have new revisions.
îh]îh}î(h]îh]îh ]îh ]îh ]îåuriîå.images/derived-data-smith-package-with-img.pngîjÑ��}îj^��j��suh&jv��hj
��h'h(h)Keubjá��)Åî}î(håyFigure 5. Smith's new data package with a data visualization. Note that the resource map and metadata have new revisions.îh]îhå{Figure 5. Smith‚Äôs new data package with a data visualization. Note that the resource map and metadata have new revisions.îÖîÅî}î(hj ��hj��ubah}î(h]îh]îh ]îh ]îh ]îuh&jÜ��h'h(h)Kehj
��ubeh}î(h]îåid7îah]îh ]îh ]îh ]îuh&jq��h)Kehj∏��hhh'h(ubeh}î(h]îå derived-data-without-scriptsîah]îh ]îå derived data without scriptsîah ]îh ]îuh&h*hj(��hhh'h(h)KVubeh}î(h]îåexamplesîah]îh ]îåexamplesîah ]îh ]îuh&h*hh,hhh'h(h)KDubh+)Åî}î(hhh]î(h0)Åî}î(hå
Sample RDFîh]îhå
Sample RDFîÖîÅî}î(hjD��hjB��hhh'Nh)Nubah}î(h]îh]îh ]îh ]îh ]îuh&h/hj?��hhh'h(h)Khubhï)Åî}î(hX
��A sample RDF notation for our above Couture and Smith example (Figure 4) can be :download:`downloaded <_static/resourceMap_couture.1.1.rdf>` or viewed below. Note that the
primary data resource will need to be described in the RDFs for its derivations so that an RDF for a derived dataset will have all the information it needs to relate the primary
resource to the derived resource. This way, a SparQL query can be run within a derived dataset RDF to make the assertion that derived_metadata wasDerivedFrom primary_metadata.îh]î(håPA sample RDF notation for our above Couture and Smith example (Figure 4) can be îÖîÅî}î(håPA sample RDF notation for our above Couture and Smith example (Figure 4) can be îhjP��hhh'Nh)Nubh?ådownload_referenceîìî)Åî}î(hå<:download:`downloaded <_static/resourceMap_couture.1.1.rdf>`îh]îh�åliteralîìî)Åî}î(hj]��h]îhå
downloadedîÖîÅî}î(hhhja��ubah}î(h]îh]î(åxrefîådownloadîeh ]îh ]îh ]îuh&j_��hj[��ubah}î(h]îh]îh ]îh ]îh ]îåreftypeîjl��å refdomainîhå refexplicitîàå reftargetîå#_static/resourceMap_couture.1.1.rdfîårefdocîåore-model-expansionîårefwarnîâåfilenameîåresourceMap_couture.1.1.rdfîuh&jY��h'h(h)KihjP��ubhXÅ�� or viewed below. Note that the
primary data resource will need to be described in the RDFs for its derivations so that an RDF for a derived dataset will have all the information it needs to relate the primary
resource to the derived resource. This way, a SparQL query can be run within a derived dataset RDF to make the assertion that derived_metadata wasDerivedFrom primary_metadata.îÖîÅî}î(hXÅ�� or viewed below. Note that the
primary data resource will need to be described in the RDFs for its derivations so that an RDF for a derived dataset will have all the information it needs to relate the primary
resource to the derived resource. This way, a SparQL query can be run within a derived dataset RDF to make the assertion that derived_metadata wasDerivedFrom primary_metadata.îhjP��hhh'Nh)Nubeh}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)Kihj?��hhubh�å
literal_blockîìî)Åî}î(hXz��<rdf:RDF
xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"
xmlns:foaf="http://xmlns.com/foaf/0.1/"
xmlns:owl="http://www.w3.org/2002/07/owl#"
xmlns:dc="http://purl.org/dc/elements/1.1/"
xmlns:ore="http://www.openarchives.org/ore/terms/"
xmlns:dcterms="http://purl.org/dc/terms/"
xmlns:j.0="http://purl.org/spar/cito/"
xmlns:prov="http://www.w3.org/ns/prov#">
<rdf:Description rdf:about="https://cn.dataone.org/cn/v1/resolve/couture_data.1.1">
<ore:isAggregatedBy>https://cn.dataone.org/cn/v1/resolve/resourceMap_couture.1.1#aggregation</ore:isAggregatedBy>
<dcterms:identifier rdf:datatype="http://www.w3.org/2001/XMLSchema#string">couture_data.1.1</dcterms:identifier>
<j.0:isDocumentedBy rdf:resource="https://cn.dataone.org/cn/v1/resolve/couture_metadata.1.1"/>
<prov:wasGeneratedBy rdf:resource="https://cn.dataone.org/cn/v1/resolve/couture_composeScript.1.1"/>
<prov:wasDerivedFrom rdf:resource="https://cn.dataone.org/cn/v1/resolve/smith_data.1.1"/>
<prov:wasDerivedFrom rdf:resource="https://cn.dataone.org/cn/v1/resolve/smith_data.2.1"/>
</rdf:Description>
<rdf:Description rdf:about="https://cn.dataone.org/cn/v1/resolve/smith_data.1.1">
<ore:isAggregatedBy>https://cn.dataone.org/cn/v1/resolve/resourceMap_smith .1.1#aggregation</ore:isAggregatedBy>
<dcterms:identifier rdf:datatype="http://www.w3.org/2001/XMLSchema#string">smith_data.1.1</dcterms:identifier>
<j.0:isDocumentedBy rdf:resource="https://cn.dataone.org/cn/v1/resolve/smith_metadata.1.1"/>
</rdf:Description>
<rdf:Description rdf:about="https://cn.dataone.org/cn/v1/resolve/resourceMap_couture.1.1#aggregation">
<rdf:type rdf:resource="http://www.openarchives.org/ore/terms/Aggregation"/>
<ore:isDescribedBy rdf:resource="https://cn.dataone.org/cn/v1/resolve/resourceMap_couture.1.1"/>
<dc:title>DataONE Aggregation</dc:title>
<ore:aggregates rdf:resource="https://cn.dataone.org/cn/v1/resolve/couture_data.1.1"/>
<ore:aggregates rdf:resource="https://cn.dataone.org/cn/v1/resolve/couture_metadata.1.1"/>
<ore:aggregates rdf:resource="https://cn.dataone.org/cn/v1/resolve/couture_img.1.1"/>
<ore:aggregates rdf:resource="https://cn.dataone.org/cn/v1/resolve/couture_script.1.1"/>
<ore:aggregates rdf:resource="https://cn.dataone.org/cn/v1/resolve/couture_composeScript.1.1"/>
</rdf:Description>
<rdf:Description rdf:nodeID="A0">
<foaf:name rdf:datatype="http://www.w3.org/2001/XMLSchema#string">Java libclient</foaf:name>
<rdf:type rdf:resource="http://purl.org/dc/terms/Agent"/>
</rdf:Description>
<rdf:Description rdf:about="https://cn.dataone.org/cn/v1/resolve/resourceMap_couture.1.1">
<dcterms:modified rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2013-09-03T09:54:06.392-07:00</dcterms:modified>
<ore:describes rdf:resource="https://cn.dataone.org/cn/v1/resolve/resourceMap_couture.1.1#aggregation"/>
<rdf:type rdf:resource="http://www.openarchives.org/ore/terms/ResourceMap"/>
<dc:creator rdf:nodeID="A0"/>
<dcterms:identifier rdf:datatype="http://www.w3.org/2001/XMLSchema#string">resourceMap_couture.1.1</dcterms:identifier>
</rdf:Description>
<rdf:Description rdf:about="https://cn.dataone.org/cn/v1/resolve/couture_metadata.1.1">
<ore:isAggregatedBy>https://cn.dataone.org/cn/v1/resolve/resourceMap_couture.1.1#aggregation</ore:isAggregatedBy>
<dcterms:identifier rdf:datatype="http://www.w3.org/2001/XMLSchema#string">couture_metadata.1.1</dcterms:identifier>
<j.0:documents rdf:resource="https://cn.dataone.org/cn/v1/resolve/couture_data.1.1"/>
<j.0:documents rdf:resource="https://cn.dataone.org/cn/v1/resolve/couture_img.1.1"/>
<j.0:documents rdf:resource="https://cn.dataone.org/cn/v1/resolve/couture_script.1.1"/>
<j.0:documents rdf:resource="https://cn.dataone.org/cn/v1/resolve/couture_composeScript.1.1"/>
</rdf:Description>
<rdf:Description rdf:about="https://cn.dataone.org/cn/v1/resolve/couture_img.1.1">
<ore:isAggregatedBy>https://cn.dataone.org/cn/v1/resolve/resourceMap_couture.1.1#aggregation</ore:isAggregatedBy>
<dcterms:identifier rdf:datatype="http://www.w3.org/2001/XMLSchema#string">couture_img.1.1</dcterms:identifier>
<j.0:isDocumentedBy rdf:resource="https://cn.dataone.org/cn/v1/resolve/couture_metadata.1.1"/>
<prov:wasDerivedFrom rdf:resource="https://cn.dataone.org/cn/v1/resolve/couture_data.1.1"/>
<prov:wasGeneratedBy rdf:resource="https://cn.dataone.org/cn/v1/resolve/couture_script.1.1"/>
</rdf:Description>
<rdf:Description rdf:about="https://cn.dataone.org/cn/v1/resolve/couture_script.1.1">
<ore:isAggregatedBy>https://cn.dataone.org/cn/v1/resolve/resourceMap_couture.1.1#aggregation</ore:isAggregatedBy>
<dcterms:identifier rdf:datatype="http://www.w3.org/2001/XMLSchema#string">couture_script.1.1</dcterms:identifier>
<j.0:isDocumentedBy rdf:resource="https://cn.dataone.org/cn/v1/resolve/couture_metadata.1.1"/>
<prov:used rdf:resource="https://cn.dataone.org/cn/v1/resolve/couture_data.1.1"/>
<prov:generated rdf:resource="https://cn.dataone.org/cn/v1/resolve/couture_img.1.1"/>
<prov:wasInformedby rdf:resource="https://cn.dataone.org/cn/v1/resolve/couture_composeScript.1.1" />
</rdf:Description>
<rdf:Description rdf:about="https://cn.dataone.org/cn/v1/resolve/couture_composeScript.1.1">
<ore:isAggregatedBy>https://cn.dataone.org/cn/v1/resolve/resourceMap_couture.1.1#aggregation</ore:isAggregatedBy>
<dcterms:identifier rdf:datatype="http://www.w3.org/2001/XMLSchema#string">couture_composeScript.1.1</dcterms:identifier>
<j.0:isDocumentedBy rdf:resource="https://cn.dataone.org/cn/v1/resolve/couture_metadata.1.1"/>
<prov:used rdf:resource="https://cn.dataone.org/cn/v1/resolve/smith_data.1.1"/>
<prov:used rdf:resource="https://cn.dataone.org/cn/v1/resolve/smith_data.2.1"/>
<prov:generated rdf:resource="https://cn.dataone.org/cn/v1/resolve/couture_data.1.1"/>
</rdf:Description>
</rdf:RDF>îh]îhXz��<rdf:RDF
xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"
xmlns:foaf="http://xmlns.com/foaf/0.1/"
xmlns:owl="http://www.w3.org/2002/07/owl#"
xmlns:dc="http://purl.org/dc/elements/1.1/"
xmlns:ore="http://www.openarchives.org/ore/terms/"
xmlns:dcterms="http://purl.org/dc/terms/"
xmlns:j.0="http://purl.org/spar/cito/"
xmlns:prov="http://www.w3.org/ns/prov#">
<rdf:Description rdf:about="https://cn.dataone.org/cn/v1/resolve/couture_data.1.1">
<ore:isAggregatedBy>https://cn.dataone.org/cn/v1/resolve/resourceMap_couture.1.1#aggregation</ore:isAggregatedBy>
<dcterms:identifier rdf:datatype="http://www.w3.org/2001/XMLSchema#string">couture_data.1.1</dcterms:identifier>
<j.0:isDocumentedBy rdf:resource="https://cn.dataone.org/cn/v1/resolve/couture_metadata.1.1"/>
<prov:wasGeneratedBy rdf:resource="https://cn.dataone.org/cn/v1/resolve/couture_composeScript.1.1"/>
<prov:wasDerivedFrom rdf:resource="https://cn.dataone.org/cn/v1/resolve/smith_data.1.1"/>
<prov:wasDerivedFrom rdf:resource="https://cn.dataone.org/cn/v1/resolve/smith_data.2.1"/>
</rdf:Description>
<rdf:Description rdf:about="https://cn.dataone.org/cn/v1/resolve/smith_data.1.1">
<ore:isAggregatedBy>https://cn.dataone.org/cn/v1/resolve/resourceMap_smith .1.1#aggregation</ore:isAggregatedBy>
<dcterms:identifier rdf:datatype="http://www.w3.org/2001/XMLSchema#string">smith_data.1.1</dcterms:identifier>
<j.0:isDocumentedBy rdf:resource="https://cn.dataone.org/cn/v1/resolve/smith_metadata.1.1"/>
</rdf:Description>
<rdf:Description rdf:about="https://cn.dataone.org/cn/v1/resolve/resourceMap_couture.1.1#aggregation">
<rdf:type rdf:resource="http://www.openarchives.org/ore/terms/Aggregation"/>
<ore:isDescribedBy rdf:resource="https://cn.dataone.org/cn/v1/resolve/resourceMap_couture.1.1"/>
<dc:title>DataONE Aggregation</dc:title>
<ore:aggregates rdf:resource="https://cn.dataone.org/cn/v1/resolve/couture_data.1.1"/>
<ore:aggregates rdf:resource="https://cn.dataone.org/cn/v1/resolve/couture_metadata.1.1"/>
<ore:aggregates rdf:resource="https://cn.dataone.org/cn/v1/resolve/couture_img.1.1"/>
<ore:aggregates rdf:resource="https://cn.dataone.org/cn/v1/resolve/couture_script.1.1"/>
<ore:aggregates rdf:resource="https://cn.dataone.org/cn/v1/resolve/couture_composeScript.1.1"/>
</rdf:Description>
<rdf:Description rdf:nodeID="A0">
<foaf:name rdf:datatype="http://www.w3.org/2001/XMLSchema#string">Java libclient</foaf:name>
<rdf:type rdf:resource="http://purl.org/dc/terms/Agent"/>
</rdf:Description>
<rdf:Description rdf:about="https://cn.dataone.org/cn/v1/resolve/resourceMap_couture.1.1">
<dcterms:modified rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2013-09-03T09:54:06.392-07:00</dcterms:modified>
<ore:describes rdf:resource="https://cn.dataone.org/cn/v1/resolve/resourceMap_couture.1.1#aggregation"/>
<rdf:type rdf:resource="http://www.openarchives.org/ore/terms/ResourceMap"/>
<dc:creator rdf:nodeID="A0"/>
<dcterms:identifier rdf:datatype="http://www.w3.org/2001/XMLSchema#string">resourceMap_couture.1.1</dcterms:identifier>
</rdf:Description>
<rdf:Description rdf:about="https://cn.dataone.org/cn/v1/resolve/couture_metadata.1.1">
<ore:isAggregatedBy>https://cn.dataone.org/cn/v1/resolve/resourceMap_couture.1.1#aggregation</ore:isAggregatedBy>
<dcterms:identifier rdf:datatype="http://www.w3.org/2001/XMLSchema#string">couture_metadata.1.1</dcterms:identifier>
<j.0:documents rdf:resource="https://cn.dataone.org/cn/v1/resolve/couture_data.1.1"/>
<j.0:documents rdf:resource="https://cn.dataone.org/cn/v1/resolve/couture_img.1.1"/>
<j.0:documents rdf:resource="https://cn.dataone.org/cn/v1/resolve/couture_script.1.1"/>
<j.0:documents rdf:resource="https://cn.dataone.org/cn/v1/resolve/couture_composeScript.1.1"/>
</rdf:Description>
<rdf:Description rdf:about="https://cn.dataone.org/cn/v1/resolve/couture_img.1.1">
<ore:isAggregatedBy>https://cn.dataone.org/cn/v1/resolve/resourceMap_couture.1.1#aggregation</ore:isAggregatedBy>
<dcterms:identifier rdf:datatype="http://www.w3.org/2001/XMLSchema#string">couture_img.1.1</dcterms:identifier>
<j.0:isDocumentedBy rdf:resource="https://cn.dataone.org/cn/v1/resolve/couture_metadata.1.1"/>
<prov:wasDerivedFrom rdf:resource="https://cn.dataone.org/cn/v1/resolve/couture_data.1.1"/>
<prov:wasGeneratedBy rdf:resource="https://cn.dataone.org/cn/v1/resolve/couture_script.1.1"/>
</rdf:Description>
<rdf:Description rdf:about="https://cn.dataone.org/cn/v1/resolve/couture_script.1.1">
<ore:isAggregatedBy>https://cn.dataone.org/cn/v1/resolve/resourceMap_couture.1.1#aggregation</ore:isAggregatedBy>
<dcterms:identifier rdf:datatype="http://www.w3.org/2001/XMLSchema#string">couture_script.1.1</dcterms:identifier>
<j.0:isDocumentedBy rdf:resource="https://cn.dataone.org/cn/v1/resolve/couture_metadata.1.1"/>
<prov:used rdf:resource="https://cn.dataone.org/cn/v1/resolve/couture_data.1.1"/>
<prov:generated rdf:resource="https://cn.dataone.org/cn/v1/resolve/couture_img.1.1"/>
<prov:wasInformedby rdf:resource="https://cn.dataone.org/cn/v1/resolve/couture_composeScript.1.1" />
</rdf:Description>
<rdf:Description rdf:about="https://cn.dataone.org/cn/v1/resolve/couture_composeScript.1.1">
<ore:isAggregatedBy>https://cn.dataone.org/cn/v1/resolve/resourceMap_couture.1.1#aggregation</ore:isAggregatedBy>
<dcterms:identifier rdf:datatype="http://www.w3.org/2001/XMLSchema#string">couture_composeScript.1.1</dcterms:identifier>
<j.0:isDocumentedBy rdf:resource="https://cn.dataone.org/cn/v1/resolve/couture_metadata.1.1"/>
<prov:used rdf:resource="https://cn.dataone.org/cn/v1/resolve/smith_data.1.1"/>
<prov:used rdf:resource="https://cn.dataone.org/cn/v1/resolve/smith_data.2.1"/>
<prov:generated rdf:resource="https://cn.dataone.org/cn/v1/resolve/couture_data.1.1"/>
</rdf:Description>
</rdf:RDF>îÖîÅî}î(hhhjç��ubah}î(h]îh]îh ]îh ]îh ]îh$h%uh&jã��h)Kohj?��hhh'h(ubeh}î(h]îå
sample-rdfîah]îh ]îå
sample rdfîah ]îh ]îuh&h*hh,hhh'h(h)Khubh+)Åî}î(hhh]î(h0)Åî}î(håIndexingîh]îhåIndexingîÖîÅî}î(hj®��hj¶��hhh'Nh)Nubah}î(h]îh]îh ]îh ]îh ]îuh&h/hj£��hhh'h(h)K…ubhï)Åî}î(håTThe Metacat Index will index some of these relationships mainly to inform MetacatUI.îh]îhåTThe Metacat Index will index some of these relationships mainly to inform MetacatUI.îÖîÅî}î(hj∂��hj¥��hhh'Nh)Nubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)K hj£��hhubhu)Åî}î(hhh]îhz)Åî}î(hå~New Index Fields
* ``wasGeneratedBy``
* ``generated``
* ``used``
* ``wasDerivedFrom``
* ``wasInformedBy``
* ``hadDerivation``
îh]î(hÄ)Åî}î(håNew Index Fieldsîh]îhåNew Index FieldsîÖîÅî}î(hjÀ��hj…��ubah}î(h]îh]îh ]îh ]îh ]îuh&hh'h(h)K“hj≈��ubhê)Åî}î(hhh]îh∆)Åî}î(hhh]î(hÀ)Åî}î(hå``wasGeneratedBy``îh]îhï)Åî}î(hjfl��h]îj`��)Åî}î(hjfl��h]îhåwasGeneratedByîÖîÅî}î(hhhj‰��ubah}î(h]îh]îh ]îh ]îh ]îuh&j_��hj·��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)KÕhj›��ubah}î(h]îh]îh ]îh ]îh ]îuh&h hj⁄��ubhÀ)Åî}î(hå
``generated``îh]îhï)Åî}î(hjˇ��h]îj`��)Åî}î(hjˇ��h]îhå generatedîÖîÅî}î(hhhj��ubah}î(h]îh]îh ]îh ]îh ]îuh&j_��hj��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)KŒhj˝��ubah}î(h]îh]îh ]îh ]îh ]îuh&h hj⁄��ubhÀ)Åî}î(hå``used``îh]îhï)Åî}î(hj ��h]îj`��)Åî}î(hj ��h]îhåusedîÖîÅî}î(hhhj$��ubah}î(h]îh]îh ]îh ]îh ]îuh&j_��hj!��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)Kœhj ��ubah}î(h]îh]îh ]îh ]îh ]îuh&h hj⁄��ubhÀ)Åî}î(hå``wasDerivedFrom``îh]îhï)Åî}î(hj?��h]îj`��)Åî}î(hj?��h]îhåwasDerivedFromîÖîÅî}î(hhhjD��ubah}î(h]îh]îh ]îh ]îh ]îuh&j_��hjA��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)K–hj=��ubah}î(h]îh]îh ]îh ]îh ]îuh&h hj⁄��ubhÀ)Åî}î(hå``wasInformedBy``îh]îhï)Åî}î(hj_��h]îj`��)Åî}î(hj_��h]îhå
wasInformedByîÖîÅî}î(hhhjd��ubah}î(h]îh]îh ]îh ]îh ]îuh&j_��hja��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)K—hj]��ubah}î(h]îh]îh ]îh ]îh ]îuh&h hj⁄��ubhÀ)Åî}î(hå``hadDerivation``
îh]îhï)Åî}î(hå``hadDerivation``îh]îj`��)Åî}î(hjÉ��h]îhå
hadDerivationîÖîÅî}î(hhhjÖ��ubah}î(h]îh]îh ]îh ]îh ]îuh&j_��hjÅ��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)K“hj}��ubah}î(h]îh]îh ]îh ]îh ]îuh&h hj⁄��ubeh}î(h]îh]îh ]îh ]îh ]îhÍj^��uh&h≈h'h(h)KÕhj◊��ubah}î(h]îh]îh ]îh ]îh ]îuh&hèhj≈��ubeh}î(h]îh]îh ]îh ]îh ]îuh&hyh'h(h)K“hj¬��ubah}î(h]îh]îh ]îh ]îh ]îuh&hthj£��hhh'Nh)Nubhï)Åî}î(hX¿��All of these fields are taken directly from the PROV ontology, except for ``hadDerivation``. Because MetacatUI navigation is metadata-centric
(i.e. metadata are retrieved and listed as search results and details on datasets are viewed via the metadata view [/#view]), it is helpful to
use SparQL to infer relationships between metadata so that it isn't necessary to send multiple queries to the index to retrieve information about
derived datasets.îh]î(håJAll of these fields are taken directly from the PROV ontology, except for îÖîÅî}î(håJAll of these fields are taken directly from the PROV ontology, except for îhj∂��hhh'Nh)Nubj`��)Åî}î(hå``hadDerivation``îh]îhå
hadDerivationîÖîÅî}î(hhhjø��ubah}î(h]îh]îh ]îh ]îh ]îuh&j_��hj∂��ubhXg��. Because MetacatUI navigation is metadata-centric
(i.e. metadata are retrieved and listed as search results and details on datasets are viewed via the metadata view [/#view]), it is helpful to
use SparQL to infer relationships between metadata so that it isn’t necessary to send multiple queries to the index to retrieve information about
derived datasets.îÖîÅî}î(hXe��. Because MetacatUI navigation is metadata-centric
(i.e. metadata are retrieved and listed as search results and details on datasets are viewed via the metadata view [/#view]), it is helpful to
use SparQL to infer relationships between metadata so that it isn't necessary to send multiple queries to the index to retrieve information about
derived datasets.îhj∂��hhh'Nh)Nubeh}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)K‘hj£��hhubhï)Åî}î(hX(��SparQL will infer that the derived metadata wasDerivedFrom the primary source metadata and the Metacat index will index both this relationship and it's inverse,
hadDerivation, for easier querying. The SparQL query used to determine the derived metadata for a primary metadata would look like:îh]îhX*��SparQL will infer that the derived metadata wasDerivedFrom the primary source metadata and the Metacat index will index both this relationship and it‚Äôs inverse,
hadDerivation, for easier querying. The SparQL query used to determine the derived metadata for a primary metadata would look like:îÖîÅî}î(hj⁄��hjÿ��hhh'Nh)Nubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)KŸhj£��hhubjå��)Åî}î(hXº��SELECT ?primary_metadata_pid ?derived_metadata_pid
WHERE {
?primary_data ore:isDocumentedBy ?primary_metadata .
?primary_metadata dcterms:identifier ?primary_metadata_pid .
?derived_data prov:wasDerivedFrom ?primary_data .
?derived_data ore:isDocumentedBy ?derived_metadata .
?derived_metadata dcterms:identifier ?derived_metadata_pid .
}îh]îhXº��SELECT ?primary_metadata_pid ?derived_metadata_pid
WHERE {
?primary_data ore:isDocumentedBy ?primary_metadata .
?primary_metadata dcterms:identifier ?primary_metadata_pid .
?derived_data prov:wasDerivedFrom ?primary_data .
?derived_data ore:isDocumentedBy ?derived_metadata .
?derived_metadata dcterms:identifier ?derived_metadata_pid .
}îÖîÅî}î(hhhjÊ��ubah}î(h]îh]îh ]îh ]îh ]îh$h%uh&jã��h)Kfihj£��hhh'h(ubhï)Åî}î(hå®More information about inverses in PROV-O and in particular, ``hadDerivation``, see `section B of the PROV documentation <http://www.w3.org/TR/prov-o/#inverse-names>`_.îh]î(hå=More information about inverses in PROV-O and in particular, îÖîÅî}î(hå=More information about inverses in PROV-O and in particular, îhjÙ��hhh'Nh)Nubj`��)Åî}î(hå``hadDerivation``îh]îhå
hadDerivationîÖîÅî}î(hhhj˝��ubah}î(h]îh]îh ]îh ]îh ]îuh&j_��hjÙ��ubhå, see îÖîÅî}î(hå, see îhjÙ��hhh'Nh)NubjF��)Åî}î(håS`section B of the PROV documentation <http://www.w3.org/TR/prov-o/#inverse-names>`_îh]îhå#section B of the PROV documentationîÖîÅî}î(hhhj��ubah}î(h]îh]îh ]îh ]îh ]îånameîå#section B of the PROV documentationîjW��å*http://www.w3.org/TR/prov-o/#inverse-namesîuh&jE��hjÙ��ubhS)Åî}î(hå- <http://www.w3.org/TR/prov-o/#inverse-names>îh]îh}î(h]îå#section-b-of-the-prov-documentationîah]îh ]îå#section b of the prov documentationîah ]îh ]îårefuriîj ��uh&hRjf��KhjÙ��ubhå.îÖîÅî}î(hå.îhjÙ��hhh'Nh)Nubeh}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)KÈhj£��hhubh+)Åî}î(hhh]î(h0)Åî}î(håExampleîh]îhåExampleîÖîÅî}î(hj>��hj<��hhh'Nh)Nubah}î(h]îh]îh ]îh ]îh ]îuh&h/hj9��hhh'h(h)KÏubhï)Åî}î(håÉUsing the above Couture and Smith example (Figure 4), the following fields and values from the PROV relationships would be indexed.îh]îhåÉUsing the above Couture and Smith example (Figure 4), the following fields and values from the PROV relationships would be indexed.îÖîÅî}î(hjL��hjJ��hhh'Nh)Nubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)KÓhj9��hhubh�åtableîìî)Åî}î(hhh]îh�åtgroupîìî)Åî}î(hhh]î(h�åcolspecîìî)Åî}î(hhh]îh}î(h]îh]îh ]îh ]îh ]îåcolwidthîKuh&jb��hj_��ubjc��)Åî}î(hhh]îh}î(h]îh]îh ]îh ]îh ]îåcolwidthîKuh&jb��hj_��ubjc��)Åî}î(hhh]îh}î(h]îh]îh ]îh ]îh ]îåcolwidthîKuh&jb��hj_��ubjc��)Åî}î(hhh]îh}î(h]îh]îh ]îh ]îh ]îåcolwidthîK uh&jb��hj_��ubh�åtheadîìî)Åî}î(hhh]îh�årowîìî)Åî}î(hhh]î(h�åentryîìî)Åî}î(hhh]îhï)Åî}î(håObjectîh]îhåObjectîÖîÅî}î(hjù��hjõ��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)KÒhjò��ubah}î(h]îh]îh ]îh ]îh ]îuh&jñ��hjì��ubjó��)Åî}î(hhh]îhï)Åî}î(hå
Field Nameîh]îhå
Field NameîÖîÅî}î(hj¥��hj≤��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)KÒhjØ��ubah}î(h]îh]îh ]îh ]îh ]îuh&jñ��hjì��ubjó��)Åî}î(hhh]îhï)Åî}î(hå
Field Typeîh]îhå
Field TypeîÖîÅî}î(hjÀ��hj…��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)KÒhj∆��ubah}î(h]îh]îh ]îh ]îh ]îuh&jñ��hjì��ubjó��)Åî}î(hhh]îhï)Åî}î(håValueîh]îhåValueîÖîÅî}î(hj‚��hj‡��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)KÒhj›��ubah}î(h]îh]îh ]îh ]îh ]îuh&jñ��hjì��ubeh}î(h]îh]îh ]îh ]îh ]îuh&jë��hjé��ubah}î(h]îh]îh ]îh ]îh ]îuh&jå��hj_��ubh�åtbodyîìî)Åî}î(hhh]î(jí��)Åî}î(hhh]î(jó��)Åî}î(hhh]îhï)Åî}î(håcouture_metadata.1.1îh]îhåcouture_metadata.1.1îÖîÅî}î(hj
��hj ��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)KÛhj��ubah}î(h]îh]îh ]îh ]îh ]îuh&jñ��hj��ubjó��)Åî}î(hhh]îhï)Åî}î(håwasDerivedFromîh]îhåwasDerivedFromîÖîÅî}î(hj$��hj"��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)KÛhj ��ubah}î(h]îh]îh ]îh ]îh ]îuh&jñ��hj��ubjó��)Åî}î(hhh]îhï)Åî}î(håstring, multivaluedîh]îhåstring, multivaluedîÖîÅî}î(hj;��hj9��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)KÛhj6��ubah}î(h]îh]îh ]îh ]îh ]îuh&jñ��hj��ubjó��)Åî}î(hhh]îhï)Åî}î(håsmith_metadata.1.1îh]îhåsmith_metadata.1.1îÖîÅî}î(hjR��hjP��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)KÛhjM��ubah}î(h]îh]îh ]îh ]îh ]îuh&jñ��hj��ubeh}î(h]îh]îh ]îh ]îh ]îuh&jë��hj��ubjí��)Åî}î(hhh]î(jó��)Åî}î(hhh]îhï)Åî}î(håsmith_metadata.1.1îh]îhåsmith_metadata.1.1îÖîÅî}î(hjr��hjp��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)Kıhjm��ubah}î(h]îh]îh ]îh ]îh ]îuh&jñ��hjj��ubjó��)Åî}î(hhh]îhï)Åî}î(hå
hadDerivationîh]îhå
hadDerivationîÖîÅî}î(hjâ��hjá��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)KıhjÑ��ubah}î(h]îh]îh ]îh ]îh ]îuh&jñ��hjj��ubjó��)Åî}î(hhh]îhï)Åî}î(håstring, multivaluedîh]îhåstring, multivaluedîÖîÅî}î(hj†��hjû��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)Kıhjõ��ubah}î(h]îh]îh ]îh ]îh ]îuh&jñ��hjj��ubjó��)Åî}î(hhh]îhï)Åî}î(håcouture_metadata.1.1îh]îhåcouture_metadata.1.1îÖîÅî}î(hj∑��hjµ��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)Kıhj≤��ubah}î(h]îh]îh ]îh ]îh ]îuh&jñ��hjj��ubeh}î(h]îh]îh ]îh ]îh ]îuh&jë��hj��ubjí��)Åî}î(hhh]î(jó��)Åî}î(hhh]îhï)Åî}î(håcouture_img.1.1îh]îhåcouture_img.1.1îÖîÅî}î(hj◊��hj’��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)K˜hj“��ubah}î(h]îh]îh ]îh ]îh ]îuh&jñ��hjœ��ubjó��)Åî}î(hhh]îhï)Åî}î(håwasGeneratedbyîh]îhåwasGeneratedbyîÖîÅî}î(hjÓ��hjÏ��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)K˜hjÈ��ubah}î(h]îh]îh ]îh ]îh ]îuh&jñ��hjœ��ubjó��)Åî}î(hhh]îhï)Åî}î(håstring, multivaluedîh]îhåstring, multivaluedîÖîÅî}î(hj ��hj ��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)K˜hj� ��ubah}î(h]îh]îh ]îh ]îh ]îuh&jñ��hjœ��ubjó��)Åî}î(hhh]îhï)Åî}î(håcouture_script.1.1îh]îhåcouture_script.1.1îÖîÅî}î(hj ��hj ��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)K˜hj ��ubah}î(h]îh]îh ]îh ]îh ]îuh&jñ��hjœ��ubeh}î(h]îh]îh ]îh ]îh ]îuh&jë��hj��ubjí��)Åî}î(hhh]î(jó��)Åî}î(hhh]îhï)Åî}î(håcouture_img.1.1îh]îhåcouture_img.1.1îÖîÅî}î(hj< ��hj: ��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)K˘hj7 ��ubah}î(h]îh]îh ]îh ]îh ]îuh&jñ��hj4 ��ubjó��)Åî}î(hhh]îhï)Åî}î(håwasDerivedFromîh]îhåwasDerivedFromîÖîÅî}î(hjS ��hjQ ��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)K˘hjN ��ubah}î(h]îh]îh ]îh ]îh ]îuh&jñ��hj4 ��ubjó��)Åî}î(hhh]îhï)Åî}î(håstring, multivaluedîh]îhåstring, multivaluedîÖîÅî}î(hjj ��hjh ��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)K˘hje ��ubah}î(h]îh]îh ]îh ]îh ]îuh&jñ��hj4 ��ubjó��)Åî}î(hhh]îhï)Åî}î(håcouture_data.1.1îh]îhåcouture_data.1.1îÖîÅî}î(hjÅ ��hj ��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)K˘hj| ��ubah}î(h]îh]îh ]îh ]îh ]îuh&jñ��hj4 ��ubeh}î(h]îh]îh ]îh ]îh ]îuh&jë��hj��ubjí��)Åî}î(hhh]î(jó��)Åî}î(hhh]îhï)Åî}î(håcouture_script.1.1îh]îhåcouture_script.1.1îÖîÅî}î(hj° ��hjü ��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)K˚hjú ��ubah}î(h]îh]îh ]îh ]îh ]îuh&jñ��hjô ��ubjó��)Åî}î(hhh]îhï)Åî}î(håusedîh]îhåusedîÖîÅî}î(hj∏ ��hj∂ ��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)K˚hj≥ ��ubah}î(h]îh]îh ]îh ]îh ]îuh&jñ��hjô ��ubjó��)Åî}î(hhh]îhï)Åî}î(håstring, multivaluedîh]îhåstring, multivaluedîÖîÅî}î(hjœ ��hjÕ ��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)K˚hj ��ubah}î(h]îh]îh ]îh ]îh ]îuh&jñ��hjô ��ubjó��)Åî}î(hhh]îhï)Åî}î(håcouture_data.1.1îh]îhåcouture_data.1.1îÖîÅî}î(hjÊ ��hj‰ ��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)K˚hj· ��ubah}î(h]îh]îh ]îh ]îh ]îuh&jñ��hjô ��ubeh}î(h]îh]îh ]îh ]îh ]îuh&jë��hj��ubjí��)Åî}î(hhh]î(jó��)Åî}î(hhh]îhï)Åî}î(håcouture_script.1.1îh]îhåcouture_script.1.1îÖîÅî}î(hj
��hj
��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)K˝hj
��ubah}î(h]îh]îh ]îh ]îh ]îuh&jñ��hj˛ ��ubjó��)Åî}î(hhh]îhï)Åî}î(hå
wasInformedByîh]îhå
wasInformedByîÖîÅî}î(hj
��hj
��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)K˝hj
��ubah}î(h]îh]îh ]îh ]îh ]îuh&jñ��hj˛ ��ubjó��)Åî}î(hhh]îhï)Åî}î(håstring, multivaluedîh]îhåstring, multivaluedîÖîÅî}î(hj4
��hj2
��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)K˝hj/
��ubah}î(h]îh]îh ]îh ]îh ]îuh&jñ��hj˛ ��ubjó��)Åî}î(hhh]îhï)Åî}î(håcouture_composeScript.1.1îh]îhåcouture_composeScript.1.1îÖîÅî}î(hjK
��hjI
��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)K˝hjF
��ubah}î(h]îh]îh ]îh ]îh ]îuh&jñ��hj˛ ��ubeh}î(h]îh]îh ]îh ]îh ]îuh&jë��hj��ubjí��)Åî}î(hhh]î(jó��)Åî}î(hhh]îhï)Åî}î(håcouture_script.1.1îh]îhåcouture_script.1.1îÖîÅî}î(hjk
��hji
��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)Kˇhjf
��ubah}î(h]îh]îh ]îh ]îh ]îuh&jñ��hjc
��ubjó��)Åî}î(hhh]îhï)Åî}î(hå generatedîh]îhå generatedîÖîÅî}î(hjÇ
��hjÄ
��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)Kˇhj}
��ubah}î(h]îh]îh ]îh ]îh ]îuh&jñ��hjc
��ubjó��)Åî}î(hhh]îhï)Åî}î(håstring, multivaluedîh]îhåstring, multivaluedîÖîÅî}î(hjô
��hjó
��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)Kˇhjî
��ubah}î(h]îh]îh ]îh ]îh ]îuh&jñ��hjc
��ubjó��)Åî}î(hhh]îhï)Åî}î(håcouture_img.1.1îh]îhåcouture_img.1.1îÖîÅî}î(hj∞
��hjÆ
��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)Kˇhj´
��ubah}î(h]îh]îh ]îh ]îh ]îuh&jñ��hjc
��ubeh}î(h]îh]îh ]îh ]îh ]îuh&jë��hj��ubjí��)Åî}î(hhh]î(jó��)Åî}î(hhh]îhï)Åî}î(håcouture_data.1.1îh]îhåcouture_data.1.1îÖîÅî}î(hj–
��hjŒ
��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)MhjÀ
��ubah}î(h]îh]îh ]îh ]îh ]îuh&jñ��hj»
��ubjó��)Åî}î(hhh]îhï)Åî}î(håwasGeneratedByîh]îhåwasGeneratedByîÖîÅî}î(hjÁ
��hjÂ
��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)Mhj‚
��ubah}î(h]îh]îh ]îh ]îh ]îuh&jñ��hj»
��ubjó��)Åî}î(hhh]îhï)Åî}î(håstring, multivaluedîh]îhåstring, multivaluedîÖîÅî}î(hj˛
��hj¸
��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)Mhj˘
��ubah}î(h]îh]îh ]îh ]îh ]îuh&jñ��hj»
��ubjó��)Åî}î(hhh]îhï)Åî}î(håcouture_composeScript.1.1îh]îhåcouture_composeScript.1.1îÖîÅî}î(hj ��hj ��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)Mhj ��ubah}î(h]îh]îh ]îh ]îh ]îuh&jñ��hj»
��ubeh}î(h]îh]îh ]îh ]îh ]îuh&jë��hj��ubjí��)Åî}î(hhh]î(jó��)Åî}î(hhh]îhï)Åî}î(håcouture_data.1.1îh]îhåcouture_data.1.1îÖîÅî}î(hj5 ��hj3 ��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)Mhj0 ��ubah}î(h]îh]îh ]îh ]îh ]îuh&jñ��hj- ��ubjó��)Åî}î(hhh]îhï)Åî}î(håwasDerivedFromîh]îhåwasDerivedFromîÖîÅî}î(hjL ��hjJ ��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)MhjG ��ubah}î(h]îh]îh ]îh ]îh ]îuh&jñ��hj- ��ubjó��)Åî}î(hhh]îhï)Åî}î(håstring, multivaluedîh]îhåstring, multivaluedîÖîÅî}î(hjc ��hja ��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)Mhj^ ��ubah}î(h]îh]îh ]îh ]îh ]îuh&jñ��hj- ��ubjó��)Åî}î(hhh]îhï)Åî}î(hå smith_data.1.1, smith_data.2.1îh]îhå smith_data.1.1, smith_data.2.1îÖîÅî}î(hjz ��hjx ��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)Mhju ��ubah}î(h]îh]îh ]îh ]îh ]îuh&jñ��hj- ��ubeh}î(h]îh]îh ]îh ]îh ]îuh&jë��hj��ubjí��)Åî}î(hhh]î(jó��)Åî}î(hhh]îhï)Åî}î(håcouture_composeScript.1.1îh]îhåcouture_composeScript.1.1îÖîÅî}î(hjö ��hjò ��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)Mhjï ��ubah}î(h]îh]îh ]îh ]îh ]îuh&jñ��hjí ��ubjó��)Åî}î(hhh]îhï)Åî}î(håusedîh]îhåusedîÖîÅî}î(hj± ��hjØ ��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)Mhj¨ ��ubah}î(h]îh]îh ]îh ]îh ]îuh&jñ��hjí ��ubjó��)Åî}î(hhh]îhï)Åî}î(håstring, multivaluedîh]îhåstring, multivaluedîÖîÅî}î(hj» ��hj∆ ��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)Mhj√ ��ubah}î(h]îh]îh ]îh ]îh ]îuh&jñ��hjí ��ubjó��)Åî}î(hhh]îhï)Åî}î(hå smith_data.1.1, smith_data.2.1îh]îhå smith_data.1.1, smith_data.2.1îÖîÅî}î(hjfl ��hj› ��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)Mhj⁄ ��ubah}î(h]îh]îh ]îh ]îh ]îuh&jñ��hjí ��ubeh}î(h]îh]îh ]îh ]îh ]îuh&jë��hj��ubjí��)Åî}î(hhh]î(jó��)Åî}î(hhh]îhï)Åî}î(håcouture_composeScript.1.1îh]îhåcouture_composeScript.1.1îÖîÅî}î(hjˇ ��hj˝ ��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)Mhj˙ ��ubah}î(h]îh]îh ]îh ]îh ]îuh&jñ��hj˜ ��ubjó��)Åî}î(hhh]îhï)Åî}î(hå generatedîh]îhå generatedîÖîÅî}î(hj ��hj ��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)Mhj ��ubah}î(h]îh]îh ]îh ]îh ]îuh&jñ��hj˜ ��ubjó��)Åî}î(hhh]îhï)Åî}î(håstring, multivaluedîh]îhåstring, multivaluedîÖîÅî}î(hj- ��hj+ ��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)Mhj( ��ubah}î(h]îh]îh ]îh ]îh ]îuh&jñ��hj˜ ��ubjó��)Åî}î(hhh]îhï)Åî}î(håcouture_data.1.1îh]îhåcouture_data.1.1îÖîÅî}î(hjD ��hjB ��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)Mhj? ��ubah}î(h]îh]îh ]îh ]îh ]îuh&jñ��hj˜ ��ubeh}î(h]îh]îh ]îh ]îh ]îuh&jë��hj��ubeh}î(h]îh]îh ]îh ]îh ]îuh&j���hj_��ubeh}î(h]îh]îh ]îh ]îh ]îåcolsîKuh&j]��hjZ��ubah}î(h]îh]îh ]îh ]îh ]îuh&jX��hj9��hhh'h(h)Nubeh}î(h]îåexampleîah]îh ]îåexampleîah ]îh ]îuh&h*hj£��hhh'h(h)KÏubh+)Åî}î(hhh]î(h0)Åî}î(håQueriesîh]îhåQueriesîÖîÅî}î(hj| ��hjz ��hhh'Nh)Nubah}î(h]îh]îh ]îh ]îh ]îuh&h/hjw ��hhh'h(h)M ubhï)Åî}î(hX≥��These indexed fields will be used primarily by MetacatUI to determine relationships between resources. An example use case is the MetacatUI metadata view (/#view/{pid}).
When a user navigates to the metadata view for a primary resource, such as smith_metadata.1.1 from the above example, MetacatUI can send a query to the index to look for
derived resources that the user might be interested in. Some pseduocode to describe this logic:îh]îhX≥��These indexed fields will be used primarily by MetacatUI to determine relationships between resources. An example use case is the MetacatUI metadata view (/#view/{pid}).
When a user navigates to the metadata view for a primary resource, such as smith_metadata.1.1 from the above example, MetacatUI can send a query to the index to look for
derived resources that the user might be interested in. Some pseduocode to describe this logic:îÖîÅî}î(hjä ��hjà ��hhh'Nh)Nubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)M hjw ��hhubjå��)Åî}î(hå©if(this_metadata.hadDerivation){
hadDerivation = this_metadata.hadDerivation;
sendQuery("q=isDocumentedBy:" + hadDerivation + "+-obsoletedBy:*&fl=id");
}îh]îhå©if(this_metadata.hadDerivation){
hadDerivation = this_metadata.hadDerivation;
sendQuery("q=isDocumentedBy:" + hadDerivation + "+-obsoletedBy:*&fl=id");
}îÖîÅî}î(hhhjñ ��ubah}î(h]îh]îh ]îh ]îh ]îh$h%uh&jã��h)Mhjw ��hhh'h(ubhï)Åî}î(håÔThis query would retrieve the IDs of objects which are documented by metadata that is derived from the metadata currently being viewed. In the above Amith and Couture example (Figure 4), the following IDs
would be returned from this query:îh]îhåÔThis query would retrieve the IDs of objects which are documented by metadata that is derived from the metadata currently being viewed. In the above Amith and Couture example (Figure 4), the following IDs
would be returned from this query:îÖîÅî}î(hj¶ ��hj§ ��hhh'Nh)Nubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)Mhjw ��hhubh∆)Åî}î(hhh]î(hÀ)Åî}î(hå ``couture_composeScript.1.1``îh]îhï)Åî}î(hj∑ ��h]îj`��)Åî}î(hj∑ ��h]îhåcouture_composeScript.1.1îÖîÅî}î(hhhjº ��ubah}î(h]îh]îh ]îh ]îh ]îuh&j_��hjπ ��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)M hjµ ��ubah}î(h]îh]îh ]îh ]îh ]îuh&h hj≤ ��hhh'h(h)NubhÀ)Åî}î(hå``couture_script.1.1``îh]îhï)Åî}î(hj◊ ��h]îj`��)Åî}î(hj◊ ��h]îhåcouture_script.1.1îÖîÅî}î(hhhj‹ ��ubah}î(h]îh]îh ]îh ]îh ]îuh&j_��hjŸ ��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)M hj’ ��ubah}î(h]îh]îh ]îh ]îh ]îuh&h hj≤ ��hhh'h(h)NubhÀ)Åî}î(hå``couture_data.1.1``îh]îhï)Åî}î(hj˜ ��h]îj`��)Åî}î(hj˜ ��h]îhåcouture_data.1.1îÖîÅî}î(hhhj¸ ��ubah}î(h]îh]îh ]îh ]îh ]îuh&j_��hj˘ ��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)M hjı ��ubah}î(h]îh]îh ]îh ]îh ]îuh&h hj≤ ��hhh'h(h)NubhÀ)Åî}î(hå``couture_img.1.1``
îh]îhï)Åî}î(hå``couture_img.1.1``îh]îj`��)Åî}î(hj
��h]îhåcouture_img.1.1îÖîÅî}î(hhhj
��ubah}î(h]îh]îh ]îh ]îh ]îuh&j_��hj
��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîh'h(h)M hj
��ubah}î(h]îh]îh ]îh ]îh ]îuh&h hj≤ ��hhh'h(h)Nubeh}î(h]îh]îh ]îh ]îh ]îhÍj^��uh&h≈h'h(h)M hjw ��hhubeh}î(h]îåqueriesîah]îh ]îåqueriesîah ]îh ]îuh&h*hj£��hhh'h(h)M ubeh}î(h]îåindexingîah]îh ]îåindexingîah ]îh ]îuh&h*hh,hhh'h(h)K…ubeh}î(h]îå#ore-model-for-derived-data-packagesîah]îh ]îå#ore model for derived data packagesîah ]îh ]îuh&h*hhhhh'h(h)Kubeh}î(h]îh]îh ]îh ]îh ]îåsourceîh(uh&håcurrent_sourceîNå current_lineîNåsettingsîådocutils.frontendîåValuesîìî)Åî}î(h/Nå generatorîNå datestampîNå source_linkîNå
source_urlîNå
toc_backlinksîjñ��åfootnote_backlinksîKå
sectnum_xformîKåstrip_commentsîNåstrip_elements_with_classesîNå
strip_classesîNå report_levelîKå
halt_levelîKåexit_status_levelîKådebugîNåwarning_streamîNå tracebackîàåinput_encodingîå utf-8-sigîå input_encoding_error_handlerîåstrictîåoutput_encodingîåutf-8îå output_encoding_error_handlerîjv
��åerror_encodingîåUTF-8îå error_encoding_error_handlerîåbackslashreplaceîå
language_codeîåenîårecord_dependenciesîNåconfigîNå id_prefixîhåauto_id_prefixîåidîå
dump_settingsîNådump_internalsîNådump_transformsîNådump_pseudo_xmlîNåexpose_internalsîNåstrict_visitorîNå_disable_configîNå_sourceîh(å _destinationîNå
_config_filesî]îåpep_referencesîNå pep_base_urlîå https://www.python.org/dev/peps/îåpep_file_url_templateîåpep-%04dîårfc_referencesîNå rfc_base_urlîå https://tools.ietf.org/html/îå tab_widthîKå trim_footnote_reference_spaceîâåfile_insertion_enabledîàå raw_enabledîKåsyntax_highlightîålongîå smart_quotesîàåsmartquotes_localesîNå character_level_inline_markupîâådoctitle_xformîâå
docinfo_xformîKåsectsubtitle_xformîâåembed_stylesheetîâåcloak_email_addressesîàåenvîNågettext_compactîàubåreporterîNåindirect_targetsî]îåsubstitution_defsî}îåsubstitution_namesî}îårefnamesî}îårefidsî}îhh]îhjasånameidsî}î(jQ
��jN
��jb��j_��j÷��j”��j%��j"��jÁ��j‰��j ��j��jS��jP��jâ��jÜ��j¿��jΩ��j<��j9��jµ��j≤��j4��j1��j†��jù��jI
��jF
��j*��j'��jt ��jq ��jA
��j>
��uå nametypesî}î(jQ
��Njb��àj÷��Nj%��NjÁ��àj ��àjS��àjâ��àj¿��àj<��Njµ��Nj4��Nj†��NjI
��Nj*��àjt ��NjA
��Nuh}î(jN
��h,hOhThhhvj_��jY��j”��jà��j"��jŸ��j��j ��j‰��jfi��j��j��jP��jJ��jÜ��jÄ��jΩ��j∑��j9��j(��j≤��j9��j1��j∏��jù��j?��jF
��j£��j'��j!��jq ��j9��j>
��jw ��jò��js��j��j˚��jx��jX��j´��jã��j��jÂ��j*��j
��uå
footnote_refsî}îå
citation_refsî}îå
autofootnotesî]îåautofootnote_refsî]îåsymbol_footnotesî]îåsymbol_footnote_refsî]îå footnotesî]îå citationsî]îåautofootnote_startîKåsymbol_footnote_startîK�åid_startîKåparse_messagesî]î(h�åsystem_messageîìî)Åî}î(hhh]îhï)Åî}î(hå0Duplicate explicit target name: "prov ontology".îh]îhå4Duplicate explicit target name: ‚Äúprov ontology‚Äù.îÖîÅî}î(hhhj”
��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîhj–
��ubah}î(h]îh]îh ]îh ]îh ]îj��aålevelîKåtypeîåINFOîåsourceîh(ålineîKuh&jŒ
��hjŸ��hhh'h(h)K,ubjœ
��)Åî}î(hhh]îhï)Åî}î(hå#Literal block expected; none found.îh]îhå#Literal block expected; none found.îÖîÅî}î(hhhjÔ
��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîhjÏ
��ubah}î(h]îh]îh ]îh ]îh ]îålevelîKåtypeîåWARNINGîålineîK»åsourceîh(uh&jŒ
��hj?��hhh'h(h)K«ubjœ
��)Åî}î(hhh]îhï)Åî}î(hå#Literal block expected; none found.îh]îhå#Literal block expected; none found.îÖîÅî}î(hhhj ��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîhj��ubah}î(h]îh]îh ]îh ]îh ]îålevelîKåtypeîj��ålineîKÈåsourceîh(uh&jŒ
��hj£��hhh'h(h)KËubeåtransform_messagesî]î(jœ
��)Åî}î(hhh]îhï)Åî}î(hhh]îhå-Hyperlink target "index-0" is not referenced.îÖîÅî}î(hhhj(��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîhj%��ubah}î(h]îh]îh ]îh ]îh ]îålevelîKåtypeîjÈ
��åsourceîh(ålineîK uh&jŒ
��ubjœ
��)Åî}î(hhh]îhï)Åî}î(hhh]îhå-Hyperlink target "index-1" is not referenced.îÖîÅî}î(hhhjB��ubah}î(h]îh]îh ]îh ]îh ]îuh&hîhj?��ubah}î(h]îh]îh ]îh ]îh ]îålevelîKåtypeîjÈ
��åsourceîh(ålineîK uh&jŒ
��ubeå transformerîNå
decorationîNhhub.