>Contributing Data>Preparing a Dataset

Preparing a Dataset


The following information and short videos describe how to prepare a dataset for uploading.

Structuring the file

  • Column headers should follow the following format: node + . + field. For example cycle.description.
  • Every node you create must have an identifier. If the node exists in HESTIA, use an @id and then use the HESTIA identifier, for example cycle.inputs.1.term.@id = electricityGridMarketMix. If the data are new, use a temporary id, for example site.id = site-1.
  • Nodes are linked using their identifiers, for example to link a Site to a Cycle, use site.cycle.id = site-1.
  • To add blank nodes to a node (e.g., Inputs to a Cycle), the column header includes a number for each blank node, for example cycle.inputs.0.term.name, cycle.inputs.0.value, cycle.inputs.1.term.name, cycle.inputs.1.value.
  • Avoid rows that contain data but do not have an identifier, or columns that contain data but have no column header.
  • You can use an empty cell or a - to indicate no data.
  • To add arrays, separate elements using a ; (e.g., cycle.inputs.0.value = 3;7.2;1.0)

Adding Data

Adding a Source

  • We can automatically get bibliographic information if you provide the title of the article or the documentDOI. It has to exist in Mendeley for this to work.
  • If it does not exist in Mendeley, you need to provide all the required bibliographic fields as defined in the schema.

How to add a Source

Adding an Organisation

  • You don't need to add an Organisation, but they can be useful to group Sites (e.g., a farm (Organisation) might manage three fields (Sites)).

Adding a Site

  • A Site requires a defaultSource. Link to the Source you have just added using the id.
  • If you added an Organisation, link the Site to the Organisation using the id.
  • Add the siteType which is a mandatory field (e.g., cropland).
  • Add the country, which is a required field. Data must be at least country specific to pass validation.
  • If the data has more geographic specificity than the country level, add the region. The region you specify should be the most specific region available in the Glossary. We use the GADM database for our regions.
  • Add the latitude and longitude if you have them.
  • Add any other fields for which you have data, including Measurements and Infrastructure.
  • For many data items, you can add values as a single value or an array. For arrays, you can use the dates field to specify on which date the value occurred.

How to add a Site

Adding a Cycle

  • A Cycle also requires a defaultSource. Link to the Source you added earlier using the id.
  • Link the Cycle to the Site you created.
  • A Cycle requires a data Completeness assessment. Refer to the Schema to understand this.
  • Add Inputs, Products, Practices, and Emissions.
  • You can add specific Sources to each Input, Product, Practice, and Emission, if the Source is different to the defaultSource.

How to add a Cycle

Adding a Transformation:

  • The Transformation blank node in HESTIA is used to describe the transformation of one Product to a new Product in the same Cycle. In animal uploads, this blank node is used to display data on how excreta ("manure") from animals is managed.
  • There are many management practices used, as per the list of terms in the Glossary. Each transformation should have a unique identifier (a transformationId). If excreta is managed in multiple systems within one Cycle, the share of excreta which is managed in each system can be indicated through the transformedShare.

Adding an Impact Assessment

  • Impact Assessments can be uploaded without Cycles and Sites, and therefore have more required fields. However, its best practice to upload a corresponding Cycle and Site and link it to the Impact Assessment.