up arrow
Nov 18, 2024

Introducing Transformations: Structure the unstructured data from systems and partners

Automatically convert data from your value chain and operational systems into datapoints for accounting and reporting to registries and programs.
Kohzy Koh
Head of Product

A growing list of operational systems, workflows, and data formats

Data collection is a key element of measurement, reporting, and verification (MRV). Measurements and data points need to be collected from carbon projects to calculate the amount of carbon sequestered, and emitted, for every unit of carbon removal.

This data comes from many sources, both structured and unstructured: flow meter readings, weigh-scale tickets, inventory counts, lab results, upfront LCAs and API integrations. Even structured data can vary widely—data from a SCADA system is very different from fuel replenishment logs that have been manually recorded and uploaded. To accurately calculate net carbon removed on a continuous basis, projects need normalized data from all these sources.

Fortunately, data collection, cleaning, and normalization can be fully automated. Mangrove Nexus makes this possible with Transformations, giving operations and revenue teams automated data ingestion and transformation tools without the need for costly custom software.

Convert data as it is ingested, into a usable feed for reporting and analysis

With transformations in Mangrove Nexus, data from Data Requests or connected sources in your project can be converted into clean data for LCA and emissions calculations. Connect an operational system as a data source, configure the transformation of data that comes from that source into specific event types using a Python script, and ingest data and supporting evidence from that source on a continuous basis.

Transformations are highly configurable and adaptable, and easy to monitor, giving you full control over how relevant data is aggregated and stored. Connect to new operational systems as they are added, and update your integrations with existing systems as they evolve.

Feature highlights:
  • Transform data as it is ingested: Automatically transform batches of data as they get received into a clean feed of structured data. Capture values, locations, and evidence files from the ingested data. Handle advanced calculations as data is brought into the system, using libraries like pandas, numpy, Mapbox, and geopy
  • Write transformations in Python: Write or tweak Python scripts that process your ingested data, right inside Mangrove Nexus
  • Hardware and system-agnostic: Ingest data from any operational system, regardless of the hardware or workflow that is generating the data
  • Schedule data collection: schedule the regular collection of data from partners, hardware, format, or data storage repositories
  • Monitor activity: Easily track the progress of every data collection activity
  • Prevent double-counting of data: automatically reject duplicate files that have already been uploaded to ensure no double counting of production activities

Here are examples of how data ingestion and transformation can benefit different pathways:

  • Direct Air Capture projects automatically pull sorbent metrics, air inflow and outflow meter readings, CO2 capture measurements, and energy usage through a SCADA system integrated with Mangrove Nexus. These readings generate a continuous data feed of unique events, ready for carbon accounting. Nexus also automatically transforms the fuel replenishment records uploaded by frontline staff, as well as monthly sorbent deliveries reported by the sorbent vendor.
  • Biochar projects automatically collect and normalize temperature and hydration data from the pyrolyzer equipment integrated with Mangrove Nexus. As new deliveries of biochar tracking units enter the system, Mangrove Nexus auto-calculates the driving distance and driving route on every delivery, to show detailed MRV in reports.
  • Carbon Capture projects can feed in compressor, pipeline, and injection data from integrated SCADA systems, pull site monitoring data from monitoring systems, all into one aggregated events feed. Biomass feedstock deliveries uploaded by biomass vendors into a portal get automatically converted into delivery events with transport distances and routes calculated and saved.

Operationalize your MRV with agility, without heavy software investment

As carbon projects grow and evolve, their data needs will change too. Your removal processes will be fine-tuned, operational workflows will shift, and your capture and sequestration activities will scale up. New projects will also come online with different equipment, data formats, and operational setups. All of this means that your data ingestion system needs to adapt seamlessly over time.

Beyond operations, you’ll need to report your carbon removal data to new carbon programs, whether for compliance markets, tax credits, or other regulatory and voluntary reporting requirements. Each program may have its own data reporting standards, adding another layer of complexity.

Despite these evolving needs, one thing remains constant: the need for a clean, normalized feed of project data. As you collect more data from more sources, maintaining this clean feed becomes even more critical to ensure accurate emissions accounting and reporting. With Mangrove Nexus, you can operationalize your MRV with agility and flexibility—without the need of an in-house software team. Our platform evolves with your project, automatically adapting to new data streams and reporting requirements, so you can focus on scaling your impact, not wrangling data.

---

For more information or to see Transformations in action, contact our team at Mangrove Systems or explore the feature within your Mangrove Nexus account.

Turn project operational data into revenue with Mangrove.

Let's chat
loading image