> For the complete documentation index, see [llms.txt](https://docs.live-eo.com/surfacescout/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.live-eo.com/surfacescout/measuring-success.md).

# Measuring Success

Context

We have developed a solution to address a common challenge for all our customers: mitigating risks around their pipelines. However, customers may perceive the quality of our analytics differently.

Several factors can influence this perception, including the varied geographical environments that require fine-tuning of our machine learning model and QA processes—for example, the contrast between arid desert landscapes in the Middle East and lush, forested regions in Northern Europe.

* **Geographies**

<table data-view="cards"><thead><tr><th></th></tr></thead><tbody><tr><td><img src="https://901668700-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FLHJMG9DD5fHIVTkjSdwy%2Fuploads%2FtRjRlLTjo0Jrq1Ks9zi4%2Fimage.png?alt=media&amp;token=70290e16-a03a-4ebe-b105-97c0b4c78a43" alt=""></td></tr><tr><td><img src="https://901668700-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FLHJMG9DD5fHIVTkjSdwy%2Fuploads%2FdiSRPNTr91IQa9K6qlEf%2Fimage.png?alt=media&amp;token=54c23bc6-e980-4a55-8ba8-eeafdcacbe45" alt="" data-size="original"></td></tr><tr><td><img src="https://901668700-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FLHJMG9DD5fHIVTkjSdwy%2Fuploads%2FHLP2I20s52lp6iQlAx2a%2Fimage.png?alt=media&amp;token=ab29e0db-19e6-4bd8-b97c-8c230c2d4570" alt="" data-size="original"></td></tr><tr><td><img src="https://901668700-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FLHJMG9DD5fHIVTkjSdwy%2Fuploads%2F7xCSYnoD5HPA6XZz8GxC%2Fimage.png?alt=media&amp;token=d5f7dbac-d1c1-4f03-ae19-30e89cf89a8e" alt="" data-size="original"></td></tr><tr><td><img src="https://901668700-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FLHJMG9DD5fHIVTkjSdwy%2Fuploads%2FV0AxjiArCAXSRURGJZIB%2Fimage.png?alt=media&amp;token=e85cfb85-f8cf-4bd2-9ac7-7cb075eb0096" alt="" data-size="original"></td></tr><tr><td><img src="https://901668700-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FLHJMG9DD5fHIVTkjSdwy%2Fuploads%2Fod6IjnmTTiSn5tcdsqrw%2Fimage.png?alt=media&amp;token=5bdd47b8-d538-4a75-9793-9fbd061c2e12" alt="" data-size="original"></td></tr></tbody></table>

* **The level of interest can vary based on the type of detected change.** For instance, one customer might prioritize insights on agricultural or plowing activities differently than another.

### We need your feedback!

We have showed you in the [Review Cases](/surfacescout/review-cases.md#reviewing-insights) section that you could evaluate the quality of an Insight:

<figure><img src="https://901668700-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FLHJMG9DD5fHIVTkjSdwy%2Fuploads%2FRZ3EI4EKjfMKRCEMor0A%2Fimage.png?alt=media&amp;token=0bacc387-2748-4024-9ada-8e8462e3e3a5" alt="" width="375"><figcaption><p>Feedback dialog box</p></figcaption></figure>

This is essential to fine-tune the analytics so you can prioritize the risks that matter most to you, minimize false positives that create operational overhead, and assess whether SurfaceScout could become a valuable information source (we think it is! But we need your data to confirm it ;)).

We typically track 3 key metrics:

* **Precision**: The percentage of actual changes detected out of all predictions delivered.
* **Relevance**: The percentage of relevant predictions out of all predictions delivered.
* **Uniqueness of Information**: The number of unique detections not captured by other methods (like helicopters), compared to everything we’ve detected.
* **Uniqueness & Relevance combined:** The number of unique and relevant detections compared to everything we've detected

With your feedback, these metrics tend to improve significantly—often reaching over 80% relevancy, for example after a few deliveries. Without your input and domain expertise, however, results are less reliable (see the orange section for details).

<figure><img src="https://901668700-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FLHJMG9DD5fHIVTkjSdwy%2Fuploads%2FZNbDm5qIc1uerpwRhG0v%2Fimage.png?alt=media&amp;token=edeec821-39b3-43d2-b1f9-5b15e9ebc02d" alt=""><figcaption><p>Analytics performance VS feedback</p></figcaption></figure>

{% hint style="info" %}
For **Precision**, which measures the rate of false alerts, we typically begin around 90%.

For **Relevance**, we usually start lower, around 40%. This is where your feedback makes a significant impact: after 4-6 deliveries, we often achieve scores above 80%!
{% endhint %}

{% hint style="info" %}
For some customers, we can directly correlate detected Insights with tangible risk reduction in financial terms (€ or $). Recently, with a customer, we were able **to reduce risk exposure by 4M€ annualy for every 1,000 km of pipeline!**
{% endhint %}


---

# Agent Instructions
This documentation is published with GitBook. GitBook is the documentation platform designed so that both humans and AI agents can read, navigate, and reason over technical content effectively. Learn more at gitbook.com.

## Querying This Documentation
If you need additional information that is not directly available in this page, you can query the documentation by asking a question.

Perform an HTTP GET request on the following URL with the `ask` and `goal` query parameters:

```
GET https://docs.live-eo.com/surfacescout/measuring-success.md?ask=<question>&goal=<user_goal>
```

`ask` is the immediate question: it should be specific, self-contained, and written in natural language.
`goal` is what the user is ultimately trying to achieve, the reason they need the answer. Sharing it helps GitBook give you a better, more relevant answer. A goal is most helpful when it describes the outcome the user wants rather than restating the question. For example, with `ask=how do I create an API token`, a goal like `automate deployments from our CI pipeline` lets GitBook tailor the answer to that use case.

The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.
