About Third Party Mediator

Intro

The C2NET Third Party Mediator (TPM) module implements an interface for other components to access external services and data sources. In particular, its role is to access web services located outside of C2NET cloud, to fetch data according to predefined parameters, perform extraction operations if needed, and deliver it to interested C2NET components.

Functionality

In the C2NET architecture valid as of Oct 2016 TPM is not used or activated by other components, but it periodically self-activated means of a timer defined by a human user via its management UI.

By itself TPM does not perform any reasoning or interpretation of data. The only operations supported are extraction and re-structuring:

• extraction - finding relevant information from documents (either structured, like XML, JSON, etc. or unstructured like HTML) and removal of un-required content.
• re-structuring - transformation of structure

One example proposed in the project is fetching weather forecasts from the site AccuWeather in form of human-readable HTML, and extracting next month's forecast in a structured format.

Scripts

Fetching and transformation processes are specific to each individual service and data source, and they are specified in form of scripts. As of Oct 2016 scripts are in form of Python modules which must implement a certain interface and follow a coding convention. TPM's architecture allows adding additional script execution engines with minor modification so other scripting languages can be added if needed.

Architecture

TBC

Dependencies

Requires: Data Knowledge Base System (DKBS)

https://opensourceprojects.eu/p/c2net/cpl/paas4man/dkbs

Dependents: UCP

Module Development:

Development Status: TPM: Third-Party Mediator
Responsible: VTT
Other Participants: (none)

Features: (none)

• TPM-001: Access to structured 3rd-party services
• TPM-002: Support for formats/​protocols
• TPM-003: Different access modes: query, timed, listener
• TPM-004: Data source adaptors defined declaratively via RM
• TPM-005: Data delivery via client-defined formats/​protocols
• TPM-006: Output adaptors defined declaratively via RM>

About this page

This page includes the Public Code developed to implement this module.

Additionally, it includes a Tickets entry to handle specific issues regarding this module as a whole (which may include management, integration, new features, etc.).