Declarative and Interoperable Overlay Networks, Applications to Systems of Systems (DIONASYS)

ed9aafa1-50af-4ab2-8caf-0aa2a138b217

Closed

EPSRC
EPSRC
EPSRC
EPSRC
EPSRC

£1,709,245

Dec. 1, 2014

Dec. 30, 2018

The DIONASYS project takes place in the context of a fast-changing computing world. Large amounts of heterogeneous resources get interconnected. This is true for example in areas such as smart cities, emergency response systems, healthcare systems, energy systems and smart grids. Building applications for such large inter-connected heterogeneous systems is a complex task. It requires taking into account end-users and applications requirements, such as service levels and end-to-end functionalities. It requires as well taking into account underlying layers and their constraints. These constraints can differ largely from one system to the other: connectivity, mobility, energy aspects and availability are prevalent examples.
In this project, we take inspiration from, and will demonstrate our results through, the specific domain of environmental and earth observation systems, which are highly heterogeneous distributed systems. Such systems are actually more accurately distributed systems of systems with underlying subsystems including a wide range of wireless sensor networks. These sensors cover different environmental parameters (e.g. related to soils, water, pollutants) at different geographical locations and measure properties at different scales. The data is then fed into cloud infrastructures that in most cases are federated and hybrid. Layered on top of this there is also a need to access data and other environmental resources on the move on mobile platforms (e.g. visualizations of outputs from prediction models).
Overlay networks offer a well-established solution to underpin low-level primitives in distributed systems. However, in complex distributed systems-of-systems, that federate heterogeneous distributed systems and support different kinds of overlays, high levels of complexity inherently occur. We propose to leverage a unique set of competencies and skills of well-recognized research teams in distributed systems, languages, networks and middleware to address the need for composable and interoperable overlay design and adaptation mechanisms and simplify the design of applications for complex, diverse and heterogeneous distributed systems.
We propose a generative approach to overlay design and implementation. We will build a domain-specific language for specifying overlays, from a global-scale abstraction perspective. Instead of specifying fine-grain interactions, overlay designers will be able to specify global characteristics of the required overlays, both from a structural and functional point of view. The descriptions will be compiled to code that will be supported by a dynamic runtime running on the heterogeneous nodes of the considered distributed system(s). The generated code will take advantage of self-organizing distributed protocols built upon the gossip-based paradigm. Such protocols allow naturally expressing global behaviours from simple local interactions between nodes. Their flexibility will also be key to addressing the need for adaptation and composability.
The domain-specific language will allow specifying adaptation and composition constraints and requirements across multiple overlays. Interoperability between multiple overlays will be supported both by the language and runtime, allowing to dynamically plug overlays horizontally-as systems of systems ranging multiple networks and providing integrated end-to-end functionalities-and vertically, by allowing stacking overlays, providing increased abstraction and richer services and functionalities when growing up the stack. We will exploit the horizontal and vertical composability and support for systems of heterogeneous systems in the context of environmental and earth observation systems.

Potential Impact:
We expect the work conducted in the project to have a long-term impact on design and implementation techniques for distributed, heterogeneous and pervasive computing infrastructures such as smart cities, emergency response systems, healthcare systems, energy systems, smart grids or Internet of Things. These systems combine many geographically distributed elements, with highly varying capacity and service requirements, multiple users and dynamically evolving deployment and usage conditions. DIONASYS will (1) promote the use of overlays and overlays compositions for complex distributed systems by focusing on properties and guarantees and (2) allow application developers to focus on their needs in terms of services and guarantees rather than low-level nodes interactions.
We also expect to impact on the design of environmental surveillance and monitoring systems thanks to our use-case, which will allow demonstrating that the integration of systems-of-systems in this context can be achieved with a reasonable complexity. This is an important area and one that features heavily in Horizon 2020. We are well placed to influence developments in this area. In particular, Blair is a member of the e-Infrastructure Steering Committee of the Belmont Forum, the key forum for international agreement on technology infrastructure to support environmental observation.
More generally, we expect to influence the research community and development teams in the industry working on large-scale distributed systems to favour the adoption of self- organizing, high-level and generative approaches to distributed systems designs. We believe the current complexity of designing primitives for distributed systems may lead to major development costs, in particular when multiple systems have to be bridged together.
Dissemination will take two forms, communication to the general public and
targeted communication to industry and academia.
Communication to the general public will allow publicizing the existence of the consortium and the challenges considered by the project, without going into technical details. It will acknowledge the support from CHIST-ERA, the EU and national funding agencies. Press releases in our four languages will be released. This proved very effective in previous projects, allowing informing the general public about challenges associated to operating large amounts of networked resources but also attracting potential users and initiating industry- oriented projects.
Communication to professionals and the industry.
First, we will set up a project Web site using the Drupal content-management system. This Web site will be regularly updated with news about the project progress and will announce new prototypes and open source software. We will also set up a news feed allowing rapid interaction with other projects, e.g., using Twitter.
Second, we will seek to participate to professional forums where we can meet potential partners for exploitation, or more generally persons with responsibilities in R&D activities in companies around the topics mentioned at the beginning of this section. Etienne Rivière is involved in the Swiss section of CRIP, the major French forum for IT infrastructure managers and is giving talks in this context.
CHIST-ERA Full Proposal Form page 50 of 60DIONASYS project proposal CHIST-ERA 4th Call for Research Proposals
Third, we will seek to publish high-level articles in professional magazines aimed at IT professionals (TechWeek, CME, Market.ch, etc.).
Finally, we count on the open source orientation of the project to attract more visibility, especially by announcing regularly updates and new features, and promoting the project results in open source communities around large-scale dynamic systems, sensor networks, etc.