A flexible architecture for multimodal applications using federated devices

The envisioned architecture allows users to access a single application using multiple devices while taking advantage of their different modalities. Users of this system can fully control which devices they federate rather than relying on automatic federations, e.g., based on location information. As most of the users are mobile, the architecture enables federations between arbitrary devices of the environment. This implies a need for flexibility with respect to changes in availability of processing components, which are distributed among the federated devices and infrastructure servers. This flexibility is necessary for ensuring a robust system, which minimises perceivable interruption due to environmental changes and maximises overall availability. Besides that, the system ensures availability even without infrastructure connection