1,303 research outputs found
Towards robust and reliable multimedia analysis through semantic integration of services
Thanks to ubiquitous Web connectivity and portable multimedia devices, it has never been so easy to produce and distribute new multimedia resources such as videos, photos, and audio. This ever-increasing production leads to an information overload for consumers, which calls for efficient multimedia retrieval techniques. Multimedia resources can be efficiently retrieved using their metadata, but the multimedia analysis methods that can automatically generate this metadata are currently not reliable enough for highly diverse multimedia content. A reliable and automatic method for analyzing general multimedia content is needed. We introduce a domain-agnostic framework that annotates multimedia resources using currently available multimedia analysis methods. By using a three-step reasoning cycle, this framework can assess and improve the quality of multimedia analysis results, by consecutively (1) combining analysis results effectively, (2) predicting which results might need improvement, and (3) invoking compatible analysis methods to retrieve new results. By using semantic descriptions for the Web services that wrap the multimedia analysis methods, compatible services can be automatically selected. By using additional semantic reasoning on these semantic descriptions, the different services can be repurposed across different use cases. We evaluated this problem-agnostic framework in the context of video face detection, and showed that it is capable of providing the best analysis results regardless of the input video. The proposed methodology can serve as a basis to build a generic multimedia annotation platform, which returns reliable results for diverse multimedia analysis problems. This allows for better metadata generation, and improves the efficient retrieval of multimedia resources
Dynamic verification of mashups of service-oriented things through a mediation platform
The new Internet is evolving into the vision of the Internet of Things, where physical
world entities are integrated into virtual world things. Things are expected to become active
participants in business, information and social processes. Then, the Internet of Things could
benefit from the Web Service architecture like today’s Web does; so Future service-oriented
Internet things will offer their functionality via service-enabled interfaces. As demonstrated in
previous work, there is a need of considering the behaviour of things to develop applications in
a more rigorous way. We proposed a lightweight model for representing such behaviour based
on the service-oriented paradigm and extending the standard DPWS profile to specify the
(partial) order with which things can receive messages. To check whether a mashup of things
respects the behaviour, specified at design-time, of composed things, we proposed a static
verification. However, at run-time a thing may change its behaviour or receive requests from
instances of different mashups. Then, it is required to check and detect dynamically possible
invalid invocations provoked by the behaviour’s changes. In this work, we extend our static
verification with an approach based on mediation techniques and complex event processing to
detect and inhibit invalid invocations, checking that things only receive requests compatible
with their behaviour. The solution automatically generates the required elements to perform
run-time validation of invocations, and it may be extended to validate other issues. Here, we
have also dealt with quality of service and temporal restrictions
Heterogeneous component interactions: Sensors integration into multimedia applications
Resource-constrained embedded and mobile devices are becoming increasingly
common. Since few years, some mobile and ubiquitous devices such as wireless
sensor, able to be aware of their physical environment, appeared. Such devices
enable proposing applications which adapt to user's need according the context
evolution. It implies the collaboration of sensors and software components
which differ on their nature and their communication mechanisms. This paper
proposes a unified component model in order to easily design applications based
on software components and sensors without taking care of their nature. Then it
presents a state of the art of communication problems linked to heterogeneous
components and proposes an interaction mechanism which ensures information
exchanges between wireless sensors and software components
- …