What is it about?

Multi-Sensory Media (MulSeMedia) systems are becoming more common as technology advances, allowing us to create immersive experiences that engage multiple senses. These systems combine various devices and applications to bring sensations from the virtual world into the real world. For example, a virtual reality game might use sights, sounds, and even smells to create a more realistic experience. However, despite the growing interest and existing tools, there is still confusion about what MulSeMedia really is. Without a clear understanding, developers might create systems that aren't compatible with each other or miss out on important design features like reusability and standardization. Our article aims to solve this problem by creating a clear and agreed-upon framework called a "reference ontology." Named MulseOnto, this framework defines the key concepts and components of MulSeMedia systems. It's like a detailed guide that explains what MulSeMedia is and how different parts should work together. To ensure that MulseOnto is accurate and useful, the researchers tested it in two ways: (1) Human Assessment: Experts in the field reviewed the ontology to see if it made sense and covered all necessary aspects. (2) Data-Driven Approach: They used real data to check if the ontology correctly represents how MulSeMedia systems work in practice. The results showed that MulseOnto is a reliable and comprehensive model. It can help developers, researchers, and designers understand and explore MulSeMedia systems better. By providing a standard guide, MulseOnto supports the creation of more integrated, reusable, and standardized MulSeMedia solutions, paving the way for more advanced and immersive sensory experiences.

Featured Image

Why is it important?

Understanding and standardizing Multi-Sensory Media (MulSeMedia) systems is important for several reasons: (1) Enhanced User Experience: MulSeMedia systems aim to create immersive experiences by engaging multiple senses. A clear understanding and standardization ensure that these systems can deliver consistent, high-quality sensory experiences. (2) Interoperability: Standardizing the concepts and components of MulSeMedia systems allows different devices and applications to work together seamlessly. This interoperability is crucial for creating complex, multi-sensory environments where various technologies need to integrate smoothly. (3) Innovation and Development: A well-defined framework like MulseOnto provides a solid foundation for researchers and developers. It helps them build upon existing knowledge, fostering innovation and the development of new technologies and applications in the field of multi-sensory media. (4) Reusability: By clearly defining the components and their interactions, developers can create solutions that are reusable across different projects. This saves time and resources, as well as promotes consistency in how sensory effects are produced and managed. (5) Standardization: A reference ontology ensures that everyone in the field has a common understanding of what MulSeMedia systems entail. This standardization is crucial for setting industry benchmarks, which in turn helps in the development of compatible and reliable products. (6) Avoiding Misconceptions: Without a formal and explicit representation, there can be misunderstandings about what MulSeMedia systems are and how they should be designed. This can lead to inefficient solutions that do not fully leverage the potential of multi-sensory media. (7) Quality Assurance: A standardized approach allows for better quality control. Developers can ensure that their systems meet certain criteria and perform as expected, leading to more reliable and effective MulSeMedia experiences. (8) Market Growth: As MulSeMedia systems become more standardized and interoperable, the market for these technologies can grow. Consumers and businesses alike will be more likely to adopt and invest in MulSeMedia solutions if they are assured of their quality and compatibility. (9) Academic and Practical Research: For researchers, having a clear ontology helps in structuring and conducting studies. It provides a framework that can be used to explore new ideas, test hypotheses, and contribute to the overall body of knowledge in the field. (10) Educational Purposes: For educators and students, a reference ontology like MulseOnto serves as a valuable educational tool. It helps in teaching the principles and components of MulSeMedia systems in a clear and organized manner.

Perspectives

Here’s my perspective on the article "Towards a reference ontology on mulsemedia systems": Key Contributions are: (1) Addressing a Growing Field: The paper tackles a significant and timely issue in the field of interactive applications. As technology advances, the ability to engage multiple senses in digital environments is becoming more feasible and relevant. This research acknowledges the need for a structured understanding of these systems. (2) Clear Conceptualization: By proposing a reference ontology (MulseOnto), the authors provide a clear and structured framework for understanding the various components and interactions within MulSeMedia systems. This is crucial for ensuring that different stakeholders have a common understanding and can work towards compatible and interoperable solutions. (3) Mitigating Misconceptions: The paper highlights the potential pitfalls of not having a formalized representation of MulSeMedia systems. Misconceptions can lead to inefficient or incompatible solutions. By establishing a reference ontology, the research helps avoid these issues, promoting more effective and standardized designs. (4) Validation and Verification: The authors' approach to validating and verifying MulseOnto through both human assessment and data-driven methods ensures the robustness and reliability of the ontology. This thorough evaluation adds credibility to their work and demonstrates its practical applicability. (5) Foundation for Future Research: MulseOnto provides a foundational framework that future research can build upon. It opens up avenues for further exploration and refinement, enabling more advanced studies and innovations in the field of multi-sensory media. Importance of this article: (1) Interoperability and Standardization: The development of a common ontology is vital for ensuring that different MulSeMedia systems and components can work together seamlessly. Standardization facilitates the creation of integrated and consistent user experiences, which is essential as the field grows. (2) Innovation and Development: By providing a clear and structured understanding of MulSeMedia systems, the paper supports innovation. Researchers and developers can use the ontology as a guide to design new technologies and applications, knowing that their work will be compatible with existing standards. (3) Improving User Experiences: The ultimate goal of MulSeMedia systems is to enhance user experiences by engaging multiple senses. A well-defined ontology helps in designing systems that can reliably deliver these experiences, improving overall user satisfaction. (4) Sustainability and Reusability: The focus on reusability and integration in the ontology promotes more sustainable development practices. Solutions can be designed to be reusable across different projects, reducing waste and improving efficiency. (5) Market Growth: As the field of MulSeMedia grows, having a standardized framework like MulseOnto can help accelerate market development. It provides a clear roadmap for companies to follow, ensuring that new products and technologies are compatible and reliable. Areas for Further Research are: (1) Expanding Scope: While the current ontology provides a solid foundation, future research could expand its scope to cover more diverse types of MulSeMedia systems and applications. (2) Real-World Case Studies: Applying the ontology to real-world scenarios and conducting case studies can help validate its practical utility and identify areas for improvement. (3) Technology Integration: Exploring how emerging technologies like artificial intelligence and the Internet of Things (IoT) can enhance MulSeMedia systems within the framework of the ontology could be a valuable direction for future research. (4) User-Centric Design: Investigating how different user preferences and sensory sensitivities can be incorporated into the ontology to create more personalized and adaptive MulSeMedia experiences.

Dr. HDR. Frederic ANDRES, IEEE Senior Member, IEEE CertifAIEd Authorized Lead Assessor (Affective Computing)
National Institute of Informatics

This work aims to establish a common understanding of mulsemedia systems by developing a reference ontology called MulseOnto. We highlight the complexity of the mulsemedia ecosystem and the need for a formal representation to address misconceptions and promote standardization, reuse, and compatibility in system design. We acknowledge that although there are existing standards, tools, and research on mulsemedia, a clear and formal definition of what constitutes mulsemedia is still lacking. We believe that the lack of a shared understanding could lead to challenges in managing and integrating various entities in the mulsemedia ecosystem, potentially hindering the development of robust and interoperable solutions. We use a systematic approach to building ontologies (SABiO) to develop MulseOnto, with a focus on creating a reference ontology that captures the core concepts and relationships in the mulsemedia domain. This process involves identifying the purpose of the ontology, eliciting requirements, capturing and formalizing knowledge, designing the ontology structure, implementing it, and finally, testing it. We also highlight the decision to integrate MulseOnto with the Software Engineering Ontology Network (SEON) to leverage existing knowledge and ensure compatibility with broader software engineering concepts. We then break down MulseOnto into three sub-ontologies to manage the complexity of the domain: Mulsemedia System, Medium, and Sensory Effect Description. Each sub-ontology addresses specific aspects of mulsemedia systems, allowing for modular development and a more focused exploration of different concerns. Next, we present a hypothetical scenario of a science museum in Tokyo utilizing a mulsemedia platform to create a multi-sensory experience for visitors. We instantiate the ontology using data from this scenario, demonstrating its ability to represent real-world situations and providing evidence for its appropriateness as a reference model for the mulsemedia domain. Furthermore, it highlights the ontology's capacity to capture a wide array of concepts, ranging from specific hardware and software components to detailed descriptions of various sensory effects. We conclude the text by acknowledging that MulseOnto represents an initial step in defining the mulsemedia ecosystem, recognizing the need for further development to address aspects like capturing, distributing, rendering, and perceiving sensory effects. Finally, we propose future work that involves expanding MulseOnto into a network of ontologies to delve deeper into these processes, as well as creating an operational ontology for practical applications such as exchanging sensory effect metadata and integrating different mulsemedia standards.

Dr. Estêvão B. Saleme
Federal Data Processing Service

Read the Original

This page is a summary of: Towards a reference ontology on mulsemedia systems, September 2018, ACM (Association for Computing Machinery),
DOI: 10.1145/3281375.3281378.
You can read the full text:

Read

Contributors

The following have contributed to this page