검색 상세

oneM2M and Microservice-oriented Convergence Architecture with the Internet of Things and Mixed Reality

초록/요약

The Convergence of Internet of Things (IoT) and Mixed Reality (MR) is the emerging trend because the strengths of each technology can complement the weaknesses. IoT has been commercialized for monitoring and remote control, but it is difficult to provide intuitive and user-friendly services due to the abstraction and low immersion of connected objects. On the other hand, MR provides intuitive interaction between digital contents and users, but still has limited service domains such as entertainment and low connectivity with physical devices. The combination of MR with rich immersion related to real world and IoT with ubiquitous connectivity is expected to produce new applications while overcoming limitations. Especially in the industrial domain, field workers wearing MR devices are provided with rich modality which overlays virtual objects on physical objects. Also, it enables collaborative works where remote expert can give instructions to workers and check the progress. Such a convergence product will be complex and large due to the coexistence of various devices, applications and platforms. Therefore, it requires robust and flexible system design. In this dissertation, we aim to design two novel architectures that complement each other for the convergence of MR and IoT. In the first detailed study, we propose a novel architecture of a convergence platform that provide connectivity between MR and IoT. In order to overcome the limitations of existing applications that do not provide domain and device interoperability, the proposed architecture adopts the oneM2M IoT standard as the basic framework. It enables the development of application services used in general-purpose environments without being subordinate to specific domains, and device manufacturers. We implement the proposed architecture utilizing the open-source oneM2M-based IoT server and device and Microsoft HoloLens. We also suggest and demonstrate the practical use cases and discuss the advantages of the proposed architecture. In the second detailed study, we propose a novel architectural concept called MR Virtual Device (MRVD) that fully provides MR-IoT connectivity and multi-user communication with minimal performance degradation. MRVD which is a server-side application that replicates MR real device (MRRD) can enhance the performance of MRRD with reducing duplicated data traffic and API calls when multiple traffic offloading runs concurrently. To demonstrate feasibility and evaluate MRVD, we develop a prototype taking into account of the scenario for the management of fire hydrant cabinets. The prototype utilizes various open-sourced software and commercial MR device, Microsoft HoloLens.

more

목차

I. Introduction 1
1.1 Motivation 1
1.2 Challenges 3
1.3 Contribution of the Dissertation. 5
1.4 Chapter Organization 6
II. Background 8
2.1 MR-IoT Convergence applications 8
2.1.1 Common Functions 8
2.1.2 Domains and Generality of MR-IoT Convergence Applications 12
2.1.3 Offloading Architecture in MR services 14
2.2 Microservice Architecture 17
2.2.1 Definition 17
2.2.2 Fundamentals 17
2.2.3 Microservice Architecture in IoT 20
III. IoT Service Standard based Platform Architecture to provide connectivity of MR and IoT 23
3.1 Overview 23
3.2 oneM2M IoT Standard 25
3.3 oneM2M-based Convergence Platform Architecture for MR and IoT 28
3.3.1 Requirements 28
3.3.2 System Design 30
3.3.3 Procedures 32
3.4 Implementation 35
3.4.1 System Environment 35
3.4.2 Component Based Development . 36
3.5 Experiments 38
3.5.1 TC1: Image Streaming for OTS 38
3.5.2 TC2: Object Tracking: MBS and MLS 39
3.5.3 TC3: Interaction between IN-CSE and HMD 40
3.6 Discussions 42
3.6.1 Case Study 42
3.6.2 Core Advantages of the Proposed Architecture 45
3.7 Summary 47
IV. Mixed Reality Virtual Device for Effective Traffic Offloading in Multi-userMR-IoT system 49
4.1 Overview 49
4.2 Microservice-oriented MR-IoT Convergence Architecture 52
4.2.1 Architectural Overview 54
4.2.2 Service Models 56
4.2.3 Design Process 61
4.2.4 Remaining Challenges 63
4.3 Mixed Reality Virtual Device Architecture 64
4.3.1 Conceptual Model 64
4.3.2 MRVD Structure 70
4.3.3 Data Replication 72
4.3.4 MR Registry 74
4.3.5 Merging API calls 74
4.3.6 Traffic Deduplication 75
4.3.7 Server Switching 77
4.4 Implementation 79
4.4.1 Scenario and Requirements 79
4.4.2 Prototype Architecture 81
4.4.3 Implementation Result 83
4.5 Evaluation 87
4.5.1 Common Experimental Setup 87
4.5.2 Performance in our Scenario 88
4.5.3 Merging API calls 90
4.5.4 Server Switching 92
4.6 Summary 95
V. Conclusion 96
References 99

more