... | ... | @@ -63,21 +63,14 @@ The prototype is to focus on tele-immersive video and interfaces required to ope |
|
|
# 2. OVERALL DESCRIPTION
|
|
|
The prototype will be a new platform that enables the capture, mixing, filtering, analysis, recording and streaming of teleimmersive 4D audio-visual data in a real-time, modular and flexible manner so that individual data sources or algorithms can be replaced or evolved in the future. The key features are therefore:
|
|
|
|
|
|
##### F1: *Capture* - Scene reconstruction from fixed lab spaces as a 4D-AV data source
|
|
|
|
|
|
##### F2: *Mixing* - 4D-AV mixing and filtering system, from any number of arbitrary data sources
|
|
|
|
|
|
##### F3: *Analysis* - 4D-AV Analysis system to extract and embed higher-level data about a scene
|
|
|
|
|
|
##### F4: *Recording* - 4D-AV recording and playback as a generic 4D-AV data source
|
|
|
|
|
|
##### F5: *Streaming* - Lossless and lossy compression of 4D-AV for storage and streaming
|
|
|
|
|
|
##### F6: *Presentation* - Interactive visualisation front-end(s) from a 4D-AV stream
|
|
|
|
|
|
##### F7: *Control* - User configuration and alteration of the pipelines and components in C1-C6
|
|
|
|
|
|
##### F8: *Representation* - Common 4D-AV data format for all components for flexibility
|
|
|
* **F1:** *Capture* - Scene reconstruction from fixed lab spaces as a 4D-AV data source
|
|
|
* **F2:** *Mixing* - 4D-AV mixing and filtering system, from any number of arbitrary data sources
|
|
|
* **F3:** *Analysis* - 4D-AV Analysis system to extract and embed higher-level data about a scene
|
|
|
* **F4:** *Recording* - 4D-AV recording and playback as a generic 4D-AV data source
|
|
|
* **F5:** *Streaming* - Lossless and lossy compression of 4D-AV for storage and streaming
|
|
|
* **F6:** *Presentation* - Interactive visualisation front-end(s) from a 4D-AV stream
|
|
|
* **F7:** *Control* - User configuration and alteration of the pipelines and components in C1-C6
|
|
|
* **F8:** *Representation* - Common 4D-AV data format for all components for flexibility
|
|
|
|
|
|
Additional virtual data sources may also be considered to allow mixing of real and virtual content into 4D-AV scenes, therefore suggesting a requirement that the representation used be independent of, or flexible with respect to, source. The analysis outputs are also to be attached or embedded in some manner into the 4D-AV stream, perhaps as an addition data channel. For example, semantic information about objects such as classification or motion information. This analysis information may also be used for predictive purpose to resolve latency issues and help with both compression and initial source capture quality. To be used in this way the data must flow not only forward with the stream but also back to previous processing steps.
|
|
|
|
... | ... | @@ -93,6 +86,30 @@ We will rely, at least initially, on OpenCV and the Point Cloud Library. It is a |
|
|
|
|
|
## 3.1 FUNCTIONAL REQUIREMENTS
|
|
|
|
|
|
### 3.1.1 Capture (F1)
|
|
|
|
|
|
### 3.1.2 Mixing (F2)
|
|
|
* **3.1.2.1** Merge multiple 4D-AV scenes into a single scene, with no restriction on the origin of the scene
|
|
|
* **3.1.2.2** Filter a scene to exclude all but a specified collection of entities
|
|
|
* **3.1.2.3** Filter a scene to exclude specific entities
|
|
|
* **3.1.2.4** Filter a scene by bounded region
|
|
|
|
|
|
### 3.1.3 Analysis (F3)
|
|
|
|
|
|
### 3.1.4 Recording (F4)
|
|
|
|
|
|
### 3.1.5 Streaming (F5)
|
|
|
* **3.1.5.1** Support adaptive bitrate streaming of 4D-AV scenes
|
|
|
* **3.1.5.2** Allow for channel selection or exclusion from the data stream
|
|
|
|
|
|
### 3.1.6 Presentation (F6)
|
|
|
|
|
|
### 3.1.7 Control (F7)
|
|
|
|
|
|
### 3.1.8 Representation (F8)
|
|
|
|
|
|
### 3.1.9 Miscellaneous
|
|
|
|
|
|
## 3.2 EXTERNAL INTERFACE REQUIREMENTS
|
|
|
|
|
|
## 3.3 NON-FUNCTIONAL REQUIREMENTS
|
... | ... | |