... | ... | @@ -63,7 +63,7 @@ The prototype is to focus on tele-immersive video and interfaces required to ope |
|
|
# 2. OVERALL DESCRIPTION
|
|
|
The prototype will be a new platform that enables the capture, mixing, filtering, analysis, recording and streaming of teleimmersive 4D audio-visual data in a real-time, modular and flexible manner so that individual data sources or algorithms can be replaced or evolved in the future. The key features are therefore:
|
|
|
|
|
|
* **F1:** *Capture* - Scene reconstruction from fixed lab spaces as a 4D-AV data source
|
|
|
* **F1:** *Generation* - Scene reconstruction from fixed lab spaces as a 4D-AV data source
|
|
|
* **F2:** *Mixing* - 4D-AV mixing and filtering system, from any number of arbitrary data sources
|
|
|
* **F3:** *Analysis* - 4D-AV Analysis system to extract and embed higher-level data about a scene
|
|
|
* **F4:** *Recording* - 4D-AV recording and playback as a generic 4D-AV data source
|
... | ... | @@ -86,21 +86,30 @@ We will rely, at least initially, on OpenCV and the Point Cloud Library. It is a |
|
|
|
|
|
## 3.1 FUNCTIONAL REQUIREMENTS
|
|
|
|
|
|
### 3.1.1 Capture (F1)
|
|
|
### 3.1.1 Generation (F1)
|
|
|
* **3.1.1.1** Capture a 4D-AV scene in real-time from a fixed laboratory with multiple people
|
|
|
* **3.1.1.2** Allow 4D scenes to be generated virtually from some scene description and animation
|
|
|
* **3.1.1.3** Support the translation of more traditional formats into our 4D-AV representation as a source
|
|
|
|
|
|
### 3.1.2 Mixing (F2)
|
|
|
* **3.1.2.1** Merge multiple 4D-AV scenes into a single scene, with no restriction on the origin of the scene
|
|
|
* **3.1.2.2** Filter a scene to exclude all but a specified collection of entities
|
|
|
* **3.1.2.3** Filter a scene to exclude specific entities
|
|
|
* **3.1.2.4** Filter a scene by bounded region
|
|
|
* **3.1.2.5** Allow data channels or kinds of data to be filtered from the scene
|
|
|
* **3.1.2.6** Allow scene transformations (translation, scaling, rotation) when mixing
|
|
|
* **3.1.2.7** Any mixed scene output can also be an input to another mixing operation
|
|
|
|
|
|
### 3.1.3 Analysis (F3)
|
|
|
|
|
|
### 3.1.4 Recording (F4)
|
|
|
|
|
|
### 3.1.5 Streaming (F5)
|
|
|
* **3.1.5.1** Support adaptive bitrate streaming of 4D-AV scenes
|
|
|
* **3.1.5.2** Allow for channel selection or exclusion from the data stream
|
|
|
* **3.1.5.1** Support compressed adaptive bitrate streaming of 4D-AV scenes
|
|
|
* **3.1.5.2** Support lossless compression of 4D-AV scenes
|
|
|
* **3.1.5.3** Streams can contain non-AV data streams for additional forms of basic or higher-level data
|
|
|
* **3.1.5.4** Allow for channel selection or exclusion from the data stream
|
|
|
* **3.1.5.5** Stream decoding must function within a web-browser
|
|
|
|
|
|
### 3.1.6 Presentation (F6)
|
|
|
|
... | ... | |