← Registry / Multimodal Conversation
AIM
Entity Dialogue Processing
MMC-EDP-V2.5
Submissions for this AIM must match this definition: the same ports, API profile and internal wiring.
Description
This AIM implements the Entity Dialogue Processing function: it produces the Machine Text and Machine Personal Status from the human Text, its Text Descriptors, the human Personal Status and identity, the identifiers of the scene objects and the Basic Audio and Visual Scene Geometries, using the running Summary as dialogue memory. In Audio Scene Management (CAE-ASM), given the Audio Scene the User edits, it turns what the User says into User Commands for CAE-ASM, says what was done or asks when the request is unclear, and tells the User Agent, as Text For UA, what only the User Agent does: undo, save, stop.
Inputs and outputs 17 in · 10 out
Inputs
- Summary optional MMC-SUM-V2.5
- TextObject optional OSD-BTO-V1.5
- TextDescriptors optional MMC-TDO-V2.5
- PersonalStatus optional MMC-EPS-V2.5
- UserID optional OSD-IID-V1.5
- VisualObjectIDs optional OSD-IID-V1.5
- AudioObjectIDs optional OSD-IID-V1.5
- VisualSceneGeometry optional OSD-BVG-V1.5
- AudioSceneGeometry optional OSD-BAG-V1.5
- BMS optional OSD-BMS-V1.5
- MemoryText optional OSD-BTO-V1.5
- MemoryPersonalStatus optional MMC-EPS-V2.5
- RefinedText optional OSD-BTO-V1.5
- AMSHCIMessageIn optional CAV-AHM-V2.0
- BasicOfflineMapObject optional OSD-BOO-V1.5
- EgoRemoteHCIMessageIn optional CAV-ERH-V2.0
- AudioScene optional OSD-BAS-V1.5 or OSD-ASD-V1.5
Outputs
- MachineAvatarModel optional OSD-B3O-V1.5
- OutputSummary optional MMC-SUM-V2.5
- MachineTextObject OSD-BTO-V1.5
- MachinePersonalStatus MMC-EPS-V2.5
- EditedSummary MMC-SUM-V2.5
- HCIMemoryData optional MMC-HMD-V2.5
- AMSHCIMessageOut optional CAV-AHM-V2.0
- EgoRemoteHCIMessageOut optional CAV-ERH-V2.0
- UserCommand optional CAE-UCM-V1.0
- TextForUA optional MMC-TFU-V1.5
Used in 2 AIMs
- Affective Multimodal Conversation MMC-AMC-V2.5
- Multimodal Conversation Avatar MMC-MCA-V2.5
Documentation
Implementations 0
None published yet.