The telepresence@home system demo is part of the European Union’s “Together Anywhere Together Anytime” (TA2) project, which aims to enable new media experiences to nurture relationships between families and friends. Through its work as a research partner within TA2, Fraunhofer contributed its Audio Communication Engine to provide the highest quality audio, and now delivers a matching low delay video solution. This new video technology reduces delay to a level that allows for natural communication experiences. In contrast to conventional video conferencing systems, the Audio Communication Engine and low delay video technology deliver a complete telepresence@home system that provides the highest audio and video quality along with imperceptible latency.
“Current low delay video technologies require either a much higher bit-rate or rely on very expensive dedicated hardware,” said Dr. Nikolaus Faerber, low delay video project manager at Fraunhofer IIS. “However, Fraunhofer’s solution is based on PC hardware, which is widely available at a very competitive price. The result is an HD video conferencing system for the home that delivers the best possible communication experience at a low cost.”
Fraunhofer’s low delay video technology consists of low delay, high-quality video encoding and decoding based on H.264 in conjunction with a custom designed low delay frame grabber card. This combination enables high quality HD video at DSL compatible bit-rates well below 100 ms delay end-to-end.
For audio, Fraunhofer’s Audio Communication Engine combines several components that vastly improve the sound quality and clarity of video conferences compared to present systems. First, the MPEG audio communications codec “AAC Enhanced Low Delay” ensures CD quality audio at very low coding delays and bit rates. Second, robust, multi-channel echo control software reliably removes echoes, providing hands-free convenience and complete freedom to move around in a room. Finally, a specially matched IP streaming stack and error concealment tools allow for high-quality audio even under adverse network conditions.
“The combination of Fraunhofer’s low delay video technology and Audio Communication Engine will enable truly outstanding video conferencing experiences in the home,” said Ian Kegel, Research Group Leader at BT Innovate & Design and Technical Delivery Manager in the TA2 project. “Because the communication is so natural, users feel as if they are in the same room whether they are playing a game, interactively sharing videos or just having a conversation. This same-room feeling means that distance between people no longer impacts the quality of their communication and relationships.”