Wednesday, November 17, 2010

eReader Display

Recently I have come across this company and its innovative plastic display technology. Rugged and flexible display for e-book readers. The way to go. I prefer an e-book reader with flexible display rather than the LCD display and really like this cool technology.
Check the technology and the cool name for the company:
http://www.plasticlogic.com/ereader/plastic-display.php

What next?
I really feel an e-book reader with 2 side by side display will be next big thing. This will be an interesting technology since users can back reference pages much faster as well as have different pages on each display. Let's see how fast someone is coming out with this new design.

Thursday, November 4, 2010

Video Telephony (VT) – Know-how

Sometime back I worked on implementing a solution for video telephony and thought I could document it for a wider audience. By now video telephony is known for a handful audience through Apple’s “FaceTime” application. FaceTime is nothing innovative from Apple since this technology was long established in China/Japan/Korea mobile market. But Apple still has the pleasure of being the first mover in the market. I won’t consider Apple’s FaceTime has a real video telephony application since it uses the WiFi and internet backbone (high bandwidth) instead of cellular backbone (low bandwidth). So the problem space is much easier to tackle with for Apple. One reason could be the wireless bandwidth crunch in US cellular network providers. One thing amuses me in US is that cellular chip technology is growing at a faster rate but not the cellular communication infrastructure. Still they are at least 1 generation behind in the kind of applications and kind of bandwidth supported in Asian markets like China, Japan, and Korea.
As far as multimedia is concerned is, I see the following 3 performance beast applications:
(1) Video/Image capture
(2) Video playback of different codecs (resolution, encoding, bit rate, frame rate) and container formats and image decoding
(3) Video telephony (VT)
I consider VT has one of the interesting problem to work with. To start with some of the design know how and specs:
In Tx side:
Video Chain: Camera (Driver to imaging sensor)->Video Capture Filter-> Video Encode Filter->Mux Filter
Audio Chain: Mic(Audio Driver)-> Audio Capture Filter-> Audio Encode Filter-> Mux Filter
Video Preview Chain: Camera-> Video Capture Filter-> Video Renderer->Display Driver

In Rx side:
Video Chain: Demux Filter->Video Decode Filter->Video Renderer->Display Driver
Audio Chain: Demux Filter->Audio Decode Filter-> Audio Renderer->Audio Driver (Speakers)

Couple of big missing block is the acoustic engine to reduce feedback audio noise and VT engine to take care of "packetization" and "depacketization". VT packets are transmitted and received at 64 kbps. Every 64 kbps consists of video encoded at 48 kbps and audio encoded at 8 kbps and another 8 kbps allocated for VT packeting overhead. It is interesting to note that there are no special synchronization mechanisms in the Rx end and so one less problem to work with compared to video playback. Just follow the specs and if there are no video frame drops then synchronization will be taken care by design. But one of the biggest problems in the receiving end is how to assemble the broken video frames (VT packets) into a frame. The problem becomes much more interesting since some time a packet carrying video header will be dropped or corrupted. More pronounced in wireless cellular communication compared to wired internet. You need to develop a robust solution in order to handle such random scenarios and there holds our engineering ingenuity. H263/MPEG4 is the most popular encoding standards for VT applications. H264 is slowly catching up. Chinese mobile operators I would say have a better solution to tackle the bandwidth problem and network conditions. All VT calls from A to B are routed through their servers which take care of packet loss and other random corruption in VT packets. I thoroughly enjoyed implementing the end to end  VT solution for mobile phones. It is one of the best engineering problems I have worked with.

What's going on?

Getting hectic with my work schedule, I long abandoned external blogging. Nowadays I am more involved with internal blogging within my firm as an outlet for exchanging views. Need to get started.
Exciting things going on in smart phone space in the interim.
(1) The battle of Application Processors: Snapdragon, Hummingbird (A4), and OMAP3630. [Comparative Performance - Source: http://www.droidforums.net/forum/droid-general-discussions/53521-difference-between-snapdragon-omap-3630-a.html]
(2) Next gen heterogeneous multi core from Texas Instruments - OMAP 4430 and nVidia slowly catching up.
(3) Android declared as the third best widely used smartphone OS. Easily beating the likes of iPhone OS and slowly catching RIM OS. Source: http://www.gartner.com/it/page.jsp?id=1421013
(4) Introduction of WM7. I am eagerly awaiting where WM7 will stay in the smart phone OS space.

Industry is heating up well and the smart phone market is going to thrive until 2015. So jump into the smartphone bandwagon.

Wednesday, January 27, 2010

Apple iPad - The Bigger iPhone

The announcement of Apple iPad turned out to damp squib. Expectations were so high for the next big thing but turned out nothing but a bigger iPhone. Worst part is again pay for the additional data plan for connectivity with their preferred network provider. Can it compete with kindle e-book reader? Big question since it is not based on e-ink and is not going to give the illusion to reading a real book. Hopefully Apple has got some secrets (may be better gaming experience) down the sleeve to sell their recent innovation iPads. May be few design engineers who want to visualize things can hand draw stuffs just like tablet. Other than that I feel it is still running iPhone OS with no multitasking (concurrent applications running) or limited multitasking.

One good thing that impressed me is the strategy to switch to their custom made 1 GHz (POWER (RISC) architecture of the kind of ARM) processor based on their recent PA acquisition. This translates to more $s per product sold. No more Intel's Atom and TI’s OMAP and other processors for time being. Certainly this is going to bring some differentiation in short run but the continued success depends on how long they can sustain their processor/platform road map.

It will be interesting to see how the promising OMAP4 (multicore heterogeneous processor architecture) based products fare in the market place. One thing for sure, the strategy of Apple’s is to stress the importance of good application processor (ARM based) + optimized system software to meet the power/performance numbers. Since the mantra of the day is “iPad running 10 hrs in a single charge".

Tuesday, February 3, 2009

Interesting articles related to Application Processors (AP)

(1) http://www.intomobile.com/2009/02/03/toshiba-tg01-announced-with-iphone-trumping-snapdragon-chipset.html
1GHz processor powering a mobile(or not so) phone. Specs: The Toshiba TG01’s Snapdragon chipset, with a dual-core processor that crams a 1Ghz ARM core next to a 600Mhz DSP core. Cost is yet to be determined and power drain is not yet ascertained. Ball park estimate says that it can stay alive for a day of use.

(2) http://www.intomobile.com/2008/06/03/nvidia-announces-tegra-650-mobile-processor-nvidia-tegra-mobile-platform-is-here.html
nVidia's take on AP. With dedicated processor for each of the media type, it is indeed a powerful processor. Specs: The nVidia Tegra 650 follows the Tegra mobile platform’s mantra of integrating ARM CPU, a HD video processor, an imaging processor, an audio processor, and an ultra-low power GeForce® GPU in to a mobile chip.

(3) http://www.intomobile.com/2007/10/03/apple-looking-towards-intel-chips-for-next-gen-iphone-intel-inside-iphone-20.html Intel's take on AP (particularly for MID). Being x-86 based architecture it is very difficult to meet the power benefits compared to RISC based ARM processor. But the specs are not yet out on power-performance numbers and it will be interesting to see how they shape up.

Monday, January 26, 2009

Palm Pre – The next (or better) iPhone

First thing first: Palm Pre is declared as the CES-2009 show stopper. Is this smart phone going to live up to the hype? Definitely should be my answer. I bet my money on the Palm Pre. Please refer to the following sites: Cnet review: http://ces.cnet.com/8301-19167_1-10137746-100.html and http://palmpre.org/ for more take/specs in the product.
In continuation of my preview blog on APs : http://karthkl.blogspot.com/2008/12/why-texas-instruments-ti-omap-open.html, TI once again proved that how far ahead they are in the club of AP competitors. With TI’s OMAP 3430-the brain behind the Palm’s Pre, taking all the responsibility of delivering the performance it has promised, it is indeed a most promising AP chip from TI’s stable for 2009. With TI’s OMAP 3430 based platform solution, what Palm done is to build innovation on top of that and build a software app solution which can fully use the potential of OMAP 3430.
Web OS, the OS running the Palm Pre, is indeed going to shape the mobile computing and would help pave the way of cloud computing and so. The ease and fast at which the UI performs stands testimony to the power of OMAP and in comparison to HTC Touch Diamond (with Touch Flo interface) is way ahead of the lot. Though HTC Touch Diamond’s Touch Flo is very good user interface (UI), but what a bad selection of AP will do to the innovation is clearly seen. What HTC Touch Diamond got in the end is very good innovative UI running on a bad AP, making the whole system sluggish like a lame horse running in the race track. Hope HTC gives a thought or too on the right selection of AP for their innovative design.
Adding a signing note, I really like the way the Google Apps are customized for iPhone while not so for Microsoft Mobile OS. It looks like in corporate world “enemy of my enemy is my friend”. Google if it really promises to release free apps, should ensure that they maintain their equality and not be partial to one OS v another. Anyways, lets see with the advent of Android what Google does with iPhone MAC OS X with regards to the Mobile Apps.

Monday, December 29, 2008

Why Texas Instruments (TI) OMAP (Open Multimedia Application platform) is the Application Processor of Choice?

With the laptop revolution reaching saturation, it is the time for the connected mobile computing in the form of smart phones and MID (mobile internet devices). With high speed mobile internet taken for granted after the advent of 3G and 4G networks, people would like to make full use of the connected computing devices. In this juncture, Application Processor (AP) has a huge market in terms of revenue. Several firms are jumping into the AP market and each company is uniquely placed with their IP in APs. But one company which shows a differentiation in the mobile battery powered devices is the OMAP AP maker Texas Instruments. Having a lion’s share (65%) in this market space, they know what it takes to make a better application processor for battery powered devices. Having introduced the 3rd generation APs and already spinning out powerful 4th generation AP they are better placed with their vast experience in their AP based platform solution for smart phones.
With TI’s competitors simply improving the speed (in simple words: higher the CPU speed, more is the power drain from the battery) of the ARM core without giving any consideration to power management, it is a bad omen for the industry that companies including Apple’s iPhone embrace these platform solution. User experience does include the power management and no user wants to see his phone’s battery drained sooner than his expectation. Here the TI’s unique “heterogeneous core” AP platform solution is standing out in this market space. TI having tightly integrated the ARM core and DSP processor on the same chip (including hardware and it supporting complete embedded software solution includes MM, Graphics, BSP, and Connectivity) have some unique advantageous compared to it s competitor both in terms of power management and CPU speed. DSP which is well suited for all Multimedia related activities is the best to perform all the codec/signal processing related activities compared to ARM both in terms of speed and performance. It is not the simple usage of dedicated DSP that matters here, but it is how it is integrated with the ARM core and made to have a seamless communication with ARM core, which TI does it, best in class.
TI’s solution also adds the additional flexibility of integrating co-processors to buy additional cpu power, if needed. What Intel is trying with its Atom AP is making using of its powerful x86 processor architecture(around 1Ghz) but completely failing in terms of power budget and so is Snapdragon from QCom as well as nVidia's solution making use of Intel's Atom processor with their powerful graphics processor. It is understandable what to expect from a company like Intel with little to no experience in battery powered mobile devices.
The ultimate winner apart from the user experience is better power management. What one can achieve with one heterogeneous core (ARM=700 MHz /DSP =600 MHz) from the TI’s OMAP is manifold than that of its competitors solution. The advantage of having a dedicated DSP to perform all MM related activity is not stopped their. Now you have the idle ARM processor that can be put into use for some other multi-tasking application when the DSP is silently performing the computational intensive MM related activities. Hope iPhone and Blackberry makers seize the potential advantage of the TI’s platform solution over other. It is not always the case “single is powerful” and it is how multiple cores are put into use in computing world. Though the “hardware codecs” are the best in class but you don’t need one when there is an intelligent platform solution like OMAP from TI. Thus apart form the performance it buys some cost benefits to the iPhones and Blackberries makers and thus lessening the burden on to the customer. After all, what the customer wants is a satisfactory max 25-30fps AV playback and recording (includes HD videos), including internet based MM content.