Slide 1

Camera-Based Real Time Smart Phone Dictionary

-Design Review # 2Prepared by Team 22, Zhuoxin Chen, Hao Shi, Yaoyu Tao,Meng Wu, Hongyi Xin

Sponsored by Peisen Huang 2011/6/13

OutlinesProject OverviewModificationsCustomer RequirementsEngineering SpecificationsDesign ProcessTop Level DesignUI Flow ChartImage ProcessingDatabase DesignTimeline

Project OverviewEnglish to Chinese DictionaryCamera Based Word-Recognition & SearchingIEEE/ACM/Wikipedia ExtensionsReal Time TranslationAndroid PlatformBenchmarkYoudao Dictionary

Customer RequirementsNew ReqsShall be able to add words to users dictionaryShall be able to record latest search historyModified ReqsNeed only English-Chinese translation, without multi-language extensionsWeight of reasonable results is raised

Revised Demo Interface

Engineering SpecificationsEngineering SpecificationsOperation StepsLess than 100Detection Size5mm x 15mmImage Resolution16 x 16Pixel Value Threshold1.00Letter Distortion2x or betterPattern Recognition CorrectnessGreater than 80%Tree Searching LevelsLess than 3 levelsRuntime ResourceLess than 1MBInternet ExtensionsIEEE, ACM, Wikipedia ,or moreHistory CollectionLatest 100 items or moreControl flow chartTop Level DesignUserTap ScreenUIWord ImageDSPKeywordDatabaseTapButtonInternetRe-send if image not clearRe-process if word not foundAdd wordUI Flow ChartAdjust the camera until the paragraph fit in to the frame. Hold static button to freeze the screen.Tap on the word to look up and wait the dictionary to respond.Tap the extension button to look up on the Internet.Release the static button to capture new paragraph.Image ProcessingImage FormatsAndroid supports BMP and JPEGIntensive image (gray scale image) Binary image (black and white image)Image SegmentationDivide image into regions such as lines, words and charactersCompute the projection profile of image Locate the word based on the user input

Image segmentation

Character Recognition Polynomial Classifier (PC)Multilayer Perceptron (MLP)Radical Basis Function (RBF)Nearest Neighbor Classifier (NNC)

Handbook of character recognition and document image analysis,by Horst Bunke,Patrick Shen-pei WangCharacter Recognition Methods SelectionAccuracy and computational cost.Principal Component Analysis has the best performance and relative less computation.Learning DataMulti-fontsAdding rotation and distortion

Database DesignOverall Structure

Searching StrategyKey Index of Main Table: First LetterIntermediate Word Processing (IWP) inside the tableMID-based circular tree structure for history extension

Database Flow ChartDATABASE BLOCKWord From UIUser-define Word!hithitReturn Result to UIACK of AddTimeline

Future PlanTaskDurationMain MemberKey WordsImage Processing6.13-6.26Meng WuAlgorithm, MATLABRelated APIs6.13-6.26HaoCamera,TouchSensor,WebDatabase Modify6.13-6.19YaoyuSQLiteUI Design6.20-7.10HongyiCode Convert7.11-7.24YaoyuMATLAB to JAVAInternet Extension7.18-7.20HaoFunction extend & linkIntegrate7.21-8.7AllTest7.18-8.7AllDebug,Testing & ModificationQ&AThank You

Thank You !