Intelligent systems: Trends, applications and open

problemsAboul Ella Hassanien

Faculty of Computers and Information, Cairo University,Founder and Chair of the Scientific Research Group in Egypt

2015 11th International Computer Engineering Conference Faculty of Engineering, Cairo University, Cairo, EGYPT - December 29-30, 2015

Invited talk – 30 Dec. 2015

THANKS

Agenda

2. Introduction to SRGE

3. Research Map

4. Intelligent Systems

4. Trends and open problems

1. Virtual Association

Virtual Association 4

Not physically existing as such but made and connected by softwareA virtual organization is a “business without walls”

Scientific Research Group in Egypt

5

Scientific Research Group in Egypt

6

1 Professor 1 Associated Professor 15 Assistant Professors 14 Ph.D students 14 M. Sc. students 50 International

collaborative researchers from 15 countries

5 undergraduate student

Scientific Research Group in Egypt

Disabled people

Awards (Unesco and Alecso) السويس قناة مشروع

Organize several workshops in the Egyptian universities

More than 35 workshops in Egypt

SRGE International conferences

AMALTA2014 SecNet2013 AISI2015

Scientific Research Group in Egypt

Research map

Medical image processing Breast cancer analysis,

(sonar, MRI, fMRI, CT) Liver fibrosis and tumour

analysis (biopsy, MRI, CT)

Medical image annotation

Bioinformatics

Problems: - Breast Cancer Case- Liver Fibrosis – HCV- Content-based image

retrieval- Formal Concept Analysis

(visualize (rule based))

Track-IBiomedical Engineering & Bioinformatics

Breast Cancer Case

According to the USA National Cancer Institute report:

Breast cancer is the leading cause of cancer deaths in women today and it is the most common type of cancer in women.

Each year about 180,000 women in the United States develop breast cancer, and

About 48,000 lose their lives to this disease. It is also reported that a woman's lifetime risk of

developing breast cancer is one in eight. Currently, digital mammography is one of

the most promising cancer control strategies in earliest stages.

MRI Breast Segmentation results

Multi-objective K-mean K-mean – goodness – assessment (adapt centers)

Hepatitis C Virus in Egypt -HCV

The World Health Organization has decleared hepatitis C a global health problem, with approximately 3% of the world’s population (roughly 170-200 million people) infected with HCV.

Egypt has one of the highest prevalence rates of the C virus in the world

In Egypt the situation is quite worse.

EGYPT: 14.7 % infected with Hepatitis C

Liver Fibrosis

Stage 0 No fibrosis (fatty liver) Stage 1 Portal expansion with fibrosis (<1/3 area) Stage 2 Bridging fibrosis (>1/3) Stage 3 Marked bridging fibrosis or early cirrhosis (

no reason for tissue conversion) Stage 4 Definite cirrhosis (<50% of biopsy fibrosis) Stage 5 Definite cirrhosis (>50% of biopsy fibrosis)

Challenges: distinguish between the late fibrosis stage and tumor Good segmentation techniques/features-based/classifier/extract the liver features using the joint features of fractal dimension and the entropies of texture edge co-

occurrence matrix based on ultrasound images =========== Classification problem

Fibro Scan – Avoid liver biopsy

A combination of blood test and fibroscan for accurate non-invasive diagnosis of liver fibrosis stages in chronic hepatitis C.

Fibroscan for assessing liver fibrosis

Liver fibrosis identification based on ultrasound images

Content-based Medical Image Retrieval

Query Image

Extract Features(Primitives)

Image Datab

ase Features Database

SimilarityMeasure

Matched

ResultsRelevanceFeedbackAlgorithm

Content-based image retrieval (CBIR) makes use of image features, such as color and texture, to index images with minimal human intervention.

hypermethylated genes in breast cancer tumor subtypes

• DNA methylation plays a very important role in the gene expression regulation, causing many diseases such as cancers. Methylation in a specific region of genes called promoter, can inhibit genes to be expressed. Methylation occurs at a specific regions in the genome called CPG sites (CPGs), the ”P” in CPG refers to phosphodiester bond between the guanine (G) and the cytosine (C).

Formal Concept Lattice

Retinal Vessel Segmentation

An Improved Ant Colony System

Retinal Image Ground-TruthSegmentation

Segmentation ofACS with OldHeuristic Function

Segmentation ofACS with NewHeuristic Function

Intrusion Detection System (Machine Intelligence, Danger theory. AIS)

Cryptanalysis Image Authentication and Applications Watermarking (vector and raster data) Digital Signatures Biometrics

Heart sound recognition Face and Finger print Gait processing

Problems: - Heart Sound as a

biometric- Watermarking (Vector

data)- Image authentication- Asymmetric hash

function- Multi-Biometric-based

Track-II Network and Information Security

Heart Sound Recognition

Biometric

Machine learning and swarms for feature extractions

Blind Separation of Information from Galaxy Spectra

0 50 100 150 200 250 300 350-0.2

0

0.2

0.4

0.6

0.8

1

1.2

1.4

Early diagnosis of pathology in fetus

Blind Source Separation (BSS) deals with the problem of separating independent sources from their observed mixtures only while both the mixing process and original sources are unknown.

Blind Source Separation (BSS)

Independent Component Analysis (ICA) for solving BSS

Image Authentication and Watermarking

We got him!

Multi-Biometric-based

Template Formation

Data Capture & Conditioning

Feature Extraction

Retinal Scan Processing

Data Capture & Conditioning

Feature Extraction

Template Formation

Fingerprint Processing

Gait!!!!!

Fingerprints (two problems)

Fractal-based generation Asymmetric Hash function

Vector geo-spatial data /3D animated Watermark

Geospatial data 3D animated object • Geospatial

data or geographic information is the data or information that identifies the geographic location of features and boundaries on Earth, such as natural or constructed features, oceans, and more.

Select the best vertices for insert the watermarks

Optimization problem

Authentication and digital signature in e-health systems

Privacy problem!

Intelligent Water/Air Quality Monitoring Smart Reading Environments Intelligent Lighting system Video Processing

(Video annotation/summarization)

Problems: - Monitoring Water

Pollutions- Plant viruses analysis- Animal identification - Remote sensing

applications- Plant ripeness and

disease diagnosis- Fish counting and

monitoring  

Track IIIIntelligent environment and applications

Recommender systems for Air and water pollutions

Multi-Class SVM based ClassificationApproach for Tomato Maturity and Ripeness

Maturity Indices

There are six maturity stages viz. mature green, breaker, turning, pink, and light red.

Tomato fruits are harvested at the required ripeness stage for marketing or consuming.Usually tomatoes are

harvested at colour break stage for distant markets and fully red /ripe stage for local markets.

Selection of right stage of maturity for harvest is an important aspect, which has considerable influence on storage life and quality and final acceptance by the consumer.

Automatic Tomatoes Diseases Diagnosis System

Animal Welfare: Cattle identification• Identify the origin of each animal; • Trace the path of each animal from

location to location; • Trace each animal exposed to disease; • Eradicate or control an animal health

threat; • Retrieve information within hours of an

outbreak and implement intervention strategies;

• Enhance the safety and security of the food chain;

• Improve consumer confidence; and, • Facilitate efficient market transactions

as it provides assurance to buyers regarding the animals life history.

Animal welfare informatics: Technology based – alternative solution: Cattle Identification Using Muzzle Print Images

Arabian Horse identification using Iris pattern

The Arabian horse is a breed of horse that originated on the Arabian Peninsula. It is one of the oldest breeds, dating back 4,500 years. Recent developments in iris scanning have led to a new form of equine identification,

and research has indicated that the horse's eye could be the most telling identifier.

Recent developments in iris scanning have led to a new form of equine identification, and research has indicated that the horse's eye could be the most telling identifier.

Automatic Nile Tilapia Fish Classification Approachusing Machine Learning Techniques

Commonly, aquatic experts use traditional methods such as casting nets or underwater human monitoring for detecting existence and quantities of different species of fish. However, the recent breakthrough in digital cameras and storage abilities, with consequent cost reduction, can be utilized for automatically observing different underwater species.

Counting!!

Example : A set of compounds (single class) have a similar interaction to cells, genes or other compounds will share similar patterns.

For a new compound, if the extracted pattern exist, then this compound is in the same class of the previously tested compounds

Cheminformatics is the application of information technology to help chemists to Investigate problems.Cheminformatics is based on Structure–Activity Relationship (SAR) principle. The SAR principle declares that similar molecules have similar activities. The structure of compounds is represented by a set of descriptors.

Molecules(Structure) Ac

tivi

tyAc

tivi

ty

Data Set

Cheminformatics Molecules(Structure)

Activity prediction

Definition

Cheminformatics

Grap

hs a

re

ever

ywhe

re.

Program Flow

Ecological NetworkBiological Network Social Network

Chemical Network Web Graph

Chemical compounds (Cheminformatics)Protein structures, biological pathways/networks (Bioinformactics)

Social networks and graph mining

Intelligent Ooptimization and applications track

Track IV: The intelligent technology for blind and visual impaired people

The intelligent technology for blind and visual impaired people

Tongue Drive System• For disabled people,

technology may do more than just improve their lives - high-tech tools may give them life back.

• Researchers from the Gergia Institute of Technology created the latest device, a mouth retainer that allows people with spinal cord ( في إصابات

الشوكي injuries to(النخاعoperate a computer and move an electric wheelchair with only their tongues

Failed projects!!

Users wear a cap that can read brain signals. Those signals are then relayed to a brain scan electroencephalograph (EEG) on the wheelchair which are then analyzed by a computer program and sent to the wheelchair. Toyota said its next goal is to allow users to think about letters in order to spell words.

Analysis brain signals?

Thought-Controlled Wheelchair

A brain scan electroencephalograph (EEG)

Electroencephalography (EEG)

Electro: relating to electricity. Encephalo: relating to the

brain. Graphy: writing or

representation produced in a specified manner.

Therefore, EEG produces a graphed representation of the electrical activity occurring in a person’s brain.

Electrodes are placed in specific regions of the scalp. These electrodes measure the electrical current occurring in varying regions of the brain and transmit this information to a computer.

Detection of seizure epilepsy (EEG signals for detection epilepsy)

one percent of the people in the world suffer from epilepsy and 30% of epileptics are not helped by medication. Careful analyses of the EEG signals can provide valuable insight and improved understanding of the mechanisms causing epileptic disorders and helps in identifying epilepsy seizures. Manual analysis of the EEG signals for detection epilepsy is very time consuming, hence researchers are looking towards automatic detection of epilepsy seizures from EEG signals recordings. 

Social Networks and Graph Mining

Social Network Framework for Deaf and Blind People Time-of-flight

Camera

CloudObject / Arabic Text

Recognition

Emotion Detection Sign language Audio

Audio Sign language

Images / Audio

Pictures

Blind mode

Deaf mode

Images / Audio

Seamless communication

SoNetBluePosts

User Name

My first post with image

Normal user

audio or text posts

Image / Video / Audio Posts

Notifications, GPS coordinatesPhone numbers

Find nearest friendCall /sms friends (SOS)

Thanks and Acknowledgement45

SRGE Workshop, Bio-Inspiring and Evolutionary Computation Trends: Applications and Open Issues (7-November-2015)