Adaptive Display Power Management for Mobile Games

Bhojan Anand‡, Karthik Thirugnanam†, Jeena Sebastian‡, Pravein G. Kannan‡, Akhihebbal L. Ananda‡,

Mun Choon Chan‡ and Rajesh Krishna Balan†

‡ National University of Singapore (NUS) and † Singapore Management University (SMU)

1

2

Problem: Display draws significant phone power

Key Challenge: No loss in end user experience

Key problem and Solution

Display45-50%

Network35-40%

CPU4-

15%Measured on HTC Magic while streaming a Youtube Video

3

Dynamically adjust image brightness and LCD display backlight levels

50-70% display power savings with no significant user experience impact

Key problem and Solution

Key problem and Solution

Background

System Design

Evaluation

Discussion/Future Work

4

Talk Outline

LCD displays have two components:

Power consumed mostly by the Backlight Thus brightening the image, and darkening

the backlight saves power.  5

Background - LCD Displays

Backlight - Provides light, and consumes power

LCD Panel - Filters light based on image to be displayed

Method 1: Naively dim the display◦ Creates visible artifacts (flicker, brightness loss,

etc)◦ Especially noticeable in high frame rate

applications

6

Background: Saving Display Power

Method 2: Compensate with increased brightness● Linearly apply same transform to entire image

Leads to saturated images

7

Background: Saving Display Power

Method 2: Compensate with increased brightness● Non linear approaches prevent saturation but cause

contrast loss

Our solution uses this approach intelligently

8

Background: Saving Display Power

Gamma Correction, or gamma, is a tone mapping function used to brighten scenes● Very Low Saturation relative to linear● Low computational overhead

9

Non Linear Gamma Correction

Before After: Gamma 2

10

Effect of Gamma on Image Quality

Original Image after Gamma Increase

(gamma=2)

Image after Gamma Increase andbacklight reduction

Games are popular and resource intensive● Extremely high frame rates● Flicker and brightness changes very noticeable to users

 We use two representative games● Quake III – Commercial First Person Shooting (FPS) game ● Planeshift – Massively Multiplayer Role Playing Game (MMORPG)

   

11

Test Applications

Key problem and Solution

Background

System Design

Evaluation

Discussion/Future Work

12

Talk Outline

Ultimate goal: Save significant power with no loss in end user experience

Challenge 1: Understanding the relationship between the backlight intensity, gamma, image brightness, and the power consumed

Challenge 2: Identifying human thresholds for brightness compensation

Challenge 3: Dynamically applying the solution

13

System Design: Key Challenges

Relationship found to be linear.  No other major contributing factors

14

Challenge 1: Backlight vs Power

0 50 100 150 200 2500

20

40

60

80

100

Backlight Value

% D

ispla

y Po

wer

Cons

umed

HTC Hero

Laptop (W500)

HTC Magic

Perceived brightness kept constant Non linear compensation necessary Useful gamma range is 1 to 4

15

Challenge 1: Backlight vs Gamma

0 1 2 3 4 5 6 7 8 9 100

50

100

150

200

250

Gamma Value

Back

light

Val

ue

Obtained via small user study●5 postgraduate students

Each user shown a range of images●Covered a full range of brightness

For each image, users had to boost gamma to obtain two quality thresholds ●Described in next slide●Tool provided boosted gamma at .1 intervals

with automatic backlight compensation16

Challenge 2: Human Thresholds

Conservative: Image quality comparable to original

Aggressive: Image quality is affected but acceptable

17

Challenge 2: Two Thresholds

0 2 4 6 8 10 12 141

2

3

4

5

Image Brightness Levels (Darkest to Brightest)

Gam

ma

Valu

e

18

Challenge 3: Runtime AlgorithmStart

Calculate Average Brightness of last X Samples. Is there a change?

Mode + Brightness -> Gamma & Backlight Leave Settings as it is

Sleep Thread for Y ms

Yes No

Test platform● Most of the evaluation on Laptop● Prototype Mobile implementation available

(demo)

Objective Analytical Experiments ● Power measurements ● Measured power saved in different modes

Perceived User Impact● Large scale user study (60 users) with Quake III● Measured perceived quality loss in different

modes 19

Evaluation Methodology

0 2 4 6 8 10 120

1

2

3

4

5

Image Brightness Levels (Darkest to Brightest)

Gam

ma

Valu

e

20

Evaluation: Three Test Modes

Unmodified

Conservative

Aggressive

Two bounding modes tested but omitted for simplicity

21

A recorded trace used to measure power

Evaluation: Power Savings

Default

Conservative

Aggressive

0 10 20 30 40 50 60 70 80

0

49

68

% Display Power Saved

Large Scale User study● 60 Singapore Management University

undergrads.● 34 Male and 26 Female students with differing

background and game experiences

Participants trained on an unmodified version of the game● They then played the 3 different versions of the

game● Play order randomized with recalibration at every

step22

User Study Methodology

23

Users rated each version by 6 criteria● Covered different quality dimensions

Evaluation: User Study Results

Aggressive Conservative Default1

2

3

4

5

Aver

age

Acce

ptab

ility

Sc

ore

Bad

Good

Strongly Agree =

Strongly Disagree =

Neutral =

Aggressive Conservative Default1

2

3

4

5

Avg

Acce

ptab

ility

Sco

re

Default

Conservative

Aggressive

0 10 20 30 40 50 60 70 80

% Display Power Saved Difference between Aggressive and

Conservative significant

24

Evaluation: Aggressive vs Conservative

25

Aggressive Conservative Default1

2

3

4

5

Avg

Acce

ptab

ility

Sco

re

Default

Conservative

Aggressive

0 10 20 30 40 50 60 70 80

% Display Power Saved Difference betw. Conservative and Default

Evaluation: Power vs Perception

Conservative (Dynamic Conservative)● High Quality

Perceived quality comparable to default.● Significant Savings – 49%

Aggressive (Dynamic Aggressive)

● High Power Saving – 68%● Acceptable Quality

26

Evaluation: Conclusions

OLED Displays● Do not use Backlight● Power consumption depends on displayed

content● Algorithm needs to be rethought

Other Limitations & Future Work● Initial User studies were small scale, and in a

controlled environment● Power Measurements could be more accurate,

esp for mobile phone● Evaluation of mobile implementation

27

Discussion

General systematic approach to save power on LCD screens

Identified key parameters determining the quality vs power savings tradeoff

Implemented and tested with 60 end users

System achieves significant power savings with minimal overhead and quality loss

28

Contributions

Thank youAny Questions

29