Collaboration with LTSI Testing · 2020. 3. 21. · LTSI Workshop / Embedded Linux Conference 2014...
Transcript of Collaboration with LTSI Testing · 2020. 3. 21. · LTSI Workshop / Embedded Linux Conference 2014...
![Page 1: Collaboration with LTSI Testing · 2020. 3. 21. · LTSI Workshop / Embedded Linux Conference 2014 16 START GOAL Accelerate Things that cannot be accelerated •CPU clock •I/O access](https://reader036.fdocuments.in/reader036/viewer/2022062606/5fe5fda96be2c9621839e8b5/html5/thumbnails/1.jpg)
Copyright 2014, Toshiba Corporation.
Collaboration with LTSI Testing
Yoshitake Kobayashi
Corporate Software Engineering CenterToshiba Corporation
![Page 2: Collaboration with LTSI Testing · 2020. 3. 21. · LTSI Workshop / Embedded Linux Conference 2014 16 START GOAL Accelerate Things that cannot be accelerated •CPU clock •I/O access](https://reader036.fdocuments.in/reader036/viewer/2022062606/5fe5fda96be2c9621839e8b5/html5/thumbnails/2.jpg)
2LTSI Workshop / Embedded Linux Conference 2014
![Page 3: Collaboration with LTSI Testing · 2020. 3. 21. · LTSI Workshop / Embedded Linux Conference 2014 16 START GOAL Accelerate Things that cannot be accelerated •CPU clock •I/O access](https://reader036.fdocuments.in/reader036/viewer/2022062606/5fe5fda96be2c9621839e8b5/html5/thumbnails/3.jpg)
3LTSI Workshop / Embedded Linux Conference 2014
![Page 4: Collaboration with LTSI Testing · 2020. 3. 21. · LTSI Workshop / Embedded Linux Conference 2014 16 START GOAL Accelerate Things that cannot be accelerated •CPU clock •I/O access](https://reader036.fdocuments.in/reader036/viewer/2022062606/5fe5fda96be2c9621839e8b5/html5/thumbnails/4.jpg)
4LTSI Workshop / Embedded Linux Conference 2014
![Page 5: Collaboration with LTSI Testing · 2020. 3. 21. · LTSI Workshop / Embedded Linux Conference 2014 16 START GOAL Accelerate Things that cannot be accelerated •CPU clock •I/O access](https://reader036.fdocuments.in/reader036/viewer/2022062606/5fe5fda96be2c9621839e8b5/html5/thumbnails/5.jpg)
5LTSI Workshop / Embedded Linux Conference 2014
![Page 6: Collaboration with LTSI Testing · 2020. 3. 21. · LTSI Workshop / Embedded Linux Conference 2014 16 START GOAL Accelerate Things that cannot be accelerated •CPU clock •I/O access](https://reader036.fdocuments.in/reader036/viewer/2022062606/5fe5fda96be2c9621839e8b5/html5/thumbnails/6.jpg)
6LTSI Workshop / Embedded Linux Conference 2014
Patches available
on upstream
Patches available
on Xilinx’s repository
LTSI-3.10
backport
backport
![Page 7: Collaboration with LTSI Testing · 2020. 3. 21. · LTSI Workshop / Embedded Linux Conference 2014 16 START GOAL Accelerate Things that cannot be accelerated •CPU clock •I/O access](https://reader036.fdocuments.in/reader036/viewer/2022062606/5fe5fda96be2c9621839e8b5/html5/thumbnails/7.jpg)
7LTSI Workshop / Embedded Linux Conference 2014
![Page 8: Collaboration with LTSI Testing · 2020. 3. 21. · LTSI Workshop / Embedded Linux Conference 2014 16 START GOAL Accelerate Things that cannot be accelerated •CPU clock •I/O access](https://reader036.fdocuments.in/reader036/viewer/2022062606/5fe5fda96be2c9621839e8b5/html5/thumbnails/8.jpg)
8LTSI Workshop / Embedded Linux Conference 2014
![Page 9: Collaboration with LTSI Testing · 2020. 3. 21. · LTSI Workshop / Embedded Linux Conference 2014 16 START GOAL Accelerate Things that cannot be accelerated •CPU clock •I/O access](https://reader036.fdocuments.in/reader036/viewer/2022062606/5fe5fda96be2c9621839e8b5/html5/thumbnails/9.jpg)
9LTSI Workshop / Embedded Linux Conference 2014
![Page 10: Collaboration with LTSI Testing · 2020. 3. 21. · LTSI Workshop / Embedded Linux Conference 2014 16 START GOAL Accelerate Things that cannot be accelerated •CPU clock •I/O access](https://reader036.fdocuments.in/reader036/viewer/2022062606/5fe5fda96be2c9621839e8b5/html5/thumbnails/10.jpg)
10LTSI Workshop / Embedded Linux Conference 2014
Target filesWriter processes (N procs)
Target Host
write() system call
Log Host
Logger
Each writer process
• writes to text files (ex. 100 files)
• sends progress log to logger
This test case available at the following URL:
https://github.com/ystk/fs-test
Reset at
random timing
![Page 11: Collaboration with LTSI Testing · 2020. 3. 21. · LTSI Workshop / Embedded Linux Conference 2014 16 START GOAL Accelerate Things that cannot be accelerated •CPU clock •I/O access](https://reader036.fdocuments.in/reader036/viewer/2022062606/5fe5fda96be2c9621839e8b5/html5/thumbnails/11.jpg)
11LTSI Workshop / Embedded Linux Conference 2014
Checker
Target
file
LOG
file
AAAAABBBBBCCCCCDDDDDEEEEE
OK
FFFFF
AAAAABBBBBCCCCCDDDDDEEEEE
OKAAAAABBBBBCCCCCDDDDDAAAAA
NGAAAAABBBBBCCCCCDDDDD
NG
?
size mismatchdata mismatch
Verify the following metrics
• file size
• file contents Estimated file
contents
Estimated file size
![Page 12: Collaboration with LTSI Testing · 2020. 3. 21. · LTSI Workshop / Embedded Linux Conference 2014 16 START GOAL Accelerate Things that cannot be accelerated •CPU clock •I/O access](https://reader036.fdocuments.in/reader036/viewer/2022062606/5fe5fda96be2c9621839e8b5/html5/thumbnails/12.jpg)
12LTSI Workshop / Embedded Linux Conference 2014
0.00
0.50
1.00
1.50
2.00
EXT3-
ORDERED
EXT3-
JOURNAL
* * * JFS XFS
Err
or
rate
[%]
45.9%
Err
or
rate
[%]
0.00
0.50
1.00
1.50
2.00
EXT3-ORDERED
EXT3-JOURNAL
EXT4-JOURNAL
EXT4-ORDERED
EXT4-WRITEBACK
* XFS BTRFS
82.4%84.7%43.4% 41.4%
43.2%
Err
or
rate
[%]
0.00
0.50
1.00
1.50
2.00
EXT3-
ORDERED
EXT3-
JOURNAL
EXT4-
JOURNAL
EXT4-
ORDERED
* JFS XFS
13.3%
kernel
2.6.18
kernel
2.6.31
kernel
2.6.33
File size mismatchData mismatch
![Page 13: Collaboration with LTSI Testing · 2020. 3. 21. · LTSI Workshop / Embedded Linux Conference 2014 16 START GOAL Accelerate Things that cannot be accelerated •CPU clock •I/O access](https://reader036.fdocuments.in/reader036/viewer/2022062606/5fe5fda96be2c9621839e8b5/html5/thumbnails/13.jpg)
13LTSI Workshop / Embedded Linux Conference 2014
0.00
0.50
1.00
1.50
2.00
EXT3-
ORDERED
EXT3-
JOURNAL
* * * JFS XFS
Err
or
rate
[%]
45.9%
Err
or
rate
[%]
0.00
0.50
1.00
1.50
2.00
EXT3-ORDERED
EXT3-JOURNAL
EXT4-JOURNAL
EXT4-ORDERED
EXT4-WRITEBACK
* XFS BTRFS
82.4%84.7%43.4% 41.4%
43.2%
Err
or
rate
[%]
0.00
0.50
1.00
1.50
2.00
EXT3-
ORDERED
EXT3-
JOURNAL
EXT4-
JOURNAL
EXT4-
ORDERED
* JFS XFS
13.3%
kernel
2.6.18
kernel
2.6.31
kernel
2.6.33
File size mismatchData mismatch
Point 1:A file system has
different characteristicsof data reliability
![Page 14: Collaboration with LTSI Testing · 2020. 3. 21. · LTSI Workshop / Embedded Linux Conference 2014 16 START GOAL Accelerate Things that cannot be accelerated •CPU clock •I/O access](https://reader036.fdocuments.in/reader036/viewer/2022062606/5fe5fda96be2c9621839e8b5/html5/thumbnails/14.jpg)
14LTSI Workshop / Embedded Linux Conference 2014
0.00
0.50
1.00
1.50
2.00
EXT3-
ORDERED
EXT3-
JOURNAL
* * * JFS XFS
Err
or
rate
[%]
45.9%
Err
or
rate
[%]
0.00
0.50
1.00
1.50
2.00
EXT3-ORDERED
EXT3-JOURNAL
EXT4-JOURNAL
EXT4-ORDERED
EXT4-WRITEBACK
* XFS BTRFS
82.4%84.7%43.4% 41.4%
43.2%
Err
or
rate
[%]
0.00
0.50
1.00
1.50
2.00
EXT3-
ORDERED
EXT3-
JOURNAL
EXT4-
JOURNAL
EXT4-
ORDERED
* JFS XFS
13.3%
kernel
2.6.18
kernel
2.6.31
kernel
2.6.33
File size mismatchData mismatch
Point 1:A file system has
different characteristicsof data reliability
Point 2:Some Results depends
on kernel version
![Page 15: Collaboration with LTSI Testing · 2020. 3. 21. · LTSI Workshop / Embedded Linux Conference 2014 16 START GOAL Accelerate Things that cannot be accelerated •CPU clock •I/O access](https://reader036.fdocuments.in/reader036/viewer/2022062606/5fe5fda96be2c9621839e8b5/html5/thumbnails/15.jpg)
15LTSI Workshop / Embedded Linux Conference 2014
0.00
0.50
1.00
1.50
2.00
EXT3-
ORDERED
EXT3-
JOURNAL
* * * JFS XFS
Err
or
rate
[%]
45.9%
Err
or
rate
[%]
0.00
0.50
1.00
1.50
2.00
EXT3-ORDERED
EXT3-JOURNAL
EXT4-JOURNAL
EXT4-ORDERED
EXT4-WRITEBACK
* XFS BTRFS
82.4%84.7%43.4% 41.4%
43.2%
Err
or
rate
[%]
0.00
0.50
1.00
1.50
2.00
EXT3-
ORDERED
EXT3-
JOURNAL
EXT4-
JOURNAL
EXT4-
ORDERED
* JFS XFS
13.3%
kernel
2.6.18
kernel
2.6.31
kernel
2.6.33
File size mismatchData mismatch
Point 1:A file system has
different characteristicsof data reliability
Point 2:Some Results depends
on kernel version
Point 3:EXT4-Journal and BTRFS
has a nice result
![Page 16: Collaboration with LTSI Testing · 2020. 3. 21. · LTSI Workshop / Embedded Linux Conference 2014 16 START GOAL Accelerate Things that cannot be accelerated •CPU clock •I/O access](https://reader036.fdocuments.in/reader036/viewer/2022062606/5fe5fda96be2c9621839e8b5/html5/thumbnails/16.jpg)
16LTSI Workshop / Embedded Linux Conference 2014
START GOAL
Accelerate
Things that cannot be accelerated
• CPU clock
• I/O access speed (ex. SSD)
• Network bandwidth
• etc.Try to detect errors that caused
by clock
Focus to accelerate clock
Issues
• Long-term testing takes really long time→ We want results as fast as possible
![Page 17: Collaboration with LTSI Testing · 2020. 3. 21. · LTSI Workshop / Embedded Linux Conference 2014 16 START GOAL Accelerate Things that cannot be accelerated •CPU clock •I/O access](https://reader036.fdocuments.in/reader036/viewer/2022062606/5fe5fda96be2c9621839e8b5/html5/thumbnails/17.jpg)
17LTSI Workshop / Embedded Linux Conference 2014
Xdaliclock works as a stopwatch
Returned an incorrect value
after about 450 days.
(It takes about 6 hours in 1000
times acceleration)
![Page 18: Collaboration with LTSI Testing · 2020. 3. 21. · LTSI Workshop / Embedded Linux Conference 2014 16 START GOAL Accelerate Things that cannot be accelerated •CPU clock •I/O access](https://reader036.fdocuments.in/reader036/viewer/2022062606/5fe5fda96be2c9621839e8b5/html5/thumbnails/18.jpg)
18LTSI Workshop / Embedded Linux Conference 2014
![Page 19: Collaboration with LTSI Testing · 2020. 3. 21. · LTSI Workshop / Embedded Linux Conference 2014 16 START GOAL Accelerate Things that cannot be accelerated •CPU clock •I/O access](https://reader036.fdocuments.in/reader036/viewer/2022062606/5fe5fda96be2c9621839e8b5/html5/thumbnails/19.jpg)
19LTSI Workshop / Embedded Linux Conference 2014
![Page 20: Collaboration with LTSI Testing · 2020. 3. 21. · LTSI Workshop / Embedded Linux Conference 2014 16 START GOAL Accelerate Things that cannot be accelerated •CPU clock •I/O access](https://reader036.fdocuments.in/reader036/viewer/2022062606/5fe5fda96be2c9621839e8b5/html5/thumbnails/20.jpg)
20LTSI Workshop / Embedded Linux Conference 2014
![Page 21: Collaboration with LTSI Testing · 2020. 3. 21. · LTSI Workshop / Embedded Linux Conference 2014 16 START GOAL Accelerate Things that cannot be accelerated •CPU clock •I/O access](https://reader036.fdocuments.in/reader036/viewer/2022062606/5fe5fda96be2c9621839e8b5/html5/thumbnails/21.jpg)
21LTSI Workshop / Embedded Linux Conference 2014
![Page 22: Collaboration with LTSI Testing · 2020. 3. 21. · LTSI Workshop / Embedded Linux Conference 2014 16 START GOAL Accelerate Things that cannot be accelerated •CPU clock •I/O access](https://reader036.fdocuments.in/reader036/viewer/2022062606/5fe5fda96be2c9621839e8b5/html5/thumbnails/22.jpg)
22LTSI Workshop / Embedded Linux Conference 2014