Resource management 1. CCDB big tables problem MySQL packet size is limited by 1 mb by default...
-
Upload
aileen-stanley -
Category
Documents
-
view
217 -
download
0
description
Transcript of Resource management 1. CCDB big tables problem MySQL packet size is limited by 1 mb by default...
![Page 1: Resource management 1. CCDB big tables problem MySQL packet size is limited by 1 mb by default gzipping doesn’t help. No partial blob transfers until.](https://reader036.fdocuments.in/reader036/viewer/2022082510/5a4d1b0c7f8b9ab05998c115/html5/thumbnails/1.jpg)
1
Resource management
![Page 2: Resource management 1. CCDB big tables problem MySQL packet size is limited by 1 mb by default gzipping doesn’t help. No partial blob transfers until.](https://reader036.fdocuments.in/reader036/viewer/2022082510/5a4d1b0c7f8b9ab05998c115/html5/thumbnails/2.jpg)
2
CCDB big tables problem
• MySQL packet size is limited by 1 mb by default• gzipping doesn’t help.• No partial blob transfers until MySQL 6• ‘root’ privileges needed to configure MySQL • Vulnerability for DDos attacks• Since CCDB is ‘do not delete’ storage it will lead
to redundant database grow
![Page 3: Resource management 1. CCDB big tables problem MySQL packet size is limited by 1 mb by default gzipping doesn’t help. No partial blob transfers until.](https://reader036.fdocuments.in/reader036/viewer/2022082510/5a4d1b0c7f8b9ab05998c115/html5/thumbnails/3.jpg)
3
Resources
Usual frameworks application structure
Configs
Data
Resources
Resources are:
• Static
• Not changing during app. run
• Seldom change during app. life
• Too big to compile into the app.
Config managerData
connectorsResource manager
Qt, Java, GTKApplicationMono, MFC, GTK,
![Page 4: Resource management 1. CCDB big tables problem MySQL packet size is limited by 1 mb by default gzipping doesn’t help. No partial blob transfers until.](https://reader036.fdocuments.in/reader036/viewer/2022082510/5a4d1b0c7f8b9ab05998c115/html5/thumbnails/4.jpg)
4
Very simple resource manager
fopen
![Page 5: Resource management 1. CCDB big tables problem MySQL packet size is limited by 1 mb by default gzipping doesn’t help. No partial blob transfers until.](https://reader036.fdocuments.in/reader036/viewer/2022082510/5a4d1b0c7f8b9ab05998c115/html5/thumbnails/5.jpg)
5
Resource manager idea
ResorceManager Server
./resources/mydata.datdata cached
?
YES
NO
Caching
mydata
• Easy to use • Automated • Flexible• Updatable
• Less mistakes • Easy to change• Easy to maintain
![Page 6: Resource management 1. CCDB big tables problem MySQL packet size is limited by 1 mb by default gzipping doesn’t help. No partial blob transfers until.](https://reader036.fdocuments.in/reader036/viewer/2022082510/5a4d1b0c7f8b9ab05998c115/html5/thumbnails/6.jpg)
6
What other use for resources
• QT 4+, QResource is a part of libqtcore.• GTK, use gtk_rc_* functions to read resources• OSX API NSBundle, CFBundleRef, etc…• Mono – System.Resources namespace• Java – lots of stuff (depends on framework)• wxWidgets – RC, WXR , XRC…
![Page 7: Resource management 1. CCDB big tables problem MySQL packet size is limited by 1 mb by default gzipping doesn’t help. No partial blob transfers until.](https://reader036.fdocuments.in/reader036/viewer/2022082510/5a4d1b0c7f8b9ab05998c115/html5/thumbnails/7.jpg)
7
What should we do• Store link to resource in the DB• Make simple resource API through JANA or CCDB.
(we already have most of the code!)
vector<vector> GetTable(“/w/HallD/data/Magnets/table.txt”)
vector<vector> GetTable(“res:Magnets/table”)
• “res:” means open files from resource directory (which is known by JANA)
• No “res:” means just open that file by that path.