Jat by birth: Cobbler by profession: Activist by mission - Naresh Kadyan
SUSE Manager Troubleshooting - susecon.com · Jabber Instant Deployment Cobbler ... Many important...
Transcript of SUSE Manager Troubleshooting - susecon.com · Jabber Instant Deployment Cobbler ... Many important...
![Page 1: SUSE Manager Troubleshooting - susecon.com · Jabber Instant Deployment Cobbler ... Many important settings for server operation /srv/www/htdocs/pub Web server data for bootstrap,](https://reader031.fdocuments.in/reader031/viewer/2022020303/5b7792c17f8b9a805c8d4d2d/html5/thumbnails/1.jpg)
SUSE® Manager Troubleshootingand Technical Tips
Don VosburgSales Engineer
SUSE
Klaus KämpfProduct Owner, SUSE Manager
SUSE
![Page 2: SUSE Manager Troubleshooting - susecon.com · Jabber Instant Deployment Cobbler ... Many important settings for server operation /srv/www/htdocs/pub Web server data for bootstrap,](https://reader031.fdocuments.in/reader031/viewer/2022020303/5b7792c17f8b9a805c8d4d2d/html5/thumbnails/2.jpg)
2
Agenda
• SUSE Manager Architectural overview
• Troubleshooting common technical issues‒ Channel sync
‒ Client registration/communication
• Optimizing your SUSE Manager
• Where to find help
![Page 3: SUSE Manager Troubleshooting - susecon.com · Jabber Instant Deployment Cobbler ... Many important settings for server operation /srv/www/htdocs/pub Web server data for bootstrap,](https://reader031.fdocuments.in/reader031/viewer/2022020303/5b7792c17f8b9a805c8d4d2d/html5/thumbnails/3.jpg)
SUSE Manager Architecture
![Page 4: SUSE Manager Troubleshooting - susecon.com · Jabber Instant Deployment Cobbler ... Many important settings for server operation /srv/www/htdocs/pub Web server data for bootstrap,](https://reader031.fdocuments.in/reader031/viewer/2022020303/5b7792c17f8b9a805c8d4d2d/html5/thumbnails/4.jpg)
4
SUSE® Manager
System Components
SUSE Manager Server
Python, Java, Tomcat, Apache Application Server
SUSE Manager Server
Python, Perl, Java, Tomcat, Apache Application Server
Jabber
InstantDeployment
Cobbler
Bare MetalProvisioning
API
Scripting,Third-party
Proxy
Load Balancing,Branches
Database
Embedded: postgresql External: Oracle
![Page 5: SUSE Manager Troubleshooting - susecon.com · Jabber Instant Deployment Cobbler ... Many important settings for server operation /srv/www/htdocs/pub Web server data for bootstrap,](https://reader031.fdocuments.in/reader031/viewer/2022020303/5b7792c17f8b9a805c8d4d2d/html5/thumbnails/5.jpg)
5
SUSE Manager Servicesspacewalk-service
• {start|stop|status|reload|restart|enable|disable}
• listListing spacewalk services...jabberd 0:off 1:off 2:off 3:on 4:on 5:on 6:offtomcat6 0:off 1:off 2:off 3:on 4:on 5:on 6:offapache2 0:off 1:off 2:off 3:on 4:on 5:on 6:offosa-dispatcher 0:off 1:off 2:off 3:on 4:on 5:on 6:offMonitoring 0:off 1:off 2:off 3:on 4:on 5:on 6:offMonitoringScout 0:off 1:off 2:off 3:on 4:on 5:on 6:offrhn-search 0:off 1:off 2:off 3:on 4:on 5:on 6:offcobblerd 0:off 1:off 2:off 3:on 4:on 5:on 6:offtaskomatic 0:off 1:off 2:off 3:on 4:on 5:on 6:off•
• Individual components may be separately stopped/started as needed
• Database has its own separate startup and is assumed
![Page 6: SUSE Manager Troubleshooting - susecon.com · Jabber Instant Deployment Cobbler ... Many important settings for server operation /srv/www/htdocs/pub Web server data for bootstrap,](https://reader031.fdocuments.in/reader031/viewer/2022020303/5b7792c17f8b9a805c8d4d2d/html5/thumbnails/6.jpg)
6
Important Files You Need to Know About (part1)
/var/log/rhn/
Log files from many SUSE Manager operations
/var/cache/rhn/repodata/
Where the client repository info is stored
/etc/rhn/rhn.conf
Many important settings for server operation
/srv/www/htdocs/pub
Web server data for bootstrap, bootstrap repositories, GPG keys
![Page 7: SUSE Manager Troubleshooting - susecon.com · Jabber Instant Deployment Cobbler ... Many important settings for server operation /srv/www/htdocs/pub Web server data for bootstrap,](https://reader031.fdocuments.in/reader031/viewer/2022020303/5b7792c17f8b9a805c8d4d2d/html5/thumbnails/7.jpg)
7
Important Files You Need to Know About (part 2)
/var/spacewalk/packages
Where your downloaded/synched rpm files are
There are MANY other files on the SUSE Manager system...
– but do not change them unless you are SURE
![Page 8: SUSE Manager Troubleshooting - susecon.com · Jabber Instant Deployment Cobbler ... Many important settings for server operation /srv/www/htdocs/pub Web server data for bootstrap,](https://reader031.fdocuments.in/reader031/viewer/2022020303/5b7792c17f8b9a805c8d4d2d/html5/thumbnails/8.jpg)
Where to Look
![Page 9: SUSE Manager Troubleshooting - susecon.com · Jabber Instant Deployment Cobbler ... Many important settings for server operation /srv/www/htdocs/pub Web server data for bootstrap,](https://reader031.fdocuments.in/reader031/viewer/2022020303/5b7792c17f8b9a805c8d4d2d/html5/thumbnails/9.jpg)
9
Log File Details
• Every request is handled by Apache first
/var/log/apache2/access_log
/var/log/apache2/error_log
• WebUI (/rhn/...) and API requests are handled by Tomcat
/var/log/tomcat6/
• Client-Server communication
/var/log/rhn/rhn_server_xmlrpc.log
• Autoinstallation: Cobbler
/var/log/cobbler/
![Page 10: SUSE Manager Troubleshooting - susecon.com · Jabber Instant Deployment Cobbler ... Many important settings for server operation /srv/www/htdocs/pub Web server data for bootstrap,](https://reader031.fdocuments.in/reader031/viewer/2022020303/5b7792c17f8b9a805c8d4d2d/html5/thumbnails/10.jpg)
Commands and Tools
![Page 11: SUSE Manager Troubleshooting - susecon.com · Jabber Instant Deployment Cobbler ... Many important settings for server operation /srv/www/htdocs/pub Web server data for bootstrap,](https://reader031.fdocuments.in/reader031/viewer/2022020303/5b7792c17f8b9a805c8d4d2d/html5/thumbnails/11.jpg)
11
Important Commands and Tools
spacecmd
All the power of the webUI and more!
spacewalk-utils
Scripts to shorten processes and accomplish important tasks – not installed by default, but supported
Neither of these tools prevents stupid!
![Page 12: SUSE Manager Troubleshooting - susecon.com · Jabber Instant Deployment Cobbler ... Many important settings for server operation /srv/www/htdocs/pub Web server data for bootstrap,](https://reader031.fdocuments.in/reader031/viewer/2022020303/5b7792c17f8b9a805c8d4d2d/html5/thumbnails/12.jpg)
12
Remember the Roots
spacewalk- and rhn-
• Retained the command structure to inherit upstream goodness
• API from upstream retains full functionality
• Consistency regardless of client distribution
• Don't be only SLES-y and YaST-y
‒ Things like CA for SUMA actually follow upstream flow
![Page 13: SUSE Manager Troubleshooting - susecon.com · Jabber Instant Deployment Cobbler ... Many important settings for server operation /srv/www/htdocs/pub Web server data for bootstrap,](https://reader031.fdocuments.in/reader031/viewer/2022020303/5b7792c17f8b9a805c8d4d2d/html5/thumbnails/13.jpg)
Troubleshooting Common Issues
![Page 14: SUSE Manager Troubleshooting - susecon.com · Jabber Instant Deployment Cobbler ... Many important settings for server operation /srv/www/htdocs/pub Web server data for bootstrap,](https://reader031.fdocuments.in/reader031/viewer/2022020303/5b7792c17f8b9a805c8d4d2d/html5/thumbnails/14.jpg)
14
Most Support Issues Fall Into Two Categories
• Channel setup and synchronization
• Client registration and communication
![Page 15: SUSE Manager Troubleshooting - susecon.com · Jabber Instant Deployment Cobbler ... Many important settings for server operation /srv/www/htdocs/pub Web server data for bootstrap,](https://reader031.fdocuments.in/reader031/viewer/2022020303/5b7792c17f8b9a805c8d4d2d/html5/thumbnails/15.jpg)
15
Channel Setup and Synchronization
• Mirroring content with Customer Center‒ Requires Customer Center to be healthy
‒ Can take a very long time – especially initially
• mgr-ncc-sync (NCC) and mgr-sync (SCC)
‒ Scripts built by SUSE to interact with Customer Center
‒ Both call spacewalk-repo-sync in non-interactive mode
‒ Both use taskomatic scheduler
![Page 16: SUSE Manager Troubleshooting - susecon.com · Jabber Instant Deployment Cobbler ... Many important settings for server operation /srv/www/htdocs/pub Web server data for bootstrap,](https://reader031.fdocuments.in/reader031/viewer/2022020303/5b7792c17f8b9a805c8d4d2d/html5/thumbnails/16.jpg)
16
• spacewalk-repo-sync is scheduled by taskomatic• Channel metadata read from repository, compared to what is
already in the database• RPM's get copied to unique (obscured) location under /var/spacewalk
‒ If the exact RPM exists already in another channel, only a database pointer is created
• RPM metadata is parsed into the database as each is copied• Errata (patch) info is not processed until all RPM's have been
copied and parsed• Client metadata cache (final step) is created in /var/cache/rhn/repodata
Channel Sync Process Flow
![Page 17: SUSE Manager Troubleshooting - susecon.com · Jabber Instant Deployment Cobbler ... Many important settings for server operation /srv/www/htdocs/pub Web server data for bootstrap,](https://reader031.fdocuments.in/reader031/viewer/2022020303/5b7792c17f8b9a805c8d4d2d/html5/thumbnails/17.jpg)
17
• Individual channel sync logs are in /var/log/rhn/reposync(1.7: one file per sync, 2.1: one file per channel)
• Taskomatic log is in /var/log/rhn/rhn_taskomatic-daemon.log
• Channel repository data is built in /var/cache/rhn/repodata/channellabelThe files in progress have a .new extension, and are not there when the repodata completes properly
• Validate completion of the repodata in the webUI – “Channel → Details” should show “Completed” and the date/time stamp will match
Watching the Channel Sync Process
![Page 18: SUSE Manager Troubleshooting - susecon.com · Jabber Instant Deployment Cobbler ... Many important settings for server operation /srv/www/htdocs/pub Web server data for bootstrap,](https://reader031.fdocuments.in/reader031/viewer/2022020303/5b7792c17f8b9a805c8d4d2d/html5/thumbnails/18.jpg)
Thank you.
18
Let's Troubleshoot!
![Page 19: SUSE Manager Troubleshooting - susecon.com · Jabber Instant Deployment Cobbler ... Many important settings for server operation /srv/www/htdocs/pub Web server data for bootstrap,](https://reader031.fdocuments.in/reader031/viewer/2022020303/5b7792c17f8b9a805c8d4d2d/html5/thumbnails/19.jpg)
19
Channel Sync Tips
• Internet speed is helpful but not the only variable‒ Much metadata has to be processed, requiring multiple
database operations
• You can temporarily force the channel to use pre-downloaded yum repos from SMT or other locations
‒ spacewalk-repo-sync -c res6-x86_64 -u file:///location/of/smtrepo
• Expect errors in initial channel sync – NCC/SCC issues, metadata change
‒ “No more mirrors to try”
‒ “Errata skipped because of missing package”
• Run it again until all is clean – be patient, drink coffee
![Page 20: SUSE Manager Troubleshooting - susecon.com · Jabber Instant Deployment Cobbler ... Many important settings for server operation /srv/www/htdocs/pub Web server data for bootstrap,](https://reader031.fdocuments.in/reader031/viewer/2022020303/5b7792c17f8b9a805c8d4d2d/html5/thumbnails/20.jpg)
Client Registration and Connectivity
![Page 21: SUSE Manager Troubleshooting - susecon.com · Jabber Instant Deployment Cobbler ... Many important settings for server operation /srv/www/htdocs/pub Web server data for bootstrap,](https://reader031.fdocuments.in/reader031/viewer/2022020303/5b7792c17f8b9a805c8d4d2d/html5/thumbnails/21.jpg)
21
Client Registration Requirements
• Properly synced channels – including SUSE Manager Tools
• Activation keys that point to the proper parent and child channels
• Availability of SUMA client software‒ Pre-installed on the client
‒ Available to be installed from a bootstrap repository
‒ Dependency resolution ASSUMES base media access at the time of registration
• Proper bootstrap script
• Bootstrap repository for SUSE distros can be built with
mgr-create-bootstrap-repo
![Page 22: SUSE Manager Troubleshooting - susecon.com · Jabber Instant Deployment Cobbler ... Many important settings for server operation /srv/www/htdocs/pub Web server data for bootstrap,](https://reader031.fdocuments.in/reader031/viewer/2022020303/5b7792c17f8b9a805c8d4d2d/html5/thumbnails/22.jpg)
22
Activation Keys
• Activation keys and bootstrap scripts SHOULD be distribution/architecture specific
• Create your own key name that makes sense (vs auto-generated)
• Point the Activation Key at a synchronized parent channel
‒ If you choose “SUSE Manager Default”, it will try to auto-detect
• Do as much automation as possible in the activation key – package installs, System Group assignment, Configuration Channel assignments, deploy config files
• Choose the Provisioning entitlement always – the Lifecycle Management module purchase includes it
• Link your activation keys and bootstrap scripts
![Page 23: SUSE Manager Troubleshooting - susecon.com · Jabber Instant Deployment Cobbler ... Many important settings for server operation /srv/www/htdocs/pub Web server data for bootstrap,](https://reader031.fdocuments.in/reader031/viewer/2022020303/5b7792c17f8b9a805c8d4d2d/html5/thumbnails/23.jpg)
23
Bootstrap Scripts• By default are designed to
‒ Install necessary client software
‒ Configure package management on the client to talk to YOUR SUSE Manager server or proxy
‒ Register the system using the activation key specified (rhnreg_ks)
• Can be re-run without harm
• Contain a DO NOT EDIT section that
‒ Detects package management subsystem (yum or zypper)
‒ Performs action on the client based on this – updating the software management software as needed.
• Can be edited to call additional scripts for other actions to be performed at time of registration
• Display – bootstrap complete – when properly done.
![Page 24: SUSE Manager Troubleshooting - susecon.com · Jabber Instant Deployment Cobbler ... Many important settings for server operation /srv/www/htdocs/pub Web server data for bootstrap,](https://reader031.fdocuments.in/reader031/viewer/2022020303/5b7792c17f8b9a805c8d4d2d/html5/thumbnails/24.jpg)
Thank you.
24
Let's Troubleshoot!
![Page 25: SUSE Manager Troubleshooting - susecon.com · Jabber Instant Deployment Cobbler ... Many important settings for server operation /srv/www/htdocs/pub Web server data for bootstrap,](https://reader031.fdocuments.in/reader031/viewer/2022020303/5b7792c17f8b9a805c8d4d2d/html5/thumbnails/25.jpg)
25
Troubleshooting Client Registration
• If bootstrap script does not finish, review the client registration requirements above
• Uninstalled packages usually means you either do not have a populated bootstrap repo and/or access to base media
• Make sure all GPG keys are referenced in the bootstrap script for RH-based distributions (not needed for SUSE)
‒ GPG key files should be in /srv/www/htdocs/pub
• If the system registers, but you see no base channel, ensure your bootstrap script/activation key match the distribution and architecture
![Page 26: SUSE Manager Troubleshooting - susecon.com · Jabber Instant Deployment Cobbler ... Many important settings for server operation /srv/www/htdocs/pub Web server data for bootstrap,](https://reader031.fdocuments.in/reader031/viewer/2022020303/5b7792c17f8b9a805c8d4d2d/html5/thumbnails/26.jpg)
26
Troubleshooting Client Communication
• osad uses port 5222 – make sure it is not being blocked
• Ensure you do not have duplicate entries for the client
• Symptom: Each new system registered overwrites a previously registered one.
If you clone systems (as in vm's), make SURE you delete the NCCcredentials file FIRST:
‒ In SLE it is stored in /etc/zypp/credentials.d
‒ In RH-based systems it is stored in /etc/
![Page 27: SUSE Manager Troubleshooting - susecon.com · Jabber Instant Deployment Cobbler ... Many important settings for server operation /srv/www/htdocs/pub Web server data for bootstrap,](https://reader031.fdocuments.in/reader031/viewer/2022020303/5b7792c17f8b9a805c8d4d2d/html5/thumbnails/27.jpg)
27
Optimizing SUSE Manager
• Add more base RAM
• Allocate more ram to the taskomatic scheduler
‒ Add memory using this parameter in /etc/rhn/rhn.conf
# Set max taskomatic mem
taskomatic.maxmemory=2048
• Add storage capacity (200GB recommended) to /var/spacewalk
‒ Stop spacewalk services, and rename the directory
mv /var/spacewalk /var/spacewalk-orig
‒ Use YaST to add more disk space, and mount it at /var/spacewalk
‒ Copy the data over and recover the disk space
‒ Start spacewalk services
![Page 28: SUSE Manager Troubleshooting - susecon.com · Jabber Instant Deployment Cobbler ... Many important settings for server operation /srv/www/htdocs/pub Web server data for bootstrap,](https://reader031.fdocuments.in/reader031/viewer/2022020303/5b7792c17f8b9a805c8d4d2d/html5/thumbnails/28.jpg)
Thank you.
28
Your Tips or Questions Are Welcome!
![Page 29: SUSE Manager Troubleshooting - susecon.com · Jabber Instant Deployment Cobbler ... Many important settings for server operation /srv/www/htdocs/pub Web server data for bootstrap,](https://reader031.fdocuments.in/reader031/viewer/2022020303/5b7792c17f8b9a805c8d4d2d/html5/thumbnails/29.jpg)
29
Resources and Links
Troubleshooting chapter – installation manual
• https://www.suse.com/documentation/suse_manager/singlehtml/book_susemanager_install/book_susemanager_install.html#ch-troubleshooting
SUSE Manager Documentation
• https://www.suse.com/documentation/suse_manager/
SUSE Manager Public Wiki
• https://wiki.novell.com/index.php/SUSE_Manager
• Attend other SUSE Manager sessions at SUSECon 2014!
![Page 30: SUSE Manager Troubleshooting - susecon.com · Jabber Instant Deployment Cobbler ... Many important settings for server operation /srv/www/htdocs/pub Web server data for bootstrap,](https://reader031.fdocuments.in/reader031/viewer/2022020303/5b7792c17f8b9a805c8d4d2d/html5/thumbnails/30.jpg)
30
![Page 31: SUSE Manager Troubleshooting - susecon.com · Jabber Instant Deployment Cobbler ... Many important settings for server operation /srv/www/htdocs/pub Web server data for bootstrap,](https://reader031.fdocuments.in/reader031/viewer/2022020303/5b7792c17f8b9a805c8d4d2d/html5/thumbnails/31.jpg)
Unpublished Work of SUSE LLC. All Rights Reserved.This work is an unpublished work and contains confidential, proprietary and trade secret information of SUSE LLC. Access to this work is restricted to SUSE employees who have a need to know to perform tasks within the scope of their assignments. No part of this work may be practiced, performed, copied, distributed, revised, modified, translated, abridged, condensed, expanded, collected, or adapted without the prior written consent of SUSE. Any use or exploitation of this work without authorization could subject the perpetrator to criminal and civil liability.
General DisclaimerThis document is not to be construed as a promise by any participating company to develop, deliver, or market a product. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. SUSE makes no representations or warranties with respect to the contents of this document, and specifically disclaims any express or implied warranties of merchantability or fitness for any particular purpose. The development, release, and timing of features or functionality described for SUSE products remains at the sole discretion of SUSE. Further, SUSE reserves the right to revise this document and to make changes to its content, at any time, without obligation to notify any person or entity of such revisions or changes. All SUSE marks referenced in this presentation are trademarks or registered trademarks of Novell, Inc. in the United States and other countries. All third-party trademarks are the property of their respective owners.