 © Rakhesh Sasidharan
|
Posted: November 6th, 2016 | Tags: monitoring, powercli, snmp, solarwinds | Category: Virtualization | § A continuation to my earlier post which was to do with SNMPv2.
As before, connect to the vCenter via PowerCLI. And as before the set() method can be used to set SNMP – both v2 and/or v3. The definition of this method is as follows:
|
|
set(string authentication, string communities, boolean enable, string engineid, string hwsrc, boolean largestorage, string loglevel, string notraps, long port, string privacy, string remoteusers, boolean reset, string syscontact, string syslocation, string targets, string users, string v3targets) |
That’s confusing so best to copy paste the definition into notepad or something so you can be sure you are passing the correct arguments.
First things first. There doesn’t seem to be a way of turning off something. As in, say you already have SNMPv2 turned on, you can’t turn it off by setting the community strings to blank. Doing so generates an error. So if you want to turn previous things off it’s best to do a reset and start with a clean slate.
|
|
$esxcli.system.snmp.set($null, $null, $null, $null, $null, $null, $null, $null, $null, $null, $null, $true, $null, $null, $null, $null, $null) |
This sets things back to their defaults:
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 |
> $esxcli.system.snmp.get() authentication : communities : enable : false engineid : hwsrc : indications largestorage : true loglevel : info notraps : port : 161 privacy : remoteusers : syscontact : syslocation : targets : users : v3targets : |
Before going ahead with any SNMPv3 configuration we need to decide on what authentication and privacy protocols to use. In my case I want to use SHA1 and AES-128. So I need to set that first:
|
|
$esxcli.system.snmp.set("SHA1", $null, $null, $null, $null, $null, $null, $null, $null, "AES128", $null, $null, $null, $null, $null, $null, $null) |
Once I have done this I can generate the hashes. I will need this later to configure SNMPv3.
|
|
> $esxcli.system.snmp.hash("Password1!","Password1!",$true) authhash privhash -------- -------- 9e79c8406990d1dxxxxxxx975b364b7e90e9c2ab 9e79c8406990d1dxxxxxxx975b364b7e90e9c2ab |
In the example above both my passwords are Password1.
With this in hand I configure SNMPv3:
|
|
$esxcli.system.snmp.set("SHA1", $null, $true, $null, $null, $null, "info", $null, 161, "AES128", $null, $null, "IT@myfirm.com", "My Firm IT Department", $null, "snmpUser1/9e79c8406990d1dxxxxxxx975b364b7e90e9c2ab/9e79c8406990d1dxxxxxxx975b364b7e90e9c2ab/priv", "xxx.xxx.xxx.xxx/user/priv/trap,xxx.xxx.xxx.xxx/user/priv/trap") |
That’s it really. In the above example I will be using an SNMPv3 user called snmpUser1.
Now to do it across my estate I can make a loop. No need to create password hashes for each host. The hash stays the same as long as you are using the same password for each host.
|
|
$Hosts = Get-VMHost | ?{ $_.ConnectionState -eq "Connected" } foreach ($VMHost in $Hosts) { Write-Host "Working on $VMHost" $ESXClI = Get-ESXCli -VMHost $VMHost $ESXCLI.system.snmp.set($null, $null, $null, $null, $null, $null, $null, $null, $null, $null, $null, $true, $null, $null, $null, $null, $null) $ESXCLI.system.snmp.set("SHA1", $null, $true, $null, $null, $null, "info", $null, 161, "AES128", $null, $null, "IT@myfirm.com", "My Firm IT Department", $null, "snmpUser1/9e79c8406990d1dxxxxxxx975b364b7e90e9c2ab/9e79c8406990d1dxxxxxxx975b364b7e90e9c2ab/priv", "xxx.xxx.xxx.xxx/user/priv/trap,xxx.xxx.xxx.xxx/user/priv/trap") } |
That’s all!
Posted: May 22nd, 2016 | Tags: monitoring, powercli, snmp, solarwinds | Category: Virtualization | § I wanted to enable SNMP on our ESXi hosts for monitoring via Solarwinds. Here’s what I did. (I am doing this kind of generically, using variables etc, so I can script the thing for multiple hosts).
First I connected to the vCenter Server from PowerCLI.
|
|
$vcenter = "myvcenter" $vcuser = Get-Credential Connect-VIServer -Server $vcenter -Credential $vcuser |
Next I got its ESXCLI object. This will let me run ESXCLI commands against the host.
|
|
$vmhost = "myHost" $esxcli = Get-EsxCli -VMHost $vmhost |
To view the current status of SNMP you can do can invoke a get() method –
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 |
> $esxcli.system.snmp.get() authentication : communities : enable : false engineid : 00000063000000a100000000 hwsrc : indications largestorage : true loglevel : info notraps : port : 161 privacy : remoteusers : syscontact : syslocation : targets : users : v3targets : |
Nothing’s configured currently. To configure something we can use the set() method. From the definition of this method we can see it takes a whole bunch of parameters –
|
|
> $esxcli.system.snmp =================== EsxCliElement: snmp Methods: -------- AgentConfig get() SNMPv3Hash hash(string authhash, string privhash, boolean rawsecret) boolean set(string authentication, string communities, boolean enable, string engineid, string hwsrc, boolean largestorage, string loglevel, string notraps, long port, string privacy, string remoteusers, boolean reset, string syscontact, string syslocation, string targets, string users, string v3targets) AgentTest test(string authhash, string privhash, boolean rawsecret, string user) |
Here’s what I did to configure SNMP. I want a community string of “public”, enable SNMP, and specify two trap destinations.
|
|
> $esxcli.system.snmp.set($null, "public", $true, $null, $null, $null, $null, $null, $null, $null, $null, $null, $null, $null, "192.x.x.x/public,192.x.x.x/public", $null, $null) |
The result of that will either be a true or false. The get() method can be used again to confirm it is set correctly. And the test() method can be used to test it works –
|
|
> $esxcli.system.snmp.test() comments -------- {There are 2 targets configured, send warmStart requested, test completed normally.} |
Now Solarwinds will be able to poll the host via SNMP.
To do this en-masse on all your hosts the following should help –
|
|
# modify this with your vCenter server name $vcenter = "myvcenter" $vcuser = Get-Credential Connect-VIServer -Server $vcenter -Credential $vcuser Get-VMHost | %{ $vmhost = $_.Name $esxcli = Get-EsxCli -VMHost $vmhost $esxcli.system.snmp.set($null, "public", $true, $null, $null, $null, $null, $null, $null, $null, $null, $null, $null, $null, "192.y.y.y/public,192.x.x.x/public", $null, $null) } |
Shout out to this VMware blog post which helped a lot and has more info.
The above script failed on some of our ESX hosts with the following error –
|
|
The method 'set' is invoked with '17' parameters, but the expected parameter count is '16'. At line:5 char:3 + $esxcli.system.snmp.set($null, "public", $true, $null, $null, $null, $null, $n ... + ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ + CategoryInfo : OperationStopped: (:) [], InvalidArgument + FullyQualifiedErrorId : VMware.VimAutomation.ViCore.Types.V1.ErrorHandling.InvalidArgument |
Turns out these hosts only accept 16 parameters instead of 17 (the one called largestorage is missing). Not sure why. All our hosts are ESXi 5.5 but am thinking the problem ones are perhaps not using the HP customized version of ESXi.
Anyways, so I modified my script above to take care of this –
|
|
# modify this with your vCenter server name $vcenter = "myvcenter" $vcuser = Get-Credential Connect-VIServer -Server $vcenter -Credential $vcuser Get-VMHost | %{ $vmhost = $_.Name Write-Host "$vmhost" $esxcli = Get-EsxCli -VMHost $vmhost $esxcli.system.snmp.set($null, "public", $true, $null, $null, $null, $null, $null, $null, $null, $null, $null, $null, $null, "192.x.x.x/public,192.y.y.y/public", $null, $null) if ($? -ne $true) { $esxcli.system.snmp.set($null, "public", $true, $null, $null, $null, $null, $null, $null, $null, $null, $null, $null, "192.x.x.x/public,192.y.y.y/public", $null, $null) } } |
Also, just for my own info – the $null above means the parameter is not set. If that parameter already has a value on the server it is not over-written. To over-write or blank out the existing value replace $null with "".
Posted: April 29th, 2016 | Tags: custom properties, monitoring, solarwinds | Category: Infrastructure | § I wanted to create account limitations in Solarwinds based on Custom Properties but the web console by default doesn’t give an option to do that.
 Then I came across this helpful video.
The trick is to logon to your Solarwinds server and find the “Account Limitation Builder”. Then click “Add” and create a new limitation similar to this –
Now the limitation you create will come in the list –
Select that, and in the next screen you can choose the value you want to limit to –
Posted: April 28th, 2016 | Tags: monitoring, solarwinds | Category: Infrastructure | § Had to remove a drive from being monitored from multiple servers in Solarwinds. Rather than go to each node, edit its properties and untick the drive, I figured that if you do a search for the nodes and expand each of them it’s possible to tick the ones you don’t need and click “Delete”.
Nice!
Posted: April 28th, 2016 | Tags: monitoring, solarwinds | Category: Infrastructure, Windows | § This is similar to how I monitored performance counters with Solarwinds.
I want to monitor a bunch of AppSense services.
Similar to the performance counters where I created an application monitor template so I could define the threshold values, here I need to create an application monitor so that the service appears in the alert manager. This part is easy (and similar to what I did for the performance counters) so I’ll skip and just put a screenshot like below –
I created a separate application monitor template but you could very well add it to one of the standard templates (if it’s a service that’s to be monitored on all nodes for instance).
Now for the part where you create alerts.
Initially I thought this would be a case of creating triggers when the above application monitor goes down. Something like this – 
And create an alert message like this –
With this I was hoping to get a one or more alert messages only for the services that actually went down. Instead, what happened is that whenever any one service went down I’d get an alert for the service that went down and also a message for the services that were up. Am guessing since I was triggering on the application monitor, Solarwinds helpfully sent the status for each of its components – up or down.
The solution is to modify your trigger such that you target each component.
Now I get alerts the way I want.
Hope this helps!
Posted: April 25th, 2016 | Tags: alerts, monitoring, solarwinds | Category: Infrastructure | § I wanted to mute Solarwinds alerts during our patch weekends when all servers are rebooted because they have to be and our mailboxes get flooded with Solarwinds alerts. I decided to use custom properties for this purpose. Here’s what I did.
Login to the Solarwinds web console. Go to the “Settings” page, and then “Manage Custom Properties” under “Node *& Group Management”.
Click “Add Custom Property”, select the default of “Nodes” from the drop down, and create something along the following lines –
Select the nodes you’d like to apply this custom property to. I chose to apply it on all my Windows and VMware nodes. Set the value to be “No”.
Now login to Orion Alerts Manager and pick an alert you’d like to mute during patch weekends. Go to its “Alert Suppression” tab and add a condition on the custom property we created earlier.
And that’s it, really!
Update: Not sure why, but the above didn’t seem to work for me. So I added the Mute_Alerts check as part of the trigger condition itself.
Note: If you don’t get the custom property in Orion, close and restart it as an administrator (i.e. right click and do “Run as Administrator” even if you are already running it with an admin account). Not sure why, but until I did that the custom property didn’t get picked up. You only need to do it one time; after that you can launch Orion normally.
Next time your server estate is being rebooted/ undergoing maintenance, login to Solarwinds webconsole and change the “Mute_Alerts” custom property to “Y” for a node/ nodes that you want to mute alerts for. Below I show how I will mute the alerts for all my Windows nodes.
Go to “Manage Nodes”. Group by “Vendor” and select Windows. Then select all nodes. (The checkbox to select all nodes got blanked out in the screenshot below but it’s easy to find).
Then click on “Custom Property Editor” to get to the screen below.
Here too select all the nodes and click “Edit multiple values”.
From the drop down, change the value for “Mute_Alerts” to “true”. Then save changes and that’s it. :)
|