{"id":5547,"date":"2021-02-25T17:48:54","date_gmt":"2021-02-25T17:48:54","guid":{"rendered":"https:\/\/rakhesh.com\/?p=5547"},"modified":"2021-02-25T17:48:54","modified_gmt":"2021-02-25T17:48:54","slug":"azure-ad-troubleshooting-etc","status":"publish","type":"post","link":"https:\/\/rakhesh.com\/azure\/azure-ad-troubleshooting-etc\/","title":{"rendered":"Azure AD Troubleshooting etc."},"content":{"rendered":"

First off check this awesome blog post<\/a> before reading mine. To give credit where due that is an exhaustive list of things to try.<\/p>\n

Additionally there’s this blog post<\/a> from Microsoft. Lastly, there’s also my earlier post<\/a> on some notes about Azure AD.<\/p>\n

The blog post you are currently reading is more for me to note down things I encounter because I happen to fix issues and then forget what I did and the next time it happens I spend time reinventing the wheel. If not already obvious 1) I have a poor memory and 2) the sole purpose of this blog is for me to go back and read what I did in the past. \ud83d\ude43 I also have a short attention span and poor eyes so sometimes I don’t manage to read my own posts as I find them long and rambling… oh well, can’t keep everyone (including myself) happy. \ud83d\ude0e<\/p>\n

Benchmark Output<\/h3>\n

Here’s the output of dsregcmd \/status<\/code> just as a benchmark when things are working:<\/p>\n

+----------------------------------------------------------------------+\r\n| Device State                                                         |\r\n+----------------------------------------------------------------------+\r\n\r\n             AzureAdJoined : YES\r\n          EnterpriseJoined : NO\r\n              DomainJoined : YES\r\n                DomainName : CONTOSO\r\n\r\n+----------------------------------------------------------------------+\r\n| Device Details                                                       |\r\n+----------------------------------------------------------------------+\r\n\r\n                  DeviceId : 126cafbf-18e6-47a8-ad06-d5affe132b36\r\n                Thumbprint : 6422A23183864B4BF99F9282715F5C9D6C881776\r\n DeviceCertificateValidity : [ 2020-11-16 18:55:24.000 UTC -- 2030-11-16 19:25:24.000 UTC ]\r\n            KeyContainerId : 5fad6f12-9a31-448d-87f3-0eb6a24033fd\r\n               KeyProvider : Microsoft Platform Crypto Provider\r\n              TpmProtected : YES\r\n\r\n+----------------------------------------------------------------------+\r\n| Tenant Details                                                       |\r\n+----------------------------------------------------------------------+\r\n\r\n                TenantName : Contoso\r\n                  TenantId : ad8e1d4f-5295-4df7-b18a-1d85b4195a17\r\n                       Idp : login.windows.net\r\n               AuthCodeUrl : https:\/\/login.microsoftonline.com\/fade1d4f-5295-4df7-b18a-1d85b4195a17\/oauth2\/authorize\r\n            AccessTokenUrl : https:\/\/login.microsoftonline.com\/fade1d4f-5295-4df7-b18a-1d85b4195a17\/oauth2\/token\r\n                    MdmUrl :\r\n                 MdmTouUrl :\r\n          MdmComplianceUrl :\r\n               SettingsUrl :\r\n            JoinSrvVersion : 1.0\r\n                JoinSrvUrl : https:\/\/enterpriseregistration.windows.net\/EnrollmentServer\/device\/\r\n                 JoinSrvId : urn:ms-drs:enterpriseregistration.windows.net\r\n             KeySrvVersion : 1.0\r\n                 KeySrvUrl : https:\/\/enterpriseregistration.windows.net\/EnrollmentServer\/key\/\r\n                  KeySrvId : urn:ms-drs:enterpriseregistration.windows.net\r\n        WebAuthNSrvVersion : 1.0\r\n            WebAuthNSrvUrl : https:\/\/enterpriseregistration.windows.net\/webauthn\/fade1d4f-5295-4df7-b18a-1d85b4195a17\/\r\n             WebAuthNSrvId : urn:ms-drs:enterpriseregistration.windows.net\r\n    DeviceManagementSrvVer : 1.0\r\n    DeviceManagementSrvUrl : https:\/\/enterpriseregistration.windows.net\/manage\/fade1d4f-5295-4df7-b18a-1d85b4195a17\/\r\n     DeviceManagementSrvId : urn:ms-drs:enterpriseregistration.windows.net\r\n\r\n+----------------------------------------------------------------------+\r\n| User State                                                           |\r\n+----------------------------------------------------------------------+\r\n\r\n                    NgcSet : NO\r\n           WorkplaceJoined : YES\r\n          WorkAccountCount : 1\r\n             WamDefaultSet : YES\r\n       WamDefaultAuthority : organizations\r\n              WamDefaultId : https:\/\/login.microsoft.com\r\n            WamDefaultGUID : {B16898C6-A148-4967-9171-64D755DA8520} (AzureAd)\r\n\r\n+----------------------------------------------------------------------+\r\n| SSO State                                                            |\r\n+----------------------------------------------------------------------+\r\n\r\n                AzureAdPrt : YES\r\n      AzureAdPrtUpdateTime : 2021-02-25 09:14:32.000 UTC\r\n      AzureAdPrtExpiryTime : 2021-03-11 13:07:08.000 UTC\r\n       AzureAdPrtAuthority : https:\/\/login.microsoftonline.com\/fade1d4f-5295-4df7-b18a-1d85b4195a17\r\n             EnterprisePrt : NO\r\n    EnterprisePrtAuthority :\r\n\r\n+----------------------------------------------------------------------+\r\n| Work Account 1                                                       |\r\n+----------------------------------------------------------------------+\r\n\r\n         WorkplaceDeviceId : fd11fa9e-3324-4266-8bd2-d16bb19c975a\r\n       WorkplaceThumbprint : 83FB67C7CA7A2B12F6DF62E380E85F24BDF68B5D\r\n DeviceCertificateValidity : [ 2020-09-10 13:46:37.000 UTC -- 2030-09-10 14:16:37.000 UTC ]\r\n            KeyContainerId : fe24021a-cfa6-401c-b9b5-f7a48ad4cbb6\r\n               KeyProvider : Microsoft Platform Crypto Provider\r\n              TpmProtected : YES\r\n              WorkplaceIdp : login.windows.net\r\n         WorkplaceTenantId : fade1d4f-5295-4df7-b18a-1d85b4195a17\r\n       WorkplaceTenantName : Contoso\r\n           WorkplaceMdmUrl :\r\n      WorkplaceSettingsUrl :\r\n                    NgcSet : NO\r\n\r\n+----------------------------------------------------------------------+\r\n| Diagnostic Data                                                      |\r\n+----------------------------------------------------------------------+\r\n\r\n        AadRecoveryEnabled : NO\r\n               KeySignTest : PASSED\r\n\r\n+----------------------------------------------------------------------+\r\n| Ngc Prerequisite Check                                               |\r\n+----------------------------------------------------------------------+\r\n\r\n            IsDeviceJoined : YES\r\n             IsUserAzureAD : YES\r\n             PolicyEnabled : NO\r\n          PostLogonEnabled : YES\r\n            DeviceEligible : NO\r\n        SessionIsNotRemote : NO\r\n            CertEnrollment : none\r\n              PreReqResult : WillNotProvision<\/pre>\n
I always ignore the Ngc Pre-req check section as that’s for Windows Hello for Business and I haven’t used that yet.<\/p>\n
The first section of Device State is what I usually look at. That tells me if a device is Azure AD joined or not (and if it’s both Azure AD joined and Domain joined then it’s implicitly Azure AD Hybrid joined).<\/p>\n
The Tenant details has my Azure AD tenant ID and name. The Device details has the Device ID (which should match with Azure AD – more on this below). The SSO State section tells if I have a Primary Refresh Token (PRT) – required for Seamless SSO (i.e. when using (Hybrid) Azure AD). So far so good.<\/p>\n
Broken Output<\/h3>\n
Here’s an example output when this is broken:<\/p>\n
+----------------------------------------------------------------------+\r\n| Device State                                                         |\r\n+----------------------------------------------------------------------+\r\n\r\n        AzureAdJoined : NO\r\n     EnterpriseJoined : NO\r\n         DomainJoined : YES\r\n           DomainName : CONTOSO\r\n\r\n+----------------------------------------------------------------------+\r\n| User State                                                           |\r\n+----------------------------------------------------------------------+\r\n\r\n               NgcSet : NO\r\n      WorkplaceJoined : NO\r\n        WamDefaultSet : NO\r\n           AzureAdPrt : NO\r\n\r\n+----------------------------------------------------------------------+\r\n| Ngc Prerequisite Check                                               |\r\n+----------------------------------------------------------------------+\r\n\r\n        IsUserAzureAD : NO\r\n        PolicyEnabled : YES\r\n       DeviceEligible : YES\r\n   SessionIsNotRemote : NO\r\n     X509CertRequired : NO\r\n         PreReqResult : WillNotProvision<\/pre>\n
Again, ignore Ngc. (So difficult to ignore it though – when there’s an error and I see the WillNotProvision<\/code> as that’s at the end of the output my first instinct is “aha! that’s broken”).<\/p>\n
Older version (and somewhat broken) Output<\/h3>\n
The “benchmark” output format I pasted above can change depending on your Windows version. The above output is from Windows 10 2004 but things were slightly different with older version. For instance, the output a colleague sent me for one of his machines (Windows 10 1607 I think) looked like this:<\/p>\n
+----------------------------------------------------------------------+\r\n| Device State                                                         |\r\n+----------------------------------------------------------------------+\r\n\r\n          AzureAdJoined : NO\r\n       EnterpriseJoined : NO\r\n               DeviceId : 0ec68cdb-9e17-426a-b055-ab6655b9927c\r\n             Thumbprint : 951B90D7D23FA46960091C67E28181B4CB4ECEEB\r\n         KeyContainerId : fe316364-a4fc-4b31-bf7f-1614efec79b3\r\n            KeyProvider : Microsoft Platform Crypto Provider\r\n           TpmProtected : YES\r\n           KeySignTest: : MUST Run elevated to test.\r\n                    Idp : login.windows.net\r\n               TenantId : fade1d4f-5295-4df7-b18a-1d85b4195a17\r\n             TenantName : Contoso\r\n            AuthCodeUrl : https:\/\/login.microsoftonline.com\/fade1d4f-5295-4df7-b18a-1d85b4195a17\/oauth2\/authorize\r\n         AccessTokenUrl : https:\/\/login.microsoftonline.com\/fade1d4f-5295-4df7-b18a-1d85b4195a17\/oauth2\/token\r\n                 MdmUrl :\r\n              MdmTouUrl :\r\n       MdmComplianceUrl :\r\n            SettingsUrl :\r\n         JoinSrvVersion : 1.0\r\n             JoinSrvUrl : https:\/\/enterpriseregistration.windows.net\/EnrollmentServer\/device\/\r\n              JoinSrvId : urn:ms-drs:enterpriseregistration.windows.net\r\n          KeySrvVersion : 1.0\r\n              KeySrvUrl : https:\/\/enterpriseregistration.windows.net\/EnrollmentServer\/key\/\r\n               KeySrvId : urn:ms-drs:enterpriseregistration.windows.net\r\n     WebAuthNSrvVersion : 1.0\r\n         WebAuthNSrvUrl : https:\/\/enterpriseregistration.windows.net\/webauthn\/fade1d4f-5295-4df7-b18a-1d85b4195a17\/\r\n          WebAuthNSrvId : urn:ms-drs:enterpriseregistration.windows.net\r\nDeviceManagementSrvUrl : https:\/\/enterpriseregistration.windows.net\/manage\/fade1d4f-5295-4df7-b18a-1d85b4195a17\/\r\n  DeviceManagementSrvId : urn:ms-drs:enterpriseregistration.windows.net\r\n           DomainJoined : YES\r\n             DomainName : CONTOSO\r\n\r\n+----------------------------------------------------------------------+\r\n| User State                                                           |\r\n+----------------------------------------------------------------------+\r\n\r\n                 NgcSet : NO\r\n        WorkplaceJoined : YES\r\n      WorkplaceDeviceId : 0ec68cda-7e17-426a-b055-ab6655b9927c\r\n    WorkplaceThumbprint : 952B90C7D33FA46960091C67E28181B4CB4ECEEB\r\n           WorkplaceIdp : login.windows.net\r\n      WorkplaceTenantId : fade1d4f-5295-4df7-b18a-1d85b4195a17\r\n    WorkplaceTenantName : Contoso\r\n        WorkplaceMdmUrl :\r\n   WorkplaceSettingsUrl :\r\n          WamDefaultSet : NO\r\n             AzureAdPrt : NO\r\n    AzureAdPrtAuthority : NO\r\n          EnterprisePrt : NO\r\nEnterprisePrtAuthority : NO\r\n\r\n+----------------------------------------------------------------------+\r\n| Ngc Prerequisite Check                                               |\r\n+----------------------------------------------------------------------+\r\n\r\n          IsUserAzureAD : NO\r\n          PolicyEnabled : NO\r\n         DeviceEligible : YES\r\n     SessionIsNotRemote : NO\r\n         CertEnrollment : none\r\n      AadRecoveryNeeded : NO\r\n           PreReqResult : WillNotProvision\r\n\r\n<\/pre>\n
Notice the Device State, Device Details, and Tenant Details were all together. No mention of SSO here – that’s not a limitation of the older output, it’s a symptom of the error in this case.<\/p>\n
The above is an example of something I wanted to record here. In this case my colleague was getting the following error: \"\"<\/p>\n
If I looked in Azure AD I could see his machine but it had a Pending status. And in the output above while it looked good at first glance (had more URLs and Tenant info than the broken version) it too said the device wasn’t Azure AD joined… and the SSO section was missing as I noticed above.<\/p>\n
Looking more into this I realized that the Device ID in the dsregcmd \/status<\/code> output was different<\/span> to the Device ID of the same device in Azure AD. Not sure why. So I asked him to do a dsregcmd \/leave<\/code>, reboot the machine and login as usual… and that fixed the issue. I wasn’t sure this would work and whether I will have to remove the device entry from Azure AD, but dsregcmd \/leave<\/code> removed and re-added I think. Nice!<\/p>\n
Device ID<\/h3>\n
So what is the Device ID? This is the GUID of the machine in Azure AD. It is tied to the state of the machine too – so a machine that is Azure AD registered has one Device ID, when the same machine becomes Azure AD hybrid joined for instance the Device ID changes (this is why you’ll see the same machine twice in Azure AD sometimes – the older one will be automatically removed).<\/p>\n
The Device ID is stored in the registry at HKEY_LOCAL_MACHINE\\SYSTEM\\CurrentControlSet\\Control\\CloudDomainJoin\\JoinInfo<\/code>.<\/p>\n
A thing to remember is that when cloning machines that are already (Hybrid) Azure AD joined, tools like sysprep<\/code> won’t delete the Device ID. This in itself may not be a problem because when the cloned machine rejoins Azure AD it can generate a new Device ID – but this is something to bear in mind. Try and not clone (Hybrid) Azure AD joined machines as sysprep<\/code> isn’t aware of this.<\/p>\n
Hybrid join failing<\/h3>\n
And this is a good segue into the issue I ran across today. A colleague had cloned a bunch of Hybrid Azure AD joined machines. Users on these machines were having trouble because conditional access was kicking in and stopping them from using Teams etc. as it required a Hybrid Azure AD joined machine. These machines however were not appearing in Azure AD at all, and dsregcmd \/status<\/code> had the broken output I showed at the beginning of this post (the second of my outputs at the top).<\/p>\n
To troubleshoot I took a look at Microsoft-Windows-User Device Registration\/Admin<\/code> in the Event Viewer and found the following Event ID 304 error:<\/p>\n
Automatic registration failed at join phase.  Exit code: Keyset does not exist. Server error: empty. Debug Output:\\r\\n joinMode: Join\r\ndrsInstance: azure\r\nregistrationType: sync\r\ntenantType: managed\r\ntenantId: fade1d4f-5295-4df7-b18a-1d85b4195a17\r\nconfigLocation: undefined\r\nerrorPhase: join\r\nadalCorrelationId: undefined\r\nadalLog: undefined\r\nadalLog: undefined\r\nadalResponseCode: 0x0\r\n.<\/pre>\n
So it was failing due to a Keyset does not exist<\/code> error. This seems to be related to the private keys used by Windows and while there’s a lot of Google hits I finally found the blog post I referenced<\/a> at the top of this post and there it said this error could be to do with TPM (see that post for fixes) or because of cloning. Since the latter was my issue, the fix was the delete C:\\ProgramData\\Microsoft\\Crypto\\Keys<\/code> and try registration again. I deleted the folder.<\/p>\n
Next I wanted to try a manual join. You can’t really do that as the dsregcmd \/join<\/code> command requires to be run under the SYSTEM account when an Azure AD synced account logs in (you could workaround using something like psexec -i -s cmd.exe<\/code> to launch a command prompt under the SYSTEM account and then do dsregcmd \/join<\/code>). An easier way to handle this though is to use the Scheduled Task created by Windows that automatically attempts a Hybrid Join (under the SYSTEM account) when an Azure AD synced user logs in. To do this open Task Scheduler and go to Microsoft\\Windows\\Workplace Join<\/code>, select the Automatic-Device-Join<\/code> task and run it. Additionally kick a delta sync for Azure AD too (Start-ADSyncSyncCycle -PolicyType delta<\/code>) and now if you login as an Azure AD joined user it will be Hybrid joined.<\/p>\n
When a machine registers with Azure AD it has certificates added to its certificate store and also to the userCertificate<\/code> attribute in AD. When you then do an Azure AD sync it looks to this attribute before syncing<\/a> those objects to Azure AD and only syncs the ones that have a userCertificate<\/code>. Hence what I did above of doing a join and then the delta sync.<\/p>\n","protected":false},"excerpt":{"rendered":"
First off check this awesome blog post before reading mine. To give credit where due that is an exhaustive list of things to try. Additionally there’s this blog post from Microsoft. Lastly, there’s also my earlier post on some notes about Azure AD. The blog post you are currently reading is more for me to … Continue reading Azure AD Troubleshooting etc.<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","enabled":false}}},"categories":[887],"tags":[982],"jetpack_publicize_connections":[],"jetpack_sharing_enabled":true,"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/rakhesh.com\/wp-json\/wp\/v2\/posts\/5547"}],"collection":[{"href":"https:\/\/rakhesh.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/rakhesh.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/rakhesh.com\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/rakhesh.com\/wp-json\/wp\/v2\/comments?post=5547"}],"version-history":[{"count":0,"href":"https:\/\/rakhesh.com\/wp-json\/wp\/v2\/posts\/5547\/revisions"}],"wp:attachment":[{"href":"https:\/\/rakhesh.com\/wp-json\/wp\/v2\/media?parent=5547"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/rakhesh.com\/wp-json\/wp\/v2\/categories?post=5547"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/rakhesh.com\/wp-json\/wp\/v2\/tags?post=5547"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}