Hi everyone,
We have about 5 CRM organisations imported from CRM 2011 to CRM 2013. 4 of them where without problems after the upgrade and are working perfect. 1 of the organisations has all the problems. When accessing the organisation we get intermittent 404 errors and they persist until we do an IISReset /noforce. It works for a period of time and then we got the error back. When we do a IISReset /noforce and startup the organisation and the organisation is loaded and we do a IISReset without /noforce the 404 error returns. We have imported the organisation within 3 different environments and all environments have the same problems. When I setup the Platform Trace I got the following messages:
>Query execution time: 0.0 seconds; database: MPL_MSCRM; Server:server.domain.local; command: SET TRANSACTION ISOLATION LEVEL READ COMMITTED.
[2015-08-17 22:29:10.502] Process: w3wp |Organization:00000000-0000-0000-0000-000000000000 |Thread: 34 |Category: Platform |User: 00000000-0000-0000-0000-000000000000 |Level: Info |ReqId: 64e9228f-65cf-42d1-b1bf-40e86e907661 | CounterList.TraceInstanceXml
ilOffset = 0x81
at CounterList.TraceInstanceXml() ilOffset = 0x81
at CounterList.TraceOrderedInstanceXml() ilOffset = 0x2B
at DynamicMetadataCacheFactory.LoadMetadataCache(LoadMethod method, CacheType type, IOrganizationContext context) ilOffset = 0x12C
at MetadataCache.LoadCache(IOrganizationContext context, Boolean fileOnlyIfExists) ilOffset = 0xEB
at MetadataCache.GetInstance(IOrganizationContext context) ilOffset = 0x71
at BusinessEntityMoniker..ctor(Guid id, String entityName, IOrganizationContext orgContext) ilOffset = 0x19
at UserDataCacheLoader.LoadCacheData(Guid key, ExecutionContext context) ilOffset = 0x6B
at ObjectModelCacheLoader`2.LoadCacheData(TKey key, IOrganizationContext context) ilOffset = 0x31
at CrmMultiOrgCacheBase`2.CreateEntry(TKey key, IOrganizationContext context) ilOffset = 0x8
at CrmMultiOrgCacheBase`2.LookupEntry(TKey key, IOrganizationContext context) ilOffset = 0x26
at SecurityLibrary.GetUserInfoCommon(IOrganizationContext context, Guid userGuid, LocatorServiceContext locatorServiceContext) ilOffset = 0xC
at SecurityLibrary.GetCallerAndBusinessGuidsFromThread(WindowsIdentity identity, Guid organizationId, LocatorServiceContext locatorServiceContext) ilOffset = 0x44
at CrmWindowsIdentity..ctor(WindowsIdentity innerIdentity, Boolean publishCrmUser, Guid organizationId) ilOffset = 0x41
at WindowsAuthenticationProviderBase.Authenticate(HttpApplication application, WindowsIdentity userIdentity) ilOffset = 0x9F
at AuthenticationStep.Authenticate(HttpApplication application) ilOffset = 0x4E
at AuthenticationPipeline.Authenticate(HttpApplication application) ilOffset = 0x11
at AuthenticationEngine.Execute(Object sender, EventArgs e) ilOffset = 0x147
at SyncEventExecutionStep.System.Web.HttpApplication.IExecutionStep.Execute() ilOffset = 0x5D
at HttpApplication.ExecuteStep(IExecutionStep step, Boolean& completedSynchronously) ilOffset = 0x15
at ApplicationStepManager.ResumeSteps(Exception error) ilOffset = 0x10A
at HttpApplication.System.Web.IHttpAsyncHandler.BeginProcessRequest(HttpContext context, AsyncCallback cb, Object extraData) ilOffset = 0x5C
at HttpRuntime.ProcessRequestInternal(HttpWorkerRequest wr) ilOffset = 0x16A
at ISAPIRuntime.ProcessRequest(IntPtr ecb, Int32 iWRType) ilOffset = 0x4B
><CounterList Name="LoadMetadataCache - LoadMethod=Database CacheType=InstanceUsingSharedSystemData IsInClientContext=False" TotalTimeMSec="703.159"><CounterList Name="LoadCacheFromDatabaseInternal - LoadMasks=OData, All"
TotalTimeMSec="703.159" PercentFromTotal="100"><CounterList Name="LoadMetadataContainerFromDatabase" TotalTimeMSec="688.2404" PercentFromTotal="97.88" /><CounterList Name="BuildMetadataContainerFromDatabase
- isSystemDataLoaded=True isSystemLanguageDataLoaded=True" TotalTimeMSec="656.2833" PercentFromTotal="93.33"><CounterList Name="IdentifyCollectionsCount" TotalTimeMSec="62.5038" PercentFromTotal="9.52"><CounterList
Name="ManagedProperty" TotalTimeMSec="15.6236" PercentFromTotal="25" /><CounterList Name="OptionSet" TotalTimeMSec="0" PercentFromTotal="0" /><CounterList Name="Entity" TotalTimeMSec="0"
PercentFromTotal="0" /><CounterList Name="Attribute" TotalTimeMSec="15.6209" PercentFromTotal="24.99" /><CounterList Name="AttributeLookupValue" TotalTimeMSec="0" PercentFromTotal="0"
/><CounterList Name="AttributePicklistValue" TotalTimeMSec="0" PercentFromTotal="0" /><CounterList Name="EntityRelationship" TotalTimeMSec="0" PercentFromTotal="0" /><CounterList
Name="Relationship" TotalTimeMSec="15.6327" PercentFromTotal="25.01" /><CounterList Name="RelationshipExtraCondition" TotalTimeMSec="0" PercentFromTotal="0" /><CounterList Name="EntityRelationshipRole"
TotalTimeMSec="0" PercentFromTotal="0" /><CounterList Name="EntityRelationshipRelationships" TotalTimeMSec="15.6266" PercentFromTotal="25" /><CounterList Name="ViewAttribute" TotalTimeMSec="0"
PercentFromTotal="0" /><CounterList Name="Privilege" TotalTimeMSec="0" PercentFromTotal="0" /></CounterList><CounterList Name="LoadContainerData" TotalTimeMSec="328.161" PercentFromTotal="50"><CounterList
Name="LoadDescriptions - MetadataEntityName=ManagedProperty" TotalTimeMSec="15.6384" PercentFromTotal="4.77" /><CounterList Name="LoadDescriptions - MetadataEntityName=OptionSet" TotalTimeMSec="0" PercentFromTotal="0"
/><CounterList Name="LoadDescriptions - MetadataEntityName=Entity" TotalTimeMSec="15.6452" PercentFromTotal="4.77" /><CounterList Name="LoadDescriptions - MetadataEntityName=Attribute" TotalTimeMSec="109.3644"
PercentFromTotal="33.33" /><CounterList Name="LoadDescriptions - MetadataEntityName=AttributeLookupValue" TotalTimeMSec="0" PercentFromTotal="0" /><CounterList Name="LoadDescriptions - MetadataEntityName=AttributePicklistValue"
TotalTimeMSec="31.2817" PercentFromTotal="9.53" /><CounterList Name="LoadDescriptions - MetadataEntityName=EntityRelationship" TotalTimeMSec="15.5743" PercentFromTotal="4.75" /><CounterList Name="LoadDescriptions
- MetadataEntityName=Relationship" TotalTimeMSec="31.2729" PercentFromTotal="9.53" /><CounterList Name="LoadDescriptions - MetadataEntityName=RelationshipExtraCondition" TotalTimeMSec="15.6638" PercentFromTotal="4.77"
/><CounterList Name="LoadDescriptions - MetadataEntityName=EntityRelationshipRole" TotalTimeMSec="31.1899" PercentFromTotal="9.5" /><CounterList Name="LoadDescriptions - MetadataEntityName=EntityRelationshipRelationships"
TotalTimeMSec="46.9057" PercentFromTotal="14.29" /><CounterList Name="LoadDescriptions - MetadataEntityName=ViewAttribute" TotalTimeMSec="15.6247" PercentFromTotal="4.76" /><CounterList Name="LoadPrivileges"
TotalTimeMSec="0" PercentFromTotal="0" /></CounterList><CounterList Name="LoadOrgSettings" TotalTimeMSec="15.5895" PercentFromTotal="2.38" /><CounterList Name="GenerateTimestamp"
TotalTimeMSec="250.029" PercentFromTotal="38.1"><CounterList Name="GetMaxMetadataSyncTimestampFromNonMetadataTables" TotalTimeMSec="15.6524" PercentFromTotal="6.26" /></CounterList></CounterList><CounterList
Name="BuildMetadataCacheFromMetadataContainer" TotalTimeMSec="14.9186" PercentFromTotal="2.12"><CounterList Name="PreloadedMetadataCacheDataProviderShare - create and initialize" TotalTimeMSec="14.9186"
PercentFromTotal="100" /></CounterList></CounterList></CounterList>
[2015-08-17 22:29:10.502] Process: w3wp |Organization:375771b6-64a7-e211-a6a7-005056b62e85 |Thread: 34 |Category: Platform |User: 00000000-0000-0000-0000-000000000000 |Level: Verbose |ReqId: 64e9228f-65cf-42d1-b1bf-40e86e907661 | ExecutionContext.OnErrorRequest
ilOffset = 0x58
at ExecutionContext.OnErrorRequest() ilOffset = 0x58
at ObjectModelCacheLoader`2.LoadCacheData(TKey key, IOrganizationContext context) ilOffset = 0x31
at CrmMultiOrgCacheBase`2.CreateEntry(TKey key, IOrganizationContext context) ilOffset = 0x8
at CrmMultiOrgCacheBase`2.LookupEntry(TKey key, IOrganizationContext context) ilOffset = 0x26
at SecurityLibrary.GetUserInfoCommon(IOrganizationContext context, Guid userGuid, LocatorServiceContext locatorServiceContext) ilOffset = 0xC
at SecurityLibrary.GetCallerAndBusinessGuidsFromThread(WindowsIdentity identity, Guid organizationId, LocatorServiceContext locatorServiceContext) ilOffset = 0x44
at CrmWindowsIdentity..ctor(WindowsIdentity innerIdentity, Boolean publishCrmUser, Guid organizationId) ilOffset = 0x41
at WindowsAuthenticationProviderBase.Authenticate(HttpApplication application, WindowsIdentity userIdentity) ilOffset = 0x9F
at AuthenticationStep.Authenticate(HttpApplication application) ilOffset = 0x4E
at AuthenticationPipeline.Authenticate(HttpApplication application) ilOffset = 0x11
at AuthenticationEngine.Execute(Object sender, EventArgs e) ilOffset = 0x147
at SyncEventExecutionStep.System.Web.HttpApplication.IExecutionStep.Execute() ilOffset = 0x5D
at HttpApplication.ExecuteStep(IExecutionStep step, Boolean& completedSynchronously) ilOffset = 0x15
at ApplicationStepManager.ResumeSteps(Exception error) ilOffset = 0x10A
at HttpApplication.System.Web.IHttpAsyncHandler.BeginProcessRequest(HttpContext context, AsyncCallback cb, Object extraData) ilOffset = 0x5C
at HttpRuntime.ProcessRequestInternal(HttpWorkerRequest wr) ilOffset = 0x16A
at ISAPIRuntime.ProcessRequest(IntPtr ecb, Int32 iWRType) ilOffset = 0x4B
>ExecutionContext not in use (OnErrorRequest) for organization {375771B6-64A7-E211-A6A7-005056B62E85}
[2015-08-17 22:29:10.502] Process: w3wp |Organization:00000000-0000-0000-0000-000000000000 |Thread: 34 |Category: Platform |User: 00000000-0000-0000-0000-000000000000 |Level: Warning |ReqId: 64e9228f-65cf-42d1-b1bf-40e86e907661 | AuthenticationEngine.Execute
ilOffset = 0x147
at AuthenticationEngine.Execute(Object sender, EventArgs e) ilOffset = 0x147
at SyncEventExecutionStep.System.Web.HttpApplication.IExecutionStep.Execute() ilOffset = 0x5D
at HttpApplication.ExecuteStep(IExecutionStep step, Boolean& completedSynchronously) ilOffset = 0x15
at ApplicationStepManager.ResumeSteps(Exception error) ilOffset = 0x10A
at HttpApplication.System.Web.IHttpAsyncHandler.BeginProcessRequest(HttpContext context, AsyncCallback cb, Object extraData) ilOffset = 0x5C
at HttpRuntime.ProcessRequestInternal(HttpWorkerRequest wr) ilOffset = 0x16A
at ISAPIRuntime.ProcessRequest(IntPtr ecb, Int32 iWRType) ilOffset = 0x4B
>A failure occurred during the execution of the AuthenticationPipeline: System.Collections.Generic.KeyNotFoundException: The given key was not present in the dictionary.
at Microsoft.Crm.Metadata.PreloadedMetadataInitializationContext.GetOptionSetProvider(Guid optionSetId)
at Microsoft.Crm.Metadata.PreloadedMetadataCacheDataProvider.AddAttributesToCollections(IPreloadedMetadataInitializationContext context)
at Microsoft.Crm.Metadata.PreloadedMetadataCacheDataProvider.Initialize(IOrganizationContext organizationContext, MetadataContainer container, LoadMasks masks)
at Microsoft.Crm.Metadata.MultiOrgSharableMetadataCacheLoader.CreateMetadataCacheDataProvider(MetadataContainer container, LoadMasks masks, CounterList counter)
at Microsoft.Crm.Metadata.DynamicMetadataCacheLoader.BuildMetadataCacheFromMetadataContainer(MetadataContainer container, LoadMasks masks, CounterList counter)
at Microsoft.Crm.Metadata.DynamicMetadataCacheLoader.LoadCacheFromDatabaseInternal(LoadMasks masks, CrmDbConnection connection, CrmTransaction transaction, CounterList counter)
at Microsoft.Crm.Metadata.DynamicMetadataCacheLoader.LoadCacheFromDatabase(LoadMasks masks, CounterList counter)
at Microsoft.Crm.Metadata.DynamicMetadataCacheFactory.LoadMetadataCache(LoadMethod method, CacheType type, IOrganizationContext context)
at Microsoft.Crm.Metadata.MetadataCache.LoadCache(IOrganizationContext context, Boolean fileOnlyIfExists)
at Microsoft.Crm.Metadata.MetadataCache.GetInstance(IOrganizationContext context)
at Microsoft.Crm.BusinessEntities.BusinessEntityMoniker..ctor(Guid id, String entityName, IOrganizationContext orgContext)
at Microsoft.Crm.Caching.UserDataCacheLoader.LoadCacheData(Guid key, ExecutionContext context)
at Microsoft.Crm.Caching.ObjectModelCacheLoader`2.LoadCacheData(TKey key, IOrganizationContext context)
at Microsoft.Crm.Caching.CrmMultiOrgCacheBase`2.CreateEntry(TKey key, IOrganizationContext context)
at Microsoft.Crm.Caching.CrmMultiOrgCacheBase`2.LookupEntry(TKey key, IOrganizationContext context)
at Microsoft.Crm.BusinessEntities.SecurityLibrary.GetUserInfoCommon(IOrganizationContext context, Guid userGuid, LocatorServiceContext locatorServiceContext)
at Microsoft.Crm.BusinessEntities.SecurityLibrary.GetCallerAndBusinessGuidsFromThread(WindowsIdentity identity, Guid organizationId, LocatorServiceContext locatorServiceContext)
at Microsoft.Crm.Authentication.CrmWindowsIdentity..ctor(WindowsIdentity innerIdentity, Boolean publishCrmUser, Guid organizationId)
at Microsoft.Crm.Authentication.WindowsAuthenticationProviderBase.Authenticate(HttpApplication application, WindowsIdentity userIdentity)
at Microsoft.Crm.Authentication.AuthenticationStep.Authenticate(HttpApplication application)
at Microsoft.Crm.Authentication.AuthenticationPipeline.Authenticate(HttpApplication application)
at Microsoft.Crm.Authentication.AuthenticationEngine.Execute(Object sender, EventArgs e)
[2015-08-17 22:29:10.502] Process: w3wp |Organization:00000000-0000-0000-0000-000000000000 |Thread: 34 |Category: Platform |User: 00000000-0000-0000-0000-000000000000 |Level: Info |ReqId: 64e9228f-65cf-42d1-b1bf-40e86e907661 | AuthenticationEngine.Execute
ilOffset = 0x2A1
at AuthenticationEngine.Execute(Object sender, EventArgs e) ilOffset = 0x2A1
at SyncEventExecutionStep.System.Web.HttpApplication.IExecutionStep.Execute() ilOffset = 0x5D
at HttpApplication.ExecuteStep(IExecutionStep step, Boolean& completedSynchronously) ilOffset = 0x15
at ApplicationStepManager.ResumeSteps(Exception error) ilOffset = 0x10A
at HttpApplication.System.Web.IHttpAsyncHandler.BeginProcessRequest(HttpContext context, AsyncCallback cb, Object extraData) ilOffset = 0x5C
at HttpRuntime.ProcessRequestInternal(HttpWorkerRequest wr) ilOffset = 0x16A
at ISAPIRuntime.ProcessRequest(IntPtr ecb, Int32 iWRType) ilOffset = 0x4B
>AUTH: Request was rejected by AuthenticationEngine.
For some reason we get errors with the AuthenticationEngine. Anyone has a clue where or how to fix this?
Thanks in advance