Outlook client for MSCRM 2015 : waiting for a page to be retrieved from a CRM server

We are installing microsoft outlook client with update 1.1 for our organization.We use adfs/ifd to connect to our on premise servers 

Base 2015 client

www.microsoft.com/en-us/download/details.aspx?id=45015

update 1.1

download/details.aspx?id=49035

This works well for few machines however for all other majority of users when we click on the Lead, Opportunity or any other records it just shows the message "waiting for a page to be retrieved from a CRM server".

We have verified the error logs on the user machines , what we see are some of the below errors

Exception occurred during outlook WinFormsRegions-AttachInterfaces : System.InvalidCastException: Unable to cast COM object of type 'System.__ComObject' to interface type 'Microsoft.Office.Interop.OutlookViewCtl.IViewCtl'. This operation failed because the QueryInterface call on the COM component for the interface with IID '{000xxxxx-0000-0000-C000-0000000xxxxx}' failed due to the following error: No such interface supported (Exception from HRESULT: 0x80004002 (E_NOINTERFACE)).
   at WinFormsRegions.AxViewCtl.AttachInterfaces()
[2016-03-10 09:34:23.056] Process:OUTLOOK |Organization:b46cf534-f43f-e211-b4d7-0050569c2a1e |Thread:    1 |Category: Application.Outlook |User: 00000000-0000-0000-0000-000000000000 |Level: Error |ReqId: 00000000-0000-0000-0000-000000000000 | AxViewCtl.AttachInterfaces ilOffset = 0x33
at AxViewCtl.AttachInterfaces()  ilOffset = 0x33
at DeferredAxViewCtl.AttachInterfaces()  ilOffset = 0x6
at AxHost.GetOcxCreate()  ilOffset = 0x1A
at AxHost.TransitionUpTo(Int32 state)  ilOffset = 0x67
at AxHost.CreateHandle()  ilOffset = 0x12
at WrappedAxHost.CreateHandle()  ilOffset = 0x33
at Control.CreateControl(Boolean fIgnoreVisible)  ilOffset = 0x3A
at Control.CreateControl(Boolean fIgnoreVisible)  ilOffset = 0x9A
at Control.CreateControl(Boolean fIgnoreVisible)  ilOffset = 0x9A
at Control.CreateControl(Boolean fIgnoreVisible)  ilOffset = 0x9A
at Control.CreateControl()  ilOffset = 0x7
at Control.OnVisibleChanged(EventArgs e)  ilOffset = 0x0
at ScrollableControl.OnVisibleChanged(EventArgs e)  ilOffset = 0x1B
at Control.SetVisibleCore(Boolean value)  ilOffset = 0xEC
at Control.set_Visible(Boolean value)  ilOffset = 0x7
at GridAndVizControl.CreateViewControl()  ilOffset = 0x3A1
at GridAndVizControl..ctor(ShellFrame parentShellFrame, DataStore dataStore, String entityType)  ilOffset = 0x47
at <>c__DisplayClass6.<.ctor>b__0()  ilOffset = 0xE2
at ExceptionFilter.TryFilter(Action body, Predicate`1 filter, Action`1 catchClause)  ilOffset = 0x0
at ShellFrame..ctor(ExplorerWrapper explorerWrapper)  ilOffset = 0x68
at ShellManager.GetShellFromEntityType(Explorer explorer, String entityType, IClientOrganizationContext context)  ilOffset = 0x1F
at ActiveXShellFrame.Init()  ilOffset = 0x7E
at ActiveXUserControl.CreateHandle()  ilOffset = 0x6
at Control.get_Handle()  ilOffset = 0x3F
at ActiveXImpl.InPlaceActivate(Int32 verb)  ilOffset = 0x124
at ActiveXImpl.DoVerb(Int32 iVerb, IntPtr lpmsg, IOleClientSite pActiveSite, Int32 lindex, IntPtr hwndParent, COMRECT lprcPosRect)  ilOffset = 0x2A
at Control.System.Windows.Forms.UnsafeNativeMethods.IOleObject.DoVerb(Int32 iVerb, IntPtr lpmsg, IOleClientSite pActiveSite, Int32 lindex, IntPtr hwndParent, COMRECT lprcPosRect)  ilOffset = 0x3

ExecuteScriptFunction 'EnableFilters' args '' failed to execute the function because it does not exist in the page at location https://xxx.xxx.com/_root/stage.aspx?id=SFA&url=SiteMapNavPage.aspx%3farea%3dSFA%26group%3dSFA&ver=63593220800861
[2016-03-10 09:34:48.745] Process:OUTLOOK |Organization:bxxxxxxx-xxxx-xxxxx-xxxx-xxxxxxxxxxx |Thread:    1 |Category: Application.Outlook |User: 00000000-0000-0000-0000-000000000000 |Level: Error |ReqId: 00000000-0000-0000-0000-000000000000 | <>c__DisplayClass19.<ExecuteScriptFunction>b__16 ilOffset = 0x0
at <>c__DisplayClass19.<ExecuteScriptFunction>b__16()  ilOffset = 0x0
at ExceptionFilter.TryFilterAllCatch(Func`1 body, Action`1 filter, TResult resultIfFailed)  ilOffset = 0xF
at <>c__DisplayClass19.<ExecuteScriptFunction>b__15()  ilOffset = 0x60
at RuntimeMethodHandle.InvokeMethod(Object target, Object[] arguments, Signature sig, Boolean constructor)  ilOffset = 0xFFFFFFFF
at RuntimeMethodInfo.UnsafeInvokeInternal(Object obj, Object[] parameters, Object[] arguments)  ilOffset = 0x3A
at RuntimeMethodInfo.UnsafeInvoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)  ilOffset = 0x59
at Delegate.DynamicInvokeImpl(Object[] args)  ilOffset = 0x2A
at Control.InvokeMarshaledCallbackDo(ThreadMethodEntry tme)  ilOffset = 0xCF
at Control.InvokeMarshaledCallbackHelper(Object obj)  ilOffset = 0x35
at Control.InvokeMarshaledCallback(ThreadMethodEntry tme)  ilOffset = 0x4F
at Control.InvokeMarshaledCallbacks()  ilOffset = 0x63
at Control.MarshaledInvoke(Control caller, Delegate method, Object[] args, Boolean synchronous)  ilOffset = 0xF6
at Control.Invoke(Delegate method, Object[] args)  ilOffset = 0xD
at Control.Invoke(Delegate method)  ilOffset = 0x3
at OutlookInstanceCache.MainThreadInvoke(Delegate method)  ilOffset = 0x17
at CrmPageContext.ExecuteScriptFunction(String functionName, Object[] arguments)  ilOffset = 0x45
at FilterArea.InitializeFilters()  ilOffset = 0x5E
at FilterArea.<CheckContext>b__0()  ilOffset = 0xE
at ExceptionFilter.TryFilter(Action body, Predicate`1 filter, Action`1 catchClause)  ilOffset = 0x0
at FilterArea.CheckContext()  ilOffset = 0x70
at FilterArea.<_ribbonactionHandler_WebContextStateChanged>b__8()  ilOffset = 0x6
at <>c__DisplayClass3.<BeginInvokeSafe>b__1()  ilOffset = 0xB
at ExceptionFilter.TryFilterAllCatch(Action body, Action`1 filter)  ilOffset = 0xF
at <>c__DisplayClass3.<BeginInvokeSafe>b__0()  ilOffset = 0x1D
at RuntimeMethodHandle.InvokeMethod(Object target, Object[] arguments, Signature sig, Boolean constructor)  ilOffset = 0xFFFFFFFF
at RuntimeMethodInfo.UnsafeInvokeInternal(Object obj, Object[] parameters, Object[] arguments)  ilOffset = 0x3A
at RuntimeMethodInfo.UnsafeInvoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)  ilOffset = 0x59
at Delegate.DynamicInvokeImpl(Object[] args)  ilOffset = 0x2A
at Control.InvokeMarshaledCallbackDo(ThreadMethodEntry tme)  ilOffset = 0xCF
at Control.InvokeMarshaledCallbackHelper(Object obj)  ilOffset = 0x20
at ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)  ilOffset = 0x70
at ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)  ilOffset = 0x9
at ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state)  ilOffset = 0x34
at Control.InvokeMarshaledCallback(ThreadMethodEntry tme)  ilOffset = 0x4F
at Control.InvokeMarshaledCallbacks()  ilOffset = 0x63
at Control.MarshaledInvoke(Control caller, Delegate method, Object[] args, Boolean synchronous)  ilOffset = 0xF6
at Control.Invoke(Delegate method, Object[] args)  ilOffset = 0xD
at Control.Invoke(Delegate method)  ilOffset = 0x3
at OutlookInstanceCache.MainThreadInvoke(Delegate method)  ilOffset = 0x17
at CrmPageContext.ExecuteScriptFunction(String functionName, Object[] arguments)  ilOffset = 0x45
at FilterArea.InitializeFilters()  ilOffset = 0x5E
at FilterArea.<CheckContext>b__0()  ilOffset = 0xE

Any pointers to the issue are welcome