Cognos Service Not Running on WAS 7 after Upgrade to CBI_10.1.1_AIX64_FP001

[emarshah]

I have applied the fix pack CBI_10.1.1_AIX64_FP001 to my Cognos Server packaged with IBM Business Monitor v7.5.1 deployed on WebSphere Application Server v 7.0.0.19 . After applying the fix pack i am facing exceptions in starting cognos service. Kindly consider following logs from cogserver.log file after the server is started. Any questions/suggestions are most welcomed, Thanks.

When i choose to open Cognos Development Interface on Web it gives me following error;

AAA-SYS-0002
   
         The service cannot process the request because it has not been initialized.

Details

AAA-CFG-0008 The handler class 'com.ibm.cognos.camaaa.internal.auth.handler.SelectDefaultNamespace' cannot be loaded.java.lang.ClassNotFoundException: com.ibm.cognos.camaaa.internal.auth.handler.SelectDefaultNamespace


Cogserver.log

10.11.50.73:9080   9044218   2013-08-21 08:37:54.507   +3               server.startup : 2   LOGSV   6235   1   server.Audit.IPF   StartService   LogService      Success      <parameters><item name="Port"><![CDATA[9380]]></item><item name="Mode"><![CDATA[UDP]]></item><item name="Secure"><![CDATA[FALSE]]></item></parameters>
10.11.50.73:9080   9044218   2013-08-21 08:38:01.209   +3   Initialization_SESS   Initialization_REQ         Thread-62   CM   6235   1   Audit.cms.CM   StartService   ContentManagerService      Info      CM-SYS-2216 A Content Manager internal PRECACHEINITACTIONS task is complete.
10.11.50.73:9080   9044218   2013-08-21 08:38:01.710   +3   Initialization_SESS   Initialization_REQ         Thread-62   CM   6235   1   Audit.cms.CM   StartService   ContentManagerService      Info      CM-SYS-2215 A Content Manager internal POSTINITACTIONS task started.
10.11.50.73:9080   9044218   2013-08-21 08:38:01.207   +3   Initialization_SESS   Initialization_REQ         Thread-62   CM   6235   1   Audit.cms.CM   StartService   ContentManagerService      Info      CM-SYS-2215 A Content Manager internal PRECACHEINITACTIONS task started.
10.11.50.73:9080   9044218   2013-08-21 08:38:02.045   +3   Initialization_SESS   Initialization_REQ         Thread-62   CM   6235   1   Audit.cms.CM   StartService   ContentManagerService      Info      CM-SYS-2216 A Content Manager internal POSTINITACTIONS task is complete.
10.11.50.73:9080   9044218   2013-08-21 08:38:02.416   +3   Initialization_SESS   Initialization_REQ         Thread-62   CM   6235   1   Audit.cms.CM   StartService   ContentManagerService      Info      CM-SYS-2215 A Content Manager internal CMUPGRADESCRIPT task started.
10.11.50.73:9080   9044218   2013-08-21 08:38:02.851   +3                Thread-62   CM   6235   1   Audit.RTUsage.cms.CM   StartService   ContentManagerService      Info      CM-SYS-5159 Content Manager is running in active mode.
10.11.50.73:9080   9044218   2013-08-21 08:38:02.985   +3   Election_SESS   Election_REQ         Thread-62   CM   6235   1   Audit.RTUsage.cms.CM            Warning      CM-SYS-5157 Content Manager failed to notify the dispatcher "http://keid:9080/p2pd/servlet/dispatch" of a running status change. CM-REQ-4128 An input/output error occurred executing an external request to the connector "CM". A remote host refused an attempted connect operation. Cause: A remote host refused an attempted connect operation.  Runtime Exception stack trace: java.net.ConnectException: A remote host refused an attempted connect operation.    at java.net.PlainSocketImpl.socketConnect(Native Method)    at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:383)    at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:245)    at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:232)    at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:377)    at java.net.Socket.connect(Socket.java:539)    at java.net.Socket.connect(Socket.java:488)    at java.net.Socket.<init>(Socket.java:385)    at java.net.Socket.<init>(Socket.java:259)    at org.apache.commons.httpclient.protocol.DefaultProtocolSocketFactory.createSocket(DefaultProtocolSocketFactory.java:80)    at org.apache.commons.httpclient.protocol.DefaultProtocolSocketFactory.createSocket(DefaultProtocolSocketFactory.java:122)    at org.apache.commons.httpclient.HttpConnection.open(HttpConnection.java:707)    at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:387)    at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171)    at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397)    at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:323)    at com.cognos.cm.connectors.BusConnectionPool$BusConnection.execute(BusConnectionPool.java:85)    at com.cognos.cm.connectors.CMConnector.CMConnector$CMConnectorRunnable.run(CMConnector.java:469)    at java.lang.Thread.run(Thread.java:736)
10.11.50.73:9080   9044218   2013-08-21 08:38:02.851   +3                Thread-62   CM   6235   1   Audit.RTUsage.cms.CM   StartService   ContentManagerService      Success      CM-SYS-5090 Content Manager build 10.1.6235.601 started (10.1.6235.601;20110713191605, schema version 6.0022, implementation: CMDbStore - Java CMCache).
10.11.50.73:9080   9044218   2013-08-21 08:38:03.384   +3   pogoStartup   na   na   0   Thread-62   DISP   6235   1   Audit.Other.dispatcher.DISP.com.cognos.pogo.services.DispatcherServices   StartService   relationalMetadataService      Success      
10.11.50.73:9080   9044218   2013-08-21 08:38:03.496   +3   pogoStartup   na   na   0   Thread-62   DISP   6235   1   Audit.Other.dispatcher.DISP.com.cognos.pogo.contentmanager.coordinator.CMBootstrap   getActiveContentManager   ContentManager      Failure   <messages><message><messageString>DPR-CMI-4006 Unable to determine the active Content Manager. Will retry periodically.</messageString></message></messages>   
10.11.50.73:9080   9044218   2013-08-21 08:38:03.515   +3   pogoStartup   na   na   0   Thread-62   DISP   6235   1   Audit.Other.dispatcher.DISP.pogo   pogo   com.cognos.pogo.contentmanager.coordinator.ActiveCMControl      Failure   <messages><message><messageString>DPR-DPR-1035 Dispatcher detected an error.</messageString></message><message><messageString>Failed to send HTTP request or read HTTP response</messageString></message></messages>   DPR-CMI-4007 Unable to perform an active Content Manager election on the local IP node. For more information, see the dispatcher and Content Manager detailed logs. Ensure that the local Content Manager service is started.Failed to send HTTP request or read HTTP responsecom.cognos.pogo.bibus.CommandExecutionException: Failed to send HTTP request or read HTTP response   at com.cognos.pogo.bibus.BIBusCommand.handleDefaultException(BIBusCommand.java:294)   at com.cognos.pogo.bibus.BIBusCommand.execute(BIBusCommand.java:194)   at com.cognos.pogo.contentmanager.StandbyContentManagerElectionCommand.executeIfLocal(StandbyContentManagerElectionCommand.java:53)   at com.cognos.pogo.contentmanager.coordinator.ActiveCMControl.sendElectCommand(ActiveCMControl.java:230)   at com.cognos.pogo.contentmanager.coordinator.ActiveCMControl.startTimer(ActiveCMControl.java:175)   at com.cognos.pogo.contentmanager.coordinator.ActiveCMControl.startupFindCM(ActiveCMControl.java:142)   at com.cognos.pogo.contentmanager.coordinator.RuntimeInfoPublishHandler.start(RuntimeInfoPublishHandler.java:113)   at com.cognos.pogo.services.DefaultHandlerService.start(DefaultHandlerService.java:94)   at com.cognos.pogo.services.DispatcherServices.startInititalServices(DispatcherServices.java:388)   at com.cognos.pogo.transport.PogoServlet$PogoStartup.run(PogoServlet.java:690)   at com.cognos.pogo.util.threads.SafeThread.safeRun(SafeThread.java:70)   at com.cognos.pogo.util.threads.SafeThread.run(SafeThread.java:61)Caused by: java.io.IOException: Failed to send HTTP request or read HTTP response   at com.cognos.pogo.http.ServerConnection.executeMethod(ServerConnection.java:760)   at com.cognos.pogo.http.ServerConnection.sendRequest(ServerConnection.java:208)   at com.cognos.pogo.bibus.BIBusCommand.sendRequest(BIBusCommand.java:213)   at com.cognos.pogo.bibus.BIBusCommand.executeCommand(BIBusCommand.java:202)   at com.cognos.pogo.bibus.BIBusCommand.execute(BIBusCommand.java:190)   ... 10 more
10.11.50.73:9080   9044218   2013-08-21 08:38:33.613   +3   election1377063483408   4q4ylw8yljMGdvl4Gs2ssyvwy9hlyGslhy9sqhyy         WebContainer : 2   CM   6235   1   Audit.Admin.cms.CM.Request   Request   ContentManagerService      Info      CM-REQ-2378 A request was received to start the negotiation process to determine which Content Manager instance should become active.
10.11.50.73:9080   9044218   2013-08-21 08:38:34.234   +3   BootstrapConfigurePublish   na      0   Thread-86   DISP   6235   1   Audit.Other.dispatcher.DISP.com.cognos.pogo.contentmanager.coordinator.CMBootstrap   StartService   dispatcherBootstrap      Info      DPR-DPR-1002 Successfully registered the dispatcher http://keid:9080/p2pd in Content Manager.
10.11.50.73:9080   9044218   2013-08-21 08:38:34.304   +3   BootstrapConfigurePublish   na      0   Thread-86   DISP   6235   1   Audit.Other.dispatcher.DISP.com.cognos.pogo.contentmanager.coordinator.CMBootstrap   StartService   dispatcherBootstrap      Info      DPR-DPR-1002 Successfully registered the dispatcher http://keid:9080/p2pd in Content Manager.
10.11.50.73:9080   9044218   2013-08-21 08:38:36.729   +3               Thread-86   AAA   6235   1   Audit.cms.CAM.AAA   StartService   camAsyncService      Failure   <messages xsi:type="SOAP-ENC:Array" SOAP-ENC:arrayType="bus:message[3]"><item xsi:type="bus:message"><messageString xsi:type="xsd:string" xml:space="preserve">AAA-SYS-0002 The service cannot process the request because it has not been initialized.</messageString></item><item xsi:type="bus:message"><nestingLevel xsi:type="xsd:integer">1</nestingLevel><messageString xsi:type="xsd:string" xml:space="preserve">AAA-CFG-0008 The handler class 'com.ibm.cognos.camaaa.internal.auth.handler.SelectDefaultNamespace' cannot be loaded.</messageString></item><item xsi:type="bus:message"><nestingLevel xsi:type="xsd:integer">2</nestingLevel><messageString xsi:type="xsd:string" xml:space="preserve">java.lang.ClassNotFoundException: com.ibm.cognos.camaaa.internal.auth.handler.SelectDefaultNamespace</messageString></item></messages>   
10.11.50.73:9080   9044218   2013-08-21 08:38:48.142   +3   BootstrapConfigurePublish   na      0   Thread-86   DISP   6235   1   Audit.Other.dispatcher.DISP.com.cognos.pogo.services.DispatcherServices   StartService   Fragment Server Service      Success      
10.11.50.73:9080   9044218   2013-08-21 08:38:48.146   +3   BootstrapConfigurePublish   na      0   Thread-86   DISP   6235   1   Audit.Other.dispatcher.DISP.com.cognos.pogo.services.DispatcherServices   StartService   BatchReportService      Success      
10.11.50.73:9080   9044218   2013-08-21 08:38:48.151   +3   BootstrapConfigurePublish   na      0   Thread-86   DISP   6235   1   Audit.Other.dispatcher.DISP.com.cognos.pogo.async.service.connection.bibustkserver.BIBusTKServerManager   Start   com.cognos.pogo.reportservice      Info      Start a External Process because the start count 1 is larger than 0.
10.11.50.73:9080   9044218   2013-08-21 08:39:03.667   +3   BootstrapConfigurePublish   na      0   Thread-86   DISP   6235   1   Audit.Other.dispatcher.DISP.com.cognos.pogo.services.DispatcherServices   StartService   QueryService      Success      
10.11.50.73:9080   9044218   2013-08-21 08:39:03.667   +3   BootstrapConfigurePublish   na      0   Thread-86   DISP   6235   1   Audit.Other.dispatcher.DISP.com.cognos.pogo.services.DispatcherServices   StartService   SystemService      Success      
10.11.50.73:9080   9044218   2013-08-21 08:39:04.157   +3   BootstrapConfigurePublish   na      0   Thread-86   DISP   6235   1   Audit.Other.dispatcher.DISP.com.cognos.pogo.services.DispatcherServices   StartService   buxService      Success      
10.11.50.73:9080   9044218   2013-08-21 08:39:05.899   +3   BootstrapConfigurePublish   na      0   Thread-86   DISP   6235   1   Audit.Other.dispatcher.DISP.com.cognos.pogo.services.DispatcherServices   StartService   GraphicsService      Success      
10.11.50.73:9080   9044218   2013-08-21 08:39:05.898   +3   BootstrapConfigurePublish   na      0   Thread-86   DISP   6235   1   Audit.Other.dispatcher.DISP.pogo   pogo   com.cognos.pogo.reportservice.ProcessManager      Failure   <messages><message><messageString>DPR-DPR-1035 Dispatcher detected an error.</messageString></message><message><messageString>Process cgsServer.sh failed to start properly.</messageString></message></messages>   External Report Server process cgsServer.sh cannot be startedProcess cgsServer.sh failed to start properly.java.io.IOException: Process cgsServer.sh failed to start properly.   at com.cognos.pogo.reportservice.ReportServerProcess.getProcessOutput(ReportServerProcess.java:154)   at com.cognos.pogo.reportservice.ReportServerProcess.start(ReportServerProcess.java:117)   at com.cognos.pogo.reportservice.ProcessFacade.createServerProcess(ProcessFacade.java:219)   at com.cognos.pogo.reportservice.ProcessFacade.<init>(ProcessFacade.java:120)   at com.cognos.pogo.reportservice.RSComponentFactory.newProcessFacade(RSComponentFactory.java:67)   at com.cognos.pogo.reportservice.ProcessManager.createProcessFacade(ProcessManager.java:514)   at com.cognos.pogo.reportservice.ProcessManager.startProcess(ProcessManager.java:490)   at com.cognos.pogo.reportservice.ProcessManager.startInitialProcesses(ProcessManager.java:364)   at com.cognos.pogo.reportservice.ProcessManager.start(ProcessManager.java:295)   at com.ibm.cgsBus.service.GraphicsServiceConnectionFactory.startProcessManager(Unknown Source)   at com.ibm.cgsBus.service.GraphicsServiceConnectionFactory.start(Unknown Source)   at com.ibm.cgsBus.service.GraphicsServiceHandler.start(Unknown Source)   at com.cognos.pogo.services.DefaultHandlerService.start(DefaultHandlerService.java:94)   at com.cognos.pogo.services.DispatcherServices.start(DispatcherServices.java:189)   at com.cognos.pogo.services.DispatcherServices.continueStartup(DispatcherServices.java:417)   at com.cognos.pogo.services.DispatcherServices.configure(DispatcherServices.java:137)   at com.cognos.pogo.contentmanager.coordinator.RefreshController.composeAndConfigureServices(RefreshController.java:120)   at com.cognos.pogo.contentmanager.coordinator.RefreshController.run(RefreshController.java:80)   at com.cognos.pogo.contentmanager.coordinator.BootstrapConfigurePublish.changeCM(BootstrapConfigurePublish.java:80)   at com.cognos.pogo.contentmanager.coordinator.RuntimeInfoPublishHandler.notifyCMChange(RuntimeInfoPublishHandler.java:134)   at com.cognos.pogo.contentmanager.coordinator.ActiveCMControl.notifyCMChanged(ActiveCMControl.java:77)   at com.cognos.pogo.contentmanager.coordinator.ActiveCMControl.notifyCM(ActiveCMControl.java:137)   at com.cognos.pogo.contentmanager.coordinator.ActiveCMControl$GetActiveCMTask.safeRun(ActiveCMControl.java:217)   at com.cognos.pogo.util.threads.SafeTimerTask.run(SafeTimerTask.java:32)   at java.util.Timer$TimerImpl.run(Timer.java:293)
10.11.50.73:9080   9044218   2013-08-21 08:39:06.003   +3   BootstrapConfigurePublish   na      0   Thread-86   DISP   6235   1   Audit.Other.dispatcher.DISP.com.cognos.pogo.services.DispatcherServices   StartService   ReportDataService      Success      
10.11.50.73:9080   9044218   2013-08-21 08:39:06.355   +3               Thread-86   xts   6235   1   Audit.ps.xts   Upgrade   PresentationService      Success   PRS-ACF-0413 Successfully wrote the upgraded cogadmin/system.xml file.   
10.11.50.73:9080   9044218   2013-08-21 08:39:07.560   +3               Thread-86   xts   6235   1   Audit.ps.xts   StartService   PresentationService      Success      
10.11.50.73:9080   9044218   2013-08-21 08:39:07.561   +3   BootstrapConfigurePublish   na      0   Thread-86   DISP   6235   1   Audit.Other.dispatcher.DISP.com.cognos.pogo.services.DispatcherServices   StartService   IBM Cognos Enhanced Search Service      Success      
10.11.50.73:9080   9044218   2013-08-21 08:39:07.561   +3   BootstrapConfigurePublish   na      0   Thread-86   DISP   6235   1   Audit.Other.dispatcher.DISP.com.cognos.pogo.services.DispatcherServices   StartService   camAsyncAA      Success      
10.11.50.73:9080   9044218   2013-08-21 08:39:07.561   +3   BootstrapConfigurePublish   na      0   Thread-86   DISP   6235   1   Audit.Other.dispatcher.DISP.com.cognos.pogo.services.DispatcherServices   StartService   CacheService      Success      
10.11.50.73:9080   9044218   2013-08-21 08:39:07.563   +3   BootstrapConfigurePublish   na      0   Thread-86   DISP   6235   1   Audit.Other.dispatcher.DISP.com.cognos.pogo.services.DispatcherServices   StartService   ContentManagerCacheService      Success      
10.11.50.73:9080   9044218   2013-08-21 08:39:08.007   +3   BootstrapConfigurePublish   na      0   Thread-86   DISP   6235   1   Audit.Other.dispatcher.DISP.com.cognos.pogo.services.DispatcherServices   StartService   ReportService      Success      
10.11.50.73:9080   9044218   2013-08-21 08:39:08.019   +3               Thread-86   MS   6235   1   Audit.ms.MS   StartService   MonitorService      Success      
10.11.50.73:9080   9044218   2013-08-21 08:39:08.019   +3   BootstrapConfigurePublish   na      0   Thread-86   DISP   6235   1   Audit.Other.dispatcher.DISP.com.cognos.pogo.services.DispatcherServices   StartService   DimensionManagementService      Success      
10.11.50.73:9080   9044218   2013-08-21 08:39:08.022   +3               Thread-86   JOBS   6235   1   Audit..JOBS   StartService   JobService      Success      
10.11.50.73:9080   9044218   2013-08-21 08:39:08.600   +3   BootstrapConfigurePublish   na      0   Thread-86   DISP   6235   1   Audit.Other.dispatcher.DISP.com.cognos.pogo.services.DispatcherServices   StartService   MetadataService      Success      
10.11.50.73:9080   9044218   2013-08-21 08:39:08.653   +3               Thread-86   EMS   6235   1   Audit.ems.EMS   StartService   EventService      Success      
10.11.50.73:9080   9044218   2013-08-21 08:39:11.032   +3   BootstrapConfigurePublish   na      0   Thread-86   DISP   6235   1   Audit.Other.dispatcher.DISP.com.cognos.pogo.services.DispatcherServices   StartService   CPS Producer Registration Service      Success      

[Grim]

After you applied FP1 did you regenerate your WAR file and redeploy?

[emarshah]

Thanks Grim, I hadn't generated the WAR file. But after generation of WAR, update and restart, I was left with following exceptions (whole log file from cogserver.log);

Also when i tried to open the Web Interface, i see this exception;
AAA-AUT-0013 The user is already authenticated in all available namespaces

Log from cogserver.log
10.11.50.73:9080   10092606   2013-08-22 09:04:02.682   +3               server.startup : 1   LOGSV   6235   1   server.Audit.IPF   StartService   LogService      Success      <parameters><item name="Port"><![CDATA[9380]]></item><item name="Mode"><![CDATA[UDP]]></item><item name="Secure"><![CDATA[FALSE]]></item></parameters>
10.11.50.73:9080   10092606   2013-08-22 09:04:09.068   +3   Initialization_SESS   Initialization_REQ         Thread-63   CM   6235   1   Audit.cms.CM   StartService   ContentManagerService      Info      CM-SYS-2216 A Content Manager internal PRECACHEINITACTIONS task is complete.
10.11.50.73:9080   10092606   2013-08-22 09:04:09.816   +3   Initialization_SESS   Initialization_REQ         Thread-63   CM   6235   1   Audit.cms.CM   StartService   ContentManagerService      Info      CM-SYS-2215 A Content Manager internal POSTINITACTIONS task started.
10.11.50.73:9080   10092606   2013-08-22 09:04:09.066   +3   Initialization_SESS   Initialization_REQ         Thread-63   CM   6235   1   Audit.cms.CM   StartService   ContentManagerService      Info      CM-SYS-2215 A Content Manager internal PRECACHEINITACTIONS task started.
10.11.50.73:9080   10092606   2013-08-22 09:04:10.207   +3   Initialization_SESS   Initialization_REQ         Thread-63   CM   6235   1   Audit.cms.CM   StartService   ContentManagerService      Info      CM-SYS-2216 A Content Manager internal POSTINITACTIONS task is complete.
10.11.50.73:9080   10092606   2013-08-22 09:04:10.792   +3   Initialization_SESS   Initialization_REQ         Thread-63   CM   6235   1   Audit.cms.CM   StartService   ContentManagerService      Info      CM-SYS-2215 A Content Manager internal CMUPGRADESCRIPT task started.
10.11.50.73:9080   10092606   2013-08-22 09:04:11.570   +3                Thread-63   CM   6235   1   Audit.RTUsage.cms.CM   StartService   ContentManagerService      Success      CM-SYS-5090 Content Manager build 10.1.6235.621 started (None;20120417134952, schema version 6.0022, implementation: CMDbStore - Java CMCache).
10.11.50.73:9080   10092606   2013-08-22 09:04:11.571   +3                Thread-63   CM   6235   1   Audit.RTUsage.cms.CM   StartService   ContentManagerService      Info      CM-SYS-5159 Content Manager is running in active mode.
10.11.50.73:9080   10092606   2013-08-22 09:04:12.035   +3   pogoStartup   na   na   0   Thread-63   DISP   6235   1   Audit.Other.dispatcher.DISP.com.cognos.pogo.services.DispatcherServices   StartService   relationalMetadataService      Success      
10.11.50.73:9080   10092606   2013-08-22 09:04:11.720   +3   Election_SESS   Election_REQ         Thread-63   CM   6235   1   Audit.RTUsage.cms.CM            Warning      CM-SYS-5157 Content Manager failed to notify the dispatcher "http://keid:9080/p2pd/servlet/dispatch" of a running status change. CM-REQ-4128 An input/output error occurred executing an external request to the connector "CM". A remote host refused an attempted connect operation. Cause: A remote host refused an attempted connect operation.  Runtime Exception stack trace: java.net.ConnectException: A remote host refused an attempted connect operation.    at java.net.PlainSocketImpl.socketConnect(Native Method)    at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:383)    at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:245)    at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:232)    at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:377)    at java.net.Socket.connect(Socket.java:539)    at java.net.Socket.connect(Socket.java:488)    at java.net.Socket.<init>(Socket.java:385)    at java.net.Socket.<init>(Socket.java:259)    at org.apache.commons.httpclient.protocol.DefaultProtocolSocketFactory.createSocket(DefaultProtocolSocketFactory.java:80)    at org.apache.commons.httpclient.protocol.DefaultProtocolSocketFactory.createSocket(DefaultProtocolSocketFactory.java:122)    at org.apache.commons.httpclient.HttpConnection.open(HttpConnection.java:707)    at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:387)    at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171)    at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397)    at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:323)    at com.cognos.cm.connectors.BusConnectionPool$BusConnection.execute(BusConnectionPool.java:85)    at com.cognos.cm.connectors.CMConnector.CMConnector$CMConnectorRunnable.run(CMConnector.java:469)    at java.lang.Thread.run(Thread.java:736)
10.11.50.73:9080   10092606   2013-08-22 09:04:12.165   +3   pogoStartup   na   na   0   Thread-63   DISP   6235   1   Audit.Other.dispatcher.DISP.com.cognos.pogo.contentmanager.coordinator.CMBootstrap   getActiveContentManager   ContentManager      Failure   <messages><message><messageString>DPR-CMI-4006 Unable to determine the active Content Manager. Will retry periodically.</messageString></message></messages>   
10.11.50.73:9080   10092606   2013-08-22 09:04:12.195   +3   pogoStartup   na   na   0   Thread-63   DISP   6235   1   Audit.Other.dispatcher.DISP.pogo   pogo   com.cognos.pogo.contentmanager.coordinator.ActiveCMControl      Failure   <messages><message><messageString>DPR-DPR-1035 Dispatcher detected an error.</messageString></message><message><messageString>Failed to send HTTP request or read HTTP response</messageString></message></messages>   DPR-CMI-4007 Unable to perform an active Content Manager election on the local IP node. For more information, see the dispatcher and Content Manager detailed logs. Ensure that the local Content Manager service is started.Failed to send HTTP request or read HTTP responsecom.cognos.pogo.bibus.CommandExecutionException: Failed to send HTTP request or read HTTP response   at com.cognos.pogo.bibus.BIBusCommand.handleDefaultException(BIBusCommand.java:310)   at com.cognos.pogo.bibus.BIBusCommand.execute(BIBusCommand.java:203)   at com.cognos.pogo.contentmanager.StandbyContentManagerElectionCommand.executeIfLocal(StandbyContentManagerElectionCommand.java:53)   at com.cognos.pogo.contentmanager.coordinator.ActiveCMControl.sendElectCommand(ActiveCMControl.java:230)   at com.cognos.pogo.contentmanager.coordinator.ActiveCMControl.startTimer(ActiveCMControl.java:175)   at com.cognos.pogo.contentmanager.coordinator.ActiveCMControl.startupFindCM(ActiveCMControl.java:142)   at com.cognos.pogo.contentmanager.coordinator.RuntimeInfoPublishHandler.start(RuntimeInfoPublishHandler.java:113)   at com.cognos.pogo.services.DefaultHandlerService.start(DefaultHandlerService.java:94)   at com.cognos.pogo.services.DispatcherServices.startInititalServices(DispatcherServices.java:389)   at com.cognos.pogo.transport.PogoServlet$PogoStartup.run(PogoServlet.java:694)   at com.cognos.pogo.util.threads.SafeThread.safeRun(SafeThread.java:70)   at com.cognos.pogo.util.threads.SafeThread.run(SafeThread.java:61)Caused by: java.io.IOException: Failed to send HTTP request or read HTTP response   at com.cognos.pogo.http.ServerConnection.executeMethod(ServerConnection.java:760)   at com.cognos.pogo.http.ServerConnection.sendRequest(ServerConnection.java:208)   at com.cognos.pogo.bibus.BIBusCommand.sendRequest(BIBusCommand.java:223)   at com.cognos.pogo.bibus.BIBusCommand.executeCommand(BIBusCommand.java:212)   at com.cognos.pogo.bibus.BIBusCommand.execute(BIBusCommand.java:194)   ... 10 more
10.11.50.73:9080   10092606   2013-08-22 09:04:42.298   +3   election1377151452064   yGqGMGq24llMjCC4j929hj8wsqlqh2wMj449jq2q         WebContainer : 2   CM   6235   1   Audit.Admin.cms.CM.Request   Request   ContentManagerService      Info      CM-REQ-2378 A request was received to start the negotiation process to determine which Content Manager instance should become active.
10.11.50.73:9080   10092606   2013-08-22 09:04:42.711   +3   BootstrapConfigurePublish   na      0   Thread-86   DISP   6235   1   Audit.Other.dispatcher.DISP.com.cognos.pogo.contentmanager.coordinator.CMBootstrap   StartService   dispatcherBootstrap      Info      DPR-DPR-1002 Successfully registered the dispatcher http://keid:9080/p2pd in Content Manager.
10.11.50.73:9080   10092606   2013-08-22 09:04:42.789   +3   BootstrapConfigurePublish   na      0   Thread-86   DISP   6235   1   Audit.Other.dispatcher.DISP.com.cognos.pogo.contentmanager.coordinator.CMBootstrap   StartService   dispatcherBootstrap      Info      DPR-DPR-1002 Successfully registered the dispatcher http://keid:9080/p2pd in Content Manager.
10.11.50.73:9080   10092606   2013-08-22 09:04:44.983   +3               Thread-86   AAA   6235   1   Audit.RTUsage.cms.CAM.AAA.SRVC   StartService   NameSpace   CAMID("WBM_Provider")   Warning   AAA-CFG-0008 The handler class 'com.ibm.wbimonitor.security.cognos.auth.VMMProvider' cannot be loaded.   <exception><![CDATA[com.ibm.cognos.camaaa.internal.common.exception.ClassLoadErrorException: AAA-CFG-0008 The handler class 'com.ibm.wbimonitor.security.cognos.auth.VMMProvider' cannot be loaded.    at com.ibm.cognos.camaaa.internal.customLegacy.auth.NamespaceAdapterFactory.<init>(NamespaceAdapterFactory.java:64)    at com.ibm.cognos.camaaa.internal.customLegacy.common.handler.CustomJavaProviderHandler.init(CustomJavaProviderHandler.java:95)    at com.ibm.cognos.camaaa.internal.common.handler.HandlerFactoryImpl.initializeHandler(HandlerFactoryImpl.java:595)    at com.ibm.cognos.camaaa.internal.common.handler.HandlerFactoryImpl.createHandler(HandlerFactoryImpl.java:288)    at com.ibm.cognos.camaaa.internal.auth.handler.AuthHandler.populateHandler(AuthHandler.java:237)    at com.ibm.cognos.camaaa.internal.auth.handler.AuthHandler.init(AuthHandler.java:190)    at com.ibm.cognos.camaaa.internal.common.handler.HandlerFactoryImpl.initializeHandler(HandlerFactoryImpl.java:578)    at com.ibm.cognos.camaaa.internal.common.handler.HandlerFactoryImpl.createHandler(HandlerFactoryImpl.java:288)    at com.ibm.cognos.camaaa.internal.common.handler.HandlerChain.processHandlerChain(HandlerChain.java:350)    at com.ibm.cognos.camaaa.internal.common.handler.HandlerChain.init(HandlerChain.java:266)    at com.ibm.cognos.camaaa.internal.common.handler.HandlerFactoryImpl.initializeHandler(HandlerFactoryImpl.java:588)    at com.ibm.cognos.camaaa.internal.common.handler.HandlerFactoryImpl.init(HandlerFactoryImpl.java:552)    at com.ibm.cognos.camaaa.internal.common.handler.HandlerDispatcher.init(HandlerDispatcher.java:142)    at com.ibm.cognos.camaaa.internal.common.NamespaceInfo.initBinding(NamespaceInfo.java:165)    at com.ibm.cognos.camaaa.internal.common.NamespaceManagerImpl.createNamespace(NamespaceManagerImpl.java:92)    at com.ibm.cognos.camaaa.internal.common.NamespaceManagerImpl.init(NamespaceManagerImpl.java:286)    at com.ibm.cognos.camaaa.internal.common.service.CAMAsyncServiceHandler.configure(CAMAsyncServiceHandler.java:246)    at com.ibm.cognos.camaaa.internal.common.service.CAMAsyncServiceHandler.configure(CAMAsyncServiceHandler.java:211)    at com.cognos.pogo.services.DefaultHandlerService.configure(DefaultHandlerService.java:57)    at com.cognos.pogo.services.DispatcherServices.configure(DispatcherServices.java:122)    at com.cognos.pogo.contentmanager.coordinator.RefreshController.composeAndConfigureServices(RefreshController.java:120)    at com.cognos.pogo.contentmanager.coordinator.RefreshController.run(RefreshController.java:80)    at com.cognos.pogo.contentmanager.coordinator.BootstrapConfigurePublish.changeCM(BootstrapConfigurePublish.java:80)    at com.cognos.pogo.contentmanager.coordinator.RuntimeInfoPublishHandler.notifyCMChange(RuntimeInfoPublishHandler.java:134)    at com.cognos.pogo.contentmanager.coordinator.ActiveCMControl.notifyCMChanged(ActiveCMControl.java:77)    at com.cognos.pogo.contentmanager.coordinator.ActiveCMControl.notifyCM(ActiveCMControl.java:137)    at com.cognos.pogo.contentmanager.coordinator.ActiveCMControl$GetActiveCMTask.safeRun(ActiveCMControl.java:217)    at com.cognos.pogo.util.threads.SafeTimerTask.run(SafeTimerTask.java:32)    at java.util.Timer$TimerImpl.run(Timer.java:293) Caused by: java.lang.ClassNotFoundException: com.ibm.wbimonitor.security.cognos.auth.VMMProvider    at java.lang.Class.forNameImpl(Native Method)    at java.lang.Class.forName(Class.java:172)    at com.ibm.cognos.camaaa.internal.customLegacy.auth.NamespaceAdapterFactory.<init>(NamespaceAdapterFactory.java:59)    ... 28 more ]]></exception>
10.11.50.73:9080   10092606   2013-08-22 09:04:45.818   +3               Thread-86   AAA   6235   1   Audit.cms.CAM.AAA   StartService   camAsyncService      Success      
10.11.50.73:9080   10092606   2013-08-22 09:04:56.826   +3   BootstrapConfigurePublish   na      0   Thread-86   DISP   6235   1   Audit.Other.dispatcher.DISP.com.cognos.pogo.services.DispatcherServices   StartService   Fragment Server Service      Success      
10.11.50.73:9080   10092606   2013-08-22 09:04:56.829   +3   BootstrapConfigurePublish   na      0   Thread-86   DISP   6235   1   Audit.Other.dispatcher.DISP.com.cognos.pogo.services.DispatcherServices   StartService   BatchReportService      Success      
10.11.50.73:9080   10092606   2013-08-22 09:04:56.832   +3   BootstrapConfigurePublish   na      0   Thread-86   DISP   6235   1   Audit.Other.dispatcher.DISP.com.cognos.pogo.async.service.connection.bibustkserver.BIBusTKServerManager   Start   com.cognos.pogo.reportservice      Info      Start a External Process because the start count 1 is larger than 0.
10.11.50.73:9080   10092606   2013-08-22 09:05:11.891   +3   BootstrapConfigurePublish   na      0   Thread-86   DISP   6235   1   Audit.Other.dispatcher.DISP.com.cognos.pogo.services.DispatcherServices   StartService   QueryService      Success      
10.11.50.73:9080   10092606   2013-08-22 09:05:11.891   +3   BootstrapConfigurePublish   na      0   Thread-86   DISP   6235   1   Audit.Other.dispatcher.DISP.com.cognos.pogo.services.DispatcherServices   StartService   SystemService      Success      
10.11.50.73:9080   10092606   2013-08-22 09:05:12.387   +3   BootstrapConfigurePublish   na      0   Thread-86   DISP   6235   1   Audit.Other.dispatcher.DISP.com.cognos.pogo.services.DispatcherServices   StartService   buxService      Success      
10.11.50.73:9080   10092606   2013-08-22 09:05:16.014   +3   BootstrapConfigurePublish   na      0   Thread-86   DISP   6235   1   Audit.Other.dispatcher.DISP.com.cognos.pogo.services.DispatcherServices   StartService   GraphicsService      Success      
10.11.50.73:9080   10092606   2013-08-22 09:05:16.116   +3   BootstrapConfigurePublish   na      0   Thread-86   DISP   6235   1   Audit.Other.dispatcher.DISP.com.cognos.pogo.services.DispatcherServices   StartService   ReportDataService      Success      
10.11.50.73:9080   10092606   2013-08-22 09:05:16.516   +3               Thread-86   xts   6235   1   Audit.ps.xts   Upgrade   PresentationService      Success   PRS-ACF-0413 Successfully wrote the upgraded cogadmin/system.xml file.   
10.11.50.73:9080   10092606   2013-08-22 09:05:17.808   +3               Thread-86   xts   6235   1   Audit.ps.xts   StartService   PresentationService      Success      
10.11.50.73:9080   10092606   2013-08-22 09:05:17.808   +3   BootstrapConfigurePublish   na      0   Thread-86   DISP   6235   1   Audit.Other.dispatcher.DISP.com.cognos.pogo.services.DispatcherServices   StartService   IBM Cognos Enhanced Search Service      Success      
10.11.50.73:9080   10092606   2013-08-22 09:05:17.808   +3   BootstrapConfigurePublish   na      0   Thread-86   DISP   6235   1   Audit.Other.dispatcher.DISP.com.cognos.pogo.services.DispatcherServices   StartService   camAsyncAA      Success      
10.11.50.73:9080   10092606   2013-08-22 09:05:17.808   +3   BootstrapConfigurePublish   na      0   Thread-86   DISP   6235   1   Audit.Other.dispatcher.DISP.com.cognos.pogo.services.DispatcherServices   StartService   CacheService      Success      
10.11.50.73:9080   10092606   2013-08-22 09:05:17.810   +3   BootstrapConfigurePublish   na      0   Thread-86   DISP   6235   1   Audit.Other.dispatcher.DISP.com.cognos.pogo.services.DispatcherServices   StartService   ContentManagerCacheService      Success      
10.11.50.73:9080   10092606   2013-08-22 09:05:18.261   +3   BootstrapConfigurePublish   na      0   Thread-86   DISP   6235   1   Audit.Other.dispatcher.DISP.com.cognos.pogo.services.DispatcherServices   StartService   ReportService      Success      
10.11.50.73:9080   10092606   2013-08-22 09:05:18.274   +3               Thread-86   MS   6301   1   Audit.ms.MS   StartService   MonitorService      Success      
10.11.50.73:9080   10092606   2013-08-22 09:05:18.274   +3   BootstrapConfigurePublish   na      0   Thread-86   DISP   6235   1   Audit.Other.dispatcher.DISP.com.cognos.pogo.services.DispatcherServices   StartService   DimensionManagementService      Success      
10.11.50.73:9080   10092606   2013-08-22 09:05:18.276   +3               Thread-86   JOBS   6301   1   Audit..JOBS   StartService   JobService      Success      
10.11.50.73:9080   10092606   2013-08-22 09:05:18.883   +3   BootstrapConfigurePublish   na      0   Thread-86   DISP   6235   1   Audit.Other.dispatcher.DISP.com.cognos.pogo.services.DispatcherServices   StartService   MetadataService      Success      
10.11.50.73:9080   10092606   2013-08-22 09:05:18.890   +3               Thread-86   EMS   6301   1   Audit.ems.EMS   StartService   EventService      Success      
10.11.50.73:9080   10092606   2013-08-22 09:05:20.932   +3   BootstrapConfigurePublish   na      0   Thread-86   DISP   6235   1   Audit.Other.dispatcher.DISP.com.cognos.pogo.services.DispatcherServices   StartService   CPS Producer Registration Service      Success      
10.11.50.73:9080   10092606   2013-08-22 09:05:21.652   +3   BootstrapConfigurePublish   na      0   Thread-86   DISP   6235   1   Audit.Other.dispatcher.DISP.com.cognos.pogo.logging.SystemEventLogger   Start   Dispatcher      Success      DPR-SYS-6000 The product is ready to use.

[Grim]

Distributed install?
Looks like things may be out of sync. Did you bring the entire Cognos Env down, then restart starting with the CM, then Dispatcher?

If a single server install, you may need to clear your cookies before attempting to login.
Can also try from a different machine.

[emarshah]

Hi Grim, its a single server install. I have done this cookie clearance before. its giving me the same problem. I had done the cogconfig test, 2 errors were there, attached is the document link having screenshot.

https://docs.google.com/document/d/1t9HKP-_8DInxMtzGNttCjO49DyGPswqrQGUeg7WVwIM/pub

[Grim]

Bah, google docs is blocked here.

Windows or Unix/Linux?

[emarshah]

It's AIX 6, attached is the img file.

[Grim]

Your CM DB connection is pooched, looks like its missing the oracle jdbc driver (says it could not load it).

[emarshah]

Hi Grim,
             thanks for being involved with high spirits, I have placed the ojdbc6.jar in p2pd/WEB-INF/lib folder, the error for CM connectivity is gone, attached is the new screenshot once I tested the cogconfig.sh .

            I don't know where to find this com.ibm.wbimonitor.security.cognos.auth.VMMProvider jar file and where to place this, if you can guide on this.
Thanks.

[Grim]

SDK - CJAP error in logfiles : AAA-CFG-0008 The handler class <classname> cannot be loaded.
http://www-01.ibm.com/support/docview.wss?uid=swg21618048

[emarshah]

Hi Grim,
       Thanks for your constant interest, I previously passed through this link but I can't get how to do this;

"You need to ensure that the Custom Java Authentication Provider is build or recompiled with the IBM Cognos SDK libraries that match the IBM Cognos Business Intelligence Server version you intend to use that Jar file with."

Can you please put some light on this point, how to recompile through IBM Cognos SDK?

[Grim]

Hi Grim,
       Thanks for your constant interest, I previously passed through this link but I can't get how to do this;

"You need to ensure that the Custom Java Authentication Provider is build or recompiled with the IBM Cognos SDK libraries that match the IBM Cognos Business Intelligence Server version you intend to use that Jar file with."

Can you please put some light on this point, how to recompile through IBM Cognos SDK?

Whoever created your CJAP will need to recompile it. Talk to the dev that created your CJAP.

[emarshah]

Hi Grim,
       None from the Dev team developed this, when we install IBM Business Monitor and Cognos over WAS, this particular CJAP come in the scenario. Seems like this custom Java Authentication Provider is one done by IBM Business Monitor team, U agree? Thanks for your constant interest.

[Grim]

Hi Grim,
       None from the Dev team developed this, when we install IBM Business Monitor and Cognos over WAS, this particular CJAP come in the scenario. Seems like this custom Java Authentication Provider is one done by IBM Business Monitor team, U agree? Thanks for your constant interest.

That makes sense. I wouldn't know for certain as I've never worked with IBM Business Monitor. :(
Might be time to open a PMR with IBM.