Hi, Jim --
I think the best thing would be to get a packet trace from both sides and
you can then see exactly what's going on over the network between WAS AIX
and the 400.
HTH,
Gary
-----Original Message-----
From: JAVA400-L [mailto:java400-l-bounces@xxxxxxxxxxxx] On Behalf Of Jim It
Sent: Wednesday, May 11, 2016 5:10 AM
To: java400-l@xxxxxxxxxxxx
Subject: Fw: Java Remote Command Failure
Hi All,
Our QA department is implementing new remote commands initiated from a
WebSphere (AIX) Application Server and they are reporting that 20%-30% of
the remote command connections are failing with the response code:
<ResponseInfo code="6003" description="Connection Exception"
message="Established connection failed to
component:AS400_CMD:216.58.195.132" source="AS400_CMD"/>
I asked for a java log showing the error and received the following:
"2016-05-02 00:14:35.527 [ERROR] [WebContainer : 192]
[1079c481-7768-4f48-a159-00bf23a09c8d]
com.ABC.soa.msg.AppMsgImpl@d010db90[code=6003,description=Connection
Exception,message=Established connection failed to
component:AS400_CMD:216.58.195.132,system=AS400_CMD]
com.ABC.soa.exception.SystemException:
com.ABC.soa.msg.AppMsgImpl@d010db90[code=6003,description=Connection
Exception,message=Established connection failed to
component:AS400_CMD:216.58.195.132,system=AS400_CMD]
at
com.ABC.soa.icom.common.As400CommandCall.execute(As400CommandCall.java:289)
~[soa-icom-commons.jar:na] at
com.ABC.soa.icom.dao.AccountsReceivableDao2Impl.getActualDaysPastDue(Account
sReceivableDao2Impl.java:137) ~[soa-icom-commons.jar:na] at
com.ABC.soa.billing.dao.IcomsRetrieveBillingInfoV1x2DaoImpl.retrieveBillingI
nfo(IcomsRetrieveBillingInfoV1x2DaoImpl.java:173)
~[soa-billing-services.jar:na] at
com.ABC.soa.billing.dao.IcomsRetrieveBillingInfoV1x2DaoImpl.getBilling(Icoms
RetrieveBillingInfoV1x2DaoImpl.java:142) ~[soa-billing-services.jar:na] at
com.ABC.soa.billing.service.RetrieveBillingInfoV1x2ServiceImpl.getBilling(Re
trieveBillingInfoV1x2ServiceImpl.java:85) ~[soa-billing-services.jar:na] at
com.ABC.soa.billing.endpoint.RetrieveBillingInfoV1x2EndPoint.retrieveBilling
(RetrieveBillingInfoV1x2EndPoint.java:64) ~[soa-billing-services.jar:na] at
sun.reflect.GeneratedMethodAccessor240.invoke(Unknown Source) ~[na:na] at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl
.java:37) ~[na:1.6.0] at java.lang.reflect.Method.invoke(Method.java:611)
~[na:1.6.0] at
org.springframework.ws.server.endpoint.MethodEndpoint.invoke(MethodEndpoint.
java:134) ~[spring-ws-2.1.3.RELEASE-all.jar:2.1.3.RELEASE]
at
org.springframework.ws.server.endpoint.adapter.MarshallingMethodEndpointAdap
ter.invokeInternal(MarshallingMethodEndpointAdapter.java:140)
~[spring-ws-2.1.3.RELEASE-all.jar:2.1.3.RELEASE]
at
org.springframework.ws.server.endpoint.adapter.AbstractMethodEndpointAdapter
.invoke(AbstractMethodEndpointAdapter.java:53)
~[spring-ws-2.1.3.RELEASE-all.jar:2.1.3.RELEASE]
at
org.springframework.ws.server.MessageDispatcher.dispatch(MessageDispatcher.j
ava:233) [spring-ws-2.1.3.RELEASE-all.jar:2.1.3.RELEASE]
at
org.springframework.ws.server.MessageDispatcher.receive(MessageDispatcher.ja
va:173) [spring-ws-2.1.3.RELEASE-all.jar:2.1.3.RELEASE]
at
org.springframework.ws.transport.support.WebServiceMessageReceiverObjectSupp
ort.handleConnection(WebServiceMessageReceiverObjectSupport.java:88)
[spring-ws-2.1.3.RELEASE-all.jar:2.1.3.RELEASE]
at
org.springframework.ws.transport.http.WebServiceMessageReceiverHandlerAdapte
r.handle(WebServiceMessageReceiverHandlerAdapter.java:59)
[spring-ws-2.1.3.RELEASE-all.jar:2.1.3.RELEASE]
at
org.springframework.ws.transport.http.MessageDispatcherServlet.doService(Mes
sageDispatcherServlet.java:239)
[spring-ws-2.1.3.RELEASE-all.jar:2.1.3.RELEASE]
at
org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkSer
vlet.java:936) [spring-webmvc-3.2.3.RELEASE.jar:3.2.3.RELEASE]
at
org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.jav
a:838) [spring-webmvc-3.2.3.RELEASE.jar:3.2.3.RELEASE]
at javax.servlet.http.HttpServlet.service(HttpServlet.java:595)
[javax.j2ee.servlet.jar:na] at
org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.ja
va:812) [spring-webmvc-3.2.3.RELEASE.jar:3.2.3.RELEASE]
at javax.servlet.http.HttpServlet.service(HttpServlet.java:668)
[javax.j2ee.servlet.jar:na] at
com.ibm.ws.webcontainer.servlet.ServletWrapper.service(ServletWrapper.java:1
230) [com.ibm.ws.webcontainer.jar:na] at
com.ibm.ws.webcontainer.servlet.ServletWrapper.handleRequest(ServletWrapper.
java:779) [com.ibm.ws.webcontainer.jar:na] at
com.ibm.ws.webcontainer.servlet.ServletWrapper.handleRequest(ServletWrapper.
java:478) [com.ibm.ws.webcontainer.jar:na] at
com.ibm.ws.webcontainer.servlet.ServletWrapperImpl.handleRequest(ServletWrap
perImpl.java:178) [com.ibm.ws.webcontainer.jar:na] at
com.ibm.ws.webcontainer.filter.WebAppFilterManager.invokeFilters(WebAppFilte
rManager.java:1071) [com.ibm.ws.webcontainer.jar:na] at
com.ibm.ws.webcontainer.servlet.CacheServletWrapper.handleRequest(CacheServl
etWrapper.java:87) [com.ibm.ws.webcontainer.jar:na] at
com.ibm.ws.webcontainer.WebContainer.handleRequest(WebContainer.java:914)
[com.ibm.ws.webcontainer.jar:na] at
com.ibm.ws.webcontainer.WSWebContainer.handleRequest(WSWebContainer.java:166
2) [com.ibm.ws.webcontainer.jar:na] at
com.ibm.ws.webcontainer.channel.WCChannelLink.ready(WCChannelLink.java:200)
[com.ibm.ws.webcontainer.jar:na] at
com.ibm.ws.http.channel.inbound.impl.HttpInboundLink.handleDiscrimination(Ht
tpInboundLink.java:453) [com.ibm.ws.runtime.jar:na] at
com.ibm.ws.http.channel.inbound.impl.HttpInboundLink.handleNewRequest(HttpIn
boundLink.java:515) [com.ibm.ws.runtime.jar:na] at
com.ibm.ws.http.channel.inbound.impl.HttpInboundLink.processRequest(HttpInbo
undLink.java:306) [com.ibm.ws.runtime.jar:na] at
com.ibm.ws.http.channel.inbound.impl.HttpInboundLink.ready(HttpInboundLink.j
ava:277) [com.ibm.ws.runtime.jar:na] at
com.ibm.ws.tcp.channel.impl.NewConnectionInitialReadCallback.sendToDiscrimin
ators(NewConnectionInitialReadCallback.java:214) [na:CCX.CF [o1330.02]] at
com.ibm.ws.tcp.channel.impl.NewConnectionInitialReadCallback.complete(NewCon
nectionInitialReadCallback.java:113) [na:CCX.CF [o1330.02]] at
com.ibm.ws.tcp.channel.impl.AioReadCompletionListener.futureCompleted(AioRea
dCompletionListener.java:175) [com.ibm.ws.runtime.jar:na] at
com.ibm.io.async.AbstractAsyncFuture.invokeCallback(AbstractAsyncFuture.java
:217) [com.ibm.ws.runtime.jar:na] at
com.ibm.io.async.AsyncChannelFuture$1.run(AsyncChannelFuture.java:205)
[com.ibm.ws.runtime.jar:na] at
com.ibm.ws.util.ThreadPool$Worker.run(ThreadPool.java:1702)
[com.ibm.ws.runtime.jar:na]
com.ibm.as400.access.ConnectionDroppedException: Disconnect request
received, connection terminated.
at
com.ibm.as400.access.AS400ThreadedServer.forceDisconnect(AS400ThreadedServer
.java:237) ~[jt400.jar:JTOpen 7.4] at
com.ibm.as400.access.AS400ImplRemote.disconnectServer(AS400ImplRemote.java:4
53) ~[jt400.jar:JTOpen 7.4] at
com.ibm.as400.access.AS400ImplRemote.disconnect(AS400ImplRemote.java:425)
~[jt400.jar:JTOpen 7.4] at
com.ibm.as400.access.AS400.disconnectAllServices(AS400.java:1203)
~[jt400.jar:JTOpen 7.4] at
com.ibm.as400.access.ConnectionList.removeExpiredConnections(ConnectionList.
java:648) ~[jt400.jar:JTOpen 7.4] at
com.ibm.as400.access.AS400ConnectionPool.cleanupConnections(AS400ConnectionP
ool.java:137) ~[jt400.jar:JTOpen 7.4] at
com.ibm.as400.access.PoolMaintenance.run(PoolMaintenance.java:86)
~[jt400.jar:JTOpen 7.4]"
looking at the classes in in the java logs, it appears that WAS makes a new
connection request from the connection pool but immediately the
ConnectionDroppedException class is invoked and then the iSeries cleans up
the disconnected connection from the connection pool.
I have an open PMR with IBM on both sides but we are finding this difficult
to troubleshoot. Can anyone give any advice for gathering more detailed
insight into digging into this error?
Jim
--
This is the Java Programming on and around the IBM i (JAVA400-L) mailing
list To post a message email: JAVA400-L@xxxxxxxxxxxx To subscribe,
unsubscribe, or change list options,
visit:
http://lists.midrange.com/mailman/listinfo/java400-l
or email: JAVA400-L-request@xxxxxxxxxxxx Before posting, please take a
moment to review the archives at
http://archive.midrange.com/java400-l.
As an Amazon Associate we earn from qualifying purchases.