The Concurrent requests are in Pending status appears / No Concurrent Manager defined to execute the request

The Concurrent request are in Pending status appears / No Concurrent Manager defines to execute the request

The submitted concurrent request are in pending state. The logs states, No Concurrent Manager is running to attend the job. When checked the Admin console for concurrent manager, we found that Internal Concurrent Manager and standard manager were not active. 

Error from $APPLCSF - 

Shutting down Internal Concurrent Manager : 10-JUL-2012 06:14:04
The visr12_0709@visr12 internal concurrent manager has terminated successfully - exiting.

When I checked the app node for FNDLIBR  process, the process was running but OAM console was showing it as terminated. So, obviously something was not right. So I decided to bounce the concurrent manager 

Possible cause for Inactive OR No Manager

i) No manager is defined to run the request

or

ii) All managers are locked by run-alone requests

or

iii) Concurrent Manager Service is down

or

iv) No concurrent manager process because of workshift

To check Work Shift for any Concurrent Manager From System Administrator responsibility > Concurrent > Manager > Define > Work Shifts > Processes

Fix 

[oracle@appsnode log]$ adcmctl.sh  stop apps/apps

You are running adcmctl.sh version 120.17.12010000.5

Shutting down concurrent managers for visr12 ...

ORACLE Password:

Submitted request 400227 for CONCURRENT FND SHUTDOWN

adcmctl.sh: exiting with status 0

adcmctl.sh: check the logfile /u01/app/oracle/visr12/inst/apps/visr12_appsnode/logs/appl/admin/log/adcmctl.txt for more information ...

-- starting the Concurrent Manager with diag=Y for detailed info
[oracle@appsnode log]$ adcmctl.sh  start apps/apps diag=Y

You are running adcmctl.sh version 120.17.12010000.5

Starting concurrent manager for visr12 ...

Starting visr12_0710@visr12 Internal Concurrent Manager

Default printer is noprint

adcmctl.sh: exiting with status 0

adcmctl.sh: check the logfile /u01/app/oracle/visr12/inst/apps/visr12_appsnode/logs/appl/admin/log/adcmctl.txt for more information ...

[oracle@appsnode log]$ adcmctl.sh  status apps/apps

You are running adcmctl.sh version 120.17.12010000.5

Internal Concurrent Manager is Active.

adcmctl.sh: exiting with status 0

[oracle@appsnode log]$ ps -ef | grep FNDLIBR

oracle    7650  7644  0 06:39 pts/1    00:00:03 FNDLIBR                                                    

oracle    7924  7759  0 06:55 ?        00:00:02 FNDLIBR                                                                                                                                                               

oracle    7925  7759  0 06:55 ?        00:00:02 FNDLIBR                                                                                                                                                               

oracle    7926  7759  0 06:55 ?        00:00:02 FNDLIBR                                                                                                                                                               

oracle    7931  7759  0 06:55 ?        00:00:00 FNDLIBR              

Once started I opened Concurrent Request form, from OAM > system administrator responsibility > concurrent > request option. 

Once the form is opened Navigate to +Concurrent > Manager > Administrator and double click on it to open another form. Here you will see Administer Concurrent Manager screen, from which you can identify running or pending requests.

for more detailed logs, pls check $LOG_HOME/appl/conc OR $APPLCSF