Printer FriendlyEmail Article Link

MRV MCC: Running out of memory - access denied

Objective/Summary
MRV MCC having memory issues, will not allow SSH/TEL login due the following error:

Password:
System resources low, access denied (only 7952kB of memory available)
USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND
root 1 0.0 1.0 1908 668 ? Ss Sep10 0:42 init
root 2 0.0 0.0 0 0 ? S Sep10 0:00 [kthreadd]
root 3 0.0 0.0 0 0 ? S Sep10 0:00 [ksoftirqd/0]
root 4 0.0 0.0 0 0 ? S Sep10 0:00 [events/0]
root 5 0.0 0.0 0 0 ? S Sep10 0:00 [khelper]
root 6 0.0 0.0 0 0 ? S Sep10 0:00 [async/mgr]
root 7 0.0 0.0 0 0 ? S Sep10 0:00 [sync_supers]
root 8 0.0 0.0 0 0 ? S Sep10 0:00 [bdi-default]
root 9 0.0 0.0 0 0 ? S Sep10 0:00 [kblockd/0]
root 10 0.0 0.0 0 0 ? S Sep10 0:00 [kswapd0]
root 11 0.0 0.0 0 0 ? S Sep10 0:00 [mtdblockd]
root 56 0.0 0.0 0 0 ? SN Sep10 0:01 [jffs2_gcd_mtd1]
root 150 52.7 23.9 186736 15032 ? Ssl Sep10 24400:22 /usr/bin/pollerd
root 151 0.0 1.2 2288 768 ? Ss Sep10 0:58 /usr/bin/watchdog
root 152 0.0 1.0 2268 640 ? Ss Sep10 0:00 /sbin/klogd -n
root 224 0.0 1.0 2272 636 ? Ss+ Sep10 0:00 /sbin/getty 0 /dev/tts/0 vt102
root 232 0.0 2.8 14096 1804 ? Ssl Sep10 2:54 /usr/bin/fdsyslogd -n
root 240 0.0 3.3 14512 2096 ? Ssl Sep10 4:12 /usr/bin/lmpd
root 278 0.0 5.9 18920 3716 ? Ssl Sep10 3:45 /usr/bin/snmpd -i /tmp/linux.ini
root 279 0.0 4.3 5908 2724 ? Ss Sep10 0:00 /usr/bin/apid
root 280 0.0 4.2 9440 2640 ? Ss Sep10 0:01 /usr/bin/guid
root 281 0.0 2.9 13428 1868 ? Ssl Sep10 3:34 /usr/bin/discoveryd
root 283 0.0 8.6 5892 5408 ? SLs Sep10 0:10 /usr/bin/ntpd -gn
root 284 0.0 3.2 5532 2040 ? Ss Sep10 1:24 /usr/sbin/sshd -D
root 300 0.0 0.7 1912 496 ? Ss Sep10 0:00 /usr/sbin/inetd
nobody 444 0.0 1.2 2320 780 ? Ss Sep10 1:20 /usr/bin/httpd -C /etc/mini-httpd.conf
admin 3475 0.0 7.8 20764 4904 ? Ssl Sep25 1:12 -cli
admin 3480 33.7 0.8 2280 560 ? R Sep25 8205:58 more
root 3615 6.1 3.7 8320 2344 ? Ss 11:48 0:00 sshd: admin [priv]
admin 3618 0.2 2.0 8320 1272 ? S 11:49 0:00 sshd: admin@pts/2
admin 3619 21.2 7.0 11444 4404 pts/2 Ss+ 11:49 0:01 -cli
admin 3621 16.0 1.4 2512 916 pts/2 R+ 11:49 0:00 ps aux
admin 3649 0.0 8.3 20764 5220 ? Ssl Sep25 1:14 -cli
admin 3654 33.6 0.8 2280 560 ? R Sep25 8172:49 more
3619:3618:mcc
server malloc info:
max system bytes = 18853888
system bytes = 17268736
in use bytes = 16383304

csl: 91196 bytes

Connection to <ip address> closed.
Environment/Versions
  • MRV
  • Media Cross Connected
  • Access denied
Procedure
The system is dangerously low on memory without enough resources to allow another user access to the system, since there is no resources to establish a new session, you should connect to the MRV directly using the RS-232 serial port.

Usually the front MRV panel  includes  an  RS-232  serial  port  and  an  RJ-45  Ethernet  port  for  management access. (Some other models have two SFP ports for additional network access options) At this point I guess the best option would be trying the Serial Console Connection:




Once connected, You can set “sys idle-timeout” to 15 or so.
 
mcc# configure terminal
mcc(config)# sys ?
  api-agent                  - Enable API agent
  audit-log                  - Enable the audit log
  date                       - Set the system clock
  disconnect                 - Disconnect a session(s)
  gui-server                 - Configure the GUI server
  idle-timeout               - Set CLI idle timeout (in minutes)
  lock-types                 - Enable Type-Locking
  login-banner               - Set login-banner
  password-strength-checking - Enable password strength checking
  prompt                     - Change prompt (and SNMP sysName)
  rdate                      - Set the system clock from an rdate server
  rdate-server               - Set rdate server address (only used for 'sys rdate')
  serial                     - Adjust serial interface configuration
  tftp-host-ip               - Set TFTP host address
  timezone                   - Timezone
mcc(config)# sys idle-timeout ?
  <0-400000> - CLI idle-timeout in minutes (zero means no timeout)
mcc(config)# sys idle-timeout 15
 
That will automatically kill sessions after 15 minutes in idle. So you shouldn't run into memory issues anymore.
 
Notes
Refer to FAQ13187 - MCC User Guide

Product : MRV