Hi,
we have following VCSA environment:
VMware vCenter Server Appliance
6.5.0.14000
recentlly our Postgresql DB grows to 90+% and I have looked how to shrink the database and found following KB: VMware Knowledge Base
I have stoped vpxd, run the script and after that vpxd wont start anymore...
vCenter appliance managemnt shows no error, and I am able to login to vCenter but Inventory is empty and in Flash client I have this error:
Could not connect to one or more vCenter Server systems:
here are also errors from vpxd.log file:
/var/log/vmware/vpxd/vpxd.log | grep -i error
2018-07-11T07:54:42.716+02:00 error vpxd[7FA9930A5800] [Originator@6876 sub=MoOptionMgr] Unable to read from '/etc/motd':N7Vmacore23FileIONotFoundExceptionE(FileIO error: Could not find file : /etc/motd)
2018-07-11T07:54:42.743+02:00 error vpxd[7FA9930A5800] [Originator@6876 sub=MoOptionMgr] [OptionMgr] Ignoring unknown entry from DB: alarms.upgraded
2018-07-11T07:54:42.744+02:00 error vpxd[7FA9930A5800] [Originator@6876 sub=MoOptionMgr] [OptionMgr] Ignoring unknown entry from DB: VirtualCenter.LDAPAdminPrincipal
2018-07-11T07:54:42.744+02:00 error vpxd[7FA9930A5800] [Originator@6876 sub=MoOptionMgr] [OptionMgr] Ignoring unknown entry from DB: VirtualCenter.VimWebServicesUrl
2018-07-11T07:54:42.744+02:00 error vpxd[7FA9930A5800] [Originator@6876 sub=MoOptionMgr] [OptionMgr] Skipping bad entry config.vpxd.enableDebugBrowse from DB. Resetting to default.Exception: vmodl.fault.InvalidArgument
2018-07-11T07:54:56.973+02:00 error vpxd[7FA9930A5800] [Originator@6876 sub=InvtId] [VpxdInvtId::CheckIp] detected IP [IMM_Network0:169.254.95.120] conflict between host [host-46] (moId:host-46) nic:NetworkInfo.vnic[2].ipAddress and entity [host-10749] (moId:host-10749)
2018-07-11T07:54:56.974+02:00 error vpxd[7FA9930A5800] [Originator@6876 sub=InvtId] [VpxdInvtId::CheckIp] detected IP [IMM_Network0:169.254.95.120] conflict between host [host-7501] (moId:host-7501) nic:NetworkInfo.vnic[2].ipAddress and entity [host-10749] (moId:host-10749)
2018-07-11T07:54:56.977+02:00 error vpxd[7FA9930A5800] [Originator@6876 sub=InvtId] [VpxdInvtId::CheckIp] detected IP [IMM_Network0:169.254.95.120] conflict between host [host-13729] (moId:host-13729) nic:NetworkInfo.vnic[2].ipAddress and entity [host-10749] (moId:host-10749)
2018-07-11T07:54:56.979+02:00 error vpxd[7FA9930A5800] [Originator@6876 sub=InvtId] [VpxdInvtId::CheckIp] detected IP [IMM_Network0:169.254.95.120] conflict between host [host-982] (moId:host-982) nic:NetworkInfo.vnic[2].ipAddress and entity [host-10749] (moId:host-10749)
2018-07-11T07:54:56.981+02:00 error vpxd[7FA9930A5800] [Originator@6876 sub=InvtId] [VpxdInvtId::CheckIp] detected IP [IMM_Network0:169.254.95.120] conflict between host [host-13800] (moId:host-13800) nic:NetworkInfo.vnic[2].ipAddress and entity [host-10749] (moId:host-10749)
2018-07-11T07:54:56.983+02:00 error vpxd[7FA9930A5800] [Originator@6876 sub=InvtId] [VpxdInvtId::CheckIp] detected IP [IMM_Network0:169.254.95.120] conflict between host [host-6810] (moId:host-6810) nic:NetworkInfo.vnic[1].ipAddress and entity [host-10749] (moId:host-10749)
2018-07-11T07:54:56.986+02:00 error vpxd[7FA9930A5800] [Originator@6876 sub=InvtId] [VpxdInvtId::CheckIp] detected IP [IMM_Network0:169.254.95.120] conflict between host [host-17706] (moId:host-17706) nic:NetworkInfo.vnic[2].ipAddress and entity [host-10749] (moId:host-10749)
2018-07-11T07:54:56.992+02:00 error vpxd[7FA9930A5800] [Originator@6876 sub=InvtId] [VpxdInvtId::CheckIp] detected IP [IMM_Network0:169.254.95.120] conflict between host [host-21058] (moId:host-21058) nic:NetworkInfo.vnic[2].ipAddress and entity [host-10749] (moId:host-10749)
2018-07-11T07:54:56.996+02:00 error vpxd[7FA9930A5800] [Originator@6876 sub=InvtId] [VpxdInvtId::CheckIp] detected IP [IMM_Network0:169.254.95.119] conflict between host [host-10] (moId:host-10) nic:NetworkInfo.vnic[2].ipAddress and entity [host-11] (moId:host-11)
2018-07-11T07:54:56.997+02:00 error vpxd[7FA9930A5800] [Originator@6876 sub=InvtId] [VpxdInvtId::CheckIp] detected IP [IMM_Network0:169.254.95.120] conflict between host [host-845] (moId:host-845) nic:NetworkInfo.vnic[2].ipAddress and entity [host-10749] (moId:host-10749)
2018-07-11T07:54:57.003+02:00 error vpxd[7FA9930A5800] [Originator@6876 sub=InvtId] [VpxdInvtId::CheckIp] detected IP [IMM_Network0:169.254.95.120] conflict between host [host-13820] (moId:host-13820) nic:NetworkInfo.vnic[1].ipAddress and entity [host-10749] (moId:host-10749)
2018-07-11T07:54:57.005+02:00 error vpxd[7FA9930A5800] [Originator@6876 sub=InvtId] [VpxdInvtId::CheckIp] detected IP [IMM_Network0:169.254.95.120] conflict between host [host-17509] (moId:host-17509) nic:NetworkInfo.vnic[1].ipAddress and entity [host-10749] (moId:host-10749)
2018-07-11T07:54:57.009+02:00 error vpxd[7FA9930A5800] [Originator@6876 sub=InvtId] [VpxdInvtId::CheckIp] detected IP [IMM_Network0:169.254.95.120] conflict between host [host-981] (moId:host-981) nic:NetworkInfo.vnic[2].ipAddress and entity [host-10749] (moId:host-10749)
2018-07-11T07:55:02.614+02:00 error vpxd[7FA9930A5800] [Originator@6876 sub=profileUtil] [DeserializeFromFile] reading failed: FileIO error: Could not find file : /var/lib/vmware/hpMetadataCache.xml
2018-07-11T07:55:05.477+02:00 error vpxd[7FA97E3C7700] [Originator@6876 sub=vmomi.soapStub[5]] initial service state request failed, disabling pings. error=HTTP Status:500 'Internal Server Error'
2018-07-11T07:55:05.665+02:00 error vpxd[7FA97F66C700] [Originator@6876 sub=vmomi.soapStub[7]] initial service state request failed, disabling pings. error=HTTP Status:500 'Internal Server Error'
2018-07-11T07:55:06.113+02:00 error vpxd[7FA9930A5800] [Originator@6876 sub=Default] [VdbStatement] Execute result code: -1
2018-07-11T07:55:06.113+02:00 error vpxd[7FA9930A5800] [Originator@6876 sub=Default] [VdbStatement] SQL execution failed: SELECT EVENT_ID, CHAIN_ID, EVENT_TYPE, EXTENDED_CLASS, CREATE_TIME, USERNAME, CATEGORY, VM_ID, VM_NAME, HOST_ID, HOST_NAME, COMPUTERESOURCE_ID, COMPUTERESOURCE_TYPE, COMPUTERESOURCE_NAME, DATACENTER_ID, DATACENTER_NAME, DATASTORE_ID, DATASTORE_NAME, NETWORK_ID, NETWORK_NAME, NETWORK_TYPE, DVS_ID, DVS_NAME, STORAGEPOD_ID, STORAGEPOD_NAME, CHANGE_TAG_ID FROM VPXV_EVENT_ALL WHERE (EVENT_ID IN (?,?,?,?)) ORDER BY EVENT_ID ASC LIMIT 4;
2018-07-11T07:55:06.113+02:00 error vpxd[7FA9930A5800] [Originator@6876 sub=Default] [VdbStatement] Execution elapsed time: 291 ms
2018-07-11T07:55:06.113+02:00 error vpxd[7FA9930A5800] [Originator@6876 sub=Default] [VdbStatement] Statement diagnostic data from driver is 58P01:0:7:ERROR: could not open file "pg_tblspc/16398/PG_9.4_201409291/16385/12321449": No such file or directory;
--> Error while executing the query
2018-07-11T07:55:06.113+02:00 error vpxd[7FA9930A5800] [Originator@6876 sub=Default] [VdbStatement] Connection diagnostic data from driver is 58P01:0:110:ERROR: could not open file "pg_tblspc/16398/PG_9.4_201409291/16385/12321449": No such file or directory
2018-07-11T07:55:06.113+02:00 error vpxd[7FA9930A5800] [Originator@6876 sub=Default] [VdbStatement] Bind parameters:
2018-07-11T07:55:06.113+02:00 error vpxd[7FA9930A5800] [Originator@6876 sub=Default] [VdbStatement] [0]datatype: 1, size: 4, arraySize: 0
2018-07-11T07:55:06.113+02:00 error vpxd[7FA9930A5800] [Originator@6876 sub=Default] [VdbStatement] value = 76357270
2018-07-11T07:55:06.113+02:00 error vpxd[7FA9930A5800] [Originator@6876 sub=Default] [VdbStatement] [1]datatype: 1, size: 4, arraySize: 0
2018-07-11T07:55:06.113+02:00 error vpxd[7FA9930A5800] [Originator@6876 sub=Default] [VdbStatement] value = 76357091
2018-07-11T07:55:06.113+02:00 error vpxd[7FA9930A5800] [Originator@6876 sub=Default] [VdbStatement] [2]datatype: 1, size: 4, arraySize: 0
2018-07-11T07:55:06.113+02:00 error vpxd[7FA9930A5800] [Originator@6876 sub=Default] [VdbStatement] value = 76357274
2018-07-11T07:55:06.113+02:00 error vpxd[7FA9930A5800] [Originator@6876 sub=Default] [VdbStatement] [3]datatype: 1, size: 4, arraySize: 0
2018-07-11T07:55:06.113+02:00 error vpxd[7FA9930A5800] [Originator@6876 sub=Default] [VdbStatement] value = 102133024
2018-07-11T07:55:06.113+02:00 error vpxd[7FA9930A5800] [Originator@6876 sub=Default] [Vdb::IsRecoverableErrorCode] Unable to recover from 58P01:7
2018-07-11T07:55:06.113+02:00 error vpxd[7FA9930A5800] [Originator@6876 sub=Default] [Vdb::IsRecoverableErrorCode] Unable to recover from 58P01:110
2018-07-11T07:55:06.113+02:00 error vpxd[7FA9930A5800] [Originator@6876 sub=Default] [VdbStatement] SQLError was thrown: "ODBC error: (58P01) - ERROR: could not open file "pg_tblspc/16398/PG_9.4_201409291/16385/12321449": No such file or directory;
--> Error while executing the query" is returned when executing SQL statement "SELECT EVENT_ID, CHAIN_ID, EVENT_TYPE, EXTENDED_CLASS, CREATE_TIME, USERNAME, CATEGORY, VM_ID, VM_NAME, HOST_ID, HOST_NAME, COMPUTERESOURCE_ID, COMPUTERESOURCE_TYPE, COMPUTERESOURCE_NAME, DATACENTER_ID, DATACENTER_NAME, DATASTORE_ID, DATASTORE_NAME, NETWORK_ID, NETWORK_NAME, NETWORK_TYPE, DVS_ID, DVS_NAME, STORAGEPOD_ID, STORAGEPOD_NAME, CHANGE_TAG_ID FROM VPXV_EVENT_ALL WHERE (EVENT_ID IN (?,?,?,?)) ORDER BY EVENT_ID ASC LIMIT "
2018-07-11T07:55:06.172+02:00 error vpxd[7FA9930A5800] [Originator@6876 sub=MoEvent] [EventManagerMo] Failed to load events: "ODBC error: (58P01) - ERROR: could not open file "pg_tblspc/16398/PG_9.4_201409291/16385/12321449": No such file or directory;
--> Error while executing the query" is returned when executing SQL statement "SELECT EVENT_ID, CHAIN_ID, EVENT_TYPE, EXTENDED_CLASS, CREATE_TIME, USERNAME, CATEGORY, VM_ID, VM_NAME, HOST_ID, HOST_NAME, COMPUTERESOURCE_ID, COMPUTERESOURCE_TYPE, COMPUTERESOURCE_NAME, DATACENTER_ID, DATACENTER_NAME, DATASTORE_ID, DATASTORE_NAME, NETWORK_ID, NETWORK_NAME, NETWORK_TYPE, DVS_ID, DVS_NAME, STORAGEPOD_ID, STORAGEPOD_NAME, CHANGE_TAG_ID FROM VPXV_EVENT_ALL WHERE (EVENT_ID IN (?,?,?,?)) ORDER BY EVENT_ID ASC LIMIT "
2018-07-11T07:55:06.173+02:00 error vpxd[7FA9930A5800] [Originator@6876 sub=ConfigIssue] [VpxdManagedEntity::Load] Processing of persisted config issues failed: vim.fault.DatabaseError
2018-07-11T07:55:06.173+02:00 error vpxd[7FA9930A5800] [Originator@6876 sub=Main] Init failed. SystemError: N5Vmomi5Fault11SystemError9ExceptionE(vmodl.fault.SystemError)
2018-07-11T07:55:06.174+02:00 error vpxd[7FA9930A5800] [Originator@6876 sub=Default] Failed to intialize VMware VirtualCenter. Shutting down
any help is welcome