plainblack.com
Username Password
search
Bookmark and Share

    
Goto page «Previous Page   1 2    Next Page»

Problems with wremonitor

User aleone
Date 7/6/2007 10:18 pm
Views 2321
Rating 3    Rate [
|
]
Previous · Next
User Message
aleone

I just installed the newest versions of the wre and webgui on rhel3.  Many thanks to the people who built the wikis for the installs - they were a big help.

Everything looks good....except that the crontab job for the wremonitor crashes the whole thing.  I restart webgui and it's good until the wremonitor job tries to run again.

Here is what i see in the log:

2007/07/06 23:00:03 - ERROR - spectre.conf - POE::Kernel::_dispatch_event[1013] - CRON: Response for job intranet.nbcc.org.conf-pbcron0000000000000004 had a communications error. <HTML>
<HEAD><TITLE>An Error Occurred</TITLE></HEAD>
<BODY>
<H1>An Error Occurred</H1>
500 Internal Server Error
</BODY>
</HTML>
2007/07/06 23:01:03 - ERROR - spectre.conf - POE::Kernel::_dispatch_event[1013] - CRON: Response for job intranet.nbcc.org.conf-pbcron0000000000000004 had a communications error. <HTML>
<HEAD><TITLE>An Error Occurred</TITLE></HEAD>
<BODY>
<H1>An Error Occurred</H1>
500 Internal Server Error
</BODY>
</HTML>

 Any ideas?  Do you need more info?

Thanks

 

--- (Edited on 7/6/2007 10:18 pm [GMT-0500] by aleone) ---



Back to Top
Rate [
|
]
 
 
aleone

Update:

I have since wiped the entire machine, and re-installed on a fresh install of RHEL3. (I was not certain of the earlier config)  But, after re-installing WRE and WebGUI, I get the same behavior:

1.  I see the new site configuration and homepage.

2. After a few minutes, i get a 'Bad Gateway' error.

Now, i am seeing 'Connection Refused' errors in the logs.  The hosts file is OK, and I did not install the firewall that comes with RHEL.  What am i missing?

Moreover, when i do a restart command, i get the following:

Stopping Spectre
Spectre Stopped
httpd (pid 13244?) not running
mod_proxy Stopped
httpd (pid 13376?) not running
mod_perl Stopped
Stopping MySQL
Shutting down MySQL..                                      [  OK  ]
MySQL Stopped
Starting MySQL
MySQL Started

Starting WebGUI 7.3.19
        Loading intranet.nbcc.org.conf
WebGUI Started!
mod_perl failed to start!
mod_proxy failed to start!
Spectre Started

I really am stuck; I appreciate any help.  Thanks

 

--- (Edited on 7/10/2007 10:55 am [GMT-0500] by aleone) ---



Back to Top
Rate [
|
]
 
 
aleone

Update:

I have since wiped the entire machine, and re-installed on a fresh install of RHEL3. (I was not certain of the earlier config)  But, after re-installing WRE and WebGUI, I get the same behavior:

1.  I see the new site configuration and homepage.

2. After a few minutes, i get a 'Bad Gateway' error.

Now, i am seeing 'Connection Refused' errors in the logs.  The hosts file is OK, and I did not install the firewall that comes with RHEL.  What am i missing?

Moreover, when i do a restart command, i get the following:

Stopping Spectre
Spectre Stopped
httpd (pid 13244?) not running
mod_proxy Stopped
httpd (pid 13376?) not running
mod_perl Stopped
Stopping MySQL
Shutting down MySQL..                                      [  OK  ]
MySQL Stopped
Starting MySQL
MySQL Started

Starting WebGUI 7.3.19
        Loading intranet.nbcc.org.conf
WebGUI Started!
mod_perl failed to start!
mod_proxy failed to start!
Spectre Started

I really am stuck; I appreciate any help.  Thanks

 

--- (Edited on 7/10/2007 11:08 am [GMT-0500] by aleone) ---



Back to Top
Rate [
|
]
 
 
DBell

Step 1 is always "Check the error log." The WebGUI error log, under the wre, is usually located at /data/wre/var/webgui.log. Otherwise it may be at /var/log/webgui.log (check your /data/WebGUI/etc/log.conf to know where yours is).

More important for your problem will be the modperl error log, located at /data/wre/prereqs/apache/logs/modperl.error.log.

What do these say? 

--- (Edited on 7/10/2007 11:24 am [GMT-0500] by DBell) ---



Back to Top
Rate [
|
]
 
 
pvanthony

Had a similar problem on fedora 1. Solved it with these setting.

Here are the setting used. Not an expert here. Use these setting with caution.  

File is at /data/wre/etc/wremonitor.conf

------------ start ----------------------- 

ipcs=/usr/bin/ipcs
grep=/bin/grep
hostname= used ip address here
adminEmail=name@domain.com.
smtpServer=/usr/lib/sendmail <-- not working for me
connectionTimeOut=30
secondsBetweenChecks=30
dsn=DBI:mysql:test;port=3306
dbuser=test
dbpass=test
modproxyPort=80
modperlPort=81
skipdb=0
skipweb=0
skiphttpdrunaway=0
#percent memory httpd process can consume before being killed
#
# NOTE: Use only whole numbers.  A setting of 3.4 will result
#       in a process living until it consumes 4.0% of memory.
#
httpdMaxMemory=8.00

------------- end -------------------------- 

P.V.Anthony 

--- (Edited on 7/10/2007 12:31 pm [GMT-0500] by pvanthony) ---



Back to Top
Rate [
|
]
 
 
aleone

Thanks, DBell and pvanthony.

First, pvanthony: I compared conf files.  The only differences were the path for grep and httpdMax memory.  My grep path was '/usr/bin/grep', but nothing was there in my FS.  I changed mine to '/bin/grep'.  My httpd MaxMemory is 5, and i did not change this.

I tried restarting  - to no avail. Same as before.

As for the error logs, here you go.  I have collapsed duplicate errors and given the most recent timestamp.

webgui.log:

2007/07/09 21:47:21 - ERROR - spectre.conf - POE::Kernel::_dispatch_event[1013] - CRON: Response for job intranet.domain.org.conf-pbcron0000000000000004 had a communications error. <HTML>
<HEAD><TITLE>An Error Occurred</TITLE></HEAD>
<BODY>
<H1>An Error Occurred</H1>
500 Internal Server Error
</BODY>
</HTML>

2007/07/09 21:50:05 - FATAL - intranet.domain.org.conf - WebGUI::Session::ErrorHandler::fatal[207] - Couldn't connect to WebGUI database, and can't continue without it.
2007/07/09 21:50:05 - ERROR - intranet.domain.org.conf - WebGUI::Session::ErrorHandler::error[183] - Couldn't connect to database: DBI:mysql:intranet_domain_org;host=localhost;port=3306
2007/07/09 21:50:05 - ERROR - intranet.domain.org.conf - WebGUI::Session::ErrorHandler::error[183] - Couldn't connect to database: DBI:mysql:intranet_domain_org;host=localhost;port=3306

2007/07/10 14:14:16 - ERROR - spectre.conf - POE::Kernel::_dispatch_event[1013] - ADMIN: Couldn't connect to WebGUI site intranet.domain.org.conf at http://intranet.domain.org:81/?op=spectreGetSiteData.  Response: 500 Can't connect to intranet.domain.org:81 (connect: Connection refused)

modperl.error.log:

[Tue Jul 10 03:35:10 2007] [warn] Init: Session Cache is not configured [hint: SSLSessionCache]
[Tue Jul 10 03:35:13 2007] [notice] Apache/2.0.59 (Unix) WebGUI/7.3.19 mod_ssl/2.0.59 OpenSSL/0.9.7i mod_apreq2-20051231/2.5.7 mod_perl/2.0.2 Perl/v5.8.8 configured -- resuming normal operations

[Tue Jul 10 09:51:53 2007] [error] Syntax error (word) at 7030 in {\n    "assetToolbarUiLevel" : {\n        "lock" : "5",\n        "copy" : "1",\n        "view" : "1",\n        "export" : "9",\n        "demote" : "3",\n        "promote" : "3",\n        "delete" : "1",\n        "shortcut" : "5",\n        "manage" : "5",\n        "revisions" : "5",\n        "edit" : "1",\n        "cut" : "1",\n        "changeUrl" : "9",\n        "editBranch" : "9"\n    },\n    "enableStreamingUploads" : "0",\n    "spectreIp" : "127.0.0.1",\n    "cookieName" : "wgSession",\n    "runOnLogout" : "",\n    "cacheType" : "WebGUI::Cache::FileCache",\n    "utilityAssets" : [\n        "WebGUI::Asset::Template",\n        "WebGUI::Asset::RichEdit",\n        "WebGUI::Asset::File::Image",\n        "WebGUI::Asset::File"\n    ],\n    "soapHttpHeaderOverride" : "0",\n    "uploadsPath" : "/data/domains/intranet.nbcc.org/public/uploads",\n    "spectrePort" : "32133",\n    "adminModeSubnets" : [\n        \n    ],\n    "macros" : {\n        "/" : "Slash_gatewayUrl",\n        "a" : "a_account",\n        "GroupText" : "GroupText",\n        "International" : "International",\n        "Thumbnail" : "Thumbnail",\n        "u" : "u_companyUrl",\n        "e" : "e_companyEmail",\n        "AdminToggle" : "AdminToggle",\n        "PageTitle" : "PageTitle",\n        "PageUrl" : "PageUrl",\n        "AssetProxy" : "AssetProxy",\n        "SubscriptionItem" : "SubscriptionItem",\n        "H" : "H_homeLink",\n        "c" : "c_companyName",\n        "FetchMimeType" : "FetchMimeType",\n        "D" : "D_date",\n        "CanEditText" : "CanEditText",\n        "r" : "r_printable",\n        "User" : "User",\n        "RandomThread" : "RandomThread",\n        "Page" : "Page",\n        "AOIRank" : "AOIRank",\n        "Spacer" : "Spacer",\n        "RootTitle" : "RootTitle",\n        "Extras" : "Extras",\n        "AdminText" : "AdminText",\n        "AdminBar" : "AdminBar",\n        "GroupAdd" : "GroupAdd",\n        "SubscriptionItemPurchaseUrl" : "SubscriptionItemPurchaseUrl",\n        "AdSpace" : "AdSpace",\n        "@" : "At_username",\n        "L" : "L_loginBox",\n        "LastModified" : "LastModified",\n        "GroupDelete" : "GroupDelete",\n        "EditableToggle" : "EditableToggle",\n        "#" : "Hash_userId",\n        "RandomAssetProxy" : "RandomAssetProxy",\n        "AOIHits" : "AOIHits",\n        "FileUrl" : "FileUrl",\n        "LoginToggle" : "LoginToggle"\n    },\n    "runOnLogin" : "",\n    "defaultTemplateParser" : "WebGUI::Asset::Template::HTMLTemplate",\n    "searchIndexerPlugins" : {\n        "doc" : "/data/wre/bin/doc2txt",\n        "pdf" : "/data/wre/bin/pdf2txt",\n        "readme" : "/bin/cat",\n        "txt" : "/bin/cat",\n        "html" : "/bin/cat",\n        "xls" : "/data/wre/bin/xls2txt",\n        "htm" : "/bin/cat",\n        "ppt" : "/data/wre/bin/ppt2txt",\n        "rtf" : "/data/wre/bin/doc2txt"\n    },\n    "shippingPlugins" : [\n        "ByPrice",\n        "ByWeight",\n        "PerTransaction"\n    ],\n    "sitename" : [\n        "intranet.nbcc.org"\n    ],\n    "ldapAlias" : {\n        "email" : "mail",\n        "firstName" : "givenName",\n        "companyName" : "o",\n        "lastName" : "sn"\n    },\n    "gateway" : "/",\n    "workflowActivities" : {\n        "WebGUI::VersionTag" : [\n            "WebGUI::Workflow::Activity::CommitVersionTag",\n            "WebGUI::Workflow::Activity::RollbackVersionTag",\n            "WebGUI::Workflow::Activity::TrashVersionTag",\n            "WebGUI::Workflow::Activity::CreateCronJob",\n            "WebGUI::Workflow::Activity::UnlockVersionTag",\n            "WebGUI::Workflow::Activity::NotifyAboutVersionTag",\n            "WebGUI::Workflow::Activity::RequestApprovalForVersionTag",\n            "WebGUI::Workflow::Activity::ExportVersionTagToHtml"\n        ],\n        "None" : [\n            "WebGUI::Workflow::Activity::DecayKarma",\n            "WebGUI::Workflow::Activity::TrashClipboard",\n            "WebGUI::Workflow::Activity::CleanTempStorage",\n            "WebGUI::Workflow::Activity::CleanFileCache",\n            "WebGUI::Workflow::Activity::CleanLoginHistory",\n            "WebGUI::Workflow::Activity::ArchiveOldThreads",\n            "WebGUI::Workflow::Activity::TrashExpiredEvents",\n            "WebGUI::Workflow::Activity::CreateCronJob",\n            "WebGUI::Workflow::Activity::DeleteExpiredSessions",\n            "WebGUI::Workflow::Activity::ExpireGroupings",\n            "WebGUI::Workflow::Activity::PurgeOldAssetRevisions",\n            "WebGUI::Workflow::Activity::ExpireSubscriptionCodes",\n            "WebGUI::Workflow::Activity::PurgeOldTrash",\n            "WebGUI::Workflow::Activity::GetSyndicatedContent",\n            "WebGUI::Workflow::Activity::ProcessRecurringPayments",\n            "WebGUI::Workflow::Activity::SyncProfilesToLdap",\n            "WebGUI::Workflow::Activity::SummarizePassiveProfileLog",\n            "WebGUI::Workflow::Activity::SendQueuedMailMessages",\n            "WebGUI::Workflow::Activity::CleanDatabaseCache",\n            "WebGUI::Workflow::Activity::CalendarUpdateFeeds"\n        ],\n        "WebGUI::User" : [\n            "WebGUI::Workflow::Activity::CreateCronJob",\n            "WebGUI::Workflow::Activity::NotifyAboutUser"\n        ]\n    },\n    "dbuser" : "ywvhgncm",\n    "extrasURL" : "/extras",\n    "graphingPlugins" : [\n        "WebGUI::Image::Graph::Pie",\n        "WebGUI::Image::Graph::XYGraph::Bar",\n        "WebGUI::Image::Graph::XYGraph::Line"\n    ],\n    "templateParsers" : [\n        "WebGUI::Asset::Template::HTMLTemplate"\n    ],\n    "dbpass" : "vQ1wI6sB4pP0",\n    "authMethods" : [\n        "LDAP",\n        "WebGUI"\n    ],\n    "richEditorsUseAssetUrls" : "0",\n    "disableCache" : "0",\n    "assets" : [\n        "WebGUI::Asset::Snippet",\n        "WebGUI::Asset::Redirect",\n        "WebGUI::Asset::FilePile",\n        "WebGUI::Asset::Wobject::Article",\n        "WebGUI::Asset::Wobject::Collaboration",\n        "WebGUI::Asset::Wobject::DataForm",\n        "WebGUI::Asset::Wobject::Calendar",\n        "WebGUI::Asset::Wobject::EventManagementSystem",\n        "WebGUI::Asset::Wobject::HttpProxy",\n        "WebGUI::Asset::Wobject::MessageBoard",\n        "WebGUI::Asset::Wobject::Navigation",\n        "WebGUI::Asset::Wobject::Matrix",\n        "WebGUI::Asset::Wobject::Poll",\n        "WebGUI::Asset::Wobject::Product",\n        "WebGUI::Asset::Wobject::ProjectManager",\n        "WebGUI::Asset::Wobject::SQLReport",\n        "WebGUI::Asset::Wobject::Search",\n        "WebGUI::Asset::Wobject::Survey",\n        "WebGUI::Asset::Wobject::TimeTracking",\n        "WebGUI::Asset::Wobject::WeatherData",\n        "WebGUI::Asset::Wobject::MultiSearch",\n        "WebGUI::Asset::Wobject::StockData",\n        "WebGUI::Asset::Wobject::SyndicatedContent",\n        "WebGUI::Asset::Wobject::InOutBoard",\n        "WebGUI::Asset::File::ZipArchive",\n        "WebGUI::Asset::Wobject::WSClient",\n        "WebGUI::Asset::Wobject::SQLForm",\n        "WebGUI::Asset::Wobject::WikiMaster"\n    ],\n    "paymentPlugins" : [\n        "ITransact",\n        "Cash"\n    ],\n    "uploadsURL" : "/uploads",\n    "extrasPath" : "/data/WebGUI/www/extras",\n    "spectreSubnets" : [\n        "10.0.0.0/16",\n        "10.11.12.0/24",\n    ],\n    "dsn" : "DBI:mysql:intranet_nbcc_org;host=localhost;port=3306",\n    "enableSaveAndCommit" : "0",\n    "assetContainers" : [\n        "WebGUI::Asset::Wobject::Layout",\n        "WebGUI::Asset::Wobject::Folder",\n        "WebGUI::Asset::Wobject::Dashboard"\n    ],\n    "maximumAssets" : "0"\n}\n. at /data/wre/prereqs/perl/lib/site_perl/5.8.8/JSON/Parser.pm line 325.\nCompilation failed in require at (eval 3) line 1.\n
[Tue Jul 10 09:51:53 2007] [error] Can't load Perl file: /data/WebGUI/sbin/preload.perl for server luvox.nbcc-us.org:0, exiting...

[Tue Jul 10 14:32:09 2007] [error] (28)No space left on device: Cannot create SSLMutex
Configuration Failed  (*****lots of these****)

Hope this sheds some light.....As for that syntax error above, i removed the 10.x.x.x subnets, and it only has the loopback IP now.

thanks

--- (Edited on 7/10/2007 2:05 pm [GMT-0500] by aleone) ---



Back to Top
Rate [
|
]
 
 
pvanthony

My httpd MaxMemory is 5, and i did not change this.

Actually that was what caused the problem for me. Just try changing it to "8.00" or larger. The setting can always be changed back. Just try it and see if there are less errors.

P.V.Anthony 

--- (Edited on 7/10/2007 9:20 pm [GMT-0500] by pvanthony) ---



Back to Top
Rate [
|
]
 
 
colink
  1. The "No space left on device" is a problem.  If your disk is full, WebGUI (and just about everything else on the computer) will have problems running.
  2. The problem just before that says that you have a syntax error in the webgui configuration file.  That will cause lots and lots of problems to show up (like not being able to connect with.  The syntax error will need to be fixed before you can go on.

 

--- (Edited on 7/10/2007 3:31 pm [GMT-0500] by colink) ---



Back to Top
Rate [
|
]
 
 
aleone

Thanks, colink, but consider these:

1.  The 'lack of space' message caught my eye, too.  However, this is a fresh install of rhel3.  Here is the status of the machine:

Filesystem           1K-blocks      Used Available Use% Mounted on
/dev/hda2             75766204   2230328  69687104   4% /
/dev/hda1               101089     15035     80835  16% /boot
none                    254416         0    254416   0% /dev/shm

 Doesn't look like a space issue to me.

2. The only tweaking i did in that conf file was add to the spectre subnets, and I have since deleted my changes.  Now, the tail of that file is:

    "uploadsURL" : "/uploads",
    "extrasPath" : "/data/WebGUI/www/extras",
    "spectreSubnets" : [
        "127.0.0.1/32"
    ],
    "dsn" : "DBI:mysql:intranet_nbcc_org;host=localhost;port=3306",
    "enableSaveAndCommit" : "0",
    "assetContainers" : [
        "WebGUI::Asset::Wobject::Layout",
        "WebGUI::Asset::Wobject::Folder",
        "WebGUI::Asset::Wobject::Dashboard"
    ],
    "maximumAssets" : "0"
}

I think that is the default settings.

I am pretty new to this, but i think that addresses your two points. :/

 

--- (Edited on 7/10/2007 3:53 pm [GMT-0500] by aleone) ---



Back to Top
Rate [
|
]
 
 
aleone

I made the change you suggested, pvanthony, and then rebooted the machine.  Webgui, modperl, modproxy, spectre all started fine.  Then, after a few minutes, i received the 'Bad Gateway' Error.  Webgui will catch itself and restart, and will work for a while, until it hits this elusive snag.  It seems to center around a specific cron job.  I have tailed the relevant logs:

[root@luvox root]# date
Wed Jul 11 11:18:22 EDT 2007


[root@luvox root]# tail /data/wre/var/wremonitor.log
Wed Jul 11 11:18:00 2007 - All is well with the database server.
Wed Jul 11 11:18:00 2007 - All is well with the web server.
Wed Jul 11 11:18:01 2007 - 1 runaway httpd processes killed for using 1 percent of shared memory.
Wed Jul 11 11:18:01 2007 - 1 runaway httpd processes killed for using 1 percent of shared memory.
Wed Jul 11 11:18:01 2007 - 1 runaway httpd processes killed for using 1 percent of shared memory.
Wed Jul 11 11:18:01 2007 - 1 runaway httpd processes killed for using 1 percent of shared memory.
Wed Jul 11 11:18:01 2007 - 1 runaway httpd processes killed for using 1 percent of shared memory.
Wed Jul 11 11:18:01 2007 - 1 runaway httpd processes killed for using 1 percent of shared memory.
Wed Jul 11 11:18:01 2007 - 1 runaway httpd processes killed for using 1 percent of shared memory.
Wed Jul 11 11:18:01 2007 - All is well with the Spectre server.

[root@luvox root]# tail /data/wre/var/webgui.log
500 Internal Server Error
</BODY>
</HTML>
2007/07/11 11:15:09 - ERROR - spectre.conf - POE::Kernel::_dispatch_event[1013] - CRON: Response for job intranet.nbcc.org.conf-pbcron0000000000000004 had a communications error. <HTML>
<HEAD><TITLE>An Error Occurred</TITLE></HEAD>
<BODY>
<H1>An Error Occurred</H1>
500 Internal Server Error
</BODY>
</HTML>

--- (Edited on 7/11/2007 10:38 am [GMT-0500] by aleone) ---



Back to Top
Rate [
|
]
 
 
     Goto page «Previous Page   1 2    Next Page»



© 2010 Plain Black Corporation | All Rights Reserved