Discussion:
[cricket-users] collector 5 min
Alban Dani
2008-05-22 13:45:07 UTC
Permalink
The collector in my cricket install is taking a little bit over 7 min to
finish all the collections.

Is there any way to speed it up os it stays below 5 min?

Thank you,

alban
Novoa Linares Octavio Humberto
2008-05-22 14:10:07 UTC
Permalink
you have to check the collector logs, it might be taking to much because
some devices are not responding.

Regards

Octavio

-----Mensaje original-----
De: cricket-users-***@lists.sourceforge.net
[mailto:cricket-users-***@lists.sourceforge.net]En nombre de Alban
Dani
Enviado el: Jueves, 22 de Mayo de 2008 08:45 a.m.
Para: cricket-***@lists.sourceforge.net
Asunto: [cricket-users] collector 5 min


The collector in my cricket install is taking a little bit over 7 min to
finish all the collections.

Is there any way to speed it up os it stays below 5 min?

Thank you,

alban
-------------------------------------------------------------------------
This SF.net email is sponsored by: Microsoft
Defy all challenges. Microsoft(R) Visual Studio 2008.
http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/
Oliver Landsmann
2008-05-22 14:21:54 UTC
Permalink
Hi,

This, depends on
a) total number of targets
b) number of targets that are not responding

In case you have two many targets (a) you could start using subtree
sets. The collector reads a file "subtree-sets" in the cricket config
directory. It is explained on
http://cricket.sourceforge.net/support/doc/beginner.html

Google for subtree-sets there is some information on huge installations
out there.

In case of a), either try to fix that or offload the polling from
cricket. Like use scripts to poll the data into files and let cricket
just read these files. Of course the content of the file will not change
if the script can't update it. So you will get some wrong data in that
case. But sometimes better then the whole tree not finishing.

Br,
Oliver
Post by Alban Dani
The collector in my cricket install is taking a little bit over 7 min to
finish all the collections.
Is there any way to speed it up os it stays below 5 min?
Thank you,
alban
-------------------------------------------------------------------------
This SF.net email is sponsored by: Microsoft
Defy all challenges. Microsoft(R) Visual Studio 2008.
http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/
_______________________________________________
cricket-users mailing list
https://lists.sourceforge.net/lists/listinfo/cricket-users
Richman, Marc
2008-05-22 14:22:56 UTC
Permalink
If you can divide up your collection tree, use subtrees and multiple
collectors

You configure subtrees in the file subtree-sets, here is the top of mine
for an example:

# This file lists the subtrees that will be processed together in one
# set. See the comments at the beginning of collect-subtrees for more
info.

set env:
/ups
/weather
/PDU

set misc:
/Sendmail
/NetApp
/DataDomain

set wan:
/Network/Pix
/Network/Site_VPN
/Network/TCP_Accelerators
/Network/Riverbed

And the cron lines for the collectors:
*/5 * * * * cricket test -x /usr/share/cricket/collect-subtrees &&
/usr/share/cricket/collect-subtrees env
*/5 * * * * cricket test -x /usr/share/cricket/collect-subtrees &&
/usr/share/cricket/collect-subtrees misc
*/5 * * * * cricket test -x /usr/share/cricket/collect-subtrees &&
/usr/share/cricket/collect-subtrees wan:

-----Original Message-----
From: cricket-users-***@lists.sourceforge.net
[mailto:cricket-users-***@lists.sourceforge.net] On Behalf Of Alban
Dani
Sent: Thursday, May 22, 2008 9:45 AM
To: cricket-***@lists.sourceforge.net
Subject: [cricket-users] collector 5 min

The collector in my cricket install is taking a little bit over 7 min to
finish all the collections.

Is there any way to speed it up os it stays below 5 min?

Thank you,

alban
------------------------------------------------------------------------
-
This SF.net email is sponsored by: Microsoft
Defy all challenges. Microsoft(R) Visual Studio 2008.
http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/
Alban Dani
2008-05-22 14:42:12 UTC
Permalink
Thank you all.

I have only one subtree ie my subtree-sets file looks like this:

set normal:
/router-interfaces
/home/cricket/cricket/subtree-sets (END)

I have 28 routers/switches that I am monitoring.

Can I just split the job in the crontab by targets instead:
such as:
*/5 * * * * /home/cricket/cricket/collector /router-interfaces/router1
/router-interfaces/router2 .../router-interfaces/router14
*/5 * * * * /home/cricket/cricket/collector /router-interfaces/router15
/router-interfaces/router16 .../router-interfaces/router28

would that have the same effect?

thanks again,

Alban
Post by Richman, Marc
If you can divide up your collection tree, use subtrees and multiple
collectors
You configure subtrees in the file subtree-sets, here is the top of mine
# This file lists the subtrees that will be processed together in one
# set. See the comments at the beginning of collect-subtrees for more
info.
/ups
/weather
/PDU
/Sendmail
/NetApp
/DataDomain
/Network/Pix
/Network/Site_VPN
/Network/TCP_Accelerators
/Network/Riverbed
*/5 * * * * cricket test -x /usr/share/cricket/collect-subtrees &&
/usr/share/cricket/collect-subtrees env
*/5 * * * * cricket test -x /usr/share/cricket/collect-subtrees &&
/usr/share/cricket/collect-subtrees misc
*/5 * * * * cricket test -x /usr/share/cricket/collect-subtrees &&
-----Original Message-----
Dani
Sent: Thursday, May 22, 2008 9:45 AM
Subject: [cricket-users] collector 5 min
The collector in my cricket install is taking a little bit over 7 min to
finish all the collections.
Is there any way to speed it up os it stays below 5 min?
Thank you,
alban
------------------------------------------------------------------------
-
This SF.net email is sponsored by: Microsoft
Defy all challenges. Microsoft(R) Visual Studio 2008.
http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/
_______________________________________________
cricket-users mailing list
https://lists.sourceforge.net/lists/listinfo/cricket-users
Richman, Marc
2008-05-22 16:53:26 UTC
Permalink
That would do the trick since your config tree is flat, but I would
investigate why it is taking 7 minutes to poll so few devices



________________________________

From: Alban Dani [mailto:***@gmail.com]
Sent: Thursday, May 22, 2008 10:42 AM
To: Richman, Marc
Cc: cricket-***@lists.sourceforge.net
Subject: Re: [cricket-users] collector 5 min



Thank you all.

I have only one subtree ie my subtree-sets file looks like this:

set normal:
/router-interfaces
/home/cricket/cricket/subtree-sets (END)

I have 28 routers/switches that I am monitoring.

Can I just split the job in the crontab by targets instead:
such as:
*/5 * * * * /home/cricket/cricket/collector /router-interfaces/router1
/router-interfaces/router2 .../router-interfaces/router14
*/5 * * * * /home/cricket/cricket/collector /router-interfaces/router15
/router-interfaces/router16 .../router-interfaces/router28

would that have the same effect?

thanks again,

Alban

On Thu, May 22, 2008 at 10:22 AM, Richman, Marc <***@atg.com>
wrote:

If you can divide up your collection tree, use subtrees and multiple
collectors

You configure subtrees in the file subtree-sets, here is the top of mine
for an example:

# This file lists the subtrees that will be processed together in one
# set. See the comments at the beginning of collect-subtrees for more
info.

set env:
/ups
/weather
/PDU

set misc:
/Sendmail
/NetApp
/DataDomain

set wan:
/Network/Pix
/Network/Site_VPN
/Network/TCP_Accelerators
/Network/Riverbed

And the cron lines for the collectors:
*/5 * * * * cricket test -x /usr/share/cricket/collect-subtrees &&
/usr/share/cricket/collect-subtrees env
*/5 * * * * cricket test -x /usr/share/cricket/collect-subtrees &&
/usr/share/cricket/collect-subtrees misc
*/5 * * * * cricket test -x /usr/share/cricket/collect-subtrees &&
/usr/share/cricket/collect-subtrees wan:


-----Original Message-----
From: cricket-users-***@lists.sourceforge.net
[mailto:cricket-users-***@lists.sourceforge.net] On Behalf Of Alban
Dani
Sent: Thursday, May 22, 2008 9:45 AM
To: cricket-***@lists.sourceforge.net
Subject: [cricket-users] collector 5 min

The collector in my cricket install is taking a little bit over 7 min to
finish all the collections.

Is there any way to speed it up os it stays below 5 min?

Thank you,

alban

------------------------------------------------------------------------

-
This SF.net email is sponsored by: Microsoft
Defy all challenges. Microsoft(R) Visual Studio 2008.
http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/

Novoa Linares Octavio Humberto
2008-05-22 14:53:28 UTC
Permalink
hope this helps...This is my subtree-sets file, and also the crontab for the
cricket user
**subtree-sets**
set bandwll:
/bandwidth/WLL

set bandmplscust:
/bandwidth/MPLS_Cust

set bandras:
/bandwidth/AccesoRemoto

set bandintranet:
/bandwidth/Intranet

set bandcore:
/bandwidth/Core

set bandcorevip:
/bandwidth/Core-VIP

set bandcustomersvip:
/bandwidth/Customers/00vip

set bandcustomers1:
/bandwidth/Customers/A
/bandwidth/Customers/B
/bandwidth/Customers/C
/bandwidth/Customers/D
/bandwidth/Customers/E

set bandcustomers2:
/bandwidth/Customers/F
/bandwidth/Customers/G
/bandwidth/Customers/H
/bandwidth/Customers/I
/bandwidth/Customers/J

set bandcustomers3:
/bandwidth/Customers/K
/bandwidth/Customers/L
/bandwidth/Customers/M
/bandwidth/Customers/N
/bandwidth/Customers/O

set bandcustomers4:
/bandwidth/Customers/P
/bandwidth/Customers/Q
/bandwidth/Customers/R
/bandwidth/Customers/S
/bandwidth/Customers/T

set bandcustomers5:
/bandwidth/Customers/U
/bandwidth/Customers/V
/bandwidth/Customers/W
/bandwidth/Customers/X
/bandwidth/Customers/Y
/bandwidth/Customers/Z

set routing:
/routing

set rttcore:
/net-rtt/Core

set rttinternet:
/net-rtt/Internet

set rttcustomers:
/net-rtt/Customers

set rttdist:
/net-rtt/Distribution

set perfcore:
/performance/Core

set perfdist:
/performance/Distribution

set perfcustomers:
/performance/Customers


**crontab**
0-59/2 * * * * ~/cricket/collect-subtrees bandcore
0-59/1 * * * * ~/cricket/collect-subtrees bandcorevip
0-59/5 * * * * ~/cricket/collect-subtrees bandras > /dev/null 2>&1
0-59/5 * * * * ~/cricket/collect-subtrees bandintranet
3-59/10 * * * * ~/cricket/collect-subtrees bandcustomersvip > /dev/null 2>&1
3-59/10 * * * * ~/cricket/collect-subtrees bandcustomers1 > /dev/null 2>&1
3-59/10 * * * * ~/cricket/collect-subtrees bandcustomers2 > /dev/null 2>&1
3-59/10 * * * * ~/cricket/collect-subtrees bandcustomers3 > /dev/null 2>&1
4-59/10 * * * * ~/cricket/collect-subtrees bandcustomers4 > /dev/null 2>&1
4-59/10 * * * * ~/cricket/collect-subtrees bandcustomers5 > /dev/null 2>&1
we are running over a thousand devices in some of the customers subtrees....

-----Mensaje original-----
De: cricket-users-***@lists.sourceforge.net
[mailto:cricket-users-***@lists.sourceforge.net]En nombre de Alban
Dani
Enviado el: Jueves, 22 de Mayo de 2008 09:42 a.m.
Para: Richman, Marc
CC: cricket-***@lists.sourceforge.net
Asunto: Re: [cricket-users] collector 5 min


Thank you all.

I have only one subtree ie my subtree-sets file looks like this:

set normal:
/router-interfaces
/home/cricket/cricket/subtree-sets (END)

I have 28 routers/switches that I am monitoring.

Can I just split the job in the crontab by targets instead:
such as:
*/5 * * * * /home/cricket/cricket/collector /router-interfaces/router1
/router-interfaces/router2 .../router-interfaces/router14
*/5 * * * * /home/cricket/cricket/collector /router-interfaces/router15
/router-interfaces/router16 .../router-interfaces/router28

would that have the same effect?

thanks again,

Alban
Post by Richman, Marc
If you can divide up your collection tree, use subtrees and multiple
collectors
You configure subtrees in the file subtree-sets, here is the top of mine
# This file lists the subtrees that will be processed together in one
# set. See the comments at the beginning of collect-subtrees for more
info.
/ups
/weather
/PDU
/Sendmail
/NetApp
/DataDomain
/Network/Pix
/Network/Site_VPN
/Network/TCP_Accelerators
/Network/Riverbed
*/5 * * * * cricket test -x /usr/share/cricket/collect-subtrees &&
/usr/share/cricket/collect-subtrees env
*/5 * * * * cricket test -x /usr/share/cricket/collect-subtrees &&
/usr/share/cricket/collect-subtrees misc
*/5 * * * * cricket test -x /usr/share/cricket/collect-subtrees &&
-----Original Message-----
Dani
Sent: Thursday, May 22, 2008 9:45 AM
Subject: [cricket-users] collector 5 min
The collector in my cricket install is taking a little bit over 7 min to
finish all the collections.
Is there any way to speed it up os it stays below 5 min?
Thank you,
alban
------------------------------------------------------------------------
-
This SF.net email is sponsored by: Microsoft
Defy all challenges. Microsoft(R) Visual Studio 2008.
http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/
_______________________________________________
cricket-users mailing list
https://lists.sourceforge.net/lists/listinfo/cricket-users
-------------------------------------------------------------------------
This SF.net email is sponsored by: Microsoft
Defy all challenges. Microsoft(R) Visual Studio 2008.
http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/
Continue reading on narkive:
Loading...