PDA

View Full Version : Boitho distributed crawler

NeoGen
3rd January 2006, 04:47 PM
Another candidate for inclusion on the vault? :)
http://www.boitho.com/dc/

It's a distributed crawling project, much alike Majestic-12, but this one creates thumbnail images of the crawled sites to show alongside the results of their search engine
http://www.boitho.com/


Top members
http://dcsetup.boitho.com/cgi-bin/dc/topCrawlers.cgi

Top Teams
http://dcsetup.boitho.com/cgi-bin/dc/topTeams.cgi

Also, a dedicated forum
http://www.boitho.com/forum/
And a blog
http://www.boitho.com/blog/
Ragnarog
3rd January 2006, 10:08 PM
Thanks for finding and reporting this one.

I've checked it out and it looks to be meeting the requirements!

Rag
runarb
4th January 2006, 05:55 PM
Hi

I am one of the people behind Boitho.

We doesn’t have any easy parsable team stats yet. But plan to add this at the end of this week.

What data and format do you gays need? Tab separated, comma separated, xml or somting else?

Maby tables lik this?:
Team: Team id, Team name, Pages crawled, Robots.txt crawled
User: User id, User name, Pages crawled, Robots.txt crawled
Ragnarog
4th January 2006, 06:33 PM
I think any format works as long as it is not changed too often, Comma, tabs or xml, everything should be ok!

Rag
russkris
8th January 2006, 05:51 AM
Maybe you might like to add a DC Vault logo to your projects page??

If so PM Rag's or me, and include your email and we could send you the logos
Nanobot
9th January 2006, 12:16 AM
As Rag stated any format is fine but putting them in team order, with the team position, would make my job a lot easier :D
runarb
13th January 2006, 01:34 PM
Maybe you might like to add a DC Vault logo to your projects page??

I will look into that. My mail is: runarb (at) boitho dot com
russkris
14th January 2006, 12:04 AM
You have an email soon then
NeoGen
10th February 2006, 04:46 AM
Almost a month since the last post... what's the status on this one? (regarding to inclusion on the Vault)
russkris
10th February 2006, 08:44 AM
Geez, your a pushy character, aren't you... Geez not so loud :lol:


but at least your on the ball and increasing your post count....
NeoGen
10th February 2006, 02:01 PM
I always liked to fight for the lost causes :lol:

And yea, the post count is also good. I've noticed that my post ranking has risen recently to "Ninja Recruit"... cool! :)
N.V.M.
10th February 2006, 02:10 PM
its still in beta?(first link,first post in this thread)
NeoGen
10th February 2006, 02:28 PM
Yes, it seems so.
The client app does show a problem here and there, but nothing major (at least to me) so the beta state is understandable...
N.V.M.
10th February 2006, 02:34 PM
well,this is only my personal opinion,but i'm not sure about making beta projects part of the Vault.
Ragnarog
11th February 2006, 02:03 AM
Then lets take out Seti Boinc :lol:

J/k guys :p

Rag
Hogward
11th February 2006, 01:26 PM
Then lets take out Seti Boinc :lol:

J/k guys :p

Rag

Yo Rag!

You put in your little toe and can see the water is fine. Now when are you gonna do that cannonball dive into SETISpace? :wink:

HtE
NeoGen
11th February 2006, 01:27 PM
Maybe not seti, but Primegrid is worse than beta, it's alpha, and it's there.:rolleyes:

But you ninjas are sneaky! :p You are trying to distract me from my earlier question!
Almost a month since the last post... what's the status on this one? (regarding to inclusion on the Vault)

I haven't forgotten yet! :D
russkris
12th February 2006, 03:07 AM
You are trying to distract me from my earlier question!
Nope...

Just turn Ninja style, to hijack a thread



http://xlforum.net/vbportal/forums/images/smilies/hijacked.gif