Get your forum today!

FrauLulu · 03-03-2008, 10:44 AM

Is Forumer (FFF) use Robot .txt to prevent site from to be archived`? I wished to look through archive to find deleted text but is unavailable due to Robot.txt? why make this unavailable to INTERNET archive??

**SawanM** · 03-03-2008, 11:06 AM

You can archive.org?

It takes quite some time for the archive.org crawler to come round one small forum.

You could always use the google cache of the thread if it is indexed to find the deleted text.

**chinhngt** · 03-03-2008, 04:43 PM

Yep, I guess you should wait for some time.

**chinhngt** · 03-03-2008, 07:07 PM

BTW, the robots.txt was put there during a test for the forumforfree.com overload troubleshooting. It was removed now

03-03-2008, 10:44 AM	#1 (permalink)
FrauLulu Junior Forumer Join Date: Sep 2006 Posts: 50 Rep Power: 2 fTrader: (0) fBuck$: 469 Bank: 0 Total fBuck$: 469 Send fBuck$ » My Forumer My Country:	Robot.txt Is Forumer (FFF) use Robot .txt to prevent site from to be archived`? I wished to look through archive to find deleted text but is unavailable due to Robot.txt? why make this unavailable to INTERNET archive??
	Du kamst, du gingst mit leiser Spur, Ein flücht'ger Gast im Erdenland; Woher? wohin? Wir wissen nur: Aus Gottes Hand in Gottes Hand.“ Ludwig Uhland: „Auf den Tod eines Kindes

03-03-2008, 11:06 AM	#2 (permalink)
SawanM Confessed Noob Join Date: Dec 2006 Tournaments Won: 2 Posts: 9,072 Rep Power: 13 fTrader: (36) fBuck$: 66,705 Bank: 0 Total fBuck$: 66,705 Send fBuck$ » My Forumer My Country:	Re: Robot.txt You can archive.org? It takes quite some time for the archive.org crawler to come round one small forum. You could always use the google cache of the thread if it is indexed to find the deleted text.
	Sezza Web Directory Top Web Hosting Reviews\|Top 10 Web Hosting\|Web Host Rating Tu ne cede malis, sed contra audentior ito Do not give in to evil but proceed ever more boldly against it!

03-03-2008, 04:43 PM	#3 (permalink)
chinhngt unix guru Join Date: Dec 2007 Location: Singapore Posts: 415 Rep Power: 1 fTrader: (0) fBuck$: 3,766 Bank: 0 Total fBuck$: 3,766 Send fBuck$ » My Forumer My Country:	Re: Robot.txt Yep, I guess you should wait for some time.
	With best regards, Chinh

03-03-2008, 07:07 PM	#4 (permalink)
chinhngt unix guru Join Date: Dec 2007 Location: Singapore Posts: 415 Rep Power: 1 fTrader: (0) fBuck$: 3,766 Bank: 0 Total fBuck$: 3,766 Send fBuck$ » My Forumer My Country:	Re: Robot.txt BTW, the robots.txt was put there during a test for the forumforfree.com overload troubleshooting. It was removed now
	With best regards, Chinh

Thread Tools
Show Printable Version Email this Page
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode

Get your forum today!

Explore

Support

About

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Like Super Robot Wars? join us now!	ShineEater	Show Off	0	02-22-2008 06:06 AM
Japanese Robot Suit That Increases Your Strength	techfeed	General Chat Area	0	10-29-2006 11:44 AM
The Robot Chicken	Edwin	General Chat Area	3	07-06-2006 05:51 AM
I own Robot Rage!	Evlesoa	Forumer Discussion	15	04-29-2006 05:50 AM
[Selling] Robot Rage CREDITS	Evlesoa	Uncategorized stuff	3	02-22-2006 08:34 PM