Forum     

Go Back   Digit Technology Discussion Forum > Community > Tutorials
Register FAQ Calendar Mark Forums Read

Tutorials This section offers tutorials and How to's on just about anything related to computers and IT. Note: All tutorials are courtesy the posters and not verified by Digit


Closed Thread
 
LinkBack Thread Tools Display Modes
Old 20-11-2007, 03:44 PM   #1 (permalink)
vaibhavtek
Guest
 
Posts: n/a
Wink Block BADBOTS from crawling your website


edited as against forum rules...

Last edited by vaibhavtek; 20-11-2007 at 07:38 PM.
 
Advertisements. Register and be a member of the community to get rid of them.
Advertisement

Old 20-11-2007, 04:14 PM   #2 (permalink)
Rubik's Uncle!!
 
Charan's Avatar
 
Join Date: Sep 2004
Location: ಬೆಂಗಳೂರು (Bengaluru)
Posts: 3,791
Default Re: Block BADBOTS from crawling your website

Thanks you for copy pasting it from chip forum
http://www.chip-india.com/forums/viewtopic.php?t=29177
__________________
i5 2400 | DH67BL | G.Skill Ripjaw 4 GB | FSP SAGA II 500W | CM 430 Black Elite | MSI R6850 Cyclone PE/OC | XBox 360 Controller | 21.5" Samsung Sync Master 2233 | 4 Mbps @75GB FUP :)
Battlefield 3 Multiplayer Discussion | Battlefield 3 Low Latency Servers List
Charan is offline  
Old 20-11-2007, 04:20 PM   #3 (permalink)
Microsoft MVP
 
Vishal Gupta's Avatar
 
Join Date: Jul 2005
Location: AskVG.com
Posts: 5,173
Default Re: Block BADBOTS from crawling your website

^^ lol.

@vaibhavtek

After this, you still hvnt learnt the lesson:

Making Folder Option Disable to make Folder Private

Also don't post in wrong sections:

CDs to DVD
Torrent Invitation
MyBB 1.2.9
__________________
:arrow: http://www.AskVG.com/

Last edited by Vishal Gupta; 20-11-2007 at 04:20 PM. Reason: Automerged Doublepost
Vishal Gupta is offline  
Old 20-11-2007, 04:26 PM   #4 (permalink)
vaibhavtek
Guest
 
Posts: n/a
Exclamation Re: Block BADBOTS from crawling your website

Quote:
Originally Posted by Charan
Thanks you for copy pasting it from chip forum
http://www.chip-india.com/forums/viewtopic.php?t=29177
this thing is also posted in other site some russian one.
I got from there so I didnot posted the source as the lang. is different...

Hope u understand...

Quote:
Originally Posted by Vishal Gupta
^^ lol.

@vaibhavtek

After this, you still hvnt learnt the lesson:

Making Folder Option Disable to make Folder Private

Also don't post in wrong sections:

CDs to DVD
Torrent Invitation
MyBB 1.2.9
Now will keep notice.
thanks....!!

Last edited by vaibhavtek; 20-11-2007 at 04:26 PM. Reason: Automerged Doublepost
 
Old 20-11-2007, 04:32 PM   #5 (permalink)
Microsoft MVP
 
Vishal Gupta's Avatar
 
Join Date: Jul 2005
Location: AskVG.com
Posts: 5,173
Default Re: Block BADBOTS from crawling your website

^^ Even you take the info from russian site, pls mention the source and credits.
__________________
:arrow: http://www.AskVG.com/
Vishal Gupta is offline  
Old 20-11-2007, 04:35 PM   #6 (permalink)
Rubik's Uncle!!
 
Charan's Avatar
 
Join Date: Sep 2004
Location: ಬೆಂಗಳೂರು (Bengaluru)
Posts: 3,791
Default Re: Block BADBOTS from crawling your website

Quote:
Originally Posted by vaibhavtek
this thing is also posted in other site some russian one.
I got from there so I didnot posted the source as the lang. is different...

Hope u understand...
Hope you understand how to give proper credit to the actual source.

Plagiarism is not tolerated here in the forum. if you want to post something then give proper credit to the author. Be it Rusian, German,chiniese or martial its our problem to understand the language .. you give correct credit to the author then you get respect else you dont.

This is not the first time you are doing this.


Now Please give us the original russian source which you are claming.

and for other members here is the source from chip
Quote:
There are some softwares available which can copy/download a whole website.Just think someone copies your whole website and create a same !

Generally these softwares uses "bots",similar to which search engines use
So better block them

Here's a list of few such (most commonly used ) bots with the syntax,Just add them in your robots.txt file to block them
This is quite obvious .. unless you dont know how to compare
__________________
i5 2400 | DH67BL | G.Skill Ripjaw 4 GB | FSP SAGA II 500W | CM 430 Black Elite | MSI R6850 Cyclone PE/OC | XBox 360 Controller | 21.5" Samsung Sync Master 2233 | 4 Mbps @75GB FUP :)
Battlefield 3 Multiplayer Discussion | Battlefield 3 Low Latency Servers List
Charan is offline  
Old 20-11-2007, 04:40 PM   #7 (permalink)
vaibhavtek
Guest
 
Posts: n/a
Default Re: Block BADBOTS from crawling your website

Quote:
Originally Posted by Vishal Gupta
^^ Even you take the info from russian site, pls mention the source and credits.
i found that 6 -7 days ago while searching in google about site copier.
 
Old 20-11-2007, 05:59 PM   #8 (permalink)
Dreamweaver
 
Gigacore's Avatar
 
Join Date: Aug 2006
Location: Bangalore
Posts: 3,904
Default Re: Block BADBOTS from crawling your website

@ vaibhava.. please give credits to authors... not be over smart
__________________
Today's noobs are tomorrow's geeks. Don't make fun of them.. encourage them. - Gigacore

Follow me on twitter.com/gigacore
Gigacore is offline  
Old 20-11-2007, 06:34 PM   #9 (permalink)
Human Spambot
 
shantanu's Avatar
 
Join Date: Dec 2006
Posts: 2,798
Default Re: Block BADBOTS from crawling your website

Vaibhav i gave you warnings before also.. mention source in your post by : 9 PM today.. or you will be given a weeks misery..

shantanu
shantanu is offline  
Old 20-11-2007, 06:35 PM   #10 (permalink)
TechTin.com
 
ravi_9793's Avatar
 
Join Date: Jun 2005
Location: www.TechTin.com
Posts: 4,090
Default Re: Block BADBOTS from crawling your website

@vaibhavtek .I hope you will take care of these from next time.Have pleasant stay here..and keep posting but within rules
ravi_9793 is offline  
Old 20-11-2007, 06:36 PM   #11 (permalink)
Rubik's Uncle!!
 
Charan's Avatar
 
Join Date: Sep 2004
Location: ಬೆಂಗಳೂರು (Bengaluru)
Posts: 3,791
Default Re: Block BADBOTS from crawling your website

^^ you and subbu are in that thread
__________________
i5 2400 | DH67BL | G.Skill Ripjaw 4 GB | FSP SAGA II 500W | CM 430 Black Elite | MSI R6850 Cyclone PE/OC | XBox 360 Controller | 21.5" Samsung Sync Master 2233 | 4 Mbps @75GB FUP :)
Battlefield 3 Multiplayer Discussion | Battlefield 3 Low Latency Servers List
Charan is offline  
Old 20-11-2007, 06:39 PM   #12 (permalink)
Wahahaha~!
 
Faun's Avatar
 
Join Date: Dec 2006
Location: Pune/there
Posts: 7,685
Default Re: Block BADBOTS from crawling your website

source matters.
__________________
Blog | Flickr | Battlelog
Spoiler:
Asus Z68 V-Pro|i5 2500k|TRUE Black|Ripjaws X|U2311H|N560GTX|D7000|XONAR STX|RE272|RE0|CC51|XE200PRO Walnut| TD II V2| Ultraphile|N5800

Mono
Faun is online now  
Old 20-11-2007, 06:40 PM   #13 (permalink)
Dreamweaver
 
Gigacore's Avatar
 
Join Date: Aug 2006
Location: Bangalore
Posts: 3,904
Default Re: Block BADBOTS from crawling your website

vaibhav... dude.. u are breaching the main rule of this forum... so please be careful with this from next time..
__________________
Today's noobs are tomorrow's geeks. Don't make fun of them.. encourage them. - Gigacore

Follow me on twitter.com/gigacore
Gigacore is offline  
Old 20-11-2007, 07:20 PM   #14 (permalink)
TechTin.com
 
ravi_9793's Avatar
 
Join Date: Jun 2005
Location: www.TechTin.com
Posts: 4,090
Default Re: Block BADBOTS from crawling your website

why don't you now edit your post..and mention source.
ravi_9793 is offline  
Old 20-11-2007, 07:24 PM   #15 (permalink)
vaibhavtek
Guest
 
Posts: n/a
Default Re: Block BADBOTS from crawling your website

Quote:
Originally Posted by shantanu
Vaibhav i gave you warnings before also.. mention source in your post by : 9 PM today.. or you will be given a weeks misery..

shantanu
pls donot banned me..
plsssssssss
last chance

pls donot banned me..

plsssssssss

last chance

Last edited by vaibhavtek; 20-11-2007 at 07:24 PM. Reason: Automerged Doublepost
 
Old 20-11-2007, 07:36 PM   #16 (permalink)
Microsoft MVP
 
Vishal Gupta's Avatar
 
Join Date: Jul 2005
Location: AskVG.com
Posts: 5,173
Default Re: Block BADBOTS from crawling your website

^^ Better to mention the Chip thread link in start of your first post and remember to provide original source with credits next time.

You'll not get any fame or respect by stealing others content.
__________________
:arrow: http://www.AskVG.com/
Vishal Gupta is offline  
Old 20-11-2007, 08:23 PM   #17 (permalink)
vaibhavtek
Guest
 
Posts: n/a
Default Re: Block BADBOTS from crawling your website

edited as against forum rules...
 
Old 20-11-2007, 11:13 PM   #18 (permalink)
Human Spambot
 
shantanu's Avatar
 
Join Date: Dec 2006
Posts: 2,798
Default Re: Block BADBOTS from crawling your website

Thread Closed... user not banned.. last warning..
shantanu is offline  
Closed Thread

Bookmarks

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
How can I block a website from being viewed or opened on my computer? ajaybc QnA (read only) 11 23-10-2007 11:16 AM
How TO Block Website krates QnA (read only) 10 10-04-2007 07:31 AM
System Crawling !!!! dreams Software Q&A 17 13-12-2006 08:42 AM
how to block a website prashantban QnA (read only) 8 21-10-2006 12:16 PM
How to block website using regedit dineshgaur1 QnA (read only) 7 17-04-2006 07:52 AM

 
Latest Threads
- by Who
- by Krow
- by clmlbx
- by Tech&ME
- by icebags

Advertisement




All times are GMT +5.5. The time now is 09:09 PM.


Powered by vBulletin® Version 3.8.7
Copyright ©2000 - 2012, vBulletin Solutions, Inc.

Search Engine Optimization by vBSEO 3.3.2