No!  You do not want to “Show her you’re a real man,” “Make her scream like a banshee,” or “Be a dynamo in bed!”  I know that nice man in Nigeria desperately needs your help and wants to send you money, even though he can’t speak English so good and somehow managed to randomly pick your email address from the millions available, but just let him go… ok?  No, no, no… you DO NOT want to get your degree online by taking a few equivilency tests.

What?  No!  Stop that!  Didn’t I tell you that you don’t want to increase your manhood or enlarge your chest?

No, you did not sign up for an account at Bank of America.  I know that’s what they said.  I know.  I know they want your personal information verified so they can ensure that your account hasn’t been compromised.  When did you sign up for an account?  You didn’t.  Then why would they be sending you an e-mail?  Just… don’t worry about it, ok?

No, you do not have a $435.67 payment to classicautos from PayPal.  I know it says so, but do you even have a PayPal account?  No?  Then how could you have sent a payment?  Nevermind, just ignore it.

Viagra?  What?  No.

I know that beautiful girl (Annanikova?) from Russia wants to meet you and probably make lots of nice little babies too, but have you even met her?  Why would she want to get to know you?  Oh, because she’s lonely and you look cute in your profile picture.  What profile?  MySpace I guess.  What?  Oh, you don’t have a MySpace profile.  Humph.

IQ test?  Online?  Prove you’re smarter than Paris Hilton… do you really need a test?

A check?  Really?  Oh, did Obama say he was going to send you a twelve thousand dollar check?  Oh!  Only if you register online at this website.  Is it a government site?  Oh, well that’s ok, I’m sure it’s still legit.  *sigh*

No, I didn’t know that I could use my cell phone to track…

Oh, well… I guess that’s terrible that the do not call list is…

What!?  A virus?  I don’t even like eBay…

Man from Nigeria…

Manhood…

PayPal…

Ok.  I don’t know who you people are or what you’re thinking, but STOP CLICKING ON SPAM!  If nobody ever clicked on it, then eventually it would just go away.  The fact that it’s still around means that there’s at least ONE PERSON OUT THERE that still looks at a bit of SPAM and says to themselves, “Why yes… actually!  I WOULD like my penis to be bigger… thank you!”  Who are you!?  STOP IT.

That is all.

Oh, by the way.  I found this great place where you can get a free sample of any over the counter medication, just by giving your name, address, and SSN. Make sure you check it out!

In the course of the cleanup it occured to me that it would just be easiest to start over.  That’s why I’m using a new blog, new image gallery, and even a new CSS template for the entire site.  I want it all to be fresh.  The information is the same, for the most part, but I had to pick through every file and pull out the good stuff while dumping the bad stuff.  This bad stuff was often hidden in nooks and crannies both in my filesystem and in almost every html file I have.

Quite the pain.

I have, however, learned my lesson when it comes to updates and user permissions.  All I can do now is hope I managed to scrape everything clean.  I also hope that the big G (Google) decideds to show mercy on me and take my site out of their spam and virus site list.   We shall see.

-Ed

So, what browser are you using today? Internet Explorer? FireFox? Opera? Maybe Safari or Konqueror? Even Lynx? No matter what you use, if you’re reading this then you can obviously view my site. This is because I don’t block anyone from using my site… I allow all visitors from all countries and using all browsers. I’m nice like that.

There are, however, some people who have suddenly stopped allowing people using the FireFox browser from accessing their websites. FireFox certainly isn’t the most popular browser, but it’s gaining a larger and larger portion of marketshare every year over the top dog Internet Explorer. FireFox is what I use, and also what I recommend to all of my friends and anyone who happens to ask. I just like it better, it seems to be a bit faster and easier to configure for my needs. The plugins are cool, and it’s just a way for my in my little tiny life to stick it to Microsoft… the big bad computer company. Just a little bit.

So why would any webmaster choose to ban FireFox users from their website? Why would you want to ban anyone at all for that matter? It’s all because of a little FireFox plug-in called AdBlock. With AdBlock running, FireFox users don’t see any advertisements when they surf the ‘net. How cool is that? No more ads! But wait, if you can’t see the ads then you can’t click them, and if you can’t click them then the webmaster of that site can’t make any advertising revenue, and if he can’t make any advertising revenue he doesn’t make any money, and if he doesn’t make any money he can’t offer the content on his site to everyone for free anymore… can he? Hence, FireFox users are universally blocked from these sites.

I think it’s pretty dumb, myself. I mean… to block an entire browser simply because a portion of the population using it also blocks your ads is pretty severe.

It raises many interesting points, and not a few hackles, however, when you start discussing the AdBlocking behavior as it pertains to the web as a whole, and stop worrying about FireFox. After all, every browser is capable of disabling advertisements like that with the right tweaks. So that brings up the question… does a user have the ‘right’ to block advertisements from a website? Does the website then have the ‘right’ to block those users from viewing it? Who should have control over the content that is shown on a user’s computer, the user or the webmaster?

Those questions are pretty black and white, and this issue really deals more in shades of gray. For example, and these are my opinions as a webmaster and websurfer who both uses ads for revenue and feels they are a necessary evil, I think that the end user has every right to block whatever they wish. The webmaster or site owner, on the other hand, should have every right to block whomever they wish for whatever reason. The fact is that this site, the very site you’re viewing this post on (duskrider.com I hope… else my copyright has been violated), is fully owned and operated by me. I paid for the domain name, I pay for the server it’s hosted on, I wrote all the code, I used my own time to write this article, and I even pay for the very bandwidth you use to view this page… every time you view another page it costs me fractions of a cent. This money comes from my own pocket. I work at a job, and the paycheck I get allows me to fund this site (and many other things of course). I could use that money to do lots of other things, but instead I put it here because I want to and I enjoy it. The ads on this site are to help me pay for it… so I don’t need to use my own money, I can use the money from the advertisers. Is it really to much to ask that you at least have the capability of viewing the ads? I mean really… what I provide is free to you… you pay nothing. How much of an insult is to to me to block the few ads that I use to try to break even each month?

I’m not asking you to look at them. I’m not asking you to click them. I merely asking for the opportunity to allow you to view them if you wish.

Now, if I found out that you blocked the ads and are still reading this content that I put out there for free, would it really be so harsh of me to deny you this content? If you don’t want to see the ads, thats fine, but you also don’t get to see my images. You don’t get to read this article. You don’t get to view my site. That’s the deal. You pay for the privilege (and it is a privilege like it or not. I don’t have to do this) by allowing me to show you a few advertisements.

I obviously don’t do this… anyone can view my stuff regardless of if they see the ads or not, but were I to change this policy would that make me a imperialistic monster out to deny the users of the web their freedoms? No. I would merely be protecting my content.

Lots of people try to justify the blocking of advertisements by saying it’s just like going to the bathroom during a commercial break on TV or flipping past the ads in a magazine. This logic makes me laugh, just a little. Perhaps if you were to go to the bathroom on EVERY commercial break in every show you watched it might relate. Maybe if you blindfolded yourself and cut all the advertisements out of a magazine before you started reading the thing it might relate. The point is that if you’re running AdBlocking software (at least if you run it the way most people run it) I don’t even get the slightest opportunity to make back some of the money I lost because you visited my site. You never even see an ad. You see a big gaping hole somewhere on my page where the ad was supposed to be. I won’t even get into the implications of viewing my content in a manner which it was not intended to be viewed. That’s a whole separate kettle of fish my friends.

The bottom line is that, like it or not, I have the right to do whatever I want with my website. I can block anyone I like, for any reason, from anywhere… that’s the beautiful part of being a webmaster on the world wide web. I have total control over my server. If I want to block you because you don’t want to view my ads… then I can. On the other hand, you have right to block the content, no matter what I think. Just know that when you block my ads, you might just be taking a few cents out of my pocket. If you don’t care, then so be it, but don’t be surprised when sites that are currently free and ad supported start asking you for membership fees.

Wow, it’s been a real long time since I’ve written anything here… I just haven’t had the time or the desire to really do any blogging. I was reading a thread today, however, that got my kickers in a bunch, so I felt that perhaps it was a good day to come out of retirement. Typically I don’t express much personal opinion on this blog, but since I haven’t expressed much of anything on this blog in the last 6 months, I don’t suppose anyone is going to care if I get a little opinionated here.

What tripped me off today was the subject of Captcha. If you don’t know what it is, it’s when you need to enter some goofy looking letters or numbers to enter a website or register for something. Here’s an Example from the Forest of Love. As you can see, I myself use Captchas on my own sites. The purpose of these is to ensure that the registering party is actually a human and not some program written by a script kiddie that wants to sell Viagra(tm) on my website. As of this writing I have a Captcha, 100% custom written by yours truly in Flash, that integrates with php in order to try to fool the bots. I love this little flash… I was very proud of it when I got it completed. It even has a place where you can use Audio to read the characters for you if you can’t read them on the screen.

As much as I love it, I’m thinking of replacing it. Why?

Accessibility.

The Flash Captcha on the page I just linked to has several Accessibility problems, and it’s likely that anyone on the Website Accessibility A-Train would virtually flame it so badly that I might as well serve it with some Favre Beans and A Nice Chianti… *slurp slurp*

For one, it’s Flash based. Bad move. Flash has become a sort of ‘Bad Boy’ of web design in recent years because it can be loud, distracting, and a overall bad experience for the visitor, not to mention long load times. In addition, Flash isn’t always installed by default on every browser, and even though it might be installed, it isn’t necessarily enabled. Without Flash installed and enabled on my site, the Captcha fails and you cannot register.

Secondly, even though I have a button that plays the audio, it’s likely that a screen reader (a program for the blind that reads the contents of a web page) couldn’t use it anyway… making the audio fairly useless. Since it’s in flash, the screen reader wouldn’t be able to read it and notify the visitor (who is probably blind) that they have an audio option.

Third, it’s a Captcha, and Captchas are ALWAYS bad for Accessibility. Ask anyone who is a ‘Web Accessibility Expert’ and they’ll tell you that a Captcha does nothing but put barriers and speedbumps in the way of legitimate users who are trying to surf the web. It’s annoying and an inconvenience and should be stricken from this Earth and avoided like the black plague!

Web Accessibility Experts annoy me. A lot.

They’re usually the same type of people who like to tell me what my site can and cannot look like, how it can and cannot operate, and how I must follow strict guidelines when creating my website so that anyone can access it from any type of computer or any type of browser. Nevermind that the site is MINE and owned by ME and I should have total creative control over it. Nevermind that maybe I don’t CARE if blind people can access my site. That’s not the case, but so what if it is? It’s MY site. That’s what I think anyway. To the ‘Expers’, however, it doesn’t matter. if I don’t make my site accessible to even the smallest minority of web users not only am I an amateur web designer and programmer by default, but I’m also insensitive, and might even be a monster, chauvinist, bigot, or even a conservative. Well… now we don’t want that, do we?

It gets worse, because, since I’m an American, I could probably be sued because someone couldn’t read my blog or view my images due to being blind. Yeah, that’s right. The Target retail store chain just got sued for this very thing. A blind person wasn’t able to shop on their online store because Target didn’t make their website accessible to the blind. Now, I’m not saying the suit against Target is totally unjustified, but I’ve seen some go so far as to say that there should be laws passed saying how accessible websites need to be. Imagine what would happen to mySpace if laws like this passed?

Anyway, I digress. I was reading about a new type of Captcha today that I’m thinking very seriously about implementing on my sites, replacing the Captcha I wrote myself. It’s called ReCaptcha, and it’s pretty cool. It uses words from books to make the Captcha, has an audio component made to work with screen readers, and it benefits the world at the same time. I think it’s a cool idea, but a couple of the comments on the page regarding ReCaptcha smack of accessibility righteousness, which is what prompted me to post this entry.

Awesome idea! For wasting a sh*tload of everyone’s time! Thanks for putting more roadblocks and speedbumps on the web!

But captchas are, at best, annoying! It’s a shame that people that want to post a comment must pass this painful step. And I don’t speak about people with difficulties.

The fact of the matter is that Captchas are the lesser of two evils. Either you endure filling out a Captcha script when you sign up for mail or any other service… or you spend your life digging through Viagra and Mobile Phone ads looking for content. Personally, if one of my visitors can’t be bothered to fill out my Captcha before they use my free service, I don’t miss them.

As an additional note to Web Accessibility Experts who carry the torch of righteousness, I applaud your efforts and hope that someday everyone regardless of age or impairment can have access to everything, but don’t tell me how to create my websites. The day I create a background image for the blind users of my website is the day that you can take me out back and put me out of my misery. Thank you.

Giving away free advertising on my new site seems to be a necessary evil.

Have I ever said on here that I don’t like link exchanges? No? Well I don’t. I find the whole idea to be a little self serving. On the rare occasions that I do a link exchange with another website, I end up feeling just a little dirty afterwards… like I’ve done something nasty and need to wash it off before it sticks. Don’t get me wrong though. In the old days doing a link exchange was a nice way to shift traffic around between a few sites that were friendly with each other, or who had similar content. I’m not opposed to the IDEA of link exchange, I’m opposed to its current incarnation.

For those of you who don’t know, a link exchange is when one website links to another website in return for the second website doing the same. The sites exchange links. I link to you, you link to me. Pretty simple, and not at all dirty. I like to consider myself a sort of link purist, however. I don’t like to link to other sites unless I think that the content they provide is exceptionally good and will truly benefit my visitors. It used to be that all sites thought the same way… after all, why would you want to link to a site that doesn’t have anything to do with your topic?

Google.

Ah, there it is again. That word. Google. Google learned a long time ago that you can’t trust a webmaster to give an accurate description of their own site. In the old days of the internet, a search engine ranked a page based on the keywords within that page. Those keywords were written into a special type of HTML tag called a META TAG, and a webmaster had control over that. To put it in perspective, how many junk e-mails did you get last week saying your loan has been approved or you can increase your breast size? Now imagine the same people that send those mails being able to tell search engines what their site contains. You’d think you’re going to a site to look up information on Paris Hilton, but instead got information on how you can enlarge your penis. Shameful.

To combat this, Google needed to find a way to rank sites that was independent of that site owner’s opinion. Their solution was to use OTHER website owner’s opinions… by counting a link to a website as a vote for that site. The more links you got to your site, the more votes you got… and the higher your site ranked in Google. Can you see where I’m going with this? Now, the more links you have the better you’re ranked. This makes a link on a site a VERY valuable resource, especially if the site doing the linking is highly ranked or has a great deal of traffic, and didn’t your Mother ever tell you that you don’t get anything for free. She was right.

In order for me to get a link from someone else to my page, I have to also link back to them. It doesn’t matter that our content isn’t the same, or that my visitors aren’t looking for what they have to offer. That’s just the way it is. This brings me to my original point… took me awhile, but here we go.

Giving away free advertising on my new site seems to be a necessary evil.

My new site, The Forest of Love, doesn’t get any traffic. It’s brand new, so it’s not highly ranked in the search engines, not listed in any directories, not in anyone’s bookmarks, not on anyone’s MySpace page (well… one person’s MySpace page), and generally not listed anywhere that anyone could find it. My job is to get traffic there, so I need to list it in places where it can get clicks. Many of those places are Free Stuff Directories, since I’m giving away a free service. Need a free way to show your significant other how much you love them? Carve a tree! etc. etc. ad infinitum.

Visitors to my site, generally, aren’t looking for freebies. They’re looking for a way to express their love, a way to create something for a loved one, or they’re looking for a unique type of gift to give… and it happens to be free. Why, then, should I link to a freebie site? My visitors aren’t looking for that! If I want to get listed in this directory of free stuff, however, I have to provide a link back to them on the FRONT PAGE of my site. Nevermind just a courtesy link… it has to be THEIR BANNER on my FRONT PAGE. 70% of those sites require that… the other 30% are more lenient, but I’ve only found two freebie directory sites that don’t ask for a return link.

Keep in mind that this is their business. This is what they do… they list free things. That’s what their visitors are there for… to find free stuff. By linking to my site, they’re adding real free content to their site for their visitors, but that’s not enough! NO! They have to have that return link. Nevermind that they link to me from a page buried three links deep in their site, and I have to link to them from my front page. Nevermind that their link to me is a small text link with a description and my link to them has to be some ridiculous animated .gif from the early 90’s. Nevermind that my site is EXACTLY the type of content they need for their visitors and their site isn’t what my visitors are looking for… the link has to be there. On top of that, I have to put their link on my site FIRST. If the link isn’t there, they won’t even consider putting me in their directory. The Nerve! I have to link to them and wait for a week while they go through all their junk mail and hope my request doesn’t get thrown in the bit bucket. In the meantime, the link to their page is slowly burning a pit in my retina every time I look at it on my page… while I get NOTHING in return. If I’m lucky they’ll add me to page #102 of their directory in the pornography section (after all, my site deals with love), and I’ll get more visitors than I can handle. Meh.

I’ve had one banner on that site for a week and a half with no link in return. That’s a week an a half worth of free advertising for a free site. I’m not in the habit of giving away advertising space for nothing.

The worst thing is that I don’t have a choice. Since I don’t have any traffic and need desperately to get some… I’m forced to play their filthy little game. Scroll down to the bottom of the index page at the Forest to see what I’m talking about. Ugh, it makes my eyes bleed.

Necessary evil.

Just thought I’d pop in and drop a link to the image that goes along with the Forest of Love. I used Vue to make this one and it turned out pretty good considering I don’t know much about Vue and haven’t done anything at all in over 6 months. Here’s the Image

As for the Forest, it’s too early to tell how much traffic I’ll get, or how well it will do. Initial results are promising however, seeing as how I’ve got 3 more trees planted today than I had yesterday and it’s not even listed anywhere yet. Let’s hope things continue to go well there.

On a personal note, if you see this, thank you Jasmine. What you wrote was beautiful and showcases exactly the spirit of the Forest. Best to you and yours.

-Ed

Well, I’m going to call it ready to go live. www.forestoflove.com, the Forest of Love, is now open to the public. This is a project that I’ve been working feverishly on for the last couple of months, and it’s an idea I’ve had since the middle of last year. At that time I was involved with someone that I cared very deeply for, and even though it didn’t work out, this idea never would’ve become a reality without that person. If she ever reads this post, then I would like to say, in all sincerity, thank you for arousing in me the feelings that made a site like the Forest of Love possible.

In any case, the project presented a number of technical challenges in general, and for me personally. It’s the first real chance I’ve had to work with sessions, a user account system, and a real built-from-scratch relational database. The idea is pretty simple. A user can create an account, for free, and then create a ‘virtual tree carving’ for someone they love. That carving is then given its own page on the site under the premise of planting a tree in the Forest of Love. The user also has the option of announcing the event to friends, family, and their loved one in several different ways… e-mail, graphical website links, and even a sort of certificate, called a portrait, that creates a printable page with a picture of the tree and carving on it.

All of the things I’ve talked about in this blog for the last month or so has been culminating on that site… the bot blocker, sitemap generator, and captcha script are all used there, though they were tested here first. The whole idea, for me anyway, was to use all I had learned up to this point to create something that was totally custom and unique. There are perhaps three scripts running on that entire site that weren’t hand coded by myself from scratch, so it gives me a real sense of accomplishment to see the site up and running. It also gives me a real life example, both to myself and others, of what I can do as a webmaster, programmer, and graphic design artist. The only thing left to do is promote it, which isn’t as big of a deal on today’s internet as it was just a few years ago. Once I’m picked up by Google, which has already happend actually, then the page will filter throughout the ‘net pretty fast… though I’ll still submit the site manually to places like dmoz, free stuff sites, and other smaller directories.

The background used for the main page logo is a modified version of a background I made before I started work on the site, specifically for use there. Pretty soon I’ll put that image up on my gallery here for everyone to use and enjoy. Feels good to be putting an image up on my site again.

-Ed

Well, I think it’s just about done. That bad bot blocking script that I’ve been working on is almost ready to push out to the rest of my sites. What’s more, I’ve decided to write it in such a way that I can distribute it to other webmasters in the hope that we can block as many bad bots as possible.

Yeah, that’s my good deed for this month.

For more information, you can visit my CrawlSnare Page and read all about it. It isn’t ready for public consumption yet, but I think it will be within a few weeks. I’ve had it running on this site for a little over three weeks with only a few problems, which has helped me iron out the last few bugs, at least I hope.

It will be interesting to see what kind of issues other people have with it, if any. This is the first script I’ve written for public consumption, so I don’t have much experience with differing configuration files, different server setups, different versions of php, mySQL, and Apache, or even different file setups for things like .htaccess. Throw into that the different ways permissions are granted for file writing and creation and it should be interesting. Unfortunately I don’t have any way to test the scripts on other server configurations. I *think* everything should work ok on other servers, but I have no way of knowing.

All of the sites I own, or administrate, are on the same box. That means that all the settings are the same for every site, so if the script works on one it will work on all. That’s great for me, but maybe not for others. Time will tell. I’m sorry, by the way, if you happen to be someone who turns out to be a guinea pig.

As for my sitemap script, I think I’ve decided to buy one. Yes, I know. Why should I buy one when I can make one or find one for free? Well… it’s mostly because I found one somewhere that I really like (or think I will) and it’s not really very much to purchase a full license for it. It has a ton of features and would take me something like a month or more to code myself (given how much time I have to devote to personal coding during my day), so I figure I’ll just purchase it and go the lazy man’s route for this one. I’d put a link to the script up here, but I don’t want to promote the thing until I know I’ll like it for sure. Once I do, I’ll put a little review up here for public consumption.

Oh, and if you get banned from my website, quit acting like a robot.

-Ed

*Update for Feb, 2009 - CrawlSnare is currently in hibernation.  It is unknown to me if it will ever be completed.  If you’re really really interested in it and want the source code, please let me know and I’ll hand it over gladly for you to tinker with.  Unfortunately there were a few database access problems and too many bugs for me to work out… and I ran out of free time and interest.*

I was working in my website control panel today, going through fantastico looking for a script to do comments… something like a blog only not as huge, and I noticed that my blog software is out of date. I use b2evoloution for this blog, and that’s what showed up on the little update panel. The version numbers were pretty far off, which is to be expected since I haven’t updated this blog since I installed it (about a year and a half ago). Normally I wouldn’t update something that seems to be working ok, but I’ve been having tons of spam problems and the old version didn’t have a few of the options I really wanted in a blog. Anyway, I figured I’d try the update and see what happens.

So I click the little update button and BANG ZOOM! The blog is updated correctly, everything works and I can go about my day.

Riiiight.

Anyway, I click the little update button and it shows me the results… everything is updated and it should be good to go. I come back to check on my blog and all the colors have changed and the layout is different. I had forgotten that I customized my layout to match the look of my website. Oh well, no big problem, I’ll just upload the old version of my template page and it should take care of it.

Riiiight.

So I uploaded my old version and lo and behold it didn’t work. In fact, it didn’t work so spectacularly that I got a whole plethora of error messages. Luckily b2evo was smart enough to make a backup copy of all my old pages just before the problem happend. I also have a local copy on my machine at home, but it probably hasn’t been updated in a year or more because I haven’t made any changes to the site. So I get into the backup directory, unzip the backup files, replace the files on the server and everything is hunky dory!

Riiiight.

The new version of b2evo was so different than my old version that it totally changed the database structure too… so simply uploading old versions of the pages wasn’t going to work. OK, no problem. B2evo also made a backup copy of my database before it did it’s little hoodoo magic on my blog, so I have that to work from. Just load the backup file and overwrite the new version so it matches my old blog… which is currently back on the site.

Done.

Ok, so we’re right back where we started and now I can retry the update to get my new version of b2evo from scratch and do the styling right this time. I go into the control panel, check the fantastico page and b2evo is flashing update again. Good. So I click update. Everything works this time, I go update my stylesheets, the blog looks good, and I can go about my day.

Riiiight.

Uh oh… what’s this? That table already exists? This procedure cannot complete? Please refer to the help documents!? Now what? Well, it turns out that overwriting the tables with old data wasn’t enough. See, the new version of b2evo actually added tables to the database, and the backup script didn’t have that information. Running the backup script rolled the tables back to the previous version, but the NEW tables created by the update script still existed. When the update tried to run the second time, it threw an error because it didn’t expect those tables to be there. That error, in turn, broke the update… which broke my blog. Again.

Ok, so now what? Well, roll back the site pages again just like before. Done. Ok, no go and wipe the database clean… drop all the tables and start from scratch. What? There’s no command to do that? Drop * from database doesn’t work? Ok, so we do it all manually. Done. Now reload the database from the backup. Done. Back to square one… Again. Now go back into fantastico and click update. Done. Check out the blog… ugly. Upload the stylesheets ONLY this time. Done. Check out the blog… better. Still a few problems… oh yeah, don’t forget to add the header and footer, plus the extra stuff over on the side there that I can’t talk about because it’s against someone’s TOS. (Some of you might get that) Ok… good. Change back a few colors that were changed around for no good reason. Done. Check out blog… perfect.

And now ladies and gentlemen I give you a blog that looks exactly like it did before!

To be fair, it does have a fair bit more options and protection than the old version. I’m actually going to allow comments to the blog entries now… on a testing basis. If I get too much spam I’ll shut comments down in a hurry, but I’m cautiously optimistic.

Oh, and if you get a 503 Temporarily Unavailable page that’s just CrawlSnare misbehaving. I haven’t got all the bugs out of him yet, but once I do I think he’ll be one of the best anti-crawler scripts on the ‘net.

Well, back to ye olde website design grind I suppose. That other little project I alluded to in my last post is eating up a fair bit of my free time. It’s funny how things start to ‘pop up’ when you’re getting close to the end of a project. Little bugs and strange coding things somehow work their way into your project and you have to go through and do your best to wipe them out.

The real problem is that I’ve been away from it for so long that I forgot about some of the important backend things that every website should have… and nobody ever sees. So, because I always forget these things, and because I always dread writing them when I finally remember them… I’ve decided to code them in such a way that I’ll be able to just plug ‘em into any site I make in the future, as well as all the sites I currently have.

#1. The bad bot blocker / banner.
Very few people realize just how much traffic there is on the internet that isn’t human. It’s pathetic, scary, and a little demoralizing. If you’ll notice, on my blog I don’t allow comments, trackbacks, or any other user submitted content. Know why? It’s not because I don’t value your opinion. It’s because the only ‘visitors’ that ever commented on my blog entries were bots. Robots. Computer Programs. They crawl the web, looking for nice juicy ways of mucking everything up with no regard for anything but their master’s will or profit. They would come into this blog and write comments, with links of course, about how great viagra is, or how you can get cialis very cheap by clicking HERE. If I hadn’t put a comment block on there in the first place, you wouldn’t even be able to read this post for the number of bot comments there would be. It used to be that I would allow comments, but only after I approved them personally. When it was like that, I would get about 10-50 e-mails a day about comments being made to my blog. EVERY DAY, and the blog was only a month or two old. Out of all that, only one comment was legitimate. So, to get rid of the spam to my inbox I just disabled comments.

The bots still visit. Every day. They just can’t do anything.

I want to change that. So, I’m in the process of writing a script that will weed out bad bots, identify them, allow me to see when they come into my site and how often, and then BAN them from ever visiting my site again. Ahh… to be fresh again.

#2. The Captcha Script
This one is a beauty. It goes hand in hand with number one. Bots can be pretty smart, but they’re never going to be as smart as a human (well, we can hope). I’m sure you’ve probably seen a Captcha Script before and never even knew what it was all about.

A Captcha script creates a graphic with letters and numbers contained inside that is impossible (or very very hard) for a computer program to read, but usually pretty easy for a human to read. If you’ve ever signed up for something and had to “Enter the letters or numbers you see into the box then click submit,” you’ve used a Captcha script. Bots can’t read that. It’s extremely easy for a bot to read text like what I’m typing right now, but if I were to put it inside a graphic file… the only way to read that is visually. Bots don’t have eyes. This makes sure that whatever content is beyond the Captcha script is only being accessed by a human. I love Captcha scripts.

I looked all over the internet for one to do things just the way I wanted… and couldn’t find one. So, I wrote my own. I’ve used it a couple of times already, though I can’t give you a link to check it out just yet.

#3. Sitemap Script
As I’ve written before, search engines like Google and Yahoo are necessary evils. There’s just no getting around it, you need to be listed to get traffic. Google, and more recently Yahoo, MSN, and some of the other big search names, have started accepting SiteMaps from websites in order to facilitate better indexing. Basically a sitemap is a… well… map of a website. It lists all the files, directories, and structures as well as how often pages are updated and some other useful information about the site. Google et all then use this information as a basis for checking your site.

It makes things easier on them because now they don’t have to guess about your site structure… they can just go check it out. Anything that makes life for the Search Engines easier is good, at least when it concerns my websites, so a sitemap is a must. They are, however, a pain to create. Each engine wants them in a different format, XML, RSS, Text file, you name it. There are a plethora of tools out there to create and upload them to the search engine manually… but I want things automatic. Hands off. Plug it in and let it run. On and on, etc, etc. So, to that end, I’ll just write my own. That way I can have it run automagically once a day, create a sitemap file in several different formats, notify the search engines that my new sitemap is available, and go along on my merry way knowing that each and every day the search engines are being fed the latest and greatest information about my site. B-E-A-utiful.

I love automagic. All of these scripts, once written, will be zipped into a nice little care package that I can just throw into the root directory of my new site. There, with a bit of modification, they will blossom and do that voodoo that they do so well. Protecting me, promoting me, and allowing me to do more important things with my time than manually block bots or send updates to Google… like play golf.

-Ed