Good point, John.
Perhaps I should rethink or reword that. But psrts of the idea might work - I mean we all put a copyright at the bottom of our pages now anyway. I way thinking of it more as a value to legitimate spiders and site owners...
I dont think a Robots.txt will change a thing about ownership or infringement in some senses, but this or another strategy could help you control what legitimate aggregator take from you. Or even pay back to you...
The whole content ownership issue is a mess and will continue to make and break companies large and small for the foreseeable future, IMHO. God knows where it is leading
Two anecdotes to demonstrate:
1) Music downloads were not really hurting album sales when they were illegal, dispite industry complaints and valid concerns. However, not that iMusic et al have legalized and monetized the practice, music execs are scrambling again, because now album sales really are down - at least 10% last number I saw.
2) Windows Theme creators a few years ago were complaining that the precursors to scrappers were stealing and repackaging their content. Valid concern, except that the content they claimed ownership on was mostly images and music clips that they did not own to begin with...
-Jeff