controlling what gets indexed and how it's handled

For posting comments and suggestions about the abcnotation.com website
Jack Campin
Posts: 9
Joined: Tue Jul 07, 2009 1:54 am
Contact:

controlling what gets indexed and how it's handled

Postby Jack Campin » Fri Dec 31, 2010 11:10 pm

I just found one of my tunes here, by a Google search on its title. Clicking on Google's link got it displayed.

That wasn't what I wanted to happen, for two reasons.

One is that this site indexed only a legacy version - in my file http://www.campin.me.uk/Music/Modes.abc , which is long superseded by a version split into many linked files, at http://www.campin.me.uk/Music/Modes/ . There is a lot more stuff in the newer version and it's better edited. How come it hasn't been noticed?

The other problem is that the tune was displayed in isolation. I'm happy with that for much of my stuff, but for others (the modes stuff included) I want people to see the tunes in context, and ONLY in context. When John Chambers's tune finder was the only game in town I could do that - if you set the X field to zero, his software will (or at least used to) download only the complete file the tune occurs in. So for some of my files, every tune has X:0. They're that way for a reason.

This site does not make the same distinction between what it indexes and what it will display.

How about it?

(I am just about to delete the older file; I hope that kills the version here).

cwalshaw
Site Admin
Posts: 63
Joined: Wed Jun 10, 2009 11:50 am

Re: controlling what gets indexed and how it's handled

Postby cwalshaw » Sat Jan 01, 2011 7:59 pm

Hi Jack,

Sorry if that's not what you wanted.

In fact the new version has been noticed - if you do a site search for "site:www.campin.me.uk/Music/Modes/Modes-" it will pick up the new version - see http://abcnotation.com/searchTunes?q=site:www.campin.me.uk/Music/Modes/Modes-&f=c&o=a&s=0.

Deleting the old version will stop it being indexed, on abcnotation.com at least (though I'm not sure that's true for all of the abc search engines). In the normal run of things it could take a month or so for the indexing here to catch up, but if you tell me when the file has been deleted I can rerun it at any time and make sure it's removed from my indexes.

If you would also like me to remove the new version just let me know. Alternatively you can do this via a robots.txt file - see http://abcnotation.com/searchHelp#robots

Seasons greetings,

Chris

cwalshaw
Site Admin
Posts: 63
Joined: Wed Jun 10, 2009 11:50 am

Re: controlling what gets indexed and how it's handled

Postby cwalshaw » Sun Jan 09, 2011 7:05 pm

Hi Jack,

I haven't heard back from you so I've removed both versions from the tune search.

Now if you try a site search for "site:www.campin.me.uk/Music/Modes" nothing is returned - see http://abcnotation.com/searchTunes?q=site:www.campin.me.uk/Music/Modes&f=c&o=a&s=0

Hope that helps,

Chris


Return to “Website”

Who is online

Users browsing this forum: No registered users and 1 guest

cron