 |
|
|
Yes, one way or another! Paying accounts now support https
indexing, so if you have a PicoSearch Professional or Premium account
then those secure links should be automatically followed (providing they
are within an Entry Point, see the Link-Following Restrictions in your
account manager).
PicoSearch Free accounts cannot follow https
secure links, but with a trick this and other unreachable content can
still be searched (if your password protection is stopping PicoSearch
then this trick may also be helpful). In cases where PicoSearch can't
get in through the front door, if you can get PicoSearch in by any
backdoor then you can apply the Auto Redirection entry box in the URL
Adjustments section. By remapping the URLs with Auto Redirections, you
can change every page in your index to point to the correct user
experience. So with SSL for example, any user of your search engine
will find SSL when they click on a search result, and they'll never know
that PicoSearch got in as a special case.
Here are some ideas for backdoors or work-arounds that can get PicoSearch's crawler into tricky situations:
- Make a mirror site that no one but PicoSearch has to know about,
then PicoSearch can index that mirror. Set Auto Redirections to point to
the normal site. The mirror can use PicoSearch-compatible HTTP
password protection for maximum security.
- Register PicoSearch's robot or IP addresses with your server to let it in without protections. Contact us for the IP ranges that cover PicoSearch. Set the Auto Redirections if there are any URL differences for this to work.
- If your traffic is low or users can be temporarily rerouted, simply
turn off protections just long enough for PicoSearch to crawl the
crucial directory, then restore normal behavior. Set the Auto
Redirections if there are any URL differences for this to work.
- Or as a last resort, you might reconsider the use of SSL entirely and switch to a password protection system, which is more compatible for PicoSearch.
|
|
 |
|
|
