Software to Search within Website

Zilla,

Sorry I am not exactly sure what are you looking for here. If you are looking at just finding keywords on a web page then most browsers will have a find function in built for example CTRL + F.

If this not what you are looking for please can you provide a little more information on what you are trying to achieve.

Thank you,

Harry

Harrylowt said:

Zilla,

Sorry I am not exactly sure what are you looking for here. If you are looking at just finding keywords on a web page then most browsers will have a find function in built for example CTRL + F.

If this not what you are looking for please can you provide a little more information on what you are trying to achieve.

Thank you,

Harry

Click to expand...

A program that can crawl a website & search with a user provided keyword. I found a program "A1 Website Analyzer". Any similar programs? Thanks!

Most search boxes in the web sites themselves just use a search engine like Google and tack on the "site:" param. Like to search LoveHKFilm.com you would type this is google
keyword site:lovehkfilm.com. A concrete example:
Shu Qi site:lovehkfilm.com

Most engines support that syntax. DuckDuckGo will work with the same search line.

MilesAhead said:

Most search boxes in the web sites themselves just use a search engine like Google and tack on the "site:" param. Like to search LoveHKFilm.com you would type this is google
keyword site:lovehkfilm.com. A concrete example:
Shu Qi site:lovehkfilm.com

Most engines support that syntax. DuckDuckGo will work with the same search line.

Click to expand...

I am aware of all this. There are many websites that do not have inbuilt search functionality & search engines like Google do not show any result with the syntax: keyword site:www.site.com

I am looking for alternate software programs that can crawl websites & search. Thanks!

Try it without the www.

MilesAhead said:

Try it without the www.

Click to expand...

Still does not work.

Can you give an example? This search string finds this thread for example when put into Google.

site:www.eightforums.com "Software to search within Website"

adamf said:

Can you give an example? This search string finds this thread for example when put into Google.

site:www.eightforums.com "Software to search within Website"

Click to expand...

Example: I am trying to search for all the posts with the name "David" on the website: vnltue.blogspot.in using the following Google syntax: David site:vnltue.blogspot.in but do not get any results. This is an open site (no need to login).

There are actually many posts on the website with the title that includes "David". For example: vnltue.blogspot.in/2011/04/new-agenative-american-flute-david.html

Looks like they have disabled google indexing. Look at http://vnltue.blogspot.in/robots.txt

I don't know how to answer your question though I'm afraid, sorry.

adamf said:

Looks like they have disabled google indexing. Look at http://vnltue.blogspot.in/robots.txt

I don't know how to answer your question though I'm afraid, sorry.

Click to expand...

Now, we again arrive at the original question. There are many website analyzers / extractors / crawlers etc out there. I am looking for a simple way of searching within a website. The user should enter the URL & the keyword & the program should crawl the domain & display the results. Thanks!

Anyone?

If the site has the flags/files used to disable crawling, any legitimate software will bypass scanning the system... whether that system is Google, or your Windows client.

To violate the system owners' rights to manage their systems and data as they wish, you would possibly be faced with civil litigation, or criminal prosecution.

There may be web sites with software available to do what you want, but be sure your virus and malware protection is up to date before you visit those sites.

You could download the whole site, then search it locally. Google will help you find a web site downloader.