InstantASP Community Forums
Home       Members    Calendar    Who's On
Welcome Guest ( Login | Register )
        



Weighted search results?? Expand / Collapse
Author
Message
Posted 08/08/2008 22:25:40
Junior Member

Junior MemberJunior MemberJunior MemberJunior MemberJunior MemberJunior MemberJunior MemberJunior Member

Group: Forum Members
Last Login: 02/12/2008 13:00:21
Posts: 26, Visits: 57
The search engine as it is now is a bit limiting because it does not rank the results based on a score related to the number of "hits" in the search.

I think it should be a standard feature to do this. If I do a search that returns hundreds of articles for a key word search, I want the article(s) that has the most occurrences of the search term shown first, not 10 pages deep because it was the first article entered into the database.

This only makes sense and since everyone uses a search engine on the web, their expectations is that the search will be a little more intelligent than just returning articles sorted by date and or title. Sorry, but Google has spoiled us.

Please advise when you can make the search engine more functional when you have thousands of articles to search through. As it is now, I am getting daily complaints from my users (there are several thousand of them world wide) that it is hard to find what they are searching for with the current limited display options.

Respectfully yours,
Tim
Post #14131
Posted 18/08/2008 18:31:32


IF.NET 4.2 Coming Soon

IF.NET 4.2 Coming SoonIF.NET 4.2 Coming SoonIF.NET 4.2 Coming SoonIF.NET 4.2 Coming SoonIF.NET 4.2 Coming SoonIF.NET 4.2 Coming SoonIF.NET 4.2 Coming SoonIF.NET 4.2 Coming Soon

Group: Administrators
Last Login: 05/01/2009 11:53:33
Posts: 1,959, Visits: 3,027
Hi Timbo,

Hope your very well. Many thanks for your feedback.

We do support sorting of results by relevancy however this option does require the Full-Text option to be enabled...

http://kb.instantasp.co.uk/Documentation/Setting-up-full-text-search-within-InstantKB.NET

If you search our own knowledgebase here for say the term InstantKB.NET you'll see this in action.

I appreciate your comments with regard to providing this as a standard feature however i doubt that would be possible. To provide this type of functionality some configuration would be required to setup a index or catalog.

You would need to maintain a scheduled catalog / index as to pre-calculate an articles weighting based on the number of times certain keywords appears within it's body .I would not even consider calculating these weights in real-time as this would result in very poor search performance.

To create such an index / catalog would require scheduling & fairly long executing SQL queries. ASP.NET does not lend it's self well to scheduling or running long SQL queries.

The only approach i can see working to provide this ability outside of SQL Server would be to provide a Windows Service you run either on the web server or database server to maintain a local file based index. Again even this would require some form of configuration. This is something we have given some thought and may develop in the future.

We opted to use the SQL Server full-text service to provide this functionality as it's a familiar feature to most dba's & .NEt developers. It's also a service most 3rd party hosting providers support. Of course you also get the reliability, performance & scheduling required through SQL Server. With SQL Server 2005 and IFilters it also makes the search extensible with the ability to search various file types that are attached to articles. I appreciate not everyone can use full-text and we have look at alternatives however all would require configuration for a index / catalog.

Our search engine with full-text search enabled will offer the weighting and performance you require with hundreds of thousands of articles. If you have more than 1,000 articles i would strongly suggest you look at enabling full-text. You'll get much better performance and also results will be weighted & sorted by relevancy as you require.

I hope this offers a little insight as to why weighting is not provided out-the-box.  If the option is available to you i would suggest speaking with your host to see if they can't enable SQL Server full-text for your database.


Kindest Regards,

Ryan Healey
Director / Developer

Explore our products...
http://demos.instantasp.co.uk/

Post #14151
Posted 21/08/2008 04:06:06
Junior Member

Junior MemberJunior MemberJunior MemberJunior MemberJunior MemberJunior MemberJunior MemberJunior Member

Group: Forum Members
Last Login: 02/12/2008 13:00:21
Posts: 26, Visits: 57
Thanks for the detailed explanation. I will turn on full-text searching and see how that works.
Post #14156
Posted 22/08/2008 03:39:04
Junior Member

Junior MemberJunior MemberJunior MemberJunior MemberJunior MemberJunior MemberJunior MemberJunior Member

Group: Forum Members
Last Login: 02/12/2008 13:00:21
Posts: 26, Visits: 57
Weighted searches is now working.

I am still have problems with the exact match search (see my other post about this)
Post #14163
Posted 24/08/2008 20:03:58
Junior Member

Junior MemberJunior MemberJunior MemberJunior MemberJunior MemberJunior MemberJunior MemberJunior Member

Group: Forum Members
Last Login: 02/12/2008 13:00:21
Posts: 26, Visits: 57
Weighted search results is working wonderfully now. Thanks.
Post #14165
« Prev Topic | Next Topic »


Reading This Topic Expand / Collapse
Active Users: 0 (0 guests, 0 members, 0 anonymous members)
No members currently viewing this topic.
Forum Moderators: Ryan Healey

Permissions Expand / Collapse

All times are GMT, Time now is 12:37am

Powered by InstantForum.NET v4.1.4 © 2009
Execution: 0.047. 10 queries. Compression Disabled.
Home | Products | Purchase | Support | Company | Contact Us
Privacy Statement | © 1999-2007 InstantASP Limited. All Rights Reserved.