How does search work?

Aug 8, 2022 at 6:07pm

I tried to search for a recent post of mine and I couldn't find it.

Do you periodically build a search index of some sort that serves as the basis for the search?

Or does a search request go against the raw post data?

If the former, it looks like maybe the search index hasn't been rebuilt in some time.

If the latter, then I'm confused why my search is not working.

Indexing is run overnight around 3am-4am - it's really taxing on the server.  I think it's running every other day or 3 nights.  I may try and rund it  nightly - need to check the cron.

For many years - we've used sphinx for this - if anyone knows of a better alternative- let me know.  Also, one that is free.  grin


I'm not familiar with sphinx or similar products.

I guess the indexing process re-indexes the entire database (or whatever tables are involved). Is there any way to fine tune it so that it only indexes data based on a date, simply adding to the search index, rather than rebuilding from scratch?


Poking around, I came across something called elasticsearch. Have you looked into that?


drummerboy said:

Poking around, I came across something called elasticsearch. Have you looked into that?

I haven't - looks like it starts around $95 a month.  And primarily uses cloud data storage.   Also, we're using mysql - for that it mainly handles logs and metrics.


Okay this thread title is funny given today’s news. 


Search seems to be down?


just wondering what the current schedule is for rebuilding the search index. was looking for a recent post (maybe from yesterday?) but can't find it.


I noticed some weirdness with it just now -- did a search for a single word and got back the earliest post in 2023, but I knew had an an earlier post than that. Did it with two words, and found the post I was looking for, from 2022.


drummerboy said:

just wondering what the current schedule is for rebuilding the search index. was looking for a recent post (maybe from yesterday?) but can't find it.

I have to check the cron - search gets indexed at night.  It may have skipped a night.  Another item that's very taxing on the current server.  My guys should be getting back on schedule tomorrow with the upgrade - it has taking much longer than anticipated.


ok. I was wondering about the upgrade. Didn't realize it hadn't been completed.


Just thought Jamie and team should know:  while I was using Search just now, that issue of the ads string floating over the text reappeared. 

iPad Air 2, iOS 18.4


Hey @jamie! Forum search doesn't seem to be pulling up anything at the moment.


ugh - sorry up now.  I have to do a reboot from time to time and I always forget to restart this.

We still have an issue by search a specific year - it's on my developer's radar.


Having a hard time with Forum search again. 

Edited to add, Search itself works, but we still can't search by year - when we try that it comes up with nothing.


ridski said:

Having a hard time with Forum search again. 

Edited to add, Search itself works, but we still can't search by year - when we try that it comes up with nothing.

yes read my previous post.😀


jamie said:

ugh - sorry up now.  I have to do a reboot from time to time and I always forget to restart this.

We still have an issue by search a specific year - it's on my developer's radar.

you forget to restart it?

there's this thing called autoexec.bat....

cheese smile



In order to add a comment – you must Join this community – Click here to do so.

Rentals

Sponsored Business

Find Business