IO "Problem"?

I have a Linode that I'm running a vBulletin forum on with Sphinx Search installed.

When I turned the Sphinx back on, I started getting high IO, but it didn't appear to be negatively affecting my site. Still, I wanted to find the cause and see what I could do to lower it.

~~![](<URL url=)http://i42.tinypic.com/k9vtid.png" />

(The Swap spikes are during site backup and stuff, so that's fine.)

However, top and iotop show minimal usage of the server:

~~![](<URL url=)http://i44.tinypic.com/334i0pl.png" />

Is it something I should concern myself with, or should I just bump up my Notification Threshold?

EDIT:

It seems that when I took the screenshot, iotop DID start showing some activity… ^^; Before, it was all 0%. My bad, there.

Um, I guess… useless thread? Though I do want to know if I have to worry about high IO, as long as it's not going to swap.~~~~

3 Replies

I wouldn't worry too much about it, although that is rather high for a search thingy. Does it do that on each search, or just when it needs to update/rebuild its index? ("vmstat 1" will give you a quick one-line summary of everything each second, so you can have that up in a window while you prod things.)

Also, does this mean your vBulletin doesn't require MyISAM's blasted fulltext index? If so, I might have to look into that…

Yes, I believe that Sphinx does NOT use the FULLTEXT. The re-indexing takes place daily, but there's also some "delta" bit that gets run every ten minutes that has to do with it–that's where I assumed the IO was coming from, since it's steady throughout the day.

Sphinx is great for us--we've got about 5 million posts, and using the default Search with vBulletin gave us a lot of timeouts, rendered it almost useless. Most guides I read say that if you have such a large amount of posts, using Sphinx would probably be beneficial.

And thanks for the vmstat info--I will definitely use it while prodding.

Sphinx appears to be transparently scalable, and there seem to be vBulletin search modules that enable to to at least offload Sphinx onto a different machine than your application server pretty easily. So in the worst case, you can always spin off Sphinx onto a separate box.

Reply

Please enter an answer
Tips:

You can mention users to notify them: @username

You can use Markdown to format your question. For more examples see the Markdown Cheatsheet.

> I’m a blockquote.

I’m a blockquote.

[I'm a link] (https://www.google.com)

I'm a link

**I am bold** I am bold

*I am italicized* I am italicized

Community Code of Conduct