ILS Benchmarks?
|
|
By ksclarke, Section Ask Anything Posted on Fri Jul 11th, 2003 at 06:45:59 AM EST
|
 |
I wonder if anyone is aware of a set of tests for catalogs that would test their response times on a range of possible queries (from simple author or title searches to more complex multi-field testing). While these tests would only cover known item searches, it would be interesting, for instance, to see how well one library catalog performs when compared to another with the same record set. One might want to load up one of the open source ILSes with the same set of records s/he has in the local proprietary database, for instance, and compare the results.
|
I realize a lot would depend on the type of indexes created by both. An effort should be made to make sure they are the same but, if they aren't, it would be interesting to learn one of the ILS choices could not create an index to make available a particular type of search. I guess what I'm curious about is the range of search possibilities that a patron might want to use. Such a tool might also be a (small) factor in considering which ILS to purchase.
As to how it would do the query I do not know... would it use the ILS' Web interface, or JDBC, or Z39.50?
Anyone know of any such thing? A possible query collection would be good, but software that does this would be even better. I would expect software to make multiple attempts at each query to try to remove random blips that might slow down the retrieval.
Hmmm, maybe query sets would also need to be domain specific? I haven't given this a lot of thought, just wanted to throw it out there...
Not even sure such a thing really would produce information that was useful in comparing different systems (maybe there are too many variables since there is no standard way to access a library catalog)... just thinking such a comparison would be nice...
FWIW,
Kevin |
|
|