How It Works: Step 2
Automated Data Collection at Scale
Once your configurations and data are in place, you can initiate a Batch Run. The platform takes your query set and systematically sends each query to every search configuration you've selected for the test. This is all done asynchronously in the background, allowing you to test thousands of queries without tying up your machine.
Fetching and Storing Results
For every query and configuration pair, TestMySearch retrieves the ranked list of search results (e.g., the top 50 documents) and stores it. This creates a comprehensive snapshot of your search engine's performance at a specific moment in time.
Automatic Metrics Calculation
As results are fetched, the platform immediately compares them against your provided Evaluation Set. It calculates dozens of Information Retrieval metrics for each query, providing instant, objective feedback on performance. You can even trigger recalculations at any time if you update your ground truth data.