Testing and Evaluation ofTel@CLEF

Realizatori: Bujdei Alexandru Ionut Petrov Alexia Ioana Florea Adriana Badita AndreeaGrupa: 2BAn: 21. Description

A project wishes to offer users a web-based application that would allow them to search 50 topics for 3 different languages and to return the most relevant documents from within those collections of information as library files. The languages put at the disposal of users are (en, fr, de).

2. Areas

The scenarios for testing and evaluation of the application`s efficiency along with the relevance of the returned data will be described.

3. Shareholders/Interests

The user: provides a list of topics which he wishes to be searched in the available libraries.The application: It returns relevant information in a minimum time, along with the duration of the search time for that specific list of topics.In this scenario, only the user is a real person.

4. Actors and Objectives

The user: To provide diversified topics, and in as many languages as possible (from the available ones) in order to enlarge the search area.The application: To return relevant data in the shortest possible time.

5. Use-case scenarios.

The next two cases describe two ways of testing and implicitly evaluating the output data.

5.1 Testing the relevance and fairness.5.1.1 Objective/ContextThe application supplies to the user relevant information found in the libraries available during the time of the search.

5.1.2 Steps Different users suggest some lists of topics. These lists must implement difficult searching scenarios to the application. The application realizes the search and retrieves the information. A series of users analyze the output data and decide whether or not the data has any correlation with the search topics. 5.1.3 Extensions If one of the queries didnt generate any result one user may suggest another search or can modify the initial search. 5.2 Testing the necessary medium time for the application to supply dates 5.2.1 Context/Objectives The application must supply to the user the documents in acceptable time period. 5.2.2 StepsDifferent users suggest some lists of topics. These lists must implement difficult searching scenarios and a large search area .For each search the application generates also the searching duration. When the searches are finished it is calculated a medium of the time in which the dates are being resulted.The users decide if this value is low enough or not.Also they can do a study about the duration for each list that has been searched in this application and can decide whether the program needs optimization.

5.2.3 Extensions If one of the searches has generated a very high value, the look-up is being reinitialized to see whether the problem is caused by the application or not.