Semantic Digital Libraries Evaluation - Results (Anna Karpinska/DSpace

)

25/01/2008 16:36

Semantic Digital Libraries Evaluation
Results of Anna Karpinska (DSpace) Pre-Evaluation Questionnaire
1. Your age < 20 21 - 25 26 - 30 31 - 35 36 - 40 > 40

2. Your education undergrad BSc MSc PhD Other

3. Main domain of education / research Informatics / Computer Science Electronics / Telecommunications Business / Marketing Fine Arts / Architecture Life Science / Social Science Bio-Chemistry Maths / Physics Other

4. How often do you visit the university library? (slide the X marks on the lines below) at least once a day at least once a week at least once a month more seldom

5. How often do you visit the university digital library? (slide the X marks on the lines below) at least once a day at least once a week at least once a month more seldom

http://localhost:8080/questionnaire/quest/complete?_u=niusianusia

Page 1 of 9

Semantic Digital Libraries Evaluation - Results (Anna Karpinska/DSpace)

25/01/2008 16:36

6. Do you know what social tagging is? Yes No

7. Do you use any online bookmarking system? (If yes - name up to 3 most often used.) Yes No

8. Are you subscribed to any online social networking site? (If yes - name up to 3 most often used.) Yes No

9. Have you ever come across the term “Web 2.0”? Do you know what it means? Yes No

10. Have you ever come across the term “Semantic Web”? Do you know what it means? Yes No

Questionnaire After the Initial Task
1. What is your general first impression about the system? (slide the X marks on the lines below ) hard to use easy to use

complex, mind boggling simple, clearly organized

hard to master, unintuitive

intuitive, straight forward

boring

interesting

http://localhost:8080/questionnaire/quest/complete?_u=niusianusia

Page 2 of 9

Semantic Digital Libraries Evaluation - Results (Anna Karpinska/DSpace)

25/01/2008 16:36

ugly, unattractive

attractive

useless

useful, handy

2. How did you find the task of registering to the digital library? (slide the X marks on the lines below ) hard to understand easy to understand

hard to execute

easy to execute

hard to master, unintuitive

intuitive, straight forward

3. How did you find the task of finding publications described with either of two given keywords: ''web services'' and ''semantic web''? (slide the X marks on the lines below) hard to understand easy to understand

hard to execute

easy to execute

hard to master, unintuitive

intuitive, straight forward

4. How did you find the task of finding ''publications about notitio.us'' ? (slide the X marks on the lines below) hard to understand easy to understand

hard to execute

easy to execute

hard to master, unintuitive

intuitive, straight forward

5. How did you find the task of bookmarking articles about notitio.us ? (slide the X marks on the lines below ) hard to understand easy to understand

http://localhost:8080/questionnaire/quest/complete?_u=niusianusia

Page 3 of 9

Semantic Digital Libraries Evaluation - Results (Anna Karpinska/DSpace)

25/01/2008 16:36

hard to execute

easy to execute

hard to master, unintuitive

intuitive, straight forward

6. Please describe how (using which system) did you bookmark articles about notitio.us. ( Please, provide a link to the bookmarking services if you used an online bookmarking solution, outside of the digital library.) I didn't

7. Do you have any comments to this part of the evaluation? No

First Task
Question: Which personality features are considered to be the factors increasing the usage of the Internet (and for which purposes)? (PL: Ktore cechy osobowosci uwaza sie czynniki zwiekszajace wykorzystywanie sieci internetowej (do jakich celow)?) Answer: Openness and Neurocism References: http://dspace.digime.name/bitstream/123456789/547/4/href/big%20five-osobowosc36099.pdf Comment: none

Evaluation Questionnaire after the First Task
1. How did you find the task of finding information in the digital library? (slide the X marks on the lines below) hard to understand easy to understand

http://localhost:8080/questionnaire/quest/complete?_u=niusianusia

Page 4 of 9

Semantic Digital Libraries Evaluation - Results (Anna Karpinska/DSpace)

25/01/2008 16:36

hard to execute

easy to execute

hard to master, unintuitive

intuitive, straight forward

2. How do you find search feature in the digital library? (slide the X marks on the lines below ) hard to use easy to use

complex, mind boggling simple, clearly organized

hard to master, unintuitive

intuitive, straight forward

boring

interesting

ugly, unattractive

attractive

useless

useful, handy

3. Do you have any comments to this part of the evaluation?

Second Task
Question: What (credibility) dimension are used to evaluate the credibility of the information on the Internet (used in the research)? (PL: Jakie skale/kryteria uzywane sa do oceny wiarygodnosci informacji Internetowej (wykorzystywane w badaniach)?) Answer: To evaluate credibility of the information on the Internet * believability * accuracy * trustworthiness * bias * completeness. "The Yale group defined credibility in terms of speaker's expertise (as web coprehesiveness of a Web information) and trustworthiness (as web site's integrality)" but also dynamism, composure and sociability. References:

http://localhost:8080/questionnaire/quest/complete?_u=niusianusia

Page 5 of 9

Semantic Digital Libraries Evaluation - Results (Anna Karpinska/DSpace)

25/01/2008 16:36

http://dspace.digime.name/bitstream/123456789/543/4/href/credibility-factors36177.pdf http://dspace.digime.name/handle/123456789/542 http://localhost:8080/jeromedl/resource/RKyRXPaE Comment:

Evaluation Questionnaire after the Second Task
1. How did you find the task of finding information in the digital library? (slide the X marks on the lines below) hard to understand easy to understand

hard to execute

easy to execute

hard to master, unintuitive

intuitive, straight forward

2. How do you find search feature in the digital library? (slide the X marks on the lines below ) hard to use easy to use

complex, mind boggling simple, clearly organized

hard to master, unintuitive

intuitive, straight forward

boring

interesting

ugly, unattractive

attractive

useless

useful, handy

3. Do you have any comments to this part of the evaluation? No

http://localhost:8080/questionnaire/quest/complete?_u=niusianusia

Page 6 of 9

Semantic Digital Libraries Evaluation - Results (Anna Karpinska/DSpace)

25/01/2008 16:36

Third Task
Question: Based on the results of the research, what is the credibility of the Internet and information delivered by it, compared to the credibility of other media sources? (PL: Jak oceniana jest, na podstawie wynikow badan, wiarygodnosc Internetu i informacji z niego pochodzacych w porownaniu z wiarygodnoscia innych mediow?) Answer: "Students in this study reported that they perceived the Internet to be moderately to somewhat credible (M=4.09, S.D.=0.82), although less credible than newspapers, television, and magazines. Compared to the nonstudent sample the students found all information channels to be more credible than did the nonstudents, as indicated by a significant between-subjects (student status) effect in a repeated-measures ANOVA." <> References: http://dspace.digime.name/bitstream/123456789/542/4/href/flanagin-%20ksiazka%20%20wiarygodnosc236204.pdf http://dspace.digime.name/bitstream/123456789/543/4/href/credibility-factors36177.pdf http://dspace.digime.name/bitstream/123456789/565/4/href/student%20web%20use%2b%20credibility36157.pdf Comment: It was easy to find articles, but difficult to find sth in it. To less time to right good essay about it.

Evaluation Questionnaire after the Third Task
1. How did you find the task of finding information in the digital library? (slide the X marks on the lines below) hard to understand easy to understand

hard to execute

easy to execute

hard to master, unintuitive

intuitive, straight forward

2. How do you find search feature in the digital library? (slide the X marks on the lines below ) hard to use easy to use

complex, mind boggling simple, clearly organized

http://localhost:8080/questionnaire/quest/complete?_u=niusianusia

Page 7 of 9

Semantic Digital Libraries Evaluation - Results (Anna Karpinska/DSpace)

25/01/2008 16:36

hard to master, unintuitive

intuitive, straight forward

boring

interesting

ugly, unattractive

attractive

useless

useful, handy

3. Do you have any comments to this part of the evaluation? no

Post-Evaluation Questionnaire
1. What is your overall impression about the DL library you used? (slide the X marks on the lines below ) hard to use easy to use

complex, mind boggling simple, clearly organized

hard to master, unintuitive

intuitive, straight forward

boring

interesting

ugly, unattractive

attractive

useless

useful, handy

2. “I think, I would perform better if only ...” (complete the sentence ) there was better funcionality of finding more information inside articles. It's easy to find sth connected to subject, but in most cases it don't help in find an answer I needed.

http://localhost:8080/questionnaire/quest/complete?_u=niusianusia

Page 8 of 9

Semantic Digital Libraries Evaluation - Results (Anna Karpinska/DSpace)

25/01/2008 16:36

3. Would you like to continue using this digital library (DSpace)? ( Say why ) Yes No I have a feeling that it will be easier to find an answer to that questions in google. I mean that their search engine is more "semantic" than Dspace. In this case I would prefer to get paper article than read it on the screen to find my answer.

4. Do you have any comments to this part of the evaluation? no

[Main Page]

http://localhost:8080/questionnaire/quest/complete?_u=niusianusia

Page 9 of 9

Semantic Digital Libraries Evaluation - Results (Anna Karpinska/DSpace)

02/03/2008 14:37

Semantic Digital Libraries Evaluation
Results of Anna Karpinska (DSpace) Memory Task
Question: What (credibility) dimension are used to evaluate the credibility of the information on the Internet (used in the research)? (PL: Jakie skale/kryteria uzywane sa do oceny wiarygodnosci informacji Internetowej (wykorzystywane w badaniach)?) Answer: I think there was 5 of them, but I'm not sure. I can't tell which References: Comment: After this time it is very difficult to answer any question

Evaluation Questionnaire after the Memory Task
1. How did you find the task of recalling previously learned information? (slide the X marks on the lines below) hard to understand easy to understand

hard to execute

easy to execute

hard to master, unintuitive

intuitive, straight forward

2. “I think, I would perform better if only ...” (complete the sentence )
There was more sematics in it. This time my search look like google search and it was not enough time to give a good answer.

http://q.digime.name/quest/complete?ismemory=true&_u=niusianusia

Page 1 of 2

Semantic Digital Libraries Evaluation - Results (Anna Karpinska/DSpace)

02/03/2008 14:37

3. Do you have any comments to this part of the evaluation?

[Main Page]

http://q.digime.name/quest/complete?ismemory=true&_u=niusianusia

Page 2 of 2