Survey Questions

This survey is conducted to analyse the current condition of the Github Copilot Code
Generation tool. The aim of this survey is to understand and propose improvements to the
code generation model of Github. The survey consists of questions to determine the code
quality - effectiveness, efficiency, security, understandibiity, and copyright.

This survey will take approximately 15 minutes to complete. (max 20mins)

LS - Likert Scale (1-5)

1. Personal Details
a. Name
b. Email address
c. Coding Experience

For the sake of the survey, the user is requested to develop a easy-medium complexity
piece of code, which the user is aware of. A basic functionality or a known code which the
user is already familiar with.

2. What are you trying to develop?

a. Name
b. functionality

3. Was Github Copilot able to generate the code you were trying to develop? Y/N/M
a. What did you input?

4. Is the generated code effective (completes the task it is created for)? LS

a. Is the code buggy?

5. Is the generated code efficient (does not waste space or life cycles of the machines)?
LS
a. Did it meet time/space complexity requirements? Y/N/M
b. Does the code perform any function which is not required? Y/N

6. Is the generated code secure (is not easy to crash)? LS

a. Are passwords hashed? (optional)
b. Are inputs validated?
c. Does the code catch errors and edge cases?

7. Does the code have all the necessary accreditation?

a. Who is it accredited to?
b. Is it correctly accredited? (optional)

8. Is the code understandable?

 a. Is the code well commented (looking for more amount of comments, not
excessive)? - adhoc
b. Is the code correctly commented (looking for accuracy of the comments)? -
adhoc

9. Are you satisfied with the end product? If not, why?

a. Looking for what a user can provide, which we completely overlooked. So this
is a subjective answer.

10. Does any change in phrasing the input changes the output?
a. What did you input?
b. Is it a better output? - write briefly
i. Effectiveness
ii. Efficiency
iii. Security
iv. Accreditation
v. Understandibility