INTRO:

Hello, may I please speak to {INSERT FIRST NAME}?

PRETEST INTRODUCTION

Hello, my name is ______, and I'm calling on behalf of the National Academy of Sciences in Washington, DC. The Academy is conducting an assessment of some National Institutes of Health research training programs. You have been selected to help us out in testing the questionnaire because of your research experience in {YEAR} at {INSTITUTION}. We are interested in hearing your responses and assessing the flow of the questionnaire. We would really appreciate your help. The call should take less than 30 minutes. Before we begin, I would like to assure you that everything we talk about will be confidential. Your answers will only be used for evaluating the questions I will ask you, and they will never be reported in a way that can be linked back to you. Keep in mind, you may refuse to answer any question. You should also know that this call is being recorded for evaluation purposes.

INTRODUCTION

Hello, my name is ______, and I'm calling on behalf of the National Academy of Sciences in Washington, DC. The Academy is conducting an assessment of some National Institutes of Health research training programs. Recently, you received a letter inviting you to participate in a telephone interview to discuss your {ACADEMIC LEVEL} research experience in {YEAR}. The interview should take between 20 and 25 minutes. Is this a good time for you? Before we begin, I would like to assure you that everything we talk about is confidential. Your answers will only be reported in the aggregate, and will never be reported in a way that they can be linked back to you. They will only be disclosed to the researchers involved in this project, except as otherwise required by law. You may also refuse to answer any question. You should also know that this call may be monitored for the purposes of quality assurance.

Q2a SCREENER:

Because participants in this study were randomly selected, I need to confirm that you are the appropriate person to be answering these questions. Could you please tell me the last four digits of your Social Security number?

[IF NECESSARY: I only need the last four digits of your Social Security number, not the entire number. I am not able to see your social security number. My computer will compare the information you provide with the information we have on the selected study participants.]

Q2a2 SSN: __ __ ___ ___

(Q2oops) /IF NO MATCH, REFUSED, DON'T KNOW GOTO GOOD-BYE/

Great, we have a match. Let's begin the interview by talking about when your research was supported by {PROGRAM} at {INSTITUTION} in {YEAR}.

A.1 How did you hear about the {PROGRAM}? I'm going to read a list of ways you might have learned about the {PROGRAM}, please tell me all that apply to you.

[INTERVIEWER NOTE: READ LIST]

A. Trainee Awareness and Expectations

ga.1a Did you hear about it from an undergraduate professor?

ga.1b Did you hear about it from an undergraduate academic counselor?

ga.1c Did you hear about it from your graduate advisor?

ga.1d Did you hear about it from departmental staff?

ga.1e Did you hear about it from a faculty colleague or peer?

ga.1f Did you hear about it from a close personal friend?

ga.1g Did you hear about it from a notice on a bulletin board?

ga.1h Did you hear about it from a scientific journal?

ga.1i Did you hear about it from the Internet?

ga.1j Or did you learn about it by some other means?

/IF A.1 = 95 THEN ASK A.1.O, ELSE GOTO A.2/

ga1o How did you learned about the {PROGRAM}?

ga1how /TEXT LENGTH = 270/ ENTER RESPONSE: _____________________

ga2 At the time your research was supported by the {PROGRAM} at {INSTITUTION}, what was the highest degree you hoped to earn?

[INTERVIEWER NOTE: IF NECESSARY READ LIST]

/IF A.2 = 95 ASK A.2.O ELSE CONTINUE/

ga2o What was the highest degree you hoped to earn?

ga2what /TEXT LENGTH = 270/ RESPONSE: _______________________

ga4_1-ga4_13 When you were at {INSTITUTION} in {YEAR}, what were your career goals? I am going to read you a list of possibilities, please tell me all of the career goals that you had at that time. Were they:

[INTERVIEWER NOTE: READ LIST. SELECT ALL THAT APPLY]

/MUL = 8/

/IF A.4 = 95 ASK A.4.O ELSE CONTINUE/

g4ao Please tell me what other career goals you had at that time?

ga4what /TEXT LENGTH = 270/ RESPONSE: _______________________

ga5 During the time of your {PROGRAM} at {INSTITUTION} what did you see as the immediate next step in your career path? I am going to read you a list of options. Please choose one. Did you see your next step as …

[INTERVIEWER NOTE: PLEASE READ LIST]

/IF A.5 = 95 ASK A.5.O ELSE CONTINUE/

ga5o Please tell me what you saw as the immediate next step?

ga5what /TEXT LENGTH = 270/ RESPONSE: _______________________

ga6_1-ga6_8 What did you expect to gain from your {PROGRAM}program? I'm going to read a list of expectations, please tell me all the ones that applied to you at that time. Did you expect:

[INTERVIEWER NOTE: READ LIST. SELECT ALL THAT APPLY]

/MUL = 9/

/SET VARIABLE EXPECTATIONS = number of responses provided in A.6/

ga7 Did you have any other expectations that I didn't mention?

/IF A.7 = 01 ASK A.7.O ELSE CONTINUE/

A.7.O What were they?

[INTERVIEWER NOTE: Respondent may provide up to 3 other expectations.]

ga7b1 01 /TEXT LENGTH = 70/ RESPONSE: _______________

ga7b2 02 /TEXT LENGTH = 70/ RESPONSE: ________________

ga7b3 03 /TEXT LENGTH = 70/ RESPONSE: ________________

/UPDATE VARIABLE EXPECTATIONS = number responses A.7 + A.7.O/

ga8_01-ga8_11. I am going to read you a list of expectations that you just mentioned you had for the {PROGRAM}. Please tell me which ones were not met.

/RECALL EXPECTATIONS FROM A.6 AND A.7.O, RANGE 1-10, LOOP BASED ON NUMBER OF EXPECTATIONS/

/START LOOP/

Was {RECALL {EXPECTATION X}} met?

/WHEN LOOP # = #EXPECTATIONS, END LOOP/

ga8a_1 Could you tell me how or in what ways the{PROGRAM} did not meet your expectations?

GA8a /LENGTH = 240 CHAR/ RESPONSE: ____________________________

B. Work and Finances

B.1 Switching gears, I would like to talk about sources of financial support.

gb2. During the time you received {PROGRAM}, did you have any additional sources of financial support?

gb3a_1-gb3a_9. I am going to read a list of other funding sources you may have had while receiving {PROGRAM} in {YEAR}. Please tell me all that applied to your situation. Did you also have:

/MUL = 9/

[PLEASE READ. SELECT ALL THAT APPLY]

/IF B.3.a = 95 ASK B.3.a.O ELSE CONTINUE/

gb3ao From what other source, or sources, did you receive support?

gb3awhat RESPONSE/TEXT 70/: __________________________________

gb3b_1-gb3b_9 Now I would like you to think about your graduate years, as a whole. I am going to read the same list of funding sources. Please tell me all the funding sources you used during graduate school. Did you have:

/MUL = 9/

/IF B.3.b = 95 ASK B.3.a.O ELSE CONTINUE/

gb3bo From what other source, or sources, did you receive support during your graduate school years?

gb3bwhat RESPONSE/TEXT 270/: _____________________________________

gb4a What is your current status, with respect to {INSTITUTION}? I am going to read you a list of possibilities, please stop me when I reach the one that best describes your current status with respect to {INSTITUTION}.

[INTERVIEWR NOTE: PLEASE READ LIST, STOP WHEN RESPONDENTS PICKS]

/IF B.4a = 95 THEN ASK, ELSE CONTINUE/

gb4a0 How would you describe your current status with respect to {INSTITUTION}?

gb4ahow RESPONSE/TEXT 270/: __________________________________

/IF B.4a = 02 or 06 ASK B.4a.O ELSE CONTINUE/

gb4a1 Tell me briefly, the reasons why you left without getting a degree?

gb4awhy /TEXT LENGTH = 270/ RESPONSE: _______________________

/IF B.4a = 04 or 08 ASK, ELSE CONTINUE/

gb4b_1-gb4b_5 What did you do after completing your Ph.D.? I am going to read you a list of possibilities, please tell me, please tell me which one, or ones, applies to you: Did you---

[INTERVIEWER NOTE: PLEASE READ LIST]

/MUL = 5/

gb5 Since your participation in the {PROGRAM}, have you been awarded any research grants on which you were the principal investigator?

gb5a1 How many research grants have you been awarded as principal investigator?

gb5a RANGE {1-500}______________ NUMBER

gb6 Since your participation in the {PROGRAM}, have you been the first or senior author on any published research papers?

gb6a1 How many research papers have you been the first or senior author?

gb6a RANGE {1-500}______________ NUMBER

D. Research and Laboratory Experience

D.1 During the time you received the {PROGRAM}, how many people were in your principal investigator's, or PI's, research group?

[INTERVIEWER NOTE: A principle investigator (or PI) is the head of the lab or research group].

[INTERVIEWER PROBE: That is, on a typical day when the lab or office was full, about how many people worked there? IF NECESSARY: Your best guess is fine.]

/RANGE 1-50 / NUMBER: ______________

d2 How many of the people in your PI's research group were underrepresented minorities?

[INTERVIEWER NOTE: Underrepresented Minorities include: African Americans, Hispanics, Native Americans, Pacific Islanders]

/RANGE 1-50 / NUMBER: ______________

E. Mentor Demographics

E.2 While you were in the {PROGRAM}, was there someone who took a personal interest in and was supportive of, your research or career?

/IF E.2 = 01 THEN READ PRE.E3;/

PRE. E.3 For the purposes of the following questions, I am going to refer to this person who took an interest in and was supportive of your research career as a "mentor"

e3a Was your mentor male or female?

[INTERVIEWER NOTE: IF THERE IS MORE THAN ONE, ASK THEM TO PICK THE ONE THAT WAS MOST INFLUENTIAL AT THE TIME.]

e4a Was your mentor Spanish, Hispanic, or Latino?

[DO NOT READ CATEGORIES]

[INTERVIEWER NOTE: PLEASE READ MAJOR CATEGORIES HEADINGS ONLY]

/MUL = 6/

[MULTIPLE RESPONSES ALLOWED]

/IF E5a_1-E5a_6 = 06 ASK, ELSE GOTO F.1/

e5ao OTHER TEXT: _________________________________

F. Principal Investigator -- Demographics

f1 Now, I would like to ask you about your PRINCIPAL INVESTIGATOR or PI, at the time you received the{PROGRAM}.

/IF E.2 = 01 ASK ELSE GOTO F.3/

f2 Were your mentor and Principal Investigator the same person?

f3 Was your PI male or female?

f4 Was your PI Spanish, Hispanic, or Latino?

[DO NOT READ CATEGORIES]

f5_1-f5_6 What was your PI's race or ethnicity? Would you say …

[INTERVIEWER NOTE: PLEASE READ MAJOR CATEGORIES HEADINGS ONLY]

/MUL = 6/

[MULTIPLE RESPONSES ALLOWED]

f5_o OTHER TEXT: _________________________________

G. Mentoring Experiences

G.1 Now, I would like to talk more about your PI, and what it was like to work with him or her?

g2 During the time of your {PROGRAM} award, how much encouragement for your research did your PI provide? On a scale of 1 to 5, where one represents abundant encouragement, and 5 represents no encouragement at all; please tell me where you would place your PI.

[INTERVIEWER NOTE: if respondent worked in more than one lab or research group during the time of their award, the response to this question should refer to the last lab or research group that the respondent spent the most time in, while the award was still active.]

g3 Would you say that your PI was not good to work with, or was good to work with? On a scale of 1 to 5, where one represents very good to work with, and 5 represents not good to work with at all, please tell me how you would rate your PI?

G4) How active was your PI in the scientific community? That is to say did your PI publish research papers, present research at national conferences, win research grants, and so forth. On a scale from 1 to 5, where 1 represents very active in the scientific community and 5 represents not active at all, how would you describe your PI?

g5 During the time of your {PROGRAM} award, how much assistance did your PI provide, in terms of helping you take the next step in your education or career path? Again, on a scale from 1 to 5, where 1 represents your PI provided a lot of assistance and 5 represents your PI provided no assistance at all, how would you rate your PI?

g6 How helpful would you say your PI was in helping you obtain grants, scholarships, fellowships, or other types of awards to support your research training? On a scale from 1 to 5, where 1 represents very helpful in securing funding and 5 represents not helpful at all, how would you rate your PI?

g7 In general, would you say that your PI gave mostly good career advice or mostly poor career advice? On a scale from 1 to 5, where 1 represents giving really good advice and 5 represents giving very poor advice, how would you rate your PI?

H. Relationships

H.1 Now, I want you to try and think about different groups of people you may have interacted with while you were supported, by the {PROGRAM} at {INSTITUTION}.

h2a How frequently did you discuss your research with your PI? Did you discuss your research….

[INTERVIEWER: PLEASE READ THE LIST UNTIL THE RESPONDENT ANSWERS]

h2b How frequently did you discuss your research with other people in your lab or research group? Would you say you discussed your research with them….

[INTERVIEWER NOTE: PLEASE READ THE LIST UNTIL THE RESPONDENT ANSWERS]

h2c How frequently did you discuss your research with other research colleagues at {INSTITUTION}? Would you say you discussed your research with them….

[INTERVIEWER NOTE: PLEASE READ THE LIST UNTIL THE RESPONDENT ANSWERS]

h3a Still thinking about the people whom you interacted with, while you were supported by the {PROGRAM} at {INSTITUTION}, tell me on a scale from 1 to 5, where 1 is distant and 5 is close, the quality of your relationship with your PI.

[IF NECESSARY PROMPT: Where 1 is distant and 5 is close?]

h3b On a scale from 1 to 5, where 1 represents distant and 5 represents close, how would you characterize your relationship with the other members of your lab or research group?

[IF NECESSARY PROMPT: Where 1 is distant and 5 is close?]

h3c On a scale from 1 to 5, where 1 represents distant and 5 represents close, how would you characterize your relationship with other research colleagues at {INSTITUTION}?

[IF NECESSARY PROMPT: Where 1 is distant and 5 is close?]

h4a Still thinking about these same groups of people, now I would like you to rate them in terms of the influence they had on your career path. On a scale from 1 to 5, where 1 represents very little influence and 5 represents a great deal of influence how would you rate the influence your PI had on your career path?

[IF NECESSARY PROMPT: 1 represents very little influence and 5 represent a great deal of influence on your career path.]

/IF H.4a = 04 OR 05 ASK H.4bO, ELSE GOTO H.4e/

h4b1 Tell me in what way your PI influenced your career path? Why do you think your PI had so much influence?

h4bo LENGTH = 240 CHAR/ RESPONSE: ___________________________

h4e How would you rate the influence of other members of your lab or research group on your career path?

[IF NECESSARY PROMPT: 1 represents very little influence and 5 represents a great deal of influence.]

h4f How would you rate the influence of other research colleagues at {INSTITUTION} on your career path?

[IF NECESSARY PROMPT: 1 represents very little influence and 5 represents a great deal of influence.]

h4g Still thinking back to when you were supported by the {PROGRAM} at {INSTITUTION}, how long after leaving that lab or research group you were in did you remain in touch with your PI? I am going to read you a list of possibilities, stop me when I read one that describes how long you stayed in touch …

[INTERVIEWER: PLEASE READ THE LIST]

h4h Similarly, how long after leaving the same lab or research group did you remain in touch with other members of your lab or research group? I am going to read you a list of possibilities, stop me when I read one that describes how long you stayed in touch …

[INTERVIEWER: PLEASE READ THE LIST]

h4i Finally, how long after leaving the same lab or research group did you remain in touch with other research colleagues at {INSTITUTION}? I am going to read you a list of possibilities, stop me when I read one that describes how long you stayed in touch …

[INTERVIEWER: PLEASE READ THE LIST]

h5 Overall, do you believe the {PROGRAM} had an influence on your education?

/IF H.5 = 01 ASK H.5.O ELSE SKIP TO H.6/

h5a Please tell me how {PROGRAM} influenced your education?

h5ao /LENGTH = 240 CHAR/ RESPONSE: ____________________________

h6 Do you believe the {PROGRAM} had an influence on your career?

/IF H.6 = 01 ASK H.6O ELSE CONTINUE/

h6a1 Please tell me how the {PROGRAM} influenced your career?

h6ao /LENGTH = 240 CHAR/ RESPONSE: _______________________

I. Demographics

I.1 Now, I want to ask you a few questions about yourself and your family.

i2a At the time you received the {PROGRAM}, did you have a spouse or long-term partner?

i2b At the time your {PROGRAM} was active, did you have any dependents?

[INTERVIEWER: a dependent is someone that the respondent supported financially and could legitimately claim on his/her income tax return].

i2c1 How many dependents did you have at that time?

i2c ENTER ____________ /RANGE =1-12/

i3 Is English your first language?

i4 Are you Spanish, Hispanic, or Latino?

[DO NOT READ CATEGORIES]

i5_1-i5_6 What is your race? Would you describe yourself as…..

[INTERVIEWER NOTE: PLEASE READ MAJOR CATEGORIES HEADINGS ONLY. SELECT ALL THAT APPLY]

/MUL = 6/

[IF I.51 = 95 CONTINUE, ELSE SKIP TO I.6]

i5o OTHER TEXT: _________________________________

i6 What is the highest degree you received?

[INTERVIEWER NOTE: Please read list]

/IF I6 = 95 ASK, ELSE CONTINUE/

i6o SPECIFY /TEXT = 70/_________________________________

i7 Are you currently working in the biological or behavioral sciences?

i8 Currently, how do you spend most of your productive daily hours Monday through Friday? I'm going to read you a list of options. Please choose one.

[INTERVIEWER NOTE: Please read list]

i9a What degree are you pursuing, currently?

[INTERVIEWER NOTE: Please read list]

/IF I.8 = 95 THEN ASK, ELSE CONTINUE/

i9b1 How would you describe what you do with your most productive hours Monday through Friday? How would you describe what you are currently doing?

i9bo RESPONSE: /TEXT = 270/_______________________

/IF I.8 = 01 DO NOT ASK, ASK OF EVERYONE ELSE/

i9c Have you ever worked?

i9d Have you ever held a full-time job?

i10 What is (was) your most recent primary employment sector? Was it in …?

[INTERVIEWER NOTE: Please read list]

i11 Within the education sector, do you (or did you) primarily work at….

[INTERVIEWER NOTE: Please read list]

/IF I.4 = 01, or I.5 = 02,04,05 ASK I.15a, ELSE GOTO I.16/

i12 Within the government sector, do you (did you) primarily work for….

[INTERVIEWER NOTE: Please read list]

/IF I.4 = 01, or I.5 = 02,04,05 ASK I.15a, ELSE GOTO I.16/

i13 Within the private sector, do you (did you) primarily work….

[INTERVIEWER NOTE: Please read list]

/IF I.4 = 01, or I.5 = 02,04,05 ASK I.15a, ELSE GOTO I.16/

i141 How would you describe your most recent primary employment sector?

i14 /TEXT = 250 CHARACTERS/ RESPONSE: ____________________

/IF I.4 = 01, or I.5 = 02,04,05 ASK I.15a, ELSE GOTO I.16/

i15a Still thinking back to when you were supported by the {PROGRAM} at {INSTITUTION}, do you believe that being a minority individual in some way, affected your research training experience?

i15bo In what ways did your minority status affected your research training experience?

i15b /TEXT = 250 CHARACTERS/ RESPONSE: ____________________

i16 Are you an only child?

/IF I.16 = 02 ASK/

i17 Do your parents or any siblings have a bachelors (4-year) degree?

/IF I.16 = 01,97,98,99 ASK/

PreI.17Do either of your parents have a bachelors have a bachelors (4-year) degree?

/IF I.16 = 02 ASK/

i18 Do your parents or any siblings have a graduate degree?

/IF I.16 = 01,97,98,99 ASK/

PreI.18 Do either of your parents have a bachelors have a graduate degree?

i19 Still thinking back to the time your {PROGRAM} was active, how supportive would you say your parents were of your overall career goals? On a scale from 1 to 5, where 1 is not supportive at all, and 5 is extremely supportive, how would you rate the supportiveness of your parents for your career goals?

/IF I.2a = 01, ASK I.20, ELSE GOTO J.1/

i20 Similarly, how supportive would you say your spouse or partner was of your overall career goals, at this same time? Remember, 1 is not supportive at all, and 5 is extremely supportive

J. General questions

J.1 Finally, to finish the survey I want to ask you some general questions about the {PROGRAM}.

j2_1 What were the best features of the {PROGRAM}?

j2o /LENGTH = 240 CHAR/ RESPONSE: ___________________________

j3_1 What were the worst features of the {PROGRAM}?

j3o /LENGTH = 240 CHAR/ RESPONSE: ___________________________

j4 Do you believe the {PROGRAM} could be improved in any way?

j4_1 If you could make improvements to the {PROGRAM} what would they be?

j4o /LENGTH = 240 CHAR/ RESPONSE: ___________________________

j6 Is there anything else you would like NIH to know about the {PROGRAM}?

j7o What would you like NIH to know about the {PROGRAM}?

/LENGTH = 240 CHAR/ RESPONSE: ___________________________

K. Goodbye

Those are all the questions I have for you today/tonight. I would like to thank you for taking the time to talk with me. Your participation is very important, and we greatly appreciate your input. The results of this study will be published in Summer 2004 and may be accessed for free at www.nap.edu.

Once again, thank you very much, and Good-bye.

GOODBYE1

We are only able to conduct this interview with people whom we can verify that they are indeed the selected respondent. Thank you very much for your time.

GOODBYE2

I am sorry, but I am having trouble pulling up your file at this time. Would it be possible for me to call you back at a later time?