Dr. Hopson, we can hear you okay when you lean in close to the microphone!

It looks like the technology check be done at one time & responses to questions can be submitted at another time, that is great news!

WWW.aamc.org/standardizedvideointerview

During a face-to-face interview, a student can respond to the interviewer’s body language to know when the have sufficiently answered the question. Are student able to end their response to a question before the 3 minute limit?

yes. you don’t have to use the full 3 minutes, just answer the question. often a shorter answer could be better

Is there an “end” button to end the answering of the question, or do you just wait quietly until the 3 minutes runs out?

You can end it

Just to clarify, PDs are not viewing the actual video or the transcript. They are receiving the raw score from a third party correct?

PDs will get the overall score and be able to see the videos as well. They will not get the individual scores for each question.

Will we be able to see our own score?

Yes, you will be given your own score

How much will this cost medical students in the future?

Will those evaluating us be PDs or former PDs, or are they just evaluators from this company?

What would prompt a PD to look at an applicants SVI?

How important will it be to have a professional backdrop and lighting for the video interview?

If we completely mess up a question on the SVI, can we erase and re-start or re-answer?

Can students take a break at any point during the 21 minute interview?

iam doing my residancy is havs

If you decide to reanswer a question, will you be graded on the initial response, the corrected response, or both?

e applied in eras now h

At this point in the SVI roll out, would you decide not to extend an interview to someone with a low score? Additionally, is there any mechanism to appeal a low score?

Is there any introductory portion of the SVI? Or does it just jump into the questions?

to our AAMC Reps: if we already have the SLOE addressing these issues, how much will the SVI really affect how our app i s viewed. What if an SVI contradicts the prof/communication skills portion of the SLOE

Will we be able to know the score we recieved on the SVI when we apply through ERAS?

Jessica - I suspect if the SVI score is discordant with your academic record it won't impact interview decisions.

I’m glad to hear that professional (expensive) videography is not required…. I’m still concerned about the inherent bias from appearance. How can we be reassured that there will be no “film bias?” considering we are judged by humans. How many people judge our responses?

Regarding content of our answers, should we aim to use examples from our experience in medical school or medical field? In other words, will the evaluators have medical background to understand specific examples?

Yes, you will know the score you received on the SVI before Sept. 15th

If the content of what we say in the interview is all that matters (disregarding nonverbal communication and interpersonal communication), how is this format different than a written response to particular questions?

Will I still have access to other documents on my computer during the interview or does the program shut down all other computer programs (similar to Examsoft software for example)?

that the eras season is close what awaits me

Exactly how the SVI is used and weighted will likely vary by program. To me a SLOE written by a department that has a significant relationship with the student and knows them well would have substantial weight.

I agree with Dr. Hopson on this

What does the SVI evaluate in 21 minutes that is not already evaluated on a 4 week emergency medicine audition rotation/SLOE?

I suspect EM applicants are a pretty safe arena to “test” the SVI in, for this very reason.

It depends on the SLOE. Many SLOEs don’t give much information especially on humanistic qualities.

I’m advising students “not to sweat” this thing so much for just those reasons. THE SLOE is a strongly protective device for students who may not “video interview” well.

Will we be able to know the score we recieved on the SVI when we apply through ERAS?

I suspect the following math will apply

At this point in the SVI roll out, would you decide not to extend an interview to someone with a low score?

strong paper + strong svi = interview offer

average paper + strong svi = interview offer

Average paper + average svi = maybe

Agree- strong application and low SVI score would not necessarily discourage me from inviting.

weak paper + strong svi = maybe

weak paper + weak svi = no

Think I lost track of the permutations!

I agree with Dr. Hopson’s math

What about strong paper + weak or average svi?

Is there any mechanism to appeal a low score?

At this point, I would not use the SVI score to not interview a strong paper application

Strong paper probably trumps svi although I would expect questions about it during the in person interview

Agree

What happens if for whatever reason, the internet goes out?

Will the scores be used by PDs after an applicant has been interviewed?

Are AOA residencies also going to use the video interviews?

What is the expectation for cost of the program going forward?

What if someone decides later in the cycle to apply for EM?

Will the video recordings themselves also be available to us as students after the fact, in addition to the scores?

Who will be grading our videos? What qualifications do they have?

I'm assuming there is a rubric that will be utilized for this. Will we have access to that rubric?

So can we use some of that three minutes to think through the answer? Will the grading start when we start talking or will points be taken off for pausing before answering?

Grading is about content of the answer itself

aamc has a generic rubic in the essentials of the svi document which they have available on their website

Regarding content of our answers, should we aim to use examples from our experience in medical school or medical field? In other words, will the evaluators have medical background to understand specific examples?

Content does not need to be medical in nature

Will we still have access to other programs on our computer during the interview or does the program shut down all other computer programs?

Use examples that you can speak to eloquently whether or not medical

Will the grading start when we start talking or will points be taken off for pausing before answering?

Your performance will not be improved by trying to read notes or do a quick google search.

Who grades the videos? And what medical background will they have?

AAMC rules that you agree to also state that you will not access other sources

Are non-medical people grading these?

Great question @alexrahnema!

they’re not looking for amazing answers. They ARE looking for you to be able to demonstrate understanding of, and examples to show, professional behaviors, in challenging circumstances. Look at the practice questions and you can really get a feel of what they are looking for. use the time now to think of a few examples in your past. build your answers off of these examples.

In that case, should medical jargon be avoided?

Should medical jargon be avoided?

Still very concerned about PDs being able to view the videos. It sounds like AAMC raters are being trained on how to view these videos and focus on content. But PD’s don’t necessarily have that training. How can we possibly control for gender, race, etc, bias?

Are multiple raters scoring each video to then be assessed for inter-rater reliability?

Yes, they are

Raters will also be assessed for bias

What ballpark range do you consider a "strong" SVI score at this point?

Data that AAMC has been showing at meetings this spring is a mean of 18 with a standard deviation of 2.something.

Will everyone get the same 6 questions? If not will everyone get 6 questions that challenge the interviewees in a similar fashion?

Here’s the slide that Dr. Hopson is referencing: https://twitter.com/zachjarou/status/858366114086219777

Zach Jarou for the save

how will IMG medical experiences in other countries be evaluated? are experiences in the US rated equally to international experiences?

If the “Grey area” students fall into that “blob” around 18, how does the video results help PD decide between them? It seems that the videos would only be useful for the outliers hig/low

Have the questions been *statistically validated* to be equally challenging?

Or is this year meant to validate the questions?

How about Military ACGME accredited programs?

For the PDs, what did you guys find from last year's opt in pilot in terms of SVI scores and places on your rank lists?

The SVI scores last year were not made available to PDs so we do not know which of our residents took it or their scores if they did

Scores were not available to programs last year. ONly for AAMC research

Questions have been through an extensive vetting process

Thank you

Thank you!

thanks to the presenters so much for everything! that was extremely informative and nerve calming.

Thanks for putting this together !

Thank you so much! The information was very helpful!

Thank you to the panel!

Thank you!

thank you

Thank you for your time

Thank you to all of the panelists for your time!

Great info, thanks

Thank you for puttting this together!

Very insightful and we appreciate all your efforts.

Thank you so much for answering our questions!

Thank you guys for putting this together!

Thank you for the great questions and answers

Thank you everyone! Very helpful information here tonight!

Thank you all for your time!

Thank you all for your time, effort, and insight. Much appreciated!

Thanks to everyone for their information and advice!

http://emramatch.org/ CHECK IT OUT!

https://www.emra.org/students/ 🙌🏻🙌🏻🙌🏻

And here is the EMRA Education Committee site: https://www.emra.org/committees-divisions/education-committee/

Challenge to all of the students on the hangout -- be a resource for your peers. Direct them to EMRA and AAMC resource