Zach Jarou
43:47
Dr. Hopson, we can hear you okay when you lean in close to the microphone!
Zach Jarou
52:46
It looks like the technology check be done at one time & responses to questions can be submitted at another time, that is great news!
Unknown Speaker
00:00
00:54:05 David Carle Hangouts Coordinator: WWW.aamc.org/standardizedvideointerview
Zach Jarou
55:13
During a face-to-face interview, a student can respond to the interviewer’s body language to know when the have sufficiently answered the question. Are student able to end their response to a question before the 3 minute limit?
Unknown Speaker
00:00
00:56:57 tommorrissey: yes. you don’t have to use the full 3 minutes, just answer the question. often a shorter answer could be better
Unknown Speaker
00:00
00:58:10 Karri: Is there an “end” button to end the answering of the question, or do you just wait quietly until the 3 minutes runs out?
Fiona Gallahue
59:15
You can end it
Unknown Speaker
00:00
01:03:54 alexrahnema: Just to clarify, PDs are not viewing the actual video or the transcript. They are receiving the raw score from a third party correct?
Fiona Gallahue
01:04:59
PDs will get the overall score and be able to see the videos as well. They will not get the individual scores for each question.
Unknown Speaker
00:00
01:06:35 philieberman: Will we be able to see our own score?
Fiona Gallahue
01:06:53
Yes, you will be given your own score
Erin Karl
01:07:52
How much will this cost medical students in the future?
Andy Leubitz
01:08:00
Will those evaluating us be PDs or former PDs, or are they just evaluators from this company?
Unknown Speaker
00:00
01:08:36 alexrahnema: What would prompt a PD to look at an applicants SVI?
Unknown Speaker
00:00
01:08:49 David Carle Hangouts Coordinator: How important will it be to have a professional backdrop and lighting for the video interview?
Unknown Speaker
00:00
01:09:42 David Carle Hangouts Coordinator: If we completely mess up a question on the SVI, can we erase and re-start or re-answer?
Stefanie Gopaul
01:11:19
Can students take a break at any point during the 21 minute interview?
Unknown Speaker
00:00
01:11:47 MuHosE2: iam doing my residancy is havs
Trevor Mattox
01:12:08
If you decide to reanswer a question, will you be graded on the initial response, the corrected response, or both?
Unknown Speaker
00:00
01:12:30 MuHosE2: e applied in eras now h
Jessica Krueger
01:12:38
At this point in the SVI roll out, would you decide not to extend an interview to someone with a low score? Additionally, is there any mechanism to appeal a low score?
Unknown Speaker
00:00
01:12:56 David Carle Hangouts Coordinator: Is there any introductory portion of the SVI? Or does it just jump into the questions?
Unknown Speaker
00:00
01:13:26 tommorrissey: to our AAMC Reps: if we already have the SLOE addressing these issues, how much will the SVI really affect how our app i s viewed. What if an SVI contradicts the prof/communication skills portion of the SLOE
Bianca Alvarez
01:13:26
Will we be able to know the score we recieved on the SVI when we apply through ERAS?
Laura Hopson
01:13:51
Jessica - I suspect if the SVI score is discordant with your academic record it won't impact interview decisions.
Unknown Speaker
00:00
01:14:45 Danielle: I’m glad to hear that professional (expensive) videography is not required…. I’m still concerned about the inherent bias from appearance. How can we be reassured that there will be no “film bias?” considering we are judged by humans. How many people judge our responses?
Alexandra Reinbold
01:14:48
Regarding content of our answers, should we aim to use examples from our experience in medical school or medical field? In other words, will the evaluators have medical background to understand specific examples?
Fiona Gallahue
01:14:52
Yes, you will know the score you received on the SVI before Sept. 15th
Unknown Speaker
00:00
01:14:59 David Carle Hangouts Coordinator: If the content of what we say in the interview is all that matters (disregarding nonverbal communication and interpersonal communication), how is this format different than a written response to particular questions?
Stefanie Gopaul
01:15:32
Will I still have access to other documents on my computer during the interview or does the program shut down all other computer programs (similar to Examsoft software for example)?
Unknown Speaker
00:00
01:16:16 MuHosE2: that the eras season is close what awaits me
Laura Hopson
01:17:06
Exactly how the SVI is used and weighted will likely vary by program. To me a SLOE written by a department that has a significant relationship with the student and knows them well would have substantial weight.
Fiona Gallahue
01:17:23
I agree with Dr. Hopson on this
Erin Karl
01:18:02
What does the SVI evaluate in 21 minutes that is not already evaluated on a 4 week emergency medicine audition rotation/SLOE?
Unknown Speaker
00:00
01:18:10 tommorrissey: I suspect EM applicants are a pretty safe arena to “test” the SVI in, for this very reason.
Fiona Gallahue
01:19:09
It depends on the SLOE. Many SLOEs don’t give much information especially on humanistic qualities.
Unknown Speaker
00:00
01:19:30 tommorrissey: I’m advising students “not to sweat” this thing so much for just those reasons. THE SLOE is a strongly protective device for students who may not “video interview” well.
Unknown Speaker
00:00
01:20:03 David Carle Hangouts Coordinator: Will we be able to know the score we recieved on the SVI when we apply through ERAS?
Laura Hopson
01:20:29
I suspect the following math will apply
Unknown Speaker
00:00
01:20:40 David Carle Hangouts Coordinator: At this point in the SVI roll out, would you decide not to extend an interview to someone with a low score?
Laura Hopson
01:20:42
strong paper + strong svi = interview offer
Laura Hopson
01:20:54
average paper + strong svi = interview offer
Laura Hopson
01:21:08
Average paper + average svi = maybe
Fiona Gallahue
01:21:27
Agree- strong application and low SVI score would not necessarily discourage me from inviting.
Laura Hopson
01:21:38
weak paper + strong svi = maybe
Laura Hopson
01:21:44
weak paper + weak svi = no
Laura Hopson
01:22:04
Think I lost track of the permutations!
Fiona Gallahue
01:22:05
I agree with Dr. Hopson’s math
Mindy Duong
01:22:24
What about strong paper + weak or average svi?
Unknown Speaker
00:00
01:22:39 David Carle Hangouts Coordinator: Is there any mechanism to appeal a low score?
Fiona Gallahue
01:22:48
At this point, I would not use the SVI score to not interview a strong paper application
Laura Hopson
01:23:14
Strong paper probably trumps svi although I would expect questions about it during the in person interview
Fiona Gallahue
01:23:19
Agree
Unknown Speaker
00:00
01:23:32 David Carle Hangouts Coordinator: What happens if for whatever reason, the internet goes out?
Unknown Speaker
00:00
01:24:28 David Carle Hangouts Coordinator: Will the scores be used by PDs after an applicant has been interviewed?
Unknown Speaker
00:00
01:26:58 David Carle Hangouts Coordinator: Are AOA residencies also going to use the video interviews?
Unknown Speaker
00:00
01:28:00 David Carle Hangouts Coordinator: What is the expectation for cost of the program going forward?
Unknown Speaker
00:00
01:28:42 David Carle Hangouts Coordinator: What if someone decides later in the cycle to apply for EM?
Unknown Speaker
00:00
01:30:25 David Carle Hangouts Coordinator: Will the video recordings themselves also be available to us as students after the fact, in addition to the scores?
Unknown Speaker
00:00
01:30:53 alexrahnema: Who will be grading our videos? What qualifications do they have?
Raza Abbas Kazmi
01:31:57
I'm assuming there is a rubric that will be utilized for this. Will we have access to that rubric?
Unknown Speaker
00:00
01:32:37 ktannerbarfield: So can we use some of that three minutes to think through the answer? Will the grading start when we start talking or will points be taken off for pausing before answering?
Fiona Gallahue
01:33:31
Grading is about content of the answer itself
Laura Hopson
01:34:07
aamc has a generic rubic in the essentials of the svi document which they have available on their website
Alexandra Reinbold
01:34:26
Regarding content of our answers, should we aim to use examples from our experience in medical school or medical field? In other words, will the evaluators have medical background to understand specific examples?
Unknown Speaker
00:00
Fiona Gallahue
01:35:16
Content does not need to be medical in nature
Stefanie Gopaul
01:35:23
Will we still have access to other programs on our computer during the interview or does the program shut down all other computer programs?
Laura Hopson
01:35:34
Use examples that you can speak to eloquently whether or not medical
Unknown Speaker
00:00
01:35:39 David Carle Hangouts Coordinator: Will the grading start when we start talking or will points be taken off for pausing before answering?
Laura Hopson
01:36:01
Your performance will not be improved by trying to read notes or do a quick google search.
Unknown Speaker
00:00
01:36:10 alexrahnema: Who grades the videos? And what medical background will they have?
Laura Hopson
01:36:22
AAMC rules that you agree to also state that you will not access other sources
Unknown Speaker
00:00
01:36:44 kjsantee: Are non-medical people grading these?
Phil Tseng
01:36:50
Great question @alexrahnema!
Unknown Speaker
00:00
01:37:48 tommorrissey: they’re not looking for amazing answers. They ARE looking for you to be able to demonstrate understanding of, and examples to show, professional behaviors, in challenging circumstances. Look at the practice questions and you can really get a feel of what they are looking for. use the time now to think of a few examples in your past. build your answers off of these examples.
Jacob Mace
01:37:49
In that case, should medical jargon be avoided?
Unknown Speaker
00:00
Unknown Speaker
00:00
01:37:53 David Carle Hangouts Coordinator: Should medical jargon be avoided?
Aimee Parks
01:37:59
Still very concerned about PDs being able to view the videos. It sounds like AAMC raters are being trained on how to view these videos and focus on content. But PD’s don’t necessarily have that training. How can we possibly control for gender, race, etc, bias?
Kestrel Reopelle
01:38:16
Are multiple raters scoring each video to then be assessed for inter-rater reliability?
Fiona Gallahue
01:38:46
Yes, they are
Fiona Gallahue
01:39:24
Raters will also be assessed for bias
Unknown Speaker
00:00
01:39:44 Nancy: What ballpark range do you consider a "strong" SVI score at this point?
Laura Hopson
01:41:01
Data that AAMC has been showing at meetings this spring is a mean of 18 with a standard deviation of 2.something.
Kyunghyun Lee
01:41:33
Will everyone get the same 6 questions? If not will everyone get 6 questions that challenge the interviewees in a similar fashion?
Zach Jarou
01:43:01
Here’s the slide that Dr. Hopson is referencing: https://twitter.com/zachjarou/status/858366114086219777
Unknown Speaker
00:00
01:43:18 David Carle Hangouts Coordinator: Zach Jarou for the save
Shruti Kamat
01:43:20
how will IMG medical experiences in other countries be evaluated? are experiences in the US rated equally to international experiences?
Vimal Shenoy
01:43:26
If the “Grey area” students fall into that “blob” around 18, how does the video results help PD decide between them? It seems that the videos would only be useful for the outliers hig/low
Michael Pasirstein
01:44:15
Have the questions been *statistically validated* to be equally challenging?
Unknown Speaker
00:00
Michael Pasirstein
01:45:19
Or is this year meant to validate the questions?
Unknown Speaker
00:00
01:45:33 Roger: How about Military ACGME accredited programs?
Chichen Qiu
01:45:39
For the PDs, what did you guys find from last year's opt in pilot in terms of SVI scores and places on your rank lists?
Fiona Gallahue
01:46:16
The SVI scores last year were not made available to PDs so we do not know which of our residents took it or their scores if they did
Laura Hopson
01:46:17
Scores were not available to programs last year. ONly for AAMC research
Laura Hopson
01:46:34
Questions have been through an extensive vetting process
Chichen Qiu
01:46:39
Thank you
Unknown Speaker
00:00
01:47:41 Alaleh: Thank you!
Unknown Speaker
00:00
01:47:42 rajeshchundu: thanks to the presenters so much for everything! that was extremely informative and nerve calming.
Unknown Speaker
00:00
01:47:45 theodoreharper: Thanks for putting this together !
Unknown Speaker
00:00
01:47:47 Dalbir: Thank you so much! The information was very helpful!
Aimee Parks
01:47:47
Thank you to the panel!
Unknown Speaker
00:00
01:47:49 Sean: Thank you!
Prachi Bhogan
01:48:02
thank you
Mina Salib
01:48:05
Thank you for your time
Unknown Speaker
00:00
01:48:16 jmgieswein: Thank you to all of the panelists for your time!
Jordan Price
01:48:19
Great info, thanks
Unknown Speaker
00:00
01:48:34 ntroll: Thank you for puttting this together!
Unknown Speaker
00:00
01:48:58 Matt: Very insightful and we appreciate all your efforts.
Unknown Speaker
00:00
01:48:59 Hala: Thank you so much for answering our questions!
Philip Giarrusso
01:49:05
Thank you guys for putting this together!
Jessica Krueger
01:49:12
Thank you for the great questions and answers
Mina Ghobrial
01:49:20
Thank you everyone! Very helpful information here tonight!
Unknown Speaker
00:00
01:49:22 alexhwang: Thank you all for your time!
Unknown Speaker
00:00
01:49:23 bmoc: Thank you all for your time, effort, and insight. Much appreciated!
Rick Tumminello
01:49:46
Thanks to everyone for their information and advice!
Zach Jarou
01:50:07
http://emramatch.org/ CHECK IT OUT!
Erin Karl
01:50:17
https://www.emra.org/students/ 🙌🏻🙌🏻🙌🏻
Unknown Speaker
00:00
01:50:43 sararparadise@gmail.com: And here is the EMRA Education Committee site: https://www.emra.org/committees-divisions/education-committee/
Laura Hopson
01:50:49
Challenge to all of the students on the hangout -- be a resource for your peers. Direct them to EMRA and AAMC resource