Zoom Logo

Implementing MEL in the COVID-19 Pandemic: Tools, Ideas & Reflections - Shared screen with speaker view
GANESH NIGA,
19:57
Good evening
Kiran Bam
20:06
Hi good evening from Nepal
Bruno Baroni
20:19
Hi all
Merry Saragih
20:25
I cant hear anything, have started?
Fidel Alvarez
20:29
Hi from Bolivia
Sandiya LAWRENCE
20:39
Can't hear
Bruno Baroni
20:40
no sound here too
Muna Aden
20:40
Hello
Lisette Anzoategui
20:42
I also can't hear
Merry Saragih
20:47
great now
Jessica Escobar-Alegria
20:48
Yes
Elizabeth Bocaletti
20:48
we hear you
Alev Kayagil
20:49
Can hear
Seema Patel
20:49
I can hear
Reem Omar
20:50
all good
Klaus Minihuber
20:50
yes
Muna Aden
20:50
I can hear
Gwen Heaner
20:50
good
Tala Dowlatshahi
20:51
No wound
Ivana Martinovic
20:51
loud and clear
Chaitra Murlidhar
20:52
can hear
Jon Silverstone
20:52
Yes
Zara Merali
20:52
i can hear
Carlene Baugh
20:53
yes
GANESH NIGA,
20:54
Able to here clear
Ujjwal Mali
20:55
Hello Everyone, This is Ujjwal from Nepal
Edwin Mejia
20:55
Im good
Khadga Ramtel
20:55
Namaste from Nepal
Chrissy Godwin
20:56
yes
Derniel O'Connor
20:56
i can hear
Dhiren Doley
20:56
audible
Amel Hammami
20:58
yes
MaryFaith Mount-Cors
20:58
I can hear
Neena Aggarwal
20:58
@Merry click on bottom right that says join by audio
shahida Noor Ali
20:59
loud and clear
Fidel Alvarez
21:01
I can hear
Orlando Hernandez
21:05
Yes, I can hear and see you
Neena Aggarwal
21:06
I couldn't hear until I did that
Alev Kayagil
21:07
Will this recording be shared after the meeting?
Maby Palmisano
21:11
hear well
Edwin Mejia
21:15
thanks
Alev Kayagil
21:18
Thanks :)
Absolom Mbinda
21:22
Absolom from Zimbabwe
Caroline Krawiec Brownstone
21:22
Good.
Amanda Stek, Social Impact
21:29
excellent, thank you!
NATHACHA PERICLES
21:34
i can hear
Fatimata Seye Sylla
21:36
Hello All
Elena Walls
21:49
Hi all!
Bruno Baroni
21:58
thanks and forwarding " click on bottom right that says join by audio"
Rawan Wehbe
22:15
Hello
yema d'ALMEIDA
23:21
Hello All
Tanya Smith-Sreen, FHI 360
23:24
Hi all, welcome to this morning's webinar! This webinar will be recorded and made publicly available
Waheedullah Zargar
24:10
Hello,This is Waheed from Kabul, Afghanistan
Waheedullah Zargar
24:23
Can't hear well
Tara Ratnam
24:44
Hi, This is Tara from India
Men Chanbona
25:12
Hello from Cambodia
Waheedullah Zargar
25:27
Hear well now
Valentyna Kyselova
25:38
Hi from Ukraine
Tanya Smith-Sreen, FHI 360
25:41
Welcome all! Glad to hear
S. M. Mobasharul Islam
25:54
Hello from Bangladesh
JUAN CARLOS RODRIGUEZ
25:59
Hi from Honduras!, glad to see and hear
Men Chanbona
26:10
This Men Chanbona from the Innovations for Social Accountability in Cambodia Project in Cambodia
Pierre Gandy Dorival
26:20
Hello from Haiti
Elena Walls
26:31
Thanks, Carina! Glad to join!
shahida Noor Ali
26:42
can you kindly share the presentations
Erna Grasz
27:14
who is on line fro mKEnya, Tanzania, Uganda
Ivana Martinovic
27:32
yeah
Carlene Baugh
27:34
yes
shahida Noor Ali
27:34
yes
Valentyna Kyselova
27:36
yes
Waheedullah Zargar
27:36
Yes, we can see
Elizabeth Bocaletti
27:37
yes
Boniface Kitungulu
27:41
This is Boniface Kitungulu from the Cross-Border Health Integrated Partnership Project (CB-HIPP) Nairobi
Patrice Smith Sterling
27:41
yes thanks
Ujjwal Mali
27:42
yes
Maurice Sikenyi
27:44
YES
Hanan Abbas
27:46
yes
JUAN CARLOS RODRIGUEZ
27:47
yes
Constantin Shyaka
27:54
Yes
Tanya Smith-Sreen, FHI 360
28:22
We plan to share the recording and presentations after the webinar!
Zara Merali
28:33
thanks!
Maurice Sikenyi
28:35
Maurice Sikenyi--from Room to Read, joining from Nairobi
shahida Noor Ali
28:40
many thanks
Tanya Smith-Sreen, FHI 360
28:46
We invite all participants to submit questions via the chat box during the presentations!
shahida Noor Ali
32:13
need to know more about EGRA
Timothy Slade
33:01
https://doi.org/10.1177/1745499917740657 <- beginning of next year not a very good proxy for end of preceding year, b/c summer learning loss. not just a US/Western Europe issue.
Yohannes Leta
34:30
Hi every body
Yohannes Leta
34:48
sorry late with other skype call
Nazrul Islm
34:52
Hi!
Zara Merali
35:51
IRB stands for what, please?
Tracy Brunette
36:17
institutional review board
Annie Smiley
36:21
Zara: IRB = Institutional Review Board
Carol Mickelson
36:23
Institutional Review Board... meaning the ethical review board...
Zara Merali
36:37
thank you
Carol Mickelson
36:55
At FHI 360 it is called the Protection of Human Subjects Committee... PHSC
S. M. Mobasharul Islam
39:47
Who will fill out the survey questionnaire during COVID-19 crisis? by respondent him or herself using tab or enumerator through phone call, skype?
Carina Omoeva, FHI 360
41:05
@Mobashar this presentation will go over these options
Carina Omoeva, FHI 360
41:11
thanks for joining!
S. M. Mobasharul Islam
41:34
Thank you Carina.
GANESH NIGA,
42:19
Some options are not available here like Google forms
GANESH NIGA,
43:17
ok it is come under online survey
Carina Omoeva, FHI 360
43:26
Great point @Ganesh, that would be part of the online surveys
Ellen Galdava
45:14
We should also consider digital literacy together with general literacy.
Ellen Galdava
45:41
Based on our experience, IVR is the best option with digital or non-literate target groups.
Timothy Slade
47:49
We use Tangerine for a lot of those same functions - it's not just for EGRA/EGMA!
Carina Omoeva, FHI 360
48:27
Good to know, thank you Timothy!
GANESH NIGA,
48:31
to set IVR system/mobile app takes time in development , Do we have any system in which any organization can customize based on the requirement
Tanya Smith-Sreen, FHI 360
48:35
Good point @Ellen - the digital literacy of your audience is also important to consider when selecting an option. That's good to hear you've had positive experience with IVR
Timothy Slade
48:37
There's also ACASI (self-administration) functionality that we've deployed for work with less-literate populations and when surveying about highly sensitive topics like SRGBV and the like
Joseph Wantz
49:18
Uploads are unlimited, but does that mean that cost doesn't vary by total number of responses?
Timothy Slade
49:29
(ACASI = 'audio computer-assisted self interviewing')
Carina Omoeva, FHI 360
51:18
thanks, Timothy! @Joseph, great question could you hold this question for the breakout?
Sarah Dunning
51:23
Timothy, can ACASI be made available on mobile devices? (to participants)
Tanya Smith-Sreen, FHI 360
51:39
Thanks for these project insights, @Timothy!
Timothy Slade
51:44
Yes, Tangerine does offline-first ACASI data collection on tablets or smartphones
Timothy Slade
51:53
Android, not iOS
Tanya Smith-Sreen, FHI 360
52:27
We encourage people to share technology they've used in the chat box in addition to questions for the presenters!
Carina Omoeva, FHI 360
53:21
Also - share if you are using paper forms using bubble forms in a socially distanced environment
Ellen Galdava
53:42
Yes, how can we use bubble forms and paper based in times of COVID 19
Timothy Slade
53:47
https://www.theverge.com/2019/3/1/18246429/microsoft-excel-covert-photos-data-tables-editable-table-ai-feature
Timothy Slade
54:07
Excel and Microsoft are also now supporting converting photos of tables and whatnot into actual spreadsheets
Khadga Ramtel
54:30
IVR, online survey tools like Kobo; and also SharePoint
Carina Omoeva, FHI 360
54:43
Ellen, we use OMR for our some of our surveys
Timothy Slade
54:45
so you could do this without needing specialized paper / print forms
Emma Catalfamo
54:49
Thanks for sharing @Timothy!
Thomas Salmon
54:53
A good low tech solution for paper forms is to barcode and scan, and then outsource data collection to a provider. It is the cheapest as well.
Thomas Salmon
55:10
It is cheaper than OMR
Carina Omoeva, FHI 360
55:23
Thanks, Thomas
Athanas Alois
57:52
How can I access the materials for SurveyCTO?
Carina Omoeva, FHI 360
58:25
we will be sharing the links to resources, both open source like ODK and others like Survey CTO
Carina Omoeva, FHI 360
58:30
after the webinar
Rita Larok
59:18
The question of literacy is quite serious!
Tanya Smith-Sreen, FHI 360
01:00:53
Agreed @Rita. Considering both general and digital literacy of your audience is key
Erna Grasz
01:02:16
I wanna go to Happy Hour?
Carina Omoeva, FHI 360
01:02:45
if you're in Senegal, you can @Erna! :-)
Erna Grasz
01:03:08
I saw it pop up on the presentation computer ( smile)
Becky Romasco-Kelly
01:03:26
I have had clients who are nervous about the security of Google forms. any thoughts on security of Google forms?
Ana Tenorio
01:03:42
I am in Senegal! But no happy hour for me with COVID containment measures.
Orlando Hernandez
01:04:10
Can we have the last slide that Brian Doodley used?
May Hui
01:04:30
As well as the decision tree graphic, please
Rowena Pascascio
01:04:39
these are so interesting and helpful...thank you
Tanya Smith-Sreen, FHI 360
01:05:35
Hi all, we'll be sharing out the presentations after the webinar, along with the webinar recording!
Momina Ahmad
01:06:47
Hi everyone , Brian please share your presentation
Tanya Smith-Sreen, FHI 360
01:07:08
@Momina we plan to share out the presentations shortly following the webinar!
Eric Eversmann
01:08:33
Will anyone be able to speak to (a) an increase in data from self-report vs. observation and (b) change in respondent profile? Validity concerns, calibration strategies, et.
Nitika Tolani
01:08:50
Some of these ideas are really useful! I manage a MEL platform project in South Sudan where wifi is inconsistent at best, and phone connectivity is also a challenge. Online platforms for surveys simply aren't possible. I like the idea of dropping paper based instruments in a central location and having informants pick up the survey to complete. If literacy is a challenge and it often is, we can consider simple phone interviews and surveys. Are there any other suggestions you can offer for technologically challenged environments, and sometimes low literacy levels?
Tanya Smith-Sreen, FHI 360
01:09:15
Thanks @Eric, we'll note this for the Q&A!
Yohannes Leta
01:09:16
Case-tracking form what is it? Anybody...
Yohannes Leta
01:10:04
Noted!
Tanya Smith-Sreen, FHI 360
01:11:16
Great question, @Nitika. This will be discussed more in the break out session
GANESH NIGA,
01:11:42
For Q & A- How we can use WhatsApp to collect the data. Any idea how to customize it. Any idea please
Tanya Smith-Sreen, FHI 360
01:12:37
Thanks @Ganesh. We'll include in the Q&A
Farhad Khan
01:12:49
Are there ethical implications for dropping paper-based instruments in a central location? Even if lockdowns aren’t mandated by local governments, is it fair to be asking people to go to a central location to collect/drop-off forms especially when outbreaks are growing?
Chanry Im
01:12:52
Any experience using Telegram bot to collect data?
Rita Larok
01:13:45
Would like to know more about Data Quality/Reliability when remote methods are used
Men Chanbona
01:15:03
If we sms or phone to collect data from our beneficiaries, how can we proceed the Data Quality Assessment?
Seba Auda
01:16:11
How can AORs /CORs conduct virtual visits for data verifications purposes?
Ana Tenorio
01:17:41
@Mathematica: in your experience, what is the average duration/length to ensure quality training of remote interviewers? Would it usually be longer than F2F training as you mentioned the skillset needs to be sharper without visual cues?
Yohannes Leta
01:17:56
test,test,testi like that
Yohannes Leta
01:18:26
ppl may misquote Test, Test, Test for COVID-19
Naeem Mamozai
01:18:48
Greetings from Afghanistan
Naeem Mamozai
01:18:56
I can't hear you
Billi Shaner
01:19:03
Yvonne mentioned delaying the administration of EGRA for one project, but I'm curious to know if the team has any specific suggestions for adapting MEL when the original intention was to survey children's abilities (EGRA, IDELA, etc.) Are you simply delaying any data collection that requires use of these types of tools or are there any instances where you're changing the research design and tools - and if so, how?
Devesh SAHU
01:19:05
How to maintain quality during data collection in case of using mobile phone for data collection?
FHI360_MEL
01:19:33
RE testing questionnaires (whether they are for phone interviews, SMS, etc.) - Important to field test the questionnaire wording and items not just with colleagues/friends but with people who have similar profile as interviewees, to see if wording, vocabulary, etc. are well understood and capturing desired info.
Pierre Gandy Dorival
01:19:36
please, i would appreciate having the ppt presentations
Emma Catalfamo
01:19:39
That was great, thank you Sarah!
shahida Noor Ali
01:19:49
ity was great
Pierre Gandy Dorival
01:19:49
very interesting
Selvyn Fuentes
01:20:00
Very interesting!!
Constantin Shyaka
01:20:04
here, my internet connection is unstable (Is on and off) remember to share with us, presentation and record, thank you
Ujjwal Mali
01:20:12
Thank you all presenters
Thomas Salmon
01:20:21
thank you for great level of detail and good tips
Fatimata Seye Sylla
01:20:27
Thank you for the interesting presentations
Koudzo Pomevor
01:20:38
thank you
Fatimata Seye Sylla
01:20:39
I have to move to another call
Seba Auda
01:20:53
Thank You so much. Great Presentations
Tanya Smith-Sreen, FHI 360
01:20:57
From Eric Eversmann to Everyone: 10:51 AMWill anyone be able to speak to (a) an increase in data from self-report vs. observation and (b) change in respondent profile? Validity concerns, calibration strategies, et.
Skye Hersh
01:21:45
MAIN QUESTION: My team finds that many respondents are actively lying on SMS interviews. (1) We've had respondents outright tell us at interview end that they had been lying, and (2) we've asked the same simple questions (e.g., "How old are you?") twice to the same respondents, and found very different answers.
Skye Hersh
01:22:00
What can be done about this?
Karla Sarr
01:22:00
I’m interested to learn more about adapting qualitative methods - there was mention early on about video FGDs. How about any technology to support more in-depth questions? Perhaps this means having a more focused sample but I wonder if in this remote environment we can still achieve some level of that thick description that we often find so valuable?
Naeem Mamozai
01:22:24
Colleagues, I would appreciate if you share the presentations
Gwendolyn Morgan
01:23:07
Important to consider safety and comfort of respondent. Respondents in abusive households may be at risk of additional abuse based on getting a phone call or SMS requesting participation in a survey.
Pierre Gandy Dorival
01:23:42
how do you conduct a data quality assessment remotely?
Amelia Mackenzie
01:23:47
Great point, @Gwendolyn!
Sopheak Sok
01:24:45
Question to Brian, I am Sopheak, FHI360 Cambodia, if we want to conduct data collection using some technology for remotely, Does FHI360 will have those technology for each country office / project to utilize for those activities?
Kiran Bam
01:26:11
Good point. Thanks
Kiran Bam
01:26:36
Using multiple techniques can be used, but time factor is also important :-)
Thomas Salmon
01:27:03
Thanks these are great resources
Kailou Garba Tinni
01:27:08
very good presentations thanks so much
Alev Kayagil
01:27:21
Thanks everyone. Look forward to receiving the slides. I have another meeting. have a nice day
MaryFaith Mount-Cors
01:27:40
Thanks, all! I have to go to my next call. Very helpful webinar.
Daniel Cohn
01:27:44
Thank you for the session, very helpful!
Selvyn Fuentes
01:28:00
Thanks everyone, very good presentation!!
Byrone Wayodi
01:28:12
Very great insights
Nazgul Kurmanbekova
01:28:34
Thanks, very useful resources
Halima Musa
01:28:59
Thank you so much for this wonderful presentation. But I miss the last part of it because of network
Maurice Sikenyi
01:29:01
Thanks! Great presentation!
Carol Mickelson
01:29:22
Thanks so much. Very informative. Signing out.
Tanya Smith-Sreen, FHI 360
01:29:28
Option 1: General guidance on how to modify MEL plans (2) Resources/Best practices for remote monitoring. If you’re interested in Option 1, please remain in the main session. If you’re interested in Option 2, please join the Breakout Room.
Sarah Dunning
01:30:02
I'm in the main room but still hearing Bryan
Sarah Dunning
01:30:04
*Brian
USAID_438308_dhusein
01:30:09
This is very helpful. Thank you
Chaitra Murlidhar
01:33:16
Could you perhaps walk us through an example for, say an Education project? What COVID indicators would look like for an education project?
Tracy Brunette
01:36:44
I love this discussion! At RTI we are thinking more deeply about what it means to delay assessment efforts -- rather than simply defaulting to next year, next grade. And are working to put together some guidance and considerations in planning. So important to touch back to the assessment purpose and how best to get data we need given current circumstances.
Chaitra Murlidhar
01:37:33
Thanks so much! That was helpful - we are all just trying to figure this together as an ED community.
Majo Aldana
01:39:19
thank you for the info and ideas. have another meeting now but I look forward to keeping in touch. hope you are all safe and well.
Ana Tenorio
01:39:58
@Chaitra: In context Analysis for Education programmes I would also prioritize including MoE National/Local efforts for learning continuity so any programming activities are complementing and not duplicating these efforts.
Chaitra Murlidhar
01:40:04
Thank you! This was a fantastic session with many useful insights.
Elena Walls
01:40:40
Thankyou FHI team for this webinar, I am sure it's very useful to practitioners! I have to drop off now
Kara Janigan
01:40:54
Thank you for this useful webinar!
Tanya Smith-Sreen, FHI 360
01:40:55
Thank you all!
Rosa Chiappe
01:41:11
Thank you very much!
Zara Merali
01:41:14
thank you so much - very very interesting.
María José Castillo
01:41:17
Would you recommend using different tools to reach more participants (same sample)? How might affect reliability and data comparability?
Rowena Pascascio
01:41:26
thank you all! appreciate the sharing of information.
Devesh SAHU
01:41:34
Thank you all
GANESH NIGA,
01:41:35
Thank you very much . Very useful session.
Belinda Ramirez
01:41:52
Thanks so much for the information!
Kamna Mantode
01:41:52
I am wondering if you can recommend a resource/insights on ethical considerations that we need to be very aware of while working in the context of COVID-19 and working with vulnerable populations.
Nazrul Islm
01:42:13
Thank you very much, very helpful.
Emma Catalfamo
01:42:20
This was excellent..thank you so much!
Hannah Carlile
01:42:22
Thank you all for the informative thoughts. Will the power point be shared after this call has ended?
Jannine Longsworth
01:42:23
Information was very useful! Great insights. Thank you very much
Becky Romasco-Kelly
01:42:37
thank you all
Yohannes Leta
01:42:44
Thank you Very much for FHI 360
Momina Ahmad
01:42:49
Thank you very much,
Gwendolyn Morgan
01:42:50
Wonderful webinar...really useful insights! Thanks so much.
Ana Tenorio
01:42:55
Tnanks everyone! Stay well and healthy.
Thomas Salmon
01:42:56
Thanks to all, great webinar
Nurgul Alybaeva
01:43:01
Thank you very much!! Very useful webinar.
Halima Musa
01:43:06
Thank you all it is a wonderful webinar.
Maby Palmisano
01:43:12
Thanks!
Tanya Smith-Sreen, FHI 360
01:43:12
We'd appreciate your feedback and any future webinars you'd be interested in!
Salwa Shameem
01:43:19
Thank you, great session!
Betsy Nolan
01:43:25
Thanks Yvonne and others!
Marcela Suazo
01:43:26
thank you very much
Esteban Villalobos
01:43:26
is this going to be uploaded?
Byrone Wayodi
01:43:30
This was a great session the most needed and well though out for at this time
Esteban Villalobos
01:43:33
thank you for the webinar!!
Rawan Wehbe
01:43:35
Many Thanks :)
Ruth Chi
01:43:38
thank you everyone and keep safe.
Maryanne Kimani
01:43:41
Thank you
Edwin Mejia
01:43:43
Thank you
Clara Pava
01:43:46
Thank you! This was a great webinar
Kamna Mantode
01:43:47
Thank you very much! Is this recording going to be available?
S. M. Mobasharul Islam
01:43:50
Thank you Carina to organize such type of important Webinar.
Elizabeth (Bess) Long
01:44:02
Thanks to all - very informative!
Tanya Smith-Sreen, FHI 360
01:44:11
https://www.povertyactionlab.org/blog/3-20-20/best-practices-conducting-phone-surveys?utm_source=newsletter&utm_medium=email&utm_campaign=march20
Tanya Smith-Sreen, FHI 360
01:44:22
https://blogs.worldbank.org/impactevaluations/mobile-phone-surveys-understanding-covid-19-impacts-part-i-sampling-and-mode
Men Chanbona
01:44:27
Thank you for R & E team for facilitating this webinar.
Reem Omar
01:44:36
Thank you!!
Sonali Chopra
01:44:37
Thank you !!
Tanya Smith-Sreen, FHI 360
01:44:38
https://blogs.worldbank.org/impactevaluations/impact-evaluations-time-covid-19-part-1
Khadga Ramtel
01:44:40
Thank you; and Namaste from Nepal! Stay Safe!!
Elana Dhuse
01:44:44
thank you
Reem Omar
01:44:46
looking fwd for more webinars
Sopheak Sok
01:44:48
Thanks
JUAN CARLOS RODRIGUEZ
01:44:51
Thank you was excellent
Constantin Shyaka
01:44:54
Thank you for the useful webiner
Ujjwal Mali
01:45:04
Thank you all presenters
Souleymane Bah
01:45:09
Thank you all
Yon Yon
01:45:10
Thank you for the presenters
JUAN CARLOS RODRIGUEZ
01:45:10
very useful !!
Ujjwal Mali
01:45:12
and Tanya
Nazrul Islm
01:45:18
Much appreciated!
Roselyn Tomas
01:45:40
thanks everyone
Sujeewa BANDARA
01:45:45
Thanks a lot. Every useful presentation!
buyile mkhulise
01:45:46
Thank you so much for the great presentation
Carina Omoeva, FHI 360
01:45:55
Thank you everyone!
Tanya Smith-Sreen, FHI 360
01:45:55
Thank you all!
Koudzo Pomevor
01:46:09
thanks a lot
Tanya Smith-Sreen, FHI 360
01:46:20
Thanks all!
Absolom Mbinda
01:46:22
Thank you