Interview request: Thoughts on genAI evaluation & documentation
Hi! We are researchers from Carnegie Mellon University conducting a study on the evaluation and documentation practices of generative AI developers. Given the popularity and success of your model, we're particularly interested in learning from your team's experiences.
Our study aims to:
- Understand current practices in Gen AI model evaluation and reporting
- Identify challenges faced by developers in these areas
- Explore potential improvements in evaluation and documentation processes
We're seeking participants with hands-on experience in these aspects of Gen AI development. Would any members of your team be interested in participating in a (compensated) interview to share their insights?
For more details about the study and to express interest, here is our recruitment page: https://forms.gle/fbn4734YxrRg6mkBA
Hello, 2 quick questions (and it might be helpful if these are added to your recruitment page):
- What is the expected interview modality? Text, phone, or video?
- What is the estimated time of the interview? Even loose lower & upper bounds would be helpful.
Hi! Thanks for the reply. The interview will be conducted via voice or video based on your preference. our average interview time is approximately 60 min.
I'm grateful to be considered, but I'm unable do such an interview at this time (currently a 1-man team).
If you haven't already and they fit the study criteria, consider reaching out to @mrfakename and @Pendrokar who, as owners of TTS Arenas, may have unique insights on model evaluation.
If your recruitment page https://forms.gle/fbn4734YxrRg6mkBA is open for those individuals to apply, consider leaving a 👍 on this comment or replying to indicate as such @evatang otherwise I will leave the targeted outreach to you. Either way, best of luck with your study!