Sommos - Interactive Family Storytelling Platform

Sommos is a web application designed to help family members across generations connect and share knowledge. It integrates key features such as audio/video interview hosting, Al-based transcription using OpenAl's Whisper model, and a family timeline/space to display Al-generated user stories with key points and transcripts. It also enables seamless profile onboarding, inviting and managing family members, and scheduling interviews with Al-generated questions based on user profiles.

Key Challenges

• Ensuring Al transcription accurately processes diverse accents, dialects, and overlapping speech.
• Designing an intuitive interface for easy navigation of Al-generated stories and transcripts.
• Implementing strong security measures to protect family data and ensure privacy compliance.

Solution Delivered

• Enhanced Al transcription with the Whisper model for accurately recognizing diverse accents and speech patterns.
• Designed an intuitive timeline to seamlessly display Al-generated family stories, transcripts, and comments.
• Implemented secure role-based access control and encryption to ensure privacy of family data.
• Boosted user engagement by 86%, enhancing content discovery and fostering increased interactions.

Highlighted Features

• Al-Powered Transcription: OpenAI API with whisper model integration for generating transcription of the Zoom video recording.
• Family Members: List of family members, invite new family members, and track invitation request status.
• Family Room/Space: Displays Al-crafted stories with key points, transcripts, videos, and comments.
• Interview: List of hosted interviews, schedule an interview, and allow the user to cancel, reschedule, or delete it.
• Seamless Video Integration: Zoom Video SDK integration for video calling and recording.
• Al-Generated Questions: OpenAl API integration for generating interview questions based on the interviewee profile details for the hosted interview.