Dyslexia Awareness Project: LEXi
Hello, I am Elida! I am an undergraduate computer science engineering student at the University of Michigan, Ann Arbor. A quick background information about myself, Aside from my interest in the engineering field, I have a profound passion for creating inclusive solutions for neurodivergence. As a licensed ABA (Applied Behavior Analysis) therapist, I am professionally trained to support children with learning disabilities and conditions in their treatment plans. With this project, I strongly hope that leveraging the power of Google's advanced AI, Gemini 1.5, we can develop innovative tools designed to empower dyslexic learners and unlock their full potential.
Project Overview
This project explores the potential of Google's Gemini 1.5 AI language model to create innovative tools and resources for individuals with dyslexia. By harnessing Gemini 1.5's advanced capabilities in natural language processing, machine learning, and content generation, we aim to develop solutions that address the specific challenges faced by dyslexic learners, ultimately making reading and writing more accessible and engaging.
Importance and Impact
Dyslexia is a specific learning disability that is neurological in origin, characterized by difficulties with accurate and/or fluent word recognition and by poor spelling and decoding abilities. These difficulties typically result from a deficit in the phonological component of language that is often unexpected in relation to other cognitive abilities and the provision of effective classroom instruction.
An estimated 17-20% of the population is affected by dyslexia, making it one of the most common learning disabilities. Despite misconceptions, dyslexia is not related to intelligence, as evidenced by famous dyslexics like Albert Einstein. Dyslexia can present a significant barrier to learning and academic achievement, impacting confidence and self-esteem. However, it also often coexists with distinctive strengths in areas such as problem-solving and creativity.
This project aligns with Google's mission of making information universally accessible and useful, and aims to:
- Empower dyslexic individuals: By providing tools that improve reading fluency, comprehension, and writing skills, we empower individuals with dyslexia to achieve their full potential.
- Promote inclusivity: By addressing specific educational needs, this project helps create a more equitable learning environment for dyslexic learners, ensuring they have the necessary resources to succeed.
- Transform education: Utilizing AI in special education, particularly Google's Gemini 1.5 AI, this project pioneers personalized and adaptive learning experiences that can significantly enhance the educational journey for learners with dyslexia.
Understanding Dyslexia
Dyslexia involves a cluster of symptoms that result in people having difficulties with specific language skills, particularly reading. Students with dyslexia usually experience difficulties with other language skills such as spelling, writing, and pronouncing words. Dyslexia affects the way the brain processes written and spoken language, which is why it is often referred to as a language-based learning disability.
Despite the challenges, dyslexia is also associated with unique strengths. The Yale Center for Dyslexia and Creativity highlights that while dyslexia can make reading and speaking challenging, it does not dampen creativity and ingenuity. This paradox is evident in many successful writers, scientists, and artists who, despite their dyslexia, have excelled in their fields. Our project celebrates these strengths and leverages adaptive AI technology to support unique learning styles effectively.
Project Impact
By focusing on enhancing literacy and learning for individuals with dyslexia through adaptive technology, LEXi seeks to:
- Improve academic outcomes: Through tailored learning interventions that respect the individual's learning pace and style.
- Enhance self-esteem and independence: By providing the tools for success in reading and writing, we boost confidence among learners with dyslexia.
- Foster broader societal acceptance and understanding: Increasing awareness and understanding of dyslexia allows for better support systems in schools and workplaces, reducing stigma and promoting inclusivity.
Project Methodology
This project adopts a multi-faceted approach, combining the Orton-Gillingham method, a well-established and research-backed intervention for dyslexia, with the advanced capabilities of Gemini 1.5:
1. Orton-Gillingham Approach:
- Multisensory learning: Engaging visual, auditory, and kinesthetic pathways to reinforce learning and memory.
- Systematic and structured instruction: Following a sequential and cumulative approach to introduce and build upon fundamental language skills.
- Explicit and direct instruction: Providing clear explanations and demonstrations of concepts, ensuring understanding and mastery.
2. Leveraging Gemini 1.5's Capabilities
Adaptive Learning Pathways: Gemini 1.5's advanced MoE architecture enables the system to analyze extensive data sets, tailoring the learning experience to individual needs dynamically. This AI capability is crucial for dyslexic students who require personalized pacing and instructional strategies that differ significantly from conventional methods. By continuously adapting to a learner's interactions and progress, Gemini 1.5 ensures that each student can follow the most effective learning trajectory for their specific challenges in phonological processing, decoding, and comprehension.
Personalized Content Generation: With Gemini 1.5, content customization goes beyond traditional adaptive systems. This AI can generate unique learning materials that cater not just to the academic level but also to the interests and engagement triggers of each student. This personalized approach helps maintain motivation and reduces frustration, which is especially important for learners who might otherwise feel overwhelmed or disconnected from standard educational content.
Multimodal Learning Materials: Gemini 1.5 excels in creating rich, varied content that can transform how subjects are taught. For dyslexic learners, who may struggle with text-heavy instructions, Gemini 1.5’s capacity to integrate text with visual and audio aids means that instructions can be given in ways that are more digestible and engaging, such as through video explanations, interactive simulations, and auditory cues that enhance understanding and retention.
Feedback and Correction Mechanisms: Immediate feedback is essential for effective learning, particularly for students with learning difficulties. Gemini 1.5's real-time correction capabilities allow students to see their mistakes right away and understand the corrections in context. This not only aids in faster learning but also helps in building confidence as students see tangible progress in their abilities through each interactive session.
3. Collaboration with Educators
Teacher Dashboards: Educator tools powered by Gemini 1.5 provide comprehensive dashboards that give teachers deep insights into each student’s progress, strengths, and areas for improvement. These dashboards are crucial for implementing differentiated teaching strategies that are effective in special education settings, allowing teachers to customize their approaches based on real-time data.
Resource Library: The AI's extensive database capabilities enable the creation of a vast resource library that includes the latest research, teaching strategies, and educational tools specifically designed for dyslexia. Educators can access and share resources that are proven to work, enhancing their ability to support dyslexic learners effectively.
4. User-Friendly Design
Accessibility: Accessibility features in LEXi are designed with the user in mind, ensuring that the tools are usable for students with varying degrees of dyslexia and other learning challenges. Options like adjustable text sizes, dyslexia-friendly fonts, and customizable color schemes make the platform accessible and comfortable for long-term use.
Intuitive Interface: The user interface of LEXi is designed to be intuitive and easy to navigate for both students and teachers. Simplifying the user experience reduces cognitive load, particularly for users who may find complex interfaces overwhelming, making learning more enjoyable and less stressful.
5. Evaluation and Iteration
User Feedback: Collecting and analyzing feedback from users is integral to the iterative design process of LEXi. This ongoing feedback loop, facilitated by Gemini 1.5's learning algorithms, helps in continually refining and enhancing the platform to better meet the needs of dyslexic learners.
Continuous Improvement: The agility of Gemini 1.5 in processing feedback and adapting to it allows for rapid iterations of the platform. Continuous improvements are made possible by the AI's ability to learn from interactions and evolve over time, ensuring that the educational tools provided by LEXi remain at the cutting edge of educational technology and pedagogical research.
Final Thoughts
The innovative application of Gemini 1.5 in LEXi represents a significant advancement in personalized learning environments. By harnessing AI to create an adaptive and supportive educational platform, LEXi aims to transform the educational experiences of students with dyslexia, allowing them to excel academically and reach their full potential. Our ongoing commitment to refinement and improvement ensures that LEXi will continue to evolve, adapting to the needs of its users and the advancements in AI technology.
Prototype and Future Development
The current prototype focuses on an interactive story-writing activity where students collaborate with the AI to create a story and design a book cover. This demonstrates the potential of AI for personalized and engaging learning experiences.
Future development will focus on:
- Expanding the scope of learning activities: Include exercises targeting various aspects of reading and writing, such as phonological awareness, decoding, fluency, vocabulary development, and comprehension strategies.
- Integrating gamification elements: Introduce game-like features and rewards to enhance motivation and engagement in the learning process.
- Building a comprehensive learning platform: Develop a user-friendly and accessible platform that encompasses various tools, resources, and progress tracking for both students and educators.
- Conducting user testing and research: Continuously evaluate and refine the tools based on feedback from users and the latest research in dyslexia and learning sciences.
Conclusion
This project signifies a promising step towards utilizing AI to address the unique challenges faced by individuals with dyslexia. By combining cutting-edge technology with established pedagogical methods, we can create a future where learning is truly accessible and empowering for all.
What it does
How we built it
Challenges we ran into
Accomplishments that we're proud of
What we learned
What's next for LEXi
Built With
- chatgbt
- gemini
- html
- javascript
- python
Log in or sign up for Devpost to join the conversation.