MakerDost: An LLM-based WhatsApp Chatbot for Hands-on STEAM Education

What makes your solution innovative?

MakerGhat stands out in the landscape of educational solutions by focusing on a scalable and affordable model for hands-on making that empowers youth and teachers, through both offline and digital components. We have developed a uniquely contextualized curriculum, rigorous training, and Monitoring and Evaluation (M&E) framework that elevates the quality and impact of our educational interventions. 

We see ourselves as complementary to other organizations like Udhyam, Reap Benefit, Learning Links Foundation, and Pi-Jam Foundation who are working on youth agency, entrepreneurship, and STEM education. We plan to make our technology solution, MakerDost, widely available to the sector to catalyze education quality. Below we also highlight our key differentiating factors.

Innovative Curriculum Development:
Our curriculum is meticulously designed to foster learning and practical application of STEAM concepts, which is crucial for nurturing problem-solving skills and entrepreneurial thinking. The curriculum is continuously refined and updated based on real-time feedback from our extensive network of trained educators and feedback analysis from our M&E systems. This dynamic approach ensures that our educational content remains relevant, practical, and highly effective in equipping students with the skills needed in a rapidly evolving job market.

High-Quality Teacher Training:
What further sets MakerGhat apart is the exceptional depth of our teacher training programs. Recognizing that teachers are the primary facilitators of learning, we invest significantly in comprehensive training programs that cover not only educational content but also pedagogical techniques focused on engagement and innovation. Our training goes beyond imparting knowledge and empowering teachers to become facilitators of change themselves, which enhances the learning experience and outcomes for students.

Robust Monitoring and Evaluation Framework:
Our M&E framework is another cornerstone of our innovation. Unlike traditional models, our framework utilizes advanced data analytics to track and assess the effectiveness of our programs in real time. This allows for rapid iteration and customization of our solutions to meet the specific needs and challenges of different student groups. The data collected is not only used to improve our programs but also shared with stakeholders to maintain transparency and drive continuous improvement across the board.

The successful scaling of our model could redefine the market for educational content and delivery, setting new standards for what effective learning looks like. As more educational stakeholders recognize the value of our approach, it could drive widespread adoption, fundamentally changing the landscape of education by prioritizing skills development and entrepreneurial thinking from an early age.

Describe in simple terms how and why you expect your solution to have an impact on the problem.

INPUTS - Our solution incorporates several critical inputs designed to enhance the educational experience and prepare youth for future challenges:

• Teacher Training: Intensive programs to equip teachers with innovative teaching techniques and STEAM knowledge.
• MakerKits and STEM Labs: Tools and spaces provided to facilitate practical and hands-on learning.
• Customized Curriculum: Tailored educational content that aligns with both local needs and global standards.
• Classroom Observations and Feedback Loops: Systematic monitoring to continuously improve teaching practices and student engagement.
• WhatsApp Chatbot Implementation: A technology tool to streamline the feedback process, track student progress, and facilitate communication.

OUTPUTS - These inputs lead to tangible outputs that immediately enhance the educational environment:

• Enhanced Teacher Capabilities: Teachers become proficient in new, engaging teaching methods.
• Community of Educators: Development of a supportive network sharing practices and improvements.
• Tracking of Foundational Skill Development: Using the WhatsApp Chatbot and other tech tools to monitor and evaluate student progress in real-time.

OUTCOMES - The direct result of these outputs are significant outcomes impacting students’ abilities:

• Enhanced 21st Century Skills: Students exhibit measurable improvements in critical thinking, problem-solving, self-efficacy, and communication and collaboration skills.

IMPACT - The long-term impact of these outcomes is profound, affecting both individual lives and the broader community:

• Career Readiness: Youth are better prepared as skilled job seekers and potential entrepreneurs, equipped with necessary skills to thrive in a competitive job market.
• Personal Development: Students develop important personal attributes such as self-confidence and empathy, contributing to their overall emotional and social well-being.

EVIDENCE - Our theory of change is supported by evidence from several sources:

• Third-party Research: Studies showing the effectiveness of hands-on STEAM education in improving learning outcomes.
• Impact Evaluations: Data collected from our programs indicate significant improvements in student engagement and skills development.
• Feedback from Stakeholders: Continuous input from teachers, students, and community leaders help refine our approach and confirm its effectiveness.

By employing this structured approach, MakerGhat ensures that each step, from input to impact, is carefully planned and executed, leading to meaningful and sustainable changes in the lives of the youth we serve.

What are your impact goals for your solution and how are you measuring your progress towards them?

For the chatbot in particular, we will focus on metrics in three areas:
1. Enrollment + Usage data: We will capture the number of teachers and youth accessing the bot, the average number of messages per user, and the topics accessed. We will also record how many have completed certification, and the average time to complete it.
2. Learning Outcomes: We will conduct a comparative assessment with students and teachers who have and have not used the bot, through a survey.
3. Attitudes and Workforce-Readiness: Finally, the same survey will also capture student and teacher attitudes towards STEM, career choices, and self-efficacy towards using technology. 

Apart from the indicators stated above, MakerGhat will assess the development of the 4 key foundational skills (critical thinking, problem-solving, communication, and collaboration) with qualitative data through classroom observations and interviews (noting youth’s level of interaction, enthusiasm, questions asked, kind of interactions observed with their educator, etc), and baseline/endline skill surveys.

Our impact goals are closely tied to UN SDGs 4 and 8. We have detailed these below.

Target 4.3: By 2030, ensure equal access for all women and men to affordable and quality technical, vocational and tertiary education, including university

• Indicator: 4.3.1: We will record the participation rate of youth in formal and non-formal education and training post our programs, by gender.

Target 4.4: By 2030, substantially increase the number of youth and adults who have relevant skills, including technical and vocational skills, for employment, decent jobs and entrepreneurship

• Indicator: 4.4.1: Our pre/post program surveys will indicate the proportion of youth with key employability skills

Target 4.5: By 2030, eliminate gender disparities in education and ensure equal access to all levels of education and vocational training for the vulnerable, including persons with disabilities, indigenous peoples and children in vulnerable situations

• Indicator 4.5.1: We will capture demographic factors including gender, rural/urban, financial status and disaggregate for all education indicators

Target 4.7: By 2030, ensure that all learners acquire the knowledge and skills needed to promote sustainable development, including, among others, through education for sustainable development and sustainable lifestyles, human rights, gender equality, promotion of a culture of peace and non-violence, global citizenship and appreciation of cultural diversity and of culture’s contribution to sustainable development

• Indicator 4.7.1: We will measure the participation rate and effectiveness of teacher  training, and undertake student assessments

Target 8.6: By 2020, substantially reduce the proportion of youth not in employment, education or training

• Indicator 8.6.1: We will note the post-program choices of youth, and whether they are in education, employment, or training

Describe the core technology that powers your solution.

At the heart of MakerGhat’s innovative educational approach is our advanced technology solution, MakerDost: a WhatsApp chatbot powered by Large Language Models (LLMs). This chatbot is designed to facilitate seamless interaction in multiple Indian vernacular languages, making it accessible and user-friendly for a diverse user base, including students, teachers, and government officials.

Core Technology Components:

• Large Language Models (LLMs): Our chatbot utilizes state-of-the-art LLMs to understand and process natural language inputs. This enables it to handle complex conversations and provide relevant, context-aware responses, significantly enhancing the user experience and engagement.

• Conversation Flows: The chatbot is programmed with sophisticated conversation flows that guide users through various interactions, whether it's gathering feedback, monitoring progress, or providing information on STEAM concepts. These flows are meticulously designed to ensure that the chatbot can handle a wide range of queries and maintain productive dialogues.

• Webhooks and Integration: A crucial aspect of our technology is the use of webhooks to integrate the chatbot with other applications and systems. This allows for real-time data transfer between platforms, facilitating the aggregation and visualization of data on custom dashboards. These dashboards are instrumental in developing comprehensive reports on program progress and skill development, which can be easily accessed and utilized by educators and program administrators.

• Real-Time Feedback Collection: The WhatsApp chatbot is instrumental in collecting real-time feedback from users, enabling ongoing monitoring and evaluation of our educational programs. This feedback is critical for assessing the effectiveness of our teaching methodologies and curriculum, allowing for rapid iterations and improvements.

• Program Monitoring and Evaluation: Beyond feedback collection, the chatbot also plays a key role in the systematic monitoring and evaluation of the program. By processing data collected via interactions with users, the chatbot helps identify trends, issues, and successes in the program, providing a robust basis for informed decision-making and strategic planning.

Below, we have provided examples of some of the key features of the bot for teachers.

Which of the following categories best describes your solution?

A new application of an existing technology

Please select the technologies currently used in your solution:

• Artificial Intelligence / Machine Learning
• Software and Mobile Applications

In which countries do you currently operate?

• India

How many people work on your solution team?

Our solution team at MakerGhat consists of 15 full-time staff members who are dedicated to program development, implementation, and evaluation. Additionally, we have 10 part-time staff who support various aspects of our projects, including designing, communications and community outreach, and administrative tasks. Together, this team ensures the effective delivery of our educational initiatives to the communities we serve.

How long have you been working on your solution?

MakerGhat has been working on our educational solution for five years. During this period, we have developed and refined our methods and programs to effectively meet the needs of the communities we serve.

Additionally, we have been focused on integrating technology into our solution for the past year, enhancing our educational delivery through tools like our WhatsApp chatbot, which supports interactive learning and efficient communication between teachers and our team.

Tell us about how you ensure that your team is diverse, minimizes barriers to opportunity for staff, and provides a welcoming and inclusive environment for all team members.

PROGRAM EQUITY: Across programs, we have a special focus on women/girls, and youth from rural, lower caste, and tribal communities that have historically lacked access to dignified work. 

LEADERSHIP: Our team is led by Dr. Azra Ismail, an expert on human-centered design, gender equity, and global development with respect to digital technology. She drives the equity efforts across the organization. 

TEAM DIVERSITY: Our team consciously reflects the backgrounds and geographies that program participants are from. At MakerGhat, we are committed to fostering a workplace that not only embraces diversity but also actively promotes equity and inclusion. Our hiring policy is open and inclusive, ensuring that we recruit talent from a broad spectrum of social, cultural, and identity-based backgrounds. This diversity is evident in our team, which includes members from various religions and gender identities, reflecting the diverse communities we serve.

DEI TRAINING: Our commitment to inclusion is supported by our workplace culture, where every employee is welcomed, respected, supported, and valued. We encourage open dialogue and the sharing of diverse perspectives, which enrich our operations and the solutions we develop. Regular training sessions on diversity, equity, and inclusion are held to educate our team and ensure that these principles are woven into the fabric of our daily operations.

RETENTION: To provide equitable access to opportunity and advancement, we have implemented several practices aimed at minimizing barriers and supporting all staff members. We recognize that systemic and unique barriers can hinder the participation and advancement of groups. In response, MakerGhat ensures that every team member has the resources and support they need to succeed, both professionally and personally. This includes offering flexible working arrangements and providing socio-emotional support to those who may face personal challenges. By doing so, we create an environment where team members have the space and time to recuperate and achieve their targets without compromising their well-being.

What is your business model?

MakerGhat is incorporated as a 501c3 nonprofit company in the US, and a nonprofit Section 8 company in India.

Key Resources:
MakerGhat operates with a dedicated team of 15 members, soon expanding to 25, to support our growing initiatives. Our programmatic expenses are approximately USD 240,000 annually, covering the development and deployment of educational technology and other resources necessary for effective program delivery.

Partners and Key Stakeholders:
Our key stakeholders include youth aged 12-25, teachers, school principals, local educational authorities, and the parents of our beneficiaries. We establish robust partnerships with these stakeholders, focusing on knowledge sharing and alignment with educational goals. Our collaborations extend to government ecosystems, particularly with Block and District Education Officers, enhancing our reach and impact.

Key Activities:
Our activities center on building partnerships with government entities, training teachers in innovative, hands-on STEAM education methods, and conducting frequent classroom observations. Feedback loops from teachers help us refine our approach continuously. Monitoring and evaluating the learning progress and skills development of youth are also critical components of our operations.

Type of Intervention: 
MakerGhat employs multiple intervention methods:

• Building relationships with governmental and educational institutions.
• Conducting bi-annual training workshops for teachers.
• Engaging directly with youth through mentorship.
• Using digital tools like a WhatsApp chatbot to facilitate monitoring, evaluation, and skill development.

Channels:
We engage our target beneficiaries—youth and teachers—through direct on-ground interactions and workshops. Additionally, we utilize digital channels, such as WhatsApp, to maintain ongoing communication and support with our community of beneficiaries.

Beneficiary Segments:
Our primary beneficiaries are youth aged 12-25 and teachers in government schools. As an NGO, we do not have traditional customers, but our value delivery is focused on these groups.

Value Propositions:
MakerGhat empowers youth to adapt to and thrive in a dynamic job market. By equipping them with necessary skills, we enable them to secure meaningful employment, sustain their jobs, and potentially become entrepreneurs. The impact of our initiatives is regularly communicated to government officials and funders through quarterly updates.

Cost Structure:
The most significant expenses for MakerGhat include the costs associated with developing educational kits, setting up STEAM labs for tinkering, and maintaining our WhatsApp Chatbot for effective program monitoring and evaluation.

Revenue Streams:
Our funding comes from various sources including grants, accelerator programs, government support, corporate social responsibility (CSR) funds, and donations. This diverse funding base supports the sustainability and expansion of our programs.

Do you primarily provide products or services directly to individuals, to other organizations, or to the government?

What is your plan for becoming financially sustainable, and what evidence can you provide that this plan has been successful so far?

MakerGhat's financial sustainability strategy is built on a diversified funding model, which includes grants, corporate social responsibility (CSR) funds, high-net-worth individual (HNI) donations, and the development of a reserve corpus. This multi-faceted approach ensures a stable and scalable financial foundation for our technology development, program implementation, and long-term operational needs.

Initial Development and Funding:
Initially, our technology and program development are financed through grants from various foundations. These grants are crucial for covering upfront costs associated with research, development, and initial deployment of our educational solutions. To date, we have successfully secured multiple grants that validate our concept and provide the necessary capital to launch our initiatives.

Sustaining Operations:
For ongoing operations and maintenance, MakerGhat relies on CSR funds from multinational corporations (MNCs). These funds are specifically allocated to sustain the implemented technology as part of our educational programs. Each project is paired with a CSR funder, whose contributions are directly tied to the project’s operational needs. This targeted funding strategy ensures that each initiative is financially supported in alignment with its specific requirements and outcomes.

Building a Financial Reserve:
In addition to project-specific funding, MakerGhat has established a corpus fund designed to absorb emergency expenses and ensure financial stability in unforeseen circumstances. This reserve is built through continuous contributions from our revenue streams and is a critical component of our long-term financial health.

Successes and Evidence of Financial Viability:
Our financial strategies have proven effective so far. For example, the initial phase of our technology rollout was funded by donations from a group of high-net-worth individuals (HNIs), whose support was instrumental in getting our projects off the ground. Their backing not only provided the necessary financial resources but also demonstrated confidence in the potential of our solution.