Skip to content

Latest commit

 

History

165 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

StumbleLele - AI Companion for Brazilian Children 🇧🇷✨

Lele Avatar

Node.js React TypeScript Gemini OpenAI XAI Vercel License

🌟 Overview

StumbleLele is an advanced interactive AI companion designed specifically for Brazilian children aged 8-11, featuring Lele - a friendly 7-year-old virtual friend who speaks Brazilian Portuguese. The application provides culturally relevant entertainment through child-appropriate humor, real-time voice chat, and interactive educational experiences, while maintaining a safe and age-appropriate environment.

🎉 Version 3.2 - Perfected Experience! Now featuring flawless ba-dum-tss sound effects on ALL jokes, completely original joke content without repetitive endings, emoji-free voice narration, and enhanced child-appropriate humor with Brazilian cultural context!

✨ Features

🤖 AI-Powered Interactions

  • Quad AI Support: Choose between Google Gemini 2.5 Flash (default), OpenAI GPT-4, XAI Grok-3, and Anthropic Claude models
  • Gemini Live Voice: Real-time AI voice generation with Leda voice for authentic Brazilian Portuguese female speech
  • Smart Conversations: Lele responds intelligently with contextual awareness and emotional intelligence
  • Contextual Memory: Remembers past conversations and creates meaningful memories
  • Voice Integration: Advanced speech synthesis with Brazilian Portuguese accent and child-like enthusiasm
  • Multi-Modal Interaction: Text, voice input, and AI-generated voice responses

🎮 Complete Game System

  • 5 Interactive Games: Memory matching, word puzzles, math challenges, emotion recognition, and Cosmic Blaster
  • Cosmic Blaster: Space adventure shooter with automatic shooting and drag-to-move controls
  • Adaptive Difficulty: 5 levels per educational game with intelligent progression requirements
  • Real-time Gameplay: Fully interactive games with timers, scoring, and feedback
  • Achievement System: 10+ achievements with feature unlocks and rewards
  • Progress Analytics: Detailed tracking of accuracy, streaks, and improvement over time
  • Mobile-Optimized: Touch-friendly game controls with responsive layouts

🚀 Cosmic Blaster Features

  • Automatic Continuous Shooting: No manual shooting required - players focus purely on movement
  • Drag-to-Move Controls: Touch anywhere on screen and drag to move Lele's ship smoothly
  • 6-Level Weapon Progression: Automatic weapon upgrades through pickup collection
  • Mobile-First Design: One-finger operation optimized for phones and tablets
  • Pickup System: Weapon, health, and shield power-ups with automatic collection
  • Visual & Audio Feedback: Pulsing animations, explosion effects, and dedicated sound effects
  • Wave-Based Enemies: Progressive difficulty with formation-flying space creatures
  • Child-Friendly Theme: Colorful space adventure with Lele as the pilot

🎭 Advanced Avatar System

  • 12 Distinct Emotions: happy, excited, sad, surprised, thinking, playful, loving, calm, encouraging, concentrating, celebrating, sleepy
  • Context-Aware Animations: Different behaviors for conversation, gaming, learning, and idle states
  • Dynamic Visual Changes: Eyes, mouth, gestures, and colors adapt to emotional state
  • Eye Tracking: Avatar follows action during games and learning activities
  • Gesture Recognition: Peace signs, tilting, bouncing based on emotions

🎤 Advanced Voice Features

  • Gemini Live Integration: Real-time AI voice generation with WebSocket streaming
  • Leda Voice: Authentic Brazilian Portuguese female voice with natural intonation
  • Child-Focused Communication: Age-appropriate interactions with simple language and topics
  • Perfected Joke System: AI-powered humor with flawless ba-dum-tss sound effects on ALL jokes
  • Original Content: Each joke is completely unique with creative endings - no repetitive "hihihi" or "hahaha"
  • Emoji-Free Voice: Clean voice narration without reading emoji symbols or descriptions
  • Enhanced Humor Quality: Brazilian cultural context with trocadilhos, wordplay, and clever twists
  • Smart Voice Selection: Prioritizes Brazilian Portuguese female voices with fallback to TTS
  • Multi-Format Audio Support: Handles various audio formats (MP3, WAV, PCM) with automatic detection
  • Real-time Processing: Instant voice recognition and synthesis with comprehensive error handling
  • Voice Personality: Enthusiastic, fluid, and vivid Brazilian Portuguese speech tailored for children

👥 Social Features

  • Virtual Friends: Manage friend lists with online/offline status
  • Memory Album: Store and review special moments with Lele
  • AI Joke Generator: Child-appropriate jokes with real-time voice delivery using Gemini Live
  • Perfected Ba-Dum-Tss Effects: Professional drum roll sound effects after ALL jokes with perfect timing
  • Original Joke Content: Each joke is completely unique with creative Brazilian humor and wordplay
  • Progress Sharing: Compare achievements and levels
  • Interactive Avatar: High-quality cartoon avatar with enhanced animations and expressions
  • Child-Friendly Interactions: Conversations tailored for Brazilian children aged 8-11

📱 Child-Friendly Interface Design

  • Vibrant Visual Design: Colorful gradients, playful animations, and engaging background elements
  • Floating Avatar Companion: Always-visible Lele character that follows and interacts throughout the experience
  • Child-Optimized Typography: Fredoka One headings and Nunito body text for optimal readability
  • Celebration Effects: Sparkle animations, rainbow gradients, and reward visuals for achievements
  • Dynamic Micro-Interactions: Bounce, wiggle, float, and bubble animations that respond to user actions
  • Touch-Friendly Interface: Large buttons with child-friendly styling and intuitive gestures
  • Responsive Design: Optimized for all screen sizes with mobile-first approach
  • Accessibility Features: High contrast support, reduced motion options, and focus indicators

🚀 Quick Start

Prerequisites

  • Node.js v22.14+
  • npm or yarn
  • Google Gemini API key (primary for voice features)
  • OpenAI API key OR XAI API key (or both for dual support)
  • Modern web browser (Chrome, Firefox, Safari, Edge)
  • For mobile testing: iOS 12+ or Android 8+

Installation

  1. Clone the repository

    git clone https://github.com/talktorobson/StumbleLele.git
    cd StumbleLele
  2. Install dependencies

    npm install
  3. Set up environment variables

    # Create .env file
    cp .env.example .env
    
    # Add your AI API keys (at least one required)
    GEMINI_API_KEY=your_gemini_api_key_here
    VITE_GEMINI_API_KEY=your_gemini_api_key_here
    OPENAI_API_KEY=your_openai_api_key_here
    XAI_API_KEY=your_xai_api_key_here
    ANTHROPIC_API_KEY=your_anthropic_api_key_here
    
    # Optional: Add PostgreSQL connection
    DATABASE_URL=postgresql://user:password@host:port/database

    ⚠️ SECURITY NOTE: Never commit your .env file to Git. It contains sensitive API keys.

  4. Start the development server

    npm run dev
  5. Open your browser

    http://localhost:5000
    

🛠️ Technology Stack

Frontend

  • React 18.3 - UI framework
  • TypeScript - Type safety
  • Vite - Build tool
  • TailwindCSS - Responsive styling with mobile-first approach
  • Custom Kids Theme - Specialized CSS animations and child-friendly styling
  • shadcn/ui - Component library with responsive components
  • Framer Motion - Smooth animations optimized for mobile and kid interactions
  • TanStack Query - Data fetching with offline support

Backend

  • Vercel Serverless Functions - Scalable API endpoints
  • TypeScript - Type safety
  • Google Gemini Live - Real-time AI voice generation (primary)
  • OpenAI API - GPT-4 AI responses
  • XAI API - Grok-3 AI responses
  • Anthropic Claude - Additional AI support
  • Drizzle ORM - Database ORM
  • PostgreSQL - Database with Supabase

📁 Project Structure

StumbleLele/
├── client/              # Frontend React application
│   ├── src/
│   │   ├── components/  # React components (mobile-responsive)
│   │   │   ├── games/   # Individual game components (touch-optimized)
│   │   │   │   ├── memory-game.tsx      # Memory matching game
│   │   │   │   ├── words-game.tsx       # Word puzzle game
│   │   │   │   ├── math-game.tsx        # Math challenge game
│   │   │   │   ├── emotion-game.tsx     # Emotion recognition game
│   │   │   │   └── cosmic-blaster-game.tsx # Space adventure shooter
│   │   │   ├── lele-avatar.tsx  # Advanced avatar system
│   │   │   ├── floating-lele.tsx # Always-visible floating companion
│   │   │   ├── voice-input.tsx  # Voice interaction
│   │   │   ├── progress.tsx     # Progress tracking
│   │   │   ├── chat.tsx         # Mobile-optimized chat
│   │   │   ├── friends.tsx      # Touch-friendly friends
│   │   │   └── memories.tsx     # Responsive memory display
│   │   ├── styles/      # Custom CSS themes and animations
│   │   │   └── kids-theme.css   # Kid-friendly animations and styling
│   │   ├── pages/       # Page components (mobile-first)
│   │   ├── hooks/       # Custom React hooks (speech, etc.)
│   │   └── lib/         # Utilities and helpers
│   └── index.html
├── server/              # Backend Express server
│   ├── routes.ts        # API endpoints with progression
│   ├── services/        # Business logic
│   │   ├── openai.ts    # AI service with dual support
│   │   └── progressionService.ts  # Level progression logic
│   ├── storage.ts       # Data persistence
│   └── index.ts         # Server entry point
├── shared/              # Shared types and schemas
└── package.json

🔧 Configuration

Environment Variables

Variable Description Required
GEMINI_API_KEY Google Gemini API key for AI responses Yes (primary)
VITE_GEMINI_API_KEY Google Gemini API key for Live Audio Yes (voice features)
OPENAI_API_KEY OpenAI API key for GPT-4 Yes (or other AI)
XAI_API_KEY XAI API key for Grok-3 Yes (or other AI)
ANTHROPIC_API_KEY Anthropic API key for Claude Yes (or other AI)
DATABASE_URL PostgreSQL connection string No (uses in-memory)
VITE_SUPABASE_URL Supabase project URL No
VITE_SUPABASE_ANON_KEY Supabase anonymous key No
PORT Server port (default: 5000) No

Customization

  • Avatar: Modify client/src/components/lele-avatar.tsx
  • AI Personality: Edit prompts in server/services/openai.ts
  • Colors: Update theme in tailwind.config.ts
  • Games: Add new games in client/src/components/games/
  • Mobile Styles: Customize responsive breakpoints in Tailwind config
  • Touch Interactions: Modify gesture handlers in component files

📱 Usage

For Children (Ages 8-11)

  1. Chat with Lele: Type or speak your message and watch her emotions change
  2. Request Custom Jokes: Get AI-powered jokes tailored for Brazilian children with classic ba-dum-tss effects
  3. Play Educational Games:
    • 🧠 Memory Game: Match card pairs with increasing difficulty
    • 📝 Word Puzzles: Unscramble words and learn new vocabulary
    • 🔢 Math Challenges: Solve arithmetic problems at your level
    • 💝 Emotion Recognition: Learn about feelings through scenarios
    • 🚀 Cosmic Blaster: Pilot Lele's spaceship with drag-to-move controls and automatic shooting
  4. Track Progress: See your levels, achievements, and improvement over time
  5. Make Friends: Add virtual friends to your list
  6. Create Memories: Special moments are saved automatically
  7. Voice Interactions: Experience real-time AI voice with authentic Brazilian Portuguese
  8. Play Anywhere: Full functionality on phones, tablets, and computers

For Parents

  • Monitor conversations through the memory system
  • Track educational progress with detailed analytics
  • Safe, age-appropriate content for children aged 8-11
  • No external communications
  • Educational focus with skill development
  • Achievement system motivates continued learning
  • Mobile-safe design with parental-friendly controls
  • Child-focused content with appropriate humor and topics for ages 8-11

🚧 Roadmap

✅ Recently Completed (v3.1)

  • Child-Focused Experience - Complete transformation for Brazilian children aged 8-11
  • Intelligent Joke System - AI-powered humor with variety and classic ba-dum-tss effects
  • Child-Friendly Interactions - Updated greetings and conversations for children
  • Enhanced Voice Features - Leda voice with child-appropriate communication
  • Smart Joke Generation - Randomized themes including animals, school, family, and nature
  • Audio Effects Integration - Classic ba-dum-tss drum roll sound effects
  • Emoji-Free Voice Synthesis - Clean audio output without emoji descriptions
  • Improved Button State Management - Fixed joke button transitions and processing states

✅ Previous Milestones (v2.9)

  • Gemini Live Voice Integration - Real-time AI voice generation with WebSocket streaming
  • Leda Voice Configuration - Authentic Brazilian Portuguese female voice with natural intonation
  • Enhanced Audio Support - Multi-format audio handling (MP3, WAV, PCM) with automatic detection
  • Comprehensive Security - API key protection, secure environment handling, and GitGuardian integration
  • Avatar System Enhancement - High-quality cartoon avatar with improved animations and expressions
  • Voice Personality Optimization - Enthusiastic, fluid, and vivid Brazilian Portuguese speech
  • Debug UI Management - Clean separation of development tools from production interface
  • Complete game implementations (memory, word, math, emotions, cosmic blaster)
  • Enhanced voice synthesis with 8 emotional variants
  • Advanced avatar system with 12 emotions and animations
  • Quad AI support (Google Gemini + OpenAI GPT-4 + XAI Grok-3 + Anthropic Claude)

In Development

  • Voice Input Enhancement - Improved speech recognition with disconnect handling
  • Advanced Child Topics - Expanded conversation topics relevant to Brazilian children
  • Social Media Integration - Safe sharing of achievements and memories
  • Personalized Learning - AI-driven content adaptation based on user preferences
  • Group Chat Features - Safe multi-user conversations with friends
  • Progressive Web App (PWA) - Offline functionality for core features

Future Features

  • Offline mode with cached responses and local voice synthesis
  • Story mode adventures with child-focused narratives
  • Multiple language support beyond Portuguese
  • Custom avatar designs and personalization options
  • Voice cloning for personalized Lele voice variations
  • AR/VR integration for immersive child experiences
  • Native mobile apps for iOS and Android
  • Study Helper Features - AI-powered homework and study assistance
  • Music Integration - Brazilian music discovery and discussion features

🚀 Deployment

Production Deployment (Vercel + Supabase)

For production deployment, we recommend using Vercel with Supabase:

  1. Set up Supabase Database:

    • Create a new project at supabase.com
    • Get your connection string from Settings > Database
  2. Deploy to Vercel:

    • Import your repository at vercel.com
    • Add environment variables:
      DATABASE_URL=postgresql://postgres:[PASSWORD]@db.[PROJECT_REF].supabase.co:5432/postgres
      GEMINI_API_KEY=your_gemini_api_key_here
      VITE_GEMINI_API_KEY=your_gemini_api_key_here
      OPENAI_API_KEY=your_openai_api_key_here
      XAI_API_KEY=your_xai_api_key_here
      ANTHROPIC_API_KEY=your_anthropic_api_key_here
      NODE_ENV=production
      
  3. Set up Database:

    npm run db:setup

📖 Complete deployment guide: See DEPLOYMENT.md for detailed instructions.

Alternative Platforms

  • Railway: Works with the same configuration
  • Render: Compatible with PostgreSQL addon
  • Heroku: Use Heroku Postgres addon

🔐 Security

API Key Security

  • Never commit .env files to version control
  • Use environment variables for all sensitive data
  • Rotate API keys regularly (every 90 days recommended)
  • Monitor API usage for unauthorized access
  • Use different keys for development/production

Deployment Security

  • Set environment variables in hosting platform (Vercel, Railway, etc.)
  • Enable domain restrictions where possible
  • Set usage quotas to prevent abuse
  • Monitor logs for suspicious activity

Child Safety

  • All AI responses are filtered for age-appropriate content for children aged 8-11
  • No external communications outside the AI providers
  • Secure data storage with encryption
  • No personal information collected or stored
  • Safe interaction environment with content monitoring
  • Appropriate humor and topics for Brazilian children's culture

📋 See SECURITY_GUIDE.md for detailed security practices.

🤝 Contributing

Contributions are welcome! Please feel free to submit a Pull Request.

  1. Fork the repository
  2. Create your feature branch (git checkout -b feature/AmazingFeature)
  3. Commit your changes (git commit -m 'Add some AmazingFeature')
  4. Push to the branch (git push origin feature/AmazingFeature)
  5. Open a Pull Request

📄 License

This project is licensed under the MIT License - see the LICENSE file for details.

🙏 Acknowledgments

  • Google for Gemini Live API and real-time voice generation capabilities
  • OpenAI for GPT-4 API and AI capabilities
  • XAI for Grok-3 API and advanced AI features
  • Anthropic for Claude API and AI assistance
  • Vercel for seamless deployment and serverless functions
  • Supabase for PostgreSQL database and real-time features
  • shadcn/ui for beautiful component library
  • Framer Motion for smooth animations
  • The React and TypeScript communities for amazing tools
  • Inspired by the need for safe, educational AI companions for children worldwide

📞 Contact

Robson Reis - @talktorobson

Project Link: https://github.com/talktorobson/StumbleLele


Made with ❤️ for Brazilian children everywhere

Releases

Packages

Used by

Contributors

Languages