🧾 VoiceBill AI – Voice-Powered Autonomous Invoice Generator

VoiceBill AI is a fully autonomous, intelligent agent that generates professional invoices directly from user voice commands. It uses state-of-the-art audio-language models like Qwen2-Audio-7B-Instruct to interpret voice, extract structured data using Pydantic, cross-check and auto-complete information from a local database, and generates polished PDF invoices using ReportLab — all wrapped in a clean Gradio UI.

🎯 Designed for freelancers, SMBs, and enterprises that need intelligent, conversational billing — fast.

---

🚀 Demo

---

🗣️ Input Audio Samples

Here are the audio inputs that were used for invoice generation:

🔊 John Doe's Invoice Request

Your browser does not support the audio element.

---

🔊 Sarah Miller's Invoice Request

Your browser does not support the audio element.

📊 Results

Here is a sample output invoice generated by VoiceBill AI:

Generated Invoice - Page 1	Generated Invoice - Page 2

🎯 Objective

Enable users to speak naturally about invoice requirements while the AI:

• Understands and parses spoken content
• Auto-fills missing fields from local memory
• Follows up with intelligent prompts if any required field is missing
• Builds and exports a professional PDF invoice
• Works seamlessly via a user-friendly Gradio UI

---

🧠 System Workflow

1. 🎙️ Voice Input:
   User says: "Generate an invoice for Ramesh for 2 iPhones and 1 MacBook."

2. 🧠 AI Model (Qwen2-Audio):
   Extracts structured data like:

   • Client: Ramesh
   • Items: iPhone, MacBook
   • Quantity: 2, 1

3. 📦 Local DB Checks:

   • If Ramesh exists → fetch data
   • If item details missing → asks user
   • Stores/update user/item info in DB

4. ✅ Data Validation:
   Validates structured input using Pydantic

5. 📄 Invoice Generation:
   Generates professional PDF using ReportLab

6. 🌐 UI:
   All happens within an intuitive Gradio interface

---

🛠️ Tech Stack

Function	Tool / Library
Voice-to-Text	Qwen2-Audio-7B-Instruct
Structured Validation	Pydantic
Audio Processing	Librosa
UI Interface	Gradio
PDF Invoice Builder	ReportLab
Runtime	Python 3.10+, Google Colab/GPU

---

📦 Features

✅ AI-powered voice input → invoice
✅ Auto-fill from local user/item DB
✅ Modular, structured data validation
✅ Dynamic follow-up on missing fields
✅ Clean, professional invoice layout (PDF)
✅ Gradio UI for real-time interaction
✅ Supports 8-bit model loading (via bitsandbytes)

---

📁 Folder Structure

    VoiceBill_AI/
    │
    ├── InvoiceGenerator.ipynb     # Main pipeline notebook
    ├── requirements.txt           # Install dependencies
    ├── audio_inputs/              # Uploaded or recorded audio
    ├── generated_invoices/        # Output PDFs saved here
    └── README.md                  # This file

---

⚙️ Setup

✅ In Colab

• Open notebook in Colab
• Ensure GPU is enabled: Runtime > Change Runtime Type > GPU
• Run all cells

✅ Local (Experimental)

$ git clone https://github.com/your-username/VoiceBill_AI.git
$ cd VoiceBill_AI
$ pip install -r requirements.txt
$ python run_app.py  # Optional: if converted to Python script

---

🧩 Missing Data Handling (Agentic)

• User Info Missing? → “Who is the client?”
• Item Info Missing? → “What’s the price for iPhone 15?”
• GST or Address Missing? → Prompt and update DB
• User Updates Info? → Accept and sync to local DB

---

📌 Future Enhancements

• Multi-language support via Whisper or MMS
• Full agent framework with LangChain/Ollama integration
• Database integration (PostgreSQL/SQLite)
• REST API and Streamlit frontend
• Voice-based editing of previous invoices

---

🙌 Credits

Developed by Gyannetra Pvt Ltd ™ Built to simplify billing using cutting-edge AI and local models. Made with 💜 and Python.