🧾 VoiceBill AI – Voice-Powered Autonomous Invoice Generator

VoiceBill AI is a fully autonomous, intelligent agent that generates professional invoices directly from user voice commands. It uses state-of-the-art audio-language models like Qwen2-Audio-7B-Instruct to interpret voice, extract structured data using Pydantic, cross-check and auto-complete information from a local database, and generates polished PDF invoices using ReportLab — all wrapped in a clean Gradio UI.

🎯 Designed for freelancers, SMBs, and enterprises that need intelligent, conversational billing — fast.

🚀 Demo

📊 Results

Here is a sample output invoice generated by VoiceBill AI:

🎯 Objective

Enable users to speak naturally about invoice requirements while the AI:

Understands and parses spoken content
Auto-fills missing fields from local memory
Follows up with intelligent prompts if any required field is missing
Builds and exports a professional PDF invoice
Works seamlessly via a user-friendly Gradio UI

🧠 System Workflow

🎙️ Voice Input:
User says: "Generate an invoice for Ramesh for 2 iPhones and 1 MacBook."
🧠 AI Model (Qwen2-Audio):
Extracts structured data like:
- Client: Ramesh
- Items: iPhone, MacBook
- Quantity: 2, 1
📦 Local DB Checks:
- If Ramesh exists → fetch data
- If item details missing → asks user
- Stores/update user/item info in DB
✅ Data Validation:
Validates structured input using Pydantic
📄 Invoice Generation:
Generates professional PDF using ReportLab
🌐 UI:
All happens within an intuitive Gradio interface

🛠️ Tech Stack

Function	Tool / Library
Voice-to-Text	Qwen2-Audio-7B-Instruct
Structured Validation	Pydantic
Audio Processing	Librosa
UI Interface	Gradio
PDF Invoice Builder	ReportLab
Runtime	Python 3.10+, Google Colab/GPU

📦 Features

✅ AI-powered voice input → invoice
✅ Auto-fill from local user/item DB
✅ Modular, structured data validation
✅ Dynamic follow-up on missing fields
✅ Clean, professional invoice layout (PDF)
✅ Gradio UI for real-time interaction
✅ Supports 8-bit model loading (via bitsandbytes)

📁 Folder Structure

    VoiceBill_AI/
    │
    ├── InvoiceGenerator.ipynb     # Main pipeline notebook
    ├── requirements.txt           # Install dependencies
    ├── audio_inputs/              # Uploaded or recorded audio
    ├── generated_invoices/        # Output PDFs saved here
    └── README.md                  # This file

⚙️ Setup

✅ In Colab

Open notebook in Colab
Ensure GPU is enabled: Runtime > Change Runtime Type > GPU
Run all cells

✅ Local (Experimental)

$ git clone https://github.com/your-username/VoiceBill_AI.git
$ cd VoiceBill_AI
$ pip install -r requirements.txt
$ python run_app.py  # Optional: if converted to Python script

🧩 Missing Data Handling (Agentic)

User Info Missing? → “Who is the client?”
Item Info Missing? → “What’s the price for iPhone 15?”
GST or Address Missing? → Prompt and update DB
User Updates Info? → Accept and sync to local DB

📌 Future Enhancements

Multi-language support via Whisper or MMS
Full agent framework with LangChain/Ollama integration
Database integration (PostgreSQL/SQLite)
REST API and Streamlit frontend
Voice-based editing of previous invoices

🙌 Credits

Developed by Gyannetra Pvt Ltd ™ Built to simplify billing using cutting-edge AI and local models. Made with 💜 and Python.

4.6 KiB Raw Blame History Unescape Escape