📖 Reference

Gupta, Kishor Datta, Mohd Ariful Haque, Hasmot Ali, Al Amin Hossain, Syed Bahauddin Alam, Afif Hasan, and Mohammad Ashiqur Rahman. Continuous Monitoring of Large-Scale Generative AI via Deterministic Knowledge Graph Structures.arXiv preprint arXiv:2509.03857 (2025).

This work defines Phase 1 of MonitorLLM.

🚀 Overview

MonitorLLM continuously monitors deployed large language models in real time using deterministic knowledge graphs. It tracks:

• Hallucination levels
• Bias indices
• Robustness against adversarial inputs
• Latency and drift metrics

🔹 Phase 1: Knowledge Graph Foundation

Phase 1 establishes deterministic knowledge graph structures for monitoring. Outputs from deployed LLMs are mapped into graphs, compared with baselines, and analyzed using structural metrics (ICR, IPR, CI, SPA, SPI, IMI).

📊 API Workflow

The MonitorLLM API works in two steps:

Step 1: Retrieve Text Section and Prompts

curl --location --globoff 'https://dev.api.monitorllm.com/api/v1/prompt/retrieve?client_type=1&client_version=1' \
--header 'client_type: 1' \
--header 'client_version: 1.0' \
--header 'Origin: http://localhost:3000'

Step 2: Send your LLM answers to our server and get score

curl --location 'https://dev.api.monitorllm.com/api/v1/prompt/report?client_type=1&client_version=1' \
--header 'client_type: 1' \
--header 'client_version: 1.0' \
--header 'Origin: http://localhost:3000' \
--header 'x-api-key: ak_fa7121cf32855c3.....' \
--header 'Content-Type: application/json' \
--data '{
  "prompt_id":"68aa72207a74422655000c24",
  "model_name": "claudeAI",
  "model_version": "claude1.0",
  "model_response": {}
}'

✅ In this workflow, MonitorLLM send prompts , collects responses, and returns monitoring scores.

👥 Contributors

• Dr. Kishor Datta Gupta (Clark Atlanta University)
• Mohd Ariful Haque (Clark Atlanta University)
• Dr. Roy George (Clark Atlanta University)
• Savannah Shanon (Clark Atlanta University)
• Hasmot Ali (Daffodil International University) -Researcher
• Al Amin Hossain (Kabi Nazrul govt. college, Affiliated University of Dhaka) -API Developer
• Afif Hasan (Daffodil International University) -Designer
• Dr. Syed Bahauddin Alam (University of Illinois Urbana-Champaign) — Advisor
• Dr. Mohammad Ashiqur Rahman (Florida International University) — Advisor