dhir patel
[<] all projects
roboticsfull stackml / ai

integratedflight

2026

a safety-first drone command and mission-control platform that turns plain-english commands into structured flight actions, validates them against mission constraints, and feeds operators back through a live ui and a voice workflow.

drop a integratedflight shot
what it does

an operator says "alpha take off to 10 meters", "fly to the northwest watch tower", or "return to the landing pad and land." the system parses intent with an llm command brain, resolves natural-language locations to canonical waypoints, runs hard safety checks, and returns a validated execution result with confidence and risk context - all reflected in a real-time mission view.

core features
  • natural-language command parsing into structured drone actions.
  • challenge-aware waypoint mapping - "northwest watch tower" resolves to TOWER_NW.
  • hard-block safety enforcement for no-go zones, bad waypoints, and unsafe targets.
  • operator confirm/cancel flow for ambiguous or high-risk commands.
  • session memory + follow-ups ("do that again", "same target").
  • multi-waypoint tasking and telemetry-ready coordinate verification.
safety model

safety is enforced before execution: unknown or invalid waypoints are blocked, no-go-zone incursions are blocked, altitude violations at constrained waypoints are blocked, unsafe targeting is blocked or confirmation-gated, and invalid weaponized intent is hard-rejected.

architecture
  • frontend/ - operator ui: command log, mission status, interaction panels.
  • whisper-backend/ - fastapi stt + command-execution bridge.
  • groq-integration/ - llm parser, validator, and mission command brain.
  • challenge/ + mavsdk sim stack - waypoints, no-go zones, sitl/gazebo context.
what's next
  • full live mission execution against sitl controls, not just validation.
  • a richer planner for multi-drone concurrent tasking.
  • automatic recovery and replanning on verification failure.
  • timeline replay, mission audit reports, and role-based command permissions.
next project
optibox