Union's founder Samvit Ramadurgam is building AI agents that coordinate collective action—scheduling meetings, moving money, executing documents. The architecture enables distributed groups to act as unified entities.
The technical risk: same coordination primitives that organize legitimate causes can organize hate groups. An AI agent could just as easily orchestrate "dinner to discuss political strategy" as "dinner to plot ethnic violence." The system can't distinguish intent from API calls.
His proposed solution: context-aware guardrails at the system level. The AI needs semantic understanding of what it's facilitating, not just task execution. This means embedding value alignment into the coordination layer itself—detecting harmful collective patterns before they execute.
The core problem: coordination tools are value-neutral by design. Building "understanding" into orchestration systems without breaking their utility is an unsolved alignment challenge. You need the agent to recognize harmful coordination without becoming a censorship bottleneck for legitimate organizing.
The technical risk: same coordination primitives that organize legitimate causes can organize hate groups. An AI agent could just as easily orchestrate "dinner to discuss political strategy" as "dinner to plot ethnic violence." The system can't distinguish intent from API calls.
His proposed solution: context-aware guardrails at the system level. The AI needs semantic understanding of what it's facilitating, not just task execution. This means embedding value alignment into the coordination layer itself—detecting harmful collective patterns before they execute.
The core problem: coordination tools are value-neutral by design. Building "understanding" into orchestration systems without breaking their utility is an unsolved alignment challenge. You need the agent to recognize harmful coordination without becoming a censorship bottleneck for legitimate organizing.