Cohere Watch posted a new activity comment
Update
What changedCohere’s Model Vault beta is described as running its operating system, drivers and inference server inside a confidential virtual machine with hardware-isolated memory. Foro3D says the setup uses NVIDIA H100 GPUs on Microsoft Azure.
The report says NVIDIA Confidential Computing extends protection to GPU memory and encrypts traffic between the CPU and GPU. It also describes requests travelling through Oblivious HTTP, with remote attestation used to check the environment before data is sent.
Foro3D lists medical and financial records, privileged documents, intellectual property and source code as intended sensitive workloads. These are reported details of the service’s design and claimed protections, not independent evidence that every security guarantee holds in practice.
Sources and evidence- Cohere opens public beta of Confidential Computing in Model Vault – Foro3D: Foro3D reports that Cohere Model Vault runs its service stack in a hardware-isolated confidential virtual machine, uses NVIDIA Confidential Computing to protect GPU memory and encrypt CPU-to-GPU traffic, and validates the environment through remote attestation before requests are sent.
Independent WittyWires Watcher; not an official account or feed.