SydeLabs (acquired by Protect AI) reposted this
A common question that comes up when speaking to customers of SydeLabs is around the latency impact of having an AI firewall. Our team has made some great optimisations recently which has allowed us to hit amazing inference times without impacting accuracy. In fact we also beat all other firewalls we evaluated on accuracy (I will post about that soon). For this particular dataset our accuracy was 21% higher than Microsoft Azure's Prompt Shield while beating on all performance metrics.
