Free speech means you have the right to say it without being locked up or killed, thats it!
This applys to threats of violence too, your not going to be locked up for threatening violence, you are going to be locked up to prevent you from committing violence, the threat just gives probable cause...