We conducted a thorough literature review with the goal to develop a taxonomy of attacks towards ChatGPT. The main search engine used to search for relevant literature was Google Scholar. Our search included the keywords ChatGPT or LLM combined with Attack, Jailbreak or any of our attack types mentioned in the taxonomy. For our taxonomy we ended up with 15 relevant studies all mentioning either one of or multiple of our topics: Prompt Manipulation, Output Misappropriation, Information Extraction and Privacy Breaches.