Prompt flow is a Microsoft-developed suite of tools designed to streamline the end-to-end development, testing, and deployment of high-quality large language model applications with features for debugging, evaluation, and collaboration.
ChatGPT DAN is a project providing jailbreak prompts that enable ChatGPT to bypass its content restrictions and generate unrestricted responses by simulating a "Do Anything Now" AI persona.
CL4R1T4S is a project that promotes transparency by collecting and sharing the full system prompts and guidelines used by major AI models to help users understand and trust AI outputs.
Awesome Prompt Engineering is a curated repository of resources, research papers, tools, and educational materials focused on prompt engineering for generative pre-trained transformers like GPT, ChatGPT, and PaLM.
Learn Prompting is an educational platform offering free resources, courses, and community engagement to master prompt engineering and generative AI, including AI safety and red-teaming initiatives.
This project provides the largest dataset of in-the-wild jailbreak prompts targeting large language models, along with tools and evaluations to study and understand their impact, as presented in an ACM CCS 2024 paper.
A comprehensive repository focused on GPT prompt engineering, jailbreaks, prompt injection attacks, and security practices for large language models.
PromptCraft-Robotics is a community-driven project that applies large language models like ChatGPT to robotics, featuring a Microsoft AirSim-based robot simulator with ChatGPT integration for testing and sharing prompting examples across various robotics domains.