GPT

Precursor

1. Proximal Policy Optimization (PPO) - an RL algorithm, PPO is better than state-of-the-art approaches while being much simpler to implement and tune and is the default reinforcement learning algorithm at OpenAI.

2. Learning from human preference (human in the loop) - a method used to infer what humans want by being told which of two proposed behaviors is better.

3. instructGPT - arguably better at following user intentions than GPT-3 while also making them more truthful and less toxic, using human in the loop.

Articles

1. what is chatGPT doing and why does it work? explaining next word prediction in detail.

2. Karpathy on building GPT

3. Is DPO Superior to PPO for LLM Alignment? A Comprehensive Study - "PPO is able to surpass other alignment methods in all cases and achieve state-of-the-art results in challenging code competitions."

Competitions

1. GPT 4 Hackathon code results

2. LangChain Gen Hackathon

Tools

1. Sentence Embeddings

   1. sentence embedding for semantic search

   2. GPT 3 Dense sentence embeddings

Virtual assistants

1. flowGPT - has many bots, prompts.