What is Negative Sampling in RAG?
Negative sampling is a crucial technique in retriever training, helping models learn to distinguish between relevant and irrelevant documents. There are two key components of RAG: Retriever: Fetches relevant documents or data. Generator: Generates the output using the retrieved information. Negative sampling is a critical technique in training retrievers, particularly dense retrievers like DPR (Dense […]