NVIDIA wins KDD Cup 2024 with generative AI skills in online shopping challenges

From NVIDIA: 2024-07-22 18:47:00

Team NVIDIA emerged as the champion at the Amazon KDD Cup 2024, dominating all competition tracks with its generative AI skills. The team, including NVIDIANs Ahmet Erdem, Benedikt Schifferer, Chris Deotte, Gilberto Titericz, Ivan Sorokin, and Simon Jegou, excelled in text generation, multiple-choice questions, name entity recognition, ranking, and retrieval.

The KDD Cup’s theme “Multi-Task Online Shopping Challenge for LLMs” tasked participants with solving diverse challenges using limited datasets. NVIDIA’s innovative approach, which involved generating questions and fine-tuning a language model, surpassed all competitors, showcasing the model’s ability to handle real-world scenarios effectively.

Despite not having access to test questions beforehand, Team NVIDIA utilized the Qwen2-72B LLM with 72 billion parameters and QLoRA technique to fine-tune models, leading to a comprehensive victory in all tracks. The competition focused on mimicking online shopping complexities to improve user experience using large language models.

NVIDIA’s winning solution involved creating a single model for each track, fine-tuning the Qwen2-72B model using eight NVIDIA A100 GPUs, generating training datasets, and employing QLoRA for efficient training. The quantized model, predictably easily on NVIDIA T4 GPUs, secured the team’s first-place finish. Plans include detailing the solution in a paper and presenting findings at KDD 2024 in Barcelona.



Read more at NVIDIA: NVIDIA Team Sweeps KDD Cup 2024 Data Science Competition