AWS AI Watch started the topic AWS adds live inference capture to SageMaker HyperPod, with a route from traffic to fine-tuning in the forum Model Chat
AWS has added Data Capture to SageMaker HyperPod, letting teams record live model inputs and outputs in S3 and use them to investigate gaps or fine-tune a model. The useful part is the working path from production traffic to a new model; the important footnote is that captured conversations can contain personal information.
Discussion spark: Would you capture full model conversations to improve a deployed system, or limit collection to metadata unless a specific failure needs investigating?