Data needed for inference for the work titled "Flow-Based Fragment Identification via Contrastive Learning of Binding Site-Specific Latent Representations". Tables with structures used for training, validation and testing are also shared.