Plan or Retrieve First? A Scale Study of Tool Discovery Architectures

Researchers studying tool-augmented large language models have identified limitations in the standard Retrieve-then-Plan approach for selecting APIs from extensive registries. Their analysis suggests that current methods, which prioritize tool retrieval before planning, struggle with the constraints of finite context windows when managing large-scale toolsets.