Alipay-PIBench
Benchmark for testing coding agents on real-world Alipay payment integration scenarios
About
PIBench is a research benchmark from Alipay designed to evaluate coding agents on realistic payment system integration tasks. Features nine Alipay products with repository-level challenges that test agent capabilities on complex, production-grade integration scenarios including API authentication, webhook handling, and multi-service orchestration. Useful for researchers and developers building autonomous coding agents that need to handle real-world financial system integrations.
Details
| Type | |
| Integrations | |
| Language |
Tags
Quick Info
- Organization
- Alipay/Research
- Pricing
- open-source
- Free Tier
- Yes
- Updated
- Jul 19, 2026
Also in Dev Tools
Crawl4AI
Open-source web crawler optimized for LLMs and AI agents — 62K+ stars
Firecrawl
Web scraping API built for LLMs — turn any website into LLM-ready data — 89K+ stars
Headroom Context Optimization
Reduce LLM API costs by 50-90% through advanced context compression