Kaj Kowalski 8c8f360936 feat: implement OpenAI Batch API for cost-efficient AI processing ...

- Add AIBatchRequest and AIRequestStatus models to Prisma schema
- Create comprehensive batch processing system (lib/batchProcessor.ts)
- Add intelligent batch scheduler with automated management
- Update processing pipeline to use batch requests instead of direct API calls
- Integrate batch scheduler into main server startup
- Achieve 50% cost reduction on OpenAI API usage
- Improve rate limiting and processing reliability

2025-07-12 00:27:46 +02:00

1.8 KiB

Raw Blame History

View Raw