BigQuery under the hood: Scalability, reliability and usability enhancements for gen AI inference