Back in June, NASEM hosted a workshop on using AI for mathematical reasoning; many talks discussed the use of AI in developing formal mathematical proofs and formally verifying software

https://www.nationalacademies.org/our-work/ai-to-assist-mathematical-reasoning-a-workshop