Fire crews are working to contain a fast-moving brush fire in Ventura and Los Angeles counties that has led to evacuations on Thursday.