Hornets are looking for three things: a sheltered nesting site, a food source, and access to building materials. Your home's eaves, soffits, and siding offer all three.
They do—and a mouse infestation produces a distinct stale, musky odor that comes from a combination of urine, droppings, and nesting material. The stronger the smell, the more established the population likely is.