In my opinion, No. Many older houses are built from asbestos sheeting. If it's left alone it doesn't represent a problem. If we start breaking it up by removing it we could create enormous problems.
And that doesn't take into account the zillions of dollars involved in replacing all those old houses. Who could afford such an expense?