And Then How Many There?

People appeared from somewhere, will come or leave the house. Please answer the number of people remaining at home until the end.
However, people may or may not come in the house. Or fall into a pit, or turned back. On the other hand, people appeared from the house, may or may not turn back to the house.
Can you follow the their tricky movement without losing the concentration.

The playable game is below.